#PAGE_PARAMS# #ADS_HEAD_SCRIPTS# #MICRODATA#

Colorectal Cancer Screening for Average-Risk North Americans: An Economic Evaluation


Background:
Colorectal cancer (CRC) fulfills the World Health Organization criteria for mass screening, but screening uptake is low in most countries. CRC screening is resource intensive, and it is unclear if an optimal strategy exists. The objective of this study was to perform an economic evaluation of CRC screening in average risk North American individuals considering all relevant screening modalities and current CRC treatment costs.

Methods and Findings:
An incremental cost-utility analysis using a Markov model was performed comparing guaiac-based fecal occult blood test (FOBT) or fecal immunochemical test (FIT) annually, fecal DNA every 3 years, flexible sigmoidoscopy or computed tomographic colonography every 5 years, and colonoscopy every 10 years. All strategies were also compared to a no screening natural history arm. Given that different FIT assays and collection methods have been previously tested, three distinct FIT testing strategies were considered, on the basis of studies that have reported “low,” “mid,” and “high” test performance characteristics for detecting adenomas and CRC. Adenoma and CRC prevalence rates were based on a recent systematic review whereas screening adherence, test performance, and CRC treatment costs were based on publicly available data. The outcome measures included lifetime costs, number of cancers, cancer-related deaths, quality-adjusted life-years gained, and incremental cost-utility ratios. Sensitivity and scenario analyses were performed. Annual FIT, assuming mid-range testing characteristics, was more effective and less costly compared to all strategies (including no screening) except FIT-high. Among the lifetimes of 100,000 average-risk patients, the number of cancers could be reduced from 4,857 to 1,782 and the number of CRC deaths from 1,393 to 457, while saving CAN$68 per person. Although screening patients with FIT became more expensive than a strategy of no screening when the test performance of FIT was reduced, or the cost of managing CRC was lowered (e.g., for jurisdictions that do not fund expensive biologic chemotherapeutic regimens), CRC screening with FIT remained economically attractive.

Conclusions:
CRC screening with FIT reduces the risk of CRC and CRC-related deaths, and lowers health care costs in comparison to no screening and to other existing screening strategies. Health policy decision makers should consider prioritizing funding for CRC screening using FIT.

: Please see later in the article for the Editors' Summary


Published in the journal: . PLoS Med 7(11): e32767. doi:10.1371/journal.pmed.1000370
Category: Research Article
doi: https://doi.org/10.1371/journal.pmed.1000370

Summary

Background:
Colorectal cancer (CRC) fulfills the World Health Organization criteria for mass screening, but screening uptake is low in most countries. CRC screening is resource intensive, and it is unclear if an optimal strategy exists. The objective of this study was to perform an economic evaluation of CRC screening in average risk North American individuals considering all relevant screening modalities and current CRC treatment costs.

Methods and Findings:
An incremental cost-utility analysis using a Markov model was performed comparing guaiac-based fecal occult blood test (FOBT) or fecal immunochemical test (FIT) annually, fecal DNA every 3 years, flexible sigmoidoscopy or computed tomographic colonography every 5 years, and colonoscopy every 10 years. All strategies were also compared to a no screening natural history arm. Given that different FIT assays and collection methods have been previously tested, three distinct FIT testing strategies were considered, on the basis of studies that have reported “low,” “mid,” and “high” test performance characteristics for detecting adenomas and CRC. Adenoma and CRC prevalence rates were based on a recent systematic review whereas screening adherence, test performance, and CRC treatment costs were based on publicly available data. The outcome measures included lifetime costs, number of cancers, cancer-related deaths, quality-adjusted life-years gained, and incremental cost-utility ratios. Sensitivity and scenario analyses were performed. Annual FIT, assuming mid-range testing characteristics, was more effective and less costly compared to all strategies (including no screening) except FIT-high. Among the lifetimes of 100,000 average-risk patients, the number of cancers could be reduced from 4,857 to 1,782 and the number of CRC deaths from 1,393 to 457, while saving CAN$68 per person. Although screening patients with FIT became more expensive than a strategy of no screening when the test performance of FIT was reduced, or the cost of managing CRC was lowered (e.g., for jurisdictions that do not fund expensive biologic chemotherapeutic regimens), CRC screening with FIT remained economically attractive.

Conclusions:
CRC screening with FIT reduces the risk of CRC and CRC-related deaths, and lowers health care costs in comparison to no screening and to other existing screening strategies. Health policy decision makers should consider prioritizing funding for CRC screening using FIT.

: Please see later in the article for the Editors' Summary

Introduction

As the fourth most common cancer and second-leading cause of cancer death among men and women [1], colorectal cancer (CRC) is an important health issue. CRC fulfills the World Health Organization (WHO) criteria for mass screening [2], and existing clinical practice guidelines recommend that average risk individuals begin screening at age 50 [3][6]. A variety of CRC screening modalities are available, including stool-based tests and radiological and endoscopic examinations of the colon. Colonoscopy has high sensitivity for identifying adenomas and cancer and permits the removal of polyps during a screening examination [7]. However, the risk of complications (including bleeding, perforation, and death) and barriers to access including limited availability and high patient-borne costs [8] diminish its appeal. The guaiac-based fecal occult blood tests (FOBTs) have been shown in randomized controlled trials (RCTs) to reduce CRC mortality [9][11]. However, FOBT has low sensitivity for identifying colorectal neoplasia, in particular adenomas. The fecal immunochemical tests (FITs) have improved test performance characteristics [12] and potential to improve participation rates compared to FOBT and flexible sigmoidoscopy [13]. A third type of stool test, based on the detection of DNA shed by neoplastic tissue (fecal DNA) is also available [14],[15]. Lastly, computed tomographic colonography (CTC) or “virtual” colonoscopy is a promising new modality [6]. Although recent studies [16][18] have shown CTC to rival colonoscopy in detecting advanced adenomas and CRC, CTC is expensive, requires a full colonic preparation, and the available cost-effectiveness data have been contradictory [19][21].

In light of the rapidly rising costs of chemotherapy for CRC [22], and evidence that CRC mortality can be reduced by screening [9][11], population-based screening programs for average risk individuals are being considered in several countries. In the absence of firm comparative evidence to guide the selection of any one modality, the practice in some jurisdictions has been to recommend choice among the available screening options [3][5]. However, some countries do not support population-based CRC screening and many with organized programs do not offer choice [23]. Given the varied test performance characteristics and the significant differences in costs and resources associated with each, health care decision makers should consider the results of cost-effectiveness analyses when deciding whether or not to offer screening and in selecting the most appropriate screening modality.

There have been several previous economic analyses of CRC screening [24], though recent studies have failed to consider all potentially relevant strategies including CTC [25],[26] and FIT [27]. Furthermore, a wide range of FIT test performance has been reported, the impact of which requires further exploration in cost-effectiveness analyses. Finally, many studies have not considered current CRC treatment costs, nor the different nonmedical costs between CRC screening strategies, both of which may be important. Given these limitations, we performed a full economic evaluation of all relevant CRC screening modalities in North America, and present our results in a transparent fashion to assist medical decision makers.

Methods

Overview

An incremental cost-utility analysis was performed comparing the following CRC screening modalities: guaiac-based FOBT, FIT, fecal DNA, colonoscopy, flexible sigmoidoscopy, and CTC. These modalities were compared to each other and to a no screening natural history arm among average-risk individuals, aged 50 to 75 y. Two average-risk age-stratified patient cohorts were simultaneously modelled: people aged 50–64 and 65–75. In the base case, screening was assumed to continue from age 50–75, but the analysis continued over the lifetime of the cohorts. Average risk was defined as asymptomatic individuals with no personal or family history of CRC or adenomatous polyps and no history of preexisting medical conditions known to increase the risk of CRC (e.g., inflammatory bowel disease).

Although we acknowledge that many jurisdictions are already committed to CRC screening, we included a no screening strategy given that, despite widespread screening recommendations, the majority of individuals are not being screened [28]. In the base case analysis, costs were those relevant to a publicly funded health care system and included patient time and travel costs in keeping with recent guidelines [29]. Consistent with contemporary guidelines and the perspective of the publicly funded health care system, costs resulting from lost productivity were not considered [29]. Given the impact of CRC on both quantity and quality of life, health benefits were measured in quality-adjusted life-years (QALYs) gained over a lifetime horizon. Future costs and benefits were discounted at 5% annually [29]. Base case analyses were performed using Markov cohort simulation; second order probabilistic sensitivity analysis was used to derive 95% confidence intervals around mean costs and QALYs, and for probabilistic sensitivity analysis (see below). First order Monte Carlo simulation was used to estimate CRC incidence and death rates and the number of primary screening tests and colonoscopies required. Incremental analyses (expressed as the cost per QALY gained) were performed by rank ordering all competing strategies by increasing cost after eliminating strategies that were more costly and less effective (i.e., dominated).

Model Validation

Consistent with guidelines for good modeling in health care [30], the validity of our model was formally established including extensive “debugging” exercises and calibration to published clinical datasets [9][11]. Gastroenterologists, including two of the authors (SJH and RJH), carefully reviewed the structure and flow of the model. The model was also reviewed by Alaa Rostom, Gastroenterologist and Medical Director at the Forzani and MacPhail Colon Cancer Screening Centre in Calgary, Alberta. Ultimately, it was determined that the model had good face validity. After ensuring that there were no syntactical errors, we first calibrated the model's no screening arm against the no screening control arms of the landmark FOBT RCTs [9][11]. For this we used baseline adenoma and CRC prevalence rates from a contemporary meta-analysis [31] and ensured that the number of cancers and cancer deaths generated by our model closely approximated the control arms of the clinical trials over an identical follow-up period. We next ensured that the number of cancers and cancer deaths predicted by the FOBT screening arms closely approximated those noted within the FOBT arms of the FOBT RCTs. All of the other strategies were validated in a similar fashion assuring face validity and calibration. Finally, we also compared our CRC and CRC death rate with those generated by another validated decision analytical model, noting near perfect correlation [32].

Computer Simulation Model

The Markov model was constructed using decision analysis software (TreeAge Pro Suite 2007). It was assumed that all CRCs arise through the following sequence: normal colon → nonadvanced adenoma → advanced adenoma → CRC. Nonadvanced adenomas were defined as tubular adenomas <10 mm in size. Advanced adenomas comprised any adenoma ≥10 mm regardless of histology, and adenomas <10 mm containing at least 25% villous component and/or high grade dysplasia. We considered several general health states, including (1) alive with no prevalent or prior history of adenomas or CRC, (2) alive with a missed adenoma, (3) alive with a missed asymptomatic CRC, (4) alive with a missed CRC after presenting with symptoms, (5) alive with a CRC found by screening, (6) alive post polypectomy, and (7) dead. Each year (1-y cycle length), individuals with or without adenomas or CRC could either remain in the same health state, progress to another health state, or die (Figure 1).

Fig. 1. Model bubble diagram.
Model bubble diagram.
This diagram depicts the general health states and flow through the model.

In the base case, screening was offered annually for FOBT and FIT, every 3 y for fecal DNA, every 5 y for flexible sigmoidoscopy and CTC, and every 10 y for colonoscopy. Once a patient was diagnosed with either an adenoma or CRC, the model's design permitted subsequent surveillance with colonoscopy at either 3- or 5-y intervals depending on the results of the last colonoscopy, consistent with current guidelines [4][6]. Screening and surveillance commenced at age 50 and stopped at age 75.

Data Inputs

Risk of polyps and CRC and the adenoma-carcinoma sequence

We based our prevalence estimates of adenomatous polyps and CRC on a recent systematic review among those at average risk for CRC [31]. Age was determined to be an important source of heterogeneity in the pooled estimates [31], and thus the prevalence rates in our model were stratified into two age categories: 50–64 and 65–75 y (Table 1).

Tab. 1. Base case model inputs and ranges considered.
Base case model inputs and ranges considered.
Minor adjustments were applied to the rates used in the US Multi-Society Task Force model [32] such that the total of our baseline prevalence of CRC plus the number of new CRCs developing in our natural history arm closely approximated the number of CRCs observed in the control arms of the FOBT RCTs [9][11].

Not all polyps are adenomatous. However, determining a polyp's histology generally requires that it be biopsied or removed. As a result, some polypectomies expose patients to complications without reducing the risk of CRC. We estimated that 41% [33] of polyps <10 mm were adenomatous compared to 82% of polyps ≥10 mm (Table 1) [16]. Screening guidelines recommend that all polyps be removed at the time of a colonoscopy to determine histology and establish an appropriate surveillance interval. Although some advocate for ignoring polyps <5 mm in size found on CTC, we assumed that all patients with polyps found on CTC regardless of size would be referred for colonoscopy. The risk of proximal adenomatous polyps and CRC is increased among those with adenomatous polyps in the left colon [34]. As such, we assumed that patients with left-sided adenomas found on flexible sigmoidoscopy would be referred for colonoscopy consistent with general clinical practice.

The rate of progression of adenomatous polyps is not well established. We initially chose progression rates that were consistent with other published models [32], and made small adjustments to these rates to ensure that the total number of CRCs in our natural history/no screening strategy closely approximated the number of CRCs found in the control arms of the FOBT trials [27].

Mortality

Death occurred according to either age-dependent population mortality rates observed for Canadians [35] or based on the mortality rates observed for patients with CRC according to their stage at diagnosis (Table 1) [36]. Those with CRC found through screening were assumed to have improved survival over patients presenting with symptomatic cancer, on the basis of a more favorable stage distribution (i.e., more early stage cancers) at diagnosis (Table 1).

Screening adherence

Adherence is important to the overall effectiveness of a screening program. Even in a randomized trial comparing annual FOBT with no screening, only 68% of patients who were randomized to FOBT actually completed the initial screen and 63% were compliant with subsequent rescreening. Moreover, for patients with positive FOBT results, only 81% had a colonoscopy [11]. We adopted these imperfect adherence rates and assumed in the base case that adherence would be the same across strategies (Table 1).

Test performance characteristics of the CRC screening strategies

The only method for properly assessing the test performance of a given screening modality is to compare it with a reference standard in all cases. Although colonoscopy is not infallible [7], it remains the accepted gold standard for evaluating the entire colon. Therefore, the base case sensitivities and specificities for polyps and CRC for each of the screening modalities were taken from the literature following a thorough search for properly designed studies that included at least a full colonoscopy in all individuals (Table 2). For the stool-based tests and for CTC, the test performance characteristics were considered on a per person basis.

Tab. 2. Base case test performance characteristics for the screening modalities.
Base case test performance characteristics for the screening modalities.

Stool-based tests

Given significant differences even between the alternative stool-based screening tests themselves (often due to different collection methods or assay types), it would not be appropriate to consider them as a class [37]. As such, we modeled different test performance scenarios for each test. A low [38] and high [14] performance level was modeled for FOBT tests that have reported in the literature (FOBT-low and FOBT-high, respectively) and a low [39],[40], mid [41], and high [42] performance level was modeled for FIT assays that have been reported in the literature (FIT-low, FIT-mid, and FIT-high, respectively). The intent of modeling different levels of test performance for FOBT and FIT was to represent the range reported in the literature. This range is greatest for FIT, likely due to differences in collection methods and assays (Table 2). FIT-low represents that reported by Morikawa et al. [39],[40] who studied the Magstream system with 1 d of stool collection. FIT-mid represents that reported by Nakama et al. [41] who used a 2-d method with the Monohaem system. FIT-high represents that reported by Levi et al. [42] who used the FlexSure OBT technology following 3 d of fecal collection. Both the first- [38] and second- [14] generation fecal DNA assays were modeled (FDNA-SDT1 and FDNA-SDT2, respectively).

Flexible sigmoidoscopy

Flexible sigmoidoscopy can evaluate the left colon to the splenic flexure, although this is not always possible [43]. Routine clinical practice is generally to perform a full colonoscopy in individuals found to have an adenomatous polyp on flexible sigmoidoscopy. As such, the sensitivity of flexible sigmoidoscopy includes the additional lesions found by colonoscopy in patients identified as having an adenoma on flexible sigmoidoscopy [44][46].

CTC and colonoscopy

Landmark studies [16],[18] that employed segmental unblinding methodology [47] provided the base case test performance estimates for both CTC and colonoscopy when possible. The sensitivity and specificity of CTC for polyps ≥10 mm was taken from the National CT Colonography Trial of the American College of Radiology Imaging Network (ACRIN) [16], a large multicenter study of CTC among primarily average-risk individuals. Polyps <5 mm were not reported in this study or other large cohorts of average risk individuals. However, we optimistically assumed that the sensitivity reported for 6–9 mm polyps would be the same for all polyps <10 mm. In a sensitivity analysis we reduced the sensitivity of polyps <10 mm to that reported in a meta-analysis of CTC that included higher risk patients [48]. The sensitivity of colonoscopy for polyps ≥10 mm was taken from the study of Pickhardt et al. [18], which reported the test performance of both CTC and colonoscopy based on segmental unblinding. As this study also did not report data for polyps <5 mm, the sensitivity of colonoscopy for polyps <10 mm was taken from two back-to-back colonoscopy studies (Table 2) [49],[50].

Screening-related risks

Flexible sigmoidoscopy and colonoscopy are associated with risks including bleeding, perforation, and rarely, death (Table 1). Even though CTC is less invasive than colonoscopy, colonic perforations have been reported [51][53], though many of the small CTC induced perforations diagnosed with the CT in asymptomatic individuals may not be clinically important. We assumed a low risk of CTC-induced perforation in the base case analysis [51],[52], and that this would never result in death (Table 1).

Costs

Costs related to screening. All costs are reported in 2008 CAN$. The direct costs of flexible sigmoidoscopy and colonoscopy, as well as costs attributed to bleeding and perforation complications [54], were based on local estimates derived from the Calgary Health Region costing database [55] and included the nonphysician costs (capital, nursing, drugs, and cleaning costs) and the physician fees for the procedure (Table 3). CTC for primary CRC screening is not currently part of the schedule of medical benefits in any province in Canada. The direct costs of CTC were therefore conservatively assumed to be the same as that of a CT abdomen/pelvis, likely an underestimate (Table 3). We assumed that stool-based screening would be offered at a person's annual visit to their general practitioner, and as such, we only considered the cost of the screening kit and related laboratory/processing costs (Table 3).

Tab. 3. Base case direct health care costs and nonmedical costs and ranges considered.
Base case direct health care costs and nonmedical costs and ranges considered.
FOBT: includes cost of FOBT kit (CAN), processing (CAN).

For all screening modalities, we included the relevant patient ± caregiver time and travel costs (nonmedical costs), on the basis of available surveys for flexible sigmoidoscopy, colonoscopy, FOBT, and CTC (Table 3) [8],[56],[57]. The nonmedical costs of FIT and fecal DNA were assumed to be the same as FOBT. In the base case, we did not consider the capital costs of initiating or administering a screening program and thus assumed that screening would be opportunistic in all strategies.

Costs related to managing CRC. Existing published data on the total costs of managing patients with CRC are outdated. We assumed that the cost of surgery for CRC has remained relatively stable and thus based our surgical costs on a Canadian study reporting 1998 figures, inflation adjusted to 2008 dollars [58].

In contrast, the cost of treating CRC with chemotherapy has increased substantially because of the development of more expensive agents [22]. To estimate the cost of chemotherapy provided for advanced CRC, we used data from the Canadian Inter-Provincial Joint Oncology Drug Review (JODR) Process [59]. These estimates were the average stage-based treatment costs for chemotherapy, taking into account that not all patients would be eligible for or would comply with treatment. Patients with stage IIB disease (∼50% of stage II patients) are generally managed with adjuvant chemotherapy using eight cycles of capecitabine [60],[61]. First line therapy for patients with stage III CRC was assumed to be 6 mo of oxaliplatin-based therapy [62]. Considering the most recent clinical trials and assumed standards of care, the average patient with stage IV CRC received approximately 10 mo of infusional fluorouracil (5-FU), leucovorin, and oxaliplatin (FOLFOX) in combination with bevacizumab, followed by 14 doses of infusional 5-FU, leucovorin, and irinotecan (FOLFIRI). Those lacking K-Ras mutations were assumed to go on to receive 4 mo of anti-epidermal growth factor receptor–based inhibition therapy. We did not include the potential costs of liver metastectomy among stage IV patients, or the cost of preoperative radiation therapy in patients with operable rectal cancer.

Valuing health benefits

Health benefits were measured in terms of QALYs gained. We obtained utilities for relevant health states on the basis of a study that used a standard gamble exercise in patients with a previous history of CRC or polyps who were presented with stage-dependent outcome states for CRC (Table 1) [63].

Sensitivity Analysis

Allowance for uncertainty in the base case polyp and CRC prevalence estimates, mortality assumptions, screening test performance characteristics, screening-related risks, and costs were considered through the use of univariate and probabilistic sensitivity analyses. A number of scenario analyses were also included. We considered a scenario in which the additional costs of biologic chemotherapies for advanced stage CRC were excluded. We also examined scenarios where FIT was offered every 2 y instead of annually and analyzed our results without nonmedical costs. We assessed the impact of differential adherence rates across strategies at the initial screening encounter. For this analysis, we used the adherence rates determined by Hol et al. in a RCT comparing participation rates of FOBT, FIT, and flexible sigmoidoscopy in a screening population [13]. As Hol et al. [13] did not study fecal DNA, colonoscopy, or CTC, we assumed that fecal DNA would have the same adherence as FIT due to its comparable simplicity for patients, and we assumed that colonoscopy would have the same adherence as flexible sigmoidoscopy. We also assessed the impact of lower subsequent adherence for the annual stool-based tests, since screening noncompliance may be more prevalent with an annual test compared to one offered less frequently. To do this assessment, we examined scenarios with decreased FOBT and FIT follow-up adherence.

Because we did not include any administrative costs for any of the CRC screening programs, we performed a sensitivity analysis to assess the impact of including administrative costs for the various screening tests. We were unable to identify a document that has reported the setup and operating costs for a population-based CRC screening program, but it is possible that programs that screen annually (i.e., stool-based tests) might have higher administrative costs than ones that screen patients every 10 y (i.e., colonoscopy). We provide sensitivity analyses varying the administrative costs per screening test between CAN$10 and CAN$50 to determine the impact on the results, making the assumption that programs screening more frequently will incur higher administrative costs.

To address limitations in classic univariate sensitivity analysis, we also performed probabilistic sensitivity analysis, which allows for the simultaneous sensitivity analysis of all variables over their plausible range [64],[65]. It does so by replacing estimates of probabilities, utilities, and costs with specific probability distributions, which are based on the reported means and variances for each variable. Statistical distributions were created around all of the variables for which there was substantial measurement uncertainty, including use of a beta distribution for proportions (i.e., mortality, proportion of patients with Stage I, II, III, and IV cancer), use of a normal distribution for normally distributed variables (i.e., certain costs and utility measures), log-normal distribution for skewed variables (i.e., certain costs), and triangular distributions for variables with a range, but no statistical distribution (i.e., adenoma transition over time, probability of adherence). Given that sensitivity and specificity are linked variables that do not vary independently (linked via receiver operating curves that were unavailable), these variables were not included within the probabilistic analyses—as noted above, the sensitivity and specificity of the various screening tests were subjected to wide sensitivity analysis using the testing characteristics provided by different primary studies.

Results

Base Case Analysis

Annual CRC screening using FIT, assuming mid-range test performance characteristics, was the preferred strategy for average risk individuals in the base case analysis (Table 4). It was more effective and less costly than almost all of the other strategies including no screening. Only FIT when assuming even better test performance characteristics (i.e., FIT-high) produced more QALYs and resulted in fewer CRCs than FIT-mid, but at an additional cost of CAN$85,150 per QALY gained.

Tab. 4. Base case incremental cost per QALY gained for average risk patients (reported value compares strategy reported in the column with the strategy reported in the row).
Base case incremental cost per QALY gained for average risk patients (reported value compares strategy reported in the column with the strategy reported in the row).
95% confidence intervals (CIs) based on probabilistic sensitivity analysis using baseline statistical distributions around all uncertain variables.

Using base case estimates, over the lifetimes of a 100,000 patient cohort, 4,857 and 1,782 individuals would develop and die from CRC, respectively, if CRC screening was not undertaken (Table 5). This “no screening” strategy would be expected to cost an average of CAN$1,901 per patient. Annual screening with FIT-mid would reduce the overall number of cancers by 71% and CRC mortality by 74% while saving CAN$68 per patient. Compared with the most effective FOBT strategy, FIT-mid would be expected to reduce the number of cancers by 60%, and CRC mortality by 63%, while saving CAN$362 per person.

Tab. 5. Cancer outcomes and number of screening tests required during the lifetimes for a hypothetical 100,000 average risk patient cohort.
Cancer outcomes and number of screening tests required during the lifetimes for a hypothetical 100,000 average risk patient cohort.
n cancers overall include symptomatic and screen found CRC.

Sensitivity Analysis

Under no circumstances did flexible sigmoidoscopy, FOBT, CTC, or fecal DNA appear attractive in comparison to other CRC screening modalities. As such, these strategies are not reported in our sensitivity analysis table (Table 6). Lowering the cost of CRC treatment by excluding the use of biologic chemotherapies resulted in a scenario where FIT-mid resulted in additional costs compared to no screening (CAN$163 per patient or CAN$3,691 per QALY gained). Increasing the cost of FIT testing by 50% had a similar effect; FIT-mid cost an additional CAN$105 per patient and was associated with a cost per QALY of CAN$2,375 compared to no screening. Biennial screening using FIT-mid increased the cost savings when compared to no screening. However, performing FIT less frequently also made it less effective.

Tab. 6. Sensitivity analysis.
Sensitivity analysis.
aNumbers rounded to nearest CAN.

When the initial adherence rates for each of the strategies was no longer assumed to be identical, FIT-mid remained dominant over no screening (Table 6). Assuming the base case initial adherence rates, when we dropped the adherence rates for subsequent screens for all of the annual fecal-based strategies, FIT-mid remained dominant over no screening. However, when subsequent adherence for FIT was dropped from 63% to 40%, both FIT-mid and FIT-high became dominant over no screening, and colonoscopy became the most effective strategy at a cost per QALY gained of CAN$300,609 compared to FIT-high. When subsequent adherence for FIT was decreased to only 20%, colonoscopy remained the most effective strategy, at a cost per QALY gained of CAN$32,912 compared to FIT-high (Table 6).

Finally, we performed a sensitivity analysis to assess the impact of higher administrative costs that might be associated with an annual screening program (i.e., FIT) compared to one offered less frequently (i.e., colonoscopy). We noted that FIT remained dominant over no screening unless the administrative costs were ∼CAN$10 per test. If administrative costs were CAN$30 per test, annual FIT was associated with a cost per QALY of CAN$3,120 compared with no screening. However, if the administrative costs were CAN$50 per test, then colonoscopy would be the preferred screening modality compared with FIT, and would be associated with a cost per QALY gained of CAN$5,903 compared with no screening.

Our probabilistic sensitivity analysis revealed that FIT-mid was cost saving and more effective compared with no screening in nearly 100% of the simulations performed, confirming the robustness of the results (Figure 2).

Fig. 2. Probabilistic sensitivity analysis.
Probabilistic sensitivity analysis.
An incremental cost-effectiveness scatterplot comparing FIT-mid with no screening in which the uncertainty in all model inputs has been tested simultaneously. Data points in the lower right quadrant reflect situations where FIT-mid is more effective and less costly than no screening.

Discussion

Our study demonstrates that annual screening with FIT, assuming mid-range test performance characteristics, is more effective and less costly than other CRC screening strategies, including the most commonly used stool-based CRC screening test, FOBT, and no screening. Among a cohort of 100,000 average risk individuals followed until death, 4,857 cancers and 1,782 cancer-related deaths would be expected with no screening. An annual FIT with high sensitivity for cancer (81%) and moderate sensitivity for advanced adenomas (54%) [41] could reduce costs and decrease the number of CRCs and cancer-related deaths to 1,393 and 457, respectively. Screening with FIT was also more effective at reducing cancer and cancer-related deaths at lower costs compared with FOBT.

FIT represents a significant advance over the traditional guaiac-based FOBTs, in large part due to FITs improved sensitivity for identifying adenomatous polyps. Our findings underscore the importance of identifying patients with advanced adenomas and preventing cancer through the identification and removal of precancerous polyps. Indeed, changing the sensitivity of FIT for cancer had relatively little impact on our results, whereas reducing the sensitivity of FIT for advanced adenomas from 54% to below 45% resulted in FIT no longer being cost saving compared with no screening.

Although it may seem counter-intuitive that screening with FIT could be even more effective than colonoscopy, this is due to the more frequent screening interval with FIT. In base case analyses, and consistent with current guidelines [3],[6], screening with FIT was done annually compared to every 10 y with colonoscopy. Therefore, even though the test performance of a single FIT test was inferior to colonoscopy, there were more opportunities to identify previously missed pathology with FIT compared to colonoscopy.

Our results are robust. FIT with mid-range performance (FIT-mid) remained optimal compared with no screening and all the other strategies except FIT with even better test performance (FIT-high) unless the cost of CRC treatment was reduced, or the sensitivity for advanced adenomas was decreased significantly. However, even with lower CRC treatment costs, FIT remained economically attractive. Many health jurisdictions now fund biologic chemotherapies for advanced-stage CRC and with further advances in CRC chemotherapy, it is unlikely that management costs for CRC will decrease [22]. In addition, our modeled CRC treatment costs were lower than those used in a recent US study that had similar results [25], lending further support to the notion that CRC screening can indeed save money.

It is possible that the administrative costs of annual screening programs such as FIT would be more expensive over the long-run compared with those offered every 5 or 10 y. As these data are not known, we did not consider administrative costs or the costs to build and staff additional screening centers in our primary analysis. However, in sensitivity analysis, we noted that FIT-mid remained cost saving if the administration costs were <CAN$10 per test, and remained attractive compared with colonoscopy even if the administrative costs per test were CAN$30 per test. It should also be noted that the additional infrastructure required to implement primary screening with CTC, flexible sigmoidoscopy, or colonoscopy would likely counterbalance a substantial portion of these additional administrative costs of an annual screening program.

We assumed in the base case that adherence would be identical across all of the CRC screening strategies. Although this may not be true, we are unaware of a study that has evaluated screening uptake for all of the strategies we considered. However, fecal-based screening does not require a bowel preparation, is associated with lower patient-borne costs, and is safe to perform, which may be more appealing to the general population. Furthermore, FIT does not require any dietary restrictions. Indeed, in a recent randomized trial, FIT was associated with higher screening uptake than flexible sigmoidoscopy and FOBT [13]. Of course, this finding only strengthens our conclusions as illustrated in our scenario analysis in which FIT had relatively higher adherence than all of the other strategies (Table 6). Recent data suggest that screening adherence with FOBT may drop by 50% after only 2 y in a biennial screening program [66]; this may affect programs with frequent screening (i.e., annual fecal-based strategies) to a greater extent than programs requiring less frequent screening (i.e., colonoscopy). As expected, when we dropped our subsequent adherence rates for FOBT and FIT, FIT-mid became less effective, though it remained dominant compared with no screening. In contrast, colonoscopy became the most effective strategy when the subsequent adherence rates for FOBT and FIT were dropped from 63% to 40%, though it was associated with an unattractive incremental cost per QALY. It is clear that further information on long-term adherence rates for annual stool-based tests are needed.

Our study has limitations. As with most economic evaluations, our results are limited by available evidence. The natural history of adenomas and their progression to cancer is not clearly known. However, we populated our model with the best available evidence including a systematic review of adenoma and CRC prevalence rates [31] and modeled new adenoma growth and adenoma progression over time to closely match high quality clinical datasets [9][11]. We did not model cancers arising from lesions other than adenomas. However, most CRCs arising in average risk individuals are believed to develop via the traditional adenoma-carcinoma sequence. A small proportion of CRC may develop from undetectable lesions (i.e., flat or depressed adenomas), and it is known that some interval cancers can arise through a rapid adenoma-carcinoma sequence between screening studies [67]. It should be noted that this potential issue would impact the effectiveness of all CRC screening modalities, and thus would be unlikely to impact the differential effectiveness between our modeled strategies. Given data limitations, we modeled identical CRC stage distributions for cancers detected using all of the stool-based strategies despite differences in testing characteristics. Given FIT's superior sensitivity compared to FOBT, patients diagnosed with CRC might be expected to have more earlier stage cancers, which again would make FIT appear more attractive. We assumed that the results of each screening test were independent of the prior test result. While not informed by evidence, it is possible that this is not entirely true; however, it is important to note that the results of our analysis were robust to small changes in the sensitivity and specificity of each of the screening tests. Finally, although we did model the most widely available and promising screening strategies, additional technologies are being developed and it is possible that other screening paradigms, including nurse-based endoscopy, may become viable in the future as a means to reduce the cost of delivering flexible sigmoidoscopy and potentially colonoscopy.

In conclusion, annual screening with FIT having test performance characteristics within the mid-range reported in the literature is both more effective and less costly than other CRC screening modalities, including FOBT and colonoscopy, and not screening for CRC. Even if this level of test performance is not attainable in clinical practice, annual screening with a lower performing FIT is still highly attractive with a cost per QALY gained of <CAN$5,000 compared to no screening. Our results are robust suggesting that screening for CRC with FIT should be considered the modality of choice for average risk patients between the ages of 50 and 75 in North America.


Zdroje

1. JemalA

SiegelR

WardE

MurrayT

XuJ

2007 Cancer statistics, 2007. CA Cancer J Clin 57 43 66

2. WilsonJMG

JungerG

1968 Principles and practice of screening for disease. Geneva WHO

3. 2008 Screening for colorectal cancer: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med 149 627 637

4. LeddinD

HuntR

ChampionM

CockeramA

FlookN

2004 Canadian Association of Gastroenterology and the Canadian Digestive Health Foundation: Guidelines on colon cancer screening. Can J Gastroenterol 18 93 99

5. WinawerS

FletcherR

RexD

BondJ

BurtR

2003 Colorectal cancer screening and surveillance: clinical guidelines and rationale-Update based on new evidence. Gastroenterology 124 544 560

6. LevinB

LiebermanDA

McFarlandB

AndrewsKS

BrooksD

2008 Screening and surveillance for the early detection of colorectal cancer and adenomatous polyps, 2008: a joint guideline from the American Cancer Society, the US Multi-Society Task Force on Colorectal Cancer, and the American College of Radiology. Gastroenterology 134 1570 1595

7. LiebermanD

2004 Colonoscopy: as good as gold? Ann Intern Med 141 401 403

8. HeitmanSJ

AuF

MannsBJ

McGregorSE

HilsdenRJ

2008 Nonmedical costs of colorectal cancer screening with the fecal occult blood test and colonoscopy. Clin Gastroenterol Hepatol 6: 912-917 e911

9. HardcastleJD

ChamberlainJO

RobinsonMH

MossSM

AmarSS

1996 Randomised controlled trial of faecal-occult-blood screening for colorectal cancer. Lancet 348 1472 1477

10. KronborgO

FengerC

OlsenJ

JorgensenOD

SondergaardO

1996 Randomised study of screening for colorectal cancer with faecal-occult-blood test. Lancet 348 1467 1471

11. MandelJS

BondJH

ChurchTR

SnoverDC

BradleyGM

1993 Reducing mortality from colorectal cancer by screening for fecal occult blood. Minnesota Colon Cancer Control Study. N Engl J Med 328 1365 1371

12. van RossumLG

van RijnAF

LaheijRJ

van OijenMG

FockensP

2008 Random comparison of guaiac and immunochemical fecal occult blood tests for colorectal cancer in a screening population. Gastroenterology 135 82 90

13. HolL

van LeerdamME

van BallegooijenM

van VuurenAJ

van DekkenH

2010 Screening for colorectal cancer: randomised trial comparing guaiac-based and immunochemical faecal occult blood testing and flexible sigmoidoscopy. Gut 59 62 68

14. AhlquistDA

SargentDJ

LoprinziCL

LevinTR

RexDK

2008 Stool DNA and occult blood testing for screen detection of colorectal neoplasia. Ann Intern Med 149: 441-450, W481

15. ItzkowitzSH

JandorfL

BrandR

RabeneckL

SchroyPC

3rd, et al. 2007 Improved fecal DNA test for colorectal cancer screening. Clin Gastroenterol Hepatol 5 111 117

16. JohnsonCD

ChenMH

ToledanoAY

HeikenJP

DachmanA

2008 Accuracy of CT colonography for detection of large adenomas and cancers. N Engl J Med 359 1207 1217

17. KimDH

PickhardtPJ

TaylorAJ

LeungWK

WinterTC

2007 CT colonography versus colonoscopy for the detection of advanced neoplasia. N Engl J Med 357 1403 1412

18. PickhardtPJ

ChoiJR

HwangI

ButlerJA

PuckettML

2003 Computed tomographic virtual colonoscopy to screen for colorectal neoplasia in asymptomatic adults. N Engl J Med 349 2191 2200

19. HeitmanSJ

MannsBJ

HilsdenRJ

FongA

DeanS

2005 Cost-effectiveness of computerized tomographic colonography versus colonoscopy for colorectal cancer screening. Cmaj 173 877 881

20. PickhardtPJ

HassanC

LaghiA

ZulloA

KimDH

2007 Cost-effectiveness of colorectal cancer screening with computed tomography colonography: the impact of not reporting diminutive lesions. Cancer 109 2213 2221

21. VijanS

HwangI

InadomiJ

WongRK

ChoiJR

2007 The cost-effectiveness of CT colonography in screening for colorectal neoplasia. Am J Gastroenterol 102 380 390

22. SchragD

2004 The price tag on progress--chemotherapy for colorectal cancer. N Engl J Med 351 317 319

23. BensonVS

PatnickJ

DaviesAK

NadelMR

SmithRA

2008 Colorectal cancer screening: a comparison of 35 initiatives in 17 countries. Int J Cancer 122 1357 1367

24. PignoneM

SahaS

HoergerT

MandelblattJ

2002 Cost-effectiveness analyses of colorectal cancer screening: a systematic review for the U.S. Preventive Services Task Force. Ann Intern Med 137 96 104

25. ParekhM

FendrickAM

LadabaumU

2008 As tests evolve and costs of cancer care rise: reappraising stool-based screening for colorectal neoplasia. Aliment Pharmacol Ther 27 697 712

26. ZauberAG

Lansdorp-VogelaarI

KnudsenAB

WilschutJ

van BallegooijenM

2008 Evaluating test strategies for colorectal cancer screening: a decision analysis for the U.S. Preventive Services Task Force. Ann Intern Med 149 659 669

27. HoC

HeitmanS

MembeSK

MorrisonA

MoultonK

2008 Computed tomographic colonography for colorectal cancer screening in an average risk population: systematic review and economic evaluation.

Canadian Agency for Drugs and Technologies in Health

Ottawa, Canada Canadian Agency for Drugs and Technologies in Health

28. RabeneckL

PaszatLF

2004 A population-based estimate of the extent of colorectal cancer screening in Ontario. Am J Gastroenterol 99 1141 1144

29. Canadian Agency for Drugs and Technologies in Health

2006 Guidelines for the economic evaluation of health technologies. Ottawa, Canada Canadian Agency for Drugs and Technologies in Health 3rd edition

30. WeinsteinMC

O'BrienB

HornbergerJ

JacksonJ

JohannessonM

2003 Principles of good practice for decision analytic modeling in health-care evaluation: report of the ISPOR Task Force on Good Research Practices--Modeling Studies. Value Health 6 9 17

31. HeitmanSJ

RonksleyPE

HilsdenRJ

MannsBJ

RostomA

2009 Prevalence of adenomas and colorectal cancer in average risk individuals: a systematic review and meta-analysis. Clin Gastroenterol Hepatol 7 1272 1278

32. WinawerSJ

FletcherRH

MillerL

GodleeF

StolarMH

1997 Colorectal cancer screening: clinical guidelines and rationale. Gastroenterology 112 594 642

33. PickhardtPJ

ChoiJR

HwangI

SchindlerWR

2004 Nonadenomatous polyps at CT colonography: prevalence, size distribution, and detection rates. Radiology 232 784 790

34. LewisJD

NgK

HungKE

BilkerWB

BerlinJA

2003 Detection of proximal adenomatous polyps with screening sigmoidoscopy: a systematic review and meta-analysis of screening colonoscopy. Arch Intern Med 163 413 420

35. 2007 Death, by age group and sex, Canada, provinces and territories, annual. Ottawa, Canada Statistics Canada

36. O'ConnellJB

MaggardMA

KoCY

2004 Colon cancer survival rates with the new American Joint Committee on Cancer sixth edition staging. J Natl Cancer Inst 96 1420 1425

37. WhitlockEP

LinJS

LilesE

BeilTL

FuR

2008 Screening for colorectal cancer: a targeted, updated systematic review for the U.S. Preventive Services Task Force. Ann Intern Med 149 638 658

38. ImperialeTF

RansohoffDF

ItzkowitzSH

TurnbullBA

RossME

2004 Fecal DNA versus fecal occult blood for colorectal-cancer screening in an average-risk population. N Engl J Med 351 2704 2714

39. MorikawaT

KatoJ

YamajiY

WadaR

MitsushimaT

2007 Sensitivity of immunochemical fecal occult blood test to small colorectal adenomas. Am J Gastroenterol 102 2259 2264

40. MorikawaT

KatoJ

YamajiY

WadaR

MitsushimaT

2005 A comparison of the immunochemical fecal occult blood test and total colonoscopy in the asymptomatic population. Gastroenterology 129 422 428

41. NakamaH

ZhangB

ZhangX

2001 Evaluation of the optimum cut-off point in immunochemical occult blood testing in screening for colorectal cancer. Eur J Cancer 37 398 401

42. LeviZ

RozenP

HazaziR

VilkinA

WakedA

2007 A quantitative immunochemical fecal occult blood test for colorectal neoplasia. Ann Intern Med 146 244 255

43. PainterJ

SaundersDB

BellGD

WilliamsCB

PittR

1999 Depth of insertion at flexible sigmoidoscopy: implications for colorectal cancer screening and instrument design. Endoscopy 31 227 231

44. ImperialeTF

WagnerDR

LinCY

LarkinGN

RoggeJD

2000 Risk of advanced proximal neoplasms in asymptomatic adults according to the distal colorectal findings. N Engl J Med 343 169 174

45. ImperialeTF

WagnerDR

LinCY

LarkinGN

RoggeJD

2003 Using risk for advanced proximal colonic neoplasia to tailor endoscopic screening for colorectal cancer. Ann Intern Med 139 959 965

46. LiebermanDA

WeissDG

BondJH

AhnenDJ

GarewalH

2000 Use of colonoscopy to screen asymptomatic adults for colorectal cancer. Veterans Affairs Cooperative Study Group 380. N Engl J Med 343 162 168

47. PineauBC

PaskettED

ChenGJ

DurkalskiVL

EspelandMA

2001 Validation of virtual colonoscopy in the detection of colorectal polyps and masses: rationale for proper study design. Int J Gastrointest Cancer 30 133 140

48. MulhallBP

VeerappanGR

JacksonJL

2005 Meta-analysis: computed tomographic colonography. Ann Intern Med 142 635 650

49. HixsonLJ

FennertyMB

SamplinerRE

McGeeD

GarewalH

1990 Prospective study of the frequency and size distribution of polyps missed by colonoscopy. J Natl Cancer Inst 82 1769 1772

50. RexDK

CutlerCS

LemmelGT

RahmaniEY

ClarkDW

1997 Colonoscopic miss rates of adenomas determined by back-to-back colonoscopies. Gastroenterology 112 24 28

51. BurlingD

HalliganS

SlaterA

NoakesMJ

TaylorSA

2006 Potentially serious adverse events at CT colonography in symptomatic patients: national survey of the United Kingdom. Radiology 239 464 471

52. PickhardtPJ

2006 Incidence of colonic perforation at CT colonography: review of existing data and implications for screening of asymptomatic adults. Radiology 239 313 316

53. SosnaJ

BlacharA

AmitaiM

BarmeirE

PeledN

2006 Colonic perforation at CT colonography: assessment of risk in a multicenter large cohort. Radiology 239 457 463

54. HeitmanSJ

FongA

RabeneckL

MannsBJ

HilsdenRJ

2005 Direct costs of bleeding and perforation complications from colonoscopy. Am J Gastroenterol 100 S281

55. LeeH

MannsB

TaubK

GhaliWA

DeanS

2002 Cost analysis of ongoing care of patients with end-stage renal disease: the impact of dialysis modality and dialysis access. Am J Kidney Dis 40 611 622

56. FrewE

WolstenholmeJL

AtkinW

WhynesDK

1999 Estimating time and travel costs incurred in clinic based screening: flexible sigmoidoscopy screening for colorectal cancer. J Med Screen 6 119 123

57. HilsdenR

HeitmanS

AuF

MannsB

McGregorE

2008 Non-medical costs of colorectal cancer screening using computed tomographic colonography. Am J Gastroenterol 103

58. MarounJ

NgE

BerthelotJM

Le PetitC

DahrougeS

2003 Lifetime costs of colon and rectal cancer management in Canada. Chronic Dis Can 24 91 101

59. 2008 Guidelines: Committee to Evaluate Drugs - Cancer Care Ontario Joint Drug Review Process, Ontario Drug Benefit Plan. Toronto, Canada Ontario Ministry of Health

60. KerrDJ

GrayR

McConkeyC

BarnwellJ

2000 Adjuvant chemotherapy with 5-fluorouracil, L-folinic acid and levamisole for patients with colorectal cancer: non-randomised comparison of weekly versus four-weekly schedules--less pain, same gain. QUASAR Colorectal Cancer Study Group. Ann Oncol 11 947 955

61. ScheithauerW

McKendrickJ

BegbieS

BornerM

BurnsWI

2003 Oral capecitabine as an alternative to i.v. 5-fluorouracil-based adjuvant therapy for colon cancer: safety results of a randomized, phase III trial. Ann Oncol 14 1735 1743

62. AndreT

BoniC

Mounedji-BoudiafL

NavarroM

TaberneroJ

2004 Oxaliplatin, fluorouracil, and leucovorin as adjuvant treatment for colon cancer. N Engl J Med 350 2343 2351

63. NessRM

HolmesAM

KleinR

DittusR

1999 Utility valuations for outcome states of colorectal cancer. Am J Gastroenterol 94 1650 1657

64. BriggsA

FennP

1998 Confidence intervals or surfaces? Uncertainty on the cost-effectiveness plane. Health Econ 7 723 740

65. BriggsA

SculpherM

BuxtonM

1994 Uncertainty in the economic evaluation of health care technologies: the role of sensitivity analysis. Health Econ 3 95 104

66. FentonJJ

ElmoreJG

BuistDS

ReidRJ

TancrediDJ

2010 Longitudinal adherence with fecal occult blood test screening in community practice. Ann Fam Med 8 397 401

67. SawhneyMS

FarrarWD

GudisevaS

NelsonDB

LederleFA

2006 Microsatellite instability in interval colon cancers. Gastroenterology 131 1700 1705

68. RegulaJ

RupinskiM

KraszewskaE

PolkowskiM

PachlewskiJ

2006 Colonoscopy in colorectal-cancer screening for detection of advanced neoplasia. N Engl J Med 355 1863 1872

69. KavicSM

BassonMD

2001 Complications of endoscopy. Am J Surg 181 319 332

70. WarrenJL

KlabundeCN

MariottoAB

MeekinsA

ToporM

2009 Adverse events after outpatient colonoscopy in the Medicare population. Ann Intern Med 150 849 857, W152

71. RosenL

BubDS

ReedJF3rd

NastaseeSA

1993 Hemorrhage following colonoscopic polypectomy. Dis Colon Rectum 36 1126 1131

72. WayeJD

LewisBS

YessayanS

1992 Colonoscopy: a prospective report of complications. J Clin Gastroenterol 15 347 351

73. MisraT

LalorE

FedorakRN

2004 Endoscopic perforation rates at a Canadian university teaching hospital. Can J Gastroenterol 18 221 226

74. GarbayJR

SucB

RotmanN

FourtanierG

EscatJ

1996 Multicentre study of surgical complications of colonoscopy. Br J Surg 83 42 44

75. BresslerB

PaszatLF

ChenZ

RothwellDM

VindenC

2007 Rates of new or missed colorectal cancers after colonoscopy and their risk factors: a population-based analysis. Gastroenterology 132 96 102

76. 2009 Primary screening programs for colorectal cancer in Canada using non-invasive home tests. http://www.cadth.ca/media/pdf/hta_htupdate_issue-9_e.pdf. Accessed 2 January, 2009

77. JonasDE

RussellLB

SandlerRS

ChouJ

PignoneM

2008 Value of patient time invested in the colonoscopy screening process: time requirements for colonoscopy study. Med Decis Making 28 56 65

Štítky
Interní lékařství

Článek vyšel v časopise

PLOS Medicine


2010 Číslo 11
Nejčtenější tento týden
Nejčtenější v tomto čísle
Kurzy

Zvyšte si kvalifikaci online z pohodlí domova

Aktuální možnosti diagnostiky a léčby litiáz
nový kurz
Autoři: MUDr. Tomáš Ürge, PhD.

Střevní příprava před kolonoskopií
Autoři: MUDr. Klára Kmochová, Ph.D.

Závislosti moderní doby – digitální závislosti a hypnotika
Autoři: MUDr. Vladimír Kmoch

Aktuální možnosti diagnostiky a léčby AML a MDS nízkého rizika
Autoři: MUDr. Natália Podstavková

Jak diagnostikovat a efektivně léčit CHOPN v roce 2024
Autoři: doc. MUDr. Vladimír Koblížek, Ph.D.

Všechny kurzy
Přihlášení
Zapomenuté heslo

Zadejte e-mailovou adresu, se kterou jste vytvářel(a) účet, budou Vám na ni zaslány informace k nastavení nového hesla.

Přihlášení

Nemáte účet?  Registrujte se

#ADS_BOTTOM_SCRIPTS#