Is single reading with computer-aided detection (CAD) as good as double reading in mammography screening? A systematic review
© Azavedo et al.; licensee BioMed Central Ltd. 2012
Received: 20 April 2012
Accepted: 23 June 2012
Published: 24 July 2012
In accordance with European guidelines, mammography screening comprises independent readings by two breast radiologists (double reading). CAD (computer-aided detection) has been suggested to complement or replace one of the two readers (single reading + CAD).
The aim of this systematic review is to address the following question: Is the reading of mammographic x-ray images by a single breast radiologist together with CAD at least as accurate as double reading?
The electronic literature search included the databases Pub Med, EMBASE and The Cochrane Library. Two independent reviewers assessed abstracts and full-text articles.
1049 abstracts were identified, of which 996 were excluded with reference to inclusion and exclusion criteria; 53 full-text articles were assessed for eligibility. Finally, four articles were included in the qualitative analysis, and one in a GRADE synthesis.
The scientific evidence is insufficient to determine whether the accuracy of single reading + CAD is at least equivalent to that obtained in standard practice, i.e. double reading where two breast radiologists independently read the mammographic images.
KeywordsCAD Mammography Screening Breast Cancer Single reading Double reading
Following reports from Swedish randomized trials [1–4], breast cancer screening programs with mammography have been established in recent decades in many countries . The age range of women invited to screening varies between countries. The Swedish National Board of Health and Welfare recommends mammography screening at regular intervals to all women between 40 and 74 years. The initial results from the randomized trials, showing a reduction in mortality in breast cancer, have been confirmed by long-term follow-up [6, 7] Similar results have been obtained in established population-based service screening programs [8, 9]. However, the pros and cons of mammography screening and how the results should be interpreted  are still matters for debate.
Besides the primary aim of detecting breast cancers in screening programs, it is important that recall rates are kept as low as possible without impairing detection rates. In this respect, the recommended recall rate in Sweden and in the rest of Europe should not exceed five per cent . The reasons for recall are several, such as suspicious findings suggesting malignancy, indeterminate findings that need further work-up, and occasionally for technical reasons or if the woman reports clinical symptoms at the time of the screening examination.
Factors that affect the ability to detect a breast cancer (sensitivity) are e.g. the prevalence of breast cancer in the target population, dense breast tissue, the frequency of tumours with subtle mammographic signs, and suboptimal technical quality. These factors, combined with high daily volumes (each Swedish screening centre usually screens more than 20,000 women annually), makes accurate screening a challenging task. Sensitivity levels of 70–85% and specificity levels of 82–98% at mammography screening have been reported . In order to maintain high sensitivity and specificity, resulting in high cancer detection rates and low false-positive rates, Swedish and European guidelines recommend double reading, i.e. that the breast images are reviewed by two specially trained radiologists (breast radiologists). Double reading has been shown to increase cancer detection rates by 5–17% .
Computer-aided detection (CAD) is a computerized method for analysing images in mammography screening. Although the method has existed for approximately 10 years, its contribution to routine screening is still debatable [13–15]. The program used in CAD identifies and marks areas which the software identifies as abnormal breast tissue. The CAD program is not intended to be the sole method for analysing mammography images. Rather, it is designed to alert the radiologist to possibly suspicious areas. Hence, a radiologist must interpret and make a decision to act upon (accept or dismiss) each CAD mark. On average, each screening examination generates two false positive marks; CAD gives 400 false positive marks for each true positive mark .
Lack of an adequate number of trained breast radiologists has led to a growing interest in computerized analysis of mammography images. There has been a discussion as to whether CAD in conjunction with mammography screening could replace one of the breast radiologists. A prerequisite would be that diagnostic accuracy and patient benefit are at least equivalent to what is achieved when the mammographic images are read by two breast radiologists. Another important prerequisite is that not too many women need to be recalled for further diagnostic work-up.
The value of CAD in mammography screening has been questioned in earlier reviews [17, 18]. The literature is scarce on studies performed in authentic screening situations. As the performance of CAD systems has improved considerably, it was considered appropriate to reassess the performance of CAD in population-based screening programs.
This review is part of a comprehensive systematic review, published in Swedish by SBU (Swedish Council on Health Technology Assessment), of computer-aided detection (CAD) as a diagnostic method in mammography screening . SBU is an independent government agency for the critical evaluation of methods for preventing, diagnosing and treating health problems.
The objective of the present is systematic review is to address the following question: Is the reading of mammographic images by a single breast radiologist plus CAD at least as accurate as readings by two breast radiologists (current practice) in terms of:
sensitivity (probability that a person with the disease has a positive test result);
specificity (probability that a healthy person has a negative test result);
cancer detection rate (number of cancer cases detected per 1,000 women examined);
recall rate (proportion of women who are recalled for further investigation); and
CAD (Computer-aided detection)
CAD research has been developed over the past two decades. CAD was first applied to digitized (scanned) screen-film mammograms (SFM). The introduction of full-field digital mammography (FFDM) has led to intensified efforts to optimise the method. CAD makes a computerized analysis of mammograms and identifies areas that need to be reviewed. The precise algorithms used by different CAD suppliers are still a commercial secret and are not further reviewed here. Two types of marks are generally used: one for microcalcifications and the other for other mammographic features such as density, mass and distortion. The systems can be adjusted to yield very high sensitivity but at the cost of specificity, generating a high rate of false positive marks.
According to a recent review, the sensitivity of CAD for microcalcifications representing malignancies is 98–99% . However, only 15–20% of detected cancers present as microcalcifications on screening mammograms . The same review reports that the sensitivity of CAD for other mammographic features representing malignancies ranges from 89 to 75%, in some cases down to 50%.
It has been assumed that CAD will be used increasingly with the transition from analogue to digital mammography. The reproducibility of CAD prompts in FFDM is expected to be more consistent than with scanned mammograms. The primary inclusion criterion in this review was CAD on FFDMs. However, when prospective studies based on FFDM could not be found, scanned analogue images were accepted.
Literature search and selection of articles
The electronic literature search included the databases PubMed, EMBASE, and The Cochrane Library from 1950 to November 2011. All Western European languages were accepted. The Mesh terms were: Breast neoplasms, Breast, Mammography, Breast (TW), Mammography (TW) AND Computer aided detection (TW) AND Computer aided diagnosis (TW) AND Cad (TW), and Economic aspects. The complete search strategy can be provided on request.
PICO elements were used to describe the population, index test, reference test and outcome:
P – Population: women, 40–74 years old, participating in mammography screening
I – Intervention (index test): CAD + one breast radiologist (single reading)
C – Control (reference test): reading by two independent radiologists (double reading)
O – Outcome: sensitivity, specificity, cancer detection rate and recall rate
The inclusion criteria were:
≥5,000 women included
study setting corresponding to Swedish conditions
follow-up time ≥ 12 months
mammography readings with one breast radiologist + CAD compared with readings by two breast radiologists.
Assessment of diagnostic accuracy
The diagnostic accuracy (validity) of a test (index test) requires a reference standard (reference test) for comparison. Two index tests were used here: 1) CAD + single reading, and 2) double reading. The reference standard should reflect the reality as closely as possible and the ideal gold standard is histopathological verification. However, biopsying all individuals is not feasible when screening an asymptomatic population. The reference standard in this review was biopsy of suspected cases or follow-up. The ultimate outcome was survival. Because no randomized controlled trials have been performed to document changes in survival following the use of double reading compared to single reading with CAD, surrogate outcomes such as cancer detection rate and recall rate are used. The main outcome measures are sensitivity and specificity. Sensitivity is the number of true positive tests divided by the total number of true cancer cases. Specificity is the number of true negative tests divided by the total number of healthy breast cases. In addition, cost-effectiveness has been considered.
Rating quality of individual studies
Criteria of high, moderate and low study quality, mainly according to QUADAS
High: small risk of bias
Prospective study design. Particular emphasis on the following:
● adequately described patients constituting a representative and clinically relevant sample (QUADAS items 1, 2).
● the index test should not form part of the reference standard (item 7).
● evaluators should be masked to results of index test and reference test (items 10, 11)
● the tests should be described in sufficient detail to permit replication (items 8, 9).
● sample size ≥ 5000.
● diagnostic accuracy presented as sensitivity and specificity.
Moderate: moderate risk of bias
Prospective study design
Since no prospective studies based on digital mammography could be identified, scanned analogue images were accepted. Otherwise the same criteria as for high quality were required.
Low: high risk of selection and/or verification bias
Retrospective study design. Selected or enriched samples
Rating evidence across studies
High (⊕⊕⊕⊕). Based on high or moderate quality studies containing no factors that weaken the overall judgement.
Moderate (⊕⊕⊕O). Based on high or moderate quality studies containing isolated factors that weaken the overall judgement.
Limited (⊕⊕OO). Based on high or moderate quality studies containing factors that weaken the overall judgement.
Insufficient (⊕OOO). The evidence base is insufficient when scientific evidence is lacking, the quality of available studies is low or studies of similar quality are contradictory.
Applying GRADE serves to obtain answers to the following questions. How much confidence can one have in a particular estimate of effect? Is the result sustainable, or is it likely that new research findings will change the evidence in the foreseeable future? The rating starts at high, but confidence in the evidence may be reduced for several reasons, including limitations in the study design and/or quality, inconsistency or indirectness of results, imprecise estimates and probability of publication bias. Any disagreements on inclusion/exclusion criteria, rating quality of individual studies or quality of evidence of test methods were solved by consensus.
Sensitivity = probability that a person with a disease has a positive test result.
Specificity = probability that a healthy person has a negative test result.
Relative sensitivity = number of detected cancer cases per reader divided by the total number of detected cancer cases.
Population based mammography screening = all women in certain age groups receive a personal mailed invitation to get a mammogram at regular intervals (1.5 – 3 years)
Cancer detection rate = the number of cancer cases detected per 1000 women examined.
Recall rate = the number of women per 1000 woman recalled for further investigation.
Interval cancer = cancer cases detected between two screening occasions.
The results of the literature search and the outcome of the selection procedures are shown in a flow chart (Figure 2).
Fifty-three articles were reviewed in full text. Nine of them were review articles [12, 16–18, 24–28]. Many studies had not been performed in screening settings or had selected or enriched populations, sometimes without comparison between single reading + CAD and double reading [14, 29–57]. Nine studies had large populations, but compared only single reading + CAD with single reading [58–66]. One study that only described different cancer types was excluded .
Main characteristics, results and quality rating of four studies on mammography screening
Author, Year (ref)
Study design, Study period,Population, Readers
Index test (I)
Results CI= confidence interval Se= sensitivity Sp=specificity
Study quality, Comments
Gilbert et al., 2008 
Prospective, multicentre 2006-2007
I.1: single reading + CAD, n=28,204
Biopsy of suspected cases or follow-up (not all, though; number not reported)
Cancer detection rate:
Single reading + CAD: 7.02 /1000.
Double reading: 7.06/1000.
Restricted generalisability since results were based on single reading +CAD by experienced radiologists.
Difference not statistically significant (NS).
I.2: double reading, n=28,204.
Initially invited: 68,060 women.
Incomplete follow-up, particularly affecting the estimates of sensitivity.
Aged 50-70 years (1 % > 70 years).
Single reading + CAD: 3.9 %.
Double reading: 3.4 %.
Scanned analogue mammograms.
Difference 0.5 % (95 % CI: 0.3;0.8).
Readers: radiologists (n=17), specially trained staff (n=10).
Single reading + CAD:
Se= 87.2 %
Sp= 96.9 %
All readers had at least 6 years’ experience and >5000 readings/year
Se= 87.7 %
Sp= 97.4 %
Difference in sensitivity:
0.5 % (95 % CI:
Difference in specificity 0,5% ( CI not specified but reported NS).
Gromet et al., 2008 
I.1: Single reading + CAD
Biopsy and follow-up
Cancer detection rate:
Single reading + CAD: 4.2/1000.
Retrospective study (controlled for age and time since last screening).
231 221 women
Double reading: 4.46/1000 (NS).
I.2: Double reading
Follow-up time unclear.
Screening situation not applicable to European conditions (i.e. recall rate higher than accepted in Europe).
Single reading + CAD: specialists in mammography.
Single reading + CAD: 10.6 %.
Double reading: Specialists in mammography + radiology.
Difference statistically significant (p=0.001).
Invitation procedure and blinded readings unclear.
Single reading + CAD: Se= 90.4 %
Scanned analogue mammograms.
Difference statistically significant.
Percent of recalled with cancer:
Single reading + CAD: 3.9%.
Double reading: 3.7%
Georgian-Smith et al., 2007 
I.1: Single reading + CAD
Biopsy and at least 12 months´ follow-up to detect false negatives.
Cancer detection rate:
Study period: 2001-03
Single reading +CAD: 2.0/1000.
Screening situation not applicable to European conditions. Invitation procedure not described.
Double reading: 2.4/1000 (NS).
Population: 6381 consecutive screening examinations
I.2: Double reading
Population, selection criteria, withdrawals unclear.
Single reading +CAD: 7.87%.
Double reading: 7.93% (NS).
Not independent double reading but blinded to CAD
Experienced breast radiologists
Sensitivity and specificity not reported.
Number of recalls based on all readings.
Single reading + CAD.
Scanned analogue radiographs.
Double reading: Not independent reading.
Khoo et al., 2005 
I.1: Single reading +CAD n= 6111.
Cancer detection rate:
Study period: not reported.
Total for double reading + single reading + symptomatic patients:10/1000.
A so-called relative sensitivity used since 3-year follow-up not yet achieved.
Population: 6,111 women (45-94 years), screening every 3rd year
Not reported individually for the groups.
Relatively high screening age and long screening intervals.
I.2: Double reading n= 6111.
Single reading + CAD: 6.1%.
Unclear whether the readings were blinded.
Double reading: 5.0 %.
Difference statistically significant
Scanned analogue radiographs.
Radiologists (n=7) and specially trained staff (n=5).
Accuracy: (relative sensitivity)*
Single reading + CAD: Se= 91.5%.
Double reading: Se= 98.4% (NS).
Double reading not always performed by two radiologists.
Quality of evidence of the difference between single reading (radiologist plus CAD) and double reading (two radiologists) related to cancer detection rate and recall rate in mammography screening (GRADE). Data from Gilbert et al.
Sample size (no. of studies)
True positive: Single reading + CAD (95% CI)
True positive: Double reading (95% CI)
Absolute difference (95%CI)
Quality of evidence
Rating based on study design/quality, indirectness, consistency, precision and publication bias**
Cancer detection rate
Study quality –1
Study quality –1
Indirectness -1 One study –1
Because of their shortcomings, the remaining three studies were not considered in our conclusions. However they deserve to be described. Two were conducted in the U.S.A. [68, 69], where population-based screening programs are not used. The populations are less well described and it is not clear whether the women received a personal invitation or had sought to get for mammography on their own. Moreover, recall rates were 8–12%, notably higher than recommended in Sweden and Europe (<5%). The larger of these two studies was retrospective and included 231,221 women who underwent mammography screening . The other study was prospective with 6381 consecutive screening examinations . Their results showed no statistically significant difference in cancer detection rate and the recall rates were inconsistent.
The third study was conducted within the framework of the United Kingdom National Health Service Screening Programme . It was prospective and included 6111 screening examinations with a relatively high total cancer detection rate; 10/1000 including those detected by double reading and single reading with CAD and because of symptoms. Even women over 64 years of age (the upper limit for screening in the UK) were included, which may partly explain the relatively high prevalence of cancer cases. Another explanation may be that the interval between screening sessions was three years (usually 1.5-2 years in Europe). Due to lack of follow-up, the authors calculated a so-called relative sensitivity, where single reading + CAD gave a lower but not statistically significantly different sensitivity of 91.5% compared to 98.4% with double reading. Single reading + CAD had a significantly higher recall rate (6.1%) compared to double reading (5.0%).
To conclude, these three studies show partly conflicting results and it is difficult to draw any conclusions. According to Gilbert et al. , the two reading methods resulted in equal numbers of cancer cases. However, this was achieved at the expense of a statistically significantly higher recall rate, implying unnecessary additional examinations. Recall rates in the two studies from the USA [68, 69] were two to three times higher than in Sweden (average 3% [20, 72]) and not in accordance with European guidelines (<5% ).
The results of the literature search on economic aspects show that out of 44 abstracts, only one led to the inclusion of the full-text article . The medical scientific evidence was insufficient to study cost-effectiveness and the quality of the study was judged to be low.
The results of this systematic review indicate that the scientific evidence is insufficient to determine whether single mammographic reading by one breast radiologist + CAD is as accurate as the current practice of double reading involving two breast radiologists.
CAD has been developed to act as a second reader for two main reasons: to enhance the diagnostic sensitivity of mammography screening and to compensate for the lack of trained breast radiologists. Most of the literature on CAD for mammography comprises studies concerning technical aspects, such as improvements to software, analysis of subtypes of breast cancer, e.g. microcalcifications only, densities only, distortions or combinations of these. The majority of the clinical studies was performed on selected materials enriched with cancer cases, and thus did not represent a true screening situation. Furthermore, comparison with double reading was not a standard procedure in many of the studies. Since the aim of this review was to critically evaluate the scientific evidence of CAD’s performance in large population-based screening programs, only four studies met our strict inclusion criteria [68–71]. Of these, only one was considered to have sufficient relevance and quality .
Two major shortcomings in study design apply to all four included studies. One is survival rate, which is the most important outcome in mammography screening. None of these studies compared the survival rates with the two strategies, and therefore the present outcome measures (cancer detection rate and recall rate) can be regarded as surrogate outcomes. The other shortcoming is incomplete follow-up. As pointed out in the study by Gilbert et al. , sensitivity will be overestimated because of this shortcoming.
Although the study by Gilbert et al.  comprised a large population and had an elaborate study set-up, its generalisability is limited since all participating breast radiologists had extensive experience of mammography screening. This is not always the case in an authentic setting. The impact of CAD performance on scanned analogue radiographs as compared to digital mammography is also a matter of concern.
Initially, all CAD studies were performed on scanned analogue mammograms that were analysed with CAD. Over time there has been a transition from analogue to digital mammography and this process is still ongoing in many parts of the world. The reliability of CAD analysis of scanned films has been questioned . This aspect, together with the fact that modern mammography is performed in a digital environment, implies that new studies are required to fully understand CAD’s performance and outcomes in large population-based screening programmes using digital mammography.
Lack of trained radiologists remains a problem even when CAD is used. Using CAD as a first/second reader due to unavailability of a trained breast radiologist could be unsustainable, for instance due to retirement. In any case, new generations of breast radiologists must be secured. Besides, being able to discuss uncertain cases with an experienced colleague is absolutely essential, both for educational purposes and in order to avoid too many false positives/false negatives. When working with CAD, a single radiologist will always have to make the final decision to recall or not to recall a woman for further work-up. This decision may depend on a single CAD mark in an area where the radiologist did not react initially. In our opinion, the single radiologist using CAD needs to be highly experienced, particularly when deciding not to recall a woman for further work-up when a potential cancer might be missed. In conclusion, education and training of new generations of breast radiologists have to be done irrespective of the use of CAD, although it has been suggested that CAD could be used in the training of radiologists .
As pointed out earlier, screening policies vary between countries and this review has been performed from a European perspective. However, all screening settings have some features in common, be they population-based, centrally-organized or non-organized (“wild” or “opportunistic” screening) mammographies on asymptomatic women. High throughput is one of these factors that place high demands on smooth screening workflows. Integrating CAD into the workflow would mean that the radiologist would have actively to consider all CAD prompts, which in turn increases the total reading time.
High recall rates imply that more women have to return for additional investigation, involving new mammographic images and often also ultrasound examination. In addition, some have to undergo biopsy and in some cases even surgery. This also means more visits to doctors/hospitals for these women. Overall, additional resources are required and women are worried unnecessarily. Since the medical consequences are not convincingly positive, it is not possible to determine either the cost-effectiveness and/or the socioeconomic consequences of replacing one of the readers with CAD in the context of mammography screening.
The conclusions from this systematic review are:
The scientific evidence is insufficient to determine whether CAD + single reading by one breast radiologist would yield results that are at least equivalent to those obtained in standard practice, i.e. double reading where two breast radiologists independently read the mammographic images.
Since the medical consequences are uncertain, it is not possible to determine the cost-effectiveness or the socioeconomic consequences of replacing one of the readings with CAD in the context of mammography screening.
Since this literature review, CAD technology has advanced further, thanks to improvements in computer software and digitalization.
Additional prospective and preferably randomized population-based studies are essential to understand the method’s specific benefits, consequences, and costs.
*First authorship shared by Azavedo E and Zackrisson S.
- Tabar L, Fagerberg CJ, Gad A, Baldetorp L, Holmberg LH, Grontoft O, Ljungquist U, Lundstrom B, Manson JC, Eklund G, et al: Reduction in mortality from breast cancer after mass screening with mammography. Randomised trial from the Breast Cancer Screening Working Group of the Swedish National Board of Health and Welfare. Lancet. 1985, 1 (8433): 829-832.View ArticlePubMed
- Andersson I, Aspegren K, Janzon L, Landberg T, Lindholm K, Linell F, Ljungberg O, Ranstam J, Sigfusson B: Mammographic screening and mortality from breast cancer: the Malmo mammographic screening trial. BMJ. 1988, 297 (6654): 943-948. 10.1136/bmj.297.6654.943.PubMed CentralView ArticlePubMed
- Bjurstam N, Bjorneld L, Duffy SW, Smith TC, Cahlin E, Eriksson O, Hafstrom LO, Lingaas H, Mattsson J, Persson S, et al: The Gothenburg breast screening trial: first results on mortality, incidence, and mode of detection for women ages 39–49 years at randomization. Cancer. 1997, 80 (11): 2091-2099. 10.1002/(SICI)1097-0142(19971201)80:11<2091::AID-CNCR8>3.0.CO;2-#.View ArticlePubMed
- Frisell J, Glas U, Hellstrom L, Somell A: Randomized mammographic screening for breast cancer in Stockholm. Design, first round results and comparisons. Breast Cancer Res Treat. 1986, 8 (1): 45-54. 10.1007/BF01805924.View ArticlePubMed
- Vainio H, Bianchini F: IARC Handbooks of Cancer Prevention- Breast Cancer Screening. 2002, IARCPress, Lyon, France, 2002-
- Nystrom L, Andersson I, Bjurstam N, Frisell J, Nordenskjold B, Rutqvist LE: Long-term effects of mammography screening: updated overview of the Swedish randomised trials. Lancet. 2002, 359 (9310): 909-919. 10.1016/S0140-6736(02)08020-0.View ArticlePubMed
- Tabar L, Vitak B, Chen TH, Yen AM, Cohen A, Tot T, Chiu SY, Chen SL, Fann JC, Rosell J, et al: Swedish two-county trial: impact of mammographic screening on breast cancer mortality during 3 decades. Radiology. 2011, 260 (3): 658-663. 10.1148/radiol.11110469.View ArticlePubMed
- Hellquist BN, Duffy SW, Abdsaleh S, Bjorneld L, Bordas P, Tabar L, Vitak B, Zackrisson S, Nystrom L, Jonsson H: Effectiveness of population-based service screening with mammography for women ages 40 to 49 years: evaluation of the Swedish Mammography Screening in Young Women (SCRY) cohort. Cancer. 2011, 117 (4): 714-722. 10.1002/cncr.25650.View ArticlePubMed
- SOSSEG SOSSEG: Reduction in breast cancer mortality from organized service screening with mammography: 1. Further confirmation with extended data. Cancer Epidemiol Biomarkers Prev. 2006, 15 (1): 45-51.View Article
- Gotzsche PC, Nielsen M: Screening for breast cancer with mammography. Cochrane Database Syst Rev. 2011, CD001877-1
- Perry N, Broeders M, de Wolf C, Törnberg S, Holland R, von Karsa L: European guidelines for quality assurance in breast cancer screening and diagnosis. 2006, Office for Official Publications of the European Communities, Luxembourg, ISBN 2006 ISBN 92-79-01258-4: EU, 4
- Helvie M: Improving mammographic interpretation: double reading and computer-aided diagnosis. Radiol Clin North Am. 2007, 45 (5): 801-811. 10.1016/j.rcl.2007.06.004. viView ArticlePubMed
- Guerriero C, Gillan MG, Cairns J, Wallis MG, Gilbert FJ: Is computer aided detection (CAD) cost effective in screening mammography? A model based on the CADET II study. BMC Health Serv Res. 2011, 11 (1): 11-10.1186/1472-6963-11-11.PubMed CentralView ArticlePubMed
- Taylor P, Champness J, Given-Wilson R, Johnston K, Potts H: Impact of computer-aided detection prompts on the sensitivity and specificity of screening mammography. Health Technol Assess. 2005, 9 (6): 1-58. iiiView ArticlePubMed
- Houssami N, Given-Wilson R: Incorporating new technologies into clinical practice without evidence of effectiveness in prospective studies: computer-aided detection (CAD) in breast screening reinforces the need for better initial evaluation. Breast. 2007, 16 (3): 219-221. 10.1016/j.breast.2007.04.006.View ArticlePubMed
- Houssami N, Given-Wilson R, Ciatto S: Early detection of breast cancer: overview of the evidence on computer-aided detection in mammography screening. J Med Imaging Radiat Oncol. 2009, 53 (2): 171-176. 10.1111/j.1754-9485.2009.02062.x.View ArticlePubMed
- Taylor P, Potts HW: Computer aids and human second reading as interventions in screening mammography: two systematic reviews to compare effects on cancer detection and recall rate. Eur J Cancer. 2008, 44 (6): 798-807. 10.1016/j.ejca.2008.02.016.View ArticlePubMed
- Bennett RL, Blanks RG, Moss SM: Does the accuracy of single reading with CAD (computer-aided detection) compare with that of double reading?: A review of the literature. Clin Radiol. 2006, 61 (12): 1023-1028. 10.1016/j.crad.2006.09.006.View ArticlePubMed
- SBU: Computer-Aided Detection (CAD) in Mammography Screening. 2011, Statens beredning för medicinsk utvärdering (SBU): SBU, Stockholm
- Azavedo E, Svane G: Radiologic aspects of breast cancers detected through a breast cancer screening program. Eur J Radiol. 1991, 13 (2): 88-90. 10.1016/0720-048X(91)90086-B.View ArticlePubMed
- Whiting P, Rutjes AW, Reitsma JB, Bossuyt PM, Kleijnen J: The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol. 2003, 3: 25-10.1186/1471-2288-3-25.PubMed CentralView ArticlePubMed
- Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schunemann HJ: GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008, 336 (7650): 924-926. 10.1136/bmj.39489.470347.AD.PubMed CentralView ArticlePubMed
- Schunemann HJ, Oxman AD, Brozek J, Glasziou P, Bossuyt P, Chang S, Muti P, Jaeschke R, Guyatt GH: GRADE: assessing the quality of evidence for diagnostic recommendations. Evid Based Med. 2008, 13 (6): 162-163.View ArticlePubMed
- Boyer B, Balleyguier C, Granat O, Pharaboz C: CAD in questions/answers Review of the literature. Eur J Radiol. 2009, 69 (1): 24-33. 10.1016/j.ejrad.2008.07.042.View ArticlePubMed
- G-S G, Chersevani R, Ciatto S, Del Favero C, Frigerio A, Giordano L, Giuseppetti G, Naldoni C, Panizza P, Petrella M, Chersevani R, Ciatto S, Del Favero C, Frigerio A, Giordano L, Giuseppetti G, Naldoni C, Panizza P, Petrella M, Gruppo di studio G-S, et al: "CADEAT": considerations on the use of CAD (computer-aided diagnosis) in mammography. La Radiologia medica. 2010, 115 (4): 563-570. 10.1007/s11547-010-0505-4.View Article
- Kolb GR: The financial impact of computer-aided detection on the mammography practice. Applied Radiology. 2001, 30 (11 SUPPL.): 21-24.
- Nishikawa RM: Evaluation of computer-aided detection and computer detection systems. Applied Radiology. 2001, 30 (11 SUPPL.): 14-16.
- Noble M, Bruening W, Uhl S, Schoelles K: Computer-aided detection mammography for breast cancer screening: systematic review and meta-analysis. Arch Gynecol Obstet. 2009, 279 (6): 881-890. 10.1007/s00404-008-0841-y.View ArticlePubMed
- Cawson JN, Nickson C, Amos A, Hill G, Whan AB, Kavanagh AM: Invasive breast cancers detected by screening mammography: a detailed comparison of computer-aided detection-assisted single reading and double reading. J Med Imaging Radiat Oncol. 2009, 53 (5): 442-449. 10.1111/j.1754-9485.2009.02100.x.View ArticlePubMed
- van den Biggelaar FJ, Kessels AG, van Engelshoven JM, Flobbe K: Strategies for digital mammography interpretation in a clinical patient population. Int J Cancer. 2009, 125 (12): 2923-2929. 10.1002/ijc.24632.View ArticlePubMed
- Paquerault S, Samuelson FW, Petrick N, Myers KJ, Smith RC: Investigation of reading mode and relative sensitivity as factors that influence reader performance when using computer-aided detection software. Acad Radiol. 2009, 16 (9): 1095-1107. 10.1016/j.acra.2009.03.024.View ArticlePubMed
- van den Biggelaar FJ, Kessels AG, van Engelshoven JM, Boetes C, Flobbe K: Computer-aided detection in full-field digital mammography in a clinical population: performance of radiologist and technologists. Breast Cancer Res Treat. 2010, 120 (2): 499-506. 10.1007/s10549-009-0409-y.View ArticlePubMed
- James JJ, Cornford EJ: Does computer-aided detection have a role in the arbitration of discordant double-reading opinions in a breast-screening programme?. Clin Radiol. 2009, 64 (1): 46-51. 10.1016/j.crad.2008.07.008.View ArticlePubMed
- Kim SJ, Moon WK, Cho N, Cha JH, Kim SM, Im JG: Computer-aided detection in full-field digital mammography: sensitivity and reproducibility in serial examinations. Radiology. 2008, 246 (1): 71-80.View ArticlePubMed
- Brancato B, Houssami N, Francesca D, Bianchi S, Risso G, Catarzi S, Taschini R, Rosselli Del Turco M, Ciatto S: Does computer-aided detection (CAD) contribute to the performance of digital mammography in a self-referred population?. Breast Cancer Res Treat. 2008, 111 (2): 373-376. 10.1007/s10549-007-9786-2.View ArticlePubMed
- Yang SK, Moon WK, Cho N, Park JS, Cha JH, Kim SM, Kim SJ, Im JG: Screening mammography-detected cancers: sensitivity of a computer-aided detection system applied to full-field digital mammograms. Radiology. 2007, 244 (1): 104-111. 10.1148/radiol.2441060756.View ArticlePubMed
- Skaane P, Kshirsagar A, Stapleton S, Young K, Castellino RA: Effect of computer-aided detection on independent double reading of paired screen-film and full-field digital screening mammograms. AJR Am J Roentgenol. 2007, 188 (2): 377-384. 10.2214/AJR.05.2207.View ArticlePubMed
- Gilbert FJ, Astley SM, McGee MA, Gillan MG, Boggis CR, Griffiths PM, Duffy SW: Single reading with computer-aided detection and double reading of screening mammograms in the United Kingdom National Breast Screening Program. Radiology. 2006, 241 (1): 47-53. 10.1148/radiol.2411051092.View ArticlePubMed
- Dean JC, Ilvento CC: Improved cancer detection using computer-aided detection with diagnostic and screening mammography: prospective study of 104 cancers. AJR Am J Roentgenol. 2006, 187 (1): 20-28. 10.2214/AJR.05.0111.View ArticlePubMed
- Hukkinen K, Vehmas T, Pamilo M, Kivisaari L: Effect of computer-aided detection on mammographic performance: experimental study on readers with different levels of experience. Acta Radiol. 2006, 47 (3): 257-263. 10.1080/02841850500539025.View ArticlePubMed
- Ciatto S, Ambrogetti D, Collini G, Cruciani A, Ercolini E, Risso G, Rosselli Del Turco M: Computer-aided detection (CAD) of cancers detected on double reading by one reader only. Breast. 2006, 15 (4): 528-532. 10.1016/j.breast.2005.08.035.View ArticlePubMed
- Hukkinen K, Pamilo M: Does computer-aided detection assist in the early detection of breast cancer?. Acta Radiol. 2005, 46 (2): 135-139. 10.1080/02841850510021300.View ArticlePubMed
- Destounis SV, DiNitto P, Logan-Young W, Bonaccio E, Zuley ML, Willison KM: Can computer-aided detection with double reading of screening mammograms help decrease the false-negative rate? Initial experience. Radiology. 2004, 232 (2): 578-584. 10.1148/radiol.2322030034.View ArticlePubMed
- Ciatto S, Rosselli Del Turco M, Burke P, Visioli C, Paci E, Zappa M: Comparison of standard and double reading and computer-aided detection (CAD) of interval cancers at prior negative screening mammograms: blind review. Br J Cancer. 2003, 89 (9): 1645-1649. 10.1038/sj.bjc.6601356.PubMed CentralView ArticlePubMed
- Ciatto S, Brancato B, Rosselli Del Turco M, Risso G, Catarzi S, Morrone D, Bricolo D, Zappa M: Comparison of standard reading and computer aided diagnosis (CAD) on a proficiency test of screening mammography. Radiol Med. 2003, 106 (1–2): 59-65.PubMed
- Brem RF, Baum J, Lechner M, Kaplan S, Souders S, Naul LG, Hoffmeister J: Improvement in sensitivity of screening mammography with computer-aided detection: a multiinstitutional trial. AJR Am J Roentgenol. 2003, 181 (3): 687-693.View ArticlePubMed
- Quek ST, Thng CH, Khoo JB, Koh WL: Radiologists' detection of mammographic abnormalities with and without a computer-aided detection system. Australas Radiol. 2003, 47 (3): 257-260. 10.1046/j.1440-1673.2003.01173.x.View ArticlePubMed
- Zheng B, Hardesty LA, Poller WR, Sumkin JH, Golla S: Mammography with computer-aided detection: reproducibility assessment initial experience. Radiology. 2003, 228 (1): 58-62. 10.1148/radiol.2281020489.View ArticlePubMed
- Karssemeijer N, Otten JD, Verbeek AL, Groenewoud JH, de Koning HJ, Hendriks JH, Holland R: Computer-aided detection versus independent double reading of masses on mammograms. Radiology. 2003, 227 (1): 192-200. 10.1148/radiol.2271011962.View ArticlePubMed
- Ciatto S, Del Turco MR, Risso G, Catarzi S, Bonardi R, Viterbo V, Gnutti P, Guglielmoni B, Pinelli L, Pandiscia A, et al: Comparison of standard reading and computer aided detection (CAD) on a national proficiency test of screening mammography. Eur J Radiol. 2003, 45 (2): 135-138. 10.1016/S0720-048X(02)00011-6.View ArticlePubMed
- Malich A, Marx C, Facius M, Boehm T, Fleck M, Kaiser WA: Tumour detection rate of a new commercially available computer-aided detection system. Eur Radiol. 2001, 11 (12): 2454-2459. 10.1007/s003300101079.View ArticlePubMed
- Moberg K, Bjurstam N, Wilczek B, Rostgard L, Egge E, Muren C: Computed assisted detection of interval breast cancers. Eur J Radiol. 2001, 39 (2): 104-110. 10.1016/S0720-048X(01)00291-1.View ArticlePubMed
- Warren Burhenne LJ, Wood SA, D'Orsi CJ, Feig SA, Kopans DB, O'Shaughnessy KF, Sickles EA, Tabar L, Vyborny CJ, Castellino RA: Potential contribution of computer-aided detection to the sensitivity of screening mammography. Radiology. 2000, 215 (2): 554-562.View ArticlePubMed
- Jiang Y, Nishikawa RM, Schmidt RA, Metz CE, Giger ML, Doi K: Improving breast cancer diagnosis with computer-aided diagnosis. Acad Radiol. 1999, 6 (1): 22-33. 10.1016/S1076-6332(99)80058-0.View ArticlePubMed
- Thurfjell E, Thurfjell MG, Egge E, Bjurstam N: Sensitivity and specificity of computer-assisted breast cancer detection in mammography screening. Acta Radiol. 1998, 39 (4): 384-388.View ArticlePubMed
- Sang KY, Woo KM, Cho N, Jeong SP, Joo HC, Sun MK, Seung JK, Im JG: Screening mammography-detected cancers: Sensitivity of a computer-aided detection system applied to full-field digital mammograms. Radiology. 2007, 244 (1): 104-111. 10.1148/radiol.2441060756.View Article
- Li JG, Li S, Xu HM, Xu K: Evaluation on the use and results of computer-aided detection for full-field digital mammorgraphy. Chinese Journal of Radiology. 2006, 40 (7): 729-732.
- Birdwell RL, Bandodkar P, Ikeda DM: Computer-aided detection with screening mammography in a university hospital setting. Radiology. 2005, 236 (2): 451-457. 10.1148/radiol.2362040864.View ArticlePubMed
- Cupples TE, Cunningham JE, Reynolds JC: Impact of computer-aided detection in a regional screening mammography program. AJR Am J Roentgenol. 2005, 185 (4): 944-950. 10.2214/AJR.04.1300.View ArticlePubMed
- Fenton JJ, Taplin SH, Carney PA, Abraham L, Sickles EA, D'Orsi C, Berns EA, Cutter G, Hendrick RE, Barlow WE, et al: Influence of computer-aided detection on performance of screening mammography. N Engl J Med. 2007, 356 (14): 1399-1409. 10.1056/NEJMoa066099.PubMed CentralView ArticlePubMed
- Freer TW, Ulissey MJ: Screening mammography with computer-aided detection: prospective study of 12,860 patients in a community breast center. Radiology. 2001, 220 (3): 781-786. 10.1148/radiol.2203001282.View ArticlePubMed
- Gur D, Sumkin JH, Rockette HE, Ganott M, Hakim C, Hardesty L, Poller WR, Shah R, Wallace L: Changes in breast cancer detection and mammography recall rates after the introduction of a computer-aided detection system. J Natl Cancer Inst. 2004, 96 (3): 185-190. 10.1093/jnci/djh067.View ArticlePubMed
- Karssemeijer N, Bluekens AM, Beijerinck D, Deurenberg JJ, Beekman M, Visser R, van Engen R, Bartels-Kortland A, Broeders MJ: Breast cancer screening results 5 years after introduction of digital mammography in a population-based screening program. Radiology. 2009, 253 (2): 353-358. 10.1148/radiol.2532090225.View ArticlePubMed
- Ko JM, Nicholas MJ, Mendel JB, Slanetz PJ: Prospective assessment of computer-aided detection in interpretation of screening mammography. AJR Am J Roentgenol. 2006, 187 (6): 1483-1491. 10.2214/AJR.05.1582.View ArticlePubMed
- Morton MJ, Whaley DH, Brandt KR, Amrami KK: Screening mammograms: interpretation with computer-aided detection–prospective evaluation. Radiology. 2006, 239 (2): 375-383. 10.1148/radiol.2392042121.View ArticlePubMed
- Sanchez Gomez S, Torres Tabanera M, Vega Bolivar A, Sainz Miranda M, Baroja Mazo A, Ruiz Diaz M, Martinez Miravete P, Lag Asturiano E, Munoz Cacho P, Delgado Macias T: Impact of a CAD system in a screen-film mammography screening program: A prospective study. Eur J Radiol. 2010
- James JJ, Gilbert FJ, Wallis MG, Gillan MG, Astley SM, Boggis CR, Agbaje OF, Brentnall AR, Duffy SW: Mammographic features of breast cancers at single reading with computer-aided detection and at double reading in a large multicenter prospective trial of computer-aided detection: CADET II. Radiology. 2010, 256 (2): 379-386. 10.1148/radiol.10091899.View ArticlePubMed
- Georgian-Smith D, Moore RH, Halpern E, Yeh ED, Rafferty EA, D'Alessandro HA, Staffa M, Hall DA, McCarthy KA, Kopans DB: Blinded comparison of computer-aided detection with human second reading in screening mammography. AJR Am J Roentgenol. 2007, 189 (5): 1135-1141. 10.2214/AJR.07.2393.View ArticlePubMed
- Gromet M: Comparison of computer-aided detection to double reading of screening mammograms: review of 231,221 mammograms. AJR Am J Roentgenol. 2008, 190 (4): 854-859. 10.2214/AJR.07.2812.View ArticlePubMed
- Khoo LA, Taylor P, Given-Wilson RM: Computer-aided detection in the United Kingdom National Breast Screening Programme: prospective study. Radiology. 2005, 237 (2): 444-449. 10.1148/radiol.2372041362.View ArticlePubMed
- Gilbert FJ, Astley SM, Gillan MG, Agbaje OF, Wallis MG, James J, Boggis CR, Duffy SW: Single reading with computer-aided detection for screening mammography. N Engl J Med. 2008, 359 (16): 1675-1684. 10.1056/NEJMoa0803545.View ArticlePubMed
- Azavedo E, Svane G: Radial scars detected mammographically in a breast cancer screening programme. Eur J Radiol. 1992, 15 (1): 18-21. 10.1016/0720-048X(92)90196-G.View ArticlePubMed
- Malich A, Azhari T, Bohm T, Fleck M, Kaiser WA: Reproducibility–an important factor determining the quality of computer-aided detection (CAD) systems. Eur J Radiol. 2000, 36 (3): 170-174. 10.1016/S0720-048X(00)00189-3.View ArticlePubMed
- Luo P, Qian W, Romilly P: CAD-aided mammogram training. Acad Radiol. 2005, 12 (8): 1039-1048. 10.1016/j.acra.2005.04.011.View ArticlePubMed
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2342/12/22/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.