PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of brjcancerBJC HomepageBJC Advance online publicationBJC Current IssueSubmitting an article to BJCWeb feeds
 
Br J Cancer. Jun 1, 2004; 90(11): 2118–2122.
Published online Apr 27, 2004. doi:  10.1038/sj.bjc.6601836
PMCID: PMC2410286
New technologies in screening for breast cancer: a systematic review of their accuracy
L Irwig,1* N Houssami,1 and C van Vliet1,2
11Screening and Test Evaluation Program (STEP), School of Public Health, A27, University of Sydney, NSW 2006, Australia
*Author for correspondence: lesi/at/health.usyd.edu.au
2van Vliet's current address: Centre for Genetic Epidemiology, University of Melbourne, 200 Berkeley Street, Carlton, Victoria 3053, Australia.
Received July 9, 2003; Revised December 18, 2003; Accepted March 11, 2004.
Keywords: mass screening, breast cancer, sensitivity and specificity, radiography
Despite recent controversy surrounding the efficacy of mammographic screening, it remains the only screening test for breast cancer that has been extensively evaluated in randomised controlled trials (RCTs) and shown to reduce breast cancer mortality (IARC, 2002; Nystrom et al, 2002). Since evidence exists that early detection reduces mortality from breast cancer, it is reasonable to evaluate a new screening test by assessing its effect on early detection of breast cancer. While RCTs examining mortality as an outcome are the gold standard, studies assessing new tests are commonly evaluated using surrogate measures as indicators of early breast cancer detection. These surrogate measures may be measurable at the time of screening or require follow-up. Immediate indicators include the cancer detection rate and the size, stage, and nodal status of cancers detected. The measure requiring follow-up is the interval cancer rate. Ascertainment of interval breast cancers poses a number of challenges that include identification (requiring linkage to cancer registries), standardisation, and validation of review and categorisation methods, as well as access to the films taken at diagnosis. Assessing whether tests differ in their interval cancer rate is best assessed by randomising people to the different tests. In designs in which women are assessed by both tests, women in whom cancers are detected by either test would obviously be identified and treated; interval cancers that arise thereafter would be those missed by both tests. To assess whether interval cancer rates differ between the tests is therefore best assessed by randomising women to the different tests. However, all of the immediately measurable surrogates can be assessed in cross-sectional analytic studies of people in whom both of the different tests have been carried out.
New screening methods can be evaluated relative to the proven screening test (screening mammography being the comparator test for breast cancer) as a replacement for the comparator or as an incremental (additional) method, whereby the new test would only be carried out in those where the comparator test is negative. To allow estimation of both replacement and incremental accuracy, the basic study design is to screen women independently by both mammography and the new test, and assess how many cancers and false positives are detected by one test and not the other. If the objective is to assess incremental accuracy only (additional cancers detected, as well as additional false positives caused by use of the new test), this can be carried out by re-examining only those who were negative on mammography and can be carried out with or without knowledge of the mammography result.
Over the past two decades numerous breast imaging tests have been evaluated and used mainly as adjunct diagnostic methods to mammography, and some have been proposed as possible screening tests. Some of these tests, such as computer-aided detection (CAD), are rapidly evolving and continue to be evaluated. Other tests, primarily ultrasound, have an established role in the investigation of symptomatic women and in the evaluation of screen-detected findings. In this paper, we present a systematic review of published work on the accuracy of new technologies that have been proposed for breast cancer screening.
To avoid bias, we systematically reviewed the literature using methods that ensure all relevant studies were identified (Appendix A, literature search methods). The quality and applicability of studies were assessed before their findings were examined (Glasziou et al, 2001) (Appendix B, strategy for selection of eligible studies). As both sensitivity and specificity are important in the screening context, our selection criteria required studies to have reported data on both sensitivity and specificity (Appendix B). To ensure the applicability of the results to screening, the studies had to have been carried out on women eligible for screening. Studies on symptomatic women cannot be used to infer the accuracy of a new technique for screening, because the objective of testing is different. In clinical settings, the objective is to determine whether an identified clinical abnormality is cancer. In screening, it is to perceive abnormalities that may be found on further testing to be early cancers. Furthermore, the spectrum of disease usually differs in that cancers which present clinically would be expected to be larger and more advanced.
Papers were therefore included only if they evaluated new tests in asymptomatic women, including populations considered at higher risk for breast cancer because of genetic predisposition or those in whom mammography may be less accurate because they are younger or have radiologically dense breast tissue. Very few studies fulfilled these criteria. The remainder of the papers were review articles, were concerned with the development of the test, or evaluated the use of the test in individual cases or as a diagnostic tool in women with a clinically or mammographically detected breast abnormality. Papers on screening were excluded if important technological changes made them no longer relevant. On these grounds, articles on thermography before 1988 were excluded, as were papers on ultrasonography with water baths or frequency probes with a resolution less than 7.5 mHz. We also excluded studies that compared the proposed technology with an unproven screening method, and on this basis one otherwise eligible study of positron emission tomography was excluded (Yasuda et al, 2000). Although studies included used histological diagnosis to verify outcomes, very few papers reported data on interval cancers. However, this does not invalidate comparative studies in which both tests (new technology and mammography) are performed in all women since interval cancers will have been missed by both tests. Our review was concerned with the accuracy of new tests or new technologies associated with mammography, and did not include a cost evaluation.
No eligible papers were found for CT scanning, magnetic resonance spectroscopy (MRS), scintimammography, electrical impedance, infrared spectroscopy, light scanning, positron emission tomography, or thermography. Eligible studies were identified for ultrasound (Kolb et al, 1998; Buchberger et al, 1999; O'Driscol et al, 2001; Warner et al, 2001; Hou et al, 2002) magnetic resonance imaging (MRI) (Kuhl et al, 2000; Tilanus-Linthorst et al, 2000a, 2000b; Stoutjesdijk et al, 2001; Warner et al, 2001), CAD (te Brake et al, 1998; Burhenne et al, 2000; Birdwell et al, 2001; Freer and Ulissey, 2001), and full-field digital mammography (FFDM) (Lewin et al, 2001, 2002). For ultrasound, MRI, and CAD, findings are summarised in Tables 1, ,2Table2 and and3 3 . There was no evidence originating from RCTs.
Table 1
Table 1
US (table summarises published studies on US in screening, including study design, quality features, and results)
Table 2
Table 2
MRI (table summarises published studies on MRI in screening, including study design, quality features, and results)
Table 3
Table 3
CAD (table summarises published studies on CAD in screening, including study design, quality features, and results)
Ultrasound (Table 1) has been evaluated primarily in younger women who have mammographically dense breast tissue or are considered to be at elevated risk of breast cancer. The five studies included over 350 cancers. The results suggest that ultrasound may be more sensitive but less specific than mammography in these women. Ultrasound used as an additional test to mammography detects additional cancers, but also increases the false-positive rate.
Magnetic resonance imaging (Table 2) has been examined in four recent studies, which evaluated the test in women at high risk of cancer (usually on the basis of genetic mutations or a family history of breast cancer). In all studies, the technology was contrast-enhanced MRI and all studies used a dedicated breast coil. There were less than 40 cancers in all studies combined. The results suggest that MRI is more sensitive than mammography in selected populations, but may also have a lower specificity. There are currently several trials being conducted in the UK, Europe, and the USA to assess the role of MRI in breast screening (UK MRI Breast Screening Study Advisory Group, 2000), (http://www.acrin.org/current_protocols.html. Accessed 5/12/03).
Computer-aided detection is essentially a tool to ‘prompt’ the radiologist to look at potential abnormalities on digitised mammograms and is complementary technology to mammography. In the screening context, it is potentially equal to another ‘read’ (that is, one reader plus CAD may potentially replace two readers). CAD (Table 3) has been assessed in several studies with over 650 cancers. However, only one of these studies was prospectively conducted (Freer and Ulissey, 2001). All of the studies examined the incremental value of CAD and showed improved sensitivity; the evidence on specificity is conflicting. It is not clear to what extent the improvement compares to other manoeuvres, such as having a second film reader.
Full-field digital mammography is a new mammography technology that uses a digital receptor instead of the conventional screen film, resulting in a computer-generated image. Full-field digital mammography has the potential to improve image resolution and image processing and display techniques relative to conventional mammography. Full-field digital mammography has been examined in one study, which screened 4489 average-risk women 40 years and older (Lewin et al, 2001, 2002). In this study, 42 invasive cancers were detected (and four interval cancers were identified at 12 months). Full-field digital mammography was found to have a lower overall sensitivity (64.3%) than conventional mammography (78.6%). However, despite having a lower overall sensitivity than conventional mammography, FFDM does result in an incremental gain in sensitivity of 21.4% (that is, it will identify additional cancers that are not identified on conventional mammography). Full-field digital mammography was reported to have a recall rate of 11.8%, which was significantly lower (P< 0.001) than the recall rate of conventional mammography (14.9%).
New technologies proposed for breast cancer detection have not been evaluated in RCTs that examine the reduction of the interval cancer rate as indicators of early breast cancer detection. These new technologies have been assessed in cross-sectional analytic studies of test sensitivity and specificity, where the new test is compared to mammography. None of the tests evaluated consistently showed sufficient accuracy in high-quality studies to support their use in population screening. The conduct and reporting of the studies were limited, and the populations were generally too small to allow adequate precision in critical measures, such as test sensitivity. Most of the eligible studies identified in our review did not provide data on interval cancers, and although this is required for an estimation of test sensitivity, it does not invalidate data presented on the difference in sensitivity of the two tests since interval cancers will have been missed by both the new and the comparator test (Chock et al, 1997).
Ultrasound may increase the sensitivity of screening if used as an adjunct to mammography for women shown to have radiologically dense breasts, but is likely to increase substantially the number of women requiring biopsy for benign findings. The data from the ultrasound studies are far from conclusive, but does suggest that the potential for ultrasound to replace mammography in screening selected populations warrants further investigation. In addition, ultrasound is highly operator dependent, and the findings from the reported studies may not be applicable in a broader screening context. Magnetic resonance imaging has not been evaluated as a screening test in unselected populations, and its potential role in screening (if any) is in women at high risk of breast cancer.
Based on a limited number of studies, FFDM and CAD show an incremental improvement in sensitivity relative to conventional mammography. However, incremental improvement in sensitivity will not necessarily translate into an absolute benefit, since the new technology may be selectively detecting cancers that are biologically inconsequential. Both FFDM and CAD are currently being evaluated in ongoing studies. Future studies of these two technologies, in particular, should be supported using prospective designs, large samples, and preferably randomised trials using the difference in interval cancers as one of the outcome measures.
Studies that assess new technology before its widespread introduction should be carried out in consecutive women eligible for screening. Cancer is likely to be detected in only a few percent of women screened. Therefore, the confidence intervals for estimates of the sensitivity of new tests, or for differences in sensitivity between new and existing tests, will require screening tens of thousands of women, to detect at least 100 cancers. Future studies should therefore be designed to have adequate sample sizes, for example as is being carried out in the digital mammography screening trial, which aims to recruit 49 500 asymptomatic women presenting for screening (http://www.cancer.gov/dmist and http://www.acrin.org/current_protocols.html Accessed 5/12/03). Studies of new tests in any context, should conform to high standards of conduct and reporting (Bossuyt et al, 2003), should clarify whether the new test is being evaluated as a replacement or as an additional test, and should use the appropriate study design to assess the intended use of the test. Studies evaluating new technologies in breast cancer screening, relative to mammography, should provide information on the number of views and the number of readers for both the new technology and mammography, and should assess the effect of increasing the number of views or readers.
Although some of the proposed new screening tests show promise, there is a need for larger and better quality of studies of new technology, starting soon after it is introduced to allow concurrent evaluation and implementation (Hunink and Krestin, 2002). As new technology often changes rapidly, it might seem appropriate to leave evaluation until the new technology is ‘stable’. However, methods can be used to assess changes and developments of new technologies as part of the study design to allow early evaluation of new technologies (Hunink and Krestin, 2002). Studies that compare two screening tests or technologies in the same women can provide data on whether new tests do better than the existing ones in detecting more cancers. Before widespread implementation, those tests that show promise in cross-sectional analytic studies should then be evaluated in large randomised trials to ensure that they also reduce the interval cancer rate.
Acknowledgments
This systematic review is based in part on an earlier report prepared for an IARC meeting on breast cancer screening (IARC, 2002) and has been funded by NHMRC Grant No. 211205 to the Screening and Test Evaluation Programme.
Appendix A
LITERATURE SEARCH
MEDLINE was searched from 1966 to December 2002 using the following methods: explode breast neoplasms (all subheadings); explode sensitivity and specificity (all subheadings); explode mass screening (all subheadings); combine previous steps using the Boolean term ‘or’; search term(s) for the specific test of interest and combining using the Boolean term ‘or; combine all previous steps using the Boolean term ‘and’. Searching for specific tests using search term(s) included: CAD; CT scan (tomography); electrical impedance; FFDM; digital mammography; scintimammography (Tc 99m sestamibi, mammoscintigraphy); MRI; MRS; optical mammography (transillumination); PET; spectroscopy; thermography; and ultrasound (sonography).
The search was extended by examining references given in relevant primary studies and review articles, contact with content experts, and targeted further MEDLINE searches, for example on authors of earlier studies. MEDLINE searching identified 649 papers, and our overall search identified more than 1750 papers.
Appendix B
STRATEGY FOR SELECTION OF ELIGIBLE STUDIES
The titles and abstracts of all papers were evaluated by one author (CVV) and those possibly relevant were then assessed for final selection by one of the two reviewing authors (reviewing authors: LI or NH). Studies that included the largest number of cancers or those for which it was difficult to extract the information were in addition independently assessed by one of the two reviewers (LI or NH), and differences between the reviewers were resolved by discussion and consensus.
The following information was examined to determine eligible studies, with assessment of quality and applicability criteria prior to the extraction of study results:
  • Quality (consecutively attending screenees; screening tests applied to all participants; screening tests assessed independent of each other).
  • Objective and applicability (Was the study designed to explore the value of the new screening test as a replacement test or to assess its incremental accuracy to existing screening test? Was the study restricted to special groups such as women with high breast cancer risk or dense breast tissue on mammography? To what was the replacement or incremental value of the new test being compared, including descriptive information on number of mammography views and number of readers?).
  • Results (number of cancers and total population size; true-positive rate (TPR or sensitivity) and false-positive rate (FPR, 1 – specificity), or as a proxy the test positivity rate or biopsy rate) in the overall screened population. Studies were excluded if they did not report any measure of TPR or FPR.
  • Birdwell RL, Ikeda DM, O'Shaughnessy KF, Sickles EA. Mammographic characteristics of 115 missed cancers later detected with screening mammography and the potential utility of computer-aided detection. Radiology. 2001;219 1:192–202. [PubMed]
  • Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Lijmer JG, Moher D, Rennie D., de Vet HCW for the STARD Group Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD Initiative. Radiology. 2003;226:24–28. [PubMed]
  • Buchberger W, DeKoekkoek-Doll P, Springer P, Obrist P, Dünser M. Incidental findings on sonography of the breast: clinical significance and diagnostic workup. Am J Roentgenol. 1999;173:921–927. [PubMed]
  • Burhenne LJW, Wood SA, D'Orsi CJ, Feig SA, Kopans DB, O'Shaughnessy KF, Sickles EA, Tabar L, Vyborny CJ, Castellino RA. Potential contribution of computer-aided detection to the sensitivity of screening mammography. Radiology. 2000;215 2:554–562. [PubMed]
  • Chock C, Irwig L, Berry G, Glasziou P. Comparing dichotomous screening tests when individuals negative on both tests are not verified. J Clin Epidemiol. 1997;50 11:1211–1217. [PubMed]
  • Freer TW, Ulissey MJ. Screening mammography with computer-aided detection: prospective study of 12,860 patients in a community breast center. Radiology. 2001;220 3:781–786. [PubMed]
  • Glasziou P, Irwig L, Bain C, Colditz G. Systematic Reviews in Health Care. A Practical Guide. UK: Cambridge University Press; 2001.
  • Hou MF, Chuang HI, Yang FO, Wang CY, Huang CL, Fan HM, Chuang CH, Wang JY, Hsieh JS, Liu GC, Huang TJ. Comparison of breast mammography, sonography and physical examination for screening women at high risk of breast cancer in Taiwan. Ultrasound in Med & Biol. 2002;28 4:415–520. [PubMed]
  • Hunink M, Krestin G. Study design for concurrent development, assessment, and implementation of new diagnostic imaging technology. Radiology. 2002;222:604–614. [PubMed]
  • International Agency for Research on Cancer IARC Handbooks of Cancer Prevention: Breast Cancer Screening. Lyon: IARC; 2002. pp. 34–39.
  • Kolb TM, Lichy J, Newhouse JH. Occult cancer in women with dense breasts: detection with screening US-diagnostic yield and tumor characteristics. Radiology. 1998;207 1:191–199. [PubMed]
  • Kuhl CK, Schmutzler RK, Leutner CC, Kempe A, Wardelmann E, Hocke A, Maringa M, Pfeifer U, Krebs D, Schild HH. Breast MR imaging screening in 192 women proved or suspected to be carriers of a breast cancer susceptibility gene: preliminary results. Radiology. 2000;215 1:267–279. [PubMed]
  • Lewin JM, D'Orsi CJ, Hendrick RE, Moss LJ, Isaacs PK, Karellas A, Cutter GR. Clinical comparison of full-field digital mammography and screen-film mammography for detection of breast cancer. Am J Roentgenol. 2002;179:671–677. [PubMed]
  • Lewin JM, Hendrick RE, D'Orsi CJ, Isaacs PK, Moss LJ, Karellas A, Sisney GA, Kuni CC, Cutter GR. Comparison of full-field digital mammography with screen-film mammography for cancer detection: results of 4945 paired examinations. Radiology. 2001;218 3:873–880. [PubMed]
  • Nystrom L, Andersson I, Bjurstam N, Frisell J, Nordenskjöld B, Rutqvist LE. Long-term effects of mammography screening: updated overview of the Swedish randomised trials. Lancet. 2002;359:909–919. [PubMed]
  • O'Driscol D, Warren R, MacKay J, Britton P, Day NE. Screening with breast ultrasound in a population at moderate risk due to family history. J Med Screen. 2001;8:106–109. [PubMed]
  • Stoutjesdijk MJ, Boetes C, Jager GJ, Beex L, Bult P, Hendriks JH, Laheij RJ. Magnetic resonance imaging and mammography in women with a hereditary risk of breast cancer. J Natl Cancer Inst. 2001;93 14:1095–1102. [PubMed]
  • te Brake GM, Karssemeijer N, Hendriks JH. Automated detection of breast carcinomas not detected in a screening program. Radiology. 1998;207 2:465–471. [PubMed]
  • Tilanus-Linthorst MM, Bartels CC, Obdeijn AI, Oudkerk M. Earlier detection of breast cancer by surveillance of women at familial risk. Eur J Cancer. 2000a;36 4:514–519. [PubMed]
  • Tilanus-Linthorst MM, Obdeijn IM, Bartels KC, de Koning HJ, Oudkerk M. First experiences in screening women at high risk for breast cancer with MR imaging. Breast Cancer Res Treat. 2000b;63 1:53–60. [PubMed]
  • UK MRI Breast Screening Study Advisory Group Magnetic resonance imaging screening in women at genetic risk of breast cancer: Imaging and analysis protocol for the UK multicentre study. Magn Reson Imaging. 2000;18:765–776. [PubMed]
  • Warner E, Plewes DB, Shumak RS, Catzavelos GC, Di Prospero LS, Yaffe MJ, Goel V, Ramsay E, Chart PL, Cole DE, Taylor GA, Cutrara M, Samuels TH, Murphy JP, Murphy JM, Narod SA. Comparison of breast magnetic resonance imaging, mammography, and ultrasound for surveillance of women at high risk for hereditary breast cancer. J Clin Oncol. 2001;19 15:3524–3531. [PubMed]
  • Yasuda S, Ide M, Fujii H, Nakahara T, Mochizuki Y, Takahashi W, Shohtsu A. Application of positron emission tomography imaging to cancer screening. Br J Cancer. 2000;83 12:1607–1611. [PMC free article] [PubMed]
Articles from British Journal of Cancer are provided here courtesy of
Cancer Research UK