Skip to main content

Advertisement

SpringerLink
Log in

Efficacy of computer-aided diagnosis in lung cancer screening with low-dose spiral computed tomography: receiver operating characteristic analysis of radiologists’ performance

  • Original Article
  • Published:
Japanese Journal of Radiology Aims and scope Submit manuscript

Abstract

Purpose

The aim of this study was to evaluate the efficacy of a computer-aided diagnosis (CAD) system we developed that can also respond to subsolid nodules, for lung cancer screening using low-dose spiral computed tomography (LDCT).

Materials and methods

The institutional review board approved this study. A total of 30 positive cases (including 15 lung cancer cases) that needed further examination and 30 negative cases were used for the observer performance study. Three thoracic radiologists, five general radiologists, and three residents participated in this study in which they first read the original CT image on its own and then reassessed the same image with the assistance of CAD. Radiologists’ performance was evaluated using receiver operating characteristic (ROC) analysis.

Results

The Az values without and with CAD were 0.872 and 0.910 for the thoracic radiologists, 0.864 and 0.924 for general radiologists, and 0.875 and 0.837 for residents, respectively. The detection accuracy improved significantly for the thoracic and general radiologists with our CAD system; however, no statistically significant difference between without or with CAD was seen for residents.

Conclusion

This CAD system is beneficial in the detection of pulmonary nodules on LDCT when used by experienced radiologists.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Health and Welfare Statistics Association, Tokyo, Japan. J Health Welfare Statistics 2002;49:45–54 (in Japanese).

    Google Scholar 

  2. Flehinger BJ, Melamed MR, Zeman MB, Heelan RT, Perchick WB, Martini N. Early lung cancer detection: results of the initial (prevalence) radiologic and cytologic screening in the Memorial-Sloan Kettering study. Am Rev Respir Dis 1984;130:555–560.

    CAS  PubMed  Google Scholar 

  3. Fontana RS, Sanderson DR, Taylor WF, Woolner LB, Miller WE, Muhm JR, et al. Early lung cancer detection; results of initial (prevalence) radiologic and screening in Mayo Clinic study. Am Rev Respir Dis 1984;130:561–565.

    CAS  PubMed  Google Scholar 

  4. Fontana RS, Sanderson DR, Woolner LB, Taylor WF, Miller WE, Muhm JR. Lung cancer screening: the Mayo program. J Occup Med 1986;28:746–750.

    Article  CAS  PubMed  Google Scholar 

  5. Tockman M. Survival and mortality from lung cancer in a screening population: the Johns Hopkins study. Chest 1986;89:325–326.

    Article  Google Scholar 

  6. Diederich S, Wormanns D, Semik M, Thomas M, Lenzen H, Roos N, et al. Screening for early lung cancer with low-dose spiral CT: prevalence in 817 asymptomatic smokers. Radiology 2002;222:773–781.

    Article  PubMed  Google Scholar 

  7. Henschke CI, McCauley DI, Yankelevitz DF, Naidich DP, McGuinness G, Miettinen OS, et al. Early lung cancer action project: overall design and findings from baseline screening. Lancet 1999;354:99–105.

    Article  CAS  PubMed  Google Scholar 

  8. Kaneko M, Eguchi K, Ohmatsu H, Kakinuma R, Naruke T, Suemasu K, et al. Peripheral lung cancer: screening and detection with low-dose spiral CT versus radiography. Radiology 1996;201:798–802.

    CAS  PubMed  Google Scholar 

  9. Nawa T, Nakagawa T, Kusano S, Kawasaki Y, Sugawara Y, Nakata H. Lung cancer screening using low-dose spiral CT: results of baseline and 1-year follow-up studies. Chest 2002;122:15–20.

    Article  PubMed  Google Scholar 

  10. Sobue T, Moriyama N, Kaneko M, Kusumoto M, Kobayashi T, Tsuchiya R, et al. Screening for lung cancer with low-dose helical computed tomography: anti-lung cancer association project. J Clin Oncol 2002;20:911–920.

    Article  PubMed  Google Scholar 

  11. Sone S, Li F, Yang ZG, Honda T, Maruyama Y, Takashima S, et al. Results of three-year mass screening program for lung cancer using mobile low-dose spiral computed tomography scanner. Br J Cancer 2001;84:25–32.

    Article  CAS  PubMed  Google Scholar 

  12. Sone S, Takashima S, Li F, Yang Z, Honda T, Maruyama Y, et al. Mass screening for lung cancer with mobile spiral computed tomography scanner. Lancet 1998;351:1242–1245.

    Article  CAS  PubMed  Google Scholar 

  13. McMahon PM, Kong CY, Johnson BE, Weinstein MC, Weeks, JC, Kuntz KM, et al. Estimating long-term effectiveness of lung cancer screening in the Mayo CT screening study. Radiology 2008;248:278–287.

    Article  PubMed  Google Scholar 

  14. International Early Lung Cancer Action Program investigators, Henschke CI, Yankelevitz DF, Libby DM, Pasmantier MW, Smith JP, Mietinen OS. Survival of patients with stage I lung cancer detected on CT screening. N Engl J Med 2006;355:1763–1771.

    Article  PubMed  Google Scholar 

  15. Chirikos TN, Hazelton T, Tockman M, Clark R. Screening for lung cancer with CT: a preliminary cost-effectiveness analysis. Chest 2002;121:1507–1514.

    Article  PubMed  Google Scholar 

  16. Hanley JA, McNeil BJ. The meaning and use of area under a receiver operating characteristic (ROC) curve. Radiology 1982;143:23–36.

    Google Scholar 

  17. Morimoto T, Iinuma G, Shiraishi J, Arai Y, Moriyama N, Beddoe G, et al. Computer-aided detection in computed tomography colonography: current status and problem with detection of early colorectal cancer Radiat Med 2008;26:261–269.

    Article  PubMed  Google Scholar 

  18. Li F, Arimura H, Suzuki K, Shiraishi J, Li Q, Abe H, et al. Computer-aided detection of peripheral lung cancer missed at CT: ROC analyses without and with localization radiology 2005;237:684–690.

    Google Scholar 

  19. Armato SG III, Li F, Giger ML, MacMahon H, Sone S, Doi K. Performance of automated CT nodule detection on missed cancers from a lung cancer screening program. Radiology 2002;225:685–692.

    Article  PubMed  Google Scholar 

  20. Awai K, Murao K, Ozawa A, Komi M, Hayakawa H, Hori S, et al. Pulmonary nodules at chest CT: effect of computeraided diagnosis on radiologists’ detection performance. Radiology 2004;230:347–352.

    Article  PubMed  Google Scholar 

  21. Gurcan MN, Sahiner B, Petrick N, Chan HP, Kazerooni EA, Philip N, et al. Lung nodule detection on thoracic computed tomography images: preliminary evaluation of a computeraided diagnosis system. Med Phys 2002;29:2552–2558.

    Article  PubMed  Google Scholar 

  22. MacMahon H, Engelmann R, Behlen FM, Hoffmann KR, Ishida T, Roe C, et al. Computer-aided diagnosis of pulmonary nodules: results of a large-scale observer test. Radiology 1999;213:723–726.

    CAS  PubMed  Google Scholar 

  23. Rubin GD, Lyo JK, Paik DS, Sherbondy AJ, Chow LC, Leung AN, et al. Pulmonary nodules on multi-detector row CT scans: performance comparison of radiologists and computer-aided detection. Radiology 2005;234:274–283.

    Article  PubMed  Google Scholar 

  24. Shiraishi J, Abe H, Engelmann R, Aoyama M, MacMahon H, Doi K. Computer-aided diagnosis to distinguish benign from malignant solitary pulmonary nodules on radiographs: ROC analysis of radiologists’ performance initial experience. Radiology 2003;227:469–474.

    Article  PubMed  Google Scholar 

  25. Wiemker R, Rogalla P, Zwartkruis A, Blaffert T. Computer aided lung nodule detection on high resolution CT data: medical imaging. Proc SPIE 2002;4684:677–688.

    Article  Google Scholar 

  26. Wormanns D, Fiebich M, Saidi M, Diederich S, Heindel W. Automatic detection of pulmonary nodules at spiral CT: clinical application of a computer-aided diagnosis system. Eur Radiol 2002;12:1052–1057.

    Article  PubMed  Google Scholar 

  27. Henschke CI, Yankelevitz DF, Mirtcheva R, McGuinness G, McCauley D, Miettinen OS. CT screening for lung cancer: frequency and significance of part-solid and nonsolid nodules. AJR Am J Roentgenol 2002;178:1053–1057.

    PubMed  Google Scholar 

  28. Fischbach F, Knollmann F, Griesshaber V, Freund T, Akkol E, Felix R. Detection of pulmonary nodules by multislice computed tomography: improved detection rate with reduced slice thickness. Eur Radiol 2003;13:2378–2383.

    Article  PubMed  Google Scholar 

  29. Henschke CI, Yankelevitz DF, Naidich DP, McCauley DI, McGuinness G, Libby DM, et al. CT screening for lung cancer: suspiciousness of nodules according to size on baseline scans. Radiology 2004;231:164–168.

    Article  PubMed  Google Scholar 

  30. Kostis WJ, Yankelevitz DF, Reeves AP, Fluture SC, Henschke CI. Small pulmonary nodules: reproducibility of threedimensional volumetric measurement and estimation of time to follow-up CT. Radiology 2004;231:446–452.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Hitachi Health Care Center, Hitachi Ltd., 4-3-16 Ose, Hitachi, 307-0076, Japan

    Suzushi Kusano & Toru Nakagawa

  2. Department of Radiology, University of Occupational and Environmental Health School of Medicine, Kitakyushu, Japan

    Takatoshi Aoki & Yukunori Korogi

  3. Hitachi General Hospital, Hitachi, Japan

    Takeshi Nawa

  4. Hitachi Medical Corporation, Tokyo, Japan

    Kuniyoshi Nakashima & Yoshihiro Goto

Authors
  1. Suzushi Kusano
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Toru Nakagawa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Takatoshi Aoki
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Takeshi Nawa
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kuniyoshi Nakashima
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yoshihiro Goto
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Yukunori Korogi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Suzushi Kusano.

About this article

Cite this article

Kusano, S., Nakagawa, T., Aoki, T. et al. Efficacy of computer-aided diagnosis in lung cancer screening with low-dose spiral computed tomography: receiver operating characteristic analysis of radiologists’ performance. Jpn J Radiol 28, 649–655 (2010). https://doi.org/10.1007/s11604-010-0486-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11604-010-0486-1

Key words

Search

Navigation