Korean Journal of Radiology

The Korean Society of Radiology (대한영상의학회)
권호 표지
DOI QR코드

DOI QR Code

Computer-Aided Detection of Malignant Lung Nodules on Chest Radiographs: Effect on Observers' Performance

  • Lee, Kyung Hee (Department of Radiology, Seoul National University College of Medicine, Institute of Radiation Medicine, Seoul National University Medical Research Center) ;
  • Goo, Jin Mo (Department of Radiology, Seoul National University College of Medicine, Institute of Radiation Medicine, Seoul National University Medical Research Center) ;
  • Park, Chang Min (Department of Radiology, Seoul National University College of Medicine, Institute of Radiation Medicine, Seoul National University Medical Research Center) ;
  • Lee, Hyun Ju (Department of Radiology, Seoul National University College of Medicine, Institute of Radiation Medicine, Seoul National University Medical Research Center) ;
  • Jin, Kwang Nam (Department of Radiology, Seoul National University College of Medicine, Institute of Radiation Medicine, Seoul National University Medical Research Center)
  • Published : 2012.10.01
⟨ Previous Next ⟩

Abstract

Objective: To evaluate the effect of computer-aided detection (CAD) system on observer performance in the detection of malignant lung nodules on chest radiograph. Materials and Methods: Two hundred chest radiographs (100 normal and 100 abnormal with malignant solitary lung nodules) were evaluated. With CT and histological confirmation serving as a reference, the mean nodule size was 15.4 mm (range, 7-20 mm). Five chest radiologists and five radiology residents independently interpreted both the original radiographs and CAD output images using the sequential testing method. The performances of the observers for the detection of malignant nodules with and without CAD were compared using the jackknife free-response receiver operating characteristic analysis. Results: Fifty-nine nodules were detected by the CAD system with a false positive rate of 1.9 nodules per case. The detection of malignant lung nodules significantly increased from 0.90 to 0.92 for a group of observers, excluding one first-year resident (p = 0.04). When lowering the confidence score was not allowed, the average figure of merit also increased from 0.90 to 0.91 (p = 0.04) for all observers after a CAD review. On average, the sensitivities with and without CAD were 87% and 84%, respectively; the false positive rates per case with and without CAD were 0.19 and 0.17, respectively. The number of additional malignancies detected following true positive CAD marks ranged from zero to seven for the various observers. Conclusion: The CAD system may help improve observer performance in detecting malignant lung nodules on chest radiographs and contribute to a decrease in missed lung cancer.

Keywords

References

  1. Muhm JR, Miller WE, Fontana RS, Sanderson DR, Uhlenhopp MA. Lung cancer detected during a screening program using four-month chest radiographs. Radiology 1983;148:609-615 https://doi.org/10.1148/radiology.148.3.6308709
  2. Austin JH, Romney BM, Goldsmith LS. Missed bronchogenic carcinoma: radiographic findings in 27 patients with a potentially resectable lesion evident in retrospect. Radiology 1992;182:115-122 https://doi.org/10.1148/radiology.182.1.1727272
  3. Monnier-Cholley L, Arrive L, Porcel A, Shehata K, Dahan H, Urban T, et al. Characteristics of missed lung cancer on chest radiographs: a French experience. Eur Radiol 2001;11:597-605 https://doi.org/10.1007/s003300000595
  4. Quekel LG, Kessels AG, Goei R, van Engelshoven JM. Miss rate of lung cancer on the chest radiograph in clinical practice. Chest 1999;115:720-724 https://doi.org/10.1378/chest.115.3.720
  5. Choi EJ, Jin GY, Han YM, Lee YS, Kweon KS. Solitary pulmonary nodule on helical dynamic CT scans: analysis of the enhancement patterns using a computer-aided diagnosis (CAD) system. Korean J Radiol 2008;9:401-408 https://doi.org/10.3348/kjr.2008.9.5.401
  6. Song KD, Chung MJ, Kim HC, Jeong SY, Lee KS. Usefulness of the CAD system for detecting pulmonary nodule in real clinical practice. Korean J Radiol 2011;12:163-168 https://doi.org/10.3348/kjr.2011.12.2.163
  7. Goo JM. A computer-aided diagnosis for evaluating lung nodules on chest CT: the current status and perspective. Korean J Radiol 2011;12:145-155 https://doi.org/10.3348/kjr.2011.12.2.145
  8. Kakeda S, Moriya J, Sato H, Aoki T, Watanabe H, Nakata H, et al. Improved detection of lung nodules on chest radiographs using a commercial computer-aided diagnosis system. AJR Am J Roentgenol 2004;182:505-510 https://doi.org/10.2214/ajr.182.2.1820505
  9. Shiraishi J, Li F, Doi K. Computer-aided diagnosis for improved detection of lung nodules by use of posterior-anterior and lateral chest radiographs. Acad Radiol 2007;14:28-37 https://doi.org/10.1016/j.acra.2006.09.057
  10. Bley TA, Baumann T, Saueressig U, Pache G, Treier M, Schaefer O, et al. Comparison of radiologist and CAD performance in the detection of CT-confirmed subtle pulmonary nodules on digital chest radiographs. Invest Radiol 2008;43:343-348 https://doi.org/10.1097/RLI.0b013e318168f705
  11. He Q, He W, Wang K, Ma D. Effect of multiscale processing in digital chest radiography on automated detection of lung nodule with a computer assistance system. J Digit Imaging 2008;21 Suppl 1:S164-S170 https://doi.org/10.1007/s10278-007-9094-8
  12. Kasai S, Li F, Shiraishi J, Doi K. Usefulness of computer-aided diagnosis schemes for vertebral fractures and lung nodules on chest radiographs. AJR Am J Roentgenol 2008;191:260-265 https://doi.org/10.2214/AJR.07.3091
  13. Li F, Engelmann R, Metz CE, Doi K, MacMahon H. Lung cancers missed on chest radiographs: results obtained with a commercial computer-aided detection program. Radiology 2008;246:273-280 https://doi.org/10.1148/radiol.2461061848
  14. van Beek EJ, Mullan B, Thompson B. Evaluation of a realtime interactive pulmonary nodule analysis system on chest digital radiographic images: a prospective study. Acad Radiol 2008;15:571-575 https://doi.org/10.1016/j.acra.2008.01.018
  15. White CS, Flukinger T, Jeudy J, Chen JJ. Use of a computeraided detection system to detect missed lung cancer at chest radiography. Radiology 2009;252:273-281 https://doi.org/10.1148/radiol.2522081319
  16. de Hoop B, De Boo DW, Gietema HA, van Hoorn F, Mearadji B, Schijf L, et al. Computer-aided detection of lung cancer on chest radiographs: effect on observer performance. Radiology 2010;257:532-540 https://doi.org/10.1148/radiol.10092437
  17. Chakraborty DP. Analysis of location specific observer performance data: validated extensions of the jackknife freeresponse (JAFROC) method. Acad Radiol 2006;13:1187-1193 https://doi.org/10.1016/j.acra.2006.06.016
  18. Giger ML, Chan HP, Boone J. Anniversary paper: History and status of CAD and quantitative image analysis: the role of Medical Physics and AAPM. Med Phys 2008;35:5799-5820 https://doi.org/10.1118/1.3013555
  19. Li Q, Li F, Shiraishi J, Katsuragawa S, Sone S, Doi K. Investigation of new psychophysical measures for evaluation of similar images on thoracic computed tomography for distinction between benign and malignant nodules. Med Phys 2003;30:2584-2593 https://doi.org/10.1118/1.1605351

Cited by

  1. Computer-aided Detection Improves Detection of Pulmonary Nodules in Chest Radiographs beyond the Support by Bone-suppressed Images vol.272, pp.1, 2012, https://doi.org/10.1148/radiol.14131315
  2. New methods for using computer-aided detection information for the detection of lung nodules on chest radiographs. vol.87, pp.1036, 2014, https://doi.org/10.1259/bjr.20140015
  3. Does the Reporting Quality of Diagnostic Test Accuracy Studies, as Defined by STARD 2015, Affect Citation? vol.17, pp.5, 2016, https://doi.org/10.3348/kjr.2016.17.5.706
  4. Selection and Reporting of Statistical Methods to Assess Reliability of a Diagnostic Test: Conformity to Recommended Methods in a Peer-Reviewed Journal vol.18, pp.6, 2017, https://doi.org/10.3348/kjr.2017.18.6.888
  5. Development and Validation of a Deep Learning-Based Automated Detection Algorithm for Major Thoracic Diseases on Chest Radiographs vol.2, pp.3, 2019, https://doi.org/10.1001/jamanetworkopen.2019.1095
  6. Clinical Implementation of Deep Learning in Thoracic Radiology: Potential Applications and Challenges vol.21, pp.5, 2012, https://doi.org/10.3348/kjr.2019.0821
  7. Deep Convolutional Neural Network-based Software Improves Radiologist Detection of Malignant Lung Nodules on Chest Radiographs vol.294, pp.1, 2012, https://doi.org/10.1148/radiol.2019182465
  8. Medical Image Perception Research in the Emerging Age of Artificial Intelligence vol.294, pp.1, 2020, https://doi.org/10.1148/radiol.2019192252
  9. Deep Learning-based Automatic Detection Algorithm for Reducing Overlooked Lung Cancers on Chest Radiographs vol.296, pp.3, 2012, https://doi.org/10.1148/radiol.2020200165
  10. Artificial Intelligence Tools for Refining Lung Cancer Screening vol.9, pp.12, 2020, https://doi.org/10.3390/jcm9123860
  11. Added Value of Deep Learning-based Detection System for Multiple Major Findings on Chest Radiographs: A Randomized Crossover Study vol.299, pp.2, 2012, https://doi.org/10.1148/radiol.2021202818
  12. AI-based improvement in lung cancer detection on chest radiographs: results of a multi-reader study in NLST dataset vol.31, pp.12, 2021, https://doi.org/10.1007/s00330-021-08074-7
  13. The Added Effect of Artificial Intelligence on Physicians’ Performance in Detecting Thoracic Pathologies on CT and Chest X-ray: A Systematic Review vol.11, pp.12, 2012, https://doi.org/10.3390/diagnostics11122206