Korean Journal of Radiology

  • 제24권9호
  • /
  • Pages.890-902
  • /
  • 2023
  • /
  • 1229-6929(pISSN)
  • /
  • 2005-8330(eISSN)
대한영상의학회 (The Korean Society of Radiology)
권호 표지
DOI QR코드

DOI QR Code

Effects of Implementing Artificial Intelligence-Based Computer-Aided Detection for Chest Radiographs in Daily Practice on the Rate of Referral to Chest Computed Tomography in Pulmonology Outpatient Clinic

  • Wonju Hong (Department of Radiology, Hallym University Sacred Heart Hospital) ;
  • Eui Jin Hwang (Department of Radiology, Seoul National University Hospital, Seoul National University College of Medicine) ;
  • Chang Min Park (Department of Radiology, Seoul National University Hospital, Seoul National University College of Medicine) ;
  • Jin Mo Goo (Department of Radiology, Seoul National University Hospital, Seoul National University College of Medicine)
  • 투고 : 2023.01.08
  • 심사 : 2023.06.26
  • 발행 : 2023.09.01
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

Objective: The clinical impact of artificial intelligence-based computer-aided detection (AI-CAD) beyond diagnostic accuracy remains uncertain. We aimed to investigate the influence of the clinical implementation of AI-CAD for chest radiograph (CR) interpretation in daily practice on the rate of referral for chest computed tomography (CT). Materials and Methods: AI-CAD was implemented in clinical practice at the Seoul National University Hospital. CRs obtained from patients who visited the pulmonology outpatient clinics before (January-December 2019) and after (January-December 2020) implementation were included in this study. After implementation, the referring pulmonologist requested CRs with or without AI-CAD analysis. We conducted multivariable logistic regression analyses to evaluate the associations between using AI-CAD and the following study outcomes: the rate of chest CT referral, defined as request and actual acquisition of chest CT within 30 days after CR acquisition, and the CT referral rates separately for subsequent positive and negative CT results. Multivariable analyses included various covariates such as patient age and sex, time of CR acquisition (before versus after AI-CAD implementation), referring pulmonologist, nature of the CR examination (baseline versus follow-up examination), and radiology reports presence at the time of the pulmonology visit. Results: A total of 28546 CRs from 14565 patients (mean age: 67 years; 7130 males) and 25888 CRs from 12929 patients (mean age: 67 years; 6435 males) before and after AI-CAD implementation were included. The use of AI-CAD was independently associated with increased chest CT referrals (odds ratio [OR], 1.33; P = 0.008) and referrals with subsequent negative chest CT results (OR, 1.46; P = 0.005). Meanwhile, referrals with positive chest CT results were not significantly associated with AI-CAD use (OR, 1.08; P = 0.647). Conclusion: The use of AI-CAD for CR interpretation in pulmonology outpatients was independently associated with an increased frequency of overall referrals for chest CT scans and referrals with subsequent negative results.

키워드

참고문헌

  1. Nam JG, Kim M, Park J, Hwang EJ, Lee JH, Hong JH, et al. Development and validation of a deep learning algorithm detecting 10 common abnormalities on chest radiographs. Eur Respir J 2021;57:2003061
  2. Hwang EJ, Nam JG, Lim WH, Park SJ, Jeong YS, Kang JH, et al. Deep learning for chest radiograph diagnosis in the emergency department. Radiology 2019;293:573-580
  3. Dunnmon JA, Yi D, Langlotz CP, Re C, Rubin DL, Lungren MP. Assessment of convolutional neural networks for automated classification of chest radiographs. Radiology 2019;290:537-544
  4. Majkowska A, Mittal S, Steiner DF, Reicher JJ, McKinney SM, Duggan GE, et al. Chest radiograph interpretation with deep learning models: assessment with radiologist-adjudicated reference standards and population-adjusted evaluation. Radiology 2020;294:421-431
  5. Nam JG, Park S, Hwang EJ, Lee JH, Jin KN, Lim KY, et al. Development and validation of deep learning-based automatic detection algorithm for malignant pulmonary nodules on chest radiographs. Radiology 2019;290:218-228
  6. Sung J, Park S, Lee SM, Bae W, Park B, Jung E, et al. Added value of deep learning-based detection system for multiple major findings on chest radiographs: a randomized crossover study. Radiology 2021;299:450-459
  7. Hong W, Hwang EJ, Lee JH, Park J, Goo JM, Park CM. Deep learning for detecting pneumothorax on chest radiographs after needle biopsy: clinical implementation. Radiology 2022;303:433-441
  8. Hwang EJ, Lee JS, Lee JH, Lim WH, Kim JH, Choi KS, et al. Deep Learning for detection of pulmonary metastasis on chest radiographs. Radiology 2021;301:455-463
  9. Lee S, Shin HJ, Kim S, Kim EK. Successful implementation of an artificial intelligence-based computer-aided detection system for chest radiography in daily clinical practice. Korean J Radiol 2022;23:847-852
  10. Hwang EJ, Goo JM, Yoon SH, Beck KS, Seo JB, Choi BW, et al. Use of artificial intelligence-based software as medical devices for chest radiography: a position paper from the Korean Society of Thoracic Radiology. Korean J Radiol 2021;22:1743-1748
  11. European Society of Radiology (ESR). Current practical experience with artificial intelligence in clinical radiology: a survey of the European Society of Radiology. Insights Imaging 2022;13:107
  12. van Leeuwen KG, Schalekamp S, Rutten MJCM, van Ginneken B, de Rooij M. Artificial intelligence in radiology: 100 commercially available products and their scientific evidence. Eur Radiol 2021;31:3797-3804
  13. Fryback DG, Thornbury JR. The efficacy of diagnostic imaging. Med Decis Making 1991;11:88-94
  14. Park SH, Han K. Methodologic guide for evaluating clinical performance and effect of artificial intelligence technology for medical diagnosis and prediction. Radiology 2018;286:800-809
  15. Kim DW, Jang HY, Kim KW, Shin Y, Park SH. Design characteristics of studies reporting the performance of artificial intelligence algorithms for diagnostic analysis of medical images: results from recently published papers. Korean J Radiol 2019;20:405-410
  16. Expert Panel on Thoracic Imaging. ACR Appropriateness Criteria((R)) acute respiratory illness in immunocompetent patients. J Am Coll Radiol 2018;15:S240-S251
  17. Heitkamp DE, Albin MM, Chung JH, Crabtree TP, Iannettoni MD, Johnson GB, et al. ACR Appropriateness Criteria(R) acute respiratory illness in immunocompromised patients. J Thorac Imaging 2015;30:W2-W5
  18. Hoffmann U, Akers SR, Brown RK, Cummings KW, Cury RC, Greenberg SB, et al. ACR Appropriateness Criteria acute nonspecific chest pain-low probability of coronary artery disease. J Am Coll Radiol 2015;12(12 Pt A):1266-1271
  19. Ketai LH, Mohammed TL, Kirsch J, Kanne JP, Chung JH, Donnelly EF, et al. ACR Appropriateness Criteria(R) hemoptysis. J Thorac Imaging 2014;29:W19-W22
  20. Hwang EJ, Park S, Jin KN, Kim JI, Choi SY, Lee JH, et al. Development and validation of a deep learning-based automatic detection algorithm for active pulmonary tuberculosis on chest radiographs. Clin Infect Dis 2019;69:739-747