DOI QR코드

DOI QR Code

Survey of the Knowledge of Korean Radiology Residents on Medical Artificial Intelligence

의료 인공지능에 대한 대한민국 영상의학과 전공의의 인식 조사 연구

  • Hyeonbin Lee (Department of Radiology, Korea University Ansan Hospital) ;
  • Seong Ho Park (Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center) ;
  • Cherry Kim (Department of Radiology, Korea University Ansan Hospital) ;
  • Seungkwan Kim (Department of Radiology, Korea University Ansan Hospital) ;
  • Jaehyung Cha (Medical Science Research Center, Korea University College of Medicine)
  • 이현빈 (고려대학교 안산병원 영상의학과) ;
  • 박성호 (울산대학교 의과대학 서울아산병원 영상의학과, 영상의학과 연구소) ;
  • 김채리 (고려대학교 안산병원 영상의학과) ;
  • 김승관 (고려대학교 안산병원 영상의학과) ;
  • 차재형 (고려대학교 의과대학 의과학연구지원센터)
  • Received : 2019.11.01
  • Accepted : 2020.02.23
  • Published : 2020.11.01

Abstract

Purpose To survey the perception, knowledge, wishes, and expectations of Korean radiology residents regarding artificial intelligence (AI) in radiology. Materials and Methods From June 4th to 7th, 2019, questionnaires comprising 19 questions related to AI were distributed to 113 radiology residents. Results were analyzed based on factors such as the year of residency and location and number of beds of the hospital. Results A total of 101 (89.4%) residents filled out the questionnaire. Fifty (49.5%) respondents had studied AI harder than the average while 68 (67.3%) had a similar or higher understanding of AI than the average. In addition, the self-evaluation and knowledge level of AI were significantly higher for radiology residents at hospitals located in Seoul and Gyeonggi-do compared to radiology residents at hospitals located in other regions. Furthermore, the self-evaluation and knowledge level of AI were significantly lower in junior residents than in residents in the 4th year of training. Of the 101 respondents, only 16 (15.8%) had experiences in AI-related study while 91 (90%) were willing to participate in AI-related study in the future. Conclusion Organizational efforts through a radiology society would be needed to meet the need of radiology trainees for AI education and to promote the role of radiologists more adequately in the era of medical AI.

목적 이 연구는 인공지능(artificial intelligence; 이하 AI)에 대한 영상의학과 전공의들의 인식 및 의견을 알아보고자 하였다. 대상과 방법 2019년 6월 4일부터 7일까지 AI와 관련한 18개의 객관식 문항과 1개의 주관식 문항이 포함된 설문의 응답을 받았다. 모집된 결과를 로지스틱 회귀분석을 이용하여 전공의 연차, 소속 병원의 위치 및 규모 등의 요인에 따라 분석하였다. 결과 총 101명(89.4%)의 전공의가 응답하였다. AI의 지식적 측면에서 응답자의 50명(49.5%)이 AI에 대해 평균 이상으로 공부하고 있으며, 68명(67.3%)이 AI 관련 용어에 대한 이해도가 평균 이상이라고 응답하였다. 또한 서울 및 경기 지역 응답자가 기타 지역 응답자에 비하여 AI에 대한 자가 평가 및 지식수준이 의미 있게 높았으며, 4년차 전공의에 비해 1~2년차 전공의가 AI에 대한 자가 평가 및 지식수준이 의미 있게 낮았다. AI 관련 연구에 참여해본 적 있는 전공의는 15.8%이었지만, 추후 연구 참여 의향이 있는 전공의는 90%에 달하였다. 전공의 들은 또한 학회 주도의 AI 교육 및 적극적 홍보를 원하고 있었다. 결론 영상의학과 전공의의 AI 교육 수요를 충족시키고, 의료 AI 시대의 영상의학과 의사의 역할을 제대로 알리기 위해 보다 많은 학회 차원의 노력이 요청된다.

Keywords

References

  1. Lee JG, Jun S, Cho YW, Lee H, Kim GB, Seo JB, et al. Deep learning in medical imaging: general overview. Korean J Radiol 2017;18:570-584 https://doi.org/10.3348/kjr.2017.18.4.570
  2. Zhou SK, Greenspan H, Shen D. Deep learning for medical image analysis. Cambridge, Massachusetts: Academic Press 2017
  3. Song KD, Kim M, Do S. The latest trends in the use of deep learning in radiology illustrated through the stages of deep learning algorithm development. J Korean Soc Radiol 2019;80:202-212 https://doi.org/10.3348/jksr.2019.80.2.202
  4. Chartrand G, Cheng PM, Vorontsov E, Drozdzal M, Turcotte S, Pal CJ, et al. Deep learning: a primer for radiologists. Radiographics 2017;37:2113-2131 https://doi.org/10.1148/rg.2017170077
  5. Jha S, Topol EJ. Adapting to artificial intelligence: radiologists and pathologists as information specialists. JAMA 2016;316:2353-2354 https://doi.org/10.1001/jama.2016.17438
  6. Topol EJ. High-performance medicine: the convergence of human and artificial intelligence. Nat Med 2019;25:44-56 https://doi.org/10.1038/s41591-018-0300-7
  7. Park SH, Do KH, Choi JI, Sim JS, Yang DM, Eo H, et al. Principles for evaluating the clinical implementation of novel digital healthcare devices. J Korean Med Assoc 2018;61:765-775 https://doi.org/10.5124/jkma.2018.61.12.765
  8. Parikh RB, Obermeyer Z, Navathe AS. Regulation of predictive analytics in medicine. Science 2019;363:810-812 https://doi.org/10.1126/science.aaw0029
  9. Park SH, Han K. Methodologic guide for evaluating clinical performance and effect of artificial intelligence technology for medical diagnosis and prediction. Radiology 2018;286:800-809 https://doi.org/10.1148/radiol.2017171920
  10. Kim DW, Jang HY, Kim KW, Shin Y, Park SH. Design characteristics of studies reporting the performance of artificial intelligence algorithms for diagnostic analysis of medical images: results from recently published papers. Korean J Radiol 2019;20:405-410 https://doi.org/10.3348/kjr.2019.0025
  11. Kim H, Jung DC, Choi BW. Exploiting the vulnerability of deep learning-based artificial intelligence models in medical imaging: adversarial attacks. J Korean Soc Radiol 2019;80:259-273 https://doi.org/10.3348/jksr.2019.80.2.259
  12. Zech JR, Badgeley MA, Liu M, Costa AB, Titano JJ, Oermann EK. Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: a cross-sectional study. PLoS Med 2018;15:e1002683
  13. Yu KH, Kohane IS. Framing the challenges of artificial intelligence in medicine. BMJ Qual Saf 2019;28:238-241 https://doi.org/10.1136/bmjqs-2018-008551
  14. Ridley EL. Deep learning algorithms need real world testing. Available at. https://www.auntminnie.com/index.aspx?sec=rca&sub=rsna_2018&pag=dis&ItemID=12387. Published 2018. Accessed Oct 29, 2019
  15. Greaves F, Joshi I, Campbell M, Roberts S, Patel N, Powell J. What is an appropriate level of evidence for a digital health intervention? Lancet 2019;392:2665-2667 https://doi.org/10.1016/S0140-6736(18)33129-5
  16. No-authors listed. AI diagnostics need attention. Nature 2018;555:285
  17. Waymel Q, Badr S, Demondion X, Cotten A, Jacques T. Impact of the rise of artificial intelligence in radiology: what do radiologists think? Diagn Interv Imaging 2019;100:327-336 https://doi.org/10.1016/j.diii.2019.03.015
  18. Oh S, Kim JH, Choi SW, Lee HJ, Hong J, Kwon SH. Physician confidence in artificial intelligence: an online mobile survey. J Med Internet Res 2019;21:e12422
  19. Pinto Dos Santos D, Giese D, Brodehl S, Chon SH, Staab W, Kleinert R, et al. Medical students' attitude towards artificial intelligence: a multicentre survey. Eur Radiol 2019;29:1640-1646 https://doi.org/10.1007/s00330-018-5601-1
  20. Collado-Mesa F, Alvarez E, Arheart K. The role of artificial intelligence in diagnostic radiology: a survey at a single radiology residency training program. J Am Coll Radiol 2018;15:1753-1757 https://doi.org/10.1016/j.jacr.2017.12.021