DOI QR코드

DOI QR Code

Research on the Evaluation and Utilization of Constitutional Diagnosis by Korean Doctors using AI-based Evaluation Tool

인공지능 기반 평가 도구를 이용한 한의사의 체질 진단 평가 및 활용 방안에 대한 연구

  • Park, Musun (KM Data Division, Korea Institute of Oriental Medicine) ;
  • Hwang, Minwoo (Department of Sasang Constitutional Medicine, College of Korean Medicine, Kyung Hee University) ;
  • Lee, Jeongyun (Department of Sasang Constitutional Medicine, Division of Clinical Medicine 4, School of Korean Medicine, Pusan National University) ;
  • Kim, Chang-Eop (Department of Physiology, College of Korean Medicine, Gachon University) ;
  • Kwon, Young-Kyu (Division of Longevity and Biofunctional Medicine, School of Korean Medicine, Pusan National University)
  • 박무순 (한국한의학연구원 한의약데이터부) ;
  • 황민우 (경희대학교 한의과대학 사상체질과) ;
  • 이정윤 (부산대학교 한의학전문대학원 임상의학4교실 사상체질과) ;
  • 김창업 (가천대학교 한의과대학 생리학교실) ;
  • 권영규 (부산대학교 한의학전문대학원 양생기능의학교실)
  • Received : 2021.12.14
  • Accepted : 2022.03.16
  • Published : 2022.04.25

Abstract

Since Traditional Korean medicine (TKM) doctors use various knowledge systems during treatment, diagnosis results may differ for each TKM doctor. However, it is difficult to explain all the reasons for the diagnosis because TKM doctors use both explicit and implicit knowledge. In this study, an upgraded random forest (RF)-based evaluation tool was proposed to extract clinical knowledge of TKM doctors. Also, it was confirmed to what extent the professor's clinical knowledge was delivered to the trainees by using the evaluation tool. The data used to construct the evaluation tool were targeted at 106 people who visited the Sasang Constitutional Department at Kyung Hee University Korean Medicine Hospital at Gangdong. For explicit knowledge extraction, four TKM doctors were asked to express the importance of symptoms as scores. In addition, for implicit knowledge extraction, importance score was confirmed in the RF model that learned the patient's symptoms and the TKM doctor's constitutional determination results. In order to confirm the delivery of clinical knowledge, the similarity of symptoms that professors and trainees consider important when discriminating constitution was calculated using the Jaccard coefficient. As a result of the study, our proposed tool was able to successfully evaluate the clinical knowledge of TKM doctors. Also, it was confirmed that the professor's clinical knowledge was delivered to the trainee. Our tool can be used in various fields such as providing feedback on treatment, education of training TKM doctors, and development of AI in TKM.

Keywords

Acknowledgement

이 논문은 2020년 정부(과학기술정보통신부)의 재원으로 한국연구재단의 지원을 받아 수행된 기본연구사업(No. 2020R1F1A1075145), 그리고 한국한의학연구원 'AI 한의사 개발을 위한 임상 빅데이터 수집 및 서비스 플랫폼 구축 (KSN2021110)' 과제의 지원을 받아 수행된 연구임.

References

  1. Polanyi M, Sen A. The tacit dimension: University of Chicago press; 2009.
  2. Davies M. Knowledge (Explicit, Implicit and Tacit): Philosophical Aspects. International Encyclopedia of the Social & Behavioral Sciences: Second Edition: Academic Press; 2015. p. 74-90.
  3. Dummett M. The logical basis of metaphysics: Harvard university press; 1991.
  4. McCarthy J. What is artificial intelligence? 2007.
  5. NEsTIAN As, SilviuMihail T, GUTA AL, editors. Incorporating artificial intelligence in knowledge creation processes in organizations. Proceedings of the International Conference on Business Excellence; 2020: Sciendo.
  6. Christopher M. Nasrabadi N. Pattern Recognition and Machine Learning. Journal of Electronic Imaging. 2007;16(4):049901. https://doi.org/10.1117/1.2819119
  7. Park M, Kim MH, Park S-Y, Kang M, Choi I, Kim C-E. Development of an explicit and implicit knowledge identification tool for the analysis of the decision-making process of traditional Asian medicine doctors. MedRxiv. 2021.
  8. Park M, Lee M, Hwang M. Development of Diagnostic Indicator for the Sasang Constitution Exterior-Interior Disease Based on Original Symptom. Journal of Sasang Constitutional Medicine [Internet]. 2020 Dec 31;32(4):65-85.
  9. Shin S, Kim Y-H, Hwang M-W. Diagnosis and treatment principle in Sasang medicine: original symptom. Integrative Medicine Research. 2016;5(2):99-104. https://doi.org/10.1016/j.imr.2016.03.005
  10. Rudin C, Radin J. Why are we using black box models in AI when we don't need to? A lesson from an explainable AI competition. Harvard Data Science Review. 2019;1(2).
  11. Vens C, Costa F, editors. Random forest based feature induction. 2011 IEEE 11th international conference on data mining; 2011: IEEE.
  12. Menze BH, Kelm BM, Masuch R, Himmelreich U, Bachert P, Petrich W, et al. A comparison of random forest and its Gini importance with standard chemometric methods for the feature selection and classification of spectral data. BMC Bioinformatics. 2009;10:213. https://doi.org/10.1186/1471-2105-10-213
  13. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: Machine learning in Python. the Journal of machine Learning research. 2011;12:2825-30.
  14. Shannon P, Markiel A, Ozier O, Baliga NS, Wang JT, Ramage D, et al. Cytoscape: a software environment for integrated models of biomolecular interaction networks. Genome research. 2003;13(11):2498-504. https://doi.org/10.1101/gr.1239303
  15. Jaccard P. THE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE.1. New Phytologist. 1912;11(2):37-50. https://doi.org/10.1111/j.1469-8137.1912.tb05611.x
  16. Jang E, Lee EJ, Yun Y, Park YC, Jung IC. Suggestion of Standard Process in Developing Questionnaire of Pattern Identification. Journal of Physiology & Pathology in Korean Medicine. 2016;30(3):190-200. https://doi.org/10.15188/kjopp.2016.06.30.3.190
  17. Park C-H, Lim H-H. The Review on the Studies Using Delphi Method in the Journals of Korean Medicine from 2006 to 2015. Journal of Korean Medicine. 2015;25(3).
  18. Maeda-Minami A, Yoshino T, Katayama K, Horiba Y, Hikiami H, Shimada Y, et al. Prediction of deficiency-excess pattern in Japanese Kampo medicine: Multi-centre data collection. Complement Ther Med. 2019;45:228-33. https://doi.org/10.1016/j.ctim.2019.07.003
  19. Hudson K, Lifton R, Patrick-Lake B, Burchard EG, Coles T, Collins R. The precision medicine initiative cohort program-Building a Research Foundation for 21st Century Medicine. Precision Medicine Initiative (PMI) Working Group Report to the Advisory Committee to the Director, ed. 2015.