Journal of Society of Preventive Korean Medicine (대한예방한의학회지)

Society of Preventive Korean Medicine (대한예방한의학회)
권호 표지
DOI QR코드

DOI QR Code

A Survey on the Perception and Satisfaction of Korean Traditional Medical Students on Computer-Based Test

컴퓨터기반시험에 대한 한의과대학 학생들의 인식 및 만족도 조사

  • Kim, Mikyung (Department of Internal Medicine, College of Korean Medicine, Sangji University) ;
  • Han, Chang-ho (Department of Internal Medicine, College of Korean Medicine, Dongguk University)
  • 김미경 (상지대학교 한의과대학 내과학교실) ;
  • 한창호 (동국대학교 한의과대학 내과학교실)
  • Received : 2021.11.25
  • Accepted : 2021.12.18
  • Published : 2021.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Objectives : Computer-based test (CBT) will be introduced in the national examination of Korean medicine doctors from 2023. This study was aimed to provide some information, including prior considerations, to those preparing for CBT, by presenting a summary of the survey results from participants in a CBT simulation test. Methods : In December 2020, applicants from the graduating class of the college of Korean medicine from four universities participated in the simulation test for CBT. An online anonymous survey on the applicants' preference for CBT versus paper-based tests (PBT) was conducted. The questionnaire consisted of multiple-choice questions on a 5-point Likert scale and free-form questions. Results : A total of 176 students responded to the survey. Their response to CBT was generally positive. The item with the highest agreement was that it should provide a sufficient opportunity to experience CBT in the undergraduate exam (4.38±0.839). Concerns about the possibility of cheating or poor concentration were also detected. In addition to guaranteeing the stability of the CBT system, there were many comments expressing the need to supplement functions within the CBT system, including the memo or highlighter function. Conclusions : This study confirmed the feasibility of CBT including multimedia questions in the field of Korean medicine education and identified overall positive responses from those who experienced the CBT simulation test. Although time is short and there is so much to prepare, we hope this will be a leap forward for effective educational innovation in line with the changing environment of the health care education field.

Keywords

Acknowledgement

이 논문은 2020년 한국보건의료인국가시험원 용역사업으로 수행된 '한의사 컴퓨터 기반 국가시험의 도입방안과 문항 개발 및 평가' 연구비로 수행된 연구입니다.

References

  1. Ministry of Science and ICT. [Press Release] Announcement of the survey on Internet use in 2020 [cited in 2021.12.23. Available from: https://www.msit.go.kr/bbs/view.do?sCode=user&mId=113&mPid=112&pageIndex=&bbsSeqNo=94&nttSeqNo=3179980&searchOpt=ALL&searchTxt=%5d]
  2. Korea Health Personnel Licensing Examination Institute. [Web Page] Test Information: What is CBT? [cited in 2021.12.23. Available from: https://www.kuksiwon.or.kr/cnt/c_2033/view.do?seq=11]
  3. Park J-W, Jang L-C, Choi J-W, Lee S-J. The Experience of Web-Based Test in Medical Education. Korean Journal of Medical Education. 2006;18(2):183-92. https://doi.org/10.3946/kjme.2006.18.2.183
  4. Im E-J, Lee W-K, Lee Y-C, Choe B-H, Chung S-K, Lee T-H, et al. Development of Computer-Based Test (CBT) and Student Recognition Survey on CBT. Korean Journal of Medical Education. 2008;20(2):145-54. https://doi.org/10.3946/kjme.2008.20.2.145
  5. Huh S. Can computerized tests be introduced to the Korean Medical Licensing Examination? Journal of the Korean Medical Association. 2012;55(2):124-30. https://doi.org/10.5124/jkma.2012.55.2.124
  6. United States Medical Licensing Examination. [Web Page] USMLE Updates & Research. Performance Data 2020 [cited in 2021.12.23. Available from: https://www.usmle.org/usmle-updates-research/performance-data]
  7. Medical Council of Canada. [Web Page] MCCQE Examinations 2021 [cited in 2021.12.23. Available from: https://www.mcc.ca/examinations/mccqe-part-i/]
  8. Yoou S-K, Won J-S, Lee K-J, Han D-K, Sung H-J, Lee H-S, et al. Study on validity of the National Examination based on smart device based test (SBT) by 7 types of healthcare occupation. Korean Journal of Emergency Medical Services. 2018;22(3):7-34. https://doi.org/10.14408/KJEMS.2018.22.3.007
  9. Korea Health Personnel Licensing Examination Institute. [Report] Mid- to Long-term management goals for 2021-2025 of KHPLEI. KHPLEI. 2020.
  10. Korea Health Personnel Licensing Examination Institute. [Press Release] Change of Test Method for National Examination (Paper-written test) for Doctors, Dentists and Korean Medicine Doctors 2019 [cited in 2021.12.23. Available from: https://www.kuksiwon.or.kr/news/brd/m_54/view.do?seq=367&srchFr=&srchTo=&srchWord=&srchTp=&itm_seq_1=0&itm_seq_2=0&multi_itm_seq=0&company_cd=&company_nm=]
  11. Korea Health Personnel Licensing Examination Institute. [Report] Current Status of Introduction of Computer-based Test (SBT). KHPLEI. 2014.
  12. Han C-h. [Report] Computer-based Test Introduction Plan for the National Examination of Korean Medicine Doctors and Development and evaluation of Questions in Preparation. KHPLEI. 2021.
  13. Huh S. [Report] Study on the implemenation Plan for Smart device Based Test (SBT). KHPLEI. 2015.
  14. Jooah Kim, Kim S-Y. Student Responses to Smart Device-Based Test on Competency Evaluation in Dental Education. J Korean Dent Sci. 2019;12(2):58-65. https://doi.org/10.5856/JKDS.2019.12.2.58
  15. Yim MK. [Report] Basic Research for Test Execution Using Computer. KHPLEI. 2006.
  16. Kwon OY, Rhee SY, Choi JM, Kim YS. Usefulness of ubiquitous-based testing for evaluations in medical education. Korean Journal of Medical Education. 2015;27(1):3-10. https://doi.org/10.3946/kjme.2015.27.1.3
  17. Kim J-H, Kim H-C. Implementation of ubiquitous-based test (UBT) and students' perceptions of UBT in dental education. The Journal of the Korean Dental Association. 2021;59(5):275-86. https://doi.org/10.22974/JKDA.2021.59.5.002
  18. Kim SG, Lee A, Hwang I. Analysis of the Satisfaction with Computer Based Test Program and Test Environment in Medical School. Korean Medical Education Review. 2020;22 (3):198-206. https://doi.org/10.17496/KMER.2020.22.3.198
  19. Lee J-m, Kam BS. A Deterrent method for Cheating in CBT (Computer-Based Testing) Applications. Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology. 2018;8(1):825-35.
  20. Kim JS. [Report] A Study on the Implementation Plan for the Improvement of the National Examination for Dentists. KHPLEI. 2005.
  21. Kim SH, Cho S-Y. Security Improvement Methods for Computer-based Test Systems. Convergence Security Journal. 2018;18(2):
  22. Park H-K. [Report] A Study on Test Takers' Fatigue According to the Computer-based Test (CBT). KHPLEI. 2021.
  23. Akomnews. [News] The Test End Time Will Be Extended by 20 minutes from the 2023 National Examination for Korean Medicine Doctors. 2021 [cited in 2021.12.23. Available from: https://www.akomnews.com/bbs/board.php?bo_table=news&wr_id=44531]
  24. Korea Health Personnel Licensing Examination Institute. [Web page] Experience CBT: What is CBT Tutorial? 2021 [cited in 2021.12.23. Available from: https://www.kuksiwon.or.kr/cnt/c_3004/view.do?seq=11]
  25. Young Doctors. [News] Pilot Test for Introduction of CBT in National Medical Examination: More Than 9 out of 10 Medical Students Are 'Satisfied'. 2021 [cited in 2021.12.23. Availble from: https://www.docdocdoc.co.kr/news/articleView.html?idxno=2013909]
  26. Jo H-j. Exploring the Conditions that will Allow for Change in Traditional Korean Medicine Curricula - Focusing on the Integrated Curriculum -. The Journal of Korean Medical Classics 2020;33(3):63-89. https://doi.org/10.14369/JKMC.2020.33.3.063