Journal of Technologic Dentistry (대한치과기공학회지)

Korean Academy of Dental Technology (대한치과기공학회)
권호 표지
DOI QR코드

DOI QR Code

Analysis of the difficulty and discrimination of paper-based tests and computer-based tests according to item response theory: focusing on the National Dental Technician Examination

문항반응이론에 따른 지필 시험과 컴퓨터적용 시험의 난이도와 변별도 분석: 치과기공사 국가시험을 중심으로

  • Received : 2022.08.05
  • Accepted : 2022.09.19
  • Published : 2022.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

Purpose: This study analyzes the difficulty and discrimination of the paper-based test (PBT) and the computer-based test (CBT) according to item response theory, focusing on the National Dental Technician Examination. Methods: A mock test was conducted from September 15 to 23, 2020, and the final 179 (1 out of 180 absentees)people were the subjects of this study. Both frequency analysis and factor analysis were performed. The collected data were analyzed using IBM SPSS Statistics ver. 18.0 (IBM) and jMetrik programs. The significance level was set to 0.05. Results: The difficulty of the mock test was more easily responded to in CBT. It was also predicted that the CBT could better measure the ability of test takers than the PBT could. Conclusion: The difficulty, discrimination, and reliability of the questions were not affected by the examination method through the mock test. The feasibility of a future change to the CBT was confirmed by the National Dental Technician Examination.

Keywords

References

  1. Kim KD. AI algorithm regulation study for 4th Industrial Revolution and ethical norms: the direction of intelligent informatization for national administration and local autonomy. Korean Local Gov Rev. 2021;23:23-48.
  2. Kim SC, Hong SK, Kim YI. A study on innovation of the personnel system for educational public service Employees - focusing on the promotion system of Gyeonggido office of education -. J Educ Cult. 2017;23:5-29. https://doi.org/10.24159/joec.2017.23.1.5
  3. Song ES, Kim B, Lim YJ, Lee JJ. Survey study on the preference of dental medical personnel for dental CAD/CAM milling machines. J Korean Acad Prosthodont. 2018;56:188-198. https://doi.org/10.4047/jkap.2018.56.3.188
  4. Jung KH, Kwon EY, Choi YK, Kim SY, Jeon HM, Park JK. Conservative and esthetic closure of maxillary midline diastema without creating "black triangle" using direct resin composite. J Dent Rehabil Appl Sci. 2017;33:163-168. https://doi.org/10.14368/jdras.2017.33.2.163
  5. Yoou SK, Kim JH, Cho JM, Um TH, Kim KY. A study on the implementation of improvement of national examination course for emergency medical technician. Seoul: Korea Health Personnel Licensing Examination Institute, 2009. Report No.: RE02-0905-19.
  6. Yoou SK, Won JS, Lee KJ, Han DK, Sung HJ, Lee HS, et al. Study on validity of the national examination based on smart device based test (SBT) by 7 types of healthcare occupation. Korean J Emerg Med Ser. 2018;22:7-34.
  7. Lim MK, Kim BH, Jung BK, Kim JK. A study on the implementation of improvement of national examination course for emergency medical technician. Seoul: Korea Health Personnel Licensing Examination Institute, 2015. Report No.: RE01-1536-00.
  8. Korea Health Personnel Licensing Examination Institute. What is CBT? [Internet]. Seoul: Korea Health Personnel Licensing Examination Institute [cited 2022 Aug 4]. Available from: https://www.kuksiwon.or.kr/cnt/c_2033/view.do?seq=10.
  9. Nam SY, Chung IS, Lee GS, Kim JH, Yu CH, Lee SK. A study on improvement of dental technicians practical examination system. J Korean Acad Dent Technol. 2014;36:27-37. https://doi.org/10.14347/kadt.2014.36.1.27
  10. Kim WS, Kim KB, Nam SY, Jung JK, Cho MH, Jeoung SH, et al. A study on the improvement of educational evaluation system in dental technician using Delphi technique. J Korean Acad Dent Technol. 2018;40:273-281.
  11. Lee CK, Lee SG, Cho KJ, Lee EI, Lee SJ, Park ES, et al. A comparative study of item analysis by item response theory based for initiating CAT (computer adaptive test) system. Korean J Clin Lab Sci. 2000;32:326-336.
  12. Lim MK, Seo MH, Heo S. National trial development research for computer-based healthcare providers. Seoul: Korea Health Personnel Licensing Examination Institute, 2015. Report No.: RE01-1545-00.
  13. Huh S. Can computerized tests be introduced to the Korean Medical Licensing Examination? J Korean Med Assoc. 2012;55:124-130. https://doi.org/10.5124/jkma.2012.55.2.124
  14. Choi CH, Park JH, Lee JB, Lee M, Kim H. Differential item functioning of multi-lingual Taekwondo knowledge test using multimedia. KSME. 2012;14:83-94.
  15. Park JH, Lee JB. Preliminary study on item characteristics of computerized physical education knowledge test with multimedia. KSME. 2009;11:93-102.
  16. Gim Y, Chung M, Kim J. A study on the actual condition and utilization plan of smart devices for educational purpose. J Korean Soc Internet Inf. 2013;14:47-55.
  17. Park YR, Kim MS, Lee GH. Basic study on smart device utilization behavior. Jincheon: Korea Information Society Development Institute, 2011 Dec. Report No.: 1105004176.