Browse > Article
http://dx.doi.org/10.17496/kmer.2020.22.3.198

Analysis of the Satisfaction with Computer Based Test Program and Test Environment in Medical School  

Kim, Soon Gu (Education Support Center, Keimyung University School of Medicine)
Lee, Aehwa (Education Support Center, Keimyung University School of Medicine)
Hwang, Ilseon (Education Support Center, Keimyung University School of Medicine)
Publication Information
Korean Medical Education Review / v.22, no.3, 2020 , pp. 198-206 More about this Journal
Abstract
This study aimed to identify needed improvements to current evaluation methods in medical school computer-based test (CBT) programs and test environments. To that end, an analysis of the importance and satisfaction was conducted through a survey of 3rd and 4th year medical students who had sufficient experience with CBT programs. Importance performance analysis methodology using the correlation coefficient was applied to assess average satisfaction and importance. The first quadrant (keep up the good work) was a factor of review and time management and test facilities among the conveniences of the CBT program. The second quadrant (concentrate here) was a factor of the convenience of the CBT program and computer monitor and chair factor within the test facilities. The third quadrant (low priority) was a factor of cheating and computer failure. The fourth quadrant (possible overkill) was the location, spacing, and temperature factors of the test facilities. Improvements are needed to reduce 'eye fatigue' and help students focus and understand the questions in the CBT programs. It is necessary to improve computer monitors, desks and chairs, and consider the subject's body type and manager in order to cope with computer breakdown and peripheral failures. Spare computers are needed. These findings are meaningful in that they have been able to identify factors that require improvement in the CBT program and test environment resulting from changes in assessment tools.
Keywords
Computer-based test; Evaluation; Importance performance analysis; Medical education;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 Lee JM, Kam B. A deterrent method for cheating in CBT(computer-based testing) applications. Asia Pac J Multimed Serv Converg Art Humanit Sociol. 2018;8(1):825-35.
2 Korea Health Personnel Licensing Examination Institute. Announcement of examination method changing for the national examination to physician, dentist and oriental doctor [Internet]. Seoul: Korea Health Personnel Licensing Examination Institute [cited 2020 Oct 22]. Available from: http://www.kuksiwon.or.kr/notice/brd/m_51/view.do?seq=2692&srchFr=&srchTo=&srchWord=&srchTp=&itm_seq_1=0&itm_seq_2=0&multi_itm_seq=0&company_cd=&company_nm.
3 Back SG, Hee CS. Computerized adaptive test. Seoul: Wonmisa; 1998.
4 Kim IS. An overview of computer-assisted English testing research and suggestions for developing a performance-based computer adaptive English listening test for elementary school students. J Humanit. 2003;9:55-87.
5 Kwon OY, Rhee SY, Choi JM, Kim YS, Kwon OY, Rhee SY, et al. Usefulness of ubiquitous-based testing for evaluations in medical education. Korean J Med Educ. 2015;27(1):3-10.   DOI
6 Kim SH, Cho SY. Security improvement methods for computer-based test systems. Converg Secur J. 2018;18(2):33-40.
7 Jeong HH. The score comparability of CBT and PBT: focusing on difference related to gender and learning ability. J Educ Technol. 2010;26(3):81-104.   DOI
8 Kwon KH, Min SW, Nah K. A study of direction for usability enhancement of UBT. J Digit Design. 2015;15(3):259-76.   DOI
9 Krantz JH. Tell me, what did you see?: the stimulus on computers. Behav Res Methods Instrum Comput. 2000;32(2):221-9.   DOI
10 Kveton P, Jelinek M, Voboril D, Klimusova H. Computer-based tests: the impact of test design and problem of equivalency. Comput Hum Behav. 2007;23(1):32-51.   DOI
11 Martilla JA, James JC. Importance-performance analysis. J Mark. 1977;41(1):77-9.   DOI
12 Ki KC, Kim JC. An evaluation of education service through IPA. J Train Dev. 2006;12:37-53.
13 Sung M, Eom W, Kim YH. An analysis of private university students' educational needs using the importance-performance analysis of learning competencies. CNU J Educ Stud. 2016;37(2):73-96.   DOI
14 Bae G, Lee SG, Park C, Kim DJ. A tourist survey on East Coast marine attractions using importance performance analysis. Culin Sci Hosp Res. 2020;26(1):159-68.   DOI
15 Duke CR, Persia MA. Performance-importance analysis of escorted tour evaluations. J Travel Tour Mark. 1996;5(3):207-23.   DOI
16 Deng W. Using a revised importance-performance analysis approach: the case of Taiwanese hot springs tourism. Tour Manag. 2007;28(5):1274-84.   DOI
17 Matzler K, Sauerwein E, Heischmidt K. Importance-performance analysis revisited: the role of the factor structure of customer satisfaction. Serv Ind J. 2003;23(2):112-29.   DOI
18 Oh H. Revisiting importance-performance analysis. Tour Manag. 2001;22(6):617-27.   DOI
19 Breiter D, Milman A. Attendees' needs and service priorities in a large convention center: application of the importance-performance theory. Tour Manag. 2006;27(6):1364-70.   DOI
20 Crompton JL, Duray NA. An investigation of the relative efficacy of four alternative approaches to importance-performance analysis. J Acad Mark Sci. 1985;13(4):69-80.   DOI
21 Im EJ, Lee WK, Lee YC, Choe BH, Chung SK, Lee TH, et al. Development of computer-based test (CBT) and student recognition survey on CBT. Korean J Med Educ. 2008;20(2):145-54.   DOI
22 Shin SH, Han SH. A study on importance-satisfaction analysis of exhibit service quality by revised-IPA. J Tour Leis Res. 2018;30(11):517-30.   DOI
23 Yun BR, Park Y. The relationship of nearly white background colors and readability of tablet PC. Sci Emot Sensib. 2014;17(2):35-44.   DOI
24 Park JH, Son JY, Kim S, Park JH, Son JY, Kim S. Experiences with establishing and implementing learning management system and computer-based test system in medical college. Korean J Med Educ. 2012;24(3):213-22.   DOI