• Journal of Korean Dental Science
• /
• 제12권2호
• /
• pp.58-65
• /
• 2019

Purpose: This study was aimed to investigate the possibility of utilizing smart device-based test (SBT) for competency evaluation in dental education and to analyze the student responses on overall competency evaluation using SBT method, in comparison to ubiquitous-based test (UBT). Materials and Methods: Questionnaire surveys have been conducted at Yonsei University College of Dentistry from 2015 to 2018 to obtain students' feedback on the application of SBT to competency evaluation. In addition, in order to supplement the competency evaluation procedure, considerations were explored by comparing the expected and actual difficulty of each item when preparing items for competency evaluation with SBT. Result: According to the survey results, student responses between the initial two years (2015 and 2016) differed from those in next two years (2017 and 2018). Students in 2017 and 2018 had more positive responses on competency evaluation with SBT. To determine the test validity, criterion-referenced evaluation was adopted to compare the data in 2017 and 2018 and slight differences in test difficulty in 2018 between the expected and actual difficulty of items were found. Conclusion: The results indicated that SBT was more appropriate for competency evaluation than UBT, based on four-year period of competency evaluation. The SBT was not affected by either the file size or the number of test-takers. Interestingly, students were not sensitive to test version of competency evaluation (paper-based test and SBT). This study suggests that the quality of the test items should be measured by continuous monitoring of the expected and actual difficulty of items for determining test validity. More detailed results and discussions of the findings are given for the development of test procedure and further potential research directions in dental education.

• 한국응급구조학회지
• /
• 제22권3호
• /
• pp.7-34
• /
• 2018

Purpose: The purposes of this research were to study the validity of the National Examination based on smart based test(SBT) by 7 types of healthcare occupation. Methods: We conducted a questionnaires survey among 1,219 people including 210 professors for all 7 types of healthcare occupation and 573 clinical specialists ; 436 students from random sampling participated and the reliability of the questionnaire was tested using Cronbach's alpha. Results: Professors from 7 types of healthcare occupation were investigated for their opinions on the introduction of the SBT system ; 65.9% of the professors answered positively on the introduction of the SBT National Examination System, while 40.1% of the clinical experts answered likewise. In particular, professors and the clinical experts recognized altogether that the multimedia questionnaire, being effective for the evaluation of clinical and practical competence of the subjects, enabling the evaluation of various areas and strengthening the school education in clinical practices, the 42.0% of the students from 7 departments answered that the future direction of the national test is in the SBT test system with significant difference (p=.000) found in students majoring in order of Emergency Medical Services, Radiology and Physical therapy, compared to students from other majors, showing the positive response to the SBT system. Conclusion: The results of this study comprehensively evaluated the positive recognition of development of multimedia items and SBT system in national examination of 7 types of healthcare occupation in professors, field specialists and students.