• Journal of Yeungnam Medical Science
• /
• v.38 no.2
• /
• pp.118-126
• /
• 2021

Background: This study is an analysis of evaluator factors affecting physician-patient interaction (PPI) scores in clinical performance examination (CPX). The purpose of this study was to investigate possible ways to increase the reliability of the CPX evaluation. Methods: The six-item Yeungnam University Scale (YUS), four-item analytic global rating scale (AGRS), and one-item holistic rating scale (HRS) were used to evaluate student performance in PPI. A total of 72 fourth-year students from Yeungnam University College of Medicine in Korea participated in the evaluation with 32 faculty and 16 standardized patient (SP) raters. The study then examined the differences in scores between types of scale, raters (SP vs. faculty), faculty specialty, evaluation experience, and level of fatigue as time passes. Results: There were significant differences between faculty and SP scores in all three scales and a significant correlation among raters' scores. Scores given by raters on items related to their specialty were lower than those given by raters on items out of their specialty. On the YUS and AGRS, there were significant differences based on the faculty's evaluation experience; scores by raters who had three to ten previous evaluation experiences were lower than others' scores. There were also significant differences among SP raters on all scales. The correlation between the YUS and AGRS/HRS declined significantly according to the length of evaluation time. Conclusion: In CPX, PPI score reliability was found to be significantly affected by the evaluator factors as well as the type of scale.

• Korean Medical Education Review
• /
• v.12 no.2
• /
• pp.19-26
• /
• 2010

Purpose: Until now, students wrote only differential diagnoses and plans during the interstation work (IW) portion of clinical performance examinations (CPX). The contents of history taking (Hx) and the physical examination (PE) were only evaluated using checklists. This study addressed the correlations of Hx and PE scores from the checklists and the subsequent IW to research the necessity of adding Hx and PE sections in to the IW. Methods: One hundred and thrity-three students participated in a ten case CPX, and eight cases were used in this study. Immediately following the 12 minute patient encounter, students were given 6 minutes to write the IW. For the Hx and PE section, students were instructed to write the findings that they considered key information in approaching the patient's problem. The Hx and PE sections of the IW were scored using the same items that appeared on the SP checklist. Calculations of Spearman's rho were performed to find the relationship between the checklist scores and IW scores of Hx and PE sections. Results: Correlations of Hx and PE scores between the SP checklists and IW were low to moderate. Across the eight cases, the median Spearman's rho was 0.37 with a range of 0.14 to 0.54. Conclusion: We suggest that, because SP checklist scores measure only what information the students gather, but not their reasons for doing so (e.g.: relative importance), students tend gather very specific information from the patients. By analyzing of their IW, we were able to explore how students prioritize the important information they have obtained from the patients.

• The Korean Journal of Emergency Medical Services
• /
• v.16 no.3
• /
• pp.45-62
• /
• 2012

Purpose : This study was carried out from September 2011 to September 2012 to indicate improvement and performance schemes and planning strategies by way of scenario based practical examination to inspire adaptable capacity to EMS field for Emergency Medical Technician. Methods : In order to improve the examination, a survey was conducted to EMT-Paramedics (Level 1), EMT-Basics (Level 2), and other expert groups. The researchers visited the National Registry of Emergency Medical Technician (NREMT) headquarter and the psychomotor examination site in Ohio in April, 2011. The 21 EMT professors took part in a workshop experiencing the US psychomotor examinations provided by two NREMT examination experts in October, 2011. Results : The results showed that the general plan of new National Practical Examination for EMTs should consist of integrated emergency care examination based on clinical performance and simple skill examination based on objective structured skill protocol Conclusion : The National Practice Examination consists of two sessions and the examinees select the test number randomly in each session. The future examination should include the critical criteria and this criteria should be the decisive factor for the pass or fail.

• Journal of Society of Preventive Korean Medicine
• /
• v.16 no.2
• /
• pp.1-15
• /
• 2012

Objectives : The aim of this study is to analyze satisfaction with clinical training in the department of oriental rehabilitation medicine and the related factors. Methods : All the students in the graduating class of school of Korean Medicine, Pusan National University must be trained for 2 weeks in the department of oriental rehabilitation medicine according to clinical training guideline including Objective Structured Clinical Examination(OSCE) and Clinical Performance Examination (CPX). After completing clinical training, we distributed questionaries to them about a reflex of the object of study, usefulness, difficulty, satisfaction and preference. And then, we analyzed the related factors including descriptive statistics, frequency analysis and correlation analysis by SPSS 18.0. Results : In general, a reflex of the aim of study($7.88{\pm}1.31$), satisfaction with contents($8.17{\pm}1.20$) and difficulty($5.53{\pm}0.99$) were evaluated respectively. The better a reflex of the aim of study is, the higher satisfaction with contents is(P<0.01, r=0.836). Chuna was highly estimated, whereas pharmacopuncture was not. In OSCE, a reflex of the aim of study($8.07{\pm}1.07$) and usefulness($8.13{\pm}1.16$) were highly evaluated. The preference for physical examination of the lumbar spine was highly estimated, whereas applying splint was not. Facilities and equipment($7.88{\pm}1.11$), contents of clinical training($7.25{\pm}1.79$), the handout($7.00{\pm}1.59$) and time scheduling($5.48{\pm}1.71$) were evaluated respectively in general composition of clinical training. There is no difference related to specialty, sex and age among students. Conclusions : Clinical training program in the department of oriental rehabilitation medicine can be highly estimated from the viewpoint of difficulty and satisfaction.

• Korean Journal of Clinical Pharmacy
• /
• v.27 no.3
• /
• pp.119-126
• /
• 2017

Background: As the demands of pharmacist's role and quality performance have increased, the verification of pharmacist's ability has been required. In this study, we aimed to select appropriate items for assessment of pharmacist's knowledge, attitude and performance. Methods: Based on the pharmacist job analysis, we selected duties and tasks in consideration of applying pharmacy practical examination through brainstorming of internal researchers and group discussion with experts. Survey was conducted to evaluate the tasks according to the criteria detailed below: Realistic, Understandable, Measurable, Behavioral and Achievable (RUMBA). The subjects included professors at colleges of pharmacy and instructors of institutional or community pharmacy settings. Results: Nine duties including 41 tasks were drawn for the survey through primary internal researchers. Of the 90 respondents, 95.6% were professors or preceptors who was engaged in practical training, and 62.2% had more than five years of practical experience. As a result of survey and discussion with expert panel, selected seven duties were selected as followings: 'Patient (customer) reception', 'Drug preparation and distribution', 'Patient care', 'Administration', 'Patient counseling', 'Non-prescription medication counseling', and 'Provision of drug information'. The final 20 tasks from seven duties were chosen to assess skills that a pharmacist should be able to perform. Conclusion: This is the first study to select the items that can be included in pharmacist practical examination in the future, based on the RUMBA criteria. As a next step, it is necessary to study how to implement these items.

• The Journal of Korean Obstetrics and Gynecology
• /
• v.32 no.2
• /
• pp.100-118
• /
• 2019

Objectives: The purpose of this study is to analyze clinical performance examination (CPX) ability using standardized patient (SP) in Korean traditional medical school. Methods: Standardized middle-aged female patients were used for clinical examination of 53 medical students, grade 6. The SP and professors assessed their communication skills and level of medical interviews. Results: 1. There is no statistically significant difference between SP score, communication skill score, medical skill score and inter-test score at the extracurricular activities level. 2. There is no statistically significant difference between SP score, communication skill score, medical skill score and inter-test score at number of medical service. 3. There is no statistically significant difference between SP score, communication skill score, medical skill score and inter-test score at personality type. 4. There is a statistically significant positive correlation between SP score, communication skill score and medical skill score. Conclusions: A variety of educational programs and practices should be conducted to improve the level of medical care and communication of Korean traditional medicine students.