Browse > Article

Validity and Reliability of a Clinical Performance Examination using Standardized Patients  

Choi, Ja-Yun (College of Nursing, Chonnam National University)
Jang, Keum-Seong (College of Nursing, Chonnam National University)
Choi, Soon-Hee (College of Nursing, Chonnam National University)
Hong, Mi-Soon (College of Nursing, Chonnam National University)
Publication Information
Journal of Korean Academy of Nursing / v.38, no.1, 2008 , pp. 83-91 More about this Journal
Abstract
Purpose: The purpose of this study was to test the validity of a modified clinical performance examination (CPX) for preclinical students in nursing. Method: 70 nursing students in their second semester of the junior year at C University participated in CPX. Scenarios and checklists were developed by our research team from September to October 2005. Six stations were organized. Evaluation included physical examination of a patient with lung cancer, education on usage of a metered dosage inhaler, and lobectomy postoperative care. Students were randomly assigned to a station. Result: There was a difference in the CPX scores according to stations. The agreement of scoring between trained faculty members and SPs was more than moderate (r=.647). The correlation between the CPX score and the average grade in the previous semester and between the CPX score and the average grade of a paper and pen test of the pulmonary system of adults was low (r=.276; r=.048). Conclusion: Traditional CPX is generally recommended, however, modified CPX is appropriate for preclinical students in the current Korean Nursing school setting if there are additional scoring systems to balance the testing level at each station.
Keywords
Patient simulation; Clinical competence; Evaluation study;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
Times Cited By Web Of Science : 3  (Related Records In Web of Science)
연도 인용수 순위
1 Burch, V. C., Nash, R. C., Zabow, T., Gibbs, T., Aubin, L., Jacobs, B., et al. (2005). A structured assessment of newly qualified medical graduates. Med Educ, 39, 723-731   DOI   ScienceOn
2 De Champlain, A. F., Margolis, M. J., King, A., & Klass, D. J. (1997). Standardized patients'accuracy in recording examinees'behaviors using checklists. Acad Med, 72(10 Suppl 1), S85-S87   DOI
3 Jung, K. H., Choi, E. H., Bae, J. D., Na, D. Y., Son, I. K., Ko, C. W., et al. (2005). Comparison of professional standardized and amateur standardized patients in OSCE. Korean J Med Educ, 17(1), 97-105   DOI   ScienceOn
4 Lee, Y. M., Hwang, K., Baik, S. H., Hong, M. H., Choi, Y. S., & Kim, S. H. (2001). An experience of OSCE for introducing clinical performance assessment to Korean medical licensure examination. Korean J Med Educ, 13(1), 47-57
5 Miller, G. E. (1990). The assessment of clinical skills/competence/ performance. Acad Med, 65(9 Suppl), S63-S67   DOI   PUBMED   ScienceOn
6 Oh, H., Jun, S., Kim, E., Hur, M., Song, Y., Yi, G., et al. (2006). Application of OSCE in clinical nursing education: development and testing validity of checklist. Annu Bull Bum-Suk Acad Scholarsh Found, 10, 237-249
7 Park, H., Kim, D., Kim, D. A., Choi, H., & Kim, K. (1998). An OSCE assessment of fourth-year students as a comprehensive evaluation of medical skills before graduation. Korean J Med Educ, 6(1), 23-35
8 Park, H., Lee, J., Hwang, H., Lee J., Choi, Y., Kim, H., et al. (2003). The agreement of checklist recordings between faculties and standardized patients in an objective structured clinical examination (OSCE). Korean J Med Educ, 15, 141-150   DOI
9 Stillman, P. L., Regan, M. B., Swanson, D. B., Case, S., McCahan, J., Feinblatt, J., et al. (1990). An assessment of clinical skills of fourth year students at four new england medical schools. Acad Med, 65, 320-326   DOI   PUBMED   ScienceOn
10 Vu, N. V., Barrows, H. S., March, M. L., Verhulst, S. J., Colliver, J. A., & Travis, T. (1992). Six years of comprehensive, clinical, performance-based assessment using standardized patients at the Southern Illinois University School of Medicine. Acad Med, 67(1), 42-50   DOI   PUBMED   ScienceOn
11 Yoo, M. S., & Yoo, I. Y. (2003). Effects of OSCE method on performance of clinical skills of students in fundamentals of nursing course. J Korean Acad Nurs, 33, 228-235   DOI
12 Mukohara, K., Kitamura, K., Wakabayashi, H., Abe, K., Sato, J., & Ban, N. (2005). Evaluation of a communication skills seminar for students in a Japanese medical school: a non-randomized controlled study. BMC Med Educ, 4, 24-29
13 Yoo, M. (2001). The effectiveness of standardized patient managed instruction for a fundamental nursing course. J Korean Acad Soc Nurs Educ, 7(1), 94-109   과학기술학회마을
14 Klein, S. P., & Stecher, B. M. (1998). Analytic versus holistic scoring of science performance tasks. App Meas Educ, 11, 121-137   DOI   ScienceOn
15 Bickley, L. (1999). Bate's guide to physical examination & history taking (7th ed.). Philadelphia: Lippincott
16 Tamblyn, R. M., Klass, D. K., Schanbl, G. K., Kopelow, M. L. (1990). Factors associated with the acuracy of standardized patient presentation. Acad Med, 65(9 Suppl), S55-S56   DOI
17 Amona, H., Sano, T., Gotoh, K., Kakuta, S., Suganuma, T., Kimura, Y., et al. (2004). Strategies for training standardized patient instructors for a competency exam. J Dent Educ, 68, 1104-1111   PUBMED
18 Park, H., Han, J., Park, M., & Oh, J. (2004). Comparison of results from objective structured clinical examinations for medical students performed before and after clinical clerkship. Korean J Med Educ, 16(1), 63-71   DOI
19 Kim, B. S., Lee, Y. M., Ahn, D. S., & Park, J. Y. (2001). Evaluation of introduction to clinical medicine by objective structured clinical examination. Korean J Med Educ, 13, 289-298
20 Suh, B. Y., Lee, D. J., Kwun, K. B., & Kang, P. S. (1998). Trial on objective structured clinical examination. Korean J Med Educ, 10, 363-381
21 Roberts, J., & Brown, B. (1990). Testing the OSCE: a reliable measurement of clinical nurisng skills. Can J Nurs Res, 22(1), 51-59
22 Nam, M. H. (1995). A validity study of performance assessment: a comparison between science hands-on assessment, experimental report assessment, computer simulation assessment. J Educ Eval, 8, 115-143
23 Reznick, R. K., Sydney, S., Baumber, J., Cohen, R., Rothman, A., Blackmore, D., et al. (1993). Guideline for estimating the real cost of an objective structured clinical examination. Acad Med, 68, 513-517   DOI   PUBMED   ScienceOn
24 Lee, M. S., & Kim, S. (1999). Clinical performance evaluation in nursing. Korean J Nurs Query, 8(1), 39-59