• The Journal of Korean Medicine
• /
• v.45 no.1
• /
• pp.1-16
• /
• 2024

Introduction: The importance of clinical skills training in traditional Korean medicine education is increasingly emphasized. Since the clinical skills tests are high-stakes tests that determine success in national licensing exams, it is essential to develop reliable multifaceted analysis methods for clinical skills tests in actual education settings. In this study, we applied the multifaceted validity evaluation methods to the evaluation results of the cardiopulmonary resuscitation module to confirm the applicability and effectiveness of the methods. Methods: In this study, we used internal consistency, factor analysis, generalizability theory G-study and D-study, ANOVA, Kendall's tau, descriptive statistics, and other statistical methods to analyze the multidimensional validity of a cardiopulmonary resuscitation test in clinical education settings over the past three years. Results: The factor analysis and internal consistency analysis showed that the evaluation rubric had an unstable structure and low concordance. The G-study showed that the error of the clinical skills assessment was large due to the evaluator and unexpected errors. The D-study showed that the variance error of the evaluator should be significantly reduced to validate the evaluation. The ANOVA and Kendall's tau confirmed that evaluator heterogeneity was a problem. Discussion and Conclusion: Clinical skills tests should be continuously evaluated and managed for validity in two steps of pre-production and actual implementation. This study has presented specific methods for analyzing the validity of clinical skills training and testing in actual education settings. This study would contribute to the foundation for competency-based evidence-based education in practical clinical training.

• Journal of the Korean Society of Clothing and Textiles
• /
• v.28 no.910
• /
• pp.1253-1264
• /
• 2004

The purpose of this study is to develop clothing shopping orientation[CSO] scale reflecting the conceptual structure of CSO. For this purpose, a questionnaire composed of comprehensive 85 CSO items was developed through 2-step preliminary tests. Data was collected from two samples. One sample(n=559) was for scale development and the other sample(n=235) was for cross validity test. Descriptive analysis, correlation analysis, exploratory factor analysis, regression analysis, ANOVA, and confirmatory factor analysis were used for data analysis. For each lower-dimension within the CSO conceptual structure model, 1-2 items were selected based on the quantitative and the qualitative standards. As a result, a CSO scale composed of 31 items was developed, and reliability, construct validity, cross validity, convergent validity, discriminant validity, and criterion validity of the scale were verified. This study has significance in offering the standardized scale to both the academic and the practical fields.

• Journal of the Korean Home Economics Association
• /
• v.39 no.12
• /
• pp.205-224
• /
• 2001

This article presents the development of a self-report measure of Korean Marital Satisfaction Scale. Based on 'Family Process Model'and interviews with 183 married couple, 3 domain structures with 74 items were identified, which included interactional process, emotional process, and intellectual process. It was administerd to 289 couples to test reliability and validity. Overall reliability coefficients were high for each of the individual domains($\alpha$=.62 to $\alpha$=.93). Face validity, content validity, content validity and concurrent validity respectively were demonstrated good. Additionally, divergent validity with scales of self-esteem and depression was observed. These results support the reliability and psychometric validity of the Korean Marital Satisfaction Scale in the assessment of key dimensions of marital process of Korean couples.

• English Language & Literature Teaching
• /
• v.9 no.1
• /
• pp.153-171
• /
• 2003

The scores of TOEFL, TOEIC, and TEPS have been increasingly used for many purposes in Korea. In particular, these test scores are being used as a predictor for determining readiness for and success in college work, or as a measure of the testees' overall English proficiency. Nonetheless, studies have rarely proposed that the validity of the test scores is used for either purpose. As a preliminary step to explore the predictive validity of the test scores, we collected the scores of TOEFL, TOEIC, and TEPS from thirty students of a university as well as their cumulative grade point averages (GPAs). The correlations between the test scores and GPAs show that TOEFL will be most likely to have the highest validity coefficient as a predictor for determining success in college work as well as a measure of overall English proficiency. Although this study has a few limitations such as the small number of participants, their homogeneousness as a group, etc., it provides some insight into the use of the three tests for college admissions and measurement of overall English proficiency and suggests need for conducting further validation studies in these areas.

• The Journal of Korean Academy of Sensory Integration
• /
• v.17 no.3
• /
• pp.14-25
• /
• 2019

Objective : This study aims to verify the content validity and inter-rater reliability of the Korean version of the Peabody Developmental Motor Scale 2 (PDMS-2) and to identify the concurrent validity by comparing it with the Korean version of the Bruininks-Oseretsky Test of Motor Proficiency-2 (BOT-2). Methods : PDMS-2 was translated by the researcher and an eighth-year clinical occupational therapist. The content consistency of the Korean version of the PDMS-2 was verified by three professors with experience using it. After the verification of the content consistency of the PDMS-2 by the five clinical occupational therapists and the additional revision, the Korean version of the PDMS-2 was completed. The researcher and another occupational therapist evaluated the Korean version of PDMS-2 in 50 children and measured the inter-rater reliability. Concurrent validity was measured by comparing the results of the Korean version of PDMS-2 and Korean version of BOT-2. Results : The content consistency test showed overall agreement of mean 3.45, and the content understanding test showed a high level of understanding of mean 3.69. The inter-rater reliability and concurrent validity of the Korean version of the PDMS-2 showed a statistically significant correlation. Conclusion : The Korean version of the PDMS-2 showed high content understanding, reliability, and validity. It can assist clinicians and researchers who work in fields related to child treatment or development.

• Journal of Korean Medicine Rehabilitation
• /
• v.19 no.2
• /
• pp.203-212
• /
• 2009

Objectives : Spurling test is one of the most widely used physical tests to diagnose herniated cervical intervertebral disc. The purpose of this study is to analyse diagnostic validity of Spurling test. Methods : This study was carried out on 382 subjects who visited Bu-Chun Ja-Seng oriental hospital with the neck pain or radiating pain from neck to upper extremities from November, 2007 to October, 2008. All subjects underwent both Spurling test and cervical magnetic resonance imaging(MRI). The associations between Spurling test and herniated cervical intervertebral disc were analysed. Results : 1. The sensitivity of Spurling test for herniated cervical intervertebral disc was 64%. 2. The specificity of Spurling test for herniated cervical intervertebral disc was 86%. 3. The positive predictive value of Spurling test for herniated cervical intervertebral disc was 93%. 4. The negative predictive value of Spurling test for herniated cervical intervertebral disc was 44%. Conclusions : This study suggests that Spurling test is not useful in screening for herniated cervical intervertebral disc due to the test's relatively low sensitivity. Thus it is necessary to consult advanced tests such as diagnostic imaging to diagnose herniated cervical intervertebral disc.

• Journal of the Korea Society of Computer and Information
• /
• v.22 no.9
• /
• pp.187-192
• /
• 2017

In this paper, we have studied scale tools for measure programming task value and learning persistence at elementary school students. In order to develop complete test tools, we have improved the completeness by revising tests through stepwise verification. The first scales were constructed based on the previous studies. As a result of the content validity test, 5 out of 14 items of the task value test tool and 1 out of 10 items of the learning persistence test were not suitable. The second test tools were constructed by revising and supplementing the first scale, and consisted of 13 items of task value and 8 items of learning persistence. As a result of the contents validity test, all the items included in the test tool proved to be valid. The reliability of the secondary testing tools were also found to be reliable at ${\alpha}=.970$ and ${\alpha}=.975$, respectively.

• Korean Journal of Child Studies
• /
• v.31 no.3
• /
• pp.235-254
• /
• 2010

The purpose of this study was to examine the feasibility and validity of the Application of Cognitive Function Scale as developed by Lidz and Jepsen (1997). Data were collected from 4 to 5-years-old children. The analysis for item adequacy indicated that the passing rate increases according to age. Futhermore the analysis for test adequacy indicated that internal consistency reliability was .85 in the pre-test and .80 of post-test in terms of the cognitive function scale, and .90 of pre-test and .93 in the post-test in relation to the behavior observation scale. In conclusion, our analysis of the ACFS shows sufficiently high scores in terms of both validity and reliability, so as to indicate that this test is an appropriate way to measure the cognitive function and non-intellective function of young Korean children.

• The Journal of Internal Korean Medicine
• /
• v.38 no.6
• /
• pp.917-929
• /
• 2017

Objectives: The objective of this study was to investigate the validity of the preliminary critical pathway of integrative medicine to improve the quality of life of lung cancer patients who received chemotherapy. Methods: The vertical axis of the preliminary critical pathway of integrated medicine consisted of nine domains: assessment, treatment, activity, consult, diet, medication, Korean medical examination, education, and others. The frame of the horizontal axis was the date from hospitalization to discharge. A total of 105 items in this preliminary critical pathway were validated by an expert group from October 28, 2016 to November 4, 2016. A total of ten experts from two different medical institutions participated in the validity test, using the four-point Content Validity Index (CVI) scale. The items with validity of greater than 80% were considered as significant. Results: The analysis of the content validity of 105 items showed 102 items with greater than 80% agreement. Assessment, treatment, consult, diet, medication, and education showed 100% agreement. Only three items showed a low validity (62.5%). Based on additional comments, the preliminary critical pathway of integrative medicine has been supplemented. Conclusions: This study suggests the possibility of using the integrated medical critical pathway for patients with lung cancer who received chemotherapy.

• The Journal of the Korea Contents Association
• /
• v.13 no.5
• /
• pp.354-365
• /
• 2013

The purpose of the study was to develop the home fall prevention checklist for community-dwelling older adults. And the validity and reliability of the checklist were tested. The preliminary questions were developed through content validity by twenty experts using the CVI(Content Validity Index). Following the establishment of content validity, 52 items of the checklist were developed. Responses of 299 community-dwelling older adults were analyzed to further establish both reliability and validity of the checklist. Reliability using cohen's kappa coefficient and test-retest reliability(rate of concordance(%)), and construct validity using known-group comparison technique were tested. 51 items were over 0.80 in the cohen's kappa coefficient of the checklist, 45 items were over 80.0% in test-retest reliability. Construct validity was established by known-group comparison(t=3.50, p=.001). Validity and reliability of the checklist were confirmed. This checklist will help further studies to develop more safe environment to prevent falls.