• 대한한의학회지
• /
• 제45권1호
• /
• pp.1-16
• /
• 2024

Introduction: The importance of clinical skills training in traditional Korean medicine education is increasingly emphasized. Since the clinical skills tests are high-stakes tests that determine success in national licensing exams, it is essential to develop reliable multifaceted analysis methods for clinical skills tests in actual education settings. In this study, we applied the multifaceted validity evaluation methods to the evaluation results of the cardiopulmonary resuscitation module to confirm the applicability and effectiveness of the methods. Methods: In this study, we used internal consistency, factor analysis, generalizability theory G-study and D-study, ANOVA, Kendall's tau, descriptive statistics, and other statistical methods to analyze the multidimensional validity of a cardiopulmonary resuscitation test in clinical education settings over the past three years. Results: The factor analysis and internal consistency analysis showed that the evaluation rubric had an unstable structure and low concordance. The G-study showed that the error of the clinical skills assessment was large due to the evaluator and unexpected errors. The D-study showed that the variance error of the evaluator should be significantly reduced to validate the evaluation. The ANOVA and Kendall's tau confirmed that evaluator heterogeneity was a problem. Discussion and Conclusion: Clinical skills tests should be continuously evaluated and managed for validity in two steps of pre-production and actual implementation. This study has presented specific methods for analyzing the validity of clinical skills training and testing in actual education settings. This study would contribute to the foundation for competency-based evidence-based education in practical clinical training.

• Journal of the Korean Academy of Child and Adolescent Psychiatry
• /
• 제22권3호
• /
• pp.169-181
• /
• 2011

Objectives: The Child Report of Post-traumatic Symptoms (CROPS) and the Parent Report of Post-traumatic Symptoms (PROPS) are screening measures for post-traumatic symptoms in children. The present study aimed to investigate the reliability and validity of the Korean versions of the CROPS and the PROPS. Methods: The Korean versions of the CROPS and the PROPS were administered to a sample of 304 children aged 6 to 15 years old. The internal reliability, test-retest reliability, factorial validity, predictive validity and concurrent validity were evaluated. Results: The reliability of the CROPS and the PROPS was shown to have excellent internal consistency and test-retest correlation. The single factor structure of the PROPS was good and that of the CROPS was borderline acceptable according to confirmatory factor analysis. Other validity measures such as the predictive validity and concurrent validity were also shown to be satisfactory. Conclusion: This study demonstrated that the Korean versions of the CROPS and the PROPS were reliable measures with satisfactory psychometric qualities. Because it takes less than 5 minutes to fill out the CROPS and the PROPS, respectively they can be quick and easy screening scales for assessing post-traumatic symptoms in Korean children.

• The Journal of Korean Physical Therapy
• /
• 제19권5호
• /
• pp.29-41
• /
• 2007

Purpose: The aim of this study was to examine the validity and reliability on Psychometric Arthritis Impact Measurement Scale-Short Form (AIMS-SF) in patients with knee osteoarthritis(OA). Methods: The sample consisted of 62 patients who had received physical therapy at the physical therapy units of the Andong Medical Center, Sungso Hospital, Ahn Orthopedic Surgery Clinic, and St. Luke Clinic in Andong city in June 2006. Questionnaire on the AIMS-SF was recruited by 5 physical therapists. The internal structure and reliability of the scales were evaluated by means of item-internal consistency(Cronbach's alpha coefficient: ${\alpha}$), item-discriminant validity, Pearson's relation coefficient. To explore construct validity we conducted a principal component factor analysis with varimax rotation analysis. The criterion for factor extraction was an eigenvalue >1.0. Results: 62 OA patients's an average $age{\pm}standard$ deviation was $53.8{\pm}14.4$ years (range: $40{\sim}81$ yr). The internal consistency reliability of 11 items, as estimated by Cronbach's ${\alpha}$ coefficient, was high ranging $0.60{\sim}0.78$ (except for 0.40 for mobility level and -0.48 for mood). The internal consistency reliability of item-each scale was also high $0.82{\sim}0.93$ (except for 0.48 for mood). Of 11 items, the item-discriminant validity on 6 items was high (${\alpha}$ coefficient range: $0.11{\sim}0.25$), however, others (0.57 for tension level, 0.48 for arthritis pain, 0.41 for walking and bending, and 0.40 for work) were a little low. The construct validity by factor analysis was a little low. Conclusion: In conclusion, the results reported here confirm the validity and reliability of the AIMS-SF in patients with OA of the knee. The Collection of information on health status using this instrument was acceptable to patients. A further prospective multi-center study will be necessary to prove the construct validity.

• Asian Pacific Journal of Cancer Prevention
• /
• 제14권7호
• /
• pp.4415-4419
• /
• 2013

Background: Measuring effects of cancer on family caregivers is important to develop methods which can improve their quality of life (QOL). Nevertheless, up to now, only a few tools have been developed to be used in this group. Among those, the Caregiver Quality of Life Index-Cancer Scale (CQOLC) has met minimum psychometric criteria in different populations in spite of conflicting results. The present study was conducted to evaluate reliability and validity of CQOLC among Turkish cancer family caregivers. Materials and Methods: The CQOLC was administered to 120 caregivers, along with Beck Depression Inventory (BDI), Medical Outcomes Study MOS 36- Item Short Form Health Survey (SF-36), State-Trait Anxiety Inventory (STAI), and Multidimensional Scale of Perceived Social Support (MSPSS). Internal consistency and test-retest stability were used to investigate reliability. Construct validity was examined by using known group method, convergent, and divergent validity. For the known group method, we hypothesized that CQOLC scores would differ between depressed and non-depressed subjects. We investigated convergent validity by correlating scores for CQOLC with scores for other similar measures including SF-36 and STAI. The MSPSS was completed at the same time as CQOLC to provide divergent validity. Results: The values for internal consistency and test-retest correlation were 0.88 and 0.96, respectively. The CQOLC discriminated those who were depressed from those who were not. Convergent validity supported strong correlations between CQOLC scores and two main component scores (PCS, MCS) in SF-36 although there was a weak correlation between CQOLC and STAI scores. Regarding divergent validity, the correlation between CQOLC and MSPSS was in the low range, as expected. Conclusions: The Turkish CQOLC is a reliable and valid tool and it can be utilized to determine QOL of family caregivers.

• 대한후두음성언어의학회지
• /
• 제30권1호
• /
• pp.21-27
• /
• 2019

Background and Objectives : Voice disorder is recognized as a major problem because it negatively affects the elderly's social participation and quality of life. The purpose of this study was to examine the validity and reliability of Korean aging voice index (KAVI), which assesses the quality of life related to the voice of the elderly. Materials and Method : This study was conducted on 211 elderly people aged 65 years or older : 111 patients with voice disorder (mean age 69.8, range 65-80 years) and 100 nomorphonic participants (mean age 70.6, range 65-82 years). Aging voice index was translated into Korean and used and Korean voice-related quality of life (KVQOL) was conducted to verify KAVI. The validity (item validity, concurrent validity, and construct validity) and reliability (test-retest reliability and internal consistency reliability) of KAVI. Results : The item validity (ICC=0.895) and construct validity (r=0.765) showed a high correlation, respectively. And concurrent validity (r=0.748), test-retest reliability (0.851), and internal consistency reliability (${\alpha}=0.832$) were statistically significant in voice disorder group. In addition, there was a significant difference between the voice disorder and the nomorphonic group in AVI total score. Conclusion : KAVI is a validated and reliable quality of life tool that will be useful for assessing the presence and effectiveness of interventions in clinical settings.

• 한국간호교육학회지
• /
• 제26권1호
• /
• pp.47-55
• /
• 2020

Purpose: The aim of this study was to examine the validity and reliability of the Korean version of the PTSD scale (K-PTSD) for measuring attitudes and knowledge of PTSD. Methods: A cross-sectional study design was used. The K-PTSD scale consisted of 8 items for attitudes, 8 items for general knowledge of PTSD, and 3 items for knowledge of PTSD treatment; 211 nursing students and paramedic students participated. Content validity, item analysis, and factor analysis were used to examine the construct validity. Criterion validity was tested by using educational experience with PTSD as a criterion. Cronbach's α was used to identify internal consistency reliability in the attitude scale. Results: Construct validity of the K-PTSD was verified by exploratory factor analysis, with factor loadings for attitude ranging from .59 to .84. Criterion validity in comparing knowledge of PTSD (t=2.02, p=.044) and PTSD treatment (t=3.19, p=.022) showed a significant difference according to PTSD educational experience. Cronbach's α for the attitude scale was .79 and .59. Conclusion: The findings suggest that the K-PTSD is a valid and reliable tool that can measure attitudes and knowledge of PTSD among nursing and paramedic students. However, further study is needed to retest the verification of this scale with more diverse participants.

• The Journal of Korean Physical Therapy
• /
• 제30권1호
• /
• pp.29-34
• /
• 2018

Purpose: This study aimed to systematically analyze the reliability and validity of Korean versions of mobility and gait assessment tools for patients with stroke. Methods: Two reviewers conducted an independent literature search and systematically reviewed the literature. Literature published until June of 2017 was searched using search engines for electronic databases. The 2 reviewers reviewed the title and abstract of each article. Among the articles examined, we read the full text of those judged to be suitable for our study. We classified the selected data into research methods and results. The determination was made through mutual agreement. Results: The reviewers selected 5 articles related to the purpose of this study. The DGI was found to be moderately associated with BBS, 10MWT, and TUG in intra-rater reliability (ICC=0.92), inter-rater reliability (ICC=0.88), and concurrent validity tests. The FGA demonstrated a high level of reliability with intra-rater (ICC=0.92-0.95) and inter-rater reliability (ICC=0.91, 0.95). The intra-rater reliability of the RMI was high at ICC=0.98. Its concurrent validity showed a high association with STREAM and BI. The intra-rater reliability of the MAS was ICC=0.75-0.99. Its inter-rater reliability was very high, exceeding 0.99. The inter-rater reliability of the Tinetti-gait Scale was ICC=0.91, and its concurrent validity was moderately associated with the DGI, 10WMT, OLST, FM-L/E, and STS. Conclusion: The results of this study revealed that the reliability and validity of the Korean versions of the mobility and gait assessment tools were high.

• 대한간호학회지
• /
• 제53권3호
• /
• pp.324-339
• /
• 2023

Purpose: This study aimed to valuate the reliability and validity of the Korean version of the 5C Psychological Antecedents of Vaccination (K-5C) scale. Methods: The English version of the 5C scale was translated into Korean, following the World Health Organization guidelines. Data were collected from 316 community-dwelling adults. Content validity was evaluated using the content validity index, while construct validity was evaluated through confirmatory factor analysis. Convergent validity was examined by assessing the correlation with vaccination attitude, and concurrent validity was evaluated by examining the association with coronavirus disease 2019 (COVID-19) vaccination status. Internal consistency and test-retest reliability were also evaluated. Results: Content validity results indicated an item-level content validity index ranging from .83 to 1, and scale-level content validity index, averaging method was .95. Confirmatory factor analysis supported the fit of the measurement model, comprising a five-factor structure with a 15-item questionnaire (RMSEA = .05, SRMR = .05, CFI = .97, TLI = .96). Convergent validity was acceptable with a significant correlation between each sub-scale of the 5C scale and vaccination attitude. In concurrent validity evaluation, confidence, constraints, and collective responsibility of the 5C scale were significant independent predictors of the current COVID-19 vaccination status. Cronbach's alpha for each subscale ranged from .78 to .88, and the intraclass correlation coefficient for each subscale ranged from .67 to .89. Conclusion: The Korean version of the 5C scale is a valid and reliable tool to assess the psychological antecedents of vaccination among Korean adults.

• 보건의료산업학회지
• /
• 제11권3호
• /
• pp.91-104
• /
• 2017

Objectives : This study was a methodological study to verify the validity and reliability of the translated and modified Older Patients in Acute Care Survey-US (OPACS) tool, which was originally developed by Dikken and his colleagues. Methods : The OPACS was translated into Korean, and the content validity, composition validity, and reliability were verified using 348 nurses working for hospitals with over 200 beds and located in C city, B city, and K province. Results : The analysis showed that the Korean version of the OPACS had of eleven questions in the practice experience section and twelve in the general opinion section for older patients in the acute phase. Cronbach's ${\alpha}s$ were 0.84 for practice experience and 0.81 for general opinion. Conclusions : The study showed that the OPACS could measure the practice and opinion of Korean nurses who cared for elderly patients in the acute phase. The significance of the study was that it provided baseline data information regarding the performance and opinion of these nurses for nursing managers to improve the nursing environment.

• 한국간호교육학회지
• /
• 제26권3호
• /
• pp.322-331
• /
• 2020

Purpose: The purpose of this study was to investigate the validity and reliability of the Korean Version of the Grit (Grit-K) scale for nursing students in Korea. Methods: The participants in the study were 277 nursing students. Their grit was verified by using self-reports and the results of a questionnaire. Grit was translated into Korean and its content validity was verified by five experts. The validity of the instrument was verified through item analysis, exploratory factor analysis, and confirmatory factor analysis. Reliability verification was analyzed by using internal consistency reliability. Results: Two factors were identified through exploratory factor analysis and six items of the original instrument were found to be valid. In the confirmatory factor analysis, the validity of the instrument was verified as the model. The internal consistency reliability was also acceptable and Grit was found to be an applicable instrument. Conclusion: This study shows that the Korean Version of the Grit Questionnaire is a valid and reliable instrument to assess nursing students in Korea.