• Journal of the Korean Home Economics Association
• /
• v.39 no.10
• /
• pp.169-186
• /
• 2001

The purpose of the study was to verify validity and reliability of performance assessment in home economics by applying performance assessment tools developed by Korean Curriculum Assessment Institute and by the researcher to a class of 17 high school female students in a rural area. For the purpose of this study, the research question was formulated and addressed:“How are the validity and reliability of performance assessment in home economics\ulcorner” The results of the study were as follows. 1. The results of testing validity a. Thirteen high school home economics teachers, whose average teaching years is ten years verified high validity in the contents of performance assessment. b. In the validity of the items that is verified being based on the scores of high school entrance examination of 2000 school year, the essay type showed its characteristics as performance assessment. c. The generalizability among assessment methods was not high. 2. The results of testing reliability Both Cronbach's $\alpha$, inter-item reliability of the assessment tools used in the research, and reliability among the raters were high. But reliability among the tasks was relatively low. This study proposed that the diverse performance methods, the increasing number of assessment, the explicit assessment criterion, and scoring criterion are needed to satisfying validity and reliability of performance assessment.

• The Mathematical Education
• /
• v.57 no.3
• /
• pp.215-229
• /
• 2018

Despite the importance of learning to do mathematical proofs, researchers have reported that not only secondary school students but also undergraduate students have difficulties in learning proofs. In this study, we introduced a new toll for learning proofs and explored the reliability and the validity of peer assessment on proofs. In the course of a university in Seoul, students were given weekly proof assignments prior to class. After solving the proofs, each student had to assess other students' proofs. The inter-rater reliabilities of weekly peer assessment was higher than .9 over 90 percent of the observed cases. To examine the validity of peer assessment, we check whether students' assessments were similar to expert assessment. Analysis showed that the equivalence has been quite high throughout the semester and the validity was low in the middle of the semester but rose by the end of the semester. Based on these results, we believe instructors can consider the application of peer assessment on proving tasks as a tool to help students learn.

• Journal of the Korean Society of Physical Medicine
• /
• v.12 no.4
• /
• pp.139-146
• /
• 2017

PURPOSE: The purpose of this study was to systematically analyze the reliability and validity of the Korean-version of the balance assessment tools. METHODS: Two reviewers of this study independently evaluated the titles of articles and abstracts of studies published until December 2016 through electronic databases (RISS, NDSL, KISS, DBpia) using the keywords "Balance or posture or postural control or postural stability", "Test or assessment or measurement or outcome measure or assessment tool or measurement tool", "Korean version", "Reliability" and "Validity". Regarding the questions considered suitable for the purpose of this study, consensus was reached after reading the full text. Selecting journals suitable for the purpose of the study, they were analyzed as data. RESULTS: The reviewers selected nine papers suitable for the purpose of this study, and Korean-version of the balance assessment tools, included the Berg Balance Scale (BBS), Activities-specific Balance Confidence (ABC) scale, Postural Assessment Scale for Stroke (PASS), Motor Assessment Scale (MAS), Trunk Impairment Scale (TIS), Falls Efficacy Scale (FES), Tinetti-Balance scale, Fullerton Advanced Balance (FAB) scale, and Function In Sitting Test (FIST). Our study showed that the reliability and validity of the Korean-version of the balance assessment tools were high. CONCLUSION: The Korean-version of the balance assessment tools with high reliability and validity would enable physical therapists to make a more accurate evaluation of balance.

• Physical Therapy Korea
• /
• v.18 no.2
• /
• pp.43-51
• /
• 2011

Balance is a complex motor skill that depends on interactions between multiple sensorimotor processes and environmental and functional contexts. Many rehabilitation specialists believe that balance assessment under multitask conditions may be a more sensitive indicator of balance problems and falls than balance assessment in a single-task context. Functional Gait Assessment has many tasks that allow for testing under multitask conditions. The purpose of this study was to determine the concurrent validity between the Functional Gait Assessment (FGA), Berg Balance Scale (BBS), and Timed "Up & Go" Test (TUG) in patients with stroke. One hundred and five participants with at least 3 months post stroke and able to walk at least 6 m with or without a mono cane, participated in this study. Concurrent validity between the FGA, BBS, and TUG was assessed using Spearman rank order correlation. The FGA correlated with the BBS (r=.80, p<.01) and TUG (r=-.77, p<.01). The good and moderate correlation between the FGA, BBS, and TUG establishes the concurrent validity of the FGA in patients with stroke. These measures provide clinicians with valuable information about patients' functional balance capabilities.

• Korean Journal of Child Studies
• /
• v.26 no.2
• /
• pp.27-41
• /
• 2005

The purpose of this study was to test the reliability and validity of the Infant Montessori Performance Assessment Scales developed by the authors. Subjects of the study consisted of 132 Montessori teachers and 50 infants who were attending Montessori home school throughout the whole country, using census method. Infant's age ranged from 6 to 24 months. Data were analysed by using SAS 8.2 PC program. Statistical methods employed were frequency, Cronbach's alpha, Kappa coefficient, test-retest correlation, construct validity, and concurrent validity. The Cronbach's alpha of 6 sub-scales included physical, creativity, practical life, sense, language, and cognitive education, which ranged from .70 to .86. And the! correlation of the test/re-test was .72. The correlation between the 6 sub-scales of Infant-Montessori Performance Assessment Scales and the total scores of 6 items ranged from .06 to .84. Therefore, the construct validity of Infant Montessori Performance Assessment Scales was verified. The Kappa coefficient of inter-rater reliability was .76. The correlation between the Infant Montessori Performance Assessment Scales and the Standardized Korean Creativity Traits Checklist(K-CTC) and the Korean Child Social Maturity Scales showed non-significant levels of .16 and .12 respectively. Conclusively, Infant Montessori Performance Assessment Scales developed by the authors were verified through the above reliability and validity tests. Specifically the Infant Montessori Performance Assessment Scales showed the relationship of the convergent and divergent validity with the Korean Child Social Maturity Scales and the Standardized Korean Creativity Traits Checklist, respectively.

• Proceedings of the Korean Institute of Building Construction Conference
• /
• 2013.05a
• /
• pp.7-9
• /
• 2013

An assessment tool's validity is crucial because its scores are used as basis of decision making. This study assessed the content validity of the indicators for environmental assessment of construction activities. Pool of candidate indicators were constituted from the literature review, and CVR(Content Validity Rate) approach was adopted to investigate the content validity. As a result, 14 indicators are effective and five of them are content valid and retained from the pool.

• The Journal of Korean Academy of Sensory Integration
• /
• v.17 no.1
• /
• pp.19-29
• /
• 2019

Objective : The aim of this study was to verify validity of the Activity Participation Assessment for school-age children. Methods : A questionnaire consisting of 30 items from the APA, 75 items from the PACS, and 55 items from the CAPE was administered to elementary school students. A total of 207 questionnaires were analyzed. Confirmatory factor analysis was performed to confirm the construct validity of the APA. Convergence validity and discriminant validity were verified with the average variance extracted (AVE) and the square of the correlation coefficient. The discriminant validity was the Pearson correlation coefficient of the APA, PACS, and CAPE. Results : The results of the analysis were as follows: 1) For construct validity, the goodness of fit of the modified hierarchical second-order factor model was found to be appropriate (p < .001), 2) For convergent validity, the AVE was higher than .50 for all latent variables, 3) For discriminant validity, the AVE of the latent variable was greater than the square of the correlation coefficient (0.239), 4) For concurrent validity, the correlation between the total sum of the APA and PACS scores showed a positive correlation in all domains, and the correlation coefficient ranged from .303 to .647 at a statistically significant level (p < .01), 5) The correlation coefficient between the total sum of the APA and CAPE scores was .490 for recreational activities, .329 for physical activities, .571 for social activities, .401 for skill-based activities, and .390 for self-improvement activities. All domains showed a positive correlation, and were statistically significant (p < .01). Conclusion : APA can be used as a valid assessment tool to measure the participation of school aged children.

• Journal of Korean Clinical Nursing Research
• /
• v.26 no.2
• /
• pp.254-264
• /
• 2020

Purpose: This study was to examine the reliability and validity of the Korean version of the Cornell Assessment of Pediatric Delirium (CAPD). Methods: For testing the reliability of the Korean version of the CAPD, this study calculated the internal consistency (Cronbach's α) and the Interrater Correlation Coefficient (ICC) by comparing the independent assessment results of three nurses in Pediatric Intensive Care Unit (PICU). For testing the validity of the Korean version of the CAPD, the assessment result of the Korean version of the CAPD compared with that of the Diagnostic and Statistical Manual of Mental Disorders V (DSM-V). Receiver Operating Characteristics (ROC) analysis was used for measuring sensitivity and specificity. Results: Overall interrater reliability of the Korean version of the CAPD, ICC was .98 (95% CI .96~.99). Cronbach's α was .91 for eight items. The concordance between the Korean version of the CAPD and psychiatrist's diagnosis was 90.0%. When the Korean version of the CAPD has the cut point of 9, sensitivity was 93.8%, and specificity was 75.0%. The area under the curve indicated by the ROC analysis was .88. Conclusion: The Korean version of the CAPD showed good reliability and validity. This tool will be useful for pediatric delirium screening and management in Korean PICU.

• Journal of Korean Clinical Nursing Research
• /
• v.25 no.2
• /
• pp.179-188
• /
• 2019

Purpose: The purpose of this study was to develop a valid Adult Fall Assessment Scale Korean version (FAS-K) for inpatients in general hospitals in Korea. Methods: This a 14 item FAS-K was developed based on a review of national and international research and expert opinions in related field. Interrater reliability of FAS-K was analyzed using the ICC (Intraclass Correlation Coefficients). To examine the validity of FAS-K, a CVI (Content Validity Index), the Pearson correlation coefficients between FAS-K and two widely used scales, the Morse Fall Scale (MFS) and the Johns Hopkins Hospital Fall Risk Assessment Tool (JHFRAT), and the Mann-Whitney test were used. Results: The ICC was .958. The CVI ranged from .70 to 1.00. The FAS-K was significantly associated with the MFS (r=.74, p<.001) and with the JHFRAT (r=.87, p<.001), verifying the concurrent validity of FAS-K. As for the construct validity of FAS-K, significant differences between the fall and non-fall groups were found not only in the MFS (Z=-3.23, p=.001) but also in the FAS-K (Z=-3.10, p=.002). Conclusion: The findings indicate that the FAS-K is a reliable fall risk assessment tool with high validity.

• Journal of Korean Academy of Nursing
• /
• v.43 no.5
• /
• pp.587-594
• /
• 2013

Purpose: The purpose of this study is to provide researchers with a simplified approach to undertaking exploratory factor analysis for the assessment of construct validity. Methods: All articles published in 2010, 2011, and 2012 in Journal of Korean Academy of Nursing were reviewed and other relevant books and articles were chosen for the review. Results: In this paper, the following were discussed: preliminary analysis process of exploratory factor analysis to examine the sample size, distribution of measured variables, correlation coefficient, and results of KMO measure and Bartlett's test of sphericity. In addition, other areas to be considered in using factor analysis are discussed, including determination of the number of factors, the choice of rotation method or extraction method of the factor structure, and the interpretation of the factor loadings and explained variance. Conclusion: Content validity is the degree to which elements of an assessment instrument are relevant to and representative of the targeted construct for a particular assessment purpose. This measurement is difficult and challenging and takes a lot of time. Factor analysis is considered one of the strongest approaches to establishing construct validity and is the most commonly used method for establishing construct validity measured by an instrument.