• 대한가정학회지
• /
• 제39권10호
• /
• pp.169-186
• /
• 2001

The purpose of the study was to verify validity and reliability of performance assessment in home economics by applying performance assessment tools developed by Korean Curriculum Assessment Institute and by the researcher to a class of 17 high school female students in a rural area. For the purpose of this study, the research question was formulated and addressed:“How are the validity and reliability of performance assessment in home economics\ulcorner” The results of the study were as follows. 1. The results of testing validity a. Thirteen high school home economics teachers, whose average teaching years is ten years verified high validity in the contents of performance assessment. b. In the validity of the items that is verified being based on the scores of high school entrance examination of 2000 school year, the essay type showed its characteristics as performance assessment. c. The generalizability among assessment methods was not high. 2. The results of testing reliability Both Cronbach's $\alpha$, inter-item reliability of the assessment tools used in the research, and reliability among the raters were high. But reliability among the tasks was relatively low. This study proposed that the diverse performance methods, the increasing number of assessment, the explicit assessment criterion, and scoring criterion are needed to satisfying validity and reliability of performance assessment.

• 한국수학교육학회지시리즈A:수학교육
• /
• 제57권3호
• /
• pp.215-229
• /
• 2018

Despite the importance of learning to do mathematical proofs, researchers have reported that not only secondary school students but also undergraduate students have difficulties in learning proofs. In this study, we introduced a new toll for learning proofs and explored the reliability and the validity of peer assessment on proofs. In the course of a university in Seoul, students were given weekly proof assignments prior to class. After solving the proofs, each student had to assess other students' proofs. The inter-rater reliabilities of weekly peer assessment was higher than .9 over 90 percent of the observed cases. To examine the validity of peer assessment, we check whether students' assessments were similar to expert assessment. Analysis showed that the equivalence has been quite high throughout the semester and the validity was low in the middle of the semester but rose by the end of the semester. Based on these results, we believe instructors can consider the application of peer assessment on proving tasks as a tool to help students learn.

• 대한물리의학회지
• /
• 제12권4호
• /
• pp.139-146
• /
• 2017

PURPOSE: The purpose of this study was to systematically analyze the reliability and validity of the Korean-version of the balance assessment tools. METHODS: Two reviewers of this study independently evaluated the titles of articles and abstracts of studies published until December 2016 through electronic databases (RISS, NDSL, KISS, DBpia) using the keywords "Balance or posture or postural control or postural stability", "Test or assessment or measurement or outcome measure or assessment tool or measurement tool", "Korean version", "Reliability" and "Validity". Regarding the questions considered suitable for the purpose of this study, consensus was reached after reading the full text. Selecting journals suitable for the purpose of the study, they were analyzed as data. RESULTS: The reviewers selected nine papers suitable for the purpose of this study, and Korean-version of the balance assessment tools, included the Berg Balance Scale (BBS), Activities-specific Balance Confidence (ABC) scale, Postural Assessment Scale for Stroke (PASS), Motor Assessment Scale (MAS), Trunk Impairment Scale (TIS), Falls Efficacy Scale (FES), Tinetti-Balance scale, Fullerton Advanced Balance (FAB) scale, and Function In Sitting Test (FIST). Our study showed that the reliability and validity of the Korean-version of the balance assessment tools were high. CONCLUSION: The Korean-version of the balance assessment tools with high reliability and validity would enable physical therapists to make a more accurate evaluation of balance.

• 한국전문물리치료학회지
• /
• 제18권2호
• /
• pp.43-51
• /
• 2011

Balance is a complex motor skill that depends on interactions between multiple sensorimotor processes and environmental and functional contexts. Many rehabilitation specialists believe that balance assessment under multitask conditions may be a more sensitive indicator of balance problems and falls than balance assessment in a single-task context. Functional Gait Assessment has many tasks that allow for testing under multitask conditions. The purpose of this study was to determine the concurrent validity between the Functional Gait Assessment (FGA), Berg Balance Scale (BBS), and Timed "Up & Go" Test (TUG) in patients with stroke. One hundred and five participants with at least 3 months post stroke and able to walk at least 6 m with or without a mono cane, participated in this study. Concurrent validity between the FGA, BBS, and TUG was assessed using Spearman rank order correlation. The FGA correlated with the BBS (r=.80, p<.01) and TUG (r=-.77, p<.01). The good and moderate correlation between the FGA, BBS, and TUG establishes the concurrent validity of the FGA in patients with stroke. These measures provide clinicians with valuable information about patients' functional balance capabilities.

• 아동학회지
• /
• 제26권2호
• /
• pp.27-41
• /
• 2005

The purpose of this study was to test the reliability and validity of the Infant Montessori Performance Assessment Scales developed by the authors. Subjects of the study consisted of 132 Montessori teachers and 50 infants who were attending Montessori home school throughout the whole country, using census method. Infant's age ranged from 6 to 24 months. Data were analysed by using SAS 8.2 PC program. Statistical methods employed were frequency, Cronbach's alpha, Kappa coefficient, test-retest correlation, construct validity, and concurrent validity. The Cronbach's alpha of 6 sub-scales included physical, creativity, practical life, sense, language, and cognitive education, which ranged from .70 to .86. And the! correlation of the test/re-test was .72. The correlation between the 6 sub-scales of Infant-Montessori Performance Assessment Scales and the total scores of 6 items ranged from .06 to .84. Therefore, the construct validity of Infant Montessori Performance Assessment Scales was verified. The Kappa coefficient of inter-rater reliability was .76. The correlation between the Infant Montessori Performance Assessment Scales and the Standardized Korean Creativity Traits Checklist(K-CTC) and the Korean Child Social Maturity Scales showed non-significant levels of .16 and .12 respectively. Conclusively, Infant Montessori Performance Assessment Scales developed by the authors were verified through the above reliability and validity tests. Specifically the Infant Montessori Performance Assessment Scales showed the relationship of the convergent and divergent validity with the Korean Child Social Maturity Scales and the Standardized Korean Creativity Traits Checklist, respectively.

• 한국건축시공학회:학술대회논문집
• /
• 한국건축시공학회 2013년도 춘계 학술논문 발표대회
• /
• pp.7-9
• /
• 2013

An assessment tool's validity is crucial because its scores are used as basis of decision making. This study assessed the content validity of the indicators for environmental assessment of construction activities. Pool of candidate indicators were constituted from the literature review, and CVR(Content Validity Rate) approach was adopted to investigate the content validity. As a result, 14 indicators are effective and five of them are content valid and retained from the pool.

• 대한감각통합치료학회지
• /
• 제17권1호
• /
• pp.19-29
• /
• 2019

목적 : 본 연구의 목적은 학령기 아동을 위한 활동 참여 평가도구(Activity Participation Assessment; APA)의 타당도를 알아보는 것이다. 연구방법 : 초등학생 207명을 대상으로 APA 30문항, PACS(Pediatric Activity Card Sort) 75문항, CAPE(Children's Assessment of Participation and Enjoyment) 55문항으로 구성된 설문지를 실시하였다. APA의 구인타당도를 알아보기 위해 확인적 요인분석을 실시하였으며, 수렴타당도와 판별타당도는 평균분산추출과 상관계수 제곱값을 통해 검증하였으며, 공인타당도는 APA와 PACS 및 CAPE의 피어슨의 상관계수를 통해 검증하였다. 연구결과 : 구인타당도는 확인적 요인분석 결과 수정된 위계적 2차 모형이 적합한 수준으로 나타났으며(p<.001), 수렴타당도는 모든 하위요인에서 평균분산 추출값이 .50이상으로 나타나 입증되었으며, 판별타당도는 평균분산 추출값이 결정계수인 0.239보다 더 크게 나타나 입증되었다. 공인타당도 분석에서 APA 항목 전체와 PACS의 자기관리는 .494(p<.01), 학교/생산성 .575(p<.01), 취미/사회 활동 .647(p<.01), 스포츠 .303(p<.01)으로 모두 정적 상관이 있는 것으로 나타났다. 또한 APA 항목 전체와 CAPE의 여가활동은 .490(p<.01), 신체적 활동 .329(p<.01), 사회 활동 .571(p<.01), 기술에 기초한 활동 .401(p<.01), 자기계발 활동 .390(p<.01)으로 모두 정적 상관관계를 보였다. 결론 : APA는 구인타당도, 수렴타당도, 변별타당도와 공인타당도가 입증되어 국내 학령기 아동의 활동 참여를 측정하는 검사로써 타당한 도구로 사용될 수 있다.

• 임상간호연구
• /
• 제26권2호
• /
• pp.254-264
• /
• 2020

Purpose: This study was to examine the reliability and validity of the Korean version of the Cornell Assessment of Pediatric Delirium (CAPD). Methods: For testing the reliability of the Korean version of the CAPD, this study calculated the internal consistency (Cronbach's α) and the Interrater Correlation Coefficient (ICC) by comparing the independent assessment results of three nurses in Pediatric Intensive Care Unit (PICU). For testing the validity of the Korean version of the CAPD, the assessment result of the Korean version of the CAPD compared with that of the Diagnostic and Statistical Manual of Mental Disorders V (DSM-V). Receiver Operating Characteristics (ROC) analysis was used for measuring sensitivity and specificity. Results: Overall interrater reliability of the Korean version of the CAPD, ICC was .98 (95% CI .96~.99). Cronbach's α was .91 for eight items. The concordance between the Korean version of the CAPD and psychiatrist's diagnosis was 90.0%. When the Korean version of the CAPD has the cut point of 9, sensitivity was 93.8%, and specificity was 75.0%. The area under the curve indicated by the ROC analysis was .88. Conclusion: The Korean version of the CAPD showed good reliability and validity. This tool will be useful for pediatric delirium screening and management in Korean PICU.

• 임상간호연구
• /
• 제25권2호
• /
• pp.179-188
• /
• 2019

Purpose: The purpose of this study was to develop a valid Adult Fall Assessment Scale Korean version (FAS-K) for inpatients in general hospitals in Korea. Methods: This a 14 item FAS-K was developed based on a review of national and international research and expert opinions in related field. Interrater reliability of FAS-K was analyzed using the ICC (Intraclass Correlation Coefficients). To examine the validity of FAS-K, a CVI (Content Validity Index), the Pearson correlation coefficients between FAS-K and two widely used scales, the Morse Fall Scale (MFS) and the Johns Hopkins Hospital Fall Risk Assessment Tool (JHFRAT), and the Mann-Whitney test were used. Results: The ICC was .958. The CVI ranged from .70 to 1.00. The FAS-K was significantly associated with the MFS (r=.74, p<.001) and with the JHFRAT (r=.87, p<.001), verifying the concurrent validity of FAS-K. As for the construct validity of FAS-K, significant differences between the fall and non-fall groups were found not only in the MFS (Z=-3.23, p=.001) but also in the FAS-K (Z=-3.10, p=.002). Conclusion: The findings indicate that the FAS-K is a reliable fall risk assessment tool with high validity.

• 대한간호학회지
• /
• 제43권5호
• /
• pp.587-594
• /
• 2013

Purpose: The purpose of this study is to provide researchers with a simplified approach to undertaking exploratory factor analysis for the assessment of construct validity. Methods: All articles published in 2010, 2011, and 2012 in Journal of Korean Academy of Nursing were reviewed and other relevant books and articles were chosen for the review. Results: In this paper, the following were discussed: preliminary analysis process of exploratory factor analysis to examine the sample size, distribution of measured variables, correlation coefficient, and results of KMO measure and Bartlett's test of sphericity. In addition, other areas to be considered in using factor analysis are discussed, including determination of the number of factors, the choice of rotation method or extraction method of the factor structure, and the interpretation of the factor loadings and explained variance. Conclusion: Content validity is the degree to which elements of an assessment instrument are relevant to and representative of the targeted construct for a particular assessment purpose. This measurement is difficult and challenging and takes a lot of time. Factor analysis is considered one of the strongest approaches to establishing construct validity and is the most commonly used method for establishing construct validity measured by an instrument.