• 대한물리의학회지
• /
• 제8권1호
• /
• pp.137-145
• /
• 2013

PURPOSE: The purpose of this study is to examine assessment of test-retest reliability for 13 items of pediatric balance scales, then the intrarater reliability among the raters. METHODS: Study participants included 6 children with spastic cerebral palsy who could walk. Raters were consist of seventy-four, 2nd year physical therapy major students. The children's ability to achieve physical balance was wideotaped for PBS items. The raters watched the tapes and evlauated each child twice. Test-retest reliability was analyzed using the Spearman correlation, and interrater reliability was analyzed using the Kendall's coefficient of concordance for ranks. RESULTS: The total PBS scores averaged 49.22 and 50.06 for first and second tests. Test-retest reliability of PBS individual items were between low and high. The low itmes were 3 items, and high were 4 itmes. Interrater reliability were low agreement. CONCLUSION: Based on the study, the pediatric balance scale is an effective evaluating tool for measuring functional balance of school age child. However, the agreement of students or beginner's interpretation is necessary in conjunction to this study results. On top of that, it is important to provide detailed explanation and repetitive training, which improves the analysis reliability. Also, each category subscores level for the pediatric balance scale must be examined carefully in conjunction to performing test, only after improving match quality via preceding practice.

• 대한물리의학회지
• /
• 제16권2호
• /
• pp.45-52
• /
• 2021

PURPOSE: This study examined the imaging procedure of pectoralis minor muscle thickness and assessed the intra- and inter-rater reliability of the muscle thickness measured by two raters using rehabilitative ultrasound imaging (RUSI) in healthy individuals. METHODS: Fifteen participants (aged 21 - 28, seven females, and eight males) were involved in the study. The primary rater palpated the coracoid process and the fourth rib, defined as the width of the index finger lateral to the sternum to avoid breast tissues, and lined the two landmarks. The second examiner checked 1 / 3 (1st point) and 1 / 2 (2nd point) of the line length as measurement points. The two raters obtained right side muscle images of the participants at a standardized sitting position using RUSI with a 7.5 MHz linear transducer at 40mm depth. For intra-rater reliability, the principal rater took three images per point and tried to take one more with an interval. For the inter-rater reliability, the other rater performed the same tasks as the principal rater on the same day. The reliability was analyzed using the intra-class correlation coefficient (ICC), the standard error of the measurement (SEM), and Bland and Altman plots. RESULTS: The reliability at all points was excellent for the same rater (ICC_3,1 = .973 - .978, SEM = .042 - .046), and between raters (ICC_2,1 = .939 - .959, SEM = .059 - .097). CONCLUSION: These findings show that the RUSI could be reliable for examining the pectoralis minor muscle thickness in healthy individuals at all measurement sites.

• 감성과학
• /
• 제11권4호
• /
• pp.553-564
• /
• 2008

본 연구에서는 일반화가능도 이론을 이용하여 폴리그라프 검사에 사용된 관련 질문의 개수와 반복측정 횟수 (차트의 수), 채점자 수가 폴리그라프 검사의 신뢰도에 미치는 영향을 평가하였다. 검찰청에서 형사피의자를 대상으로 Backster ZCT를 사용한 폴리그라프 검사자료 중 31명의 폴리그라프 검사자료를 표본추출하였으며, 31명의 검사자료를 13명의 채점자가 수치적 채점방법을 이용하여 채점한 점수에 대하여 일반화가능도 이론을 적용하여 분석하였다. 분석결과, 피검사자의 변량성분이 43.97%로 가장 컸으며, 다음으로 잔여오차변량성분이 16.84%, 피검사자와 반복측정 횟수의 상호작용오차변량성분이 12.17%, 피검사자와 반복측정 횟수, 관련 질문 개수의 삼원상호작용오차변량성분이 10.31%였으며, 나머지 변량성분은 모두 7% 미만이었다. 관련 질문의 개수와 반복측정 횟수, 채점자의 수에 따른 일반화가능도 계수를 산출한 결과, 바람직한 일반화가능도 계수인 0.80 이상을 보이는 조건은 관련 질문 2개 이상과 반복측정 3회 이상, 채점자 2명 이상의 조합인 것으로 나타났다.

• Journal of the Korean Statistical Society
• /
• 제21권2호
• /
• pp.179-185
• /
• 1992

A model is proposed for describing agreement between two raters on a nominal categorical scale. This model has a structure of symmetry plus main-diagonal equiprobability, which is a special case of the quasi-symmetry model. An example is given.

• 영어어문교육
• /
• 제12권3호
• /
• pp.147-166
• /
• 2006

This study investigates the effect of misplacement in a written Computer-delivered ESL Placement Test (CEPT) context. The study aims to address the following two research questions: a) which scoring rubric features cause the misplacement of ESL learner's writing scores? and b) which scoring rubric features improve ESL learner's writing scores? Thirty-four international examinees took the test and participated in surveys at the University of Illinois. Twelve examinees of them attended the CEPT workshop test. In the workshop test, they carried out self-evaluation on their first essays using a scoring rubric and compared with expert raters' results. After the workshop, the examinees responded to a survey and interview. For the first research question, the results of the survey and interview addressed that the majority disagreed with the raters' rating results. The self-evaluation results also indicated that their misunderstanding of organization feature caused the misplacement. For the second question, the CEPT workshop scores were improved due to the score improvement in the organization feature while the contribution of other features to the total scores was little. Most of the examinees pointed out that a lesson on the scoring rubric enhanced their understanding of the writing features of the rubric so that their placement scores were generally improved.

• The Journal of Korean Physical Therapy
• /
• 제22권5호
• /
• pp.83-93
• /
• 2010

Purpose: The purpose of this study was to determine the reliability and validity of the Functional Movement Screen (FMS) for assessing Korean athletes. Methods: A total of 48 patients (37 males and 11 females) participated in this study. Data were acquired after translation of the FMS from English to Korean and cross-cultural adaptation of the this questionnaire. To determine inter-rater reliability, the relationship between the FMS scores obtained by two raters was evaluated using the Kappa coefficient, which was in total agreement with the Intra-Correlation Coefficient (ICC3,1). Concurrent validity was examined by correlating the FMS scores with the Oswestry disability index (ODI) scores and Visual analogue scale (VAS) scores. Results: The raters demonstrated excellent agreement on 7 (above 90%) of the 17 test (72.9 to 97.9%) components. Substantial agreement was seen in 11 of the 17 tests. Two components of the In-line lunge and rotatory stability tests demonstrated moderate agreement. It showed good inter-rater reliability: the Kappa coefficients ranged from 0.42 to 0.97. ICC3,1=0.42~0.99 and 0.93 (total FMS score). Cronbach's alpha for FMS was 0.80. It was not correlated with ODI or VAS. Conclusion: The Korean version of the FMS is a reliable instrument for measuring movement patterns of Korean athletes and for making decisions related to interventions for performance enhancement.

• 한국수학교육학회지시리즈A:수학교육
• /
• 제55권4호
• /
• pp.397-416
• /
• 2016

This study analyzed the quality of mathematics classes with observations using the instrument, MQI(Mathematical Quality of Instruction). Class recordings and interviews were conducted on 2 pre-service teachers and 4 in-service teachers. This study recorded and analyzed 3 or 4 classes for each mathematics teacher by using revised MQI. There were a total of 8 raters: 2 or 3 raters analyzed each class. MQI has four dimensions: Richness of the Mathematics, Working with Students and Mathematic, Errors and Imprecision, Student Participation in Meaning-Making and Reasoning. In the dimension of 'Richness of Mathematics', all teachers had good scores of 'explanations of teacher' but had lower scores of 'linking and connections', 'multiple procedures or solution methods' and 'developing mathematical generalizations.' In the dimension of 'Working with Students and Mathematics', two in-service teachers who have worked and having more experience had higher scores than others. In the dimension of 'Errors and Imprecision', all teachers had high scores. In the dimension of 'Student Participation in Meaning-Making and Reasoning', two pre-service teachers had contrast and also two in-service teachers who hadn't worked not long had contrast. Implications were deducted from finding to improving quality of mathematics classes.

• The Journal of Asian Finance, Economics and Business
• /
• 제5권4호
• /
• pp.9-20
• /
• 2018

Global rating agencies, such as Moody's and S&P, have assigned credit ratings to corporate bonds issued by Japanese firms since 1980s. Local Japanese rating agencies, such as R&I and JCR, have more market share than the global raters. We examine the yield spreads of 1,050 yen-denominated corporate bonds issued by financial firms in Japan from 1998 to 2014 and find no evidence that bonds rated by at least one global agency are associated with a significant reduction in the cost of debt as compared to those rated by only local rating agencies. Unlike non-financial firms, the reputation effect of global rating agencies does not exist for Japanese financial firms. We also observe that firms with less information asymmetry are more likely to acquire ratings from Moody's or S&P. Additionally, the firm's financial profile does not affect its choice to seek out ratings from global raters. Our findings are contradictory to those by Han, Pagano, and Shin (2012), who employ bonds issued by non-financial firms in Japan. Our conjecture is that the asymmetric nature of financial firms makes investors less likely to depend on a credit risk assessment by rating agencies in determining the yields of new bonds.

• 응용통계연구
• /
• 제20권1호
• /
• pp.117-132
• /
• 2007

두 평정자가 있는 이차원 분류표에서 우연에 의한 합치 비율을 보정한 Cohen의 합치도($\kappa$)는 문제점이 있는 측도로 알려져 있다. $\kappa$는 평정자의 분류 비율(주변확률)에 매우 민감하고, 합치도로서의 조건도 만족하지 못한다. 그러나 $\kappa$를 비롯한 기존 합치도들은 주변확률이 0.5에 가까울 때 안정되며 비슷한 값을 갖는다. 본 연구에서는 이차원 분류표의 불균형적 주변분포를 보정함으로써 $\kappa$의 역설을 해결하는 새로운 합치도 H를 제안한다. 또한 예제를 통해 기존의 합치도들과 제안된 합치도를 비교한다.

• Human Ecology Research
• /
• 제57권1호
• /
• pp.109-125
• /
• 2019

Few studies have utilized observational methods in the field of couple research even though using self-report questionnaires is prone to the subjective biases of the reporter. This study validates the Marital Interaction Coding System-Global (MICS-G), a global version of the well-established microanalytic observational coding system, Marital Interaction Coding System (MICS). Participants in the study consisted of 30 married couples with varied levels of marital adjustment who visited one of the Healthy Family and Multicultural Family Support Centers in Seoul, either for couple therapy or the "Marriage Checkup"program. Ten-minute problem-solving discussions were rated by two undergraduate student raters who were trained for 10 hours. Interobserver agreement based on percentage agreement and intraclass correlation coefficients showed a high level of agreement between raters in establishing interrater reliability. Convergent validity was established by: correlations among marital adjustment, psychological aggression, mental health, and MICS-G categories of conflicts, validation, invalidation, facilitation, and withdrawal. MICS-G categories also were successful in discriminating between distressed and nondistressed couples, which provides evidence of discriminant validity for MICS-G. This study showed that MICS-G is a promising method for researchers to observe couple interactions in a more cost-effective way. Methodological issues and practical applications are also discussed.