• 제목/요약/키워드: Rater Reliability

검색결과 227건 처리시간 0.023초

아동중심놀이치료에서의 아동과 치료자 반응 관찰척도 개발 (The Development of an Observation Scale to facilitate a Valid and Reliable Analysis of the Responses of Child and Therapist in Child-Centered Play Therapy)

  • 이행숙;한유진
    • 아동학회지
    • /
    • 제34권1호
    • /
    • pp.141-159
    • /
    • 2013
  • This study was conducted in order to develop an observation scale for analyzing the responses of child and therapist in child-centered play therapy in terms of item discrimination, validity, and reliability. The observation scale was developed on the basis of child-centered play therapy literature, the author's experience of child-centered play therapy, the observation of video tapes of play therapy session, and discussions with child-centered play therapy experts. The participants in this study were 54 children aged from 4 to 9 years old who have emotional and behavioral problems, and 7 therapists who consult with the children. The reliability of factors, as measured by inter-rater reliability and Cronbach's', ranged from .72 to .77. The results of factor analysis identified 2 factors and 21 items associated with the reponses of the children, and 2 factors and 19 items associated with the responses of the therapists. The significant factors identified were as follows; (1) the child's response style; (2) the child's response content (adaptability, initiation, structuring, flexibility); (3) the therapist's response style, and (4) the therapist's response content (facilitative response, structuring, nonfacilitative response). In conclusion, these results demonstrated that the observation scale provides a valid and reliable means of analyzing the responses of child and therapist in child-centered play therapy.

영아용 몬테소리 수행평가 도구 개발 - 6~24개월 영아를 중심으로 - (The Development of Infant Montessori Performance Assessment Scales - Centered on 6 to 24 Month Infants -)

  • 김명희;신화식;김지영;김민선
    • 아동학회지
    • /
    • 제26권2호
    • /
    • pp.27-41
    • /
    • 2005
  • The purpose of this study was to test the reliability and validity of the Infant Montessori Performance Assessment Scales developed by the authors. Subjects of the study consisted of 132 Montessori teachers and 50 infants who were attending Montessori home school throughout the whole country, using census method. Infant's age ranged from 6 to 24 months. Data were analysed by using SAS 8.2 PC program. Statistical methods employed were frequency, Cronbach's alpha, Kappa coefficient, test-retest correlation, construct validity, and concurrent validity. The Cronbach's alpha of 6 sub-scales included physical, creativity, practical life, sense, language, and cognitive education, which ranged from .70 to .86. And the! correlation of the test/re-test was .72. The correlation between the 6 sub-scales of Infant-Montessori Performance Assessment Scales and the total scores of 6 items ranged from .06 to .84. Therefore, the construct validity of Infant Montessori Performance Assessment Scales was verified. The Kappa coefficient of inter-rater reliability was .76. The correlation between the Infant Montessori Performance Assessment Scales and the Standardized Korean Creativity Traits Checklist(K-CTC) and the Korean Child Social Maturity Scales showed non-significant levels of .16 and .12 respectively. Conclusively, Infant Montessori Performance Assessment Scales developed by the authors were verified through the above reliability and validity tests. Specifically the Infant Montessori Performance Assessment Scales showed the relationship of the convergent and divergent validity with the Korean Child Social Maturity Scales and the Standardized Korean Creativity Traits Checklist, respectively.

  • PDF

Validity and Reliability of Korean Version of Behavior Problems Inventory in Autism Spectrum Disorder and/or Intellectual Developmental Disorder

  • Hwang, Samuel Suk-Hyun;Park, Jangho;Kim, Sohee;Lee, Gayoung;Kim, Yeni;Bhang, Soo-Young
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • 제29권1호
    • /
    • pp.7-13
    • /
    • 2018
  • Objectives: Problem behaviors pose a great obstacle to daily functioning in children with neurodevelopmental deficits and are an important target for treatment. In this study, we translated the Behavior Problems Inventory (BPI)-01 into Korean language and tested its psychometric properties. Methods: We attained the approval of the BPI author and performed standard translation-back translation. Then, professional caregivers examined appropriateness according to cultural and situational contexts in order to make necessary modifications of the Korean version of the BPI. Results: The BPI-01, Korea-Scales of Independent Behavior-Revised (K-SIB-R), and Child Behavior Checklist were completed for 98 autistic spectrum disorder or intellectual development disorder participants (mean age=28.3, standard deviation=7.3, range=10.1-51.7). The inter-rater reliability of the BPI-01 was found to be high (r=0.992-1.000). As for the results for concurrent validity for subscale items of BPI-01 and scales of SIB, correlations between SIB and BPI-01 subscales were statistically significant (r=0.357-0.672). Discussion: The Korean version of the BPI-01 showed good psychometric properties with high reliability and sufficient convergent validity. Further examination of the validity of BPI-01 should be carried out with inclusion of younger aged children and a closer look at less frequently occurring symptoms.

젊은 성인의 흉추후만지수 및 자세 경직도와 흉추회전각 간의 상관성과 신뢰도 (The Reliability and Relationships Between Thoracic Kyphosis, Postural Stiffness and Thoracic Rotation in Young Subjects)

  • 장현정;김선엽;김명준
    • 대한정형도수물리치료학회지
    • /
    • 제18권2호
    • /
    • pp.49-55
    • /
    • 2012
  • Background: The purposes of this study were to: 1) investigate the relation between thoracic kyphosis, postural stiffness and thoracic rotation and 2) the intra-rater reliability of the measurement methods for thoracic kyphosis and rotation angle. Methods: Thirty-nine young adults (13 males, 26 females) participated in the study. Thoracic kyphosis was measured using a Flexicurve while standing in their usual relaxed posture and then in their maximally erector posture. Index of kyphosis (IK) measures taken in the relaxed and maximally erect positions were used to estimate postural stiffness. Thoracic rotation range of motion (ROM) was measured using universal goniometer and inclinometer in two positions. The association between the magnitude of the IK and thoracic stiffness and thoracic rotation ROM was also examined. Reliability was determined using intra-class correlation coefficients (ICC). Results: When measured from the mean relaxed IK (${\pm}SD$) was 7.42 (${\pm}1.47$) and mean erect IK was 4.92 (${\pm}1.63$) and mean IK ratio was 1.66 (${\pm}.65$). The relaxed IK was significantly correlated with the range of motion thoracic rotation in two positions (r=.503~580, p<.01). Conclusion: Thoracic kyphosis in relaxed position was associated with the range of motion thoracic rotation. Thoracic kyphosis measurement with the Flexicurve and range of motion 2 techniques of thoracic rotation showed good reliablity and may be a useful measurement tool in clinical practice.

  • PDF

Reliability and validity of pelvic mobility measurement using a cushion sensor in healthy adults

  • Jung, Seung-Hwa;Kim, Su-Kyeong;Lee, Ji-Hyun;Choi, Soo-Ih;Park, Dae-Sung
    • Physical Therapy Rehabilitation Science
    • /
    • 제9권2호
    • /
    • pp.74-81
    • /
    • 2020
  • Objective: To prevent low back pain, an objective evaluation tool to evaluate pelvic mobility and exercise to improve the flexibility of the lumbar region is needed. The purpose of this study was to compare the results of pelvic mobility measurements using the Wii Balance Board (WBB) and Sensbalance Therapy Cushion (STC), evaluate the usefulness of the STC as a tool for measuring pelvic mobility. Design: Cross-sectional study. Methods: Fifty healthy subjects participated in this study. The subjects performed pelvic mobility range, proprioception, reaction time and reach of the arm using the STC. The pelvic movement parameter was measured two times to determine the intra-rater reliability. To measure the correlation between lumbar muscle tension and pelvic mobility, Myovision was used to measure tension of L4, L5 level erector spinae muscle. Correlations between measured variables were checked to determine the validity of the pelvic mobility assessment tool. Results: STC showed high test-retest reliability in pelvic tilt measurement and reaching task [intraclass correlation coefficients (3,1)=0.804-0.915]. The relationship between WBB and STC showed a significant positive correlation with the pelvic tilt and reaching task (p<0.05). Posterior tilt and erector spinae activation (Lt. L5) showed a significant negative correlation (p<0.05). Left, right tilt and erector spinae activation (L5) showed a significant negative correlation (p<0.05). Conclusions: This study confirmed the advantages of the STC and found efficiency as an objective measuring device of pelvic mobility.

Effect of lower facial height and anteroposterior lip position on esthetic preference for Korean silhouette profiles

  • Seo, Kyung-Hyun;So, Deuk-Hun;Song, Kyeong-Tae;Choi, Sung-Kwon;Kang, Kyung-Hwa
    • 대한치과교정학회지
    • /
    • 제51권6호
    • /
    • pp.419-427
    • /
    • 2021
  • Objective: The purpose of this study was to evaluate the esthetic preference for various Korean silhouette profiles. Methods: The Korean average male and female profiles were modified by changing the lower facial height and anteroposterior lip position to produce nine types of profiles. In order to test intrarater reliability, the average profile was copied once more to be included for evaluation. A questionnaire containing 10 profiles for each sex, each of which had to be rated for preference on a numerical rating scale from 0 to 10, was administered to 30 adult orthodontic patients, 30 dental students, 30 orthodontists, and 30 dentists excluding orthodontists. The data were statistically analyzed using the intraclass correlation coefficient (ICC), independent t-test, and one-way ANOVA. Results: The ICC of overall intrarater reliability was 0.629. For several profiles, significantly higher scores were given to male profiles than to female profiles (p < 0.05). However, no significant differences were found in the scores for all profiles among the four rater groups. Among the short profiles, a significantly higher score was given to the retruded profile, and among the vertically average and long profiles, a significantly higher score was given to the horizontally average profile (p < 0.001). Among all the profiles, significantly lower scores were given to the protruded profile (p < 0.001). Conclusions: This study revealed good overall intrarater reliability, with several types of male profiles being esthetically preferred over female profiles. Moreover, while retruded and horizontally average profiles were generally preferred, protruded profiles were not.

우리나라 도시지역의 식환경 측정을 위한 조사도구 개발 및 신뢰도 검정 - 식품상점을 중심으로 - (Developing and testing the reliability of a measurement tool for an urban area food environment in Korea - Focusing on food stores -)

  • 장미진;신상아;김성아;정상원;백희영;최정숙;홍은주;정효지
    • Journal of Nutrition and Health
    • /
    • 제47권5호
    • /
    • pp.351-363
    • /
    • 2014
  • 본 연구는 도시지역의 식품상점 환경을 측정하기 위한 조사도구를 개발하고, 활용가능성 및 신뢰도를 검증하기 위해 실시하였다. 문헌고찰을 통해 기 개발된 식품상점 조사도구를 검토하여, 우리나라 실정에 맞는 식환경 조사도구를 개발하였고, 크게 식품상점의 특성, 접근성, 식품의 이용가능성에 대한 문항으로 구성하였다. 개발된 조사도구의 현장 적용성 검토를 위해 소요시간, 응답수월성, 참여의사, 현장조사의 어려움, 사용된 용어의 적절성 등을 평가한 결과, 조사시간이 상점의 특성에 따라 차이가 있다는 점을 제외하고는, 모든 측면에서 현장적용성이 높았다. 그리고 식품의 이용가능성 문항에 대해 신뢰도를 검증한 결과, 조사자간 및 조사자내 일치율이 매우 높았다. 건강이 강조된 식품의 경우에는 일반식품에 비해 상대적으로 일치율이 낮았으나, 여전히 높은 일치율 수준을 보였다. 본 연구에서 개발한 식환경 조사도구는 현장적용성과 신뢰도가 높은 것이 확인되었으므로, 추후에 객관적인 식환경 측정이 필요한연구에 다양하게 활용될 수 있을 것이다.

한국판 일상생활활동중심 작업기반 신경행동평가(A-ONE)의 개발 및 평가 (Cross-cultural Adaptation and Psychometric Evaluation of the Korean Version of the A-ONE)

  • 강재원;박혜연;김정란;박지혁
    • 재활치료과학
    • /
    • 제10권2호
    • /
    • pp.109-128
    • /
    • 2021
  • 목적 : 본 연구는 타문화권에서 개발된 일상생활활동중심 작업기반 신경행동평가(A-ONE)를 국내 임상에서 사용할 수 있도록 한국판을 개발하고 한국 환자에게 적용하여 신뢰도와 타당도를 검증하고자 하였다. 연구방법 : 영문판 A-ONE을 한국어로 번역하고 문화적 차이를 검토하였다. 완성된 한국판을 13명의 작업치료학과 교수와 작업치료사에게 국내 적용 가능성을 확인받고, 뇌졸중 환자 42명을 대상으로 신뢰도와 타당성을 검증하였다. 결과 : 총 3개의 문항을 국내 문화에 알맞도록 수정한 결과, 한국판 A-ONE은 Index at the item level(I-CVI)=0.92-1.00을 보이며 평가 문항들이 국내 문화를 잘 대표하고 있는 것으로 나타났다. Functional Independence Measure(FIM)과 상관관계는 의사소통영역을 제외하고 r=0.52-0.77(p>0.01)로 높게 나타난 반면, Lowenstein Occupational Therapy Cognitive Assessment(LOTCA)와는 전반적으로 유의미한 상관관계를 보이지 않았다(p>0.05). 내적일치도는 기능적 독립성이 Cronbach's α=0.58-0.93, 신경행동손상이 α=0.42-0.93을 보였다. 검사-재검사 신뢰도는 기능적 독립성이 Intraclass correlation coefficient(ICC)=0.79-1.00, 신경행동손상이 ICC=0.74-1.00으로 높은 수준을 보였다. 마지막으로, 검사자간 신뢰도는 기능적 독립성이 ICC=0.75-1.00, 신경행동손상이 ICC=0.72-1.00으로 높은 신뢰도를 보였다. 결론 : 한국판 A-ONE은 뇌졸중 환자의 일상생활활동 수행능력과 신경행동손상의 종류 및 손상정도를 평가하기 위해 국내 임상에서 사용될 수 있는 유용한 평가도구이다.

웨어러블 소프트 센서 장갑의 손가락 관절 관절가동범위 측정에 대한 신뢰도 분석 (Reliability Analysis of Finger Joint Range of Motion Measurements in Wearable Soft Sensor Gloves)

  • 김은경;김진홍;김유리;홍예지;이강표;전은혜;배준범;김수인;이상이
    • PNF and Movement
    • /
    • 제21권2호
    • /
    • pp.171-183
    • /
    • 2023
  • Purpose: The purpose of this study was to compare universal goniometry (UG), which is commonly used in clinical practice to measure the range of motion (ROM) of finger joints with a wearable soft sensor glove, and to analyze the reliability to determine its usefulness. Methods: Ten healthy adults (6 males, 4 females) participated in this study. The metacarpophalangeal joint (MCP), interphalangeal joint (IP), and proximal interphalangeal joint (PIP) of both hands were measured using UG and Mollisen HAND soft sensor gloves during active flexion, according to the American Society for Hand Therapists' measurement criteria. Measurements were taken in triplicate and averaged. The mean and standard deviation of the two methods were calculated, and the 95% limits of agreement (LOA) of the measurements were calculated using the intraclass correlation coefficient (ICC) and Bland-Altman plot to examine the reliability and discrepancies between the measurements. Results: The results of the mean values of the flexion angles for the active range of motion (AROM) of the finger joints showed large angular differences in the finger joints, except for the MCP of the thumb. In the inter-rater reliability analysis according to the measurement method, the ICC (2, 1) value showed a low level close to 0, and the mean difference by the Bland-Altman plot showed a value greater than 0, showing a pattern of discrepancy. The 95% LOA had a wide range of differences. Conclusion: This study is a preliminary study investigating the usefulness of the soft sensor glove, and the reliability analysis showed a low level of reliability and inconsistency. However, if future studies can overcome the limitations of this study and the technical problems of the soft sensor glove in the development stage, it is suggested that the measurement instrument can show more accurate measurement and higher reliability when measuring ROM with UG.

정서발달의 관점에서 본 우리나라의 전통태교: 태교신기를 중심으로 (The Korean Tradition of Taegyo for Supporting Prenatal Development: Focusing on Emotion in Taegyo-Singi)

  • 정순화
    • Human Ecology Research
    • /
    • 제52권1호
    • /
    • pp.1-10
    • /
    • 2014
  • The purpose of this study was to analyse the principles and methods of Taegyo-Singi with regard to emotion and to review basic informations on Taegyo programs for promoting prenatal development. Taegyo-Singi was analyzed as follows. First, the contents of Taegyo-Singi were classified into principles and methods of Taegyo. Second, the domains of emotion were categorized into emotional perception, emotional expression, emotional understanding, and emotional regulation based on the classification of Mayer and Salovey, and Moon. Third, the contents of Taegyo-Singi were classified into the four domains of emotion. Finally, the reliability and validity of the classification were obtained through inter-rater agreement and analysis of content validity. The results indicated that first, the principles of Taegyo presuppose parental influence on temperament formation, and that the emotional states of the mother in the prenatal and prepregnancy period is the most influential variable in a child's temperament formation. Second, the methods of Taegyo presuppose that the human mind interacts with their behavior. Therefore, through emotional support of family members, 'jon-sim (the serene mind)' and 'chung-sim (the mind from rectitude)' are the key methods of Taegyo. This means that the Korean tradition of Taegyo focused on the emotional domain of development, especially emotional regulation. This coincides with the emotion-focused temperament theory that individual differences in temperament reflect individual differences in emotion.