• 제목/요약/키워드: Inter-Rater reliability

검색결과 199건 처리시간 0.024초

영아용 몬테소리 수행평가 도구 개발 - 6~24개월 영아를 중심으로 - (The Development of Infant Montessori Performance Assessment Scales - Centered on 6 to 24 Month Infants -)

  • 김명희;신화식;김지영;김민선
    • 아동학회지
    • /
    • 제26권2호
    • /
    • pp.27-41
    • /
    • 2005
  • The purpose of this study was to test the reliability and validity of the Infant Montessori Performance Assessment Scales developed by the authors. Subjects of the study consisted of 132 Montessori teachers and 50 infants who were attending Montessori home school throughout the whole country, using census method. Infant's age ranged from 6 to 24 months. Data were analysed by using SAS 8.2 PC program. Statistical methods employed were frequency, Cronbach's alpha, Kappa coefficient, test-retest correlation, construct validity, and concurrent validity. The Cronbach's alpha of 6 sub-scales included physical, creativity, practical life, sense, language, and cognitive education, which ranged from .70 to .86. And the! correlation of the test/re-test was .72. The correlation between the 6 sub-scales of Infant-Montessori Performance Assessment Scales and the total scores of 6 items ranged from .06 to .84. Therefore, the construct validity of Infant Montessori Performance Assessment Scales was verified. The Kappa coefficient of inter-rater reliability was .76. The correlation between the Infant Montessori Performance Assessment Scales and the Standardized Korean Creativity Traits Checklist(K-CTC) and the Korean Child Social Maturity Scales showed non-significant levels of .16 and .12 respectively. Conclusively, Infant Montessori Performance Assessment Scales developed by the authors were verified through the above reliability and validity tests. Specifically the Infant Montessori Performance Assessment Scales showed the relationship of the convergent and divergent validity with the Korean Child Social Maturity Scales and the Standardized Korean Creativity Traits Checklist, respectively.

  • PDF

Validity and Reliability of Korean Version of Behavior Problems Inventory in Autism Spectrum Disorder and/or Intellectual Developmental Disorder

  • Hwang, Samuel Suk-Hyun;Park, Jangho;Kim, Sohee;Lee, Gayoung;Kim, Yeni;Bhang, Soo-Young
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • 제29권1호
    • /
    • pp.7-13
    • /
    • 2018
  • Objectives: Problem behaviors pose a great obstacle to daily functioning in children with neurodevelopmental deficits and are an important target for treatment. In this study, we translated the Behavior Problems Inventory (BPI)-01 into Korean language and tested its psychometric properties. Methods: We attained the approval of the BPI author and performed standard translation-back translation. Then, professional caregivers examined appropriateness according to cultural and situational contexts in order to make necessary modifications of the Korean version of the BPI. Results: The BPI-01, Korea-Scales of Independent Behavior-Revised (K-SIB-R), and Child Behavior Checklist were completed for 98 autistic spectrum disorder or intellectual development disorder participants (mean age=28.3, standard deviation=7.3, range=10.1-51.7). The inter-rater reliability of the BPI-01 was found to be high (r=0.992-1.000). As for the results for concurrent validity for subscale items of BPI-01 and scales of SIB, correlations between SIB and BPI-01 subscales were statistically significant (r=0.357-0.672). Discussion: The Korean version of the BPI-01 showed good psychometric properties with high reliability and sufficient convergent validity. Further examination of the validity of BPI-01 should be carried out with inclusion of younger aged children and a closer look at less frequently occurring symptoms.

정서발달의 관점에서 본 우리나라의 전통태교: 태교신기를 중심으로 (The Korean Tradition of Taegyo for Supporting Prenatal Development: Focusing on Emotion in Taegyo-Singi)

  • 정순화
    • Human Ecology Research
    • /
    • 제52권1호
    • /
    • pp.1-10
    • /
    • 2014
  • The purpose of this study was to analyse the principles and methods of Taegyo-Singi with regard to emotion and to review basic informations on Taegyo programs for promoting prenatal development. Taegyo-Singi was analyzed as follows. First, the contents of Taegyo-Singi were classified into principles and methods of Taegyo. Second, the domains of emotion were categorized into emotional perception, emotional expression, emotional understanding, and emotional regulation based on the classification of Mayer and Salovey, and Moon. Third, the contents of Taegyo-Singi were classified into the four domains of emotion. Finally, the reliability and validity of the classification were obtained through inter-rater agreement and analysis of content validity. The results indicated that first, the principles of Taegyo presuppose parental influence on temperament formation, and that the emotional states of the mother in the prenatal and prepregnancy period is the most influential variable in a child's temperament formation. Second, the methods of Taegyo presuppose that the human mind interacts with their behavior. Therefore, through emotional support of family members, 'jon-sim (the serene mind)' and 'chung-sim (the mind from rectitude)' are the key methods of Taegyo. This means that the Korean tradition of Taegyo focused on the emotional domain of development, especially emotional regulation. This coincides with the emotion-focused temperament theory that individual differences in temperament reflect individual differences in emotion.

치매선별검사로서의 시계 그리기 검사(CDT)에 관한 기초연구 (The Pilot study of Clock Drawing Test as a screening test for dementia)

  • 김광호;임재환;김종우;황의완;조성훈
    • 동의신경정신과학회지
    • /
    • 제12권2호
    • /
    • pp.185-191
    • /
    • 2001
  • Objectives: This study aimed to evaluate the usefulness as a screening test of Clock Drawing Test(CDT) compared with the standard K-DRS in probably dementia. Methods: The subjects for this study consisted of 19 elderly persons who visited to the outpatient department of Oriental Neuropsychiatry of the Kyunghee Oriental hospital. They received the K-DRS and the Clock Drawing Test. Three observers evaluated them with circle, numbers, hands. Inter-rater reliability of scores from Clock Drawing Test was assessed and Pearson correlation coefficients were used to examined the relationships between scores from Clock Drawing Test and K-DRS. Results: Correlations between individual raters was highly significant (r= .957, .974, and .970, respectively: p<.001). There was stastically significant correlations between K-DRS and CDT scores (r= 0.849, p<.001). Conclusions: The CDT can be rated reliably by observers and correlations between CDT and K-DRS is significantly high. We confirmed the usefulness of CDT as simple, easily administered, low cost, and reliable general screening test for dementia.

  • PDF

Perturbation and Perceptual Analysis of Pathological Sustained Vowels according to Signal Typing

  • 이지연;최성희;;한민수;최홍식
    • 말소리와 음성과학
    • /
    • 제2권2호
    • /
    • pp.109-115
    • /
    • 2010
  • In this paper, we investigate a signal typing on the basis of visual impression of distinctive spectrogram. Pathological voices are classified into signal type 1, 2, 3, or 4 to estimate perturbation parameters and to mark perceptual rating based on Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V). The results suggest that perturbation analysis can be applied to only type 1 and 2 signals and the perceptual ratings of overall grade increase with each signal type, overall. A good inter-rater reliability is showed among three raters. We recommend that pathological voices should be marked the signal typing and CAPE-V, together, to definitely describe the characteristics of pathological voices.

  • PDF

Reliability and Validity of the Appropriateness Evaluation Protocol for Public Hospitals in Korea

  • Lee, Clara;Kim, Stella Jung-Hyun;Lee, Changwoo;Shin, Euichul
    • Journal of Preventive Medicine and Public Health
    • /
    • 제52권5호
    • /
    • pp.316-322
    • /
    • 2019
  • Objectives: This study was conducted to assess the applicability of the Appropriateness Evaluation Protocol (AEP) for public hospitals in Korea. Methods: In May 2016, 1500 admission claims were collected from Korean public district hospitals using stratified random sampling. Of these claims, 560 admissions to 37 hospitals were retrieved for analysis. Medical records administrators determined the appropriateness of admission using the criteria detailed in the AEP, and a physician separately assessed the appropriateness of admission based on her clinical judgment. To examine the applicability of the AEP, the concordance of the decisions made between a pair of AEP reviewers and between an AEP reviewer and a physician reviewer was compared. Results: The results showed an almost perfect inter-rater agreement between the AEP reviewers and a moderate agreement between the AEP reviewers and the physician. The sensitivity and specificity of the AEP were calculated as 0.86 and 0.56, respectively. Conclusions: Our findings suggest that the AEP could potentially be applied to Korean public hospitals as a reliable and valid instrument for assessing the appropriateness of admissions.

Morphological variation of the velum in children and adults using magnetic resonance imaging

  • Kotlarek, Katelyn J.;Haenssler, Abigail E.;Hildebrand, Kori E.;Perry, Jamie L.
    • Imaging Science in Dentistry
    • /
    • 제49권2호
    • /
    • pp.153-158
    • /
    • 2019
  • Purpose: The purpose of this study was to investigate variations in velar shape according to age, sex, and race using magnetic resonance imaging (MRI). Materials and Methods: The study sample consisted of 170 participants (85 children, 85 adults) between 4 and 34 years of age. Velar morphology was visually classified using midsagittal MRI scans for each participant by 2 independent raters. Inter- and intra-rater reliability was assessed. Statistical analyses were performed to identify correlations of velar shape with sex, age, and race. Results: The most frequent velar shape was "butt" for both adults(41%) and children (58%) in this study. The least common shapes for adults were "leaf" and "S." The children did not exhibit any "leaf" or "straight" velar shapes. A statistically significant difference was noted for age with respect to velar shape (P=0.014). Sex and race were found to have no significant impact on velar shape in this study. Conclusion: When using MRI to evaluate velar morphology, the "butt" shape was most common in both children and adults. Velar shape varied significantly with age, while race and sex did not have a significant impact.

우리나라 도시지역의 식환경 측정을 위한 조사도구 개발 및 신뢰도 검정 - 식품상점을 중심으로 - (Developing and testing the reliability of a measurement tool for an urban area food environment in Korea - Focusing on food stores -)

  • 장미진;신상아;김성아;정상원;백희영;최정숙;홍은주;정효지
    • Journal of Nutrition and Health
    • /
    • 제47권5호
    • /
    • pp.351-363
    • /
    • 2014
  • 본 연구는 도시지역의 식품상점 환경을 측정하기 위한 조사도구를 개발하고, 활용가능성 및 신뢰도를 검증하기 위해 실시하였다. 문헌고찰을 통해 기 개발된 식품상점 조사도구를 검토하여, 우리나라 실정에 맞는 식환경 조사도구를 개발하였고, 크게 식품상점의 특성, 접근성, 식품의 이용가능성에 대한 문항으로 구성하였다. 개발된 조사도구의 현장 적용성 검토를 위해 소요시간, 응답수월성, 참여의사, 현장조사의 어려움, 사용된 용어의 적절성 등을 평가한 결과, 조사시간이 상점의 특성에 따라 차이가 있다는 점을 제외하고는, 모든 측면에서 현장적용성이 높았다. 그리고 식품의 이용가능성 문항에 대해 신뢰도를 검증한 결과, 조사자간 및 조사자내 일치율이 매우 높았다. 건강이 강조된 식품의 경우에는 일반식품에 비해 상대적으로 일치율이 낮았으나, 여전히 높은 일치율 수준을 보였다. 본 연구에서 개발한 식환경 조사도구는 현장적용성과 신뢰도가 높은 것이 확인되었으므로, 추후에 객관적인 식환경 측정이 필요한연구에 다양하게 활용될 수 있을 것이다.

한국판 일상생활활동중심 작업기반 신경행동평가(A-ONE)의 개발 및 평가 (Cross-cultural Adaptation and Psychometric Evaluation of the Korean Version of the A-ONE)

  • 강재원;박혜연;김정란;박지혁
    • 재활치료과학
    • /
    • 제10권2호
    • /
    • pp.109-128
    • /
    • 2021
  • 목적 : 본 연구는 타문화권에서 개발된 일상생활활동중심 작업기반 신경행동평가(A-ONE)를 국내 임상에서 사용할 수 있도록 한국판을 개발하고 한국 환자에게 적용하여 신뢰도와 타당도를 검증하고자 하였다. 연구방법 : 영문판 A-ONE을 한국어로 번역하고 문화적 차이를 검토하였다. 완성된 한국판을 13명의 작업치료학과 교수와 작업치료사에게 국내 적용 가능성을 확인받고, 뇌졸중 환자 42명을 대상으로 신뢰도와 타당성을 검증하였다. 결과 : 총 3개의 문항을 국내 문화에 알맞도록 수정한 결과, 한국판 A-ONE은 Index at the item level(I-CVI)=0.92-1.00을 보이며 평가 문항들이 국내 문화를 잘 대표하고 있는 것으로 나타났다. Functional Independence Measure(FIM)과 상관관계는 의사소통영역을 제외하고 r=0.52-0.77(p>0.01)로 높게 나타난 반면, Lowenstein Occupational Therapy Cognitive Assessment(LOTCA)와는 전반적으로 유의미한 상관관계를 보이지 않았다(p>0.05). 내적일치도는 기능적 독립성이 Cronbach's α=0.58-0.93, 신경행동손상이 α=0.42-0.93을 보였다. 검사-재검사 신뢰도는 기능적 독립성이 Intraclass correlation coefficient(ICC)=0.79-1.00, 신경행동손상이 ICC=0.74-1.00으로 높은 수준을 보였다. 마지막으로, 검사자간 신뢰도는 기능적 독립성이 ICC=0.75-1.00, 신경행동손상이 ICC=0.72-1.00으로 높은 신뢰도를 보였다. 결론 : 한국판 A-ONE은 뇌졸중 환자의 일상생활활동 수행능력과 신경행동손상의 종류 및 손상정도를 평가하기 위해 국내 임상에서 사용될 수 있는 유용한 평가도구이다.

웨어러블 소프트 센서 장갑의 손가락 관절 관절가동범위 측정에 대한 신뢰도 분석 (Reliability Analysis of Finger Joint Range of Motion Measurements in Wearable Soft Sensor Gloves)

  • 김은경;김진홍;김유리;홍예지;이강표;전은혜;배준범;김수인;이상이
    • PNF and Movement
    • /
    • 제21권2호
    • /
    • pp.171-183
    • /
    • 2023
  • Purpose: The purpose of this study was to compare universal goniometry (UG), which is commonly used in clinical practice to measure the range of motion (ROM) of finger joints with a wearable soft sensor glove, and to analyze the reliability to determine its usefulness. Methods: Ten healthy adults (6 males, 4 females) participated in this study. The metacarpophalangeal joint (MCP), interphalangeal joint (IP), and proximal interphalangeal joint (PIP) of both hands were measured using UG and Mollisen HAND soft sensor gloves during active flexion, according to the American Society for Hand Therapists' measurement criteria. Measurements were taken in triplicate and averaged. The mean and standard deviation of the two methods were calculated, and the 95% limits of agreement (LOA) of the measurements were calculated using the intraclass correlation coefficient (ICC) and Bland-Altman plot to examine the reliability and discrepancies between the measurements. Results: The results of the mean values of the flexion angles for the active range of motion (AROM) of the finger joints showed large angular differences in the finger joints, except for the MCP of the thumb. In the inter-rater reliability analysis according to the measurement method, the ICC (2, 1) value showed a low level close to 0, and the mean difference by the Bland-Altman plot showed a value greater than 0, showing a pattern of discrepancy. The 95% LOA had a wide range of differences. Conclusion: This study is a preliminary study investigating the usefulness of the soft sensor glove, and the reliability analysis showed a low level of reliability and inconsistency. However, if future studies can overcome the limitations of this study and the technical problems of the soft sensor glove in the development stage, it is suggested that the measurement instrument can show more accurate measurement and higher reliability when measuring ROM with UG.