• Title/Summary/Keyword: Inter-rater Reliability

Search Result 198, Processing Time 0.025 seconds

The Development of Infant Montessori Performance Assessment Scales - Centered on 6 to 24 Month Infants - (영아용 몬테소리 수행평가 도구 개발 - 6~24개월 영아를 중심으로 -)

  • Kim, Myung-Hee;Shin, Hwa-Sik;Kim, Ji-Young;Kim, Min-Sun
    • Korean Journal of Child Studies
    • /
    • v.26 no.2
    • /
    • pp.27-41
    • /
    • 2005
  • The purpose of this study was to test the reliability and validity of the Infant Montessori Performance Assessment Scales developed by the authors. Subjects of the study consisted of 132 Montessori teachers and 50 infants who were attending Montessori home school throughout the whole country, using census method. Infant's age ranged from 6 to 24 months. Data were analysed by using SAS 8.2 PC program. Statistical methods employed were frequency, Cronbach's alpha, Kappa coefficient, test-retest correlation, construct validity, and concurrent validity. The Cronbach's alpha of 6 sub-scales included physical, creativity, practical life, sense, language, and cognitive education, which ranged from .70 to .86. And the! correlation of the test/re-test was .72. The correlation between the 6 sub-scales of Infant-Montessori Performance Assessment Scales and the total scores of 6 items ranged from .06 to .84. Therefore, the construct validity of Infant Montessori Performance Assessment Scales was verified. The Kappa coefficient of inter-rater reliability was .76. The correlation between the Infant Montessori Performance Assessment Scales and the Standardized Korean Creativity Traits Checklist(K-CTC) and the Korean Child Social Maturity Scales showed non-significant levels of .16 and .12 respectively. Conclusively, Infant Montessori Performance Assessment Scales developed by the authors were verified through the above reliability and validity tests. Specifically the Infant Montessori Performance Assessment Scales showed the relationship of the convergent and divergent validity with the Korean Child Social Maturity Scales and the Standardized Korean Creativity Traits Checklist, respectively.

  • PDF

Validity and Reliability of Korean Version of Behavior Problems Inventory in Autism Spectrum Disorder and/or Intellectual Developmental Disorder

  • Hwang, Samuel Suk-Hyun;Park, Jangho;Kim, Sohee;Lee, Gayoung;Kim, Yeni;Bhang, Soo-Young
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • v.29 no.1
    • /
    • pp.7-13
    • /
    • 2018
  • Objectives: Problem behaviors pose a great obstacle to daily functioning in children with neurodevelopmental deficits and are an important target for treatment. In this study, we translated the Behavior Problems Inventory (BPI)-01 into Korean language and tested its psychometric properties. Methods: We attained the approval of the BPI author and performed standard translation-back translation. Then, professional caregivers examined appropriateness according to cultural and situational contexts in order to make necessary modifications of the Korean version of the BPI. Results: The BPI-01, Korea-Scales of Independent Behavior-Revised (K-SIB-R), and Child Behavior Checklist were completed for 98 autistic spectrum disorder or intellectual development disorder participants (mean age=28.3, standard deviation=7.3, range=10.1-51.7). The inter-rater reliability of the BPI-01 was found to be high (r=0.992-1.000). As for the results for concurrent validity for subscale items of BPI-01 and scales of SIB, correlations between SIB and BPI-01 subscales were statistically significant (r=0.357-0.672). Discussion: The Korean version of the BPI-01 showed good psychometric properties with high reliability and sufficient convergent validity. Further examination of the validity of BPI-01 should be carried out with inclusion of younger aged children and a closer look at less frequently occurring symptoms.

The Korean Tradition of Taegyo for Supporting Prenatal Development: Focusing on Emotion in Taegyo-Singi (정서발달의 관점에서 본 우리나라의 전통태교: 태교신기를 중심으로)

  • Chung, Soon Hwa
    • Human Ecology Research
    • /
    • v.52 no.1
    • /
    • pp.1-10
    • /
    • 2014
  • The purpose of this study was to analyse the principles and methods of Taegyo-Singi with regard to emotion and to review basic informations on Taegyo programs for promoting prenatal development. Taegyo-Singi was analyzed as follows. First, the contents of Taegyo-Singi were classified into principles and methods of Taegyo. Second, the domains of emotion were categorized into emotional perception, emotional expression, emotional understanding, and emotional regulation based on the classification of Mayer and Salovey, and Moon. Third, the contents of Taegyo-Singi were classified into the four domains of emotion. Finally, the reliability and validity of the classification were obtained through inter-rater agreement and analysis of content validity. The results indicated that first, the principles of Taegyo presuppose parental influence on temperament formation, and that the emotional states of the mother in the prenatal and prepregnancy period is the most influential variable in a child's temperament formation. Second, the methods of Taegyo presuppose that the human mind interacts with their behavior. Therefore, through emotional support of family members, 'jon-sim (the serene mind)' and 'chung-sim (the mind from rectitude)' are the key methods of Taegyo. This means that the Korean tradition of Taegyo focused on the emotional domain of development, especially emotional regulation. This coincides with the emotion-focused temperament theory that individual differences in temperament reflect individual differences in emotion.

The Pilot study of Clock Drawing Test as a screening test for dementia (치매선별검사로서의 시계 그리기 검사(CDT)에 관한 기초연구)

  • Kim Gwang-Ho;Lim Jae-Hwan;Kim Jong-Woo;Whang Wei-Wan;Cho Seung-Hun
    • Journal of Oriental Neuropsychiatry
    • /
    • v.12 no.2
    • /
    • pp.185-191
    • /
    • 2001
  • Objectives: This study aimed to evaluate the usefulness as a screening test of Clock Drawing Test(CDT) compared with the standard K-DRS in probably dementia. Methods: The subjects for this study consisted of 19 elderly persons who visited to the outpatient department of Oriental Neuropsychiatry of the Kyunghee Oriental hospital. They received the K-DRS and the Clock Drawing Test. Three observers evaluated them with circle, numbers, hands. Inter-rater reliability of scores from Clock Drawing Test was assessed and Pearson correlation coefficients were used to examined the relationships between scores from Clock Drawing Test and K-DRS. Results: Correlations between individual raters was highly significant (r= .957, .974, and .970, respectively: p<.001). There was stastically significant correlations between K-DRS and CDT scores (r= 0.849, p<.001). Conclusions: The CDT can be rated reliably by observers and correlations between CDT and K-DRS is significantly high. We confirmed the usefulness of CDT as simple, easily administered, low cost, and reliable general screening test for dementia.

  • PDF

Perturbation and Perceptual Analysis of Pathological Sustained Vowels according to Signal Typing

  • Lee, Ji-Yeoun;Choi, Seong-Hee;Jiang, Jack J.;Hahn, Min-Soo;Choi, Hong-Shik
    • Phonetics and Speech Sciences
    • /
    • v.2 no.2
    • /
    • pp.109-115
    • /
    • 2010
  • In this paper, we investigate a signal typing on the basis of visual impression of distinctive spectrogram. Pathological voices are classified into signal type 1, 2, 3, or 4 to estimate perturbation parameters and to mark perceptual rating based on Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V). The results suggest that perturbation analysis can be applied to only type 1 and 2 signals and the perceptual ratings of overall grade increase with each signal type, overall. A good inter-rater reliability is showed among three raters. We recommend that pathological voices should be marked the signal typing and CAPE-V, together, to definitely describe the characteristics of pathological voices.

  • PDF

Reliability and Validity of the Appropriateness Evaluation Protocol for Public Hospitals in Korea

  • Lee, Clara;Kim, Stella Jung-Hyun;Lee, Changwoo;Shin, Euichul
    • Journal of Preventive Medicine and Public Health
    • /
    • v.52 no.5
    • /
    • pp.316-322
    • /
    • 2019
  • Objectives: This study was conducted to assess the applicability of the Appropriateness Evaluation Protocol (AEP) for public hospitals in Korea. Methods: In May 2016, 1500 admission claims were collected from Korean public district hospitals using stratified random sampling. Of these claims, 560 admissions to 37 hospitals were retrieved for analysis. Medical records administrators determined the appropriateness of admission using the criteria detailed in the AEP, and a physician separately assessed the appropriateness of admission based on her clinical judgment. To examine the applicability of the AEP, the concordance of the decisions made between a pair of AEP reviewers and between an AEP reviewer and a physician reviewer was compared. Results: The results showed an almost perfect inter-rater agreement between the AEP reviewers and a moderate agreement between the AEP reviewers and the physician. The sensitivity and specificity of the AEP were calculated as 0.86 and 0.56, respectively. Conclusions: Our findings suggest that the AEP could potentially be applied to Korean public hospitals as a reliable and valid instrument for assessing the appropriateness of admissions.

Morphological variation of the velum in children and adults using magnetic resonance imaging

  • Kotlarek, Katelyn J.;Haenssler, Abigail E.;Hildebrand, Kori E.;Perry, Jamie L.
    • Imaging Science in Dentistry
    • /
    • v.49 no.2
    • /
    • pp.153-158
    • /
    • 2019
  • Purpose: The purpose of this study was to investigate variations in velar shape according to age, sex, and race using magnetic resonance imaging (MRI). Materials and Methods: The study sample consisted of 170 participants (85 children, 85 adults) between 4 and 34 years of age. Velar morphology was visually classified using midsagittal MRI scans for each participant by 2 independent raters. Inter- and intra-rater reliability was assessed. Statistical analyses were performed to identify correlations of velar shape with sex, age, and race. Results: The most frequent velar shape was "butt" for both adults(41%) and children (58%) in this study. The least common shapes for adults were "leaf" and "S." The children did not exhibit any "leaf" or "straight" velar shapes. A statistically significant difference was noted for age with respect to velar shape (P=0.014). Sex and race were found to have no significant impact on velar shape in this study. Conclusion: When using MRI to evaluate velar morphology, the "butt" shape was most common in both children and adults. Velar shape varied significantly with age, while race and sex did not have a significant impact.

Developing and testing the reliability of a measurement tool for an urban area food environment in Korea - Focusing on food stores - (우리나라 도시지역의 식환경 측정을 위한 조사도구 개발 및 신뢰도 검정 - 식품상점을 중심으로 -)

  • Jang, Mi Jin;Shin, Sangah;Kim, Seong-Ah;Chung, Sangwon;Paik, Hee Young;Choe, Jeong-Sook;Hong, Eun Joo;Joung, Hyojee
    • Journal of Nutrition and Health
    • /
    • v.47 no.5
    • /
    • pp.351-363
    • /
    • 2014
  • Purpose: The aim of this study was to develop a reliable measurement tool to assess the urban food environment, particularly focusing on food stores in Korea. Methods: The items for the measurement tool were selected through systematic literature reviews and adjusted to the Korean food environment. A total of 25 food stores in an urban area were recruited for the pilot test to evaluate the time required for completion of the survey, ease of response, willingness to participate, difficulties in conducting the survey, and appropriateness, and 34 food stores were recruited for assessment of the reliability of the tool using percent agreement and kappa value. Results: The measurement tool is composed of questions regarding food store characteristics, accessibility, and food availability. On average, 26 minutes was required to survey a single food store, and the subjects and interviewers answered that the process was not difficult for the survey. The percent agreement for the inter-rater and test-retest reliability ranged from 93.9~98.8% and 91.9~97.9, respectively. The kappa values ranged from 0.78 to 0.97, which was very high. Percent agreement and kappa value of food with healthy option were lower than those of the general food in the inter-rater reliability (p = 0.0027, p = 0.0095 respectively) as well as in the test-retest reliability (p = 0.0081, p = 0.0290, respectively), although they were still high enough (86.4~98.0% for percent agreement, 0.64~0.96 for kappa value). Conclusion: The newly developed measurement tool for assessment of food store environment appears to be feasible and reliable; therefore, it can be applied to research on the association between food environment and dietary behaviors as well as health outcomes.

Cross-cultural Adaptation and Psychometric Evaluation of the Korean Version of the A-ONE (한국판 일상생활활동중심 작업기반 신경행동평가(A-ONE)의 개발 및 평가)

  • Kang, Jaewon;Park, Hae Yean;Kim, Jung-Ran;Park, Ji-Hyuk
    • Therapeutic Science for Rehabilitation
    • /
    • v.10 no.2
    • /
    • pp.109-128
    • /
    • 2021
  • Objective : The purpose of this study was to develop a Korean version of the Activities of Daily Living (ADL)-focused Occupation-Based Neurobehavioral Evaluation (A-ONE) through cross-cultural adaptation and examine its validity and reliability. Methods : This study translated the A-ONE into Korean and performed cross-cultural adaptation for the Korean population. After the development of the Korean version of the A-ONE, cross-cultural and concurrent validities were analyzed. Internal consistency, test-retest reliability, and inter-rater reliability were also evaluated. Results : We adapted three items to the Korean culture. The Korean version of the A-ONE showed high cross-cultural validity with a content validity index (I-CVI) >0.9. It correlated with the Functional Independence Measure (FIM) (r=0.52-0.77, p<0.001), except for communication. Cronbach's α was 0.58-0.93 for the functional independence scale (FI) and 0.42-0.93 for the neurobehavioral specific impairment subscale (NBSIS). Intraclass correlation coefficients (ICCs) indicated high test-retest and inter-rater reliability for FI (ICC=0.79-1.00 and 0.75-1.00, respectively) and NBSIS (ICC=0.74-1.00 and 0.72-1.00, respectively). Conclusion : The Korean version of the A-ONE is well adapted to the Korean culture and has good validity and reliability. It is recommended to evaluate ADL performance skills and neurobehavioral impairments simultaneously in Korea.

Reliability Analysis of Finger Joint Range of Motion Measurements in Wearable Soft Sensor Gloves (웨어러블 소프트 센서 장갑의 손가락 관절 관절가동범위 측정에 대한 신뢰도 분석)

  • Eun-Kyung Kim;Jin-Hong Kim;Yu-Ri Kim;Ye-Ji Hong;Gang-Pyo Lee;Eun-Hye Jeon;Joon-bum Bae;Su-in Kim;Sang-Yi Lee
    • PNF and Movement
    • /
    • v.21 no.2
    • /
    • pp.171-183
    • /
    • 2023
  • Purpose: The purpose of this study was to compare universal goniometry (UG), which is commonly used in clinical practice to measure the range of motion (ROM) of finger joints with a wearable soft sensor glove, and to analyze the reliability to determine its usefulness. Methods: Ten healthy adults (6 males, 4 females) participated in this study. The metacarpophalangeal joint (MCP), interphalangeal joint (IP), and proximal interphalangeal joint (PIP) of both hands were measured using UG and Mollisen HAND soft sensor gloves during active flexion, according to the American Society for Hand Therapists' measurement criteria. Measurements were taken in triplicate and averaged. The mean and standard deviation of the two methods were calculated, and the 95% limits of agreement (LOA) of the measurements were calculated using the intraclass correlation coefficient (ICC) and Bland-Altman plot to examine the reliability and discrepancies between the measurements. Results: The results of the mean values of the flexion angles for the active range of motion (AROM) of the finger joints showed large angular differences in the finger joints, except for the MCP of the thumb. In the inter-rater reliability analysis according to the measurement method, the ICC (2, 1) value showed a low level close to 0, and the mean difference by the Bland-Altman plot showed a value greater than 0, showing a pattern of discrepancy. The 95% LOA had a wide range of differences. Conclusion: This study is a preliminary study investigating the usefulness of the soft sensor glove, and the reliability analysis showed a low level of reliability and inconsistency. However, if future studies can overcome the limitations of this study and the technical problems of the soft sensor glove in the development stage, it is suggested that the measurement instrument can show more accurate measurement and higher reliability when measuring ROM with UG.