• Title/Summary/Keyword: inter-rater reliability

Search Result 200, Processing Time 0.027 seconds

The Development of an Observation Scale to facilitate a Valid and Reliable Analysis of the Responses of Child and Therapist in Child-Centered Play Therapy (아동중심놀이치료에서의 아동과 치료자 반응 관찰척도 개발)

  • Lee, Haeng Suk;Han, You Jin
    • Korean Journal of Child Studies
    • /
    • v.34 no.1
    • /
    • pp.141-159
    • /
    • 2013
  • This study was conducted in order to develop an observation scale for analyzing the responses of child and therapist in child-centered play therapy in terms of item discrimination, validity, and reliability. The observation scale was developed on the basis of child-centered play therapy literature, the author's experience of child-centered play therapy, the observation of video tapes of play therapy session, and discussions with child-centered play therapy experts. The participants in this study were 54 children aged from 4 to 9 years old who have emotional and behavioral problems, and 7 therapists who consult with the children. The reliability of factors, as measured by inter-rater reliability and Cronbach's', ranged from .72 to .77. The results of factor analysis identified 2 factors and 21 items associated with the reponses of the children, and 2 factors and 19 items associated with the responses of the therapists. The significant factors identified were as follows; (1) the child's response style; (2) the child's response content (adaptability, initiation, structuring, flexibility); (3) the therapist's response style, and (4) the therapist's response content (facilitative response, structuring, nonfacilitative response). In conclusion, these results demonstrated that the observation scale provides a valid and reliable means of analyzing the responses of child and therapist in child-centered play therapy.

The Development of Infant Montessori Performance Assessment Scales - Centered on 6 to 24 Month Infants - (영아용 몬테소리 수행평가 도구 개발 - 6~24개월 영아를 중심으로 -)

  • Kim, Myung-Hee;Shin, Hwa-Sik;Kim, Ji-Young;Kim, Min-Sun
    • Korean Journal of Child Studies
    • /
    • v.26 no.2
    • /
    • pp.27-41
    • /
    • 2005
  • The purpose of this study was to test the reliability and validity of the Infant Montessori Performance Assessment Scales developed by the authors. Subjects of the study consisted of 132 Montessori teachers and 50 infants who were attending Montessori home school throughout the whole country, using census method. Infant's age ranged from 6 to 24 months. Data were analysed by using SAS 8.2 PC program. Statistical methods employed were frequency, Cronbach's alpha, Kappa coefficient, test-retest correlation, construct validity, and concurrent validity. The Cronbach's alpha of 6 sub-scales included physical, creativity, practical life, sense, language, and cognitive education, which ranged from .70 to .86. And the! correlation of the test/re-test was .72. The correlation between the 6 sub-scales of Infant-Montessori Performance Assessment Scales and the total scores of 6 items ranged from .06 to .84. Therefore, the construct validity of Infant Montessori Performance Assessment Scales was verified. The Kappa coefficient of inter-rater reliability was .76. The correlation between the Infant Montessori Performance Assessment Scales and the Standardized Korean Creativity Traits Checklist(K-CTC) and the Korean Child Social Maturity Scales showed non-significant levels of .16 and .12 respectively. Conclusively, Infant Montessori Performance Assessment Scales developed by the authors were verified through the above reliability and validity tests. Specifically the Infant Montessori Performance Assessment Scales showed the relationship of the convergent and divergent validity with the Korean Child Social Maturity Scales and the Standardized Korean Creativity Traits Checklist, respectively.

  • PDF

Validity and Reliability of Korean Version of Behavior Problems Inventory in Autism Spectrum Disorder and/or Intellectual Developmental Disorder

  • Hwang, Samuel Suk-Hyun;Park, Jangho;Kim, Sohee;Lee, Gayoung;Kim, Yeni;Bhang, Soo-Young
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • v.29 no.1
    • /
    • pp.7-13
    • /
    • 2018
  • Objectives: Problem behaviors pose a great obstacle to daily functioning in children with neurodevelopmental deficits and are an important target for treatment. In this study, we translated the Behavior Problems Inventory (BPI)-01 into Korean language and tested its psychometric properties. Methods: We attained the approval of the BPI author and performed standard translation-back translation. Then, professional caregivers examined appropriateness according to cultural and situational contexts in order to make necessary modifications of the Korean version of the BPI. Results: The BPI-01, Korea-Scales of Independent Behavior-Revised (K-SIB-R), and Child Behavior Checklist were completed for 98 autistic spectrum disorder or intellectual development disorder participants (mean age=28.3, standard deviation=7.3, range=10.1-51.7). The inter-rater reliability of the BPI-01 was found to be high (r=0.992-1.000). As for the results for concurrent validity for subscale items of BPI-01 and scales of SIB, correlations between SIB and BPI-01 subscales were statistically significant (r=0.357-0.672). Discussion: The Korean version of the BPI-01 showed good psychometric properties with high reliability and sufficient convergent validity. Further examination of the validity of BPI-01 should be carried out with inclusion of younger aged children and a closer look at less frequently occurring symptoms.

The Korean Tradition of Taegyo for Supporting Prenatal Development: Focusing on Emotion in Taegyo-Singi (정서발달의 관점에서 본 우리나라의 전통태교: 태교신기를 중심으로)

  • Chung, Soon Hwa
    • Human Ecology Research
    • /
    • v.52 no.1
    • /
    • pp.1-10
    • /
    • 2014
  • The purpose of this study was to analyse the principles and methods of Taegyo-Singi with regard to emotion and to review basic informations on Taegyo programs for promoting prenatal development. Taegyo-Singi was analyzed as follows. First, the contents of Taegyo-Singi were classified into principles and methods of Taegyo. Second, the domains of emotion were categorized into emotional perception, emotional expression, emotional understanding, and emotional regulation based on the classification of Mayer and Salovey, and Moon. Third, the contents of Taegyo-Singi were classified into the four domains of emotion. Finally, the reliability and validity of the classification were obtained through inter-rater agreement and analysis of content validity. The results indicated that first, the principles of Taegyo presuppose parental influence on temperament formation, and that the emotional states of the mother in the prenatal and prepregnancy period is the most influential variable in a child's temperament formation. Second, the methods of Taegyo presuppose that the human mind interacts with their behavior. Therefore, through emotional support of family members, 'jon-sim (the serene mind)' and 'chung-sim (the mind from rectitude)' are the key methods of Taegyo. This means that the Korean tradition of Taegyo focused on the emotional domain of development, especially emotional regulation. This coincides with the emotion-focused temperament theory that individual differences in temperament reflect individual differences in emotion.

The Pilot study of Clock Drawing Test as a screening test for dementia (치매선별검사로서의 시계 그리기 검사(CDT)에 관한 기초연구)

  • Kim Gwang-Ho;Lim Jae-Hwan;Kim Jong-Woo;Whang Wei-Wan;Cho Seung-Hun
    • Journal of Oriental Neuropsychiatry
    • /
    • v.12 no.2
    • /
    • pp.185-191
    • /
    • 2001
  • Objectives: This study aimed to evaluate the usefulness as a screening test of Clock Drawing Test(CDT) compared with the standard K-DRS in probably dementia. Methods: The subjects for this study consisted of 19 elderly persons who visited to the outpatient department of Oriental Neuropsychiatry of the Kyunghee Oriental hospital. They received the K-DRS and the Clock Drawing Test. Three observers evaluated them with circle, numbers, hands. Inter-rater reliability of scores from Clock Drawing Test was assessed and Pearson correlation coefficients were used to examined the relationships between scores from Clock Drawing Test and K-DRS. Results: Correlations between individual raters was highly significant (r= .957, .974, and .970, respectively: p<.001). There was stastically significant correlations between K-DRS and CDT scores (r= 0.849, p<.001). Conclusions: The CDT can be rated reliably by observers and correlations between CDT and K-DRS is significantly high. We confirmed the usefulness of CDT as simple, easily administered, low cost, and reliable general screening test for dementia.

  • PDF

Perturbation and Perceptual Analysis of Pathological Sustained Vowels according to Signal Typing

  • Lee, Ji-Yeoun;Choi, Seong-Hee;Jiang, Jack J.;Hahn, Min-Soo;Choi, Hong-Shik
    • Phonetics and Speech Sciences
    • /
    • v.2 no.2
    • /
    • pp.109-115
    • /
    • 2010
  • In this paper, we investigate a signal typing on the basis of visual impression of distinctive spectrogram. Pathological voices are classified into signal type 1, 2, 3, or 4 to estimate perturbation parameters and to mark perceptual rating based on Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V). The results suggest that perturbation analysis can be applied to only type 1 and 2 signals and the perceptual ratings of overall grade increase with each signal type, overall. A good inter-rater reliability is showed among three raters. We recommend that pathological voices should be marked the signal typing and CAPE-V, together, to definitely describe the characteristics of pathological voices.

  • PDF

Reliability and Validity of the Appropriateness Evaluation Protocol for Public Hospitals in Korea

  • Lee, Clara;Kim, Stella Jung-Hyun;Lee, Changwoo;Shin, Euichul
    • Journal of Preventive Medicine and Public Health
    • /
    • v.52 no.5
    • /
    • pp.316-322
    • /
    • 2019
  • Objectives: This study was conducted to assess the applicability of the Appropriateness Evaluation Protocol (AEP) for public hospitals in Korea. Methods: In May 2016, 1500 admission claims were collected from Korean public district hospitals using stratified random sampling. Of these claims, 560 admissions to 37 hospitals were retrieved for analysis. Medical records administrators determined the appropriateness of admission using the criteria detailed in the AEP, and a physician separately assessed the appropriateness of admission based on her clinical judgment. To examine the applicability of the AEP, the concordance of the decisions made between a pair of AEP reviewers and between an AEP reviewer and a physician reviewer was compared. Results: The results showed an almost perfect inter-rater agreement between the AEP reviewers and a moderate agreement between the AEP reviewers and the physician. The sensitivity and specificity of the AEP were calculated as 0.86 and 0.56, respectively. Conclusions: Our findings suggest that the AEP could potentially be applied to Korean public hospitals as a reliable and valid instrument for assessing the appropriateness of admissions.

Morphological variation of the velum in children and adults using magnetic resonance imaging

  • Kotlarek, Katelyn J.;Haenssler, Abigail E.;Hildebrand, Kori E.;Perry, Jamie L.
    • Imaging Science in Dentistry
    • /
    • v.49 no.2
    • /
    • pp.153-158
    • /
    • 2019
  • Purpose: The purpose of this study was to investigate variations in velar shape according to age, sex, and race using magnetic resonance imaging (MRI). Materials and Methods: The study sample consisted of 170 participants (85 children, 85 adults) between 4 and 34 years of age. Velar morphology was visually classified using midsagittal MRI scans for each participant by 2 independent raters. Inter- and intra-rater reliability was assessed. Statistical analyses were performed to identify correlations of velar shape with sex, age, and race. Results: The most frequent velar shape was "butt" for both adults(41%) and children (58%) in this study. The least common shapes for adults were "leaf" and "S." The children did not exhibit any "leaf" or "straight" velar shapes. A statistically significant difference was noted for age with respect to velar shape (P=0.014). Sex and race were found to have no significant impact on velar shape in this study. Conclusion: When using MRI to evaluate velar morphology, the "butt" shape was most common in both children and adults. Velar shape varied significantly with age, while race and sex did not have a significant impact.

Developing and testing the reliability of a measurement tool for an urban area food environment in Korea - Focusing on food stores - (우리나라 도시지역의 식환경 측정을 위한 조사도구 개발 및 신뢰도 검정 - 식품상점을 중심으로 -)

  • Jang, Mi Jin;Shin, Sangah;Kim, Seong-Ah;Chung, Sangwon;Paik, Hee Young;Choe, Jeong-Sook;Hong, Eun Joo;Joung, Hyojee
    • Journal of Nutrition and Health
    • /
    • v.47 no.5
    • /
    • pp.351-363
    • /
    • 2014
  • Purpose: The aim of this study was to develop a reliable measurement tool to assess the urban food environment, particularly focusing on food stores in Korea. Methods: The items for the measurement tool were selected through systematic literature reviews and adjusted to the Korean food environment. A total of 25 food stores in an urban area were recruited for the pilot test to evaluate the time required for completion of the survey, ease of response, willingness to participate, difficulties in conducting the survey, and appropriateness, and 34 food stores were recruited for assessment of the reliability of the tool using percent agreement and kappa value. Results: The measurement tool is composed of questions regarding food store characteristics, accessibility, and food availability. On average, 26 minutes was required to survey a single food store, and the subjects and interviewers answered that the process was not difficult for the survey. The percent agreement for the inter-rater and test-retest reliability ranged from 93.9~98.8% and 91.9~97.9, respectively. The kappa values ranged from 0.78 to 0.97, which was very high. Percent agreement and kappa value of food with healthy option were lower than those of the general food in the inter-rater reliability (p = 0.0027, p = 0.0095 respectively) as well as in the test-retest reliability (p = 0.0081, p = 0.0290, respectively), although they were still high enough (86.4~98.0% for percent agreement, 0.64~0.96 for kappa value). Conclusion: The newly developed measurement tool for assessment of food store environment appears to be feasible and reliable; therefore, it can be applied to research on the association between food environment and dietary behaviors as well as health outcomes.

Cross-cultural Adaptation and Psychometric Evaluation of the Korean Version of the A-ONE (한국판 일상생활활동중심 작업기반 신경행동평가(A-ONE)의 개발 및 평가)

  • Kang, Jaewon;Park, Hae Yean;Kim, Jung-Ran;Park, Ji-Hyuk
    • Therapeutic Science for Rehabilitation
    • /
    • v.10 no.2
    • /
    • pp.109-128
    • /
    • 2021
  • Objective : The purpose of this study was to develop a Korean version of the Activities of Daily Living (ADL)-focused Occupation-Based Neurobehavioral Evaluation (A-ONE) through cross-cultural adaptation and examine its validity and reliability. Methods : This study translated the A-ONE into Korean and performed cross-cultural adaptation for the Korean population. After the development of the Korean version of the A-ONE, cross-cultural and concurrent validities were analyzed. Internal consistency, test-retest reliability, and inter-rater reliability were also evaluated. Results : We adapted three items to the Korean culture. The Korean version of the A-ONE showed high cross-cultural validity with a content validity index (I-CVI) >0.9. It correlated with the Functional Independence Measure (FIM) (r=0.52-0.77, p<0.001), except for communication. Cronbach's α was 0.58-0.93 for the functional independence scale (FI) and 0.42-0.93 for the neurobehavioral specific impairment subscale (NBSIS). Intraclass correlation coefficients (ICCs) indicated high test-retest and inter-rater reliability for FI (ICC=0.79-1.00 and 0.75-1.00, respectively) and NBSIS (ICC=0.74-1.00 and 0.72-1.00, respectively). Conclusion : The Korean version of the A-ONE is well adapted to the Korean culture and has good validity and reliability. It is recommended to evaluate ADL performance skills and neurobehavioral impairments simultaneously in Korea.