• Title/Summary/Keyword: rater reliability

Search Result 228, Processing Time 0.022 seconds

Analysis of Clinical Indicators related to Pattern-Identification in Acute Cerebral Infarction Patient (급성기 뇌경색 환자에 있어 변증형별 유의한 임상지표의 분석)

  • Lee, Eun-chan;Hyun, Sang-ho;Kwak, Seung-hyuk;Woo, Su-kyung;Park, Ju-young;Jung, Woo-sang;Moon, Sang-kwan;Cho, Ki-ho;Park, Sung-wook;Ko, Chang-nam
    • The Journal of the Society of Stroke on Korean Medicine
    • /
    • v.13 no.1
    • /
    • pp.33-42
    • /
    • 2012
  • Object : The aim of this study was to assess the clinical indicators related to Pattern-Identification(PI) in acute cerebral infarction patients. Methods : We studied hospitalized patients within 30days after ictus, who admitted at Korean Medicine Center of Kyung-Hee University from January 2010 to October 2012.(n=290) Two Traditional Korean Medicine(TKM) physicians evaluated the patients independently and diagnosed PI. Inter-rater reliability was measured using simple percentage agreement and the Cohen's kappa(κ) coefficient. To assess the clinical indicators closely related to each PI, we analysed average score of each indicator in each group. Results : Simple percentage agreement of PI between raters was 64.83% and Cohen's kappa(κ) coefficient was 0.526(95% CI: 0.451-0.600). Inter-rater reliability level was fair to good. We analysed the clinical indicators in each group. Significant indicators for Fire-Heat Pattern(FHP) were reddened complexion and strong pulse power, and meaningful indicators for FHP were halitosis and thick tongue fur. Significant indicator for Dampness-Phlegm Pattern(DPP) was overweight and there was no meaningful indicator. Significant indicator for Yin-Deficiency Pattern(YDP) was dry tongue fur and meaningful indicator for YDP was thirst. There was no significant indicator for Qi-Deficiency Pattern(QDP) and pale complexion and faint low voice were meaningful indicators for QDP. Conclusions : This study reveals the significant and meaningful clinical indicators related to each Pattern-Identification in acute cerebral infarction patients. It will contribute to standardization of Korean Medical Diagnosis and Treatment in acute cerebral infarction patients.

  • PDF

The Development of an Observation Scale to facilitate a Valid and Reliable Analysis of the Responses of Child and Therapist in Child-Centered Play Therapy (아동중심놀이치료에서의 아동과 치료자 반응 관찰척도 개발)

  • Lee, Haeng Suk;Han, You Jin
    • Korean Journal of Child Studies
    • /
    • v.34 no.1
    • /
    • pp.141-159
    • /
    • 2013
  • This study was conducted in order to develop an observation scale for analyzing the responses of child and therapist in child-centered play therapy in terms of item discrimination, validity, and reliability. The observation scale was developed on the basis of child-centered play therapy literature, the author's experience of child-centered play therapy, the observation of video tapes of play therapy session, and discussions with child-centered play therapy experts. The participants in this study were 54 children aged from 4 to 9 years old who have emotional and behavioral problems, and 7 therapists who consult with the children. The reliability of factors, as measured by inter-rater reliability and Cronbach's', ranged from .72 to .77. The results of factor analysis identified 2 factors and 21 items associated with the reponses of the children, and 2 factors and 19 items associated with the responses of the therapists. The significant factors identified were as follows; (1) the child's response style; (2) the child's response content (adaptability, initiation, structuring, flexibility); (3) the therapist's response style, and (4) the therapist's response content (facilitative response, structuring, nonfacilitative response). In conclusion, these results demonstrated that the observation scale provides a valid and reliable means of analyzing the responses of child and therapist in child-centered play therapy.

The Development of Infant Montessori Performance Assessment Scales - Centered on 6 to 24 Month Infants - (영아용 몬테소리 수행평가 도구 개발 - 6~24개월 영아를 중심으로 -)

  • Kim, Myung-Hee;Shin, Hwa-Sik;Kim, Ji-Young;Kim, Min-Sun
    • Korean Journal of Child Studies
    • /
    • v.26 no.2
    • /
    • pp.27-41
    • /
    • 2005
  • The purpose of this study was to test the reliability and validity of the Infant Montessori Performance Assessment Scales developed by the authors. Subjects of the study consisted of 132 Montessori teachers and 50 infants who were attending Montessori home school throughout the whole country, using census method. Infant's age ranged from 6 to 24 months. Data were analysed by using SAS 8.2 PC program. Statistical methods employed were frequency, Cronbach's alpha, Kappa coefficient, test-retest correlation, construct validity, and concurrent validity. The Cronbach's alpha of 6 sub-scales included physical, creativity, practical life, sense, language, and cognitive education, which ranged from .70 to .86. And the! correlation of the test/re-test was .72. The correlation between the 6 sub-scales of Infant-Montessori Performance Assessment Scales and the total scores of 6 items ranged from .06 to .84. Therefore, the construct validity of Infant Montessori Performance Assessment Scales was verified. The Kappa coefficient of inter-rater reliability was .76. The correlation between the Infant Montessori Performance Assessment Scales and the Standardized Korean Creativity Traits Checklist(K-CTC) and the Korean Child Social Maturity Scales showed non-significant levels of .16 and .12 respectively. Conclusively, Infant Montessori Performance Assessment Scales developed by the authors were verified through the above reliability and validity tests. Specifically the Infant Montessori Performance Assessment Scales showed the relationship of the convergent and divergent validity with the Korean Child Social Maturity Scales and the Standardized Korean Creativity Traits Checklist, respectively.

  • PDF

Validity and Reliability of Korean Version of Behavior Problems Inventory in Autism Spectrum Disorder and/or Intellectual Developmental Disorder

  • Hwang, Samuel Suk-Hyun;Park, Jangho;Kim, Sohee;Lee, Gayoung;Kim, Yeni;Bhang, Soo-Young
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • v.29 no.1
    • /
    • pp.7-13
    • /
    • 2018
  • Objectives: Problem behaviors pose a great obstacle to daily functioning in children with neurodevelopmental deficits and are an important target for treatment. In this study, we translated the Behavior Problems Inventory (BPI)-01 into Korean language and tested its psychometric properties. Methods: We attained the approval of the BPI author and performed standard translation-back translation. Then, professional caregivers examined appropriateness according to cultural and situational contexts in order to make necessary modifications of the Korean version of the BPI. Results: The BPI-01, Korea-Scales of Independent Behavior-Revised (K-SIB-R), and Child Behavior Checklist were completed for 98 autistic spectrum disorder or intellectual development disorder participants (mean age=28.3, standard deviation=7.3, range=10.1-51.7). The inter-rater reliability of the BPI-01 was found to be high (r=0.992-1.000). As for the results for concurrent validity for subscale items of BPI-01 and scales of SIB, correlations between SIB and BPI-01 subscales were statistically significant (r=0.357-0.672). Discussion: The Korean version of the BPI-01 showed good psychometric properties with high reliability and sufficient convergent validity. Further examination of the validity of BPI-01 should be carried out with inclusion of younger aged children and a closer look at less frequently occurring symptoms.

The Reliability and Relationships Between Thoracic Kyphosis, Postural Stiffness and Thoracic Rotation in Young Subjects (젊은 성인의 흉추후만지수 및 자세 경직도와 흉추회전각 간의 상관성과 신뢰도)

  • Jang, Hyun-Jeong;Kim, Suhn-Yeop;Kim, Myung-Jun
    • The Journal of Korean Academy of Orthopedic Manual Physical Therapy
    • /
    • v.18 no.2
    • /
    • pp.49-55
    • /
    • 2012
  • Background: The purposes of this study were to: 1) investigate the relation between thoracic kyphosis, postural stiffness and thoracic rotation and 2) the intra-rater reliability of the measurement methods for thoracic kyphosis and rotation angle. Methods: Thirty-nine young adults (13 males, 26 females) participated in the study. Thoracic kyphosis was measured using a Flexicurve while standing in their usual relaxed posture and then in their maximally erector posture. Index of kyphosis (IK) measures taken in the relaxed and maximally erect positions were used to estimate postural stiffness. Thoracic rotation range of motion (ROM) was measured using universal goniometer and inclinometer in two positions. The association between the magnitude of the IK and thoracic stiffness and thoracic rotation ROM was also examined. Reliability was determined using intra-class correlation coefficients (ICC). Results: When measured from the mean relaxed IK (${\pm}SD$) was 7.42 (${\pm}1.47$) and mean erect IK was 4.92 (${\pm}1.63$) and mean IK ratio was 1.66 (${\pm}.65$). The relaxed IK was significantly correlated with the range of motion thoracic rotation in two positions (r=.503~580, p<.01). Conclusion: Thoracic kyphosis in relaxed position was associated with the range of motion thoracic rotation. Thoracic kyphosis measurement with the Flexicurve and range of motion 2 techniques of thoracic rotation showed good reliablity and may be a useful measurement tool in clinical practice.

  • PDF

Reliability and validity of pelvic mobility measurement using a cushion sensor in healthy adults

  • Jung, Seung-Hwa;Kim, Su-Kyeong;Lee, Ji-Hyun;Choi, Soo-Ih;Park, Dae-Sung
    • Physical Therapy Rehabilitation Science
    • /
    • v.9 no.2
    • /
    • pp.74-81
    • /
    • 2020
  • Objective: To prevent low back pain, an objective evaluation tool to evaluate pelvic mobility and exercise to improve the flexibility of the lumbar region is needed. The purpose of this study was to compare the results of pelvic mobility measurements using the Wii Balance Board (WBB) and Sensbalance Therapy Cushion (STC), evaluate the usefulness of the STC as a tool for measuring pelvic mobility. Design: Cross-sectional study. Methods: Fifty healthy subjects participated in this study. The subjects performed pelvic mobility range, proprioception, reaction time and reach of the arm using the STC. The pelvic movement parameter was measured two times to determine the intra-rater reliability. To measure the correlation between lumbar muscle tension and pelvic mobility, Myovision was used to measure tension of L4, L5 level erector spinae muscle. Correlations between measured variables were checked to determine the validity of the pelvic mobility assessment tool. Results: STC showed high test-retest reliability in pelvic tilt measurement and reaching task [intraclass correlation coefficients (3,1)=0.804-0.915]. The relationship between WBB and STC showed a significant positive correlation with the pelvic tilt and reaching task (p<0.05). Posterior tilt and erector spinae activation (Lt. L5) showed a significant negative correlation (p<0.05). Left, right tilt and erector spinae activation (L5) showed a significant negative correlation (p<0.05). Conclusions: This study confirmed the advantages of the STC and found efficiency as an objective measuring device of pelvic mobility.

Effect of lower facial height and anteroposterior lip position on esthetic preference for Korean silhouette profiles

  • Seo, Kyung-Hyun;So, Deuk-Hun;Song, Kyeong-Tae;Choi, Sung-Kwon;Kang, Kyung-Hwa
    • The korean journal of orthodontics
    • /
    • v.51 no.6
    • /
    • pp.419-427
    • /
    • 2021
  • Objective: The purpose of this study was to evaluate the esthetic preference for various Korean silhouette profiles. Methods: The Korean average male and female profiles were modified by changing the lower facial height and anteroposterior lip position to produce nine types of profiles. In order to test intrarater reliability, the average profile was copied once more to be included for evaluation. A questionnaire containing 10 profiles for each sex, each of which had to be rated for preference on a numerical rating scale from 0 to 10, was administered to 30 adult orthodontic patients, 30 dental students, 30 orthodontists, and 30 dentists excluding orthodontists. The data were statistically analyzed using the intraclass correlation coefficient (ICC), independent t-test, and one-way ANOVA. Results: The ICC of overall intrarater reliability was 0.629. For several profiles, significantly higher scores were given to male profiles than to female profiles (p < 0.05). However, no significant differences were found in the scores for all profiles among the four rater groups. Among the short profiles, a significantly higher score was given to the retruded profile, and among the vertically average and long profiles, a significantly higher score was given to the horizontally average profile (p < 0.001). Among all the profiles, significantly lower scores were given to the protruded profile (p < 0.001). Conclusions: This study revealed good overall intrarater reliability, with several types of male profiles being esthetically preferred over female profiles. Moreover, while retruded and horizontally average profiles were generally preferred, protruded profiles were not.

Developing and testing the reliability of a measurement tool for an urban area food environment in Korea - Focusing on food stores - (우리나라 도시지역의 식환경 측정을 위한 조사도구 개발 및 신뢰도 검정 - 식품상점을 중심으로 -)

  • Jang, Mi Jin;Shin, Sangah;Kim, Seong-Ah;Chung, Sangwon;Paik, Hee Young;Choe, Jeong-Sook;Hong, Eun Joo;Joung, Hyojee
    • Journal of Nutrition and Health
    • /
    • v.47 no.5
    • /
    • pp.351-363
    • /
    • 2014
  • Purpose: The aim of this study was to develop a reliable measurement tool to assess the urban food environment, particularly focusing on food stores in Korea. Methods: The items for the measurement tool were selected through systematic literature reviews and adjusted to the Korean food environment. A total of 25 food stores in an urban area were recruited for the pilot test to evaluate the time required for completion of the survey, ease of response, willingness to participate, difficulties in conducting the survey, and appropriateness, and 34 food stores were recruited for assessment of the reliability of the tool using percent agreement and kappa value. Results: The measurement tool is composed of questions regarding food store characteristics, accessibility, and food availability. On average, 26 minutes was required to survey a single food store, and the subjects and interviewers answered that the process was not difficult for the survey. The percent agreement for the inter-rater and test-retest reliability ranged from 93.9~98.8% and 91.9~97.9, respectively. The kappa values ranged from 0.78 to 0.97, which was very high. Percent agreement and kappa value of food with healthy option were lower than those of the general food in the inter-rater reliability (p = 0.0027, p = 0.0095 respectively) as well as in the test-retest reliability (p = 0.0081, p = 0.0290, respectively), although they were still high enough (86.4~98.0% for percent agreement, 0.64~0.96 for kappa value). Conclusion: The newly developed measurement tool for assessment of food store environment appears to be feasible and reliable; therefore, it can be applied to research on the association between food environment and dietary behaviors as well as health outcomes.

Cross-cultural Adaptation and Psychometric Evaluation of the Korean Version of the A-ONE (한국판 일상생활활동중심 작업기반 신경행동평가(A-ONE)의 개발 및 평가)

  • Kang, Jaewon;Park, Hae Yean;Kim, Jung-Ran;Park, Ji-Hyuk
    • Therapeutic Science for Rehabilitation
    • /
    • v.10 no.2
    • /
    • pp.109-128
    • /
    • 2021
  • Objective : The purpose of this study was to develop a Korean version of the Activities of Daily Living (ADL)-focused Occupation-Based Neurobehavioral Evaluation (A-ONE) through cross-cultural adaptation and examine its validity and reliability. Methods : This study translated the A-ONE into Korean and performed cross-cultural adaptation for the Korean population. After the development of the Korean version of the A-ONE, cross-cultural and concurrent validities were analyzed. Internal consistency, test-retest reliability, and inter-rater reliability were also evaluated. Results : We adapted three items to the Korean culture. The Korean version of the A-ONE showed high cross-cultural validity with a content validity index (I-CVI) >0.9. It correlated with the Functional Independence Measure (FIM) (r=0.52-0.77, p<0.001), except for communication. Cronbach's α was 0.58-0.93 for the functional independence scale (FI) and 0.42-0.93 for the neurobehavioral specific impairment subscale (NBSIS). Intraclass correlation coefficients (ICCs) indicated high test-retest and inter-rater reliability for FI (ICC=0.79-1.00 and 0.75-1.00, respectively) and NBSIS (ICC=0.74-1.00 and 0.72-1.00, respectively). Conclusion : The Korean version of the A-ONE is well adapted to the Korean culture and has good validity and reliability. It is recommended to evaluate ADL performance skills and neurobehavioral impairments simultaneously in Korea.

Reliability Analysis of Finger Joint Range of Motion Measurements in Wearable Soft Sensor Gloves (웨어러블 소프트 센서 장갑의 손가락 관절 관절가동범위 측정에 대한 신뢰도 분석)

  • Eun-Kyung Kim;Jin-Hong Kim;Yu-Ri Kim;Ye-Ji Hong;Gang-Pyo Lee;Eun-Hye Jeon;Joon-bum Bae;Su-in Kim;Sang-Yi Lee
    • PNF and Movement
    • /
    • v.21 no.2
    • /
    • pp.171-183
    • /
    • 2023
  • Purpose: The purpose of this study was to compare universal goniometry (UG), which is commonly used in clinical practice to measure the range of motion (ROM) of finger joints with a wearable soft sensor glove, and to analyze the reliability to determine its usefulness. Methods: Ten healthy adults (6 males, 4 females) participated in this study. The metacarpophalangeal joint (MCP), interphalangeal joint (IP), and proximal interphalangeal joint (PIP) of both hands were measured using UG and Mollisen HAND soft sensor gloves during active flexion, according to the American Society for Hand Therapists' measurement criteria. Measurements were taken in triplicate and averaged. The mean and standard deviation of the two methods were calculated, and the 95% limits of agreement (LOA) of the measurements were calculated using the intraclass correlation coefficient (ICC) and Bland-Altman plot to examine the reliability and discrepancies between the measurements. Results: The results of the mean values of the flexion angles for the active range of motion (AROM) of the finger joints showed large angular differences in the finger joints, except for the MCP of the thumb. In the inter-rater reliability analysis according to the measurement method, the ICC (2, 1) value showed a low level close to 0, and the mean difference by the Bland-Altman plot showed a value greater than 0, showing a pattern of discrepancy. The 95% LOA had a wide range of differences. Conclusion: This study is a preliminary study investigating the usefulness of the soft sensor glove, and the reliability analysis showed a low level of reliability and inconsistency. However, if future studies can overcome the limitations of this study and the technical problems of the soft sensor glove in the development stage, it is suggested that the measurement instrument can show more accurate measurement and higher reliability when measuring ROM with UG.