• 제목/요약/키워드: Interrater reliability

검색결과 76건 처리시간 0.022초

Reliability and Concurrent Validity of Korean Version of the Trunk Control Measurement Scale (K-TCMS) for Children with Cerebral Palsy

  • Ko, Jooyeon;Jung, Jeewoon
    • The Journal of Korean Physical Therapy
    • /
    • 제29권1호
    • /
    • pp.16-26
    • /
    • 2017
  • Purpose: This study was conducted to develop a Korean version of the trunk control measurement scale (TCMS) and examine the reliability and concurrent validity of the K-TCMS in children with cerebral palsy. Methods: Subjects for the study were 23 children with cerebral palsy (CP)(mean age: 84.70 months) recruited from one CP clinic. For the interrater and test-retest reliabilities, four raters (A, B, C, D) measured the K-TCMS two times using video clips with an interval of two weeks. For the concurrent validity, the Korean version of the gross motor function measure (K-GMFM) was chosen. Inter-rater reliability and test-retest reliability of the three K-TCMS subscale (static sitting balance, dynamic sitting balance and dynamic reaching) scores and the total scores were investigated using the intra-correlation coefficient ($ICC_{3,1}$). Spearman's correlation coefficient (r) was calculated to investigate the concurrent validity. Results: The inter-rater reliability of the K-TCMS subscales and total scores were all high ($ICC_{3,1}=0.968-0.992$). For the test-retest reliability, $ICC_{3,1}=0.827-0.962$. The concurrent validity between the K-TCMS's total and three subscale scores and K-GMFM's total score were r=0.600-0.667. Conclusion: The results suggest that the K-TCMS can be used in clinical and research settings as a standardized tool for CP children. The K-TCMS might be also useful for selecting treatment goals and planning interventions for children with cerebral palsy.

자동화 프로그램을 이용한 아동의 전체두개강내용적 평가 (Total Intracranial Volume Measurement for Children by Using an Automatized Program)

  • 이정환;김지은;임성진;주가원;김시경;손정우;신철진;이상익;김혜리
    • 생물정신의학
    • /
    • 제21권3호
    • /
    • pp.81-86
    • /
    • 2014
  • Objectives Total intracranial volume (TIV) is a major nuisance of neuroimaging research for interindividual differences of brain structure and function. Authors intended to prove the reliability of the atlas scaling factor (ASF) method for TIV estimation in FreeSurfer by comparing it with the results of manual tracing as reference method. Methods The TIVs of 26 normal children and 26 children with attention-deficit hyperactivity disorder (ADHD) were obtained by using FreeSurfer reconstruction and manual tracing with T1-weighted images. Manual tracing performed in every 10th slice of MRI dataset from midline of sagittal plane by one researcher who was blinded from clinical data. Another reseacher performed manual tracing independently for randomly selected 20 dataset to verify interrater reliability. Results The interrater reliability was excellent (intraclass coefficient = 0.91, p < 7.1e-07). There were no significant differences of age and gender distribution between normal and ADHD groups. No significant differences were found between TIVs from ASF method and manual tracing. Strong correlation between TIVs from 2 different methods were shown (r = 0.90, p < 2.2e-16). Conclusions The ASF method for TIV estimation by using FreeSurfer showed good agreement with the reference method. We can use the TIV from ASF method for correction in analysis of structural and functional neuroimaging studies with not only elderly subjects but also children, even with ADHD.

목말밑관절 가동범위 측정방법에 관한 연구 (A Study of Measurement Methods for Subtalar Joint Motion)

  • 김기원;홍완성
    • The Journal of Korean Physical Therapy
    • /
    • 제22권4호
    • /
    • pp.57-64
    • /
    • 2010
  • Purpose: This study aimed to determine whether there are differences in subtalar joint range of motion (ROM) when using different measurement methods, and to determine inter- and intra-rater reliability of goniometry as used in clinical setting. Methods: Subjects were thirty-one healthy males and females (sixty-two ankles) living in Korea. Three raters with different clinical experiences measured inversion and eversion range of motion of the subtalar joint two times. Measurements were done with subjects prone (open kinetic chain) and standing (closed kinetic chain). Rater and measurement methods were based on analyzing differences in range of motion. Intra-class correlation coefficients (ICCs) were calculated to determine intra-rater and inter-rater reliability. Results: Mean subtalar jont range of motion for inversion ranged from $9.31^{\circ}$ to $11.94^{\circ}$ for eversion, it ranged from $6.73^{\circ}$ to $9.20^{\circ}$. The differences in ROM between raters and between measurement methods were significant (p<0.01). The ICCs for interrater reliability ranged from $0.02^{\circ}$ to $0.20^{\circ}$ for inversion and from $0.23^{\circ}$ to $0.39^{\circ}$ for eversion. Intrarater reliability ranged from $0.32^{\circ}$ to $0.78^{\circ}$ for inversion and from $0.45^{\circ}$ to $0.73^{\circ}$ for eversion. Conclusion: Subtalar joint inversion and eversion ROM show differences for measurement methods low reliability between different raters, and low to high intra-rater reliability within sessions.

사상의학 병증진단에 있어서 사상의학 전문가의 한열 특성 및 건강상태 평가에 관한 일치도 연구 (The Agreement in Cold-Heat and Health Status among Sasang Constitutional Experts in Diagnosis of Sasang Pathological Symptoms)

  • 진희정;김상혁;동상옥;장은수;이시우
    • 사상체질의학회지
    • /
    • 제26권2호
    • /
    • pp.146-155
    • /
    • 2014
  • Objectives In Sasang Constitutional medicine(SCM), it is an important factor to assess the degree of cold/heat and healthy status. We purposed to check the agreement among the experts on the assessment of cold/heat and healthy status. Methods Six SCM experts and 10 healthy volunteers were recruited for this study. The SCM experts had an interviewed with each volunteer in the similar condition like that of the actual clinic. And then the expert evaluated each volunteer's cold/heat and healthy status. Intraclass correlation coefficient(ICC) was used to measure the interrater reliability and interrater agreement among the experts. Results Two volunteers are excluded due to the missing data, therefore eight persons' data (3 males and 5 females) were included in our analysis. The mean of age and BMI are 21.73(${\pm}2.32$) and 29.63(${\pm}4.66$), respectively. In health status, cold status and heat status, the ICC was 0.789, 0.904, 0.925, respectively. Conclusions We found that the assessment of cold/heat and healthy status was continued reliable among SCM experts. The assessment of cold/heat status was more consistent than the assessment of healthy status.

간호요구 정도에 의한 신생아중환자 분류도구의 타당도 및 신뢰도 검증 (Validity and Reliability Tests of Neonatal Patient Classification System Based on Nursing Needs)

  • 고범자;유미;강진선;김동연;복정희
    • 임상간호연구
    • /
    • 제18권3호
    • /
    • pp.354-367
    • /
    • 2012
  • Purpose: This study was done to verify validity and reliability of a neonatal patient classification system (NeoPCS-1). Methods: An expert group of 8 nurse managers and 40 nurses from 8 Neonatal Intensive Care Units in Korea, verified content validity of the measurement using item level content validity index (I-CVI). The participants were nurses caring for 469 neonates. Data were collected from November 11 to December 14, 2011 and analyzed using descriptive statistics, ANOVA, intraclass correlation coefficient, and K-cluster analysis with PASW 18.0 program. Results: Nursing domains and activities included 8 items with 91 activities. I-CVI was above .80 in all areas. Interrater reliability was significant between two raters (r=.95, p<.001). Classification scores for participants according to patient types and nurses' intuition were significantly higher for the following patients; gestational age (${\leq}29$ weeks), body weight (<1,000 gm), and transfer from hospital. Six groups were classified using cluster analysis method based on nursing needs. Patient classification scores were significantly different for the groups. Conclusion: These results show adequate validity and reliability for the NeoPCS-1 based on nursing needs. Study is needed to refine the measurement and develop index scores to estimate number of nurses needed for adequate neonatal care.

치매노인의 통증사정을 위한 한국어판 PACSLAC의 신뢰도, 타당도 및 유용성 평가 (Validity and Reliability of the Korean Version of the Pain Assessment Checklist for Seniors with Limited Ability to Communicate)

  • 김은경;김세영;엄미란;김현숙;이은표
    • 대한간호학회지
    • /
    • 제44권4호
    • /
    • pp.398-406
    • /
    • 2014
  • Purpose: This study was done to develop and test the validity and reliability of the Korean version of the Pain Assessment Checklist for Seniors with Limited Ability to Communicate (PACSLAC-K) in assessing pain of elders with dementia living in long-term care facilities. Methods: The PACSLAC-K was developed through forward-backward translation techniques. Survey data were collected from 307 elders with dementia living in 5 long-term care facilities in Korea. Data were analyzed using descriptive statistics, Pearson correlation, Spearman's rho, paired t-test, ROC (receiver operation characteristic) curve with the SPSS/WIN (20.0) program. Results: The PACSLAC-K showed high internal consistency (.90), interrater reliability (.86), intrarater reliability (.93), and high concurrent validity (.74) in paired t-test with PAINAD. Discriminant validity also showed a significant difference compared with no pain. The PACSLAC-K showed a sensitivity of .93, specificity of .88, and Area Under the Curve of .95 in the ROC curve. Conclusion: The findings of this study demonstrate that PACSLAC-K is useful in assessing pain for elders with dementia living in long-term care facilities.

Construction of the Mobility to Participation Assessment Scale for Stroke (MPASS) and Testing Its Validity and Reliability in Persons With Stroke in Thailand

  • Nawarat, Jiraphat;Chaipinyo, Kanda
    • Journal of Preventive Medicine and Public Health
    • /
    • 제55권4호
    • /
    • pp.334-341
    • /
    • 2022
  • Objectives: This study was conducted to develop the Mobility to Participation Assessment Scale for Stroke (MPASS) and assess its content validity, internal consistency, inter-rater and intra-rater reliability, and convergent validity in people with stroke living in the community. Methods: The MPASS was developed using published data on mobility-related activity and participation timing in elderly individuals, and then reviewed by community physical therapists. Content validity was established by reaching a consensus of experienced physical therapists in a focus group. The MPASS was scored for 32 participants with stroke (mean age 61.75±4.92 years) by 3 individual testers. Reliability was examined using the intraclass correlation coefficient (ICC), internal consistency using the Cronbach alpha coefficient (α), and convergent validity using the Pearson correlation coefficient (r) to compare the MPASS to the Modified Rivermead Mobility Index as a referent test of mobility. Results: The MPASS consists of 8 items, and its scoring system provides information on the ability of people with stroke to reach a movement level enabling them to live in society, including interactions with other people and safe living in the community. The interrater and intra-rater reliability were excellent (ICC, 0.948; 95% confidence interval [CI], 0.893 to 0.982 and ICC, 0.967; 95% CI, 0.933 to 0.989, respectively). Internal consistency was good (α=0.877). The convergent validity was moderate (r=0.646; p<0.001). Conclusions: The newly developed MPASS showed acceptable construct validity and high reliability. The MPASS is suitable for use in people with stroke, especially those who have been discharged and live in the community with the ability to initiate sitting.

중환자 통증사정을 위한 한국어판 Critical care Pain Observation Tool (CPOT)의 신뢰도 및 타당도 검증 (Validation of a Korean translated version of the Critical Care Pain Observation Tool (CPOT) for ICU patients)

  • 곽은미;오희영
    • 대한간호학회지
    • /
    • 제42권1호
    • /
    • pp.76-84
    • /
    • 2012
  • Purpose: The purpose of this methodological study was to examine the reliability and validity of a translated Korean version of the Critical Care Pain Observation Tool (CPOT) developed for assessment of pain in critically ill nonverbal patients. Methods: A cross-sectional study design was used. Data were collected from a convenience sample of 202 critically ill patients admitted to a university hospital. Upon establishment of content and translation equivalence between the English and Korean version of CPOT, psychometric properties were evaluated. Results: The interrater reliability was found to be acceptable with the weighted kappa coefficients of .81-.88. Significant high correlations between the CPOT and the Checklist of Nonverbal Pain Indicators were found indicating good concurrent validity (r=.72-.83, p<.001). Data showed the area under the ROC curve of 0.86 with a cut-off point of 1, which resulted in 76.9% sensitivity and 88.6% specificity. The mean score of CPOT during suctioning was significantly different from that of before (t= -14.16, p<.001) or 20 minutes after suctioning (t=16.31, p<.001). Conclusion: Results of this study suggest that the CPOT can be used as a reliable and valid measure to assess pain in critically ill nonverbal patients.

간호요구도에 따른 중환자간호 분류도구 개발 (Development of Classification System for Critical Care Nursing Based on Nursing Needs)

  • 유정숙;김금순
    • 임상간호연구
    • /
    • 제19권1호
    • /
    • pp.33-44
    • /
    • 2013
  • Purpose: This study was done to develop a valid and reliable Classification System for Critical Care Nursing (CSCCN) to be used in Intensive Care Units (ICUs). Methods: Head nurses and staff nurses of 17 ICUs in 6 hospitals classified 307 patients to verify interrater reliability. To verify construct validity, the staff nurses classified 404 patients according to CSCCN comparing difference in medical department and type of stay in ICU. For conversion index, 78 patients from 4 ICUs of 'S' hospital were classified and nursing time was measured by 107 nurses and 18 nurse aids using stopwatches. Results: The developed CSCCN has 11 categories, 76 nursing activities and 101 criteria. The reliability was verified as having high agreement (r=.946). The construct validity was verified comparing differences in medical department and type of stay in ICU. According to scores, four groups in the CSCCN classification were identified. According to the conversion index, one score on the CSCCN means 7.2 minutes of nursing time. Conclusion: CSCCN can be used to measure diverse and complex nursing demands including psycho-social aspects of ICU patients and convert nursing demands to numbers.

한국형 중환자간호 분류도구 개발 (Development of Korean Patient Classification System for Critical Care Nurses)

  • 유정숙;심미영;최은하
    • 임상간호연구
    • /
    • 제21권3호
    • /
    • pp.401-411
    • /
    • 2015
  • Purpose: This study was performed to develop a valid and reliable Korean Patient Classification System for Critical Care Nurses (KPCSC). Methods: Tertiary and general hospitals with various levels of ICU nurse staffing were included. To verify interrater reliability, data collectors and staff nurses of 15 ICUs in 11 hospitals classified 262 patients. To verify construct validity, the staff nurses classified 457 patients according to KPCSC comparing difference by medical department and type of stay in ICU. For conversion index, 195 patients from 10 ICUs in 7 hospitals were classified and nursing time was measured by 174 nurses, 7 head nurses, 18 charge nurses, 37 nurse aids and 1 secretary. Results: The developed KPCSC has 11 categories, 82 nursing activities and 115 criterias. Reliability was found to have high agreement (r=.96). Construct validity was verified by comparing differences in medical department and type of stay in ICU. According to scores, four groups in the KPCSC were identified. One score on the KPCSC indicates 6.12 minutes of nursing time. Conclusion: The findings show that the KPCSC can be used to measure new and complex nursing demands including rehabilitation and the safety of ICU patients.