• 제목/요약/키워드: Inter-Rater reliability

검색결과 198건 처리시간 0.026초

뇌졸중 환자에서 '환자 주도적 총체적 영양사정' 도구의 신뢰도 및 타당도 평가 (The Reliability and Validity of Patient-Generated Subjective Global Assessment (PG-SGA) in Stroke Patients)

  • 유성희;오의금;윤미정
    • 성인간호학회지
    • /
    • 제21권6호
    • /
    • pp.559-569
    • /
    • 2009
  • Purpose: This study was to examine the reliability and validity of Patient-Generated Subjective Global Assessment (PG-SGA) as a nutritional measurement for stroke patients. Methods: This was a methodological study performed from May 6 to June 10, 2009 at a tertiary university hospital in Seoul. For reliability of PG-SGA, inter-rater reliability was used for statistics. For concurrent validity, BMI and biomarkers were compared between PG-SGA 0 ~ 8 and ${\geq}$ 9. In addition, sensitivity, specificity, and predictive value of PG-SGA compared with SGA were calculated using a contingency table. For predictive validity, hospital day, complications, and readmission within 1-month after discharge were compared between PG-SGA 0 ~ 8 and ${\geq}$ 9. Results: Correlation of PG-SGA score between two observers was 0.83, and kappa value for the agreement of severe malnutrition was 0.78(all $p_s$ < .001). The scored PG-SGA showed high sensitivity and specificity (100% and 96.7%, respectively). Severe undernourished patients (PG-SGA ${\geq}$ 9) had significantly low TLC, protein, albumin, and prealbumin (all $p_s$ < .01) compared with non-undernourished patients (PG-SGA 0 ~ 8). Also, in severe undernourished patients, complications and readmission (all $p_s$ = 0.01) were more often represented, and hospital days (p = .013) were significantly delayed. Conclusion: PG-SGA is a reliable and valid measurement to assess nutritional status for stroke patients.

  • PDF

정신분열병 환자의 한국어판 사회기능척도 개발 : 신뢰도 및 타당도 연구 (Development of the Korean Version of the Social Functioning Scale in the Schizophrenics : A Study on the Reliability and Validity)

  • 김철권;이지아
    • 생물정신의학
    • /
    • 제16권2호
    • /
    • pp.76-111
    • /
    • 2009
  • Objectives : The purpose of this study was to develop the Korean version of the Social Functioning Scale (KSFS) in the patients with schizophrenia. Methods : KSFS was administered to 90 schizophrenic patients and 80 their parents and 90 normal controls for examining the reliability and validity. Results : Data analysis showed statistically significant reliabilities and validities of KSFS. The test-retest reliability, rater vs. self-report reliability, and internal consistency for total scores of KSFS were 0.93, 0.44 and 0.94 respectively. Evidence for discriminant validity of KSFS comes from the results that the mean scores of schizophrenic patients were significantly higher than those of normal controls. Construct validity was assessed by calculating the 7 inter-areas correlations of the KSFS, and all areas were statistically significant. Significant correlations between the total scores of KSFS and those of SOFAS lend support for the concurrent validity of this instrument. Factor analyses were performed and two factors were extracted accounting for 63.7% of the variance. Sensitivity was assessed indirectly via the distribution and range of scores on the SFS. The normal control group showed a distribution around a higher mean with a moderate positive skew. Conclusion : KSFS was found to be a valid, reliable, and sensitive instrument which can be used to evaluate the degree of social functioning in the patients with schizophrenia.

  • PDF

Korean Cultural Adaptation of WHODAS 2.0 (36-Item Version): Reliability and Linking to ICF

  • Song, Ju Min;Lee, Hae Jung
    • The Journal of Korean Physical Therapy
    • /
    • 제30권6호
    • /
    • pp.246-255
    • /
    • 2018
  • Purpose: This study was to conduct a Korean cultural adaptation of the WHO disability assessment schedule (WHODAS) 2.0: 36-item version. Methods: An internationally standardized process of translation and cultural adaptation of an instrument was used to develop a Korean version of WHODAS 2.0: 36-item version. Linking each item into the International Classification of Functioning, Disability and Health (ICF) was also conducted in order to ensure the concepts in the translated instrument were compatible with ICF. All translated versions of the instrument, linking results and feedback from participants were used for the final adaptation of the Korean version of the instrument. The Korean version of the instrument was assessed twice on different occasions to examine Inter- and intra-rater reliability, and the intra-class correlation coefficient (ICC) was calculated. Results: Twelve participants were involved in the translation and linking process. Ninety-five volunteers were invited to participate to examine the reliability of the instrument. Fifty participants completed the self-rated version of the instrument and 45 finished the interviewer version. The Korean WHODAS 2.0: 36-item version was found to have excellent reliability: self-rated version and interviewer version reliability coefficients were ICC=0.92 and ICC=0.94, respectively. Thirty-four items of the translated instrument were to be linked to ICF categories. Some adaptation was made; details and a familiar example were added to help respondents answer the questions. Conclusion: The study results show that the adaptation of the 36-item version of WHODAS 2.0 to Korean was successful and the instrument is ready for use in testing its psychometric properties.

그림의 '부드러운-딱딱한' 정도의 평가 방법 (A Method to Evaluate Rate of 'Soft-Hard' In a Drawing)

  • 윤석훈
    • 한국산학기술학회논문지
    • /
    • 제10권12호
    • /
    • pp.3963-3970
    • /
    • 2009
  • 본 연구에서는 컴퓨터를 이용하여 미술치료에서 윤곽선의 예리성으로 형태를 평가하고 컬러이미지스케일을 통해 색채를 평가하여 '부드러운-딱딱한'의 정도를 정량적으로 평가하는 방법을 제안한다. 회귀모형을 사용하며 종속 변수는 색채 전문가가 그림을 '부드러운-딱딱한'으로 평가한 순위가 된다. 독립변수는 그림의 명도 및 채도의 평균과 표준편차, 그림의 색채 수, 픽셀의 양, 클러스터의 수, 윤곽선의 길이 및 예리성 등을 고려한다. 단계별 회귀분석에 의하여 종속변수를 설명하는 적절한 독립변수들을 선정한다. 평가자 간의 신뢰성을 살피고 평가자 순위와 시스템 순위 간의 순위상관계수를 통해 시스템의 타당성을 입증한다. 객관적이고 정량적 평가를 가능케 함으로써 색채심리 연구, 미술치료뿐만 아니라 패션, 섬유, 인테리어 산업 등에 유용한 정보를 제공한다.

아동학회지에 게재된 측정도구 개발 및 타당화 연구 고찰: 1984-2016년 (A Review of Published Instruments for Children and their Families in the Korean Journal of Child Studies)

  • 김경은;박주희;임지영
    • 아동학회지
    • /
    • 제38권3호
    • /
    • pp.91-111
    • /
    • 2017
  • Objective: This study aimed to review scales and tests developed for or validated with children and their families that were published in the Korean Journal of Child Studies from 1984 to 2016. Specifically, the purpose of the present study was to analyze the contents and format of the selected instruments, as well as to evaluate their psychometric properties. Methods: Using several databases and journal archives from the Korean Journal of Child Studies, searches were implemented using the key terms: instrument, scale, development, and validation. Instruments from 76 selected studies were reviewed based on several characteristics, such as assessment areas, contents, respondents, responding types, and psychometric properties. Results and Conclusion: First, a majority of the reviewed instruments were developed for infants and children, whereas only one was developed for adolescents. With regard to their specific measurement domains, many instruments focused on social emotional development among children. Second, with a few exceptions, the selected studies provided appropriate evidence for the reliability of the instrument, including its internal consistency, inter-rater reliability, and spilt-half reliability. Many studies also reported on the criterion-related or construct validity of the instrument to establish its validity. Future studies need to develop instruments across diverse developmental areas that collect information from multiple sources and raters. In addition, more evidence on the reliability and validity of the reviewed instruments should be provided to demonstrate their psychometric qualities.

만성 편마비 환자의 modified Emory Functional Ambulation Profile의 임상 적용 (The Clinical Application of modified Emory Functional Ambulation Profile for Chronic Stroke Patients)

  • 김성렬;이제훈;안승헌
    • 대한물리의학회지
    • /
    • 제5권4호
    • /
    • pp.655-666
    • /
    • 2010
  • Purpose : The examine the reliability and validity of the modified Emory Functional Ambulation Profile(mEFAP) for assessing gait function in chronic stroke patients. Methods : A total of 45 stroke patients, who had a stroke more than 6 months, participated in the study. Reliability was determined by Intra-class Correlation Coefficient($ICC_{3,1}$), including Bland and Altman method (Standard Error of Measurement: SEM, Small Real Differences: SRD). Validity was examined by correlating results to the gait ability(mEFAP, Modified Motor Assessment Scale-Gait(MMAS-G), Scandinavian Stroke Scale-Gait(SSS-G), Functional Ambulation Category(FAC), 10m Waking Test(10m WT)), and Fugl Meyer-Lower/Extremity(FM-L/E), Berg Balance Scale(BBS). Results : Inter-rater reliability for the total mEFAP was High($ICC_{2,1}$=.998), and absolute reliability were excellent (SEM: 1.75, SRD: 4.85). Subjects without assistance factor performed better on all tests than did subjects who had stroke. There were significant correlations between the mEFAP and MMAS-G, SSS-G, FAC(r=-.66~-.79), 10 m WT(r=-.86), and FM-L/E, BBS(r=-.72~-.78), indicating good validity. Increased times on the mEFAP correlated with poor performance on the gait ability, motor function of lower extremity, BBS and slow gait speeds on the 10 m WT in stroke patients. Conclusion : The mEFAP can be administered easily and comprehensively. It is a reliable gait assessment tool for patients with stroke and correlated with known of function, the mEFAP may be a clinically useful measure of ambulation.

인지수행척도(Cognitive Performance Scale)의 타당도와 신뢰도 (Validity and Reliability of Cognitive Performance Scale in Long Term Care Hospital in Korea)

  • 이지윤;김선민;김아름
    • 한국노년학
    • /
    • 제30권1호
    • /
    • pp.81-91
    • /
    • 2010
  • 본 연구는 노인의 인지능력을 기능적 관점에서 평가하기 위해 개발된 인지수행척도(Cognitive Performance Scale, CPS)가 우리나라 요양병원의 임상환경에 적합한지를 검증하기 위해 수행되었다. 이를 위해 CPS와 MMSE(Mini-Mental State Examination), GDS(Global Deterioration Scale)간의 수렴타당도, 조사자간 일치도, 내적 일관성을 측정하였다. 2개의 치매전문 요양병원 입원환자 393명을 대상으로 해당병원의 간호사가 표준화된 작성지침을 이용하여 CPS를 직접 측정하였고, 이 점수가 해당병원의 의사, 간호사가 측정한 GDS점수, 건강보험 청구 자료의 MMSE점수와 상관성이 있는지 분석하였다. 또한 동일 환자에 대해 또 한명의 간호사가 CPS를 한 번 더 측정하여 기존의 CPS점수와 비교하였다. 그 결과 CPS는 GDS와 중등도 이상의 상관관계(r=0.742, p<0.0001)를 보였고, MMSE와는 높은 상관관계(r=-0.794, p<0.0001)를 보였다. CPS의 Cronbach ${\alpha}$ 계수는 0.742로 높은 내적 일관성을 나타냈고 조사자간 일치도를 보기 위해 산출한 문항별 Kappa 계수는 0.772~1.000이었다. 우리나라 요양병원 환경에서도 노인의 인지능력을 기능적 관점에서 평가하기 위해 CPS를 사용하는 것이 타당하다고 판단된다.

인지장애 변증평가도구의 신뢰도와 타당도 평가: 임상연구 프로토콜 (A Research to Evaluate the Reliability and Validity of Pattern Identifications Tool for Cognitive Disorder: A Clinical Study Protocol)

  • 이지윤;김환;서영경;강형원;강위창;정인철
    • 동의신경정신과학회지
    • /
    • 제29권4호
    • /
    • pp.255-266
    • /
    • 2018
  • Objectives: The objective of this study was to evaluate the reliability and validity of Pattern Identifications Tool for Cognitive Disorders (PIT-C) and verify the correlation with other related scales. Methods: The study in this protocol is a single group, prospective, observational one. The subjects of the study were men and women between the ages of 45 and 85, diagnosed with neurocognitive disorders by Diagnostic and Statistical Manual of Mental Disorder (fifth Edition) criteria (n=60, Clinical Dementia Rating (CDR)=0.5, Korean Version of Montreal Cognitive Assessment $(MoCA-K){\leq}22$). The reliability of PIT-C was evaluated as test-retest and inter-rater reliability. And correlation between PIT-C and other related scales was also assessed. Results: This study was approved by the Institutional Review Board (IRB) of Dunsan Korean Medicine Hospital of Daejeon University and registered in the Clinical Research Information Service (CRIS), and was made public in advance to ensure transparency of the research process and conduct ethical clinical trials. Conclusions: The results of this study can be used to classify neurocognitive disorders as Korean medicine and PIT-C will be helpful tool for primary health care.

Reliability and Validity Inquiry for Tele-assessment Based on Video Conferencing

  • Suha Lee;Changho Song
    • Physical Therapy Rehabilitation Science
    • /
    • 제12권2호
    • /
    • pp.105-114
    • /
    • 2023
  • Objective: The study examined the validity and reliability of tele-assessment of cervical range of motion (ROM) through video conferencing. Design: A cross-sectional study Methods: The study included 22 healthy adults as subjects and 10 physical therapists as evaluators. The subjects underwent both face-to-face and tele-assessment of cervical ROM. The CROM (Cervical Range of Motion) device was used for reference measurements in the face-to-face assessment. The evaluators assessed the subjects' ROM through visual inspection (VI) and using a Universal Goniometer (UG) in the tele-assessment. Results: The results showed a significant correlation between the face-to-face and tele-assessment measurements for all ROM contents. The correlation coefficients ranged from r=0.54 to 0.71 (p<0.05), indicating concurrent validity. In terms of inter-rater reliability, the ICC values for both VI and UG assessments in the tele-assessment were high, with ICCs of 0.93 and 0.92, respectively. Additionally, the study investigated the usability of the tele-assessment method and environment. The satisfaction of the participants and evaluators was assessed using the Telehealth Usability Questionnaire (TUQ), which evaluates perceptions, usability, and satisfaction with telehealth services. Conclusions: In conclusion, tele-assessment of cervical range of motion using video conferencing was valid and reliable. Also, investigated participant and evaluator satisfaction and opinions, providing insights into the clinical value of tele-assessment. It is important to note that the study was conducted only healthy adults, and further research may be needed to validate the tele-assessment method in populations with cervical dysfunction or neck pain. These findings support the potential effectiveness of telerehabilitation services in assessing and managing musculoskeletal disorders.

아동중심놀이치료에서의 아동과 치료자 반응 관찰척도 개발 (The Development of an Observation Scale to facilitate a Valid and Reliable Analysis of the Responses of Child and Therapist in Child-Centered Play Therapy)

  • 이행숙;한유진
    • 아동학회지
    • /
    • 제34권1호
    • /
    • pp.141-159
    • /
    • 2013
  • This study was conducted in order to develop an observation scale for analyzing the responses of child and therapist in child-centered play therapy in terms of item discrimination, validity, and reliability. The observation scale was developed on the basis of child-centered play therapy literature, the author's experience of child-centered play therapy, the observation of video tapes of play therapy session, and discussions with child-centered play therapy experts. The participants in this study were 54 children aged from 4 to 9 years old who have emotional and behavioral problems, and 7 therapists who consult with the children. The reliability of factors, as measured by inter-rater reliability and Cronbach's', ranged from .72 to .77. The results of factor analysis identified 2 factors and 21 items associated with the reponses of the children, and 2 factors and 19 items associated with the responses of the therapists. The significant factors identified were as follows; (1) the child's response style; (2) the child's response content (adaptability, initiation, structuring, flexibility); (3) the therapist's response style, and (4) the therapist's response content (facilitative response, structuring, nonfacilitative response). In conclusion, these results demonstrated that the observation scale provides a valid and reliable means of analyzing the responses of child and therapist in child-centered play therapy.