• Title/Summary/Keyword: Inter-rater Reliability

Search Result 198, Processing Time 0.026 seconds

The Reliability and Validity of Patient-Generated Subjective Global Assessment (PG-SGA) in Stroke Patients (뇌졸중 환자에서 '환자 주도적 총체적 영양사정' 도구의 신뢰도 및 타당도 평가)

  • Yoo, Sung-Hee;Oh, Eui-Guem;Youn, Mi-Jung
    • Korean Journal of Adult Nursing
    • /
    • v.21 no.6
    • /
    • pp.559-569
    • /
    • 2009
  • Purpose: This study was to examine the reliability and validity of Patient-Generated Subjective Global Assessment (PG-SGA) as a nutritional measurement for stroke patients. Methods: This was a methodological study performed from May 6 to June 10, 2009 at a tertiary university hospital in Seoul. For reliability of PG-SGA, inter-rater reliability was used for statistics. For concurrent validity, BMI and biomarkers were compared between PG-SGA 0 ~ 8 and ${\geq}$ 9. In addition, sensitivity, specificity, and predictive value of PG-SGA compared with SGA were calculated using a contingency table. For predictive validity, hospital day, complications, and readmission within 1-month after discharge were compared between PG-SGA 0 ~ 8 and ${\geq}$ 9. Results: Correlation of PG-SGA score between two observers was 0.83, and kappa value for the agreement of severe malnutrition was 0.78(all $p_s$ < .001). The scored PG-SGA showed high sensitivity and specificity (100% and 96.7%, respectively). Severe undernourished patients (PG-SGA ${\geq}$ 9) had significantly low TLC, protein, albumin, and prealbumin (all $p_s$ < .01) compared with non-undernourished patients (PG-SGA 0 ~ 8). Also, in severe undernourished patients, complications and readmission (all $p_s$ = 0.01) were more often represented, and hospital days (p = .013) were significantly delayed. Conclusion: PG-SGA is a reliable and valid measurement to assess nutritional status for stroke patients.

  • PDF

Development of the Korean Version of the Social Functioning Scale in the Schizophrenics : A Study on the Reliability and Validity (정신분열병 환자의 한국어판 사회기능척도 개발 : 신뢰도 및 타당도 연구)

  • Kim, Chul-Kwon;Lee, Ji-Ah
    • Korean Journal of Biological Psychiatry
    • /
    • v.16 no.2
    • /
    • pp.76-111
    • /
    • 2009
  • Objectives : The purpose of this study was to develop the Korean version of the Social Functioning Scale (KSFS) in the patients with schizophrenia. Methods : KSFS was administered to 90 schizophrenic patients and 80 their parents and 90 normal controls for examining the reliability and validity. Results : Data analysis showed statistically significant reliabilities and validities of KSFS. The test-retest reliability, rater vs. self-report reliability, and internal consistency for total scores of KSFS were 0.93, 0.44 and 0.94 respectively. Evidence for discriminant validity of KSFS comes from the results that the mean scores of schizophrenic patients were significantly higher than those of normal controls. Construct validity was assessed by calculating the 7 inter-areas correlations of the KSFS, and all areas were statistically significant. Significant correlations between the total scores of KSFS and those of SOFAS lend support for the concurrent validity of this instrument. Factor analyses were performed and two factors were extracted accounting for 63.7% of the variance. Sensitivity was assessed indirectly via the distribution and range of scores on the SFS. The normal control group showed a distribution around a higher mean with a moderate positive skew. Conclusion : KSFS was found to be a valid, reliable, and sensitive instrument which can be used to evaluate the degree of social functioning in the patients with schizophrenia.

  • PDF

Korean Cultural Adaptation of WHODAS 2.0 (36-Item Version): Reliability and Linking to ICF

  • Song, Ju Min;Lee, Hae Jung
    • The Journal of Korean Physical Therapy
    • /
    • v.30 no.6
    • /
    • pp.246-255
    • /
    • 2018
  • Purpose: This study was to conduct a Korean cultural adaptation of the WHO disability assessment schedule (WHODAS) 2.0: 36-item version. Methods: An internationally standardized process of translation and cultural adaptation of an instrument was used to develop a Korean version of WHODAS 2.0: 36-item version. Linking each item into the International Classification of Functioning, Disability and Health (ICF) was also conducted in order to ensure the concepts in the translated instrument were compatible with ICF. All translated versions of the instrument, linking results and feedback from participants were used for the final adaptation of the Korean version of the instrument. The Korean version of the instrument was assessed twice on different occasions to examine Inter- and intra-rater reliability, and the intra-class correlation coefficient (ICC) was calculated. Results: Twelve participants were involved in the translation and linking process. Ninety-five volunteers were invited to participate to examine the reliability of the instrument. Fifty participants completed the self-rated version of the instrument and 45 finished the interviewer version. The Korean WHODAS 2.0: 36-item version was found to have excellent reliability: self-rated version and interviewer version reliability coefficients were ICC=0.92 and ICC=0.94, respectively. Thirty-four items of the translated instrument were to be linked to ICF categories. Some adaptation was made; details and a familiar example were added to help respondents answer the questions. Conclusion: The study results show that the adaptation of the 36-item version of WHODAS 2.0 to Korean was successful and the instrument is ready for use in testing its psychometric properties.

A Method to Evaluate Rate of 'Soft-Hard' In a Drawing (그림의 '부드러운-딱딱한' 정도의 평가 방법)

  • Yoon, Seok-Hoon
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.10 no.12
    • /
    • pp.3963-3970
    • /
    • 2009
  • This study proposes a method to evaluate the level of 'soft-hard' of color quantitatively by evaluating the shape with edge sharpness automatically and by evaluating color in the color image scale in a drawing in art therapy using a computer. The dependent variable is the rank for the color experts to rate the level of 'soft-hard'. The mean and standard deviation of Value(V), and Chroma(C), colors, main color, clusters, length of edge, and sharp line rate of edge are considered as the independent variable. The appropriate independent variables to explain the dependent variable are selected through the step wise regression analysis. The inter-rater reliability of two raters is checked and the validity of developed system is verified by the rank correlations coefficient between the ranks of rater's and system's. This system can be used to evaluate of the shape or color in a drawing objectively and quantitatively for art therapy assessment, and to give the useful information to the fashion, textile, interior industry as well as color psychology and art therapy.

A Review of Published Instruments for Children and their Families in the Korean Journal of Child Studies (아동학회지에 게재된 측정도구 개발 및 타당화 연구 고찰: 1984-2016년)

  • Kim, Kyoung-Eun;Park, Ju Hee;Lim, Ji Young
    • Korean Journal of Child Studies
    • /
    • v.38 no.3
    • /
    • pp.91-111
    • /
    • 2017
  • Objective: This study aimed to review scales and tests developed for or validated with children and their families that were published in the Korean Journal of Child Studies from 1984 to 2016. Specifically, the purpose of the present study was to analyze the contents and format of the selected instruments, as well as to evaluate their psychometric properties. Methods: Using several databases and journal archives from the Korean Journal of Child Studies, searches were implemented using the key terms: instrument, scale, development, and validation. Instruments from 76 selected studies were reviewed based on several characteristics, such as assessment areas, contents, respondents, responding types, and psychometric properties. Results and Conclusion: First, a majority of the reviewed instruments were developed for infants and children, whereas only one was developed for adolescents. With regard to their specific measurement domains, many instruments focused on social emotional development among children. Second, with a few exceptions, the selected studies provided appropriate evidence for the reliability of the instrument, including its internal consistency, inter-rater reliability, and spilt-half reliability. Many studies also reported on the criterion-related or construct validity of the instrument to establish its validity. Future studies need to develop instruments across diverse developmental areas that collect information from multiple sources and raters. In addition, more evidence on the reliability and validity of the reviewed instruments should be provided to demonstrate their psychometric qualities.

The Clinical Application of modified Emory Functional Ambulation Profile for Chronic Stroke Patients (만성 편마비 환자의 modified Emory Functional Ambulation Profile의 임상 적용)

  • Kim, Seong-Yeol;Lee, Je-Hoon;An, Seung-Heon
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.5 no.4
    • /
    • pp.655-666
    • /
    • 2010
  • Purpose : The examine the reliability and validity of the modified Emory Functional Ambulation Profile(mEFAP) for assessing gait function in chronic stroke patients. Methods : A total of 45 stroke patients, who had a stroke more than 6 months, participated in the study. Reliability was determined by Intra-class Correlation Coefficient($ICC_{3,1}$), including Bland and Altman method (Standard Error of Measurement: SEM, Small Real Differences: SRD). Validity was examined by correlating results to the gait ability(mEFAP, Modified Motor Assessment Scale-Gait(MMAS-G), Scandinavian Stroke Scale-Gait(SSS-G), Functional Ambulation Category(FAC), 10m Waking Test(10m WT)), and Fugl Meyer-Lower/Extremity(FM-L/E), Berg Balance Scale(BBS). Results : Inter-rater reliability for the total mEFAP was High($ICC_{2,1}$=.998), and absolute reliability were excellent (SEM: 1.75, SRD: 4.85). Subjects without assistance factor performed better on all tests than did subjects who had stroke. There were significant correlations between the mEFAP and MMAS-G, SSS-G, FAC(r=-.66~-.79), 10 m WT(r=-.86), and FM-L/E, BBS(r=-.72~-.78), indicating good validity. Increased times on the mEFAP correlated with poor performance on the gait ability, motor function of lower extremity, BBS and slow gait speeds on the 10 m WT in stroke patients. Conclusion : The mEFAP can be administered easily and comprehensively. It is a reliable gait assessment tool for patients with stroke and correlated with known of function, the mEFAP may be a clinically useful measure of ambulation.

Validity and Reliability of Cognitive Performance Scale in Long Term Care Hospital in Korea (인지수행척도(Cognitive Performance Scale)의 타당도와 신뢰도)

  • Lee, Ji Yun;Kim, Sun Min;Kim, A Reum
    • 한국노년학
    • /
    • v.30 no.1
    • /
    • pp.81-91
    • /
    • 2010
  • The purpose of this study was to test a validity and reliability of Cognitive Performance Scale(CPS), a cognitive measure generated from 5 items(comatose status, decision making, short-term memory, making self understood, and eating). Method: 393 patients in 2 hospitals for the elderly with dementia were measured with CPS by two nurses independently. The inter-rater agreement was tested by comparing two scores. The CPS score was compared with GDS, which was measured by doctors and nurses, and MMSE score which was drawn from the claim data of Health Insurance Review & Assessment Service. Result: The correlation coefficient between CPS and GDS was 0.742(p<0.0001), CPS and MMSE was -0.794(p<0.0001). The Cronbach's coefficient alpha of CPS was 0.742, Kappa value was 0.772~1.000. The CPS showed high validity and reliability in long term care hospitals of Korea.

A Research to Evaluate the Reliability and Validity of Pattern Identifications Tool for Cognitive Disorder: A Clinical Study Protocol (인지장애 변증평가도구의 신뢰도와 타당도 평가: 임상연구 프로토콜)

  • Lee, Ji-yoon;Kim, Hwan;Seo, Young Kyung;Kang, Hyung Won;Kang, Wee-Chang;Jung, In Chul
    • Journal of Oriental Neuropsychiatry
    • /
    • v.29 no.4
    • /
    • pp.255-266
    • /
    • 2018
  • Objectives: The objective of this study was to evaluate the reliability and validity of Pattern Identifications Tool for Cognitive Disorders (PIT-C) and verify the correlation with other related scales. Methods: The study in this protocol is a single group, prospective, observational one. The subjects of the study were men and women between the ages of 45 and 85, diagnosed with neurocognitive disorders by Diagnostic and Statistical Manual of Mental Disorder (fifth Edition) criteria (n=60, Clinical Dementia Rating (CDR)=0.5, Korean Version of Montreal Cognitive Assessment $(MoCA-K){\leq}22$). The reliability of PIT-C was evaluated as test-retest and inter-rater reliability. And correlation between PIT-C and other related scales was also assessed. Results: This study was approved by the Institutional Review Board (IRB) of Dunsan Korean Medicine Hospital of Daejeon University and registered in the Clinical Research Information Service (CRIS), and was made public in advance to ensure transparency of the research process and conduct ethical clinical trials. Conclusions: The results of this study can be used to classify neurocognitive disorders as Korean medicine and PIT-C will be helpful tool for primary health care.

Reliability and Validity Inquiry for Tele-assessment Based on Video Conferencing

  • Suha Lee;Changho Song
    • Physical Therapy Rehabilitation Science
    • /
    • v.12 no.2
    • /
    • pp.105-114
    • /
    • 2023
  • Objective: The study examined the validity and reliability of tele-assessment of cervical range of motion (ROM) through video conferencing. Design: A cross-sectional study Methods: The study included 22 healthy adults as subjects and 10 physical therapists as evaluators. The subjects underwent both face-to-face and tele-assessment of cervical ROM. The CROM (Cervical Range of Motion) device was used for reference measurements in the face-to-face assessment. The evaluators assessed the subjects' ROM through visual inspection (VI) and using a Universal Goniometer (UG) in the tele-assessment. Results: The results showed a significant correlation between the face-to-face and tele-assessment measurements for all ROM contents. The correlation coefficients ranged from r=0.54 to 0.71 (p<0.05), indicating concurrent validity. In terms of inter-rater reliability, the ICC values for both VI and UG assessments in the tele-assessment were high, with ICCs of 0.93 and 0.92, respectively. Additionally, the study investigated the usability of the tele-assessment method and environment. The satisfaction of the participants and evaluators was assessed using the Telehealth Usability Questionnaire (TUQ), which evaluates perceptions, usability, and satisfaction with telehealth services. Conclusions: In conclusion, tele-assessment of cervical range of motion using video conferencing was valid and reliable. Also, investigated participant and evaluator satisfaction and opinions, providing insights into the clinical value of tele-assessment. It is important to note that the study was conducted only healthy adults, and further research may be needed to validate the tele-assessment method in populations with cervical dysfunction or neck pain. These findings support the potential effectiveness of telerehabilitation services in assessing and managing musculoskeletal disorders.

The Development of an Observation Scale to facilitate a Valid and Reliable Analysis of the Responses of Child and Therapist in Child-Centered Play Therapy (아동중심놀이치료에서의 아동과 치료자 반응 관찰척도 개발)

  • Lee, Haeng Suk;Han, You Jin
    • Korean Journal of Child Studies
    • /
    • v.34 no.1
    • /
    • pp.141-159
    • /
    • 2013
  • This study was conducted in order to develop an observation scale for analyzing the responses of child and therapist in child-centered play therapy in terms of item discrimination, validity, and reliability. The observation scale was developed on the basis of child-centered play therapy literature, the author's experience of child-centered play therapy, the observation of video tapes of play therapy session, and discussions with child-centered play therapy experts. The participants in this study were 54 children aged from 4 to 9 years old who have emotional and behavioral problems, and 7 therapists who consult with the children. The reliability of factors, as measured by inter-rater reliability and Cronbach's', ranged from .72 to .77. The results of factor analysis identified 2 factors and 21 items associated with the reponses of the children, and 2 factors and 19 items associated with the responses of the therapists. The significant factors identified were as follows; (1) the child's response style; (2) the child's response content (adaptability, initiation, structuring, flexibility); (3) the therapist's response style, and (4) the therapist's response content (facilitative response, structuring, nonfacilitative response). In conclusion, these results demonstrated that the observation scale provides a valid and reliable means of analyzing the responses of child and therapist in child-centered play therapy.