• Title/Summary/Keyword: Interrater reliability

Search Result 76, Processing Time 0.021 seconds

The Reliability and Validity of Clock Drawing Test as a Screening Tool for Cognitive Impairment in Clients after Cerebrovascular Accident (뇌졸중 클라이언트의 인지 손상 선별 도구로서 CDT의 신뢰도 및 타당도)

  • Lee, Sang-Heon
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.13 no.10
    • /
    • pp.4612-4618
    • /
    • 2012
  • The purpose of this study was to analyze the reliability and validity of CDT as a screening tool for cognitive impairment for stroke clients living in local community. Two evaluator assessed 51 clients' cognitive function using CDT and K-MMSE from October 2010 to August 2011 year. The researcher analyzed test-retest reliability, interrater reliability, construct validity, construct validity. The test-retest and interrater reliability was higher than .54(p<.01). The construct validity and concurrent validity was statistically significant(p<.01). So, The CDT using productive method and scoring system of Freedman et al., may be applied to screen cognitive impairment of clients with stroke.

Reliability, Validity, and Conversion Index of the Workload Management System for Critical Care Nurses(WMSCN) (중환자 분류도구(WMSCN)의 신뢰도, 타당도 및 환산지수 검증)

  • Yoo, Cheong-Suk;Kwon, Eun-Ok;Kim, Soon-Hee;Cho, Yong-Ae
    • Journal of Korean Critical Care Nursing
    • /
    • v.2 no.1
    • /
    • pp.48-57
    • /
    • 2009
  • Purpose: The purpose of this study is to establish reliability and validity and to identify the conversion index. Method: The WMSCN for ICU was revised from Workload Management System for Nurses(WMSN) of Walter Reed Army Hospital. Reliability of the WMSCN was evaluated interrater reliability between head nurses and staff nurses at 124 patients in April 2008. Validity through the correlation between direct nursing care hours and WMSCN score was conducted at 20 ICUs of 10 hospitals. Finally the conversion index was identified by total nursing hours and it divided by WMSCN score. Results: The scores by nurses were highly correlated with head nurses’(p=.967), and also scores of the WMSCN were highly correlated with the direct nursing care hours(p<.001). The distribution of patient classification ranks into class V(61.3%), class IV(24.2%) and class VI(11.3%). The scores of the WMSCN were no differences between MICU and SICU. Finally, the conversion index was 8.2 minutes. Conclusion: WMSCN is available to classify the nursing workload for critical care patients. The repeated evaluation of validity and reliability are requisite to use WMSCN effectively. And the conversion index should be adjusted to estimate the appropriate staffing in Korea.

  • PDF

Interrater and Intrarater Reliability for Three Clinical Measures of Balance and Gait in Individuals With Hemiparetic Stroke (뇌졸중 환자률 대상으로 한 균형 및 보행에 관한 3가지 임상평가도구의 측정자간 및 측정자내 신뢰도)

  • Woo, Young-Keun;Park, So-Yeon;Hwang, Su-Jin;Kim, Hyouk-Il;Yoo, Kyoung-Hoon
    • PNF and Movement
    • /
    • v.9 no.2
    • /
    • pp.45-53
    • /
    • 2011
  • Purpose : Many researchers have attempted to identity the reliability used in clinical examination of balance and gait performance for individuals of hemiparetic stroke. The study aims to evaluate whether the reliabilities of three popular clinical measures of balance and gait performance was consistency regardless of applicate experience of those clinical measures compared with previous studies for persons with hemiparetic stroke. Methods : A total of three hemiparetic stroke populations and twenty-six physical therapists were recruited from Glory hospital, Inchen, Korea in this study. The three clinical measures, involving Berg balance test (BBT), dynamic gait index (DGI), and Tinetti performance-oriented mobility assessment (POMA), were assessed in two sessions that were seven days apart. Results : The POMA was showed a good intrarater and interrater reliabilities in people with hemiparetic stroke regardless of measure's experience in clinical field. However BBT and DGI were showed below moderate intrarater and interrater reliabilities. Conclusion : The POMA could be a reliable measure to evaluate functional postural stability and gait performance in hemiparetic stroke patients compared with other two clinical measures regardless of measure's experience of physical therapists.

Verification of Reliability and Validity of KPCS-1 and Estimation of Nursing Time Conversion Index (한국형 환자분류도구-1(KPCS-1)의 신뢰도와 타당도 검증 및 간호시간 환산지수 산출)

  • Song, Kyung Ja;Kim, Eun Hye;Yoo, Cheong Suk;Park, Hyeoun Ae;Song, Mal Soon;Park, Kwang Ok
    • Journal of Korean Clinical Nursing Research
    • /
    • v.16 no.2
    • /
    • pp.127-140
    • /
    • 2010
  • Purpose: This study was performed to verify reliability and validity of Korean Patient Classification System for nurses(KPCS-1), to estimate nursing time conversion index, and to classify patients into groups according to KPCS-1 scores. Methods: KPCS-1 was revised from KPCS by a professional review team. Interrater reliability and construct validity of KPCS-1 were verified by data from 433 patients. Direct and indirect nursing time of 204 patients were measured by stopwatch observation and self reports for 24 hours. Nursing time conversion index was calculated. Results: KPCS-1 consisted of 12 area, 50 nursing activities, and 73 items. The interrater reliability was tested between two nurse group (r=.88, p<.001) and construct validity was verified according to medical department (F=10.97, p<.001) and patient pattern (F=5.54, p=.001). The correlation of nursing time and classification score was also statistically significant (r=.56, p<.001). The nursing time conversion index was 9.03 minutes per 1 classification score. The patients were classified into 4 groups by the classification scores. Conclusion: KPCS-1 can be a useful factor type patient classification system for general ward. Further study is needed to evaluate validity and reliability for refining KPCS-1 and to develop ways connecting the scores with nursing outcomes.

INTERRATER RELIABILITY OF CARIES DIAGNOSIS BY DIAGNODENT (Diagnodent를 사용한 우식진단법의 검사자내 신뢰도에 관한 연구)

  • Lee, Kwang-Hee
    • Journal of the korean academy of Pediatric Dentistry
    • /
    • v.27 no.1
    • /
    • pp.40-44
    • /
    • 2000
  • The purpose of study was to measure the interrater reliability of the newly developed caries diagnostic instrument, Diagnodent(KaVo, Germany), using a new laser fluorescence techinique. One hundred and three extracted human premolars and molars were examined by Diagnodent, three times for fissures and five times for smooth surfaces. There was no significant difference among the three fissure means, but two combinations showed significant differences among the five smooth surface means. Correlation coefficients of Pearson and Spearman were all above 0.9(P<0.01). The $\alpha$ values from reliability analysis were 0.9980 or 0.9981 for fissures and 0.9992 for smooth surfaces.

  • PDF

Evaluation of Lasater Clinical Judgment Rubric to Measure Nursing Student' Performance of Emergency Management Simulation of Hypoglycemia (간호대학생의 저혈당 응급관리 시뮬레이션 실습 수행 평가를 위한 임상판단 루브릭 적용)

  • Hur, Hea Kung;Park, So Mi;Kim, Ki Kyong;Jung, Ji Soo;Shin, Yoon Hee;Choi, Hyang Ok
    • Journal of Korean Critical Care Nursing
    • /
    • v.5 no.2
    • /
    • pp.15-27
    • /
    • 2012
  • Purpose: To evaluate the applicability of Lasater Clinical Judgment Rubric (LCJR) as an evaluation tool for hypoglycemia simulation practicum on Korean nursing students. Methods: The methodological study was done to evaluate the reliability and validity of the LCJR. Based on Benner's 4 levels of nursing grading rubric, ten items of the LCJR was evaluated for interrater reliability and internal consistency. The content validity was tested by eight experts and concurrent validity was done by Clark (2006)'s clinical simulation grading rubric. Fifty five video-taped cases of senior nursing students in Y University were used for the reliability and concurrent validity of the LCJR. Results: The interrater reliability was r=.90 (p<.001); Kendall tau b=.87 (p <.001), and Cronbach's alpha was .90. A value of item content validity index of the LCJR was .97 and correlation coefficient between the LCJR and Clark's instrument was .90 (p<.001). The mean (${\pm}SD$) of the nursing students' clinical judgment was 2.04 (${\pm}50$). Conclusion: The LCJR is a useful tool to examine the simulation performance evaluation for improving competency among nursing students. The results indicated that the LCJR may provide valuable information regarding clinical judgment of nursing students and thus, suggested to use to develop a simulation-based education program.

  • PDF

Pragmatic Combinations of Acupuncture Points for Lateral Epicondylalgia are Unreliable in the Physiotherapy Setting

  • Alvim, Danielle T.;Ferreira, Arthur S.
    • Journal of Acupuncture & Meridian Studies
    • /
    • v.11 no.6
    • /
    • pp.367-374
    • /
    • 2018
  • This study describes the reliability of pragmatic combinations of acupuncture points for lateral epicondylalgia (LE) as prescribed by physiotherapists who were experts in acupuncture. Raters (n = 14; 33-59 years) independently prescribed acupuncture points for 30 simulated human patients with LE who were surveyed via a printed questionnaire. The frequency and cooccurrence of acupuncture points prescribed for patients with lateral epicondylitis were assessed. Absolute agreement and Light's kappa (${\kappa}_{Light}$) with 95% confidence interval (CI) were used to quantify the interrater agreement. Raters prescribed 103 unique acupuncture points in different combinations with a median (min-max) of 5 (0-11) acupuncture points. The most prescribed acupuncture point was LI-11 (297 of 420; 71%), and the most common cooccurring acupuncture points were LI-11 and LI-4 (160 of 420; 38%). The absolute agreement for prescribing the acupuncture points ranged from 70% (point GB-20) to 0% (points LI-10, SP-6, LI-11, GB-34, LI-12, and LI-4). Point LR-3 showed the highest interrater reliability for prescribing the acupuncture points [${\kappa}_{Light}=0.112$, 95% CI = (0.055-0.194)], whereas point LI-4 showed the lowest reliability [${\kappa}_{Light}=-0.003$, 95% CI = (-0.024 to 0.024)]. These findings suggest that pragmatic prescriptions of acupuncture points for LE are unreliable among physiotherapists who are experts in acupuncture. Explicit, high-level evidence-based rules for prescribing and teaching combinations of acupuncture points for LE are warranted.

Inter-rater Reliability of Korean Triage and Acuity Scale (KTAS) among the Research Nurses and the Triage Nurses (한국형 응급환자 분류도구의 간호사 간 신뢰도 평가)

  • Yang, Jungeun;Lee, Eunja
    • Journal of East-West Nursing Research
    • /
    • v.26 no.1
    • /
    • pp.91-99
    • /
    • 2020
  • Purpose: The study aims to assess the inter-rater reliability of the Korean Triage and Acuity Scale between the research nurses and the triage nurses. Methods: Interrater reliability was measured on 400 adult (≧15) and 400 pediatric (<15) patients who visited the emergency medical center from January 4 to June 30, 2018. Results: The study result showed that the inter-rater reliability of the Korean Triage and Acuity Scale was substantial, with κ=.73 (95% Confidence interval= .68-.78) and 77.0 percent agreement. The inter-rater of Pediatric Korean Triage and Acuity Scale was also substantial, with κ=.76 (95% Confidence interval= .71-.82) and 83.8 percent agreement. Conclusion: Although the inter-rater reliability of the Korean Triage and Acuity Scale was acceptable, the percent agreement was lower than the desirable level (<80.0%). It was confirmed that Pediatric Korean Triage and Acuity Scale had an acceptable level of inter-rater reliability and percent agreement for clinical use. Efforts should be made to improve the reliability in the future.

Reliability and Validity of the Korean Version of Melbourne Low-Vision ADL Index (한국판 맬버른 저시력 일상생활지수(Melbourne Low-vision ADL Index: MLVAI)의 신뢰도 및 타당도)

  • Yoo, Yeon Hwan;Park, Ji-Hyuk;Jung, Min-Ye;Park, Hae Yean
    • Therapeutic Science for Rehabilitation
    • /
    • v.7 no.2
    • /
    • pp.51-61
    • /
    • 2018
  • Objective: The purpose of this study was performed to modify the performance-based assessment tool, Melbourne Low-Vision ADL Index (MLVAI) had been developed in Australia to suit the Korea culture to verify the reliability and validity. Methods: The subjects were only over the age of 20 living in communities, 26 with low-vision and 42 normal persons. The Korean MLVAI was completed through the expert translation verification and validation of the configuration tool. The validity of the Korean MLVAI was established through the content, discriminant, and convergent validity. Also, the reliability was analyzed through internal consistency reliability for the items, test-retest, and interrater reliability. Results: The Content Validity Index(CVI) was more than .78. There was a statically significant low in low-vision. Also, there was a statically significant low in low-vision. The convergent validity was determined the correlation coefficient of .751 analyzing LVQOL and Korean MLVAI total score, had a significant correlation(p<.05). Cronbach's ${\alpha}$ coefficient indicated an internal consistency of .983(p<.05). Test-retest reliability had a high, significant correlation of .976 and interrater reliability had a high, an intraclass correlation coefficient of .91(p<.05). Conclusion: The results of this study mean that the Korean MLVAI which was modified to fit the Korean is the ADL assessment tool with both validity and reliability. Based on this study, the Korean MLVAI can be used as a useful ADL assessment for OT interventions in low vision.

The Development of patient classification system for hemodialysis (혈액투석환자 중증도 분류체계 개발)

  • Kim, Moon-Sil;Yoon, Ji-Sook
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.8 no.4
    • /
    • pp.633-643
    • /
    • 2002
  • Purpose : This study was conducted to develop a patient classification system for hemodialysis and to test its validity and reliability. Method : The process of the system development was as below. The lists of hemodialysis nursing activities were collected from literature and hemodialysis practice guideline and they were classified into 10 factors and 16 elements. And then, 4 classification levels were identified for each element. The content validity and interrater reliability of developed patient classification system were tested. Result & Conclusion : 10 factors of patient classification system for hemodialysis were consisted of psychosocial support, mobility, access, teaching, assessment, stability, supportive therapy, test, general nursing during hemodialysis, hemodialysis room management. According to validity and reliability results and experts' opinions, 4 classification levels revised to 3 classification levels and 2 elements were deleted. Finally, patient classification system were consisted of 10 factors, 14 elements, 3 classification levels, 3 categories.

  • PDF