• Title/Summary/Keyword: Agreement score

Search Result 153, Processing Time 0.028 seconds

Reliability of the Foot Posture Index (FPI-6) for Assessment of Stroke Patients

  • Lee, Jong Dae;Kim, Young Mi;Kim, Kyung;Koh, Da Hyun;Choi, Myeong Su;Lee, Ho Jung
    • The Journal of Korean Physical Therapy
    • /
    • v.27 no.5
    • /
    • pp.311-314
    • /
    • 2015
  • Purpose: This study attempted to determine intra-rater reliability and inter-rater reliability for measurement of foot form using the FPI-6 (Foot Posture Index) in patients with hemiplegia caused by stroke. Methods: Twenty two stroke patients were recruited into the research and their foot posture was evaluated using the FPI. Two raters assessed 6 items sequentially in accordance with the FPI-6 manual. This procedure involved asking the subject to take several steps in-place, prior to settling into a comfortable stance position with double limb support. Subjects were instructed to stand still with their arms by their sides and look straight ahead. FPI-6 values ranged from -2 to +2 for each of the six criteria and from -12 to +12 for the total score, indicating a position for each foot either along the supinated (negative score) to pronated (more than +6) continuum of foot posture. Results: The results showed that intra-rater reliability and inter-rater reliability for a total FPI-6 score was high: 0.807-0.888. An almost perfect agreement between the two raters was identified in the foot's morphological classification (Somer's D=0.712; p<0.05). Intra-percentage agreement was high (88.6%). Conclusion: The FPI-6 is a quick, simple, and reliable clinical tool with demonstrated good to excellent intra-rater reliability and good inter-rater reliability when used in assessment of the stroke patient's foot.

Validity and Reliability on the Walking Index for Spinal Cord Injury in the walking assessment of the SCI patient (척수손상환자에서 보행 기능 평가도구인 WISCI II의 타당도와 신뢰도)

  • Lee Hyoung-Soo;Jeong Chan-Ju;Yang Hoi-song;Shin Young-Il
    • The Journal of Korean Physical Therapy
    • /
    • v.16 no.3
    • /
    • pp.142-151
    • /
    • 2004
  • The purpose of this study was to determine the validity and the reliability of the WISCI II to ascertain its value in the walking function evaluation of spinal cord injury patient. The WISCI II consists of 20 variables with a total valus ranging from 6 to 20 score. A group of 23 spinal cord injury patient were included in this study. To determine the validity, kappa statistics between the WISCI II and SCIM II were measured. The result of this study are as follows: 1) In the validity study, the kappa statistics between the WISCI II and SCIM II were 0.79 and 0.84 for an initial total score and a discharge total score respectively, indicating a reasonable agreement between the two test. 2) In the reliability study, the Cronbach's alpha coefficient was 0.83 and 0.95 for total score indicating a good internal consistency. The finding suggest that the WISCI II demonstrated an acceptable validity and reliabilit for the evaluation of walking function capacity of spinal cord injury patient in clinical practice.

  • PDF

Triage Accuracy of Pediatric Patients using the Korean Triage and Acuity Scale in Emergency Departments (한국형응급환자분류도구를 적용한 응급실에서 소아 환자의 중증도 분류 정확성)

  • Moon, Sun-Hee;Shim, Jae Lan
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.19 no.11
    • /
    • pp.626-634
    • /
    • 2018
  • This retrospective study investigates the accuracy of triage procedures for pediatric patients in emergency departments (EDs) using the Korean Triage and Acuity Scale (KTAS). The study includes 250 randomly selected initial nursing records and clinical outcomes of pediatric patients who visited one regional ED or a local ED from October 2016 to September 2017. The collected data were analyzed by a qualified expert to determine the true triage score. The accuracy of triage was defined as the agreement between the triage score of the emergency nurses (ENs) and the true triage score as determined by the expert. Based on expert comments, the cause of the triage error was analyzed and the KTAS score was compared with the discharge, length of stay (LOS), and medical cost. The results showed that the degree of agreement in the triage score between the experts and the ENs was excellent (weighted kappa=0.77). Among the causes of triage discordance, the most frequent was the incorrect application of vital signs to the KTAS algorithm criteria (n=13). Patients with high severity KTAS levels 1 and 2 were discharged less often (${\chi}=43.25$, p<0.001). There were significant differences in the length of stay (F=12.39, p<0.001) and cost (F=11.78, p<0.001) between KTAS scores when adjusting for age. The results of this study indicate that KTAS is highly accurate in EDs. Hence, the newly developed triage tool is becoming well established in Korea.

Is the Spinal Instability Neoplastic Score Accurate and Reliable in Predicting Vertebral Compression Fractures for Spinal Metastasis? A Systematic Review and Qualitative Analysis

  • Lee, Chang-Hyun;Hong, Jae Taek;Lee, Sun-Ho;Yi, Seong;Sohn, Moon-Jun;Kim, Sung Hwan;Chung, Chun Kee;Korean Spine Oncology Research Society
    • Journal of Korean Neurosurgical Society
    • /
    • v.64 no.1
    • /
    • pp.4-12
    • /
    • 2021
  • Spinal metastases can present with varying degrees of mechanical instability. The Spinal Instability Neoplastic Score (SINS) was developed as a tool to assess spinal neoplastic-related instability while helping to guide referrals among oncology specialists. Some previous papers suggested that the SINS was accurate and reliable, while others disagreed with this opinion. We performed a systematic review regarding the SINS to evaluate its accuracy and precision in predicting vertebral compression fractures (VCFs). The 21 included studies investigated a total of 2118 patients. Thirteen studies dealt with the accuracy of SINS to predict post-radiotherapy VCFs, and eight dealt with the precision. Among 13 studies, 11 agreed that the SINS categories showed statistically significant accuracy in predicting VCF. Among eight studies, body collapse was effective for predicting VCFs in six studies, and alignment and bone lesion in two studies. Location has no statistical significance in predicting VCFs in any of the eight studies. The precision of SINS categories was substantial to excellent in six of eight studies. Among the six components of the SINS, the majority of the included studies reported that location showed near perfect agreement; body collapse, alignment, and posterolateral involvement showed moderate agreement; and bone lesion showed fair agreement. Bone lesion showed significant accuracy in predicting VCFs in half of eight studies, but displayed fair reliability in five of seven studies. Although location was indicated as having near perfect reliability, the component showed no accuracy for predicting VCFs in any of the studies and deleting or modifying the item needs to be considered. The SINS system may be accurate and reliable in predicting the occurrence of post-radiotherapy VCFs for spinal metastasis. Some components seem to be substantially weak and need to be revised.

Attitude of Hospital Nurse's on Death with Dignity (병원 간호사의 존엄사에 대한 태도)

  • Kim, Tae-Kyung;Jung, Ha-Yun;Min, Hye-Sook
    • The Korean Journal of Health Service Management
    • /
    • v.6 no.1
    • /
    • pp.129-140
    • /
    • 2012
  • The purpose of this study was to identify attitude of hospital nurse's on death with dignity. The subjects of the study were 516 nurses. The data was analyzed by SPSS PC 19.0 program. 1) 82.8% participants agree to death with dignity, and they and their family will ask death with dignity in actual situations. 2) The average score of overall attitude on death with dignity was $3.13{\pm}0.52$. 3) With respect to the general characteristics of participants there were statistically significant difference in total score according to age, Marital Status, education level, religion, career, position, and existence of patients with incurable disease around. 4) With respect to the death with dignity related characteristics of participants there were statistically significant difference in total score according to agreement to death with dignity, request to my death with dignity, in case my family member requests death with dignity. Although many nurses had a positive concept of death with dignity, they still have ethical dilemmas in life-sustaining care. Therefore training programs on moral rights are necessary to provide guidelines foe end-of-life care.

Comparison of the Autism Diagnostic Observation Schedule and Childhood Autism Rating Scale in the Diagnosis of Autism Spectrum Disorder: A Preliminary Study

  • Park, Hyung Seo;Yi, So Young;Yoon, Sun Ah;Hong, Soon-Beom
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • v.29 no.4
    • /
    • pp.172-177
    • /
    • 2018
  • Objectives: We examined the agreement between the Autism Diagnostic Observation Schedule (ADOS) and the Childhood Autism Rating Scale (CARS) in the diagnosis of autism spectrum disorder. Methods: The ADOS and CARS scores of 78 children were retrospectively collected from a chart review. A correlation analysis was performed to examine the concurrent validity between the two measures. Using the receiver operating characteristic (ROC) curve, we determined the optimal cut-off score of the CARS for identifying autism spectrum disorder. Results: The CARS score was significantly correlated with the ADOS score (r=0.808, p<0.001). Taking ADOS as the ideal standard, the optimal cut-off scores of CARS for identifying autism and autism spectrum were 30 and 24.5, respectively. Conclusion: We determined the optimal cut-off scores of CARS for screening and diagnosing autism spectrum disorder.

Comparison of results between modified-Angoff and bookmark methods for estimating cut score of the Korean medical licensing examination

  • Yim, Mikyoung
    • Korean journal of medical education
    • /
    • v.30 no.4
    • /
    • pp.347-357
    • /
    • 2018
  • Purpose: The purpose of this study was to apply alternative standard setting methods for the Korean Medical Licensing Examination (KMLE), a criterion-referenced written examination, and to compare them to the conventional cut score used on the KMLE. Methods: The process and results of criterion-referenced standard settings (i.e., the modified-Angoff and bookmark methods) were evaluated. The ratio of passing and failing examinees determined using these alternative standard setting methods was compared to the results of the conventional criteria. Additionally, the external, internal and procedural evaluation of these methods were reviewed. Results: The modified-Angoff method yielded the highest cut score, followed sequentially by the conventional method and the bookmark method. The classification agreement between the modified-Angoff and bookmark methods was 0.720 measured by Cohen's ${\kappa}$ coefficient. The intra-panelist classification consistency of modified-Angoff method was higher than bookmark method. However, the inter-panelist classification consistency was vice versa. The standard setting panelists' survey results showed that the procedures of both methods were satisfactory, but panelists had more confidence in the results of the modified-Angoff method. Conclusion: The modified-Angoff method showed results that were more similar to those of the conventional method. Both new methods showed very high concordance with the conventional method, as well as with each other. The modified-Angoff method was considered feasible for adoption on the KMLE. The standard setting panelists responded positively to the modified-Angoff method in terms of its practical applicability, despite certain advantages of the bookmark method.

Perceptions and Practices for Core Action Message on Green Dietary Life: The Case of Homemakers in Ulsan, Korea (울산지역 주부의 녹색식생활지침에 대한 인식 및 실천)

  • Ha, Tae Jeong;Park, Dong-Yean
    • The Korean Journal of Community Living Science
    • /
    • v.25 no.4
    • /
    • pp.533-548
    • /
    • 2014
  • The Ministry for Agriculture, Food and Rural Affairs developed a program called "Core Action Massages for Green Dietary Life" to reduce greenhouse gas emissions and energy consumption and improve health. This study examines the degree of perceptions and practices with respect to these massages by considering a sample of 245 homemakers in Ulsan, Korea. The questionnaire consisted of questions about perceptions and practices of Core Action Massage and its three parts of detailed massages: , , . The data were analyzed with cross tabulation analysis, Tukey analysis after ANOVA. The score of agreement to Core Action Massage was 4.57(range 1-5). The score of perception about showed significant differences in age(p<0.01) and income(p<0.05). The score of perception about and showed significant differences in age(p<0.05). The score of practicing showed significant differences in age(0.001), education(0.01), housing style(p<0.01), and region(0.01). The score of practicing showed significant differences in age(p<0.001), education(0.05), and region(0.05). The frequency of practices for was low. As to the results of the study, education on green dietary life must be provided to homemakers, especially young homemakers. Opportunities to experience of farming to appreciate others' efforts to obtain food should also be provided.

Utility of the 16-cm Axial Volume Scan Technique for Coronary Artery Calcium Scoring on Non-Enhanced Chest CT: A Prospective Pilot Study (비 조영증강 흉부 CT에서 관상동맥 칼슘스코어 측정을 위한 16 cm 축상 촬영 기법의 유용성: 전향적 탐색적 연구)

  • So Jung Ki;Chul Hwan Park;Kyunghwa Han;Jae Min Shin;Ji Young Kim;Tae Hoon Kim
    • Journal of the Korean Society of Radiology
    • /
    • v.82 no.6
    • /
    • pp.1493-1504
    • /
    • 2021
  • Purpose This study aimed to evaluate the utility of the 16-cm axial volume scan technique for calculating the coronary artery calcium score (CACS) using non-enhanced chest CT. Materials and Methods This study prospectively enrolled 20 participants who underwent both, non-enhanced chest CT (16-cm-coverage axial volume scan technique) and calcium-score CT, with the same parameters, differing only in slice thickness (in non-enhanced chest CT = 0.625, 1.25, 2.5 mm; in calcium score CT = 2.5 mm). The CACS was calculated using the conventional Agatston method. The difference between the CACS obtained from the two CT scans was compared, and the degree of agreement for the clinical significance of the CACS was confirmed through sectional analysis. Each calcified lesion was classified by location and size, and a one-to-one comparison of non-contrast-enhanced chest CT and calcium score CT was performed. Results The correlation coefficients of the CACS obtained from the two CT scans for slice thickness of 2.5, 1.25, and 0.625 mm were 0.9850, 0.9688, and 0.9834, respectively. The mean differences between the CACS were -21.4% at 0.625 mm, -39.4% at 1.25 mm, and -76.2% at 2.5 mm slice thicknesses. Sectional analysis revealed that 16 (80%), 16 (80%), and 13 (65%) patients showed agreement for the degree of coronary artery disease at each slice interval, respectively. Inter-reader agreement was high for each slice interval. The 0.625 mm CT showed the highest sensitivity for detecting calcified lesions. Conclusion The values in the non-contrast-enhanced chest CT, using the 16-cm axial volume scan technique, were similar to those obtained using the CACS in the calcium score CT, at 0.625 mm slice thickness without electrocardiogram gating. This can ultimately help predict cardiovascular risk without additional radiation exposure.

Evaluation of the Triage by Emergency Medical Technicians by Using Trauma Score for Occupant Injuries Caused by Motor Vehicle Collisions (자동차 탑승자 사고에서 외상계수를 이용한 구급대원의 중증도 분류 평가)

  • Kim, Sang Chul;Kim, Byung Woo;Tak, Yang Ju;Lee, Sang Hee
    • Journal of Trauma and Injury
    • /
    • v.26 no.3
    • /
    • pp.89-98
    • /
    • 2013
  • Purpose: The assessment of trauma patients in the prehospital setting is difficult, but appropriate field triage is critical to the prognosis of trauma patients. We sought to evaluate the triage given by the emergency medical technicians (EMTs) using the trauma score to patients injured in motor vehicle collisions (MVCs). Methods: From June 2012 to July 2012, questionnaires were distributed to EMTs, who had transported injured patients to the study hospital. Scene records, photos of the damaged vehicle, and ambulance run sheets were used to provide physiologic, physical, and mechanistic information about the MVC. To evaluate the appropriateness of the injury assessment by EMTs, we compared their impressions with the hospital's final diagnosis within a 3 level triage system comprising both the maximum abbreviated injury scale (MAIS) and the injury severity score (ISS). Kappa (k) was calculated to evaluate the agreement between the triage by EMTs and the triage based on hospital's final diagnosis. Results: A total of 91 patients were analyzed by 31 EMTs. The percentage of males was 57.1%, the mean age was 44.5, and the mean MAIS and ISS were 2.7 and 16.6 respectively. While EMTs correctly diagnosed patient injuries to the extremities in 35.7%, and to the neck in 32.1%, pelvic injuries were missed in 80.0%. The agreement between the triage by the EMTs and the triage based on the hospital's final diagnosis was 62.6%(k=0.366) by the MAIS and 50.5%(k=0.234) by the ISS. The kappa value was higher in EMT-I than in EMT-II. Conclusion: In MVC, the assessment of injured patients by EMT-I was more appropriate, and the 3-level triage method based on the MAIS could contribute to a more accurate triage. Prospective studies to search for appropriate methods of field triage are required for programming practical education for EMTs.