• Title/Summary/Keyword: Reliability Indicators

Search Result 247, Processing Time 0.024 seconds

Reliability Analysis on the Assessment Indicators for Senior Walking Environment (노인 보행환경 평가항목 신뢰도 분석연구)

  • Lee, Hyung-Sook
    • KIEAE Journal
    • /
    • v.12 no.3
    • /
    • pp.69-75
    • /
    • 2012
  • Developing reliable measures of the environment is important to increase our understanding of the environmental effects on walking among seniors. As a preliminary study for developing an instrument for measuring walkability of seniors' environment, the purpose of this study are to identify important assessment indicators associated with seniors' walking and to test their reliability using inter-rater and intra-rater reliability methods. A set of assessment indicators was identified through literature review, and field studies by trained raters were conducted in three senior centers located in Seongnam area in order to test reliability of the audit tool. The results indicated high percent agreement for most indicators and overall 91.6% and 86.1% of items assessed had good or medium inter-rater and intra-rater reliability, respectively. The reliable assessment indicators would provide reliable data for use in community-based audits of built environment in relation to walking among older adults. The findings showed that the indicators of aesthetics had lower reliability compare to safety, convenience, and access. Rater training with various images would improve rater agreement while reduce rater bias.

Development of Outcome Indicators of Urinary Incontinence for Quality Evaluation in Long Term Care Hospitals (요양병원의 서비스 질 평가를 위한 요실금 결과 지표 개발)

  • Yoon, Ju-Young;Lee, Ji-Yun
    • Journal of Korean Academy of Nursing
    • /
    • v.40 no.1
    • /
    • pp.110-118
    • /
    • 2010
  • Purpose: To develop outcome indicators of urinary incontinence to measure quality of care in long term care hospitals in Korea. Methods: The draft indicators of urinary incontinence were developed from a literature review and clinical expert panel. A survey of medical records of 280 patients in 20 hospitals was conducted to test inter-rater reliability. Statistical analysis was done to test risk adjustment criteria, variation between hospitals, and stability of indicators, using assessment data from 77,918 patients in 623 hospitals. Results: The inter-rater reliability of items was high (Kappa range: 0.66- 0.92). Severe cognitive impairment (odds ratio [OR]: 3.15, confidence interval [CI]: 3.03-3.26) and total mobility activities of daily living (ADLs) dependency (OR: 4.85, CI: 4.72-4.98) increased the prevalence of urinary incontinence, thus they proved to be significant criteria to stratify high and low risk groups. The prevalence for low risk showed more substantial variation than the high risk group. The indicators were stable over one month. Conclusion: This study demonstrated the feasibility of outcome indicators of urinary incontinence. Improving the reliability of the patient assessment tool and refining the indicators through validation study is a must for future study.

The Current State of and Barriers to Quality Measurement, and Quality Managers' Reported Evaluation on Quality Indicators in Korea (국내 질 향상부서 중심의 질 지표 측정 현황, 장애요인과 평가)

  • Hwang Jee-In
    • Health Policy and Management
    • /
    • v.15 no.4
    • /
    • pp.26-45
    • /
    • 2005
  • The purposes of this study were to Identify the .level of measurement on quality Indicators and evaluate the existing indicators in order to determine the priority of quality indicators' application in Korean general hospitals. A survey was conducted using a questionnaire. The subjects were quality managers working at general hospital having over 300 beds. The criteria were relevance, reliability, precision, impact, application, and preference to evaluate quality indicators. According to these six criteria, each indicator was evaluated on a five point scale(5: excellent, 1: poor). The response rate was $40.4\%$. The hospitals have monitored the average of 3.8 indicators(median 4). The indicators such as return to operating room, unplanned readmission, cancellation of booked operations, death, hospital infection, cesarean section rate, volume per disease or procedure, readmission, re-operation, blood transfusion, and post-procedural complications were frequently measured. The top ten quality indicators in the evaluation by its relevance, validity, reliability, impact, preference and application were decubitus ulcer, clean wound infection, fall, unplanned return to operation room, transfusion reactions, foreign body left In during procedure, unplanned readmission, wound infection after contaminated surgery, postoperative hemorrhage/hematoma, and cesarean section rate in order. The high priority quality indicators frequently measured could be used as primary national indicators. Standardized guidelines about monitoring indicators and the utilization will preliminarily be needed to compare and reuse the data for various purposes and improve the quality of care continuously.

Identification of Performance Indicators for Poultry Agribusiness Operations

  • Pun, Kit Fai;Hosein, Anesa
    • International Journal of Quality Innovation
    • /
    • v.8 no.3
    • /
    • pp.11-22
    • /
    • 2007
  • Nowadays, the competitiveness of any organisations rests dominantly on how they can manage their performance, A host of performance variables such as quality, reliability, and efficiency are recognised as competitive priorities. This paper reviews the criteria and dimensions of performance measures, and discusses six core performance indicators in agribusiness operations with particular reference to the poultry/broiler farms. Besides, a holistic "Quality, Reliability and Efficiency" view of performance is proposed when developing measures for poultry agribusiness operations.

Development and Validation of the Strengths Assessment Indicators for Daycare Centers (어린이집 강점평가지표 개발 및 타당화)

  • Hong, Sung hee;Hwang, Hae-Ik
    • Korean Journal of Childcare and Education
    • /
    • v.14 no.6
    • /
    • pp.143-170
    • /
    • 2018
  • Objective: The purpose of this study was to develop assessment indicators and to verify the validity and reliability of the developed assessment indicators. Methods: A Delphi survey, focus group interviews, and content verification were conducted in order for experts to develop an evaluation index of the strengths of the day care center. A main survey was conducted on 438 daycare center principals and teachers to test their item quality, validity and reliability. Results: The final assessment indicators consisted of three areas, seven assessment criteria, 19 evaluation factors, 41 assessment items and a five-point rubric rating scale. As for the common strengths indicators, there were three assessment areas, five assessment criteria, 12 assessment elements and 22 assessment items. In regard to the selective strengths indicators, there were 3 assessment areas, 5 assessment criteria, 12 assessment elements and 16 assessment items. Conclusion/Implications: The efforts to confirm the strengths of daycare centers are expected to facilitate the identity building of the daycare center itself and for its organizational members to make a contribution to the qualitative improvement of childcare.

Development of human rights indicators for dental hygiene students (치위생(학)과 학생들의 인권 실태 지표 개발: 치과의료기관 임상실습을 중심으로)

  • Won, Yoon-Ah;Noh, Hie-Jin;Mun, So-Jung;Chung, Won-Gyun;Park, Bo-Young;Sim, Eun-Bi;Choi, Eun-Mi
    • Journal of Korean society of Dental Hygiene
    • /
    • v.21 no.3
    • /
    • pp.291-300
    • /
    • 2021
  • Objectives: This study aimed to develop human rights indicators through reliability and validity tests in order to measure the human rights situation of dental hygiene students who experience clinical practice at dental clincs. Methods: The basic framework of questions was constructed through literature review. Nine experts were tested for validity of the contents of the experts twice. The main survey was conducted on 121 students in the 3rd and 4th grade who were enrolled in the department of dental hygiene located in Seoul, Gyeonggi and Gangwon-do. Validity was tested through exploratory factor analysis, and reliability was tested through internal reliability coefficient and test-retest method. Results: The cronbach's α value was 0.734, and the Kappa coefficient was 0.584. The result of the reliability and validity test was composed of 11 questions and 3 factors. Conclusions: During the practice of a dental institution, the validity and reliability of the indicators that can grasp the human rights status of dental hygiene students were tested. It is expected that the indicators of this study will be provided an opportunity to understand the human rights situation of dental hygiene students and to improve problems such as human rights violations.

Reliability Assessment of Temperature Indicator for Simplified Measurement on Conservation Environment of Cultural Heritage (문화재 보존환경 간이 측정을 위한 온도지시카드 신뢰성 평가)

  • Lim, Bo-A;Shin, Eun-Jeong;Lee, Sun-Myung
    • 보존과학연구
    • /
    • s.31
    • /
    • pp.59-68
    • /
    • 2010
  • Cultural heritages are damaged by surrounding several environmental factors. Main factors are temperature, humidity, light, atmosphere and indoor pollutant, organism, etc. Therefore, to prevent damage of cultural heritage from such environmental factor, conservation environment monitoring becomes more important. Indicator is one of the simple method for environment monitoring. It can be used without expensive and complex equipments. However, it should be performed scientific examination for application to cultural heritage. In this study, some Temperature Indicators were chosen and reliability assessment was carried out for application to cultural heritage. Brightness($L^*$) is selected for reliability assessment factor. As a result of lab test, Temperature Indicators were not influenced greatly in humidity change. When they were exposed to setting temperature, the color was changed in setting temperature area and ${\pm}2^{\circ}C$ part of setting temperature. Especially brightness value was high in setting temperature area. Also, Temperature Indicators were stabilized after about 16 minutes when were exposed to temperature difference of $10^{\circ}C$ and when temperature difference with exposure environment is smaller, stabilization time shortened. Therefore, it is a possible to confirm that selected Temperature Indicator is reliable product through measurement of color difference value and naked eye observation.

  • PDF

Development and Verification of Indicators for a Foodservice & Nutrition Management Evaluation at a Hospital Nutrition Department (병원 영양부서의 급식 및 영양관리 평가 지표 개발 및 검증)

  • Lee, Joo-Eun;Kwak, Tong-Kung
    • Journal of the Korean Dietetic Association
    • /
    • v.15 no.4
    • /
    • pp.364-382
    • /
    • 2009
  • The purposes of this study were to develop the standard indicators to evaluate the food and nutrition systems in hospitals and to test the validity of those items scientifically. The results were as follows: First, the conceptual validity was examined with recognition degrees of importance from the hospital nutrition department managers. All of the hospital nutrition department's operation evaluation standards and the indicators' conceptual validity tested were in the range of 3.71~4.93 out of 5.0, and the mean score was 4.36. Therefore, the conceptual validity was verified. Second, to verify the factor validity of the items of the standards and indicators for the hospital nutrition department's operation evaluation, the standards and indicators were analyzed as key-factors. Key-factor analysis after vertical rotation showed that four factors appeared and were composed of (a) facilities management, (b) sanitation management, (c) operation & foodservice management, and (d) nutrition management. Third, the reliability of the standards and indicators for the hospital nutrition department's operation evaluation was analyzed and resulted in a score of 0.98, which showed good internal consistency. Fourth, the discriminative power of each item of the standards for the hospital nutrition department's operation evaluation was tested by checking the differences between groups with first quartile and forth quartile of total evaluation scores. The indicators having low distinction power were modified into obligatory items or eliminated for better differentiation.

  • PDF

Validity and Reliability of the Korean Version of the Observable Indicators of Nursing Home Care Quality Evaluation Instrument (한국형 노인요양시설 질 관찰평가도구의 타당도와 신뢰도 분석)

  • Lee, Ji-A
    • Journal of Korean Academy of Nursing
    • /
    • v.38 no.3
    • /
    • pp.474-482
    • /
    • 2008
  • Purpose: The purposes of this study were; 1) to test the validity and reliability of the Korean version of Rantz's Observable Indicators of Nursing Home Care Quality Instrument (ONHQ) and 2) to evaluate the quality of Korean nursing homes. Methods: The study employed a three-phase methodological research design. 1) The original instrument of Rantz's. ONHQ was translated into Korean and modified by Korean nursing home experts. 2) A pilot study using the modified instrument was done in 20 nursing homes to examine inter-rater reliability. 3) The validity and reliability were tested.in 98 nursing homes. Results: Seven factors were extracted through factor analysis: 'communication', 'care delivery', 'grooming', 'odor, 'environment-basics', 'environment-access', and 'environment-homelike'. These factors explained 86.07% of the total variance. Cronbach's alpha coefficient of the 30 items was .97 indicating a high internal consistency of the instrument. Inter-rater reliability according to Kappa was .82. The average score of nursing home quality was 112.07 indicating an average range of quality level. Conclusion: The Korean version of the ONHQ was identified as a tool with a high degree of validity and reliability. This tool can be effectively used to assess the quality of nursing homes by professions as well as family members.

Development and Application of Service Quality Indicators in Nursing Homes: Structure-Process Evaluation (노인요양시설의 서비스 질 평가 지표 개발 및 적용: 구조-과정 측면의 질 평가)

  • Kim, Moon-Sil;Lee, Seung-Hee
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.14 no.2
    • /
    • pp.131-143
    • /
    • 2008
  • Purpose: The aim of this study was to develop service quality indicators to evaluate structure and process of the nursing home service. Method: On the basis of literature review and analysis of existing quality indicators, the researcher made a preliminary service quality indicators and verified content validity twice. The final service quality indicators were applied in 30 nursing homes. Results: Preliminarily, 3 domains, 24 sub-domains, and 156 indicators were generated. Through two content validity testings, the indicators scoring over .80 CVI for each testing were adopted and modified by discussion with a panel of experts. The final indicators consisted of 3 domains, 15 sub-domains, and 128 indicators. These indicators were applied in 30 nursing homes. The result showed that they were easily applicable and suitable for a evaluation of service quality in nursing home. Conclusion: This 'service quality indicators in nursing home' was verified by the content validity. This tool will be able to be used for evaluation and improvement of nursing home service quality. However, repeated researches are needed for further validity and reliability.

  • PDF