• Title/Summary/Keyword: Hosmer-Lemeshow Test

Search Result 23, Processing Time 0.027 seconds

Classification Accuracy Test of Hearing Laboratory Test Models for Railway Noise at Station Platform (철도 승강장 소음의 청감실반응평가모형에 대한 적합도 검정)

  • Kim, Phillip;Ahn, Soyeon;Jeon, Hyesung;Lee, Jae Kwan;Park, Sunghyun;Chang, Seo Il;Park, Il Gun;Jung, Chan Gu;Kwon, Se Gon
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.25 no.4
    • /
    • pp.299-305
    • /
    • 2015
  • A statistical annoyance model to railway noise at platform was proposed by jury evaluation test performed in hearing laboratory. ITX-Saemaeul and Mugunghwa were chosen as the noise sources of the test, and announcement sound was included to simulate real situation. Logistic regression analysis produced %HALAB curve. Hosmer-Lemeshow test and classification accuracy test were used to verify the model's statistical significance. It was shown that the model which was generated from relatively small number of samples is statistically significant.

Impact of Risk Adjustment with Insurance Claims Data on Cesarean Delivery Rates of Healthcare Organizations in Korea (건강보험 청구명세서 자료를 이용한 제왕절개 분만율 위험도 보정의 효과)

  • Lee, Sang-Il;Seo, Kyung;Do, Young-Mi;Lee, Kwang-Soo
    • Journal of Preventive Medicine and Public Health
    • /
    • v.38 no.2
    • /
    • pp.132-140
    • /
    • 2005
  • Objectives: To propose a risk-adjustment model from insurance claims data, and analyze the changes in cesarean section rates of healthcare organizations after adjusting for risk distribution. Methods: The study sample included delivery claims data from January to September, 2003. A risk-adjustment model was built using the 1st quarter data, and the 2nd and 3rd quarter data were used for a validation test. Patients' risk factors were adjusted using a logistic regression analysis. The c-statistic and Hosmer-Lemeshow test were used to evaluate the performance of the risk-adjustment model. Crude, predicted and risk-adjusted rates were calculated, and compared to analyze the effects of the adjustment. Results: Nine risk factors (malpresentation, eclampsia, malignancy, multiple pregnancies, problems in the placenta, previous Cesarean section, older mothers, bleeding and diabetes) were included in the final risk-adjustment model, and were found to have statistically significant effects on the mode of delivery. The c-statistic (0.78) and Hosmer-Lemeshow test ($x^2$=0.60, p=0.439) indicated a good model performance. After applying the 2nd and 3rd quarter data to the model, there were no differences in the c-statistic and Hosmer-Lemeshow $x^2$. Also, risk factor adjustment led to changes in the ranking of hospital Cesarean section rates, especially in tertiary and general hospitals. Conclusion: This study showed a model performance, using medical record abstracted data, was comparable to the results of previous studies. Insurance claims data can be used for identifying areas where risk factors should be adjusted. The changes in the ranking of hospital Cesarean section rates implied that crude rates can mislead people and therefore, the risk should be adjusted before the rates are released to the public. The proposed risk-adjustment model can be applied for the fair comparisons of the rates between hospitals.

Evaluation of the Validity of Risk-Adjustment Model of Acute Stroke Mortality for Comparing Hospital Performance (병원 성과 비교를 위한 급성기 뇌졸중 사망률 위험보정모형의 타당도 평가)

  • Choi, Eun Young;Kim, Seon-Ha;Ock, Minsu;Lee, Hyeon-Jeong;Son, Woo-Seung;Jo, Min-Woo;Lee, Sang-il
    • Health Policy and Management
    • /
    • v.26 no.4
    • /
    • pp.359-372
    • /
    • 2016
  • Background: The purpose of this study was to develop risk-adjustment models for acute stroke mortality that were based on data from Health Insurance Review and Assessment Service (HIRA) dataset and to evaluate the validity of these models for comparing hospital performance. Methods: We identified prognostic factors of acute stroke mortality through literature review. On the basis of the avaliable data, the following factors was included in risk adjustment models: age, sex, stroke subtype, stroke severity, and comorbid conditions. Survey data in 2014 was used for development and 2012 dataset was analysed for validation. Prediction models of acute stroke mortality by stroke type were developed using logistic regression. Model performance was evaluated using C-statistics, $R^2$ values, and Hosmer-Lemeshow goodness-of-fit statistics. Results: We excluded some of the clinical factors such as mental status, vital sign, and lab finding from risk adjustment model because there is no avaliable data. The ischemic stroke model with age, sex, and stroke severity (categorical) showed good performance (C-statistic=0.881, Hosmer-Lemeshow test p=0.371). The hemorrhagic stroke model with age, sex, stroke subtype, and stroke severity (categorical) also showed good performance (C-statistic=0.867, Hosmer-Lemeshow test p=0.850). Conclusion: Among risk adjustment models we recommend the model including age, sex, stroke severity, and stroke subtype for HIRA assessment. However, this model may be inappropriate for comparing hospital performance due to several methodological weaknesses such as lack of clinical information, variations across hospitals in the coding of comorbidities, inability to discriminate between comorbidity and complication, missing of stroke severity, and small case number of hospitals. Therefore, further studies are needed to enhance the validity of the risk adjustment model of acute stroke mortality.

Characteristics and Influencing Factors of Red Light Running (RLR) Crashes (신호위반사고의 특성과 영향요인 분석)

  • Park, Jeong Soon;Jung, Yong Il;Kim, Yun Hwan
    • Journal of Korean Society of Transportation
    • /
    • v.32 no.3
    • /
    • pp.198-206
    • /
    • 2014
  • According to the statistics of the National Police Agency, red light running (RLR) crashes represent a significant safety issue throughout Korea. This study deals with the RLR crashes occurred at signalized intersections in Cheongju. The objectives of this study are to comparatively analyze the characteristics of between RLR crashes and the Non-RLR crashes, and to find out factors using a Binary Logistic Regression(BLR) model. In pursuing the above, the study gives particular attentions to testing the differences between the above two groups with the data of 2,246 RLR/ 3,884 Non-RLR crashes (2007-2011). The main results are as follows. First, many RLR crashes were occurred in the nighttime and in going straight. Second, the difference between RLR and Non-RLR crashes were clearly defined by crash type, maneuver of vehicle before crash, age of driver (30s, 50s), alcohol use and accident pattern. Finally, a statistically significant model (Hosmer and Lemeshow test : 7.052, p-value : 0.531) was developed through the BLR model.

Construction of a Nomogram for Predicting Difficulty in Peripheral Intravenous Cannulation (말초 정맥주사 삽입 어려움 예측을 위한 노모그램 구축)

  • Kim, Kyeong Sug;Choi, Su Jung;Jang, Su Mi;Ahn, Hyun Ju;Na, Eun Hee;Lee, Mi Kyoung
    • Journal of Korean Academic Society of Home Health Care Nursing
    • /
    • v.30 no.1
    • /
    • pp.48-58
    • /
    • 2023
  • Purpose: The purpose of this study was to construct a nomogram for predicting difficulty in peripheral intravenous cannulation (DPIVC) for adult inpatients. Methods: This study conducted a secondary analysis of data from the intravenous cannulation cohort by intravenous specialist nurses at a tertiary hospital in Seoul. Overall, 504 patients were included; of these, 166 (32.9%) patients with failed cannulation in the first intravenous cannulation attempt were included in the case group, while the remaining 338 patients were included in the control group. The nomogram was built with the identified risk factors using a multiple logistic regression analysis. The model performance was analyzed using the Hosmer-Lemeshow test, area under the curve (AUC), and calibration plot. Results: Five factors, including vein diameter, vein visibility, chronic kidney disease, diabetes, and chemotherapy, were risk factors of DPIVC. The nomogram showed good discrimination with an AUC of 0.81 (95% confidence interval: 0.80-0.82) by the sample data and 0.79 (95% confidence interval: 0.74-0.84) by bootstrapping validation. The Hosmer-Lemeshow goodness-of-fit test showed a p-value of 0.694, and the calibration curve of the nomogram showed high coherence between the predicted and actual probabilities of DPIVC. Conclusion: This nomogram can be used in clinical practice by nurses to predict DPIVC probability. Future studies are required, including those on factors possibly affecting intravenous cannulation.

Performance effectiveness of pediatric index of mortality 2 (PIM2) and pediatricrisk of mortality III (PRISM III) in pediatric patients with intensive care in single institution: Retrospective study (단일 병원에서 소아 중환자의 예후인자 예측을 위한 PIM2 (pediatric index of mortality 2)와 PRIMS III (pediatric risk of mortality)의 유효성 평가 - 후향적 조사 -)

  • Hwang, Hui Seung;Lee, Na Young;Han, Seung Beom;Kwak, Ga Young;Lee, Soo Young;Chung, Seung Yun;Kang, Jin Han;Jeong, Dae Chul
    • Clinical and Experimental Pediatrics
    • /
    • v.51 no.11
    • /
    • pp.1158-1164
    • /
    • 2008
  • Purpose : To investigate the discriminative ability of pediatric index of mortality 2 (PIM2) and pediatric risk of mortality III (PRISM III) in predicting mortality in children admitted into the intensive care unit (ICU). Methods : We retrospectively analyzed variables of PIM2 and PRISM III based on medical records with children cared for in a single hospital ICU from January 2003 to December 2007. Exclusions were children who died within 2 h of admission into ICU or hopeless discharge. We used Students t test and ANOVA for general characteristics and for correlation between survivors and non-survivors for variables of PIM2 and PRISM III. In addition, we performed multiple logistic regression analysis for Hosmer-Lemeshow goodness-of-fit, receiver operating characteristic curve (ROC) for discrimination, and calculated standardized mortality ratio (SMR) for estimation of prediction. Results : We collected 193 medical records but analyzed 190 events because three children died within 2 h of ICU admission. The variables of PIM2 correlated with survival, except for the presence of post-procedure and low risk. In PRISM III, there was a significant correlation for cardiovascular/neurologic signs, arterial blood gas analysis but not for biochemical and hematologic data. Discriminatory performance by ROC showed an area under the curve 0.858 (95% confidence interval; 0.779-0.938) for PIM2, 0.798 (95% CI; 0.686-0.891) for PRISM III, respectively. Further, SMR was calculated approximately as 1 for the 2 systems, and multiple logistic regression analysis showed ${\chi}^2(13)=14.986$, P=0.308 for PIM2, ${\chi}^2(13)=12.899$, P=0.456 for PRISM III in Hosmer-Lemeshow goodness-of-fit. However, PIM2 was significant for PRISM III in the likelihood ratio test (${\chi}^2(4)=55.3$, P<0.01). Conclusion : We identified two acceptable scoring systems (PRISM III, PIM2) for the prediction of mortality in children admitted into the ICU. PIM2 was more accurate and had a better fit than PRISM III on the model tested.

Goodness-of-fit tests for a proportional odds model

  • Lee, Hyun Yung
    • Journal of the Korean Data and Information Science Society
    • /
    • v.24 no.6
    • /
    • pp.1465-1475
    • /
    • 2013
  • The chi-square type test statistic is the most commonly used test in terms of measuring testing goodness-of-fit for multinomial logistic regression model, which has its grouped data (binomial data) and ungrouped (binary) data classified by a covariate pattern. Chi-square type statistic is not a satisfactory gauge, however, because the ungrouped Pearson chi-square statistic does not adhere well to the chi-square statistic and the ungrouped Pearson chi-square statistic is also not a satisfactory form of measurement in itself. Currently, goodness-of-fit in the ordinal setting is often assessed using the Pearson chi-square statistic and deviance tests. These tests involve creating a contingency table in which rows consist of all possible cross-classifications of the model covariates, and columns consist of the levels of the ordinal response. I examined goodness-of-fit tests for a proportional odds logistic regression model-the most commonly used regression model for an ordinal response variable. Using a simulation study, I investigated the distribution and power properties of this test and compared these with those of three other goodness-of-fit tests. The new test had lower power than the existing tests; however, it was able to detect a greater number of the different types of lack of fit considered in this study. I illustrated the ability of the tests to detect lack of fit using a study of aftercare decisions for psychiatrically hospitalized adolescents.

Analysis of Speeding Characteristics Using Data from Red Light and Speed Enforcement Cameras (다기능단속카메라 수집 자료를 활용한 과속운전 특성 분석)

  • PARK, Jeong Soon;KIM, Joong Hyo;HYUN, Chul Seng;JOO, Doo Hwan
    • Journal of Korean Society of Transportation
    • /
    • v.34 no.1
    • /
    • pp.29-42
    • /
    • 2016
  • Speeding is an important factor in traffic safety. Speed not only affects crash severity, but is also related to the possibility of crash occurrence. This study presents results from an analysis of 27,968 speed violation cases collected from 36 red light and speed enforcement cameras at signalized intersections in the city of Cheongju. Data included details of their violation history such as speeding tickets within a recent 3-year span and their demographic characteristics. The goal of this analysis is to understand the correlation between speed violations and various factors in terms of humans, vehicles and road environments. This study used descriptive statistics and Binary Logistics Regression(BLR) analysis with SPSS 20.0 software. The major results of this study are as follows. First, speed violations occurred at rural and suburban area. Second, about 25.6% of the violators committed to more than 20km/h over a speed limit. Third, the difference between speed violators and normal drivers clearly appeared in location of intersection(urban/rural/suburban area), gender and age. Finally, a statistically significant model(Hosmer and Lemeshow test: 11.586, p-value: 0.171) was developed through the BLR.

Score System for Operative Risk Evaluation in Coronary Artery Bypass Surgery (관상동맥 우회로술의 수술 위험인자에 대한 스코어 시스템)

  • Kang Joon-Kyu;Kim Chong-Wook;Sheen Seung-Soo;Chung Cheol-Hyun;Lee Jae-Won;Song Meong-Gun;Lee Jung-Sook;Song Hyun
    • Journal of Chest Surgery
    • /
    • v.39 no.10 s.267
    • /
    • pp.749-753
    • /
    • 2006
  • Background: The purpose of this study is to assess a score system for operative risk evaluation of CABG. Material and Method: From January 2001 to September 2005, retrospective study for various perioperative factors of 2993 cases was done. Result: The early operative mortality was 2.4% and the beta coefficients of 7 core variables related to it (preoperative LV dysfuction, preoperative renal failure, MI within 1 week, reoperation, combined surgery, preoperative atrial fibrillation, preoperative IABP) were adjusted to score system. ROC curve and Hosmer and Lemeshow goodness of fit test was done. Conclusion: This score system was effective in assessing operative risk of CABG. But It is necessary to gather larger volume of case and perform multicenter study.

Inter-hospital Comparison of Cesarean Section Rates after Risk Adjustment (위험도 보정을 통한 병원간 제왕절개 분만율의 비교)

  • Lee, Sang-Il;Ha, Beom-Man;Lee, Moo-Song;Kang, Wee-Chang;Koo, Hee-Jo;Kim, Chang-Yup;Khang, Young-Ho
    • Journal of Preventive Medicine and Public Health
    • /
    • v.34 no.4
    • /
    • pp.337-346
    • /
    • 2001
  • Objective : To determine the clinical risk factors associated with the mode of delivery decision and to compare cesarean section rates after adjusting for risk factors identified among Korean hospitals. Methods Data were collected from 9 general hospitals in two provincial regions by medical record abstraction during February 2000. A total of 3,467 cases were enrolled and analyzed by stepwise logistic regression. Performance of the risk-adjustment model (discrimination and calibration) was evaluated by the C statistic and the Hosmer-Lemeshow test. Crude rates, predicted rates with 95% confidence intervals, and adjusted rates of cesarean section were calculated and compared among the hospitals. Results : The average crude cesarean section rate was 53.2%, ranging from 39.4% to 65.7%. Several risk factors such as maternal age, previous history of cesarean section, placenta previa, placental abruption, malpresentation, amniotic fluid abnormality, gestational anemia, infant body weight, pregnancy-induced hypertension, and chorioamnionitis were found to have statistically significant effects on the mode of delivery. It was confirmed that information about most of these risk factors was able to be collected through the national health insurance claims database in Korea. Performance of the risk-adjustment model was good (c statistic=0.815, Hosmer-Lemeshow test=0.0621). Risk factor adjustment did lead to some change in the rank of hospital cesarean section rates. The crude rates of three hospitals were beyond 95% confidence intervals of the predicted rates. Conclusions : Considering that cesarean section rates in Korean hospitals are too high, it is apparent that some policy interventions need to be introduced. The concept and methodology of risk adjustment should be used in the process of health policy development to lower the cesarean section rate in Korea.

  • PDF