Comparative Analysis of the Accuracy of Severity Scoring Systems for the Prediction of Healthcare Outcomes of Intensive Care Unit Patients

중환자실 환자의 건강결과 예측을 위한 중증도 평가도구의 정확도 비교분석

  • Received : 2014.12.18
  • Accepted : 2015.06.22
  • Published : 2015.06.30

Abstract

Purpose: The purpose of this study was to compare the applicability of the Charlson Comorbidity Index (CCI) and Acute Physiology, Age, Chronic Health Evaluation III (APACHE III) to the prediction of the healthcare outcomes of intensive care unit (ICU) patients. Methods: This research was performed with 136 adult patients (age>18 years) who were admitted to the ICU between May and June 2012. Data were measured using the CCI score with a comorbidity index of 19 and the APACHE III score on the standard of the worst result with vital signs and laboratory results. Discrimination was evaluated using receiver operating characteristic (ROC) curves and area under an ROC curve (AUC). Calibration was performed using logistic regression. Results: The overall mortality was 25.7%. The mean CCI and APACHE III scores for survivors were found to be significantly lower than those of non-survivors. The AUC was 0.835 for the APACHE III score and remained high, at 0.688, for the CCI score. The rate of concordance according to the CCI and the APACHE III score was 69.1%. Conclusion: The route of admission, days in ICU, CCI, and APACHE III score are associated with an increased mortality risk in ICU patients.

Keywords

References

  1. Bastos, P. G., Sun, X., Wagner, D. P., Knaus, W. A., & Zimmerman, J. E. (1996). Application of the APACHE III prognostic system in Brazilian intensive care units: a prospective multicenter study. Intensive Care Medicine, 22 (6), 546-570. https://doi.org/10.1007/BF01708094
  2. Cabrera, R., Shakeel, Q., Uduman, A., Watanabe, L., Vahia, A., & Paje, D. (2013). Evaluation of Charlson comorbidity index as a predictor of adverse outcomes in patients admitted with community-acquired pneumonia [abstract]. Journal of Hospital Medicine, 8 (suppl 2).
  3. Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987). A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. Journal of Chronic Diseases, 40 (5), 373-383. https://doi.org/10.1016/0021-9681(87)90171-8
  4. Chatzicostas, C., Roussomoustakaki, M., Notas, G., Vlachonikolis, I. G., Samonakis, D., Romanos, J., et al. (2003). A comparison of Child-Pugh, APACHE II and APACHE III scoring systems in predicting hospital mortality of patients with liver cirrhosis. BioMed Central Gastroenterology, 3 (1), 1-7.
  5. Cho, S. J., Chung, S. H., & Oh, J. Y. (2011). Differences between diabetic patients' tertiary hospital and non-tertiary hospital utilization according to comorbidity score. Korean Journal of Health Policy and Administration, 21 (4), 527-540. https://doi.org/10.4332/KJHPA.2011.21.4.527
  6. Christensen, S., Johansen, M. B., Christiansen, C. F., Jensen, R., & Lemeshow, S. (2011). Comparison of Charlson comorbidity index with SAPS and APACHE scores for prediction of mortality following intensive care. Journal of Clinical Epidemiology, 3 , 203-211.
  7. Hwang, S. M., Yoon, S. J., Ahn, H. S., An, H. G., Kim, S. H., Kyeong, M. H., et al. (2009). Usefulness of comorbidity indices in operative gastric cancer cases. Journal of Preventive Medicine and Public Health, 42 (1), 49-58. https://doi.org/10.3961/jpmph.2009.42.1.49
  8. Iezzoni, L. I. (1997). Risk adjustment for measuring healthcare outcomes (2nd ed.). Chicago: Health Administrative Press.
  9. Johnson, J. A. (2012). FDA regulation of medical devices. Washington DC: Congressional Research Service.
  10. Kim, H. J., & Kim, K. H. (2011). Verification of validity of MPM II for neurological patients in intensive care units. Journal of Korean Academy of Nursing, 41 (1), 92-100. https://doi.org/10.4040/jkan.2011.41.1.92
  11. Kim, S. D., Min, S. W., Son, J. T., & Kim, D. O. (1989). An evaluation of therapeutic intervention scoring system (TISS) in critically ill pediatric patients. Korean Journal of Anesthesiology, 22 (2), 284-290. https://doi.org/10.4097/kjae.1989.22.2.284
  12. Kim, Y. S., & Yoo, Y. S. (2005). The APACHE III score and multiple organ failure (MOF) score in patients who were recipients of decision-making do-not-resuscitate. Korean Journal of Adult Nursing, 17 (5), 762-771.
  13. Knaus, W. A., Wagner, D. P., Draper, E. A., Russo, M., Bergner, M., Shortell, S. M., et al. (1989). The APACHE III study design: analytic plan for evaluation of severity and outcome. Critical Care Medicine, 17 , S169-221.
  14. Knaus, W. A., Wagner, D. P., Draper, E. A., Zimmerman, J. E., Bergner, M., Bastos, P. G., et al. (1991). The APACHE III prognostic system: risk prediction of hospital mortality for critically ill hospitalized adults. Chest, 100 (6), 1619-1636. https://doi.org/10.1378/chest.100.6.1619
  15. Lee, H. S. (1989). Korea grand dictionary (3rd ed.). Seoul: Minjung Seorim.
  16. Lim, J. H., & Park, J. Y. (2011). The impact of comorbidity (the Charlson comorbidity index) on the health outcomes of patients with the acute myocardial infarction (AMI). Korean Journal of Health Policy and Administration, 21 (4), 541-564. https://doi.org/10.4332/KJHPA.2011.21.4.541
  17. Shwartz, M., Iezzoni, L. I., Moskowitz, M. A., Ash, A. S., & Sawitz, E. (1996). The importance of comorbidities in explaining differences in patient costs. Medical Care, 34 (8), 767-782. https://doi.org/10.1097/00005650-199608000-00005
  18. Somme, D., Maillet, J. M., Gisselbrecht, M., Novara, A., Ract, C., & Fagon, J. Y. (2003). Critically ill old and the oldest-old patients in intensive care: short-and long-term outcomes. Intensive Care Medicine, 29 (12), 2137-2143. https://doi.org/10.1007/s00134-003-1929-2
  19. Sundararajan, V., Henderson, T., Perry, C., Muggivan, A., Quan, H., & Ghali, W. A. (2004). New ICD-10 version of the charlson comorbidity index predicted in-hospital mortality. Journal of Clinical Epidemiology, 57 (12), 1288-1294. https://doi.org/10.1016/j.jclinepi.2004.03.012
  20. You, Y. Y., Min, Y. G., Ahn, J. H., Choi, S. C., Shin, Y. H., Jung, Y. S., et al. (2011). Prediction of mortality in patients with acute paraquat intoxication using simplified acute physiology score II. The Korean Journal of Critical Care Medicine, 26 (4), 221-225. https://doi.org/10.4266/kjccm.2011.26.4.221