Journal of Korean Academy of Nursing (대한간호학회지)

Korean Society of Nursing Science (한국간호과학회)
권호 표지
DOI QR코드

DOI QR Code

Cut-Off Values of the Post-Intensive Care Syndrome Questionnaire for the Screening of Unplanned Hospital Readmission within One Year

  • Received : 2020.09.24
  • Accepted : 2020.11.30
  • Published : 2020.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Purpose: This study aimed to assign weights for subscales and items of the Post-Intensive Care Syndrome questionnaire and suggest optimal cut-off values for screening unplanned hospital readmissions of critical care survivors. Methods: Seventeen experts participated in an analytic hierarchy process for weight assignment. Participants for cut-off analysis were 240 survivors who had been admitted to intensive care units for more than 48 hours in three cities in Korea. We assessed participants using the 18-item Post-Intensive Care Syndrome questionnaire, generated receiver operating characteristic curves, and analysed cut-off values for unplanned readmission based on sensitivity, specificity, and positive likelihood ratios. Results: Cognitive, physical, and mental subscale weights were 1.13, 0.95, and 0.92, respectively. Incidence of unplanned readmission was 25.4%. Optimal cut-off values were 23.00 for raw scores and 23.73 for weighted scores (total score 54.00), with an area of under the curve (AUC) of .933 and .929, respectively. There was no significant difference in accuracy for original and weighted scores. Conclusion: The optimal cut-off value accuracy is excellent for screening of unplanned readmissions. We recommend that nurses use the Post-Intensive Care Syndrome Questionnaire to screen for readmission risk or evaluating relevant interventions for critical care survivors.

Keywords

References

  1. Kress JP, Hall JB. ICU-acquired weakness and recovery from critical illness. New England Journal of Medicine. 2014;370(17):1626-1635. https://doi.org/10.1056/NEJMra1209390
  2. Iwashyna TJ. Trajectories of recovery and dysfunction after acute illness, with implications for clinical trial design. American Journal of Respiratory and Critical Care Medicine. 2012;186(4):302-304. https://doi.org/10.1164/rccm.201206-1138ED
  3. Needham DM, Davidson J, Cohen H, Hopkins RO, Weinert C, Wunsch H, et al. Improving long-term outcomes after discharge from intensive care unit: Report from a stakeholders' conference. Critical Care Medicine. 2012;40(2):502-509. https://doi.org/10.1097/CCM.0b013e318232da75
  4. Mikkelsen ME, Netzer G, Iwashyna T. Post-intensive care syndrome (PICS) [Internet]. Waltham (MA): UpToDate, Inc; c2019 [cited 2020 Nov 16]. Available from: http://www.uptodate.com/contents/post-intensive-care-syndrome-pics.
  5. Blackwood B, Clarke M, McAuley DF, McGuigan PJ, Marshall JC, Rose L. How outcomes are defined in clinical trials of mechanically ventilated adults and children. American Journal of Respiratory and Critical Care Medicine. 2014;189(8):886-893. https://doi.org/10.1164/rccm.201309-1645PP
  6. Needham DM. Understanding and improving clinical trial outcome measures in acute respiratory failure. American Journal of Respiratory and Critical Care Medicine. 2014;189(8):875-877. https://doi.org/10.1164/rccm.201402-0362ED
  7. Turnbull AE, Rabiee A, Davis WE, Nasser MF, Venna VR, Lolitha R, et al. Outcome measurement in ICU survivorship research from 1970 to 2013: A scoping review of 425 publications. Critical Care Medicine. 2016;44(7):1267-1277. https://doi.org/10.1097/CCM.0000000000001651
  8. Needham DM, Sepulveda KA, Dinglas VD, Chessare CM, Friedman LA, Bingham CO 3rd, et al. Core outcome measures for clinical research in acute respiratory failure survivors. An international modified Delphi consensus study. American Journal of Respiratory and Critical Care Medicine. 2017;196(9):1122-1130. https://doi.org/10.1164/rccm.201702-0372OC
  9. Jeong YJ, Kang J. Development and validation of a questionnaire to measure post-intensive care syndrome. Intensive and Critical Care Nursing. 2019;55:102756. https://doi.org/10.1016/j.iccn.2019.102756
  10. Kosilek RP, Baumeister SE, Ittermann T, Gründling M, Brunkhorst FM, Felix SB, et al. The association of intensive care with utilization and costs of outpatient healthcare services and quality of life. PloS One. 2019;14(9):e0222671. https://doi.org/10.1371/journal.pone.0222671
  11. Lone NI, Gillies MA, Haddow C, Dobbie R, Rowan KM, Wild SH, et al. Five-year mortality and hospital costs associated with surviving intensive care. American Journal of Respiratory and Critical Care Medicine. 2016;194(2):198-208. https://doi.org/10.1164/rccm.201511-2234OC
  12. Fischer C, Lingsma HF, Marang-van de Mheen PJ, Kringos DS, Klazinga NS, Steyerberg EW. Is the readmission rate a valid quality indicator? A review of the evidence. PloS One. 2014;9(11):e112282. https://doi.org/10.1371/journal.pone.0112282
  13. Lone NI, Seretny M, Wild SH, Rowan KM, Murray GD, Walsh TS. Surviving intensive care: A systematic review of healthcare resource use after hospital discharge. Critical Care Medicine. 2013;41(8):1832-1843. https://doi.org/10.1097/CCM.0b013e31828a409c
  14. Donaghy E, Salisbury L, Lone NI, Lee R, Ramsey P, Rattray JE, et al. Unplanned early hospital readmission among critical care survivors: A mixed methods study of patients and carers. BMJ Quality & Safety. 2018;27(11):915-927. https://doi.org/10.1136/bmjqs-2017-007513
  15. Brown SM, Bose S, Banner-Goodspeed V, Beesley SJ, Dinglas VD, Hopkins RO, et al. Approaches to addressing post-intensive care syndrome among intensive care unit survivors. A narrative review. Annals of the American Thoracic Society. 2019;16(8):947-956. https://doi.org/10.1513/AnnalsATS.201812-913FR
  16. Koksalmis E, Kabak O. Deriving decision makers' weights in group decision making: An overview of objective methods. Information Fusion. 2019;49:146-160. https://doi.org/10.1016/j.inffus.2018.11.009
  17. Schmidt K, Aumann I, Hollander I, Damm K, von der Schulenburg JM. Applying the Analytic Hierarchy Process in healthcare research: A systematic literature review and evaluation of reporting. BMC Medical Informatics and Decision Making. 2015;15:112. https://doi.org/10.1186/s12911-015-0234-7
  18. Saaty TL. Decision making with the analytic hierarchy process. International Journal of Services Sciences. 2008;1(1):83-98. https://doi.org/10.1504/IJSSCI.2008.017590
  19. Waris M, Panigrahi S, Mengal A, Soomro MI, Mirjat NH, Ullah M, et al. An application of analytic hierarchy process (AHP) for sustainable procurement of construction equipment: Multicriteria-based decision framework for Malaysia. Mathematical Problems in Engineering. 2019;2019:6391431. https://doi.org/10.1155/2019/6391431
  20. Chen L, Chan CM, Lee HC, Chung Y, Lai F. Development of a decision support engine to assist patients with hospital selection. Journal of Medical Systems. 2014;38(6):59. https://doi.org/10.1007/s10916-014-0059-4
  21. Dolan JG. Shared decision-making-transferring research into practice: The Analytic Hierarchy Process (AHP). Patient Education and Counseling. 2008;73(3):418-425. https://doi.org/10.1016/j.pec.2008.07.032
  22. Song SW. Using the receiver operating characteristic (ROC) curve to measure sensitivity and specificity. Korean Journal of Family Medicine. 2009;30(11):841-842. https://doi.org/10.4082/kjfm.2009.30.11.841
  23. Simundic AM. Measures of diagnostic accuracy: Basic definitions. EJIFCC. 2009;19(4):203-211.
  24. Fischer JE, Bachmann LM, Jaeschke R. A readers' guide to the interpretation of diagnostic test properties: Clinical example of sepsis. Intensive Care Medicine. 2003;29(7):1043-1051. https://doi.org/10.1007/s00134-003-1761-8
  25. Dollaghan CA, Horner EA. Bilingual language assessment: A meta-analysis of diagnostic accuracy. Journal of Speech, Language, and Hearing Research. 2011;54(4):1077-1088. https://doi.org/10.1044/1092-4388(2010/10-0093)
  26. Leal JE. AHP-express: A simplified version of the analytical hierarchy process method. MethodsX. 2020;7:100748. https://doi.org/10.1016/j.mex.2019.11.021
  27. Harvey MA, Davidson JE. Postintensive care syndrome: Right care, right now...and later. Critical Care Medicine. 2016;44(2):381-385. https://doi.org/10.1097/CCM.0000000000001531
  28. Iwashyna TJ, Ely EW, Smith DM, Langa KM. Long-term cognitive impairment and functional disability among survivors of severe sepsis. JAMA. 2010;304(16):1787-1794. https://doi.org/10.1001/jama.2010.1553
  29. Marra A, Pandharipande PP, Girard TD, Patel MB, Hughes CG, Jackson JC, et al. Co-occurrence of post-intensive care syndrome problems among 406 survivors of critical illness. Critical Care Medicine. 2018;46(9):1393-1401. https://doi.org/10.1097/CCM.0000000000003218
  30. Schulte PJ, Warner DO, Martin DP, Deljou A, Mielke MM, Knopman DS, et al. Association between critical care admissions and cognitive trajectories in older adults. Critical Care Medicine. 2019;47(8):1116-1124. https://doi.org/10.1097/CCM.0000000000003829
  31. Marra A, Ely EW, Pandharipande PP, Patel MB. The ABCDEF bundle in critical care. Critical Care Clinics. 2017;33(2):225-243. https://doi.org/10.1016/j.ccc.2016.12.005
  32. Devlin JW, Skrobik Y, Gélinas C, Needham DM, Slooter AJC, Pandharipande PP, et al. Clinical practice guidelines for the prevention and management of pain, agitation/sedation, delirium, immobility, and sleep disruption in adult patients in the ICU. Critical Care Medicine. 2018;46(9):e825-e873. https://doi.org/10.1097/CCM.0000000000003299
  33. Trevethan R. Sensitivity, specificity, and predictive values: Foundations, pliabilities, and pitfalls in research and practice. Frontiers in Public Health. 2017;5:307. https://doi.org/10.3389/fpubh.2017.00307
  34. Williams TA, Knuiman MW, Finn JC, Ho KM, Dobb GJ, Webb SA. Effect of an episode of critical illness on subsequent hospitalisation: A linked data study. Anaesthesia. 2010;65(2):172-177. https://doi.org/10.1111/j.1365-2044.2009.06206.x
  35. Fan E, Dowdy DW, Colantuoni E, Mendez-Tellez PA, Sevransky JE, Shanholtz C, et al. Physical complications in acute lung injury survivors: A two-year longitudinal prospective study. Critical Care Medicine. 2014;42(4):849-859. https://doi.org/10.1097/CCM.0000000000000040
  36. Kang J, Jeong YJ. Embracing the new vulnerable self: A grounded theory approach on critical care survivors' post-intensive care syndrome. Intensive and Critical Care Nursing. 2018;49:44-50. https://doi.org/10.1016/j.iccn.2018.08.004
  37. Lasiter S, Oles SK, Mundell J, London S, Khan B. Critical care follow-up clinics: A scoping review of interventions and outcomes. Clinical Nurse Specialist CNS. 2016;30(4):227-237. https://doi.org/10.1097/NUR.0000000000000219
  38. Sevin CM, Bloom SL, Jackson JC, Wang L, Ely EW, Stollings JL. Comprehensive care of ICU survivors: Development and implementation of an ICU recovery center. Journal of Critical Care. 2018;46:141-148. https://doi.org/10.1016/j.jcrc.2018.02.011
  39. Inoue S, Hatakeyama J, Kondo Y, Hifumi T, Sakuramoto H, Kawasaki T, et al. Post-intensive care syndrome: Its pathophysiology, prevention, and future directions. Acute Medicine & Surgery. 2019;6(3):233-246. https://doi.org/10.1002/ams2.415
  40. Hua M, Gong MN, Brady J, Wunsch H. Early and late unplanned rehospitalizations for survivors of critical illness. Critical Care Medicine. 2015;43(2):430-438. https://doi.org/10.1097/CCM.0000000000000717