Browse > Article
http://dx.doi.org/10.4040/jkan.20233

Cut-Off Values of the Post-Intensive Care Syndrome Questionnaire for the Screening of Unplanned Hospital Readmission within One Year  

Kang, Jiyeon (College of Nursing, Dong-A University)
Jeong, Yeon Jin (Department of Nursing, Dongju College)
Hong, Jiwon (College of Nursing, Dong-A University)
Publication Information
Journal of Korean Academy of Nursing / v.50, no.6, 2020 , pp. 787-798 More about this Journal
Abstract
Purpose: This study aimed to assign weights for subscales and items of the Post-Intensive Care Syndrome questionnaire and suggest optimal cut-off values for screening unplanned hospital readmissions of critical care survivors. Methods: Seventeen experts participated in an analytic hierarchy process for weight assignment. Participants for cut-off analysis were 240 survivors who had been admitted to intensive care units for more than 48 hours in three cities in Korea. We assessed participants using the 18-item Post-Intensive Care Syndrome questionnaire, generated receiver operating characteristic curves, and analysed cut-off values for unplanned readmission based on sensitivity, specificity, and positive likelihood ratios. Results: Cognitive, physical, and mental subscale weights were 1.13, 0.95, and 0.92, respectively. Incidence of unplanned readmission was 25.4%. Optimal cut-off values were 23.00 for raw scores and 23.73 for weighted scores (total score 54.00), with an area of under the curve (AUC) of .933 and .929, respectively. There was no significant difference in accuracy for original and weighted scores. Conclusion: The optimal cut-off value accuracy is excellent for screening of unplanned readmissions. We recommend that nurses use the Post-Intensive Care Syndrome Questionnaire to screen for readmission risk or evaluating relevant interventions for critical care survivors.
Keywords
Intensive Care Unit; Patient Readmission; Reproducibility of Results; ROC Curve; Survivor;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Fischer JE, Bachmann LM, Jaeschke R. A readers' guide to the interpretation of diagnostic test properties: Clinical example of sepsis. Intensive Care Medicine. 2003;29(7):1043-1051. https://doi.org/10.1007/s00134-003-1761-8   DOI
2 Dollaghan CA, Horner EA. Bilingual language assessment: A meta-analysis of diagnostic accuracy. Journal of Speech, Language, and Hearing Research. 2011;54(4):1077-1088. https://doi.org/10.1044/1092-4388(2010/10-0093)   DOI
3 Leal JE. AHP-express: A simplified version of the analytical hierarchy process method. MethodsX. 2020;7:100748. https://doi.org/10.1016/j.mex.2019.11.021   DOI
4 Harvey MA, Davidson JE. Postintensive care syndrome: Right care, right now...and later. Critical Care Medicine. 2016;44(2):381-385. https://doi.org/10.1097/CCM.0000000000001531   DOI
5 Iwashyna TJ, Ely EW, Smith DM, Langa KM. Long-term cognitive impairment and functional disability among survivors of severe sepsis. JAMA. 2010;304(16):1787-1794. https://doi.org/10.1001/jama.2010.1553   DOI
6 Marra A, Pandharipande PP, Girard TD, Patel MB, Hughes CG, Jackson JC, et al. Co-occurrence of post-intensive care syndrome problems among 406 survivors of critical illness. Critical Care Medicine. 2018;46(9):1393-1401. https://doi.org/10.1097/CCM.0000000000003218   DOI
7 Schulte PJ, Warner DO, Martin DP, Deljou A, Mielke MM, Knopman DS, et al. Association between critical care admissions and cognitive trajectories in older adults. Critical Care Medicine. 2019;47(8):1116-1124. https://doi.org/10.1097/CCM.0000000000003829   DOI
8 Marra A, Ely EW, Pandharipande PP, Patel MB. The ABCDEF bundle in critical care. Critical Care Clinics. 2017;33(2):225-243. https://doi.org/10.1016/j.ccc.2016.12.005   DOI
9 Trevethan R. Sensitivity, specificity, and predictive values: Foundations, pliabilities, and pitfalls in research and practice. Frontiers in Public Health. 2017;5:307. https://doi.org/10.3389/fpubh.2017.00307   DOI
10 Devlin JW, Skrobik Y, Gélinas C, Needham DM, Slooter AJC, Pandharipande PP, et al. Clinical practice guidelines for the prevention and management of pain, agitation/sedation, delirium, immobility, and sleep disruption in adult patients in the ICU. Critical Care Medicine. 2018;46(9):e825-e873. https://doi.org/10.1097/CCM.0000000000003299   DOI
11 Williams TA, Knuiman MW, Finn JC, Ho KM, Dobb GJ, Webb SA. Effect of an episode of critical illness on subsequent hospitalisation: A linked data study. Anaesthesia. 2010;65(2):172-177. https://doi.org/10.1111/j.1365-2044.2009.06206.x   DOI
12 Fan E, Dowdy DW, Colantuoni E, Mendez-Tellez PA, Sevransky JE, Shanholtz C, et al. Physical complications in acute lung injury survivors: A two-year longitudinal prospective study. Critical Care Medicine. 2014;42(4):849-859. https://doi.org/10.1097/CCM.0000000000000040   DOI
13 Kang J, Jeong YJ. Embracing the new vulnerable self: A grounded theory approach on critical care survivors' post-intensive care syndrome. Intensive and Critical Care Nursing. 2018;49:44-50. https://doi.org/10.1016/j.iccn.2018.08.004   DOI
14 Lasiter S, Oles SK, Mundell J, London S, Khan B. Critical care follow-up clinics: A scoping review of interventions and outcomes. Clinical Nurse Specialist CNS. 2016;30(4):227-237. https://doi.org/10.1097/NUR.0000000000000219   DOI
15 Sevin CM, Bloom SL, Jackson JC, Wang L, Ely EW, Stollings JL. Comprehensive care of ICU survivors: Development and implementation of an ICU recovery center. Journal of Critical Care. 2018;46:141-148. https://doi.org/10.1016/j.jcrc.2018.02.011   DOI
16 Blackwood B, Clarke M, McAuley DF, McGuigan PJ, Marshall JC, Rose L. How outcomes are defined in clinical trials of mechanically ventilated adults and children. American Journal of Respiratory and Critical Care Medicine. 2014;189(8):886-893. https://doi.org/10.1164/rccm.201309-1645PP   DOI
17 Needham DM, Davidson J, Cohen H, Hopkins RO, Weinert C, Wunsch H, et al. Improving long-term outcomes after discharge from intensive care unit: Report from a stakeholders' conference. Critical Care Medicine. 2012;40(2):502-509. https://doi.org/10.1097/CCM.0b013e318232da75   DOI
18 Inoue S, Hatakeyama J, Kondo Y, Hifumi T, Sakuramoto H, Kawasaki T, et al. Post-intensive care syndrome: Its pathophysiology, prevention, and future directions. Acute Medicine & Surgery. 2019;6(3):233-246. https://doi.org/10.1002/ams2.415   DOI
19 Hua M, Gong MN, Brady J, Wunsch H. Early and late unplanned rehospitalizations for survivors of critical illness. Critical Care Medicine. 2015;43(2):430-438. https://doi.org/10.1097/CCM.0000000000000717   DOI
20 Mikkelsen ME, Netzer G, Iwashyna T. Post-intensive care syndrome (PICS) [Internet]. Waltham (MA): UpToDate, Inc; c2019 [cited 2020 Nov 16]. Available from: http://www.uptodate.com/contents/post-intensive-care-syndrome-pics.
21 Needham DM. Understanding and improving clinical trial outcome measures in acute respiratory failure. American Journal of Respiratory and Critical Care Medicine. 2014;189(8):875-877. https://doi.org/10.1164/rccm.201402-0362ED   DOI
22 Turnbull AE, Rabiee A, Davis WE, Nasser MF, Venna VR, Lolitha R, et al. Outcome measurement in ICU survivorship research from 1970 to 2013: A scoping review of 425 publications. Critical Care Medicine. 2016;44(7):1267-1277. https://doi.org/10.1097/CCM.0000000000001651   DOI
23 Needham DM, Sepulveda KA, Dinglas VD, Chessare CM, Friedman LA, Bingham CO 3rd, et al. Core outcome measures for clinical research in acute respiratory failure survivors. An international modified Delphi consensus study. American Journal of Respiratory and Critical Care Medicine. 2017;196(9):1122-1130. https://doi.org/10.1164/rccm.201702-0372OC   DOI
24 Jeong YJ, Kang J. Development and validation of a questionnaire to measure post-intensive care syndrome. Intensive and Critical Care Nursing. 2019;55:102756. https://doi.org/10.1016/j.iccn.2019.102756   DOI
25 Kress JP, Hall JB. ICU-acquired weakness and recovery from critical illness. New England Journal of Medicine. 2014;370(17):1626-1635. https://doi.org/10.1056/NEJMra1209390   DOI
26 Lone NI, Seretny M, Wild SH, Rowan KM, Murray GD, Walsh TS. Surviving intensive care: A systematic review of healthcare resource use after hospital discharge. Critical Care Medicine. 2013;41(8):1832-1843. https://doi.org/10.1097/CCM.0b013e31828a409c   DOI
27 Iwashyna TJ. Trajectories of recovery and dysfunction after acute illness, with implications for clinical trial design. American Journal of Respiratory and Critical Care Medicine. 2012;186(4):302-304. https://doi.org/10.1164/rccm.201206-1138ED   DOI
28 Kosilek RP, Baumeister SE, Ittermann T, Gründling M, Brunkhorst FM, Felix SB, et al. The association of intensive care with utilization and costs of outpatient healthcare services and quality of life. PloS One. 2019;14(9):e0222671. https://doi.org/10.1371/journal.pone.0222671   DOI
29 Lone NI, Gillies MA, Haddow C, Dobbie R, Rowan KM, Wild SH, et al. Five-year mortality and hospital costs associated with surviving intensive care. American Journal of Respiratory and Critical Care Medicine. 2016;194(2):198-208. https://doi.org/10.1164/rccm.201511-2234OC   DOI
30 Fischer C, Lingsma HF, Marang-van de Mheen PJ, Kringos DS, Klazinga NS, Steyerberg EW. Is the readmission rate a valid quality indicator? A review of the evidence. PloS One. 2014;9(11):e112282. https://doi.org/10.1371/journal.pone.0112282   DOI
31 Donaghy E, Salisbury L, Lone NI, Lee R, Ramsey P, Rattray JE, et al. Unplanned early hospital readmission among critical care survivors: A mixed methods study of patients and carers. BMJ Quality & Safety. 2018;27(11):915-927. https://doi.org/10.1136/bmjqs-2017-007513   DOI
32 Brown SM, Bose S, Banner-Goodspeed V, Beesley SJ, Dinglas VD, Hopkins RO, et al. Approaches to addressing post-intensive care syndrome among intensive care unit survivors. A narrative review. Annals of the American Thoracic Society. 2019;16(8):947-956. https://doi.org/10.1513/AnnalsATS.201812-913FR   DOI
33 Dolan JG. Shared decision-making-transferring research into practice: The Analytic Hierarchy Process (AHP). Patient Education and Counseling. 2008;73(3):418-425. https://doi.org/10.1016/j.pec.2008.07.032   DOI
34 Koksalmis E, Kabak O. Deriving decision makers' weights in group decision making: An overview of objective methods. Information Fusion. 2019;49:146-160. https://doi.org/10.1016/j.inffus.2018.11.009   DOI
35 Schmidt K, Aumann I, Hollander I, Damm K, von der Schulenburg JM. Applying the Analytic Hierarchy Process in healthcare research: A systematic literature review and evaluation of reporting. BMC Medical Informatics and Decision Making. 2015;15:112. https://doi.org/10.1186/s12911-015-0234-7   DOI
36 Saaty TL. Decision making with the analytic hierarchy process. International Journal of Services Sciences. 2008;1(1):83-98.   DOI
37 Waris M, Panigrahi S, Mengal A, Soomro MI, Mirjat NH, Ullah M, et al. An application of analytic hierarchy process (AHP) for sustainable procurement of construction equipment: Multicriteria-based decision framework for Malaysia. Mathematical Problems in Engineering. 2019;2019:6391431. https://doi.org/10.1155/2019/6391431   DOI
38 Chen L, Chan CM, Lee HC, Chung Y, Lai F. Development of a decision support engine to assist patients with hospital selection. Journal of Medical Systems. 2014;38(6):59. https://doi.org/10.1007/s10916-014-0059-4   DOI
39 Song SW. Using the receiver operating characteristic (ROC) curve to measure sensitivity and specificity. Korean Journal of Family Medicine. 2009;30(11):841-842. https://doi.org/10.4082/kjfm.2009.30.11.841   DOI
40 Simundic AM. Measures of diagnostic accuracy: Basic definitions. EJIFCC. 2009;19(4):203-211.