DOI QR코드

DOI QR Code

An Analytic Framework to Assess Organizational Resilience

  • Patriarca, Riccardo (Department of Mechanical and Aerospace Engineering, Sapienza University of Rome) ;
  • Di Gravio, Giulio (Department of Mechanical and Aerospace Engineering, Sapienza University of Rome) ;
  • Costantino, Francesco (Department of Mechanical and Aerospace Engineering, Sapienza University of Rome) ;
  • Falegnami, Andrea (Department of Mechanical and Aerospace Engineering, Sapienza University of Rome) ;
  • Bilotta, Federico (Department of Anesthesiology, Critical Care and Pain Medicine, Sapienza University of Rome)
  • Received : 2017.04.14
  • Accepted : 2017.10.24
  • Published : 2018.09.30

Abstract

Background: Resilience engineering is a paradigm for safety management that focuses on coping with complexity to achieve success, even considering several conflicting goals. Modern sociotechnical systems have to be resilient to comply with the variability of everyday activities, the tight-coupled and under-specified nature of work, and the nonlinear interactions among agents. At organizational level, resilience can be described as a combination of four cornerstones: monitoring, responding, learning, and anticipating. Methods: Starting from these four categories, this article aims at defining a semiquantitative analytic framework to measure organizational resilience in complex sociotechnical systems, combining the resilience analysis grid and the analytic hierarchy process. Results: This article presents an approach for defining resilience abilities of an organization, creating a structured domain-dependent framework to define a resilience profile at different levels of abstraction, and identifying weaknesses and strengths of the system and potential actions to increase system's adaptive capacity. An illustrative example in an anesthesia department clarifies the outcomes of the approach. Conclusion: The outcome of the resilience analysis grid, i.e., a weighed set of probing questions, can be used in different domains, as a support tool in a wider Safety-II oriented managerial action to bring safety management into the core business of the organization.

Keywords

References

  1. Trist EL, Bamforth KW. Some social and psychological consequences of the Longwall method of coal-getting: an examination of the psychological situation and defences of a work group in relation to the social structure and technological content of the work system. Hum Relat 1951;4:3-38. https://doi.org/10.1177/001872675100400101.
  2. Walker G. Come back sociotechnical systems theory, all is forgiven. Civ Eng Environ Syst 2015;32:170-9. https://doi.org/10.1080/10286608.2015.1024112.
  3. Pincetl S, Chester M, Eisenman D. Urban heat stress vulnerability in the U.S. Southwest: the role of sociotechnical systems. Sustainability 2016;8:1-13. https://doi.org/10.3390/su8090842.
  4. Westbrook JI, Braithwaite J, Georgiou A, Ampt A, Creswick N, Coiera E, Iedema R. Multimethod evaluation of information and communication technologies in health in the context of wicked problems and sociotechnical theory. J Am Med Inform Assoc 2007;14:746-55. https://doi.org/10.1197/jamia.M2462.
  5. Pasmore W, Francis C, Haldeman J. Sociotechnical systems: a North American reflection on empirical studies of the seventies. Hum Relat 1982;35:1179-204. https://doi.org/10.1177/001872678203501207.
  6. Dekker S. Patient safety - a human factor approach. Boca Raton (FL): CRC Press - Taylor & Francis Group; 2011.
  7. Hollnagel E. Safety-I and safety-II (the past and future of safety management). Farnham (UK): Ashgate; 2014.
  8. Patriarca R, Di Gravio G, Costantino F. A Monte Carlo evolution of the Functional Resonance Analysis Method (FRAM) to assess performance variability in complex systems. Saf Sci 2017;91:49-60. https://doi.org/10.1016/j.ssci.2016.07.016.
  9. Ferreira PNP, Balfe N. Lect Notes Comput Sci (Including Subser Lect Notes Artif Intell Lect Notes Bioinformatics). The contribution of automation to resilience in rail traffic control, 8532 LNAI; 2014. p. 458-69. https://doi.org/10.1007/978-3-319-07515-0_46.
  10. Hollnagel E, Fujita Y. The Fukushima disaster-systemic failures as the lack of resilience. Nucl Eng Technol 2013;45:13-20. https://doi.org/10.5516/NET.03.2011.078.
  11. Amalberti R. Resilience and safety in health care: marriage or divorce? In: Hollnagel E, Braithwaite J, Wears RL, editors. Resilient Heal. Care 2013. p. 27-38.
  12. McDonald N. Organisational resilience and industrial risk. In: Hollnagel E, Woods DD, Leveson N, editors. Resil. Eng. Concepts Precepts. Ashgate Publishing, Ltd; 2006. p. 155-80.
  13. Patterson M, Deutsch ES. Safety-I, Safety-II and resilience engineering. Curr Probl Pediatr Adolesc Health Care 2015;45:382-9. https://doi.org/10.1016/j.cppeds.2015.10.001.
  14. Hollnagel E. Prologue: the scope of resilience engineering. In: Hollnagel E, Paries J, Woods DD, Wreathall J, editors. Resil. Eng. Pract. A Guideb., MINES ParisTech. France: Ashgate Publishing, Ltd; 2011 p. xxix-xxxix.
  15. Woods DD. Essential characteristics of resilience. In: Hollnagel E, Woods DD, Leveson N, editors. Resil. Eng. Concepts Precepts. Ashgate Publishing, Ltd; 2006. p. 21-34.
  16. Dekker S. Resilience engineering: chronicling the emergence of confused consensus. In: Hollnagel E, Woods DD, Leveson N, editors. Resil. Eng. Concepts Precepts. Ashgate Publishing, Ltd; 2006. p. 77-94.
  17. Nemeth CP. Resilience engineering: the birth of a notion. In: Hollnagel E, Nemeth CP, Dekker S, editors. Resil. Eng. Perspect. Vol. 1-Remain. Sensitive to Possibility Fail. Ashgate Publishing, Ltd; 2008. p. 3-10.
  18. Rankin A, Lundberg J, Woltjer R. A framework for learning from adaptive performance. In: Nemeth CP, Hollnagel E, editors. Becom. Resilient. Ashgate Publishing, Ltd; 2014. p. 79-96.
  19. Praetorius G, Hollnagel E. Control and resilience within the maritime traffic management domain. J Cogn Eng Decis Mak 2014;8:303-17. https://doi.org/10.1177/1555343414560022.
  20. Becker P, Abrahamsson M, Tehler H. An emergent means to assurgent ends: societal resilience for safety and sustainability. In: Nemeth CP, Hollnagel E, editors. Becom. Resilient. Ashgate Publishing, Ltd; 2014. p. 1-12.
  21. Herrera IA, Pasquini A, Ragosta M, Vennesland A. The SCALES framework for identifying and extracting resilience related indicators: preliminary findings of a go-around case study. SIDs 2014-Proc. SESAR Innov. Days, EUROCONTROL; 2014.
  22. Van Der Beek D, Schraagen JM. ADAPTER: analysing and developing adaptability and performance in teams to enhance resilience. Reliab Eng Syst Saf 2015:141. https://doi.org/10.1016/j.ress.2015.03.019.
  23. Paries J. Lessons from the hudson. In: Hollnagel E, Paries J, Woods DD, Wreathall J, editors. Resil. Eng. Pract. A Guideb. Ashgate Publishing, Ltd; 2011. p. 9-28.
  24. Cuvelier L, Falzon P. Coping with uncertainty. Resilient Decis Anaesth 2011.
  25. Wears RL, Perry S, McFauls A. " Free Fall " - a case study of resilience, its degradation, and recovery in an emergency department. In: Proc Second Resil Eng Symp Novemb 2006 Sophia-Antip [Online] 2006. p. 8-10.
  26. Nemeth C, Wears R, Woods D, Hollnagel E, Cook R. Minding the gaps: creating resilience in health care. In: Henriksen K, Battles JB, Keyes MA, Grady ML, editors. Advances in Patient Safety: New Directions and Alternative Approaches (Vol. 3: Performance and Tools). Rockville (MD): Agency for Healthcare Research and Quality (US); 2008.
  27. Wachs P, Saurin TA, Righi AW, Wears RL. Resilience skills as emergent phenomena: a study of emergency departments in Brazil and the United States. Appl Ergon 2016. https://doi.org/10.1016/j.apergo.2016.02.012.
  28. Valdez Banda OA, Goerlandt F, Montewka J, Kujala P. A risk analysis of winter navigation in Finnish sea areas. Accid Anal Prev 2015;79:100-16. https://doi.org/10.1016/j.aap.2015.03.024.
  29. Di Gravio G, Mancini M, Patriarca R, Costantino F. Overall safety performance of the air traffic management system: indicators and analysis. J Air Transp Manag 2015;44-45:65-9. https://doi.org/10.1016/j.jairtraman.2015.02.005.
  30. Oien K, Massaiu S, Tinmannsvik RK, Storseth F. Development of early warning indicators based on Resilience Engineering. In: 10th Int. Conf. Probabilistic Saf. Assess. Manag. 2010, PSAM 2010, vol. 3; 2010.
  31. Wreathall J. Monitoring - a critical ability in resilience engineering. In: Resil Eng Pract A Guideb., Safety and Security in Work and Its Environment, Brazil 2011. p. 61-8.
  32. Di Gravio G, Mancini M, Patriarca R, Costantino F. Overall safety performance of air traffic management system: forecasting and monitoring. Saf Sci 2015;72:351-62. https://doi.org/10.1016/j.ssci.2014.10.003.
  33. Tjorhom B, Aase K. The art of balance: using upward resilience traits to deal with conflicting goals. In: Hollnagel E, Paries J, Woods DD, Wreathall J, editors. Resil. Eng. Pract. A Guideb. Ashgate Publishing, Ltd; 2011. p. 157-70.
  34. Wilson JR, Ryan B, Schock A, Ferreira P, Smith S, Pitsopoulos J. Understanding safety and production risks in rail engineering planning and protection. Ergonomics 2009:52. https://doi.org/10.1080/00140130802642211.
  35. Hollnagel E. To learn or not to learn, that is the question. In: Hollnagel E, Paries J, Woods DD, Wreathall J, editors. Resil. Eng. Pract. A Guideb. Ashgate Publishing, Ltd; 2011. p. 193-8.
  36. Weick KE. Educational organization as loosely couples systems. Adm Sci Q 1976;21:1-19. https://doi.org/10.2307/2391875
  37. Weick KE, Sutcliffe KM. Managing the unexpected: resilient performance in an age of uncertainty. John Wiley & Sons; 2011.
  38. Herrera IA, Nordskag AO, Myhre G, Halvorsen K. Aviation safety and maintenance under major organizational changes, investigating non-existing accidents. Accid Anal Prev 2009;41:1155-63. https://doi.org/10.1016/j.aap.2008.06.007.
  39. Woods DD, Sarter NB. Learning from automation surprises and "going sour" accidents: progress on human-centered automation. In: Sarter NB, Amalberti R, editors. Cogn. Eng. Aviat. Domain. Hillsdale (NJ): Erlbaum; 2000. p. 327-54.
  40. Wreathall J. Measuring resilience. In: Nemeth CP, Hollnagel E, Dekker S, editors. Resil. Eng. Perspect. Vol. 2 Prep. Restor. Ashgate Publishing, Ltd; 2009. p. 95-114.
  41. Hollnagel E. Epilogue: RAG - the resilience analysis grid. In: Hollnagel E, Paries J, Woods DD, Wreathall J, editors. Resil. Eng. Pract. A Guideb. Ashgate Publishing, Ltd; 2011. p. 275-96.
  42. Rigaud E, Martin C. Considering trade-offs when assessing resilience. In: Resil. Eng. Assoc. 4th Int. Symp. Soesterberg (The Netherlands): REA; 2013.
  43. Apneseth K, Wahl AM, Hollnagel E. Measuring resilience in integrated planning. In: Albrechtsen E, Besnard D, editors. Oil Gas, Technol. Humans Assess. Hum. Factors Technol. Chang. Norway: Health, Safety and Environment (HSE) Competence Centre, Statoil; 2013.
  44. Ljungberg D, Lundh V. Resilience engineering within ATM - development, adaption, and application of the resilience analysis grid (RAG). Norrkoping, Sweden; 2013.
  45. Hegde S, Hettinger AZ, Fairbanks RJ, Wreathall J, Wears RL, Bisantz AM. Knowledge elicitation for resilience engineering in health care. In: Proc. Hum. Factors Ergon. Soc., vol. 2015-Janua. Buffalo (NY), United States: Department of Industrial and Systems Engineering, University at Buffalo-SUNY; 2015. p. 175-9. https://doi.org/10.1177/1541931215591036.
  46. Pecillo M. The resilience engineering concept in enterprises with and without occupational safety and health management systems. Saf Sci 2016:82. https://doi.org/10.1016/j.ssci.2015.09.017.
  47. Branlat M, Woods DD. How do systems manage their adaptive capacity to successfully handle disruptions? A resilience engineering perspective. In: AAAI Fall Symp. - 2010.
  48. Grote G. Safety management in different high-risk domains - all the same? Saf Sci 2012:50. https://doi.org/10.1016/j.ssci.2011.07.017.
  49. Saaty TL. Decision making - the analytic hierarchy and network processes (AHP/ANP). J Syst Sci Syst Eng 2004;13:1-35. https://doi.org/10.1007/s11518-006-0151-5.
  50. De Felice F, Petrillo A. Proposal of a structured methodology for the measure of intangible criteria and for decision making. Int J Simul Process Model 2014;9:157. https://doi.org/10.1504/IJSPM.2014.064392.
  51. Patriarca R, Di Gravio G, Mancini M, Costantino F. Change management in the ATM system: integrating information in the preliminary system safety assessment. Int J Appl Decis Sci 2016;9:121-38. https://doi.org/10.1504/IJADS.2016.080123.
  52. Braithwaite J, Wears RL, Hollnagel E. Resilient health care: turning patient safety on its head. Int J Qual Heal Care 2015;27:418-20. https://doi.org/10.1093/intqhc/mzv063.
  53. Hernan AL, Giles SJ, Fuller J, Johnson JK, Walker C, Dunbar JA. Patient and carer identified factors which contribute to safety incidents in primary care: a qualitative study. BMJ Qual Saf 2015;24:583-93. https://doi.org/10.1136/bmjqs-2015-004049.
  54. Di Gravio G, Patriarca R, Mancini M, Costantino F. Overall safety performance of the air traffic management system: the Italian ANSP's experience on APF. Res Transp Bus Manag 2016;20:3-12. https://doi.org/10.1016/j.rtbm.2016.03.001.
  55. van der Vorm J, van der Beek D, Bos E, Steijger N, Gallis R. Images of resilience: the resilience analysis grid applicable at several organizational levels. In: 4th Resil. Eng. Assoc. Symp. 2011. p. 263-8.
  56. Bonzo SM, Mclain D, Avnet MS. Process modeling in the operating room: a socio-technical systems perspective. Syst Eng 2016;19:267-77. https://doi.org/10.1002/sys.
  57. Lawler EK, Hedge A, Pavlovic-Veselinovic S. International journal of industrial ergonomics cognitive ergonomics, socio-technical systems, and the impact of healthcare information technologies. Int J Ind Ergon 2011;41:336-44. https://doi.org/10.1016/j.ergon.2011.02.006.
  58. Hollnagel E. FRAM: the functional resonance analysis method - modelling complex socio-technical systems. Ashgate; 2012.
  59. Leveson N. A new accident model for engineering safer systems. Saf Sci 2004;42:237-70. https://doi.org/10.1016/S0925-7535(03)00047-X.

Cited by

  1. A new structure of sociotechnical system processes using resilience engineering vol.11, pp.None, 2019, https://doi.org/10.1177/1847979019827151
  2. Predictors of organizational resilience by factorial analysis vol.11, pp.None, 2019, https://doi.org/10.1177/1847979019837046
  3. Preliminary Human Safety Assessment (PHSA) for the Improvement of the Behavioral Aspects of Safety Climate in the Construction Industry vol.9, pp.3, 2018, https://doi.org/10.3390/buildings9030069
  4. Measurement of resilience potential - development of a resilience assessment grid for emergency departments vol.15, pp.9, 2020, https://doi.org/10.1371/journal.pone.0239472
  5. Hotels in contexts of uncertainty: Measuring organisational resilience vol.36, pp.None, 2020, https://doi.org/10.1016/j.tmp.2020.100747
  6. Measuring Resilience Potentials: A Pilot Program Using the Resilience Assessment Grid vol.6, pp.4, 2018, https://doi.org/10.3390/safety6040051
  7. Safety-II and Resilience Engineering in a Nutshell: An Introductory Guide to Their Concepts and Methods vol.12, pp.1, 2018, https://doi.org/10.1016/j.shaw.2020.11.004
  8. Analysis of the Safety Resilience Implementation in the Maritime Industry at Public and Private Companies (A Case Study in Indonesia) vol.7, pp.3, 2018, https://doi.org/10.3390/safety7030056
  9. Adaptive Resilience of Complex Safety-Critical Sociotechnical Systems: Toward a Unified Conceptual Framework and Its Formalization vol.13, pp.24, 2018, https://doi.org/10.3390/su132413915