Nuclear Engineering and Technology

Korean Nuclear Society (한국원자력학회)
권호 표지
DOI QR코드

DOI QR Code

Considerations for generating meaningful HRA data: Lessons learned from HuREX data collection

  • Kim, Yochan (Risk & Reliability Research Team, Korea Atomic Energy Research Institute)
  • Received : 2019.10.07
  • Accepted : 2020.01.31
  • Published : 2020.08.25
Download PDF
⟨ Previous Next ⟩

Abstract

To enhance the credibility of human reliability analysis, various kinds of data have been recently collected and analyzed. Although it is obvious that the quality of data is critical, the practices or considerations for securing data quality have not been sufficiently discussed. In this work, based on the experience of the recent human reliability data extraction projects, which produced more than fifty thousand data-points, we derive a number of issues to be considered for generating meaningful data. As a result, thirteen considerations are presented here as pertaining to the four different data extraction activities: preparation, collection, analysis, and application. Although the lessons were acquired from a single kind of data collection framework, it is believed that these results will guide researchers to consider important issues in the process of extracting data.

Keywords

References

  1. B. Kirwan, A Guide to Practical Human Reliability Assessment, Taylor & Francis, London, 1994.
  2. J. Bell, J. Holroyd, Review of Human Reliability Assessment Methods, Health and Safety Laboratory, United Kingdom, 2009.
  3. E. Hollnagel, Y. Fujita, The Fukushima disaster - systemic failures as the lack of resilience, Nucl. Eng. Technol. 45 (2013) 13-20. https://doi.org/10.5516/NET.03.2011.078
  4. E.M. Dougherty Jr., Human Reliability Analysis - where shouldst thou turn? Reliab. Eng. Syst. Saf. 29 (1990) 283-299. https://doi.org/10.1016/0951-8320(90)90012-C
  5. Y. Kim, J. Park, W. Jung, I. Jang, P.H. Seong, A statistical approach to estimating effects of performance shaping factors on human error probabilities of soft controls, Reliab. Eng. Syst. Saf. 142 (2015) 378-387. https://doi.org/10.1016/j.ress.2015.06.004
  6. B. Kirwan, G. Basra, S.E. Taylor-Adams, Core-data: a computerized human error database for human reliability support, in: Proceedings on IEEE Sixth Annual Human Factors Meeting, 1997.
  7. O. Strater, H. Bubb, Assessment of human reliability based on evaluation of plant experience: requirements and implementation, Reliab. Eng. Syst. Saf. 63 (1999) 199-219. https://doi.org/10.1016/S0951-8320(98)00047-7
  8. B. Hallbert, R. Boring, D. Gertman, D. Dudenhoeffer, A. Whaley, J. Marble, J. Joe, E. Lois, Human Event Repository and Analysis (HERA) System - Overview, NUREG/CR-6903, vol 1, US Nuclear Regulatory Commission, Washington DC, 2006.
  9. W. Preischl, M. Hellmich, Human error probabilities from operational experience of German nuclear power plants, Reliab. Eng. Syst. Saf. 109 (2013) 150-159. https://doi.org/10.1016/j.ress.2012.08.004
  10. US Nuclear Regulatory Commission, The International HRA Empirical Study: Lessons Learned from Comparing HRA Methods Predictions to HAMMLAB Simulator Data, US Nuclear Regulatory Commission, Washington DC, 2014. NUREG-2127.
  11. US Nuclear Regulatory Commission, The U.S. HRA Empirical Study - Assessment of HRA Method Predictions against Operating Crew Performance on a U.S. Nuclear Power Plant Simulator, NUREG-2156, US Nuclear Regulatory Commission, Washington DC, 2016.
  12. Y.J. Chang, D. Bley, L. Criscione, B. Kirwan, A. Mosleh, T. Madary, R. Nowell, R. Richards, E.M. Roth, S. Sieben, A. Zoulis, The SACADA database for human reliability and human performance, Reliab. Eng. Syst. Saf. 125 (2014) 117-133. https://doi.org/10.1016/j.ress.2013.07.014
  13. W. Jung, J. Park, Y. Kim, S.Y. Choi, S. Kim, HuREX-A framework of HRA data collection from simulators in nuclear power plnats, Reliab. Eng. Syst. Saf. (2018), https://doi.org/10.1016/j.ress.2018.07.036.
  14. J. Park, D. Lee, W. Jung, J. Kim, An experimental investigation on relationship between PSFs and operator performances in the digital main control room, Ann. Nucl. Energy 101 (2017) 58-68. https://doi.org/10.1016/j.anucene.2016.10.020
  15. A. Bye, A. Wright, M. Reid, Human reliability data for modern control rooms, a survey, in: Asian Symposium on Risk Assessment and Management 2019, Gyeongju, Korea, 2019. September 30 - October 2.
  16. R.Y. Wang, D.M. Strong, Beyond accuracy: what data quality means to data consumers, J. Manag. Inf. Syst. 12 (4) (1996) 5-33. https://doi.org/10.1080/07421222.1996.11518099
  17. L. Cai, Y. Zhu, The challenges of data quality and data quality assessment in the big data era, Data Sci. J. 14 (2015).
  18. Y. Kim, J. Park, W. Jung, S.Y. Choi, S. Kim, Estimating the quantitative relation between PSFs and HEPs from full-scope simulator data, Reliab. Eng. Syst. Saf. 173 (2018) 12-22. https://doi.org/10.1016/j.ress.2018.01.001
  19. Y. Kim, J. Park, Incorporating prior knowledge with simulation data to estimate PSF multipliers using bayesian logistic regression, Reliab. Eng. Syst. Saf. 189 (2019) 210-217. https://doi.org/10.1016/j.ress.2019.04.022
  20. Y. Kim, J. Park, Characteristics of the HuREX framework as a tool for HRA data, in: PSAM14 Workshop on Collecting HRA Data, September 16, 2018. Los Angeles, CA.
  21. D.H. Ham, J. Park, Use of a big data analysis technique for extracting HRA data from event investigation reports based on the Safety-II concept, Reliab. Eng. Syst. Saf. 194 (2020) 106232. https://doi.org/10.1016/j.ress.2018.07.033
  22. Y. Kim, J. Choi, J. Park, W. Jung, S.J. Lee, Estimating diagnosis time of emergency situations in digitalized control rooms, in: Proceedings of the AHFE 2018 International Conference on Human Error, Reliability, Resilience, and Performance, July 21-25, 2018. Florida, USA.
  23. Y. Kim, J. Kim, J. Park, S.Y. Choi, S. Kim, W. Jung, H.E. Kim, S.K. Shin, An HRA Method for Digital Main Control Rooms - Part I: Estimating the Failure Probability of Timely Performance, KAERI, 2019. KAERI/TR-7607/2019.
  24. Y. Kim, J. Park, W. Jung, A classification scheme of erroneous behaviors for human error probability estimations based on simulator data, Reliab. Eng. Syst. Saf. 163 (2017) 1-13. https://doi.org/10.1016/j.ress.2017.01.022
  25. Y. Kim, J. Park, S. Kim, S.Y. Choi, W. Jung, Estimating recovery failure probabilities in off-normal situations from full-scope simulator data, in: Proceedings of the KNS 2016 Autumn Meeting, October 27-28, 2016. Gyeongju, Korea.
  26. US Nuclear Regulatory Commission, Cognitive Basis for Human Reliability Analysis, NUREG-2114, US Nuclear Regulatory Commission, Washington DC, 2016.
  27. K.J. Vicente, J. Rasmussen, Ecological interface design: theoretical foundations, in: IEEE. T. Syst. Man. Cyb., vol 22, 1992, pp. 589-606, 4. https://doi.org/10.1109/21.156574
  28. W.R. Corcoran, N.J. Porter, J.F. Church, M.T. Cross, W.M. Guinn, The critical safety functions and plant operation, Nucl. Technol. 55 (3) (1981) 690-712. https://doi.org/10.13182/NT81-A32814
  29. US Nuclear Regulatory Commission, An Integrated Human Event Analysis System (IDHEAS) for Nuclear Power Plant Internal Events At-Power Application, vol 1, US Nuclear Regulatory Commission, Washington DC, 2017. NUREG-2199.
  30. E.M. Hickling, J.E. Bowie, Applicability of human reliability assessment methods to humanecomputer interfaces, Cognit. Technol. Work 15 (1) (2013) 19-27. https://doi.org/10.1007/s10111-012-0215-x
  31. Y. Kim, J. Park, Suggestions of HRA method improvement for the practical assessment of human reliability, J. Ergon. Soc. Korea. 37 (3) (2018) 229-241. https://doi.org/10.5143/JESK.2018.37.3.229
  32. M. Barber, Data science concepts you need to know! Part 1. Towards Data Science, 14, 2018. Webpage published January, https://towardsdatascience.com/introduction-to-statistics-e9d72d818745.
  33. US Nuclear Regulatory Commission, Integrated Safety Analysis Guidance Document, NUREG-1513, US Nuclear Regulatory Commission, Washington DC, 2001.
  34. J. Silva-Martinez, Human systems integration: process to help minimize human errors, a systems engineering perspective for human space exploration missions, Reach. Out. 2 (2016) 8-23. https://doi.org/10.1016/j.reach.2016.11.003
  35. US Nuclear Regulatory Commission, Good Practices for Implementing Human Reliability Analysis, NUREG-1792, US Nuclear Regulatory Commission, Washington DC, 2005.
  36. A.R. Kim, J. Park, Y. Kim, J. Kim, P.H. Seong, Quantification of performance shaping factors (PSFs)'weightings for human reliability analysis (HRA) of low power and shutdown (LPSD) operations, Ann. Nucl. Energy 101 (2017) 375-382. https://doi.org/10.1016/j.anucene.2016.11.009
  37. B. Kirwan, The development of a nuclear chemical plant human reliability management approach: HRMS and JHEDI, Reliab. Eng. Syst. Saf. 56 (2) (1997) 107-133. https://doi.org/10.1016/S0951-8320(97)00006-9
  38. Y.J. Chang, C. Franklin, L. Criscione, J. Xing, Example use of the SACADA data to inform HRA, in: The Enlarged Halden Programme Group Meeting, Fornebu, Norway, 2016.
  39. D. Kelly, C. Smith, Bayesian Inference for Probabilistic Risk Assessment: A Practitioner's Guidebook, Springer, New York, 2011.
  40. D. Gunning, Explainable Artificial Intelligence (Xai), Defense Advanced Research Projects Agency (DARPA), 2017. https://www.darpa.mil/attachments/XAIProgramUpdate.pdf.
  41. S. Massaiu, A. Fernandes, The Reliability of Identification Tasks in Digital and Analogue Interfaces: A Re-analysis of Two Micro-tasks Studies, Halden reactor project, 2019. HWR 1218.
  42. Y. Kim, Expert elicitation for estimating PSF effects on HEPs in computerbased control rooms, in: 29th European Safety and Reliability Conference, September 22 - 26, 2019. Hannover, Germany.

Cited by

  1. Selecting significant contextual factors and estimating their effects on operator reliability in computer-based control rooms vol.213, 2020, https://doi.org/10.1016/j.ress.2021.107679
  2. Do we have a domain-specific group culture? vol.213, 2021, https://doi.org/10.1016/j.ress.2021.107692
  3. Robust data-driven human reliability analysis using credal networks vol.218, pp.no.pa, 2020, https://doi.org/10.1016/j.ress.2021.107990