Acknowledgement
This work of authorship was prepared as an account of work sponsored by Idaho National Laboratory (under Contract DE-AC07-05ID14517), an agency of the U.S. Government. Neither the U.S. Government, nor any agency thereof, nor any of their employees makes any warranty, express or implied, or assumes any legal liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or represents that its use would not infringe privately owned rights. The United States Government retains and the publisher, by accepting the article for publication, acknowledges that the U.S. Government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this manuscript, or allow others to do so, for U.S. Government purposes. We would like to thank Thomas Ulrich, Katya Le Blanc, and Roger Lew for their scientific contributions cited in this paper, as well as the members of the Human Factors and Reliability Department at INL (Department C240) for their research efforts in the HSSL. Additionally, Brandon Rice and Kirk Fitzgerald were invaluable in building out the HSSL from its beginnings. Lastly, we would also like to express thanks to all the individuals in the LWRS program who supported and sponsored the work conducted in the HSSL.
References
- International Atomic Energy Agency (IAEA), Simulators for Training Nuclear Power Plant Personnel, IAEA-TECDOC-685, Austria, 1993.
- J. Miettinen, Nuclear power plant simulators: goals and evolution, in: THICKET 2008: Committee on the Safety of Nuclear Installations (CSNI) of the OECD Nuclear Energy Agency, OECD/NEA), Pisa, Italy, 2008.
- International Atomic Energy Agency (IAEA), Use of Control Room Simulators for Training of Nuclear Power Plant Personnel, IAEA-TECDOC Series No. 1411, Austria, 2004.
- World Nuclear Association, Three Mile Island Accident, 2020. https://WorldNuclear.Org/Information-Library/Safety-and-Security/Safety-of-Plants/Three-Mile-Island-Accident.Aspx.
- J.G. Kemeny, The Need for Change, the Legacy of TMI: Report of the President's Commission on the Accident at Three Mile Island, Pergamon Press, 1979.
- US Nuclear Regulatory Commission, NRC Action Plan Developed as a Result of the TMI-2 Accident (NUREG-0660), US Nuclear Regulatory Commission, Washington, DC, 1980.
- American National Standards Institute and American Nuclear Society, Nuclear Plant Simulators for Use in Operator Training and Examination, ANSI/ANS-3.5-2018, American National Standards Institute, New York, 2018.
- I.J. dos Santos, D.V. Teixeira, F.T. Ferraz, P.V. Carvalho, The use of a simulator to include human factors issues in the interface design of a nuclear power plant control room, Journal of Loss Prevention in the Process Industries 21 (2008) 227-238. https://doi.org/10.1016/j.jlp.2007.04.006
- F. Owre, The history of HAMMLAB, in: Simulator-Based Human Factors Studies across 25 Years, Springer, London, UK, 2010, pp. 13-42.
- R.L. Boring, W. Jung, N. Lau, G. Skraaning Jr., How to Run a Control Room Simulator Research Study, Idaho National Lab.(INL), Idaho Falls, ID (United States), 2015.
- R.L. Boring, V. Agarwal, J.C. Joe, J.J. Persensky, Digital Full-Scope Mockup of a Conventional Nuclear Power Plant Control Room, Phase 1: Installation of a Utility Simulator at the Idaho National Laboratory, 2012. Idaho Falls, ID (United States).
- J. Hugo, K. le Blanc, D. Gertman, The Development of a Human Systems Simulation Laboratory: Strategic Direction, Idaho National Lab.(INL), 2012. Idaho Falls, ID (United States).
- W.T. Subalusky, Survey of nuclear training activity, Nuclear News 36 (1993) (1992).
- A.B. Skjerve, A. Bye, Simulator-based Human Factors Studies across 25 Years, Springer, London, UK, 2011.
- R.L. Boring, The use of simulators in human factors studies within the nuclear industry, in: Simulator-Based Human Factors Studies across 25 Years, Springer, London, UK, 2010, pp. 3-12.
- R.L. Boring, V. Agarwal, K. Fitzgerald, J. Hugo, B. Hallbert, Digital Full-Scope Simulation of a Conventional Nuclear Power Plant Control Room, Phase 2: Installation of a Reconfigurable Simulator to Support Nuclear Plant Sustainability, Idaho National Lab.(INL), Idaho Falls, ID (United States), 2013.
- IAEA's NUCLEUS Information Resource Portal, IAEA Research Reactor Database, 2022. https://nucleus.iaea.org/rrdb/#/home. (Accessed 26 July 2022).
- K. Wiles, Purdue University Newsroom, 2019. First all-digital nuclear reactor system in the U.S. installed at Purdue University, https://www.purdue.edu/newsroom/releases/2019/Q3/first-all-digital-nuclear-reactor-control-system-in-the-u.s.-installed-at-purdue-university. (Accessed 26 July 2022).
- R.B. Shirley, Science Based Human Reliability Analysis: Using Digital Nuclear Power Plant Simulators for Human Reliability Research, Doctoral Dissertation, The Ohio State University, 2017.
- R. Leis, L. Reinerman-Jones, J. Mercado, J. Szalma, P. Hancock, Workload change over time for nuclear power plant operation tasks, in: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, SAGE Publications Sage CA, Los Angeles, CA, 2015, pp. 105-109.
- B. Bailey, C. Elks, N. Lau, M. Demas, Progress and lessons learned in establishing the integrated control room and operator performance laboratory (incontrol) for digital instrumentation and control and human factors research in nuclear power, in: Proceedings of the 9th American Nuclear Society International Topical Meeting on Nuclear Plant Instrumentation, Control and Human-Machine Interface Technologies, NPIC&HMIT), 2015.
- R.B. Shirley, C. Smidts, Bridging the simulator gap: measuring motivational bias in digital nuclear power plant environments, Reliability Engineering & System Safety 177 (2018) 191-209. https://doi.org/10.1016/j.ress.2018.04.016
- NuScale Power, The NuScale Energy Exploration (E2) Center (Version 1.0 Product Information Sheet), 2021. Corvallis, OR.
- R.L. Boring, The first decade of the Human Systems Simulation Laboratory: a brief history of human factors research in support of nuclear power plants, in: International Conference on Applied Human Factors and Ergonomics, 2020, pp. 528-535.
- J.C. Joe, R.L. Boring, Using the human systems simulation laboratory at Idaho National Laboratory for safety focused research, in: Advances in Human Factors in Energy: Oil, Gas, Nuclear and Electric Power Industries, Springer, 2017, pp. 193-201.
- J.C. Joe, R.L. Boring, J.J. Persensky, Commercial Utility Perspectives on Nuclear Power Plant Control Room Modernization. INL/CON-12-26175, Idaho National Lab.(INL), 2012. Idaho Falls, ID (United States).
- K. le Blanc, J. Hugo, Z. Spielman, C. Kovesdi, R. Hill, J. Oxstrand, T. Hansen, Control Room Modernization End-State Design Philosophy. INL/EXT-18-44798, Idaho National Lab.(INL), 2018. Idaho Falls, ID (United States).
- United States Department of Energy, Office of Nuclear Energy, Strategic Vision, Washington, D.C, 2021.
- H. Medema, J. Mohon, R. Boring, Extracting human reliability findings from human factors studies in the Human Systems Simulation Laboratory, in: Proceedings of the 2021 International Topical Meeting on Probabilistic Safety Assessment and Analysis, PSA 2021, 2021, pp. 98-107.
- J. O'Hara, J. Higgins, S. Fleger, Human factors engineering program review model (NUREG-0711) revision 3: update methodology and key revisions, in: Proceedings of 8th International Topical Meeting on Nuclear Plant Instrumentation and Control and Human-Machine Interface Technologies, 2012.
- R. Boring, J. Hugo, L. Hanes, K. Thomas, M. Gibson, Scope Document: Human Factors Engineering Program Design, Verification & Validation, and Implementation Phase Activities for Plant Process Computer and Turbine Control System Modernization at Duke Energy Progress, INL/LTD-13, 2013.
- P. Braarud, H. Svengren, P. Hunton, J. Joe, L. Hanes, A graded approach to the human factors validation of turbine control system digital upgrade and control room modernization, in: 11th Nuclear Plant Instrumentation, Control and Human-Machine Interface Technologies, NPIC-HMIT), Orlando, Florida, 2019, pp. 903-917.
- J.C. Joe, C. Kovesdi, Using qualified on-site nuclear power plant simulators in human factors validations of control room upgrades, in: International Conference on Applied Human Factors and Ergonomics, Springer, 2021, pp. 171-178.
- J.C. Joe, C. Kovesdi, J. Hugo, G. Clefton, Ergonomic safety and health activities to support commercial nuclear power plant control room modernization in the United States, in: Congress of the International Ergonomics Association, Springer, 2018, pp. 693-700.
- R.L. Boring, T.A. Ulrich, J.C. Joe, R.T. Lew, Guideline for operational nuclear usability and knowledge elicitation (GONUKE), Procedia Manufacturing 3 (2015) 1327-1334. https://doi.org/10.1016/j.promfg.2015.07.287
- R. Boring, R. Lew, T. Ulrich, Advanced nuclear interface modeling environment (ANIME): a tool for developing human-computer interfaces for experimental process control systems, in: International Conference on HCI in Business, Government, and Organizations, Springer, 2017, pp. 3-15.
- R. Lew, T.A. Ulrich, R.L. Boring, Nuclear reactor crew evaluation of a computerized operator support system HMI for chemical and volume control system, in: International Conference on Augmented Cognition, Springer, 2017, pp. 501-513.
- K. le Blanc, R. Boring, J. Joe, B. Hallbert, K. Thomas, A Research Framework for Demonstrating Benefits of Advanced Control Room Technologies: INL/EXT14-33901, Idaho National Lab.(INL), 2014. Idaho Falls, ID (United States).
- K. le Blanc, J. Joe, B. Rice, T. Ulrich, R. Boring, Benefits of Advanced Control Room Technologies: Phase One Upgrades to the HSSL and Performance Measures, INL/EXT-15-3538 Revision 0, Idaho National Lab.(INL), 2015. Idaho Falls, ID (United States).
- K. le Blanc, D. Powers, J. Joe, Z. Spielman, B. Rice, K. Fitzgerald, A Pilot Study Investigating the Effects of Advanced Nuclear Power Plant Control Room Technologies: Methods and Qualitative Results: INL/EXT-15-36432, Idaho National Lab.(INL), 2015. Idaho Falls, ID (United States).
- R.L. Boring, T.A. Ulrich, H.M. Medema, R. Lew, Operator resilience to cyber interdictions in nuclear power plants, in: 2019 Resilience Week (RWS), IEEE, 2019, pp. 247-251.
- S.Y. Pickering, P.B. Davies, Cyber security of nuclear power plants: US and global perspectives, Georgetown Journal of International Affairs (2021). https://gjia.georgetown.edu/2021/01/22/cyber-security-of-nuclear-power-plants-us-and-global-perspectives/.
- K. Zetter, Countdown to Zero Day: Stuxnet and the Launch of the World's First Digital Weapon, Broadway Books, New York, NY,
- D. Dudenhoeffer, IAEA Information and Computer Security, 2013.
- R. Masood, Assessment of Cyber Security Challenges in Nuclear Power Plants Security Incidents, Threats, and Initiatives, Cybersecurity and Privacy Research Institute the George Washington University, 2016.
- B. Kesler, The Vulnerability of Nuclear Facilities to Cyber Attack, Strategic Insights, 2011.
- US Nuclear Regulatory Commission, Protection of Digital Computer and Communication Systems and Networks. 10 CFR Part 73.54, 2009.
- J. Scholtz, L. Franklin, K. le Blanc, E. Andersen, Cybersecurity awareness in the power grid, in: Advances in Human Factors in Cybersecurity, Springer, 2016, pp. 183-193.
- K. le Blanc, S. Freeman, Investigating the relationship between need for cognition and skill in ethical hackers, in: Advances in Human Factors in Cybersecurity, Springer, 2016, pp. 223-228.
- K. le Blanc, Human factors challenges in developing cyber-informed risk assessment for critical infrastructure, in: International Conference on Applied Human Factors and Ergonomics, Springer, 2020, pp. 536-541.
- K. le Blanc, A. Ashok, L. Franklin, J. Scholtz, E. Andersen, M. Cassiadoro, Characterizing cyber tools for monitoring power grid systems: what information is available and who needs it?, in: 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC) IEEE, 2017, pp. 3451-3456.
- R. Youngblood, K. le Blanc, Application of traditional risk assessment methods to cyber manipulation: adapting traditional logic modeling techniques to address cyberattack, in: Probabilistic Safety Assessment and Management, 2018. Los Angeles.
- S. Eggers, K. le Blanc, Survey of cyber risk analysis techniques for use in the nuclear industry, Progress in Nuclear Energy 140 (2021), 103908.
- V. Yadav, R.W. Youngblood, K.L. le Blanc, J. Perschon, R. Pitcher, Fault-tree based prevention analysis of cyber-attack scenarios for PRA applications, in: 2019 Annual Reliability and Maintainability Symposium (RAMS), IEEE, 2019, pp. 1-7.
- Y. Zhao, N. Adina, K. le Blanc, C. Rieger, B.K. Johnson, H. Le, T. McJunkin, P.-K. Vaddi, T. Ulrich, R. Li, C. Smidts, Dynamic probabilistic risk assessment for cyber security risk analysis of the electric grid, in: The 30th European Safety and Reliability Conference: The 15th Probabilistic Safety Assessment and Management Conference, 2020. Venice, Italy.
- J.C. Scholtz, L. Franklin, A. Ashok, K. LeBlanc, C. Bonebrake, E. Andersen, M. Cassiadoro, Employing a user-centered design process for cybersecurity awareness in the power grid, Journal of Human Performance in Extreme Environments (2018) 14.
- M. Branlat, A. Morison, D.D. Woods, Challenges in managing uncertainty during cyber events: lessons from the staged-world study of a large-scale adversarial cyber security exercise, in: Human Systems Integration Symposium, 2011, pp. 10-25.
- S.S. Adams, R.J. Bruneau, N. Murchison, N. Jacobs, D.R. Sandoval, B.E. Seng, Enhancing Power Plant Safety through Simulator Coupling with Digital Architecture, Sandia National Lab.(SNL-NM), Albuquerque, NM (United States), 2018.
- S.S. Adams, N. Murchison, R.J. Bruneau, Investigating Cyber Threats in a Nuclear Power Plant, Sandia National Lab.(SNL-NM), Albuquerque, NM (United States), 2018.
- C. Poresky, R. Lew, T.A. Ulrich, R.L. Boring, Fault understanding, navigation, and control interface: a visualization system for cyber-resilient operations for advanced nuclear power plants, in: Industrial Control Systems Security and Resiliency, Springer, 2019, pp. 237-252.
- K. le Blanc, R. Youngblood, S. Eggers, K. Herdt, R. Rice, Application of Traditional Risk Assessment Methods to Cyber Manipulation Scenarios, Idaho National Laboratory(INL), Idaho Falls, ID (United States), 2019.
- B.C. Rice, J.P. Lehmer, R.T. England, Modeling and Simulation-Introducing Hardware-In-The-Loop Capabilities to the Human Systems Simulation Laboratory, Idaho National Lab.(INL), Idaho Falls, ID (United States), 2019.
- International Atomic Energy Agency, Non-baseload Operations in Nuclear Power Plants: Load Following and Frequency Control Modes of Flexible Operation, IAEA, 2018.
- T.A. Ulrich, R. Lew, S. Hancock, T. Westover, A. Hall, R. Boring, K. Thomas, H. Medema, S. Werner, L. Terry, N. Minard, A. Michael, C. Alivisatos, T. Mortenson, Dynamic Human-In-The-Loop Simulated Nuclear Power Plant Thermal Power Dispatch System Demonstration and Evaluation Study, Idaho National Laboratory(INL), Idaho Falls, ID (United States), 2021.
- World Nuclear Association, Hydrogen Production and Uses, 2021. https://www.World-Nuclear.Org/Information-Library/Energy-and-the-Environment/Hydrogen-Production-and-Uses.Aspx.
- T.A. Ulrich, R. Lew, T. Mortenson, J. Park, H. Medema, S. Hancock, T. Westover, R.L. Boring, Preliminary Human-System Evaluation of Thermal Power Dispatch Concept of Operations, 2020. Idaho Falls, ID.
- P. Morilhat, S. Feutry, C. le Maitre, J.M. Favennec, Nuclear power plant flexibility at EDF, Atw Int Z Fuer Kernenerg 64 (2019) 131-140.
- National Regulatory Commission, Principles of human reliability analysis (HRA), Joint RES/EPRI Fire PRA Workshop (2010).
- R. Patriarca, M. Ramos, N. Paltrinieri, S. Massaiu, F. Costantino, G. di Gravio, R.L. Boring, Human reliability analysis: exploring the intellectual structure of a research field, Reliability Engineering & System Safety 203 (2020), 107102.
- R.L. Boring, T.A. Ulrich, R. Lew, M. Rasmussen, Parts and wholes: scenarios and simulators for human performance studies, in: International Conference on Applied Human Factors and Ergonomics, Springer, 2018, pp. 116-127.
- T.A. Ulrich, R. Lew, S. Werner, R.L. Boring, Rancor: a gamified microworld nuclear power plant simulation for engineering psychology research and process control applications, in: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, SAGE Publications Sage CA, Los Angeles, CA, 2017, pp. 398-402.
- J. Park, R.L. Boring, T.A. Ulrich, R. Lew, S. Lee, B. Park, J. Kim, A Framework to Collect Human Reliability Analysis Data for Nuclear Power Plants Using a Simplified Simulator and Student Operators, Reliability Engineering & System Safety, 2022, 108326.
- M. Stroud, Nuclear Leaders Say Education Key to Industry's Future, Pittsburgh Business Times, 2015. http://www.bizjournals.com/pittsburgh/blog/energy/2015/09/nuclearleaders-say-education-key-to-industrys.html. (Accessed 3 February 2021). accessed.
- A. Hall, R. Boring, T. Miyake, Cognitive aging as a human factor: age of operator on human performance in the nuclear control room, in: 12th Nuclear Plant Instrumentation, Control and Human-Machine Interface Technologies (NPIC&HMIT 2021), Virtual Conference, 2021.
- J.K. Hartshorne, L.T. Germine, When does cognitive functioning peak? The asynchronous rise and fall of different cognitive abilities across the life span, Psychol Sci 26 (2015) 433-443. https://doi.org/10.1177/0956797614567339
- Y.-T. Jou, T.-C. Yenn, C.J. Lin, C.-W. Yang, C.-C. Chiang, Evaluation of operators' mental workload of human-system interface automation in the advanced nuclear power plants, Nuclear Engineering and Design 239 (2009) 2537-2542. https://doi.org/10.1016/j.nucengdes.2009.06.023
- A. Hall, R.L. Boring, T.M. Miyake, Cognitive Aging as a Human Factor: Effects of Age on Human Performance, Nuclear Technol. (2022) 1-15, https://doi.org/10.1080/00295450.2022.2073951.
- International Atomic Energy Agency, Accident Management Programmes for Nuclear Power Plants, Specific Safety Guides, Vienna, 2019.
- Nuclear Energy Institute, Diverse and Flexible Coping Strategies (FLEX) Implementation Guide, 2012.
- Nuclear Energy Agency, Informing Severe Accident Management Guidance and Actions for Nuclear Power Plants through Analytical Simulation, Nuclear Safety. NEA/CSNI/R vol. 16, 2017, p. 2018.
- R. Kadota, On the Brink: the inside Story of Fukushima Daiichi, 2014. BookBaby.
- J. Waksman, Project Pele Overview: Mobile Nuclear Power for Future DoD Needs, GAIN, 2020. March.
- R. Boring, T. Ulrich, R. Lew, A. Hall, A microworld framework for advanced control room design, in: 12th International Topical Meeting on Nuclear Power Plant Instrumentation, Control, and Human-Machine Interface Technologies, NPIC&HMIT)., 2021.