Browse > Article
http://dx.doi.org/10.1016/j.net.2018.03.010

An accident diagnosis algorithm using long short-term memory  

Yang, Jaemin (Department of Nuclear Engineering, Chosun University)
Kim, Jonghyun (Department of Nuclear Engineering, Chosun University)
Publication Information
Nuclear Engineering and Technology / v.50, no.4, 2018 , pp. 582-588 More about this Journal
Abstract
Accident diagnosis is one of the complex tasks for nuclear power plant (NPP) operators. In abnormal or emergency situations, the diagnostic activity of the NPP states is burdensome though necessary. Numerous computer-based methods and operator support systems have been suggested to address this problem. Among them, the recurrent neural network (RNN) has performed well at analyzing time series data. This study proposes an algorithm for accident diagnosis using long short-term memory (LSTM), which is a kind of RNN, which improves the limitation for time reflection. The algorithm consists of preprocessing, the LSTM network, and postprocessing. In the LSTM-based algorithm, preprocessed input variables are calculated to output the accident diagnosis results. The outputs are also postprocessed using softmax to determine the ranking of accident diagnosis results with probabilities. This algorithm was trained using a compact nuclear simulator for several accidents: a loss of coolant accident, a steam generator tube rupture, and a main steam line break. The trained algorithm was also tested to demonstrate the feasibility of diagnosing NPP accidents.
Keywords
Accident Diagnosis; Long Short-term Memory; Recurrent Neural Network; Softmax;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Gianluca Pollastri, Darisz Przybylski, Burkhard Rost, Pierre Baldi, Improving the prediction of protein secondary structure in three and eight classes using recurrent neural networks and profiles, Proteins Struct. Funct. Bioinform. 47 (2002) 228-235.   DOI
2 Jiri Vohradsky, Neural network model of gene expression, FASEB J. 15 (3) (2001) 846-854.   DOI
3 Rui Xu, Donald Wunsch II, Ronald Frank, Inference of genetic regulatory networks with recurrent neural network models using particle swarm optimization, IEEE/ACM Trans. Comput. Biol. Bioinform. (TCBB) (2007) 681-692.
4 Muhammad Subekti, Kazuhiko Kudo, Kunihiko Nabeshima, The development of anomaly diagnosis method using neuro-expert for PWR monitoring system, in: International Conference on Advanced in Nuclear Science and Engineering (ICANSE2007), 2006.
5 Abiodun Ayodeji, Yong-kuo Liu, Hong Xia, Knowledge base operator support system for nuclear power plant fault diagnosis, Progr. Nucl. Energy 105 (2018) 42-50.   DOI
6 D. Monner, J.A. Reggia, A generalized LSTM-like training algorithm for secondorder recurrent neural networks, Neural Netw. 25 (2012) 70-83.   DOI
7 C. Lipton, et al., learning to diagnose with LSTM recurrent neural networks, in: International Conference on Learning Representation, Caribe Hilton, San Juan, Puerto Rico, May 2-4, 2016.
8 James Bergstra, Yoshua Bengio, Random search for hyper-parameter optimization, J. Mach. Learn. Res. (2012) 281-305.
9 Christopher M. Bishop, Machine learning and pattern recognition, in: Information Science and Statistics, Springer, Heidelberg, 2006.
10 Jasper Snoek, Hugo Larochelle, Ryan P. Adams, Practical bayesian optimization of machine learning algorithms, in: Advances in Neural Information Processing Systems, 2012, pp. 2951-2959.
11 Yaguo Lei, et al., An intelligent fault diagnosis method using unsupervised feature learning towards mechanical big data, IEEE Trans. Ind. Electron. 63 (5) (2016) 3137-3147.   DOI
12 P.F. Fantoni, A. Mazzola, A pattern recognition-artificial neural networks based model for signal validation in nuclear power plants, Ann. Nucl. Energy 23 (13) (1996) 1069-1076.   DOI
13 Siqin Tao, et al., Bearing fault diagnosismethod based onstacked autoencoder and softmax regression, in: Control Conference (CCC), 2015 34th Chinese, IEEE, 2015.
14 Kee-Choon Kwon, Jin-Hyung Kim, Accident identification in nuclear power plants using hidden Markov models, Eng. Appl. Artif. Intell. 12 (4) (1999) 491-501.   DOI
15 Robert E. Uhrig, J. Hines, Computational intelligence in nuclear engineering, Nucl. Eng. Technol. 37.2 (2005) 127-138.
16 Mark J. Embrechts, Sandor Benedek, Hybrid identification of nuclear power plant transients with artificial neural networks, IEEE Trans. Ind. Electron. 51 (3) (2004) 686-693.   DOI
17 Seung Jun Lee, Poong Hyun Seong, A dynamic neural network based accident diagnosis advisory system for nuclear power plants, Progr. Nucl. Energy 46 (3-4) (2005) 268-281.   DOI
18 Kun Mo, Seung Jun Lee, Poong Hyun Seong, A dynamic neural network aggregation model for transient diagnosis in nuclear power plants, Prog. Nucl. Energy 49.3 (2007) 262-272.   DOI
19 Sepp Hochreiter, Jurgen Schmidhuber, Bridging long time lags by weight guessing and Long Short-Term Memory, Spatiotemporal Models Biol. Artif. Syst. 37 (1996) 65-72.
20 K. Nabeshima, et al., On-line neuro-expert monitoring system for borssele nuclear power plant, Progr. Nucl. Energy 43 (1-4) (2003) 397-404.   DOI
21 Sepp Hochreiter, Jurgen Schmidhuber, Long short-term memory, Neural Comput. 9 (8) (1997) 1735-1780.   DOI
22 Michael Auli, Michel Galley, Chris Quirk, Geoffrey Zweig, Joint language and translation modeling with recurrent neural networks, in: Empirical Methods in Natural Language Processing (EMNPL), vol. 3, 2013.
23 Ilya Sutskever, Oriol Vinyals, Quoc VV. Le, Sequence to sequence learning with neural networks, in: Advances in Neural Information Processing Systems (NIPS), vol. 27, 2014, pp. 3104-3112.
24 Oriol Vinyals, Alexander Toshev, Samy Bengio, Dumitru Erhan, Show and tell: a neural image caption generator, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 3156-3164.
25 Andrej Karpathy, Li Fei-Fei, Deep visual-semantic alignments for generating image descriptions, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 3128-3137.
26 Marcus Liwicki, Alex Graves, Horst Bunke, Jurgen Schmidhuber, A novel approach to on-line handwriting recognition based on bidirectional long short-term memory networks, in: Proceedings of the Ninth International Conference on Document Analysis and Recognition, vol. 1, 2007, pp. 367-371.
27 O. Maruo, et al., HSI for Monitoring the Critical Safety Functions Status Tree of a NPP, International Nuclear Atlantic Conference, Recife, PE, Brazil, Nov. 24-29, 2013.
28 J.K. Vaurio, Safety-related decision making at a nuclear power plant, Nucl. Eng. Des. 185 (1998) 335-345.   DOI
29 David D. Woods, Coping with complexity: the psychology of human behaviour in complex systems, in: Tasks, Errors, and Mental Models, Taylor & Francis, Inc, 1988, pp. 128-148.
30 T. Kontogiannis, Stress and operator decision making in coping with emergencies, Int. J. Hum. Comput. Inter. 45 (1996) 75-104.   DOI
31 David Meister, Cognitive behavior of nuclear reactor operators, Int. J. Ind. Ergonom. 16.2 (1995) 109-122.   DOI
32 Nuclear Energy Agency, Critical Operator Actions: Human Reliability Modeling and Data Issues, 1998. NEA/CSNI/R(98)1.
33 T.V. Santosh, et al., Application of artificial neural networks to nuclear power plant transient diagnosis, Reliab. Eng. Syst. Saf. 92 (10) (2007) 1468-1472.   DOI
34 Jinkyun Park, Wondea Jung, A study on the systematic framework to develop effective diagnosis procedures of nuclear power plants, Reliab. Eng. Syst. Saf. 84.3 (2004) 319-335.   DOI
35 Serhat Seker, Emine Ayaz, Erdinc Turkcan, Elman's recurrent neural network applications to condition monitoring in nuclear power plant and rotating machinery, Eng. Appl. Artifi. Intell. 16 (7) (2003) 647-656.   DOI
36 Moshkbar-Bakhshayesh Khalil, Mohammad B. Ghofrani, Transient identification in nuclear power plants: a review, Progr. Nucl. Energy 67 (2013) 23-32.   DOI