Browse > Article
http://dx.doi.org/10.1016/j.net.2020.06.017

Quantitative measures of thoroughness of FBD simulations for PLC-based digital I&C system  

Lee, Dong-Ah (Konkuk University)
Kim, Eui-Sub (Konkuk University)
Yoo, Junbeom (Konkuk University)
Publication Information
Nuclear Engineering and Technology / v.53, no.1, 2021 , pp. 131-141 More about this Journal
Abstract
Simulation is a widely used functional verification method for FBD programs of PLC-based digital I&C system in nuclear power plants. It is difficult, however, to estimate the thoroughness (i.e., effectiveness or quality) of a simulation in the absence of any clear measure for the estimation. This paper proposes two sets of structural coverage adequacy criteria for the FBD simulation, toggle coverage and modified condition/decision coverage, which can estimate the thoroughness of simulation scenarios for FBD programs, as recommended by international standards for functional safety. We developed two supporting tools to generate numerous simulation scenarios and to measure automatically the coverages of the scenarios. The results of our experiment on five FBD programs demonstrated that the measures and tools can help software engineers estimate the thoroughness and improve the simulation scenarios quantitatively.
Keywords
Simulation coverage; FBD simulation; Scenario generation; Coverage estimation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 K.J. Hayhurst, D.S. Veerhusen, J.J. Chilenski, L.K. Rierson, A Practical Tutorial on Modified Condition/decision Coverage, NASA, 2001. TM-2001-210876.
2 J.H. Kim, D.Y. Oh, N.H. Lee, C.H. Kim, J.H. Kim, A nuclear safety system based on industrial computer, in: Transactions of the Korean Nuclear Society Spring Meeting, Taebaek, Korea, May 26-27, 2011.
3 E.-S. Kim, S. Jung, J. Kim, J. Yoo, MC/DC and toggle coverage measurement tool for FBD program simulation, in: Transactions of the Korean Nuclear Society Spring Meeting, Jeju, Korea, May 11-13, 2016.
4 International Atomic Energy Agency (IAEA), Verification and Validation of Software Related to Nuclear Power Plant Instrumentation and Control, 1999. Technical reports series No. 384.
5 M. Pezze, M. Young, Software Testing and Analysis: Process, Principles and Techniques, Wiley, 2008.
6 K. Maruchi, H. Shin, M. Sakai, MC/DC-like structural coverage criteria for function block diagrams, in: 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation Workshops, OH, USA, Mar 31-Apr 4, 2014.
7 R. Alur, A. Kanade, S. Ramesh, K. Shashidhar, Symbolic analysis for improving simulation coverage of simulink/stateflow models, in: Proceedings of the 8th ACM International Conference on Embedded Software, New York, USA, Oct 19-24, 2008.
8 International Electrotechnical Commission (IEC), IEC 61131-3, Programmable Controllers: Part 3-Programming Languages, second ed., 2003.
9 R.G. Sargent, Verification and validation of simulation models, J. Simulat. 7 (2013) 12-24.   DOI
10 C. Schnakenbourg, J.-M. Faure, J.-J. Lesage, Towards IEC 61499 function blocks diagrams verification, in: IEEE International Conference on Systems Man and Cybernetics, Yasmine Hammamet, Tunisia, Oct 6-9, 2002.
11 PLCopen Technical Committee 6, XML formats for IEC 61131-3, Ver. 2.01, Available: http://www.plcopen.org, 2009.
12 International Organization for Standardization (ISO), ISO 26262 Road Vehicles-Functional Safety, 2011.
13 E. Jee, D. Shin, S. Cha, J.-S. Lee, D.-H. Bae, Automated test case generation for FBD programs implementing reactor protection system software, Softw. Test. Verif. Reliab. 24 (8) (2014) 608-628.   DOI
14 G.J. Myers, C. Sandler, T. Badgett, The Art of Software Testing, John Wiley & Sons, 2011.
15 E. Jee, J. Yoo, S. Cha, Control and data flow testing on function block diagrams, in: Proceedings of the 24th International Conference on Computer Safety, Reliability and Security, Fredrikstad, Norway, Sep 28-30, 2005.
16 E. Jee, J. Yoo, S. Cha, D. Bae, A data flow-based structural testing technique for FBD programs, Inf. Software Technol. 51 (7) (2009) 1131-1139.   DOI
17 Wikipedia, Software testing. https://en.wikipedia.org/wiki/Softwaretesting.
18 ISO/IEC/IEEE, ISO/IEC/IEEE 29119-4 Software and System Engineering Software Testing Part 4: Test tTchniques, 2015.
19 S. Tasiran, K. Keutzer, Coverage metrics for functional validation of hardware designs, IEEE Design Test Comput. 4 (2001) 36-45.
20 J. Yoo, E.-S. Kim, D.-A. Lee, J.-G. Choi, Y.J. Lee, J.-S. Lee, Nude 2.0: a model-based software development environment for the PLC & FPGA based digital systems in nuclear power plants, in: Proceedings of the 2014 International Symposium on Integrated Circuits, Singapore, Dec 10-12, 2014.
21 E.-S. Kim, D.-A. Lee, J. Yoo, The scenario generator for verifying the correctness of FBDtoVerilog translator, in: Proceedings of the Korea Information Processing Society, vol. 21, Ajou University, Korea, April 24-25, 2014.
22 J. Kim, E.-S. Kim, J. Yoo, Y.J. Lee, J.-G. Choi, An integrated software testing framework for FPGA-based controllers in nuclear power plants, Nucl. Eng. Technol. 48 (2) (2016) 470-481.   DOI
23 Esterel Technologies, SCADE - IEC 60880 compliant, Available: http://www.esterel-technologies.com/.
24 Institute of Electrical and Electronics Engineers (IEEE), IEEE Standard 1012 - IEEE Standard for System and Software Verification and Validation, 2012.
25 Rev.00, KAERI, Software Requirements Specification for Reactor Protection System, 2005. KNICS-RPS-SRS221.
26 Korea Atomic Energy Research Institute (KAERI), Software Design Specification for Reactor Protection System, Rev.02, 2006. KNICS-RPS-SD231.
27 Liverpool Data Research Associates (LDRA), LDRA tool suite, Available: http://www.ldra.com/.
28 C. Park, C. Choe, S. Jin, An effective application process for code coverage analysis, in: Proceedings of the International Symposium on Future I&C for Nuclear Power Plants/International Symposium on Symbiotic Nuclear Power System 2014, Jeju, Korea, Aug 24-28, 2014.
29 D. Shin, E. Jee, D.-H. Bae, Comprehensive analysis of FBD test coverage criteria using mutants, Software Syst. Model 15 (3) (2016) 631-645.   DOI
30 Radio Technical Commission for Aeronautics, DO-178B Software Considerations in Airborne Systems and Equipment Certification, 1992.
31 IEC, IEC 61508 Functional Safety of Electrical, Electronic and Programmable Electronic (E/E/PE) Safety-Related Systems, 2000.
32 E.-S. Kim, D.-A. Lee, J. Kim, S. Jung, J. Yoo, J.-G. Choi, J.-S. Lee, NuDE 2.0: a formal-methods based software development, verification and safety analysis environment for digital I&Cs in NPPs, J. Comp. Sci. Eng. 11 (1) (2017) 9-23.   DOI
33 D.-A. Lee, E.-S. Kim, Y.-J. Seo, J. Yoo, FBDEditor: an FBD design program for developing nuclear digital I&C systems, in: Proceedings of the 16th Korea Conference on Software Engineering, PyeongChang, Korea, Feb 12-14, 2014
34 IEC, IEC 60880 Nuclear Power Plants - Instrumentation and Control Systems Important to Safety-Software Aspects for Computer-Based Systems Performing Category A Functions, 2006.
35 IEEE, IEEE Standard 1028 - IEEE Standard for Software Reviews and Audits, 2008.