KIPS Transactions on Software and Data Engineering (정보처리학회논문지:소프트웨어 및 데이터공학)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Generating Test Cases of Stateflow Model Using Extended RRT Method Based on Test Goal

테스트 목표 기반의 향상된 RRT 확장 기법을 이용한 Stateflow 모델 테스트 케이스 생성

  • 박현상 (아주대학교 정보통신전문대학원 정보통신공학과) ;
  • 최경희 (아주대학교 정보통신전문대학원 정보통신공학과) ;
  • 정기현 (아주대학교 일반대학원 전자공학과)
  • Received : 2013.05.13
  • Accepted : 2013.09.05
  • Published : 2013.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a test case generation method for Stateflow model using the extended RRT method. The RRT method which has been popularly used for planning paths for complex systems also shows a good performance for test case generation. However, it does not consider the test coverage which is important for test case generation. The proposed extension method hires the concept of test goal achievement to increase test coverage and drives RRT extension in the direction that increases the goal achievement. Considering the concept, a RRT distance metric, random node generation method and modified RRT extension algorithm are proposed. The effectiveness of proposed algorithm is compared with that of the typical RRT algorithm through the experiment using the practical automotive ECUs.

본 논문은 Rapidly-exploring Random Tree(RRT) 확장 기법을 이용하여 Stateflow 모델 기반의 블랙박스 테스트 케이스 자동 생성 방법을 제안한다. 복잡한 시스템의 경로 계획 문제를 효율적으로 해결하는 방법으로 널리 사용되고 있는RRT기법은 테스트 케이스 생성에서도 좋은 성능을 보이고 있으나, 테스트 케이스 생성에 있어서 중요한 부분을 차지하는 테스트 커버리지를 고려하고 있지 않다. 제안하는 확장 기법은 테스트 커버리지를 향상시키기 위하여 테스트 목표 달성 율의 개념을 RRT 확장에 도입하여 테스트 목표를 더 달성할 수 있는 방향으로 RRT 확장을 유도 한다. 이를 위해서 테스트 목표 달성 율을 고려한 RRT 거리 함수와 RRT 무작위 노드 생성 방법, 그리고 변형된 RRT 확장 알고리즘을 제안한다. 제안된 기법의 유용성은 실제 자동차에서 사용되는 제어 ECU들의 Stateflow 모델을 이용한 실험을 통해 기존 RRT를 이용한 테스트 케이스 생성 기법과의 성능을 비교를 통해 보인다.

Keywords

References

  1. MATLAB Simulink Stateflow http://www.mathworks.com/products/stateflow/ 1994-2012 The MathWorks, Inc.
  2. M.Utting, B. Legeard, "Practical Model-Based Testing: A Tools Approach", Morgan Kaufmann, 2007.
  3. R. Alur, "Model checking of hierarchical state machines" in Proceedings of the 6th ACM SIGSOFT FSE, Vol.23, Issue 6, pp.175-188, 1998.
  4. T.A. Henzinger, "The Theory of Hybrid Automata" in Proceedings of Logic in Computer Science, Eleventh Annual IEEE Symposium, pp.278-292, 1996.
  5. A. Agrawal, G. Simun, G. Karsai, "Semantic Translation of Simulink/Stateflow models to Hybrid Automata using Graph Transformations" in Proceedings of the Workshop on Graph Transformation and Visual Modelling Techniques, Vol.109, pp.43-56, 2004.
  6. T. A. Henzinger, P. W. Kopke, A. Puri, P. Varaiya, "What's Decidable About Hybrid Automata?", Journal of Computer and System Sciences Vol.57, Issue 1, pp.94-124, 1998. https://doi.org/10.1006/jcss.1998.1581
  7. T. Brihaye, "A note on the undecidability of the reachability problem for o-minimal dynamical systems" in Mathematical Logic Quarterly, Vol.52, Issue 2, pp.165-170, 2006. https://doi.org/10.1002/malq.200510024
  8. H. S. Hong, I. S. Lee, O. Sokolsky, S. D. Cha, "Automatic Test Generation From Statecharts Using Model Checking" in Technical Report, Department of Computer & Information Science University of Pennsylvania MS-CIS-01-07, 2001.
  9. C.S. Pasareanu, "Model Based Analysis and Test Generation for Flight Software" in SMC-IT 2009, Third IEEE International Conference, pp.83-90, 2009.
  10. M. Satpathy, A. Yeolekar, S. Ramesh, "Randomized Directed Testing(REDIRECT) for Simulink/Stateflow Models" in Proceedings of the 8th ACM international conference on Embedded software, pp.217-226, 2008.
  11. P. Roy, N. Shankar, "SimCheck: a contract type system for Simulink", in Journal of Innovations in Systems and Software Engineering, Vol.7, Issue 2, pp.73-83, 2011. https://doi.org/10.1007/s11334-011-0145-4
  12. S. M. LaValle, "Rapidly-Exploring Random Trees: A New Tool for Path Planning" TR 98-11 Computer Science Dept., Iowa State Univ.
  13. J.M. Esposito, J. Kim, V. Kumar "A Probabilistic Approach to Automated Test Case Generation for Hybrid Systems" in Hybrid Systems: Computation and Control, 2004.
  14. T. Dang, T. Nahhal, "Coverage-guided test generation for continuous and hybrid systems" in Formal Methods in System Design, Vol.34, No.2, pp.183-213, 2009. https://doi.org/10.1007/s10703-009-0066-0
  15. J. M. Esposito, "Randomized Test Case Generation for Hybrid Systems: metric selection" in System Theory, Proceedings of the Thirty-Sixth Southeastern Symposium, pp.236-240, 2004.
  16. J. Kim, "Adaptive Sample Bias for Rapidly-exploring Random Trees with Applications to Test Generation" in American Control Conference, Proceedings, Vol.2, pp.1166-1172, 2005.
  17. S. N. Ahmadyan, "Goal-oriented stimulus generation for analog circuits", in Design Automation Conference, pp.1018-1023, 2012.
  18. S. M. LaValle, J. J. Kuffner. In B. R. Donald, K. M. Lynch, D. Rus, "Rapidly-exploring random trees: Progress and prospects.", Algorithmic and Computational Robotics: New Directions, pp.293-308. A K Peters, Wellesley, MA, 2001.
  19. K. J. Hayhurst, D. S. Veerhusen, J. J. Chilenski, L. K. Rierson, "A Practical Tutorial on Modified Condition/ Decision Coverage", NASA, 2001.
  20. Reactis http://www.reactive-systems.com/products.msp Reactive Systems, Inc
  21. Design Verifier http://www.mathworks.com/products/sldesignverifier/ Mathworks, Inc.
  22. K. L. McMillan, "Symbolic Model Checking - an Approach to the State Explosion Problem" Kluwer Academic Publishers, 1993.
  23. E.M. Clarke, E.A. Emerson, A.P. Sistla, "Automatic Verification of Finite-State Concurrent Systems Using Temporal Logic Specifications", ACM Transitions on Programming Languages and Systems, Vol.8, No.2, pp.244-263, 1986. https://doi.org/10.1145/5397.5399
  24. C. S. Pasareanu, P. C. Mehlitz, D. H. Bushnell, K. G. Burlet, M. Lowry, S. Person, M. Pape, "Combining unit level symbolic execution and system level concrete execution for testing" NASA softwrae. In Proc. ISSTA'08 (to appear), 2008.
  25. The Yices SMT Solver, http://www.csl.sri.com
  26. J. C. Gower "A general coefficient of similarity and some of its properties" in Biometrics, Vol.27, pp.857-871, 1971. https://doi.org/10.2307/2528823