DOI QR코드

DOI QR Code

A Hierarchical Checklist to Automatically Generate Test Scripts

테스트 스크립트 자동 생성을 위한 계층 구조 체크리스트

  • Received : 2016.10.17
  • Accepted : 2016.12.04
  • Published : 2017.05.31

Abstract

This paper proposes a method to generate test scripts for testing embedded system in an easy manner by using hierarchical checklist. In the proposed method, a checklist is constructed with event, component and command dictionaries. And the test scripts are hierarchically generated based on the dictionaries. Since the physical layer of system input becomes abstract with component layer and event layer by virtue of the hierarchy, It is possible to generate test scripts without complicated system input information. It is easy to generate test scripts for embedded systems with similar inputs using the highly reusable dictionaries. The effectiveness of the proposed method is demonstrated with experiments.

본 논문은 구조화된 체크리스트로부터 임베디드 시스템 테스팅을 위한 테스트 스크립트를 쉽게 생성할 수 있는 방법을 제안한다. 제안하는 방법은 체크리스트를 이벤트(Event), 컴포넌트(Component), 입력 명령어(Command) 사전을 기반으로 구성하고, 사전으로부터 계층적으로 테스트 스크립트를 생성한다. 계층 구조로 임베디드 시스템의 물리적 입력 계층이 상위 계층의 컴포넌트 및 이벤트 계층에서 추상화되어 복잡한 시스템 입력 정보를 사용하지 않고도 테스트 스크립트를 생성할 수 있다. 비슷한 종류의 입출력 정보를 가지는 임베디드 시스템을 테스트하기 위한 테스트 스크립트 생성은 재사용성이 높은 사전을 이용하여 매우 쉽게 할 수 있다. 제안하는 방법의 유용성은 실험을 통해 보인다.

Keywords

References

  1. J. Y. Seo, A. Y. Sung, B. J. Choi, and S. B. Kang, "Automating Embedded software Testing on an Emulated Target Board," Proc. of the Second International Workshop on Automation of Software Test, 20-26 May, 2007.
  2. S. Y. Jeong, Y. W. Chang, and C. J. Yoo, "Test Case Genration Technique Based on State Transition Model for Embedded System," Journal of Korean Institute of Information Technology, Vol.9, No.4, pp.11-21, 2011.
  3. M. R. Keyvanpour, H. Homayouni, and Hossein Shirazee, "Automatic Software Test Case Generation: An Analytical Classification Framework," International Journal of Software Engineering and Its Applications, Vol.6, No.4, pp.1-16, October, 2012.
  4. T. Y. Chen, H. Leung, and I. K. Mak, "Adaptive random testing," in Proceedigns of the 9th Asian Computaing Science Conference, volum 3321 of Lecture Notes in Computer Science, pp.320-329, 2004.
  5. Kuo Chung Tai and Yu Lei, "A Test Generation Strategy for Pairwise Testing," IEEE Transactions on Software Engineering, Vol.28, No.1, pp.109-111, January, 2002. https://doi.org/10.1109/32.979992
  6. K. P. Chan, T. Y. Chen, and Dave Towey, "Restricted Random Testing," in Proceedings of the 7th European Conference on Software Quality Helsinki, Finland, Vol.2349/2002 of Lecture Notes in Computer Science, pp.321-330, June, 2002.
  7. Conrad, M., Dörr, H., Fey, I., and Yap, A., "Model-based Generation and Structured Representation of Test Scenarios," Workshop on Software-Embedded Systems Testing (WSEST), Gaithersburg, USA, November, 1999.
  8. P. S. Loo and W. K. Tsai, "Random Testing Revisited," Information and Software Technology, Vol.30, Issue 7, pp.402- 417, Sep., 1988. https://doi.org/10.1016/0950-5849(88)90037-7
  9. T. Y. Chen, F. C. Kuo, Huai Liu, and W. E. Wong, "Does Adaptive Random Testing Deliver a Higher Confidence than Random Testing?," The Eighth International Conference on Quality Software, 2008, QSCI'08, pp.145-154, 12-13 August, 2008.
  10. M. Grochtmann and K. Grimm, "Classification Trees for Partition Testing," Software Testing, Verification & Reliability, Vol.3, No.2, pp.63-82, June, 1993. https://doi.org/10.1002/stvr.4370030203
  11. J. H. Shin, K. H. Chung, and K. H. Choi, "Destructive Test of a BLDC Motor controller utilizing a Modified Classification Tree Method," KIPS Tr. Software and Data Eng., Vol.3, No.6 pp.201-214, piSSN: 2287-5905, March 21, 2014. https://doi.org/10.3745/KTSDE.2014.3.6.201
  12. P. M. Kruse and M. Luniak, "Automated test case generation using classification trees," Software Quality Professional Magazine, Vol.13, No.1, pp.4-12, 2010.
  13. The International Engineering Consortium, technical report, "Specification and Description Language(SDL)."
  14. AGEDIS Consortium, technical report, "Model Based Test Generation Tools."
  15. A. Hartman and K. Nagin, "The AGEDIS Tools for Model Based Testing," Proceedings of the 2004 ACM SIGSOFT International symposium on software testing and analysis, pp.129-132.
  16. Alexander Pretschner, "Model-Based Testing," Proceedings of the 27th interantional conference on Software engineering, pp.723-822.
  17. H. S. Park, "Generating Structural Test Cases for MATLAB Stateflow Model Using Rapidly-exploring Random Tree," Ajou Univ, Engineering doctoral dissertation, 2014.
  18. M. Utting and B. Legeard, "Practical Model-Based Testing: A Tools Approach," Morgan kaufmann, 2007.
  19. K. J. Hayhurst, D. S. Veerhusen, J. J. Chilenski, and L. K. Rierson, "A Practical Tutorial on Modified Condition/Decision Coverage," NASA, 2001.
  20. Yu Lei and K. C. Tai, "In-Parameter-Order: A Test Generation Strategy for Pairwise Testing," in Proceedings of the 3rd IEEE International High-Assurance Systems Engineering Symposium, pp.254-261, 1998.
  21. A. P. Mathur, "Foundations of Software Testing," Pearson Education, 2008.
  22. Junyeon Hwang, "Auto Test Script Generation Based on Checklist," Master Dissertation, Ajou University, Suwon, Korea, 2015.
  23. Joseph Schmuller, "Teach yourself UML in 24 Hours, 3/E," SAMS, 2004.
  24. Ivar Jacobson, "Object-Oriented Software Engineering: A Use-Case-Driven Approach," Addison-Wesley, 1992.
  25. Lvar Jacobson, Kurt Bittner, lan Spence, "Use Case Modeling," Addison-Wesley, 2002.
  26. Paul C. Jorgensen, "Software Testing: A Craftsman's Approach, 4/E," CRC Press, 2016
  27. U.S.NRC, "Fault Tree Handbook (NUREG-0492)," US, 1981
  28. Rick Kuhn, Raghu Kacker, Yu Lei, and Justin Hunter, "Combinatorial Software Testing," IEEE Computer Society, Vol.42, Issue 8, pp.94-96, August 2009.
  29. Kang Tae Hoon, Kim Dae Joon, Chung Ki Hyun, and Choi Kyung Hee, "A Method to Automatically Generate Test Scripts from Checklist for Testing Embedded System," KIPS, 2016 to be published.