KIPS Transactions on Software and Data Engineering (정보처리학회논문지:소프트웨어 및 데이터공학)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

A Method to Automatically Generate Test Scripts from Checklist for Testing Embedded System

임베디드 시스템 테스팅을 위한 체크리스트로부터 테스트 스크립트 자동 생성 방안

  • Received : 2016.04.21
  • Accepted : 2016.07.01
  • Published : 2016.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a method to generate test scripts in an automatic manner, based on checklist used for testing embedded systems in the fields. The proposed method can reduce the mistakes which may be introduced during manual generation. In addition, it can generate test scripts to test various mode combinations, which is not possible to be tested by the typical checklist. The test commands in a checklist are transformed into a test script suit referencing the signal values defined in a test command dictionary. In addition, the method to generate test scripts in sequential, double permutation and random manners is proposed useful to test the inter-operations between modes, a series of operations for a specific behavior. The proposed method is implemented and the feasibility is shown through the experiments.

본 논문은 임베디드 시스템 테스트를 위해 산업현장에서 많이 사용하는 체크리스트를 기반으로 테스트 스크립트를 자동으로 생성하기 위한 방법을 제안한다. 제안하는 방법은 수동 생성에서 발생할 수 있는 오류를 줄일 수 있을 뿐만 아니라, 기존의 체크리스트로는 테스트하지 못하는 다양한 모드 조합을 테스트하기 위한 테스트 스크립트도 생성할 수 있다. 체크리스트에 있는 테스트 명령어는 테스트 명령어 사전에 정의된 신호 값을 참조하여 테스트 스크립트로 변환된다. 또한, 체크리스트를 정의된 일련의 연관된 동작의 집합인 모드들 간의 동작을 확인할 수 있게 하는 순차적, Double permutation 및 무작위 방법으로 테스트 스크립트를 생성할 수 있는 방법을 제안한다. 제안된 방법은 구현되었고, 실험을 통해 그 가능성을 보여준다.

Keywords

References

  1. J. Y. Seo, A. Y. Sung, B. J. Choi, and S. B. Kang, "Automating Embedded software Testing on an Emulated Target Board," Proc. of the Second International Workshop on Automation of Software Test, 20-26 May, 2007.
  2. S. Y. Jeong, Y. W. Chang, and C. J. Yoo, "Test Case Genration Technique Based on State Transition Model for Embedded System," Journal of Korean Institute of Information Technology, Vol.9, No.4, pp.11-21, 2011.
  3. M. R. Keyvanpour, H. Homayouni, and Hossein Shirazee, "Automatic Software Test Case Generation: An Analytical Classification Framework," International Journal of Software Engineering and Its Applications, Vol.6, No.4, Oct., 2012.
  4. T. Y. Chen, H. Leung, and I. K. Mak, "Adaptive random testing," in Proceedigns of the 9th Asian computaing Science Conference, volum 3321 of Lecture Notes in Computer Science, pp.320-329, 2004
  5. Kuo Chung Tai and Yu Lei, "A Test Generation Strategy for Pairwise Testing," IEEE Transactions on Software Engineering, Vol.28, No.1, pp.109-111, Jan., 2002. https://doi.org/10.1109/32.979992
  6. K. P. Chan, T. Y. Chen, and Dave Towey, "Restricted Random Testing," in Proceedings of the 7th European Conference on Software Quality Helsinki, Finland, Vol.2349/2002 of Lecture Notes in Computer Science, pp.321-330, Jun., 2002.
  7. M. Conrad, H. Dorr, I. Fey, and A. Yap, "Model-based Generation and Structured Representation of Test Scenarios," Workshop on Software-Embedded Systems Testing (WSEST), Gaithersburg, USA, Nov., 1999.
  8. P. S. Loo and W. K. Tsai, "Random Testing Revisited," Information and Software Technology, Vol.30, Iss.7, pp.402- 417, Sep., 1988 https://doi.org/10.1016/0950-5849(88)90037-7
  9. T. Y. Chen, F. C. Kuo, Huai Liu, and W. E. Wong, "Does Adaptive Random Testing Deliver a Higher Confidence than Random Testing?" The Eighth International Conference on Quality Software, QSCI'08, pp.145-154, Aug., 2008.
  10. M. Grochtmann and K. Grimm, "Classification Trees for Partition Testing," Software Testing, Verification & Reliability, Vol.3, No.2, pp.63-82, Jun., 1993. https://doi.org/10.1002/stvr.4370030203
  11. J. H. Shin, K. H. Chung, and K. H. Choi, "Destructive Test of a BLDC Motor controller utilizing a Modified Classification Tree Method," KIPS Tr. Software and Data Eng., Vol.3, No.6, pp.201-214, piSSN: 2287-5905, Mar., 2014. https://doi.org/10.3745/KTSDE.2014.3.6.201
  12. P. M. Kruse and M. Luniak, "Automated test case generation using classification trees," Software Quality Professional Magazine, 2010.
  13. The International Engineering Consortium, Technical Report, "Specification and Description Language(SDL)."
  14. AGEDIS Consortium, Technical Report, "Model Based Test Generation Tools."
  15. A. Hartman and K. Nagin, "The AGEDIS Tools for Model Based Testing," Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis, pp.129-132.
  16. Alexander Pretschner, "Model-Based Testing," Proceedings of the 27th Interantional Conference on Software Engineering, pp.723-822.
  17. H. S. Park, "Generating Structural Test Cases for MATLAB Stateflow Model Using Rapidly-exploring Random Tree," Ajou Univ, Engineering doctoral dissertation, 2014.
  18. M. Utting and B. Legeard, "Practical Model-Based Testing: A Tools Approach," Morgan kaufmann, 2007.
  19. K. J. Hayhurst, D. S. Veerhusen, J. J. Chilenski, and L. K. Rierson, "A Practical Tutorial on Modified Condition/Decision Coverage," NASA, 2001.
  20. Yu Lei and K. C. Tai, "In-Parameter-Order: A Test Generation Strategy for Pairwise Testing," High-Assurance Systems Engineering Symposium, Proceedigns. 3rd IEEE International, 1998.
  21. A. P. Mathur, "Foundations of Software Testing," Pearson Education, 2008.
  22. Junyeon Hwang, "Auto Test Script Generation Based on Checklist," Master Dissertation, Ajou University, Suwon, Korea, 2015.
  23. Joseph Schmuller, "Teach yourself UML in 24 Hours, 3/E," SAMS, 2004.
  24. Ivar Jacobson, "Object-Oriented Software Engineering: A Use-Case-Driven Approach," Addison-Wesley, 1992.
  25. lvar Jacobson, Kurt Bittner, and lan Spence, "Use Case Modeling," Addison-Wesley, 2002.
  26. Paul C. Jorgensen, "Software Testing: A Craftsman's Approach, 4/E," CRC Press, 2016.
  27. U. S. NRC, "Fault Tree Handbook (NUREG-0492)," US, 1981.
  28. Rick Kuhn, Raghu Kacker, Yu Lei, and Justin Hunter, "Combinatorial Software Testing," IEEE, 2009.