Browse > Article

An Improved Technique of Fitness Evaluation for Automated Test Data Generation  

Lee, Sun-Yul (부산대학교 컴퓨터공학과)
Choi, Hyun-Jae (부산대학교 컴퓨터공학과)
Jeong, Yeon-Ji (부산대학교 컴퓨터공학과)
Bae, Jung-Ho (부산대학교 컴퓨터공학과)
Kim, Tae-Ho (한국전자통신연구원 임베디드SW플랫폼연구팀)
Chae, Heung-Suk (부산대학교 컴퓨터공학과)
Publication Information
Journal of KIISE:Software and Applications / v.37, no.12, 2010 , pp. 882-891 More about this Journal
Abstract
Many automated dynamic test data generation technique have been proposed. The techniques evaluate fitness of test data through executing instrumented Software Under Test (SUT) and then generate new test data based on evaluated fitness values and optimization algorithms. Previous researches and experiments have been showed that these techniques generate effective test data. However, optimization algorithms in these techniques incur much time to generate test data, which results in huge test case generation cost. In this paper, we propose a technique for reducing the time of evaluating a fitness of test data among steps of dynamic test data generation methods. We introduce the concept of Fitness Evaluation Program (FEP), derived from a path constraint of SUT. We suggest a test data generation method based on FEP and implement a test generation tool, named ConGA. We also apply ConGA to generate test cases for C programs, and evaluate efficiency of the FEP-based test case generation technique. The experiments show that the proposed technique reduces 20% of test data generation time on average.
Keywords
Dynamic test data generation; optimization algorithms; fitness evaluation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 E. M. H. Alison Watkins, "Evolutionary test data generation: a comparison of fitness functions," Software: Practice and Experience, vol.36, pp.95-116, 2006.   DOI   ScienceOn
2 P. M. S. Bueno and M. Jino, "Identifìcation of potentially infeasible program paths by monitoring the search for test data," in Proceedings of the fifteenth IEEE international conference on Automated Software Engineering (ASE '00), pp.209-218, 2000.
3 Y. Zhan and J. A. Clark, "Search-based mutation testing for Simulink models," in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '05), Washington DC, USA: ACM, 2005.
4 Sagama R., and Lozano J. A., "On the performance of Estimation of Distribution Algorithms applied to software testing." Applied Artificial Intelligence, vol.19 no.5, pp.457-489, 2005.   DOI   ScienceOn
5 S. Ali, L. C. Briand, H. Hemmati, and K. R. Panesar-Walawege, "A systematic review of the application and empirical investigation of search based test-case generation," IEEE Transactions on Software Engineering, Accepted for future publication.   DOI
6 Michael CC, McGraw G, Schatz MA., "Generating software test data by evolution," IEEE Transactions On Software Engineering, vol.27, no.12, pp.1085-1110, 2001.   DOI   ScienceOn
7 E. Alba and F. Chicano, "Observations in using parallel and sequential evolutionary algorithms for automatic software testing," Computers ond Operations Research, vol.35, no.10, pp.3161-3183, 2008.   DOI   ScienceOn
8 T. Shiba, T. Tsuchiya, and T. Kikuno, "Using artificial life techniques to generate test cases for combinatorial testing," in Proceedings of the 28th Annual International Computer Software and Applications Conference (COMPSAC '04), pp.72-77, 2004.
9 KOREL, B, "Automated software test generation," IEEE Trans. Softw. Eng., vol.16, no.8, pp.870-879, 1990.   DOI   ScienceOn
10 R. Sagarna and J. A. Lozano, "Scatter search in software testing, comparison and collaboration with estimation of distribution algorithms," Euro pean Journal of Operational Research, vol.169, no.2, pp.392-412, 2006   DOI   ScienceOn
11 Man Xiao, Mohamed El-Attar, Marek Reformat, "Empirical evaluation of optimìzation algorithms when used in goal-oriented automated test data generation techniques," Empir Software Eng., vol. 12, pp.183-239, 2007.   DOI   ScienceOn
12 B. Beizer. Software Testing Techniques. International Thomson Computer Press, 1990.
13 Y. Zhan and J. A. Clark, "The state problem for test generation in Simulink," in Proceedings of the Genetic ond Evolutionary Computation Conference (GECCO '06), Seattle, Washington, USA: ACM, 2006.
14 Wang, H.-C, "A Hybrid Genetic Algorithm for Automatic Test Data Generation," Master's thesis, National Sun Yat-sen University, Department of Information Management, Taiwan, China, 2006.