The KIPS Transactions:PartD (정보처리학회논문지D)

Korea Information Processing Society (한국정보처리학회)
권호 표지

Automatic Test Data Generation for Mutation Testing Using Genetic Algorithms

유전자 알고리즘을 이용한 뮤테이션 테스팅의 테스트 데이터 자동 생성

  • 정인상 (한성대학교 정보전산학부) ;
  • 창병모 (숙명여자대학교 정보과학부)
  • Published : 2001.02.01
Download PDF
⟨ Previous Next ⟩

Abstract

one key goal of software testing is to generate a 'good' test data set, which is consideres as the most difficult and time-consuming task. This paper discusses how genetic algorithns can be used for automatic generation of test data set for software testing. We employ mutation testing to show the effectiveness of genetic algorithms (GAs) in automatic test data generation. The approach presented in this paper is different from other in that test generation process requireas no lnowledge of implementation details of a program under test. In addition, we have conducted some experiments and compared our approach with random testing which is also regarded as a black-box test generation technique to show its effectiveness.

소프트웨어 테스팅의 중요 목표 중의 하나는 '좋은' 테스트 데이터 집합을 생성하는 것으로 이는 매우 어렵고 시간이 걸리는 작업이다. 본 논문은 소프트웨어 테스팅을 위한 자동 테스트 데이터 집합 생성에 유전자 알고리즘을 적용하는 방법을 제시하며 자동 테스트 데이터 생성에서 유전자 알고리즘의 효용성을 보이기 위해 유테이션 테스팅을 도입한다. 본 연구는 테스트 데이터 생성 과정이 테스트 대상 프로그램의 구현에 대한 지식을 필요로하지 않는다는 점에서 다른 방법들과 다르다. 또한, 제안된 방법의 효율성을 보이기 위하여 몇 가지 실험을 통해서 블랙박스 테스트 생성 기법은 랜덤 테스팅과 비교한다.

Keywords

References

  1. H. Agrawal, R. A. DeMillo, R. Hataway, W. Hsu, W. Hsu, E. W. Krauser, R. J. Martin, and A. P. Mathur, 'Design of Mutant Operators for C Programming Language,' Technical Report SERC-TR-41-P, Software Engineering Research Center, Purdue Univ., March, 1989
  2. L. A. Clarke, 'A System to Generate Test Data and Symbolically Execute Programs,' IEEE Transactions on Software Engineering, Vol.SE-2, pp.215-222, Sept. 1976
  3. D. E. Delamaro, J. C. Maldonado, and A. P. Mathur, 'Proteum-A Tool for the Assessment of Test Adequacy for C Programs-User's Guide,' Technical Report SERC-TR-168-P, Software Engineering Research Center, Purdue Univ., Apr., 1996
  4. R. A. DeMillo, R. J. Lipton, and F. G. Sayward,'Hints on Test Data Selection : Help for the Practicing Programmar,' in IEEE Computer, Vol.SE-11(4), pp.34-41, Apr. 1978 https://doi.org/10.1109/C-M.1978.218136
  5. R. A. DeMillo and A. J. Offutt,'Constraint-Based Automatic Test Data Generation,' IEEE Transactions on Software Engineering, Vol.17, No.9, pp.900-910, Sept. 1991 https://doi.org/10.1109/32.92910
  6. D. E. Goldberg,'Genetic Algorithms in Search, Optimization Machine Learning,' Addison-Wesley, Reading, Massachusetts, 1989
  7. J. Hartman and D. J. Robson, 'Approaches to Regression Testing,' in Proceedings of IEEE Conference on Software Maintenance, Los Alarnitos, Calif., pp.368-372, 1988 https://doi.org/10.1109/ICSM.1988.10189
  8. J. H. Holland, 'Adaption in Natural and Artificial Systems,' Ann Arbor: The University of Michigan Press. 1975
  9. B. F. Jones, H.-H. Sthamer and D. E. Eyres, 'Automatic Structural Testing Using Genetic Algorithms,' Software Engineering Journal, pp.299-306, Sept., 1996
  10. Y. K. Malaiya, 'Antirandom Testing : Getting the Most out of Black-Box Testing,' Technical Report CS-96-129, Colorado State Univ., 1996
  11. A. P. Mathur, 'Performance, Effectiveness, and Reliability Issues in Software Testing,' Proceedings of the Fifteenth Annual International Computer Software and Applications Conference, pp.604-605, Tokyo, Japan, Sept., 1991 https://doi.org/10.1109/CMPSAC.1991.170248
  12. A. P. Mathur and W. E. Wong, 'An Empirical Comparison of Mutation and Data Flow Based Test Adequacy Criteria,' Technical Report SERC-TR-135-P, Software Engineering Research Center, Purdue Univ., 1993
  13. A. P. Mathur and W. E. Wong, 'Evaluation of the Cost of Alternate Mutation Testing Strategies,' Technical Report SERC-TR-138-P, Software Engineering Research Center, Purdue Univ., 1993
  14. J. Voas, L. Morell, and K. Miller,'Predicting Where Faults Can Hide from Testing,' IEEE Software, pp.41-48, March, 1991 https://doi.org/10.1109/52.73748
  15. A. L. Watkins, 'A Tool for the Automatic Generation of Test Data Using Genetic Algorithms,' in Proceedings of Software Quality Conference, Dundee, Scotland, 1995
  16. H. Yin, Z. Lehne-Dengel and Y. K. Malaiya, 'Automatic Test Generation using Checkpoint Encoding and Antirandom Testing,' in Proceedings of International Symposium on Software Reliability Engineering, pp.84-95, Oct., 1997 https://doi.org/10.1109/ISSRE.1997.630850