Browse > Article
http://dx.doi.org/10.9709/JKSS.2011.20.3.019

Adaptive Random Testing for Integrated System based on Output Distribution Estimation  

Shin, Seung-Hun (아주대학교 정보컴퓨터공학부)
Park, Seung-Kyu (아주대학교 정보컴퓨터공학부)
Choi, Kyung-Hee (아주대학교 정보컴퓨터공학부)
Jung, Ki-Hyun (아주대학교 전자공학부)
Publication Information
Journal of the Korea Society for Simulation / v.20, no.3, 2011 , pp. 19-28 More about this Journal
Abstract
Adaptive Random Testing (ART) aims to enhance the performance of pure random testing by detecting failure region in a software. The ART algorithm generates effective test cases which requires less number of test cases than that of pure random testing. However, all ART algorithms currently proposed are designed for the tests of monolithic system or unit level. In case of integrated system tests, ART approaches do not achieve same performances as those of ARTs applied to the unit or monolithic system. In this paper, we propose an extended ART algorithm which can be applied to the integrated system testing environment without degradation of performance. The proposed approach investigates an input distribution of the unit under a test with limited number of seed input data and generates information to be used to resizing input domain partitions. The simulation results show that our approach in an integration environment could achieve similar level of performance as an ART is applied to a unit testing. Results also show resilient effectiveness for various failure rates.
Keywords
Random Testing; Adaptive Random Testing; Integration Test; Test Case Generation; Simulation;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 S.H. Shin, S.K. Park, K.H. Choi and K.H. Jung, "Normalized adaptive random test for integration test," Proceedings of the 2nd IEEE International Workshop on Software Test Automation, pp. 335-340, Jul. 2010.
2 M. Sutton, A. Greene and P. Amini, Fuzzing, brute force vulnerability discovery, Addison-Wesley, pp. 387-416, 2007.
3 신승훈, 박승규, "입력 도메인 확장을 이용한 반복 분할 기반의 적응적 랜덤 테스팅 기법," 한국정보처리학회논문지 D, 15-D(4), pp. 531-540, 2008년 8월.
4 G.B. Finelli, "NASA software failure characterization experiments," Reliability Engineering and System Safety, vol. 32, issues 1-2, pp. 155-169, 1991.   DOI
5 신승훈, 박승규, 최경희, "테스트 케이스 분포 조절을 통한 IP-ART 기법의 성능 향상 정책," 정보과학회논문지 : 소프트웨어 및 응용, 36(6), pp. 451-461, 2009년 6월.
6 F.T. Chan, T.Y. Chen, I.K. Mak and Y.T. Yu, "Proportional sampling strategy: guidelines for software testing practitioners," Information and Software Technology, vol. 38, issue 12, pp. 775-782, Dec. 1996.   DOI   ScienceOn
7 K.P. Chan, T.Y. Chen and D. Towey, "Restricted random testing," Proc. of the 7th International Conference on Software Quality, LNCS 2349, pp. 321-330, 2002.
8 T.Y. Chen, D.H. Huang and Z.Q. Zhou, "Adaptive random testing through iterative partitioning," Proc. of the 11th International Conference on Reliable Software Technologies, LNCS 4006, pp. 155-166, 2006.
9 T.Y. Chen, H. Leung and I.K. Mak, "Adaptive random testing," Proc. of the 9th Asian Computing Science Conference, LNCS 3321, pp. 320-329, 2004.
10 T.Y. Chen and R. Merkel, "Efficient and effective random testing using the voronoi diagram," Proceedings of the 2006 Australian Software Engineering Conference, pp. 300-305, Apr. 2006.
11 V. Ganesh, T. Leek and M. Rinard (2009), "Taint-based directed whitebox fuzzing," Proceedings of the 31st International Conference on Software Engineering, pp. 474-484, May. 2009.
12 R. Hamlet, "Random testing," Encyclopedia of Software Engineering, Wiley, pp. 970-978, 1994.
13 J. Mayer, "Adaptive random testing by bisection and localization," Proc. of the 5th International Workshop on Formal Approaches to Testing of Software, LNCS 3997, pp. 72-86, 2006.
14 W.H. Press, S.A. Teukolsky, W.T. Vetterling and B.P. Flannery, Numerical recipes in C++, the art of scientific computing, 2nd Ed., Cambridge University Press, pp. 237, 631, 2002
15 J. Mayer and C. Schneckenburger, "Adaptive random testing with enlarged input domain," Proceedings of the 6th International Conference on Quality Software, pp. 251-258, Oct. 2006.
16 B.P. Miller, L. Fredriksen and B. So, "An empirical study of the reliability of UNIX utilities," Communications of the ACM, vol. 33, issue 12, pp. 32-44, Dec. 1990.   DOI
17 A.B.M. Omar Faruk, "Testing & exploring vulnerabilities of the applications implementing DNP3 protocol," Master Thesis, KTH Royal Institute of Technology, Aug. 2008.