Computing Method for The Number of The Interaction Strength Based on Software Whitebox Testing

소프트웨어 화이트박스 테스트의 교호 강도 수 기반 테스트 방법

  • Published : 2009.09.25

Abstract

Cost and Time for software test is gradually increasing as the software complexity increases. To cope with this problem, it is very important to reduce the number of test cases used in the software test. The interaction strength number is especially important in decision of the number of test cases for the unit test, where the interaction strength number means the number of arguments which affect the results of a function by the analysis of their combination used in source code of the function. This paper proposes the algorithm that computes the number of the interaction strength, where analyzes the patterns used in the source code of a function and increase its number when the pattern matches one of the specified patterns. The proposed algorithm is validated by some experiments finding coverage and the number of fault detection.

소프트웨어가 복잡할수록 소프트웨어의 테스트에 들어가는 비용과 시간이 점점 증가되고 있는 문제점이 존재한다. 이러한 문제를 해결하기 위해서는 테스트에 사용되는 테스트 케이스의 수를 줄이는 것이 중요하다. 특히 단위 테스트 케이스 수를 결정하는 것에는 교호강도의 수가 중요한데 교호강도 수는 소스에서 인자간의 조합에 의해 함수의 결과에 영향을 미치는 인자들의 수를 말한다. 본 논문에서는 프로그램 코드 상에서 인자의 사용 패턴을 분석하여 특정 패턴이 되면 교호 강도 수를 늘리고 최종적으로 교호 강도수를 결정할 수 있는 방법을 제시한다. 제안하는 방법의 효과를 커버리지 및 결함 발견 수의 항목으로 실험을 통해 증명한다.

Keywords

References

  1. D. Richard Kuhn, Dolores R. Wallace, Albert M. Gallo Jr., 'Software Fault Interactions and Implications for Software Testing,' IEEE transactions on Software Engineering, vol. 30, no. 6, pp. 418-421, June 2004 https://doi.org/10.1109/TSE.2004.24
  2. David M. Cohen, Siddhartha R. Dalal, Michael L. Fredman, Gardner C. Patton, 'The AETG System: An Approach to Testing Based on Combinatorial Design,' IEEE transactions on Software Engineering, vol. 23, no. 7, July 1997 https://doi.org/10.1109/32.605761
  3. Lei, Y and Tai, K. C., In-Parameter-Order: A Test Generating Strategy for Pairwise Test- ing, High-AssuranceSystems Engineering Symposium, 1998. Proceedings. Third IEEE International 13-14 pp. 254-261, November 1998 https://doi.org/10.1109/HASE.1998.731623
  4. R. Mandle, 'Orthogonal Latin squares: An application of experimental design to compiler testing,' Communication of the ACM, vol. 28 no. 10 pp. 1054-1058, 1985 https://doi.org/10.1145/4372.4375
  5. R. Brownlie, J Prowse, and M.S. Phadke, 'Robust Testing of AT&T PMX/StarMAIL Using OATS,' AT&T Technical Journal, Vol. 71 No. 3, pp. 41-47, May/June 1992 https://doi.org/10.1002/j.1538-7305.1992.tb00164.x
  6. Soumen Maity, Amiya Nayak, 'Improved Test Generation Algorithms for Pair-Wise Testing,' Proc. 16th IEEE International Symposium on Software Reliability Engineering, pp. 244-253, November 2005
  7. M. B. Cohen, C. J. Colbourn, J.S. Collofello, P. B. Gibbons and W. B. Mugridge, 'Variable Strength Interaction Testing of Components,' In Proc. of the Intl. Computer Software and Applications Conference, (COMPSAC 2003), Dallas TX, pp. 413-418, 2003 https://doi.org/10.1109/CMPSAC.2003.1245373
  8. M. B. Cohen, C. J. Colbourn and A.C.H. Ling, 'Augmenting simulated annealing to build interaction test suites,' 14th IEEE Intl. Symp. on Software Reliability Engineering(ISSRE 2003), Denver CO, pp. 394-405, November 2003 https://doi.org/10.1109/ISSRE.2003.1251061
  9. http://burtleburtle.net/bob/math/jenny.html
  10. Y. Lei, R. Kacker, D. R. Kuhn, V. Okun, and J. Lawrence. IPOG: A general strategy for t-way software testing. In Fourteenth Int. Conf. Engineering Computer-Based Systems. pp.549–556, March 2007