DOI QR코드

DOI QR Code

GUI-based Black Box Test Automation Program Tool in Windows Environment

윈도우 환경에서의 GUI 기반 블랙박스 테스트 자동화 프로그램 도구

  • 정범진 (홍익대학교 컴퓨터정보통신공학과) ;
  • 이정우 (홍익대학교 컴퓨터정보통신공학과) ;
  • 홍창완 (홍익대학교 컴퓨터정보통신공학과) ;
  • 안병구 (홍익대학교 소프트웨어융합학과)
  • Received : 2018.02.20
  • Accepted : 2018.04.06
  • Published : 2018.04.30

Abstract

In this paper, we propose and develop a test automation program tool that automates GUI based testing using black box testing technique in Windows environment. The main features of the proposed test automation program tool are as follows. First, an error condition is designated as an image, a screen is captured for each test step, and an error message is detected through comparison of image similarity. Second, the proposed system supports various setting options such as event waiting time during execution and coordinate increment value between each test step. Such black box test automation research was common in environments such as Android and Web, but not in Windows environment. The results of performance evaluation show that the proposed system performs GUI test automation as an image comparison module and confirms that the test is performed normally by confirming process status and error image detection.

본 논문에서는 윈도우 환경에서 블랙박스 테스트 기법을 사용하여 GUI 기반 테스트를 자동화하는 테스트 자동화 프로그램 도구를 제안 및 개발한다. 제안된 테스트 자동화 프로그램 도구의 주요한 특징은 다음과 같다. 첫째, 에러 상태를 이미지로써 지정하고, 테스트 스텝마다 화면을 캡처하여 이미지 유사도 비교를 통해 에러 메시지 검출 여부를 확인한다. 둘째, 실행 중 이벤트 대기시간이나 각 테스트 스텝 간 좌표 증가 값 등 여러 옵션 설정을 지원한다. 이러한 블랙박스 테스트 자동화 연구는 안드로이드나 웹 등의 환경에서는 많았지만 윈도우 환경에서는 그렇지 않았다. 제안된 시스템의 성능평가 결과 제안된 시스템은 이미지 비교 모듈로써 GUI 테스트 자동화를 수행하고, 프로세스 상태 확인과 에러 이미지 검출 여부를 확인함으로써 테스트를 정상적으로 수행함을 확인하였다.

Keywords

References

  1. Jemin Lee, Hyungshin Kim, "A Black-Box based Testing for GUI Bug Detection," Journal of KIISE, 41(12), pp.1013-1017, December 2014. https://doi.org/10.5626/JOK.2014.41.12.1013
  2. JungGyuew Lee, HyeonSoo Kim, SeunGhak Kuk, DaeWan Cho, "Record-Playback based Automatic test case generation for GUI test," Proc. of KCC 2007, vol.34, no.1(B), pp.96-100, June 2007.
  3. Youngmin Baek, Gwangui Hong, Cheonghyun Lee, Doo-Hwan Bae, "A GUI State Comparison Technique for Effective Model-based Android GUI Testing," Journal of KIISE, JOK, vol.42, no.11, pp. 1386-1396, 2015. https://doi.org/10.5626/JOK.2015.42.11.1386
  4. OpenCV,"Template Matching," https://docs.opencv.org/3.0-last-rst/doc/tutorials/imgproc/hist ograms/template_matching/template_matching.html, December 2014.
  5. Wikipedia, "Fuzzing," https://ko.wikipedia.org/wiki/%ED%8D%BC%EC%A7%95, March 2016.
  6. Jung Gyw Lee, Seung Hak Kuk, Hyeon Soo Kim, "Test Cases Generation Method for GUI Testing with Automatic Scenario Generation," Journal of KISS : Software and Applications 36(1), pp.45-53, January 2009.
  7. Atif M. Memon, Martha E. Pollack and Mary Lou Soffa, Hierarchical GUI Test Case Generation Using Automated Planning, IEEE Transaction on Software Engineering, vol.27, no.2, pp.144-155, February 2001. https://doi.org/10.1109/32.908959
  8. Atif M. Memon, GUI Testing: Pitfalls and Process, IEEE Computer, pp.90-91, August 2002.
  9. Jessica Chen and Suganthan Subramaniam, Specification-based Testing for GUI-based Application, Software Quality Journal, vol.10, pp.205-224, 2002. https://doi.org/10.1023/A:1021634422504
  10. Li, Kanglin, Mengqi Wu, Effective GUI testing automation: Developing an automated GUI testing tool, John Wiley & Sons, 2006.
  11. Myers, Glenford J., Corey Sandler, and Tom Badgett, The art of software testing, John Wiley & Sons, 2011.
  12. Soeui Kim, Duri Choi, Beongku An, "Detection and Prevention Method by Analyzing Malignant Code of Malignant Bot," JIIBC, Vol. 13, No.2, pp.199-207, April 2013.
  13. Sungjik Choi, Minji Kim, Jeungwook Han, Beongku An, "Android Based Mobile Student Identity Card," JIIBC, Vol. 13, No.2, pp. 209-215, April 2013.