Browse > Article
http://dx.doi.org/10.9708/jksci.2018.23.02.009

A New Exploratory Testing Method for Improving the Effective IP Set-Top Box Test  

Kim, Donghyun (Dept. of Computer and Communications Engineering, Kangwon National University)
Kim, Yoon (Dept. of Computer and Communications Engineering, Kangwon National University)
Abstract
Recently, as various IP set-top boxes based on Android OS have been widely used in general households and public facilities, complaints about services and set-top boxes have continued to increase as much as other smart devices. In order to reduce this problem, the manufacturer performs the testing work before the product is commercialized. However, the testing can reduce potential defects in the product, but it can not prove that the product is free of defects. Therefore, the quality of the product can vary depending on how effective testing techniques are introduced. In this paper, we propose a new exploratory testing method that minimizes test case creation time and makes it easier to plan and execute test while simultaneously learning how to run the product under test. Using the first proposed method, the test time is reduced by about 16.7 hours and the defect detection rate is 25.4% higher than the formal specification-based testing method. Informally, the test time was shortened by about 4.7 hours and the defect detection rate was 13% higher than the informal experience-based testing method.
Keywords
IP Set-Top Box; Exploratory testing; Specification based testing; Experience based testing; Test time; Defect detection rate;
Citations & Related Records
연도 인용수 순위
  • Reference
1 KIBA, KAIT, KEA, "IPTV Subscriber status", 2016.
2 Broekman, E. Notenboom, "Testing Embedded Software Addison-Wesley", 2003.
3 J. Regehr, "Random testing of interrupt-driven software", In Proc. of the Conf. on Embedded Software (EMSOFT), pp.290, pp.298, 2005.
4 Wonil Kwon, Christen Eunyoung Park, Hyunjoo Lee, and Hyungil Cho, "Developers Need to Know Practice of Software Testing," the third edition, STA Testing consulting, pp.92, 2012.
5 ISO/IEC/IEEE DIS 29119 - 4 Software and Systems Engineering - Software Testing - Part 4: Test Techniques.
6 NIPA, STA Testing consulting, "Software Testing Practice Guide," STA, pp.197, 2012.
7 Wikipedia(IPTV), http://ko.wikipedia.org/wiki/IPTV.
8 TTA Journal, Changsik Jo and Pyeongsu Ma, "IP Set top box SW platform technology," pp.68, 2004.
9 Junkeun Kim and Sungjin Choi, "A Study on the Analysis of Similarities between IPTV and DCATV," Seoul Univ, Master's thesis, pp.23, 2008.
10 MKE,NIPA, "Open Source Software Test Guide," pp.4, 2012.
11 Kyungsu Kim and Yongsuk Kim, "A Performance Evaluation of Software Testing Methods for Medical Devices," Kangwon Univ, Master's thesis, pp.23, 2013.
12 TTA Journal, Changsik Jo and Pyeongsu Ma, "IP Set top box SW platform technology," pp.67, 2004.
13 Jaechul Lee and Yoon Kim, "Wi-Fi Directional Test Simplification for Smart Set-Top Box Based on Pair-Wise Testing," Journal of the Korea Society of Computer and Information, Vol. 20, No. 3, pp.1-8, 2015.   DOI
14 Seunghee Choi and Gooyeun Lee, "A Study of Test Design Framework (R-TDF) Based on Information System Requirement," Kangwon Univ, Master's thesis, pp.30, 2013.
15 Jonghyun Park and Myunghee Seo, "Research of Audit Detail Check Method for Applied Systems Using Black Box Testing," Konkuk Univ, Master's thesis, pp.25, 2013.
16 Wonil Kwon, Christen Eunyoung Park, Hyunjoo Lee, and Hyungil Cho, "Developers Need to Know Practice of Software Testing," the third edition, STA Testing consulting, pp.153, 2012.
17 NIPA,STA Testing consulting, "Software Testing Practice Guide," STA, pp.209, 2012.
18 James Back, "What is Exploratory Testing?," Satisfice Inc, articles, 2017.
19 Wikipedia(PMI), http://ko.wikipedia.org/wiki/PMI
20 ISTQB, "Certified Tester Foundation Level Syllabus," pp.14, 2011.
21 Jonggu Kim and Hoyeol Kwon, "Improvement of Software Testing Quality for Medical Ultrasound System Using Exploratory Testing," Journal of the Institte of Electronics and Information Engineers, pp.691-693, 2012.
22 Sooyong Jeong○, Tae-San Baek, Bueng Il Hwang, Woo Jin Lee, "A Testing on Robustness of Embedded Software Based on Software-in-the-Loop Simulation," Journal of the Korea Society of Computer and Information, pp.5-8, 2015.
23 Jangwoo Cho and Cheolhwan Jung, "An Effective Method of Testing Application Software of Smart Sensors," Journal of the Korea Society of Computer and Information, pp.105-111, 2013.
24 Jinho Lee ,Cheolhyun Jung, Seunggun Gang, Hyunwoo Jo, Jemyung Lee, Myungjoo Gang, Changil Park, Hyunjoo Ooh, Sangjung Kim, and Jongwon Lee, "Games QA using Checklists Technique," Journal of the Korea Society of Computer and Information, pp.307-310, 2014.
25 DongGyu Kwak, Chae-Woo Yoo, Jaeyoung Choi, "A Design and Implementation of Reliability Analyzer for Embedded Software using Markov Chain Model and Unit Testing," Journal of the Korea Society of Computer and Information, pp.1-10, 2011.