Browse > Article
http://dx.doi.org/10.3837/tiis.2020.05.001

A Comprehensive Review on Regression Test Case Prioritization Techniques for Web Services  

Hasnain, Muhammad (School of Information Technology, Monash University Malaysia)
Ghani, Imran (Department of Mathematics and Computer Sciences, Indiana University of Pennsylvania)
Pasha, Muhammad Fermi (School of Information Technology, Monash University Malaysia)
Lim, Chern Hong (School of Information Technology, Monash University Malaysia)
Jeong, Seung Ryul (Graduate School of Business Information Technology, Kookmin University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.14, no.5, 2020 , pp. 1861-1885 More about this Journal
Abstract
Test Case Prioritization (TCP) involves the rearrangement of test cases on a prioritized basis for various services. This research work focuses on TCP in web services, as it has been a growing challenge for researchers. Web services continuously evolve and hence require reforming and re-execution of test cases to ensure the accurate working of web services. This study aims to investigate gaps, issues, and existing solutions related to test case prioritization. This study examines research publications within popular selected databases. We perform a meticulous screening of research publications and selected 65 papers through which to answer the proposed research questions. The results show that criteria-based test case prioritization techniques are reported mainly in 41 primary studies. Test case prioritization models, frameworks, and related algorithms are also reported in primary studies. In addition, there are eight issues related to TCP techniques. Among these eight issues, optimization and high effectiveness are most discussed within primary studies. This systematic review has identified that a significant proportion of primary studies are not involved in the use of statistical methods in measuring or comparing the effectiveness of TCP techniques. However, a large number of primary studies use 'Average Percentage of Faults Detected' (APFD) or extended APFD metrics to compute the performance of techniques for web services.
Keywords
Systematic Literature Review; Web Services; Regression Testing; Test Case Prioritization; Validation Metrics;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Rajarathinam, K., & Natarajan, S, "Test suite prioritization using trace events technique," IET Softw, 7(2), 85-92, 2013.   DOI
2 Wang, R., Jiang, S., Chen, D., & Zhang, Y, "Empirical Study of the Effects of Different Similarity Measures on Test Case Prioritization," Mathematical Problems in Engineering, vol. 2016, 1-19, 2016.
3 Maheswari, R. U., & JeyaMala, D, "A Novel Approach for Test Case Prioritization," in Proc. of the Computational Intelligence and Computing Research (ICCIC), 2013 IEEE International Conference, Enathi, India, 2013.
4 Felderer, M., & Schieferdecker, I, "A taxonomy of risk-based testing," Int J Softw Tools Technol Transfer, 16, 559-568, 2014.   DOI
5 Jiang, B., & Chan, W. K, "Input-based adaptive randomized test case prioritization: A local beam search approach," Journal of Systems and Software, 105, 91-106, 2015.   DOI
6 Tyagi, M., & Malhotra, S, "Test case prioritization using multi objective particle swarm optimizer," in Proc. of the Signal Propagation and Computer Technology (ICSPCT), 2014 International Conference, Ajmer, India, 2014.
7 Askarunisa, A., Punitha, K. A. J., & Ramaraj, N, "Test Case Generation and Prioritization for Composite Web Service Based on OWL-S," Neural Network World, 21(6), 519, 2011.   DOI
8 Kumar, L., Rath, S. K., & Sureka, A, "Using source code metrics to predict change-prone web services: A case-study on ebay services," in Proc. of Machine Learning Techniques for Software Quality Evaluation (MaLTeSQuE), IEEE Workshop on, pp. 1-7, 2017.
9 He, P., Li, B., Liu, X., Chen, J., & Ma, Y, "An empirical study on software defect prediction with a simplified metric set," Information and Software Technology, 59, 170-190, 2015.   DOI
10 Kery, M, Introduction to WinBUGS for EcologistsA Bayesian Approach to Regression, Anova, Mixed Models, and Related Analyses, Boston: Elsevier Inc., 2010.
11 Kitchenham, B., Brereton, P., David, B., Mark, T., Bailey, J., & Linkman, S, "Systematic literature reviews in software engineering - A systematic literature review," Information and Software Technology, 51(1), 7-15, 2009.   DOI
12 Kitchenham, B. A., Budgen, D., & Brereton, P, Evidence-Based Software Engineering and Systematic Reviews, Boca Raton, Florida: CRC Press, 2015.
13 Brereton, P., Kitchenham, B. A., Budgen, D., Turner,M., & Khalil,M, "Lessons from applying the systematic literature review process within the software engineering domain," Journal of systems and software, 80(4), 571-583, 2007.   DOI
14 Kazmi, R., Jawawi, D. N., Mohamad, R., & Ghani, I, "Effective regression test case selection: a systematic literature review," ACM Computing Surveys (CSUR), 50(2), 29, 2017.
15 Kitchenham, B. A., Brereton, P., Turner,M., Niazi,M. K., Linkman, S., Pretorius, R., & Budgen, D, "Refining the systematic literature review process two participant-observer case studies," Empir Software Eng, 15, 618-653, 2010.   DOI
16 Kitchenham, B, "Procedures for performing systematic reviews," Keele, UK, Keele University, 33(2004), 1-26, 2004.
17 Zhou, Y., Zhang, H., Huang, X., Yang, S., Babar, M. A., & Tang, H, "Quality Assessment of Systematic Reviews in Software Engineering: A Tertiary Study," in Proc. of the EASE '15: Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering, 2015.
18 Ham-Baloyi, W. t., & Jordan, P, "Systematic review as a research method in postgraduate nursing education," Health Sa Gesondheid, 21, 120-128, 2016.   DOI
19 Gao, D., Guo, X., & Zhao, L, "Test case prioritization for regression testing based on ant colony optimization," in Proc. of the Software Engineering and Service Science (ICSESS), 2015 6th IEEE International Conference, Beijing, China, 2015.
20 Tsai, W. T., Paul, R., Song, W., & Cao, Z, "Coyote: An xml-based framework for web services testing," in Proc. of High Assurance Systems Engineering, 2002. Proceedings. 7th IEEE International Symposium on, pp. 173-174, 2002.
21 Mei, L., Cai, Y., Jia, C., Jiang, B., Chan, W. K., Zhang, Z., & Tse, T. H, "A subsumption hierarchy of test case prioritization for composite services," IEEE Transactions on Services Computing, 8(5), 658-673, 2015.   DOI
22 Ryschka, S., Murawski, M., & Bick, M, "Location-Based Services," Bus Inf Syst Eng, 58(3), 233-237, 2016.   DOI
23 Nagar, R., Kumar, A., Singh, G. P., & Kumar, S, "Test Case Selection and Prioritization using Cuckoos Search Algorithm," in Proc. of the 2015 1st International Conference on Futuristic trend in Computational Analysis and Knowledge Management (ABLAZE-2015), Noida, India, 2015
24 Nardo, D. D., Alshahwan, N., Briand, L., & Labiche, Y, "Coverage-based regression test case selection, minimization and prioritization: a case study on an industrial system," SOFTWARE TESTING, VERIFICATION AND RELIABILITY, 25, 371-396, 2015.   DOI
25 Hemmati, H., Fang, Z., Mantyla, M. V., & Adams, B, "Prioritizing manual test cases in rapid release environments," SOFTWARE TESTING, VERIFICATION AND RELIABILITY, 27(6), 1-25, 2016.
26 Hettiarachchi, C., Do, H., & Choi, B, "Risk-based test case prioritization using a fuzzy expert system. Information and Software Technology, 69, 1-15.   DOI
27 Hao, D., Zhang, L., Zang, L., Wang, Y., Wu, X., & Xie, T, "To Be Optimal or Not in Test-Case Prioritization," IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 42(5), 490-504, 2016.   DOI
28 Kumar, S., Ranjan, P., & R.Rajesh, "Modified ACO to maintain diversity in Regression Test Optimization," in Proc. of the 3rd Int'l Conf. on Recent Advances in Information Technology, 2016.
29 Liu, C. H., Chen, S. L., & Chen, W.-K, "Cost-Benefit Evaluation on Parallel Execution for Improving Test Efficiency over Cloud," in Proc. of the Proceedings of the 2017 IEEE International Conference on Applied System Innovation IEEE-ICASI, Sapporo, Japan, 2017.
30 Garg, D., & Datta, A, "Parallel Execution of Prioritized Test Cases for Regression Testing of Web Applications," in Proc. of the ACSC '13 Proceedings of the Thirty-Sixth Australasian Computer Science Conference, Adelaide, Australia, 2013.
31 Parejoa, J. A., Sanchez, A. B., Seguraa, S., Ruiz-Cortes, A., Lopez-Herrejonb, R. E., & Egyed, A, "Multi-objective test case prioritization in highly configurable systems: A case study," The Journal of Systems and Software, 122, 287-310, 2016.   DOI
32 Ansari, A., Khan, A., Khan, A., & Mukadam, K, "Optimized Regression Test using Test Case Prioritization," Procedia Computer Science, 79, 152-160, 2016.   DOI
33 Catal, C., & Mishra, D, "Test case prioritization: a systematic mapping study," Software Qual J, 21, 445-478, 2013.   DOI
34 Mei, L., Chan, W. K., Tse, T. H., & Merkel, R. G, "XML-manipulating test case prioritization for XML-manipulating services," Journal of Systems and Software, 84(4), 603-619, 2011.   DOI
35 Chu, P.-H., Hsueh, N.-L., Chen, H.-H., & Liu, C.-H, "A test case refactoring approach for pattern-based software development," Software Qual J, 20, 43-75, 2012.   DOI
36 Srikanth, H., & Banerjee, S, "Improving test efficiency through system test prioritization," The Journal of Systems and Software, 85, 1176-1187, 2012.   DOI
37 Li, B., Qiua, D., Leungb, H., & Wanga, D, "Automatic test case selection for regression testing of composite service based on extensible BPEL flow graph," The Journal of Systems and Software, 85, 1300-1324, 2012.   DOI
38 Laranjeiro, N., Vieira,M., & Madeira, H, "A robustness testing approach for SOAPWeb services," J Internet Serv Appl, 3, 215-232, 2012.   DOI
39 Tahir, A., Tosi, D., & Morasca, S, "A systematic review on the functional testing of semantic web services," The Journal of Systems and Software, 86, 2877-2889, 2013.   DOI
40 Kazi, S., & Stamp, M, "Hidden Markov Models for Software Piracy Detection," Information Security Journal: A Global Perspective, 22, 140-149, 2013.   DOI
41 Dobolyi, K., Soechting, E., & Weimer, W, "Automating regression testing using web-based application similarities," Int J Softw Tools Technol Transfer, 13, 111-129, 2011.   DOI
42 Wang, Z., Zhao, X., Zou, Y., Yu, X., & Wang, Z, "IMPROVED ANNEALING-GENETIC ALGORITHM FOR TEST CASE PRIORITIZATION," COMPUTING AND INFORMATICS, 36(3), 705-732, 2017.   DOI
43 Siddiqui, J. H., & Khurshid, S, "Scaling symbolic execution using staged analysis," Innovations Syst Softw Eng, 9, 119-131, 2013.   DOI
44 Zhai, K., Jiang, B., Chan, W. K., & Tse, T. H, "Taking Advantage of Service Selection: A Study on the Testing of Location-Based Web Services through Test Case Prioritization," in Proc. of the Web Services (ICWS), 2010 IEEE International Conference, Miami, FL, USA, 2010.
45 Panigrahi, C. R., & Mall, R, "A heuristic-based regression test case prioritization approach for object-oriented programs," Innovations Syst Softw Eng, 10, 155-163, 2013.   DOI
46 Farrag, T. A., Saleh, A. I., & Ali, H. A, "Toward SWSs Discovery: Mapping from WSDL to OWL-S Based on Ontology Search and Standardization Engine," IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 25(5), 1135-1147, 2013.   DOI
47 Simon, B., Goldschmidt, B., & Kondorosi, K, "A Metamodel for the Web Services Standards," J Grid Computing, 11, 735-752, 2013.   DOI
48 Petry, F., Ladner, R., Gupta, K. M., Moore, P., Aha, D. W., Lin, B., & Sween, R, "Design of an Integrated Web services Brokering System," International Journal of Information Technology and Web Engineering, 4(3), 58-77, 2009.   DOI
49 Bozkurt, M., Harman, M., & Hassoun, Y, "Testing and verification in service-oriented architecture: a survey," SOFTWARE TESTING, VERIFICATION AND RELIABILITY, 23, 261-313, 2013.   DOI
50 Mei, L., Cai, Y., Jia, C., Jiang, B., & Chan,W. K, "Prioritizing Structurally Complex Test Pairs for Validating WS-BPEL Evolutions," in Proc. of the Web Services (ICWS), 2013 IEEE 20th International Conference, Santa Clara, CA, USA, 2013.
51 Kumar, G., & Bhatia, P. K, "Software testing optimization through test suite reduction using fuzzy clustering," CSI Transaction on ICT, 1(3), 253-260, 2013.   DOI
52 Ansari, A. S. A., Devadkar, K. K., & Gharpure, P, "Optimization of Test Suite- Test Case in Regression Test," in Proc. of the Computational Intelligence and Computing Research (ICCIC), 2013 IEEE International Conference, Enathi, India, 2013.
53 Xin, Q.,& Reiss, S. P, "Identifying Test-Suite-Overfitted Patches through Test Case Generation," in Proc. of the ISSTA 2017 Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis, Santa Barbara, CA, USA, pp. 226-236, 2017.
54 Smith, E. K., Barr, E. T., Goues, C. L., & Brun, Y, "Is the Cure Worse Than the Disease? Overfitting in Automated Program Repair," in Proc. of the ESEC/FSE 2015 Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, Bergamo, Italy, pp. 532-543, 2015.
55 Park, H., Ryu, H., & Baik, J, "Historical Value-Based Approach for Cost-cognizant Test Case Prioritization to Improve the Effectiveness of Regression Testing," in Proc. of the The Second International Conference on Secure System Integration and Reliability Improvement, Yokohama, Japan, 2008.
56 Li, Z., Harman,M., & Hierons, R. M, "Search Algorithms for Regression Test Case Prioritization," IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 23(4), 225-237, 2007.
57 Jones, J. A., & Harrold, M. J, "Test-Suite Reduction and Prioritization for Modified Condition/Decision Coverage," IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 29(3), 195-209, 2003.   DOI
58 Do, H., & Rothermel, G, "On the Use of Mutation Faults in Empirical Assessments of Test Case Prioritization Techniques," IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 32(9), 733-752, 2006.   DOI
59 Bai, X., Dai, G., Xu, D., & Tsai, W. T, "A multi-agent based framework for collaborative testing on web services," in Proc. of The Fourth IEEE Workshop on Software Technologies for Future Embedded and Ubiquitous Systems, and the Second International Workshop on Collaborative Computing, Integration, and Assurance (SEUS-WCCIA'06), pp. 205-210, 2006.
60 Di Penta, M., Bruno, M., Esposito, G., Mazza, V., & Canfora, G, "Web services regression testing," Test and Analysis of web Services, Springer, Berlin, Heidelberg, pp. 205-234, 2007.
61 Krishnamoorthi, R., & Mary, S. A. S. A, "Factor oriented requirement coverage based system test case prioritization of new and regression test cases," Information and Software Technology, 51, 799-808, 2009.   DOI
62 Zhang, X., Nie, C., Xu, B., & Qu, B, "Test Case Prioritization based on Varying Testing Requirement Priorities and Test Case Costs," in Proc. of the Seventh International Conference on Quality Software, Portland, OR, USA, 2007.
63 Sampath, S., Bryce, R. C., Viswanath, G., Kandimalla, V., & Koru, A. G, "Prioritizing User-Session-Based Test Cases for Web Applications Testing," in Proc. of the Software Testing, Verification, and Validation, 2008 1st International Conference, Lillehammer, Norway, 2008.
64 Roberts, F. S, "Computer science and decision theory," Ann Oper Res, 163, 209-253, 2008.   DOI
65 Gonzalez-Sanchez, A., Piel, E., Gross, R. A. H.-G., & Gemund, A. J. C. v, "Prioritizing tests for software fault diagnosis," SOFTWARE - PRACTICE AND EXPERIENCE, 41, 1105-1129, 2011.
66 Chawla, P., Chana, I., & Rana, A, "Cloud-based automatic test data generation framework," Journal of Computer and System Sciences, 82, 712-738, 2016.   DOI
67 Ma, T., Zeng, H., & Wang, X, "Test case prioritization based on requirement correlations," in Proc. of the Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), 2016 17th IEEE/ACIS International Conference, Shanghai, China, 2016.
68 Wang, X., & Zeng, H, "History-Based Dynamic Test Case Prioritization for Requirement Properties in Regression Testing," in Proc. of the Continuous Software Evolution and Delivery (CSED), IEEE/ACM International Workshop, Austin, TX, USA, pp. 41-47, 2016.
69 Panda, S.,Munjal, D., & Mohapatra, D. P, "A Slice-Based Change Impact Analysis for Regression Test Case Prioritization of Object-Oriented Programs," Advances in Software Engineering, vol. 2016, 1-20, 2016.
70 Alves, E. L. G., Machado, P. D. L., Massoni, T., & Kim, M, "Prioritizing test cases for early detection of refactoring faults," SOFTWARE TESTING, VERIFICATION AND RELIABILITY, 26, 402-426, 2016.   DOI
71 Kaur,M, "Testing in the Cloud: New Challenges," in Proc. of the Computing, Communication and Automation (ICCCA), 2016 International Conference, Noida, India, 2016
72 Sanchez, A. B., Segura, S., Parejo, J. A., & Ruiz-Cortes, A, "Variability Testing in the wild: the Drupal case study," Softw Syst Model, 16, 173-194, 2017.   DOI
73 Tahat, L., Korel, B., Koutsogiannakis, G., & Almasri, N, "State-based models in regression test suite prioritization," Software Qual J, 25, 703-742, 2017.   DOI
74 Elbaum, S.,Malishevsky, A. G., & Rothermel, G, "Test Case Prioritization: A Family of Empirical Studies," IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 28(2), 159-182, 2002.   DOI
75 International Business Machines Corporation, "Patent issued for method and system for ranking services in a web services architecture," From Journal of Engineering, 2013.
76 Masood, T., Nadeem, A., & Ali, S, "An Automated Approach to Regression Testing of Web Services based on WSDL Operation Changes," in Proc. of the Emerging Technologies (ICET), 2013 IEEE 9th International Conference, Islamabad, Pakistan, 2013.
77 Elbaum, S.,Malishevsky, A., & Rothermel, G, "Incorporating varying test costs and fault severities into test case prioritization," in Proc. of the 23rd International Conference on Software Engineering, IEEE Computer Society, pp. 329-338, 2001.
78 Rothermel, G., Untch, R. H., & Harrold, M. J, "Prioritizing Test Cases For Regression Testing," IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 27(10), 929-948, 2001.   DOI
79 Mostafa, S., Wang, X., & Xie, T, "PerfRanker: Prioritization of Performance Regression Tests for Collection-Intensive Sotware," in Proc. of the ISSTA 2017 Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis, Santa Barbara, CA, USA, pp. 23-34, 2017.
80 Athira, B., & Samuel, P, "Web services regression test case prioritization," in Proc. of the Computer Information Systems and Industrial Management Applications (CISIM), 2010 International Conference, Krackow, Poland, Poland, 2010.
81 Zhang, L., Hou, S. S., Guo, C., Xie, T., & Mei, H, "Time-aware test-case prioritization using integer linear programming," in Proc. of the eighteenth international symposium on Software testing and analysis, pp. 213-224, 2009,
82 Marchetto, A., Islam,M. M., Asghar, W., Susi, A., & Scanniello, G, "A Multi-Objective Technique to Prioritize Test Cases," IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 42(10), 918-940, 2016.   DOI
83 Huang, R., Zhou, Y., Zong, W., Towey, D., & Chen, J, "An Empirical Comparison of Similarity Measures for Abstract Test Case Prioritization," in Proc. of the Computer Software and Applications Conference (COMPSAC), 2017 IEEE 41st Annual, Turin, Italy, Italy, 2017.
84 Kitchenham, B. & Charters, S, "Guidelines for performing systematic literature reviews in software engineering version 2.3," Technical Report, 2007.
85 Thomas, S. W., Hemmati, H., Hassan, A. E., & Blostein, D, "Static test case prioritization using topic models. Empir Software Eng, 19, 182-212, 2014.   DOI
86 Do, H., & Hossain, M, "An efficient regression testing approach for PHP web applications: a controlled experiment," Softw. Test. Verif. Reliab, 24, 367-385, 2014.   DOI
87 Fang, C., Chen, Z., Wu, K., & Zhao, Z, "Similarity-based test case prioritization using ordered sequences of program entities," Software Qual J, 22, 335-361, 2014.   DOI
88 Zhai, K., Jiang, B., & Chan, W. K, "Prioritizing Test Cases for Regression Testing of Location-Based Services: Metrics, Techniques, and Case Study," IEEE TRANSACTIONS ON SERVICES COMPUTING, 7(1), 54-67, 2014.   DOI
89 Huang, P., Ma, X., Shen, D., & Zhou, Y, "Performance regression testing target prioritization via performance risk analysis," in Proc. of the ICSE 2014 Proceedings of the 36th International Conference on Software Engineering, Hyderabad, India, pp. 60-71, 2014.
90 Mei, L., Chan, W. K., Tse, T. H., Jiang, B., & Zhai, K, "Preemptive Regression Testing of Workflow-Based Web Services," IEEE TRANSACTIONS ON SERVICES COMPUTING, 8(5), 740-754, 2015.   DOI
91 Wang, X., Jiang, X., & Shi, H, "Prioritization of Test Scenarios using Hybrid Genetic Algorithm Based on UML Activity Diagram," in Proc. of the Software Engineering and Service Science (ICSESS), 2015 6th IEEE International Conference, Beijing, China, 2015.
92 Sampath, S., Bryce, R. e., & Memon, A. M, "A Uniform Representation of Hybrid Criteria for Regression Testing," IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 39(10), 1326-1344, 2013.   DOI
93 Qiu, D., Li, B., Ji, S., & Leung, H, "Regression Testing of Web Service: A Systematic Mapping Study," ACM Comput. Surv, 47(2), 1-46, 2014.
94 Mei, L., Zhang, Z., Chan, W. K., & Tse, T. H, "Test case prioritization for regression testing of service-oriented business applications," in Proc. of the 18th international conference on World wide web, pp. 901-910, 2009.
95 Chen, L., Wang, Z., Xu, L., Lu, H., & Xu, B, "Test case prioritization for web service regression testing," in Proc. of Service Oriented System Engineering (SOSE), 2010 Fifth IEEE International Symposium on, pp. 173-178, 2010.
96 Kayes, I., Islam, S., & Chakareski, J, "The network of faults: a complex network approach to prioritize test cases for regression testing," Innovations Syst Softw Eng, 11, 251-275, 2015.
97 Emam, S. S., & Miller, J, "Test case prioritization using extended digraphs," ACM Trans. Softw. Eng. Methodol, 25(1), 1-41, 2015.   DOI
98 Elbaum, S., Rothermel, G., & Penix, J, "Techniques for improving regression testing in continuous integration development environments," in Proc. of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, pp. 235-245, 2014,
99 Hillah, L. M.,Maesano, A.-P., Rosa, F. D., Kordon, F.,Wuillemin, P.-H., Fontanelli, R., Maesano3, L, "Automation and intelligent scheduling of distributed system functional testing," Int J Softw Tools Technol Transfer, 19, 281-308, 2017.   DOI
100 Do, H., Mirarab, S., Tahvildari, L., & Rothermel, G, "The Effects of Time Constraints on Test Case Prioritization: A Series of Controlled Experiments," IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 36(5), 593-617, 2010.   DOI
101 Anwar, Z., Ahsan, A., & Catal, C, "Neuro-Fuzzy Modeling for Multi-Objective Test Suite Optimization," J. Intell. Syst, 25(2), 123-146, 2016.   DOI
102 Walcott, K. R., Soffa, M. L., Kapfhammer, G. M., & Roos, R. S, "TimeAware Test Suite Prioritization," in Proc. of the ISSTA'06, Portland, Maine, USA, pp. 1-12, 2006.
103 Sampath, S., & Bryce, R. C, "Improving the effectiveness of test suite reduction for user-session-based testing of web applications," Information and Software Technology, 54(7), 724-738, 2012.   DOI
104 Kundu, D., Sarma, M., Samanta, D., & Mall, R, "System testing for object-oriented systems with test case prioritization," SOFTWARE TESTING, VERIFICATION AND RELIABILITY, 19, 297-333, 2009.   DOI
105 Li, J. & Xing, D, "User Session Data based Web Applications Test with Cluster Analysis," in Proc. of Advanced Research on Computer Science and Information Engineering: International Conference, CSIE 2011, Zhengzhou, China, May 21-22, 2011. Proceedings, Part I, Berlin, Heidelberg: Springer Berlin Heidelberg, pp. 415-421, 2011.
106 Bai, X., Kenett, R. S., & Yu, W, "Risk assessment and adaptive group testing of semantic web services," International Journal of Software Engineering and Knowledge Engineering, 22(05), 595-620, 2012.   DOI
107 Jiang, B., Zhang, Z., Chan, W. K., Tse, T. H., & Chen, T. Y, "How well does test case prioritization integrate with statistical fault localization?," Information and Software Technology, 54, 739-758, 2012.   DOI
108 Fang, C., Chen, Z., & Xu, B, "Comparing logic coverage criteria on test case prioritization," Science China Information Sciences, 55(12), 2826-2840, 2012.   DOI
109 Zhu, H., & Zhang, Y, "Collaborative Testing of Web Services," IEEE TRANSACTIONS ON SERVICES COMPUTING, 5(1), 116-130, 2012.   DOI
110 Yoo, S., & Harman, M, "Regression testing minimization, selection and prioritization: a survey," Softw. Test. Verif. Reliab, 22, 67-120, 2012.   DOI
111 Ledru, Y., Petrenko, A., Boroday, S., & Mandran, N, "Prioritizing test cases with string distances," Autom Softw Eng., 19, 65-95, 2012.   DOI