Browse > Article
http://dx.doi.org/10.3837/tiis.2021.08.015

Personality Characteristic-based Enhanced Software Testing Levels for Crowd Outsourcing Environment  

Kamangar, Zainab U. (Department of Software Engineering, Mehran University of Engineering and Technology)
Siddiqui, Isma Farah (Department of Software Engineering, Mehran University of Engineering and Technology)
Arain, Qasim Ali (Department of Software Engineering, Mehran University of Engineering and Technology)
Kamangar, Umair A. (Department of Software Engineering, Mehran University of Engineering and Technology)
Qureshi, Nawab Muhammad Faseeh (Department of Computer Education, Sungkyunkwan University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.15, no.8, 2021 , pp. 2974-2992 More about this Journal
Abstract
Crowd-based outsourcing is an emerging trend in testing, which integrates advantages of crowd-based outsourcing in software testing. Open call format is used to accomplish various network tasks involving different types of testing levels and techniques at various places by software testers. Crowd-sourced software testing can lead to an improper testing process as if it does not allocate the right task to the right crowd with required skills and not choose the right crowd; it can lead to huge results, which become time-consuming and challenging crowd-source manager for the identification of improper one. The primary purpose of this research is to make crowd-based outsourced software testing more effective and reliable by relating association between the software tester, personality characteristic, and different levels of software testing, i.e., unit, integration, and system, in order to find appropriate personality characteristic for required testing level. This research has shown an observed experiment to determine which software testing level suits which personality characteristic tester in a crowd-based software testing environment. A total of 1000 software testers from different software houses and firms in Pakistan were registered to perform tasks at different software testing levels. The Myers-Briggs Type Indicator (MBTI) test is used to identify each tester's personality characteristic involved in this research study.
Keywords
Crowd-based outsourcing; MBTI; software testing levels; personality characteristics; open call;
Citations & Related Records
연도 인용수 순위
  • Reference
1 J. Howe, "The rise of crowdsourcing," Wired magazine, vol. 14, no. 6, pp. 1-4, 2006.
2 K. Mao, Y. Yang, Q. Wang, Y. Jia, and M. Harman, "Developer recommendation for crowdsourced software development tasks," in Proc. of 9th IEEE Int. Symp. Service-oriented Syst. Eng. (SOSE), vol. 30, pp. 347-356, Mar. 2015.
3 Ke Mao, Licia Capra, Mark Harman, and Yue Jia, "A Survey of the Use of Crowdsourcing in Software Engineering," Journal of Systems and Software, vol. 126, pp. 57-84, Apr. 2017.   DOI
4 L. B. Chilton, J. J. Horton, R. C. Miller, and S. Azenkot, "Task search in a human computation market," in Proc. of the ACM SIGKDD Workshop on Human Computation, Washington, DC, pp. 1-9, 2010.
5 U. Hassan and E. Curry, "A capability requirements approach for predicting worker performance in crowdsourcing," in Proc. of 9th Int. Conf. Collaborative Comput., Netw., Appl. Worksharing, Austin, TX, USA, Oct. 2013, pp. 429-437.
6 Muhammad Zahid Tunio, Haiyong Luo, Cong Wang, Fang Zhao, Abdul Rehman Gilal, Wenhua Shao, "Task Assignment Model for Crowdsourcing Software Development: TAM," Journal of Information Processing Systems, 14(3), 621-630, March 2018.   DOI
7 Muhammad Zahid Tunio, Haiyong Luo, Cong Wang, Fang Zhao, Abdul Rehman Gilal, Wenhua Shao, "Impact of Personality on Task Selection in Crowdsourcing Software Development: A Sorting Approach" IEEE Access, Vol. 5, pp. 18287-18294, 2017.   DOI
8 E. Aldhahri, V. Shandilya, and S. Shiva, "Towards an effective crowdsourcing recommendation system: a survey of the state-of-the-art," in Proc. of 2015 IEEE Symposium on Service-Oriented System Engineering, San Francisco Bay, CA, pp. 372-377, 2015.
9 IEEE Guide for Software Verification and Validation Plans, IEEE Std 1059-1993, pp.1-87, 28 April 1994.
10 A.Brew, D.Greene, and P.Cunningham, "Using crowdsourcing and active learning to track sentiment in online media," in Proc. of 19th Eur. Conf. Artif. Intell. (ECAI), Amsterdam, The Netherlands, vol. 215, pp. 145-150, Aug. 2010.
11 D. Geiger and M. Schader, "Personalized task recommendation in crowdsourcing information systems_Current state of the art," Decision Support Syst., vol. 65, pp. 3-16, Sep. 2014.   DOI
12 V. Ambati, S. Vogel, and J. G. Carbonell, "Towards task recommendation in micro-task markets," in Proc. of Hum. Comput., pp. 80-83, 2011.
13 I.F. Siddiqui et al, "Pseudo-cache-based IoT small files management framework in HDFS cluster," Wireless Personal Communications, vol. 113. pp. 1495-1522, May. 2020.   DOI
14 R. Valencia-Garcia, F. Garcia-Sanchez, D. Castellanos-Nieves, J. T. Fernandez-Breis, and A. Toval, "Exploitation of social semantic technology for software development team configuration," IET Softw., vol. 4, no. 6, pp. 373-385, 2010.   DOI
15 N. R. Mead, "Software engineering education: How far we've come and how far we have to go," J. Syst. Softw., vol. 82, no. 4, pp. 571-575, 2009.   DOI
16 I.F. Siddiqui, et al., "Edge-node-aware adaptive data processing framework for smart grid," Wireless Personal Communications, vol. 106. pp. 179-189, Mar. 2019.   DOI
17 A. Brew, D. Greene, and P. Cunningham, "Using crowdsourcing and active learning to track sentiment in online media," in Proc. of 19th Eur. Conf. Artif. Intell. (ECAI), The Netherlands, Amsterdam, vol. 215, pp. 145-150, Aug. 2010.
18 V. S. Sheng, F. Provost, and P. G. Ipeirotis, "Get another label? Improving data quality and data mining using multiple, noisy labelers," in Proc. of 14th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, pp. 614-622, 2008.
19 L. F. Capretz and F. Ahmed, "Making sense of software development and personality types," IT Prof., vol. 12, no. 1, pp. 6-13, 2010.   DOI
20 G. Kazai, J. Kamps, and N. Milic-Frayling, "Worker types and personality traits in crowdsourcing relevance labels," in Proc. of CIKM, Scotland, U.K, pp. 1941-1944., Oct. 2011.
21 L. Machado, R. Prikladnicki, F. Meneguzzi, R. B. C. de Souza, and E. Carmel, "Task allocation for crowdsourcing using AI planning," in Proc. of 3rd Int. Workshop Crowdsourcing Softw. Eng. (CSISE), Austin, TX, USA, pp. 36-40, May 2016.
22 I. Boutsis and V. Kalogeraki, "Crowdsourcing under real-time constraints," in Proc. of IEEE 27th Int. Symp. Parallel Distrib. Process, Boston, MA, USA, pp. 753-764, May 2013.
23 Luo, Lu, "Software testing techniques: technology maturation and research strategy," Class report for, 2001.
24 K. Sneha and G. M. Malle, "Research on software testing techniques and software automation testing tools," in Proc. of Int. Conf. Energy, Commun. Data Anal. Soft Comput. (ICECDS) 2017, pp. 77-81, 2017.
25 C. Padmini, "Beginners Guide to Software Testing," pp. 1-41, 2013.
26 T. D. LaToza and A. van der Hoek, "A vision of crowd development," in Proc. of IEEE/ACM 7th IEEE Int. Conf. Softw. Eng., vol. 2, pp. 563-566, May 2015.
27 Zainab Umair Kamangar, Umair Ayaz Kamangar, Qasim Ali, Isma Farah, Shahzad Nizamani and Tauha Husain Ali, "To enhance Effectiveness of Crowdsource Software Testing by applying Personality Types," in Proc. of ICSIE '19 8th International Conference on Software and Information Engineering, Cairo, Egypt, pp. 15-19, April 2019.
28 Leicht, N., Rhyn M., Hansbauer G., "Can laymen outperform experts? The effects of user expertise and task design in crowdsourced Software Testing," in Proc. of Twenty-Fourth European Conference on Information Systems (ECIS 2016), Istanbul, Turkey, pp. 8, 2016.
29 M. Allahbakhsh, B. Benatallah, A. Ignjatovic, H. R. Motahari-Nezhad, E. Bertino, and S. Dustdar, "Quality control in crowdsourcing systems: Issues and directions," IEEE Internet Comput., vol. 17, no. 2, pp. 76-81, Mar. 2013.   DOI
30 O. F. Zaidan and C. Callison-Burch, "Crowdsourcing translation: Professional quality from non-professionals," in Proc. of 49th Annu. Meet. Assoc. Comput. Linguistics, Hum. Lang. Technol., vol. 1, pp. 1220-1229, 2011.
31 N.M.F. Qureshi et al., "A knowledge-based path optimization technique for cognitive nodes in smart grid," in Proc. of IEEE Globecom 2018, Abu Dhabi, UAE, pp. 1-6, Dec. 2018.
32 Yu, Dunhui & Zhou, Zhuang & Wang, Yi, "Crowdsourcing Software Task Assignment Method for Collaborative Development," IEEE Access, vol. 7, pp. 35743-35754, March 2019.   DOI
33 E. Simpson and S. Roberts, "Bayesian methods for intelligent task assignment in crowdsourcing systems," Decision Making: Uncertainty, Imperfection, Deliberation and Scalability, Basel, Switzerland: Springer, pp. 1-32, 2015.
34 M.-C. Yuen, I. King, and K.-S. Leung, "Task matching in crowdsourcing," in Proc. of 4th Int. Conf. Cyber, Phys. Social Comput. Int. Conf. Internet Things (iThings/CPSCom), pp. 409-412, Oct. 2011.
35 L. F. Capretz, D. Varona, and A. Raza, "Influence of personality types in software tasks choices," Comput. Hum. Behavior, vol. 52, pp. 373-378, Nov. 2015.   DOI
36 S. Cruz, F. Q. B. da Silva, and L. F. Capretz, "Forty years of research on personality in software engineering: A mapping study," Comput. Hum. Behavior, vol. 46, pp. 94-113, May 2015.   DOI
37 S. Zhao, B. Shen, Y. Chen, and H. Zhong, "Towards effective developer recommendation in software crowdsourcing," Proc. SEKE, pp. 326-329, 2015.