Browse > Article
http://dx.doi.org/10.7469/JKSQM.2017.45.4.933

Evaluating the Performance Quality of Open Source Database Management Systems  

Min, Meekyung (Dept. of Computer Science, Seokyeong University)
Publication Information
Abstract
Purpose: The purpose of this paper is to evaluate the performance quality of the open source DBMSs. Performance quality is defined as processing time for Join queries. Query processing time is measured and compared in the most widely used open source DBMSs and commercial DBMS. Methods: By varying the number of tuples of two relations to be joined, the average processing time(seconds) of a Join query in each DBMS was obtained experimentally. ANOVA and Tukey HSD test were used in order to compare the performance quality of DBMSs. Results: There was a significant difference between the performance qualities of the three DBMSs at all experimental levels where the number of tuples was 100, 1,000, 2,000, 10,000, and 50,000. As a result of the Tukey HSD test, two open source DBMSs (MariaDB, MySQL) were classified in the same group only at the tuple level of 100. The commercial DBMS (MS-SQL Server) belonged to another group. At level of more than 1,000 tuples, all three DBMSs belonged to different groups. Conclusion: Within the open source DBMS group, MariaDB showed the better performance quality except for a small number of tuples. Thus the results show that MariaDB can be the alternative to MySQL which is currently most widely used. Between open source DBMS and commercial DBMS groups, MS-SQL Server always shows the best performance quality, but the less number of tuples, the less the difference.
Keywords
Open Source Software; DBMS; Join Query; Time Performance; Tukey HSD;
Citations & Related Records
Times Cited By KSCI : 5  (Citation Analysis)
연도 인용수 순위
1 Spinellis, D., Gousios G., Karakoidas, V., Louridas, P., and Adams, P. 2009. "Evaluating the Quality of Open Source Software." Electronic Notes in Theoretical Computer Science 233: 5-28.   DOI
2 Androutsellis-Theotokis, S., Spinellis, D., Kechagia, M., and Gousios, G. 2011. Open Source Software: A Survey from 10,000 Feet. Foundations and Trends in Technology Information and Operations Management and Publish.
3 Choi, Seung-jun, Park, Jae-Won, Kim, Jong-Bae, and Choi, Jae-Hyun. 2014. "A Quality Evaluation Model for Distributed Processing Systems of Big Data." Journal of Digital Contents Society 15: 533-545.   DOI
4 Chung, Su-min, Choi, Jae-hyun, and Park, Jae-won. 2016. "Design of Software Quality Evaluation Model for IoT." Journal of the Korea Institute of Information and Communication Engineering 20: 1342-1354.   DOI
5 Date, C. J. 2004. An Introduction to Database Systems 8th Edition. Pearson.
6 ISO/IEC TR 9126-1. 2001. Software Engineering-Product Quality-Part 1: Quality Model.
7 ISO/IEC TR 9126-2. 2003. Software Engineering-Product Quality-Part 2: Internal Metrics.
8 ISO/IEC TR 25010. 2011. System and software engineering - Systems and software Quality Requirements and Evaluation.
9 Lee, Chung-Hyun, Choi, Jae-Hyun, and Park, Jea-Won. 2015. "A Practical Quality Evaluation Model of Mobile Cloud Software." Journal of Korean Institute of Information Technology 13: 95-110.
10 Lim, Kwang-Hyeon, Ryu, Kwang-Sum, Shon, Ho-Sun, and Ryu, Keun-Ho. 2012. "The Study of quality measurement plan for software reliability." Journal of the Korea Society of Computer and Information 17: 187-198.
11 Ree, Sangbok. 2013. "Study on the result changes with the size of the variance in Taguchi method and factor experimental." Journal of Quality Management 41: 119-134.
12 Ryu, Gui-Yeol. 2014. "A Study on Quality Portals Based on Probability Distributions of Response Time." Journal of Quality Management: 42: 33-42.
13 Samoladas, I., Gousios, G., Spinellis, D., and Stamelos, I. 2008. "The SQO-OSS quality model: measurement-based open source software evaluation." Open source development, communities and quality, 237-248.
14 Spinellis, D. 2006. Code Quality: The Open Source Perspective. Addison Wesley Professional.