KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

A SURVEY OF QUALITY OF SERVICE IN MULTI-TIER WEB APPLICATIONS

  • Received : 2015.05.26
  • Accepted : 2015.10.29
  • Published : 2016.01.31
Download PDF
⟨ Previous Next ⟩

Abstract

Modern web services have been broadly deployed on the Internet. Most of these services use multi-tier architecture for flexible scaling and software reusability. However, managing the performance of multi-tier web services under dynamic and unpredictable workload, and different resource demands in each tier is a critical problem for a service provider. When offering quality of service assurance with least resource usage costs, web service providers should adopt self-adaptive resource provisioning in each tier. Recently, a number of rule- and model-based approaches have been designed for dynamic resource management in virtualized data centers. This survey investigates the challenges of resource provisioning and provides a competing assessment on the existing approaches. After the evaluation of their benefits and drawbacks, the new research direction to improve the efficiency of resource management and recommendations are introduced.

Keywords

References

  1. Douglas and K Barry, “Web Services, Service-oriented Architectures, and Cloud Computing: The Savvy Manager's Guide,” Morgan Kaufmann Pub, 2003.
  2. R.T.Fielding and G.Kaiser, “The Apache HTTP Server Project,” IEEE Internet Computing, vol.1, no.4, p.88-90, July, 1997. Article (CrossRef Link). https://doi.org/10.1109/4236.612229
  3. The Apache Jarkarta Project, "Tomcat 6.0.44," [Online] available at http://jakarta.apache.org/tomcat/.
  4. Java Comm. Process, "The Java Community Process Program," [Online] http://jcp.org/en/introduction/overview.
  5. Menasc, Daniel A and Almeida, Virgilio AF and Dowdy, Larry W, “Capacity Planning for Web Services: metrics, models, and methods,” Prentice Hall PTR, 2002.
  6. Kleinrock and Leonard, “Queuing Systems, Vol. 2: Computer Applications,” NY: Wiley, 1976.
  7. Chandra, Abhishek, Weibo Gong, and Prashant Shenoy, "Dynamic resource allocation for shared data centers using online measurements," in Proc. of Quality of Service—IWQoS 2003, pp. 381-398. Springer Berlin Heidelberg, 2003. Article (CrossRef Link).
  8. P. Xiong, Z. Wang, G. Jung, and C. Pu, "Study on performance management and application behavior in virtualized environment," in Proc. of Network Operations and Management Symposium (NOMS), 2010 IEEE, pp. 841-844, 2010. Article (CrossRef Link).
  9. B. Urgaonkar, G. Pacifici, P. Shenoy, M. Spreitzer, and A. Tantawi, "An Analytical Model for Multi-Tier Internet Services and Its Applications," in Proc. of ACM SIGMETRICS Performance Evaluation Review, vol. 33, pp. 291-302, 2005. Article (CrossRef Link).
  10. Rackspace, [Online] "http://www.rackspace.com/," 2012.
  11. Wei, Jianbin, and Cheng-Zhong Xu, "eQoS: Provisioning of client-perceived end-to-end QoS guarantees in web servers," Computers, IEEE Transactions, vol. 55, no. 12, pp 1543-1556, 2006. Article (CrossRef Link). https://doi.org/10.1109/TC.2006.197
  12. Liu, Xue, Lui Sha, Yixin Diao, Steven Froehlich, Joseph L. Hellerstein, and Sujay Parekh, "Online response time optimization of apache web server," in Proc. of Quality of Service—IWQoS 2003, pp. 461-478, 2003. Article (CrossRef Link).
  13. Zhou, Duanning, and Wayne Wei Huang, "Using a fuzzy classification approach to assess e-commerce web sites: An empirical investigation," ACM Transactions on Internet Technology (TOIT), vol. 9, no. 3, pp. 12, 2009. Article (CrossRef Link). https://doi.org/10.1145/1552291.1552295
  14. Diao, Yixin, Joseph L. Hellerstein, and Sujay Parekh, "Optimizing quality of service using fuzzy control," Management Technologies for E-Commerce and E-Business Applications, pp. 42-53., 2002. Article (CrossRef Link).
  15. Lama, Palden, and Xiaobo Zhou, "Autonomic provisioning with self-adaptive neural fuzzy control for percentile-based delay guarantee," ACM Transactions on Autonomous and Adaptive Systems (TAAS), vol. 8, no. 2, pp. 9, 2013. Article (CrossRef Link). https://doi.org/10.1145/2491465.2491468
  16. Rao, Jia, Yudi Wei, Jiayu Gong, and Cheng-Zhong Xu, "Qos guarantees and service differentiation for dynamic cloud applications," Network and Service Management, IEEE Transactions, vol.10, no. 1, pp. 43-55. 2013. Article (CrossRef Link). https://doi.org/10.1109/TNSM.2012.091012.120238
  17. Maurer, Michael, Ivona Brandic, and Rizos Sakellariou, "Self-adaptive and resource-efficient SLA enactment for cloud computing infrastructures," in Proc. of Cloud Computing (CLOUD), 2012 IEEE 5th International Conference on, pp. 368-375, 2012. Article (CrossRef Link).
  18. Lama, Palden, and Xiaobo Zhou, “Efficient server provisioning with control for end-to-end response time guarantee on multitier clusters," Parallel and Distributed Systems, IEEE Transactions on, vol.23, no. 1, pp. 78-86, 2012. Article (CrossRef Link). https://doi.org/10.1109/TPDS.2011.88
  19. Wang, Lixi, Jing Xu, Ming Zhao, Yicheng Tu, and Jose AB Fortes, "Fuzzy modeling based resource management for virtualized database systems," in Proc. of Modeling, Analysis & Simulation of Computer and Telecommunication Systems (MASCOTS), 2011 IEEE 19th International Symposium on, pp. 32-42, 2011. Article (CrossRef Link).
  20. Martinez, Jose F., and Engin Ipek, “Dynamic multicore resource management: A machine learning approach," Micro, IEEE, vol. 29, no. 5, pp. 8-17, 2009. Article (CrossRef Link). https://doi.org/10.1109/MM.2009.77
  21. Tesauro, Gerald, Nicholas K. Jong, Rajarshi Das, and Mohamed N. Bennani, "A hybrid reinforcement learning approach to autonomic resource allocation," in Proc. of Autonomic Computing, 2006. ICAC'06. IEEE International Conference on, pp. 65-73, 2006. Article (CrossRef Link).
  22. Xu, Cheng-Zhong, Jia Rao, and Xiangping Bu, “URL: A unified reinforcement learning approach for autonomic cloud management," Journal of Parallel and Distributed Computing, vol. 72, no. 2, pp. 95-105, 2012. Article (CrossRef Link). https://doi.org/10.1016/j.jpdc.2011.10.003
  23. Bodık, Peter, Rean Griffith, Charles Sutton, Armando Fox, Michael Jordan, and David Patterson, "Statistical machine learning makes automatic control practical for internet datacenters," in Proc. of the 2009 conference on Hot topics in cloud computing, pp. 12-12, 2009.
  24. Gong, Zhenhuan, Xiaohui Gu, and John Wilkes, "Press: Predictive elastic resource scaling for cloud systems," in Proc. of Network and Service Management (CNSM), 2010 International Conference on IEEE, pp. 9-16, 2010. Articale (CrossRef Link).
  25. Kamra, Abhinav, Vishal Misra, and Erich M. Nahum, "Yaksha: A self-tuning controller for managing the performance of 3-tiered web sites," in Proc. of Quality of Service, 2004. IWQOS 2004. Twelfth IEEE International Workshop on, pp. 47-56, 2004. Article (CrossRef Link).
  26. Liu, Xue, Jin Heo, Lui Sha, and Xiaoyun Zhu, "Adaptive control of multi-tiered web applications using queueing predictor," in Proc. of Network Operations and Management Symposium, 2006. NOMS 2006. 10th IEEE/IFIP, pp. 106-114, 2006. Article (CrossRef Link).
  27. Hellerstein, Joseph L., Yixin Diao, Sujay Parekh, and Dawn M. Tilbury, “Feedback control of computing systems,” John Wiley & Sons, 2004. Article (CrossRef Link).
  28. Lu, Chenyang, Ying Lu, Tarek F. Abdelzaher, John A. Stankovic, and Sang Hyuk Son, “Feedback control architecture and design methodology for service delay guarantees in web servers," Parallel and Distributed Systems, IEEE Transactions on, vol. 17, no. 9, pp. 1014-1027, 2006. Article (CrossRef Link). https://doi.org/10.1109/TPDS.2006.123
  29. Lu, Ying, Tarek Abdelzaher, Chenyang Lu, Lui Sha, and Xue Liu, "Feedback control with queueing-theoretic prediction for relative delay guarantees in web servers," in Proc. of Real-Time and Embedded Technology and Applications Symposium, 2003. Proceedings. The 9th IEEE, pp. pp. 208-217, 2003. Article (CrossRef Link).
  30. Abdelzaher, Tarek, Ying Lu, Ronghua Zhang, and Dan Henriksson, "Practical application of control theory to web services," in Proc. of American Control Conference, 2004. The 2004, IEEE, vol. 3, pp. 1992-1997, 2004. Article (CrossRef Link).
  31. Chandra, Abhishek, Weibo Gong, and Prashant Shenoy, "Dynamic resource allocation for shared data centers using online measurements," in Proc. of Quality of Service—IWQoS 2003, Springer Berlin Heidelberg, pp. 381-398, 2003. Article (CrossRef Link).
  32. Urgaonkar, Bhuvan, Giovanni Pacifici, Prashant Shenoy, Mike Spreitzer, and Asser Tantawi, "An analytical model for multi-tier internet services and its applications," in Proc. of ACM SIGMETRICS Performance Evaluation Review, vol. 33, no. 1, pp. 291-302. ACM, 2005. Article (CrossRef Link).
  33. Xiong, Pengcheng, Zhikui Wang, Simon Malkowski, Qingyang Wang, Deepal Jayasinghe, and Calton Pu, "Economical and robust provisioning of n-tier cloud workloads: A multi-level control approach," in Proc. of Distributed Computing Systems (ICDCS), 2011 31st International Conference on, pp. 571-580. IEEE, 2011. Article (CrossRef Link).
  34. Padala, Pradeep, Kai-Yuan Hou, Kang G. Shin, Xiaoyun Zhu, Mustafa Uysal, Zhikui Wang, Sharad Singhal, and Arif Merchant, "Automated control of multiple virtualized resources," in Proc. of the 4th ACM European conference on Computer systems, pp. 13-26. ACM, 2009. Article (CrossRef Link).
  35. Tang, Chunqiang, Malgorzata Steinder, Michael Spreitzer, and Giovanni Pacifici, "A scalable application placement controller for enterprise data centers," in Proc. of the 16th international conference on World Wide Web, pp. 331-340. ACM, 2007. Article (CrossRef Link).
  36. Urgaonkar, Bhuvan, Prashant Shenoy, Abhishek Chandra, Pawan Goyal, and Timothy Wood, "Agile dynamic provisioning of multi-tier internet applications," ACM Transactions on Autonomous and Adaptive Systems (TAAS), vol. 3, no. 1, pp. 1, 2008. Article (CrossRef Link). https://doi.org/10.1145/1342171.1342172
  37. Kusic, Dara, Jeffrey O. Kephart, James E. Hanson, Nagarajan Kandasamy, and Guofei Jiang, "Power and performance management of virtualized computing environments via lookahead control," Cluster computing, vol. 12, no. 1, pp. 1-15, 2009. Article (CrossRef Link). https://doi.org/10.1007/s10586-008-0070-y
  38. Han, Rui, Moustafa M. Ghanem, Li Guo, Yike Guo, and Michelle Osmond, "Enabling cost-aware and adaptive elasticity of multi-tier cloud applications," Future Generation Computer Systems, vol. 32, pp. 82-98, 2014. Article (CrossRef Link). https://doi.org/10.1016/j.future.2012.05.018
  39. Jiang, Jing, Jie Lu, Guangquan Zhang, and Guodong Long, "Optimal cloud resource auto-scaling for web applications," in Proc. of Cluster, Cloud and Grid Computing (CCGrid), 2013 13th IEEE/ACM International Symposium on, pp. 58-65, 2013. Article (CrossRef Link).
  40. Ashraf, Adnan, Benjamin Byholm, Joonas Lehtinen, and Ivan Porres, "Feedback control algorithms to deploy and scale multiple web applications per virtual machine," in Proc. of Software Engineering and Advanced Applications (SEAA), 2012 38th EUROMICRO Conference on, pp. 431-438, 2012. Article (CrossRef Link).
  41. Iqbal, Waheed, Matthew N. Dailey, David Carrera, and Paul Janecek, "Adaptive resource provisioning for read intensive multi-tier applications in the cloud," Future Generation Computer Systems, vol. 27, no. 6, pp. 871-879, 2011. Article (CrossRef Link). https://doi.org/10.1016/j.future.2010.10.016
  42. Mi, Haibo, Huaimin Wang, Gang Yin, Yangfan Zhou, Dianxi Shi, and Lin Yuan, "Online self-reconfiguration with performance guarantee for energy-efficient large-scale cloud computing data centers," in Proc. of Services Computing (SCC), 2010 IEEE International Conference on, pp. 514-521, 2010. Article (CrossRef Link).
  43. Zhang, Qi, Ludmila Cherkasova, Ningfang Mi, and Evgenia Smirni, "A regression-based analytic model for capacity planning of multi-tier applications," Cluster Computing, vol. 11, no. 3, pp. 197-211, 2008. Article (CrossRef Link). https://doi.org/10.1007/s10586-008-0052-0
  44. Song, Ying, Hui Wang, Yaqiong Li, Binquan Feng, and Yuzhong Sun, "Multi-tiered on-demand resource scheduling for VM-based data center," in Proc. of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, pp. 148-155, 2009. Article (CrossRef Link).
  45. Liu, Xue, Jin Heo, Lui Sha, and Xiaoyun Zhu, "Queueing-model-based adaptive control of multi-tiered web applications," Network and Service Management, IEEE Transactions on, vol. 5, no. 3, pp. 157-167, 2008. Article (CrossRef Link). https://doi.org/10.1109/TNSM.2009.031103
  46. Diao, Yixin, Joseph L. Hellerstein, Sujay Parekh, Hidayatullah Shaikh, and Maheswaran Surendra, "Controlling quality of service in multi-tier web applications," in Proc. of Distributed Computing Systems, 2006. ICDCS 2006. 26th IEEE International Conference on, pp. 25-25, 2006. Article (CrossRef Link).
  47. Wang, Xiaoying, Zhihui Du, Yinong Chen, and Sanli Li, "Virtualization-based autonomic resource management for multi-tier Web applications in shared data center," Journal of Systems and Software, vol. 81, no. 9, pp. 1591-1608, 2008. Article (CrossRef Link). https://doi.org/10.1016/j.jss.2007.11.719
  48. Liu, Xue, Xiaoyun Zhu, Pradeep Padala, Zhikui Wang, and Sharad Singhal, "Optimal multivariate control for differentiated services on a shared hosting platform," in Proc. of Decision and Control, 2007 46th IEEE Conference on, pp. 3792-3799, 2007. Article (CrossRef Link).
  49. Cao, Jianhua, Mikael Andersson, Christian Nyberg, and Maria Kihl, "Web server performance modeling using an M/G/1/K* PS queue," in Proc. of Telecommunications, 2003. ICT 2003. 10th International Conference on, vol. 2, pp. 1501-1506, 2003. Article (CrossRef Link).
  50. Liu, Xue, Jin Heo, and Lui Sha, "Modeling 3-tiered web applications," in Proc. of Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, 2005. 13th IEEE International Symposium on, pp. 307-310, 2005. Article (CrossRef Link).
  51. Standard Performance Evaluation Corporation, [Online] https://www.spec.org/web2005/.
  52. Transaction Processing performance Council, [Online], http://www.tpc.org/tpcw/
  53. BM WebSphere Software, http://www.ibm.com/software/webservers/appserv/benchmark3.html.
  54. Rubis, [Online] http://rubis.ow2.org/.
  55. Banga, Gaurav, and Peter Druschel, "Measuring the Capacity of a Web Server," in Proc. of USENIX Symposium on Internet Technologies and Systems, pp. 61-71. 1997.
  56. Wang, Zhikui, Xiaoyun Zhu, and Sharad Singhal, "Utilization and SLO-based control for dynamic sizing of resource partitions," Ambient Networks, pp. 133-144, 2005. Article (CrossRef Link).
  57. Slotine, Jean-Jacques E., and Weiping Li, Applied nonlinear control. Vol. 60. Englewood Cliffs, NJ: Prentice-Hall, 1991.
  58. Arjan, S. L2-gain and passivity techniques in nonlinear control, New York, 2000.
  59. Wang, Zhikui, Yuan Chen, Daniel Gmach, Sharad Singhal, Brian J. Watson, Wilson Rivera, Xiaoyun Zhu, and Chris D. Hyser, "Appraise: application-level performance management in virtualized server environments," Network and Service Management, IEEE Transactions on, vol. 6, no. 4, pp. 240-254, 2009. Article (CrossRef Link). https://doi.org/10.1109/TNSM.2009.04.090404

Cited by

  1. Digital Tourism Security System for Nepal vol.14, pp.11, 2020, https://doi.org/10.3837/tiis.2020.11.005