Browse > Article
http://dx.doi.org/10.3837/tiis.2019.06.003

AutoScale: Adaptive QoS-Aware Container-based Cloud Applications Scheduling Framework  

Sun, Yao (School of Software Engineering, Jinling Institute of Technology)
Meng, Lun (College of public administration, Hohai university)
Song, Yunkui (Institute of Software, Chinese Academy of Sciences)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.13, no.6, 2019 , pp. 2824-2837 More about this Journal
Abstract
Container technologies are widely used in infrastructures to deploy and manage applications in cloud computing environment. As containers are light-weight software, the cluster of cloud applications can easily scale up or down to provide Internet-based services. Container-based applications can well deal with fluctuate workloads by dynamically adjusting physical resources. Current works of scheduling applications often construct applications' performance models with collected historical training data, but these works with static models cannot self-adjust physical resources to meet the dynamic requirements of cloud computing. Thus, we propose a self-adaptive automatic container scheduling framework AutoScale for cloud applications, which uses a feedback-based approach to adjust physical resources by extending, contracting and migrating containers. First, a queue-based performance model for cloud applications is proposed to correlate performance and workloads. Second, a fuzzy Kalman filter is used to adjust the performance model's parameters to accurately predict applications' response time. Third, extension, contraction and migration strategies based on predicted response time are designed to schedule containers at runtime. Furthermore, we have implemented a framework AutoScale with container scheduling strategies. By comparing with current approaches in an experiment environment deployed with typical applications, we observe that AutoScale has advantages in predicting response time, and scheduling containers to guarantee that response time keeps stable in fluctuant workloads.
Keywords
Kalman filter; Fuzzy logic; Cloud applications; Resource scheduling; Performance management;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Shanthikumar J G, Buzacott J A., "Open queueing network models of dynamic job shops," International Journal of Production Research, 19(3): 255-266, 1981.   DOI
2 Kalman R E., "A New Approach to Linear Filtering and Prediction Problems," Transaction of the ASME-Journal of Basic Engineering, 82:35-45, 1960.   DOI
3 Sinopoli B, Schenato L, Franceschetti M, et al., "Kalman filtering with intermittent observations," IEEE Transactions on Automatic Control, 49(9): 1453-1464, 2004.   DOI
4 Martinez J F, Ipek E., "Dynamic multicore resource management: A machine learning approach," IEEE Micro, 29(5): 8-17, 2009.   DOI
5 Lama P, Zhou X., "Autonomic provisioning with self-adaptive neural fuzzy control for end-to-end delay guarantee," IEEE International Symposium on Modeling, Analysis & Simulation of Computer and Telecommunication Systems (MASCOTS), 151-160, 2010.
6 Chengyang Lu, Lu Y, Abdelzaher T F, et al., "Feedback control architecture and design methodology for service delay guarantees in web servers," IEEE Transactions on Parallel and Distributed Systems, 17(9): 1014-1027, 2006.   DOI
7 Lama P, Guo Y, Zhou X., "Autonomic performance and power control for co-located Web applications on virtualized servers," IEEE/ACM 21st International Symposium on Quality of Service (IWQoS), 1-10, 2013.
8 Lama P, Zhou X., "Efficient server provisioning with control for end-to-end response time guarantee on multitier clusters," IEEE Transactions on Parallel and Distributed Systems, 23(1): 78-86, 2012.   DOI
9 Cao J, Zhang W, Tan W., "Dynamic control of data streaming and processing in a virtualized environment," IEEE Transactions on Automation Science and Engineering, 9(2): 365-376, 2012.   DOI
10 Cherkasova L, Phaal P., "Session-based admission control: A mechanism for peak load management of commercial web sites," IEEE Transactions on Computers, 51(6): 669-685, 2002.   DOI
11 Lama P, Zhou X., "Autonomic provisioning with self-adaptive neural fuzzy control for percentile-based delay guarantee," ACM Transactions on Autonomous and Adaptive Systems, 8(2): 9, 2013.
12 Robertsson A, Wittenmark B, Kihl M, et al., "Design and evaluation of load control in web server systems," in Proc. of IEEE American Control Conference, 3: 1980-1985, 2004.
13 Xu C Z, Rao J, Bu X., "URL: A unified reinforcement learning approach for autonomic cloud management," Journal of Parallel and Distributed Computing, 72(2): 95-105, 2012.   DOI
14 Karlsson M, Karamanolis C, Zhu X., "Triage: Performance isolation and differentiation for storage systems," IEEE International Workshop on Quality of Service, IWQOS 2004: 67-74, 2004.
15 Tumano VA, Cipar J, Kozuch MA, Ganger GR., "Alsched: Algebraic scheduling of mixed workloads in heterogeneous clouds," in Proc. of the 3rd ACM Symp. on Cloud Computing, ACM Press, 2012.
16 Alizadeh M., "Fast and Smart Network Resource Management for Datacenters and Beyond," in Proc. of the 13th International Conference on emerging Networking EXperiments and Technologies, 12-21, 2017.
17 Takagi T, Sugeno M., "Fuzzy identification of systems and its applications to modeling and control," IEEE Transactions on Systems, Man and Cybernetics, (1): 116-132, 1985.
18 Adriyendi, "Fuzzy Logic using Tsukamoto Model and Sugeno Model on Prediction Cost," International Journal of Intelligent Systems & Applications, 6(2), 2018.
19 Li Z, Zhang Y, Zhao Y, Peng Y, Li D., "Best Effort Task Scheduling for Data Parallel Jobs," in Proc. of ACM SIGCOMM Conference, ACM Press, 555-556, 2016.
20 Delimitrou C, Kozyrakis C., "Paragon: QoS-Aware scheduling for heterogeneous datacenters," ACM Transactions on Computer Systems, 31(4): 77-88, 2013.