Browse > Article
http://dx.doi.org/10.3745/KTCCS.2022.11.3.73

An Improvement of Kubernetes Auto-Scaling Based on Multivariate Time Series Analysis  

Kim, Yong Hae (숭실대학교 IT융합학과)
Kim, Young Han (숭실대학교 전자정보공학부)
Publication Information
KIPS Transactions on Computer and Communication Systems / v.11, no.3, 2022 , pp. 73-82 More about this Journal
Abstract
Auto-scaling is one of the most important functions for cloud computing technology. Even if the number of users or service requests is explosively increased or decreased, system resources and service instances can be appropriately expanded or reduced to provide services suitable for the situation and it can improves stability and cost-effectiveness. However, since the policy is performed based on a single metric data at the time of monitoring a specific system resource, there is a problem that the service is already affected or the service instance that is actually needed cannot be managed in detail. To solve this problem, in this paper, we propose a method to predict system resource and service response time using a multivariate time series analysis model and establish an auto-scaling policy based on this. To verify this, implement it as a custom scheduler in the Kubernetes environment and compare it with the Kubernetes default auto-scaling method through experiments. The proposed method utilizes predictive data based on the impact between system resources and response time to preemptively execute auto-scaling for expected situations, thereby securing system stability and providing as much as necessary within the scope of not degrading service quality. It shows results that allow you to manage instances in detail.
Keywords
Multivariate Time Series; VAR; Kubernetes; Auto-Scaling;
Citations & Related Records
연도 인용수 순위
  • Reference
1 A. Fazli, A. Sayedi, and J. D. Shulman, "The effects of autoscaling in cloud computing," Journal of Management Science, Vol. 64, No.11, pp.5149-5163, 2018.
2 M. A. Netto, C. Cardonha, R. L. Cunha, and M. D. Assuncao, "Evaluating auto-scaling strategies for cloud computing environments," 2014 IEEE 22nd International Symposium on Modelling, Analysis & Simulation of Computer and Telecommunication Systems, IEEE, 2014.
3 S. H. Eum and J. S. Kim, "Method for efficient storage resource management in docker container-based cloud environments," in Proceeding The Korean Institute of Information Scientists and Engineers, pp.1247-1249, Jul. 2020.
4 M. S. Yhu, C. G. Song, H. C. Yu, and E. Y. Lee, "Task type based autoscaling criteria selection and performance analysis in Kubernetes cluster," in Proceeding the Korean Institute of Information Scientists and Engineers, pp.1382-1834, Jun. 2021.
5 L. Toka, G. Dobreff, B. Fodor, and B. Sonkoly, "Machine learning-based scaling management for kubernetes edge clusters," IEEE Transactions on Network and Service Management, Vol.18, No.1, pp.958-972, 2021.   DOI
6 Kubernetes [Internet], https://kubernetes.io
7 Apache Mesos [Internet], http://mesos.apache.org
8 CNCF [Internet], https://www.cncf.io/reports/#cloud-native-surveys
9 A. Nielsen, "Chapter.6 Satistical Models for Time Series," in Practical Time Series Analysis, Hanbit Media, Inc., pp.217-264, 2021.
10 K. I. Kim, et al., "Kubernetes Architecture for Cloud Service," Information and Communications Magazine, Vol.35, No.11, pp.11-19, Oct. 2018.
11 JMeter [Internet], http://jmeter.apache.org/
12 Docker Swarm [Internet], https://docs.docker.com/engine/swarm
13 CNCF Kubernetes Projects [Internet], https://www.cncf.io/projects/kubernetes
14 K. S. Moon, "A understanding of vector autoregressive model," Journal of the Korean Official Statistics, Vol.2 No.1, pp.23-56, Apr. 1997.
15 statsmodels [Internet], https://www.statsmodels.org/stable/index.html
16 S. M. Jeong, J. G. Kim, K. H. Yeom, and J. S. Park, "Container orchestration framework deployment technique based on the feature of microservice," Journal of the Korean Institute of Communication Sciences, Vol.46, No.3, pp.466-475, Mar. 2021.   DOI
17 S. W. Ahn, "Changes in cloud virtualization technology - container-based cloud virtualization and DevOps," Issue Report of Software Policy & Research Institute, No.2018-008, pp.1-36, 2018.
18 S. Y. Choi, "Cloud infrastructure abnormal monitoring using machine learning," Journal of the Korea Society of Computer and Information, Vol.25, No.4, pp.105-112, Apr. 2020.   DOI
19 Y. H. Jang, J. W. Jeong, J. H. Lee, H. C. Yu, and E. Y. Lee, "Modelling the kubernetes horizontal pod autoscaler based on number of requests for comparing the autoscaling algorithm," in Proceeding the Korean Institute of Information Scientists and Engineers, pp.1385-1837, Jun. 2021.
20 W. S. Choi, H. J. Chung, and Y. M. Nah, "Orchestration method for efficient resource management in containerbased cloud environments," Journal of Korean Institute of Next Generation Computing, Vol.15, No.2, pp.71-78, Apr. 2019.
21 Time Series Algorithm (Multivariate linear probability) [Internet], https://github.com/cheonbi/OnlineTSA/blob/master/Lecture4_Algorithms_TimeSeries_Linear_Multivariate_KK.ipynb