DOI QR코드

DOI QR Code

A Study on Cold Start and Resource Improvement Using Time Warming Allocation Engine in Serverless Computing

  • Gun-Woo Kim (Department of Computer Science, Kwangwoon University) ;
  • Seok-Jae Moon (Department of Artificial Intelligence Institute of Information Technology, KwangWoon University) ;
  • Byung-Joon Park (Department of Computer Science, Kwangwoon University)
  • Received : 2024.07.13
  • Accepted : 2024.07.26
  • Published : 2024.09.30

Abstract

With the advent of serverless computing, cloud customers no longer needed to maintain and manage server environments directly. Instead, cloud service providers took on that role, managing and maintaining the server environment according to customer requests, a concept known as Function as a Service (FaaS). This service demonstrated improvements in operational costs and resource utilization over traditional cloud computing, offering various advantages such as enhanced scalability. However, a delay occurred in processing and returning results to user requests, a phenomenon referred to as the cold start problem. This paper proposed the Time Warming Allocation Engine (TWAE) to improve resource management and mitigate the cold start problem in Function as a Service. The proposed engine comprised a collection module, a learning module, a classification module, and an allocation module. Additionally, it utilized a list called Pre-Warming. Through this approach, it suggested directions for improving cold start issues and resource utilization according to different time periods.

Keywords

Acknowledgement

This work is financially supported by Korea Ministry of Environment(MOE) Graduate School specialized in Integrated Pollution Prevention and Control Project.

References

  1. Mohammad S. Aslanpour, Adel N. Toosi, Claudio Cicconetti, Bahman Javadi, Peter Sbarski, Davide Taibi, Marcos Assuncao, Sukhpal Singh Gill, Raj Gaire, and Schahram Dustdar, "Serverless Edge Computing: Vision and Challenges", In Proceedings of the 2021 Australasian Computer Science Week Multiconference (ACSW '21), 2021, DOI: doi.org/10.1145/3437378.3444367
  2. E. Jonas et al., "Cloud Programming Simplified: A Berkeley View on Serverless Computing," arXiv, Feb. 2019, DOI: https://arxiv.org/abs/1902.03383
  3. G. C. Fox, Vatche Ishakian, V. Muthusamy, and A. Slominski, "Status of Serverless Computing and Function-as-a-Service(FaaS) in Industry and Research," arXiv, Aug. 2017, DOI: https://doi.org/10.13140/rg.2.2.15007.87206.
  4. P. Vahidinia, B. Farahani and F. S. Aliee, "Cold Start in Serverless Computing: Current Trends and Mitigation Strategies," 2020 International Conference on Omni-layer Intelligent Systems (COINS), pp. 1-7, Aug. 2020, DOI: https://10.1109/COINS49042.2020.9191377.
  5. E. Oakes, L. Yang, D. Zhou, K. Houck, T. Harter, A. Arpaci-Dusseau, et al., "{SOCK}: Rapid Task Provisioning with Serverless- Optimized Containers", In 2018 {USENIX} Annual Technical Conference ({USENIX}{ATC} 18), 2018., DOI: https://www.usenix.org/conference/atc18/presentation/oakes
  6. G. McGrath and P. R. Brenner, "Serverless Computing: Design, Implementation, and Performance," 2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW), Atlanta, GA, USA, 2017, pp. 405-410, doi: 10.1109/ICDCSW.2017.36..
  7. A. Das, S. Imai, S. Patterson and M. P. Wittie, "Performance Optimization for Edge-Cloud Serverless Platforms via Dynamic Task Placement," 2020 20th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGRID), pp. 41-50, May. 2020, DOI: https://10.1109/CCGrid49817.2020.00-89
  8. Golec, Muhammed, et al. "Cold start latency in serverless computing: A systematic review, taxonomy, and future directions." arXiv preprint arXiv:2310.08437 (2023).
  9. LI, Zijun, et al. The serverless computing survey: A technical primer for design architecture. ACM Computing Surveys (CSUR), 2022, 54.10s: 1-34.
  10. M. A. Wiering and H. van Hasselt, "Ensemble Algorithms in Reinforcement Learning," in IEEE Transactions on Systems, Man, and Cybernetics, vol. 38, no. 4, pp. 930-936, Aug. 2008, doi: https://10.1109/TSMCB.2008.920231.
  11. Azure Public Dataset. https://github.com/Azure/AzurePublicDataset/tree/master
  12. Amoghavarsha Suresh, Gagan Somashekar, Anandh Varadarajan, Veerendra Ramesh Kakarla, Hima Upadhyay, and Anshul Gandhi. 2020. ENSURE: Efficient Scheduling and Autonomous Resource Management in Serverless Environments. In International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS 2020). 1-10.