Browse > Article
http://dx.doi.org/10.7472/jksii.2021.22.5.57

Hybrid in-memory storage for cloud infrastructure  

Kim, Dae Won (Electronics and Telecommunications Research Institute)
Kim, Sun Wook (Electronics and Telecommunications Research Institute)
Oh, Soo Cheol (Electronics and Telecommunications Research Institute)
Publication Information
Journal of Internet Computing and Services / v.22, no.5, 2021 , pp. 57-67 More about this Journal
Abstract
Modern cloud computing is rapidly changing from traditional hypervisor-based virtual machines to container-based cloud-native environments. Due to limitations in I/O performance required for both virtual machines and containers, the use of high-speed storage (SSD, NVMe, etc.) is increasing, and in-memory computing using main memory is also emerging. Running a virtual environment on main memory gives better performance compared to other storage arrays. However, RAM used as main memory is expensive and due to its volatile characteristics, data is lost when the system goes down. Therefore, additional work is required to run the virtual environment in main memory. In this paper, we propose a hybrid in-memory storage that combines a block storage such as a high-speed SSD with main memory to safely operate virtual machines and containers on main memory. In addition, the proposed storage showed 6 times faster write speed and 42 times faster read operation compared to regular disks for virtual machines, and showed the average 12% improvement of container's performance tests.
Keywords
cloud computing; hybrid in-memory; virtual machine; container;
Citations & Related Records
연도 인용수 순위
  • Reference
1 A. Kemper and T. Neumann, "HyPer: A hybrid OLTP & OLAP main memory database system based on virtual memory snapshots," in IEEE 27th Int. Conf. Data Eng., pp. 195-206, 2011. https://doi.org/10.1109/ICDE.2011.5767867   DOI
2 Bahl, B., Sharma, V. and Rajpal, N., "Boosting geographic information system's performance using in-memory data grid," BVICAM's International Journal of Information Technology, Vol 4, pp. 468-473, 2012. https://www.semanticscholar.org/paper/Boosting-Geographic-Information-System%27s-using-Data-Bahl-Sharma/a2f85cc1c536169ecf9747662a95a2f87b1eb744
3 C. Diaconu, C. Freedman, E. Ismert, P.-A. Larson, P. Mittal, R. Stonecipher, N. Verma, and M. Zwilling, "Hekaton: SQL server's memory-optimized OLTP engine," in Proc. ACM SIGMOD Int. Conf. Manag. Data, pp. 1243-1254, 2013. https://doi.org/10.1145/2463676.2463710   DOI
4 OpenDedup - Opensource Dedupe to cloud and Local storage https://opendedup.org/odd/overview/
5 Use containers to Build, Share and Run your applications https://www.docker.com/resources/what-container
6 Aurora, Valerie, "Union file systems: Architecture, features, and design choices," LWN.net. Retrieved 2018-01-17. https://lwn.net/Articles/324291/
7 GitHub: Where the world builds software.GitHub https://github-landing-page.netlify.app/
8 Jonathan Corbet, Alessandro Rubini and Greg Kroah-Hartman, "Memory Mapping and DMA," Linux Device Drivers, 3rd Edition. https://www.oreilly.com/library/view/linux-device-drivers/0596005903/ch15.html
9 Soo-Cheol Oh and Seong Woon Kim, "Design and implementation of high-performance virtual desktop system managing virtual desktop image in main memory," KIISE Transactions on Computing Practices, Vol 22, No. 8, pp. 363-368, Aug, 2016. https://doi.org/10.5626/KTCP.2016.22.8.363   DOI
10 NGINX Application Platform https://www.nginx.com/products/
11 AL-Harbi Fahad Jazi, Kangseok kim, and Jai-Hoon Kim, "Design and Cost Analysis for a Fault-Tolerant Distributed Shared Memory System," Journal of Internet Computing and Services, vol 17 issue 4, pp1-9, 2016. https://doi.org/10.7472/jksii.2016.17.4.01   DOI
12 CrystalDiskMark https://osdn.net/projects/crystaldiskmark/
13 Kubernetes- Container runtimes https://kubernetes.io/ko/docs/setup/production-environment/container-runtimes/
14 ab - Apache HTTP server benchmarking tool https://httpd.apache.org/docs/2.4/en/programs/ab.html
15 Lee Kyu Woong, "Management of Data base replication in main memory DBMS ALTIBASE for high availability," Journal of Internet Computing and Services, vol 6 issue 1, pp73-84, 2005. https://www.koreascience.or.kr/article/JAKO200516610543538.pdf
16 Hao Zhang, Gang Chen, Beng Chin Ooi, Kian-Lee Tan, Meihui Zhang, "In-Memory Big Data Management and Processing: A Survey," IEEE Transactions on Knowledge and Data Engineering, Vol 27, issue 7, pp. 1920-1948, July, 2015. https://doi.org/10.1109/TKDE.2015.2427795   DOI
17 Soroosh Khoram, Yue Zha, Jialiang Zhang, Jing Li, "Challenges and Opportunities: From Near-memory Computing to In-memory Computing," Proceedings of the 2017 ACM on International Symposium on Physical Design, pp. 43-46, March 2017. https://doi.org/10.1145/3036669.3038242   DOI
18 J. Ousterhout, P. Agrawal, D. Erickson, C. Kozyrakis, J. Leverich, D. Mazieres, S. Mitra, A. Narayanan, G. Parulkar, M. Rosenblum, S. M. Rumble, E. Stratmann, and R. Stutsman, "The case for RAMClouds: Scalable high-performance storage entirely in dram," ACM SIGOPS Operating Syst. Rev., vol. 43, pp. 92-105, 2010. https://doi.org/10.1145/1713254.1713276   DOI
19 Arora, I. and Gupta, A., "Improving performance of cloud based transactional applications using in-memory data grid," International Journal of Computer Applications, Vol 107, pp. 14-19. 2014. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.684.9087&rep=rep1&type=pdf   DOI
20 R. Kallman, H. Kimura, J. Natkins, A. Pavlo, A. Rasin, S. Zdonik, E. P. C. Jones, S. Madden, M. Stonebraker, Y. Zhang, J. Hugg, and D. J. Abadi, "H-store: A high-performance, distributed main memory transaction processing system," Proc. VLDB Endowment, vol. 1, pp. 1496-1499, 2008. https://doi.org/10.14778/1454159.1454211   DOI
21 In-Memory Storage Driver https://docs.docker.com/registry/storage-drivers/inmemory/
22 Docker - Volumes https://docs.docker.com/storage/volumes/
23 S. Robbins, "RAM is the new disk," InfoQ News, Jun. 2008. https://www.infoq.com/news/2008/06/ram-is-disk/
24 Memory Optimized for Data-Centric Workloads https://www.intel.co.kr/content/www/kr/ko/architecture-and-technology/optane-dc-persistent-memory.html
25 "QEMU Git tree - docs/interop/qcow2.txt," qemu.org, May 29, 2018. https://github.com/qemu/qemu/blob/master/docs/interop/qcow2.txt
26 "QEMU System Emulation User's Guide," https://www.qemu.org/docs/master/system/index.