[KSCI] Korea Science Citation Index Service

http://dx.doi.org/10.5392/IJoC.2016.12.3.029

Design of Testbed for Agile Computing of MapReduce Applications by using Docker

Kang, Yunhee (Division of Information and Communication Baekseok University)

Publication Information

International Journal of Contents / v.12, no.3, 2016 , pp. 29-33 More about this Journal

Abstract

Cloud computing makes extensive use of virtual machines that permit for workloads, as well as resource usage, to be isolated from one another, and a hypervisor can be used by a virtual machine to construct cloud computing infrastructure. However, the hypervisor has high resource usage when constructing virtual machines, which results in a waste of allocated resources when not activated. Docker provides a more light-weight method to obtain agile computing resources based on a container technique that handles this problem. In this study, we have chosen this specific tool due to the increasing popularity of MapReduce and cloud container technologies such as Docker. This study aims to automatically configure Twister workloads for container-driven clouds. Basically, this is the first attempt towards automatic configuration of Twister jobs on a container-based cloud platform VM for many workloads.

Keywords

Docker; Testbed; Agile Computing; MapReduce; k-means; Twister;

Citations & Related Records

Reference

1	J. Dean and S. Ghemawat, "MapReduce: Simplified data processing on large clusters," Communications of the ACM, vol. 51, no. 1, Jan. 2008, pp. 107-113. DOI
2	I. Foster, Y. Zhao, I. Raicu, and S. Lu, "Cloud computing and grid computing 360-degree compared," Proc. Of Grid computing environments workshop, 2008, p. 1.
3	J. Dean and S. Ghemawat, "MapReduce: A Flexible Data Processing Tool," Communications of the ACM, vol. 53, no. 1, Jan. 2010, pp. 72-77. DOI
4	K. Morton, A. Friesen, M. Balazinska, and D. Grossman, "Estimating the Progress of MapReduce Pipelines," Proc. Of IEEE 26th International Conference on Data Engineering (ICDE), 2010, p. 681.
5	MPI, MPI(Message Passing Interface). Available: http://www-unix.mcs.anl.gov/mpi/
6	PVM, PVM(Parallel Virtual Machine). Available: http://www.csm.ornl.gov/pvm/
7	J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.H. Bae, J. Qiu, and G. Fox, "Twister: A Runtime for Iterative MapReduce," Proc. of the 19th ACM International Symposium on High Performance Distributed Computing (HPDC '10), 2010, p. 810.
8	G. Fox and S. Pallickara, "Deploying the NaradaBrokering Substrate in Aiding Efficient Web & Grid Service Interactions," Proc. of the IEEE on Grid Computing, vol. 93, no. 3, 2005, p. 564.