[KSCI] Korea Science Citation Index Service

http://dx.doi.org/10.9717/kmms.2012.15.12.1499

The Creation and Placement of VMs and Tasks in Virtualized Hadoop Cluster Environments

Kim, Tae-Won (Department of Computer Science and Engineering, Dankook University)
Chung, Hae-jin (Department of Computer Science and Engineering, Dankook University)
Kim, Joon-Mo (Department of Computer Science and Engineering, Dankook University)

Publication Information

Journal of Korea Multimedia Society / v.15, no.12, 2012 , pp. 1499-1505 More about this Journal

Abstract

Recently, the distributed processing system for big data has been actively investigated owing to the development of high speed network and storage technologies. In addition, virtual system that can provide efficient use of system resources through the consolidation of servers has been increasingly recognized. But, when we configure distributed processing system for big data in virtual machine environments, many problems occur. In this paper, we did an experiment on the optimization of I/O bandwidth according to the creation and placement of VMs and tasks with composing Hadoop cluster in virtual environments and evaluated the results of an experiment. These results conducted by this paper will be used in the study on the development of Hadoop Scheduler supporting I/O bandwidth balancing in virtual environments.

Keywords

Hadoop; Distributed Database; Virtual Machine; Big Data;

Citations & Related Records

Times Cited By KSCI : 1 (Citation Analysis)

Reference
Cited By KSCI

1	D. Borthaku, The Hadoop Distributed File System: Architecture and Design, Hadoop Project Website, 2007.
2	Chao Tian, "A Dynamic MapReduce Scheduler for Heterogeneous Workloads," International Conference on Grid and Cooperative Computing, pp. 218-224, 2009.
3	Jeffrey Dean and Sanjay Ghemawat, "Map- Reduce: Simplified Data Processing on Large Clusters," Communications of the ACM, Vol. 51, No. 1, pp. 107-113, 2008.
4	S.H. Kim, T.H. Keum, and C.H. Jeon, "Implementation and Performance Analysis of Testbed Clusters for Cloud Computing," The Korean Institute of Information, Vol. 36, No. 1, pp. 545-548, 2009.
5	Mate Zaharia, "Improving MapReduce Performance in Heterogeneous Environments," Proc. OSDI'08, Vol. 13, No. 4, pp. 277-298, 2008.
6	S. Ghemawat and S.T. Leung, "The Google File System," Proc. SOSP'03, Vol. 37, No. 5, pp. 29- 43, 2003.
7	Paul Barham, "Xen and the Art of Virtualization," Proc. SOSP'03, Vol. 35, No. 5, pp. 164-177, 2003.
8	Hwang, "Web-based Distributed Visualization System for Large Scale Geographic Data," Journal of Korea Multimedia Society, Vol. 14, No. 6, pp. 835-848, 2011. 과학기술학회마을 DOI