한국멀티미디어학회논문지 (Journal of Korea Multimedia Society)

  • 제15권12호
  • /
  • Pages.1499-1505
  • /
  • 2012
  • /
  • 1229-7771(pISSN)
  • /
  • 2384-0102(eISSN)
한국멀티미디어학회 (Korea Multimedia Society)
권호 표지
DOI QR코드

DOI QR Code

The Creation and Placement of VMs and Tasks in Virtualized Hadoop Cluster Environments

  • Kim, Tae-Won (Department of Computer Science and Engineering, Dankook University) ;
  • Chung, Hae-jin (Department of Computer Science and Engineering, Dankook University) ;
  • Kim, Joon-Mo (Department of Computer Science and Engineering, Dankook University)
  • 투고 : 2012.09.23
  • 심사 : 2012.11.19
  • 발행 : 2012.12.31
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

Recently, the distributed processing system for big data has been actively investigated owing to the development of high speed network and storage technologies. In addition, virtual system that can provide efficient use of system resources through the consolidation of servers has been increasingly recognized. But, when we configure distributed processing system for big data in virtual machine environments, many problems occur. In this paper, we did an experiment on the optimization of I/O bandwidth according to the creation and placement of VMs and tasks with composing Hadoop cluster in virtual environments and evaluated the results of an experiment. These results conducted by this paper will be used in the study on the development of Hadoop Scheduler supporting I/O bandwidth balancing in virtual environments.

키워드

참고문헌

  1. D. Borthaku, The Hadoop Distributed File System: Architecture and Design, Hadoop Project Website, 2007.
  2. Chao Tian, "A Dynamic MapReduce Scheduler for Heterogeneous Workloads," International Conference on Grid and Cooperative Computing, pp. 218-224, 2009.
  3. Jeffrey Dean and Sanjay Ghemawat, "Map- Reduce: Simplified Data Processing on Large Clusters," Communications of the ACM, Vol. 51, No. 1, pp. 107-113, 2008.
  4. S.H. Kim, T.H. Keum, and C.H. Jeon, "Implementation and Performance Analysis of Testbed Clusters for Cloud Computing," The Korean Institute of Information, Vol. 36, No. 1, pp. 545-548, 2009.
  5. Mate Zaharia, "Improving MapReduce Performance in Heterogeneous Environments," Proc. OSDI'08, Vol. 13, No. 4, pp. 277-298, 2008.
  6. S. Ghemawat and S.T. Leung, "The Google File System," Proc. SOSP'03, Vol. 37, No. 5, pp. 29- 43, 2003.
  7. Paul Barham, "Xen and the Art of Virtualization," Proc. SOSP'03, Vol. 35, No. 5, pp. 164-177, 2003.
  8. Hwang, "Web-based Distributed Visualization System for Large Scale Geographic Data," Journal of Korea Multimedia Society, Vol. 14, No. 6, pp. 835-848, 2011. https://doi.org/10.9717/kmms.2011.14.6.835