Browse > Article

Performance Analysis of MapReduce Application on Private Cloud by using OpenStack  

Kang, Yun-Hee (Div. of Information and Communication, Basekseok University)
Publication Information
The Journal of Korean Institute of Information Technology / v.11, no.12, 2013 , pp. 177-183 More about this Journal
Abstract
Recently software based virtualization technology has been used to utilize high performance hardware computing resources for providing high availability. MapReduce programming has been driving Internet services and those services operation in a private cloud environment, which is composed of virtualized computing resources. Hence it is required to efficiently provide virtualized resources for handling diverse MapReduce applications. In this paper OpenStack is used to build a private cloud. We show the relationship of a Hadoop application and virtualized resource allocations in the experiment. As a result of this experiment, the performance of Hadoop based compute intensive application provides up to 110.76% of the performance of physical server when running on the virtual machine in the private cloud.
Keywords
OpenStack; private cloud; MapReduce programming model; hadoop; performance evaluation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 M. Armbrust, A. Fox, and R. Griggith, et al., "Above the cloud: A Berkeley View of Cloud Computing", Technical Report No.UCB/EECS- 2009-28, EECS Department, University of California at Berkeley, USA, Feb. 2009.
2 Shadi Ibrahim, Hai Jin, Lu Lu, Li Qi, Song Wu, and Xuanhua Shi, "Evaluating MapReduce on Virtual Machines: The Hadoop Case", In Proceedings of the 1st International Conference on Cloud Computing (CloudCom '09), pp. 519-528, 2009.
3 J. Dean and S. Ghemawat, "MapReduce: A Flexible Data Processing Tool", Communications of the ACM, Vol. 53, pp. 72-77, Jan. 2010.
4 Yun-Hee Kang, "Construction of a MapReduce Application Running on Twister in Cloud Computing Environments, FutureGrid", Journal of KIIT, Vol. 9 No. 4, pp. 147-154, April 2011.
5 J. Ekanayake, et al., "MapReduce for Data Intensive Scientific Analyses", the 2008 Fourth IEEE International Conference on eScience, pp. 277-284, Dec. 2008.
6 M. Mahjoub and A. Mdhaffar, et al. "A Comparative Study of the Current Cloud Computing Technologies and Offers", IEEE First Symposium on Network Cloud Computing and Applications, pp. 131-134, Nov. 2011.
7 P. Sempolinski and D. Thain, "A Comparison and Critique of Eucalyptus, OpenNebula and Nimbus", 2nd IEEE International Conference on Cloud Computing Technology and Science, pp. 417-426, Nov. 2010.
8 Hadoop. http://hadoop.apache.org/
9 OpenStack. http://www.openstack.org/
10 KVM. http://www.linux-kvm.org/
11 RackSpace. http://www.rackspace.com/