Browse > Article

A Study on the Effect of the Name Node and Data Node on the Big Data Processing Performance in a Hadoop Cluster  

Lee, Younghun (호남대학교 인터넷소프트웨어학과)
Kim, Yongil (호남대학교 인터넷콘텐츠학과)
Publication Information
Smart Media Journal / v.6, no.3, 2017 , pp. 68-74 More about this Journal
Abstract
Big data processing processes various types of data such as files, images, and video to solve problems and provide insightful useful information. Currently, various platforms are used for big data processing, but many organizations and enterprises are using Hadoop for big data processing due to the simplicity, productivity, scalability, and fault tolerance of Hadoop. In addition, Hadoop can build clusters on various hardware platforms and handle big data by dividing into a name node (master) and a data node (slave). In this paper, we use a fully distributed mode used by actual institutions and companies as an operation mode. We have constructed a Hadoop cluster using a low-power and low-cost single board for smooth experiment. The performance analysis of Name node is compared through the same data processing using single board and laptop as name nodes. Analysis of influence by number of data nodes increases the number of data nodes by two times from the number of existing clusters. The effect of the above experiment was analyzed.
Keywords
BigData; Hadoop; Cluster; Single Board Computing;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Chris Snijders, Uwe Matzat, Ulf-Dietrich Reips, "Big Data: Big gaps of knowledge in the field of Internet Science". International Journal of Internet Science, vol.7, no.1, pp. 1-5, 2012.
2 Laney, Douglas, "3D Data Management: Controlling Data Volume, Velocity and Variety", Gartner
3 조성우, "빅데이터 시대의 기술", KT종합기술원, 5-7쪽, 2011년 10월
4 CNET, "Google spotlights data center inner workings", Tech news blog
5 정재화, "시작하세요! 하둡 프로그래밍", wikibooks, 98-101쪽, 2014년 12월
6 ANSI, "Airline on-time performance", Data expo, 2009.
7 Hardkernel, "Odroid C1 Product Introduce", http://www.hardkernel.com/main/products/prdt_info.php?g_code=G141578608433, 2014.
8 Khaled Tannir, "Optimizing Hadoop for MapReduce", Packt Publishing, 2014.
9 이영훈, 김용일, "Mi Band와 MongoDB를 사용한 생체정보 빅데이터 시스템의 설계", 스마트미디어저널, vol.5, no.4, 124-130쪽, 2016년 12월