Browse > Article
http://dx.doi.org/10.14400/JDC.2016.14.4.251

On Implementing a Learning Environment for Big Data Processing using Raspberry Pi  

Hwang, Boram (Dept. of Computer Engineering, Anyang University)
Kim, Seonggyu (Dept. of Computer Engineering, Anyang University)
Publication Information
Journal of Digital Convergence / v.14, no.4, 2016 , pp. 251-258 More about this Journal
Abstract
Big data processing is a broad term for processing data sets so large or complex that traditional data processing applications are inadequate. Widespread use of smart devices results in a huge impact on the way we process data. Many organizations are contemplating how to incorporate or integrate those devices into their enterprise data systems. We have proposed a way to process big data by way of integrating Raspberry Pi into a Hadoop cluster as a computational grid. We have then shown the efficiency through several experiments and the ease of scaling of the proposed system.
Keywords
Big data; Smart device; Hadoop; Raspberry Pi; Computational Grid;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 IDC Digital Universe Study: Korean Digital Data Survey, 2014.
2 G. Fox, S. Kamburugamuve, H. He, Current and Planned IoT Cloud Research at Digital Science Center, 2015.
3 T. Plunkett et al., Oracle Big Data Handbook, Oracle Press, 2013.
4 E. Dumbill, What is Big Data?, https://www.oreilly.com/ideas/what-is-big-data, 2012.
5 Jung-Hoon Kim, Jun-Young Go, Keun-Ho Lee, "A Scheme of Social Engineering Attacks and Countermeasures Using Big Data based Conversion Voice Phishing", Journal of the Korea Convergence Society, Vol. 6, No. 1, pp. 85-91, 2015.   DOI
6 Yun-A Hur, Keun-Ho Lee, "A Study on Countermeasures of Convergence for Big Data and Security Threats to Attack DRDoS in U-Healthcare Device", Journal of the Korea Convergence Society, Vol. 6, No. 4, pp. 243-248, 2015.   DOI
7 I. Foster and C. Kesselman (Eds), The Grid: Blueprint for a Future Computing Infrastructure, 1998.
8 G. Fox and D. Cannon, Computational Grids, Computing in Science and Engineering Magazine, 2001.
9 T. Phan, L. Huang and C. Dulan, Challehge: Integrating Mobile Wireless Devices Into the Computational Grid, Proceedings of 8th international conference on Mobile Computing and Networking, 2002.
10 L. T. Yang et. al., A Lightweight Platform for Integration of Mobile Devices into Pervasive Grids, First International Conference HPCC 2005, LNCS 3726, pp 1058-1063, 2005.
11 Dhruba Borthakur, The Hadoop Distributed File System: Architecture and Design, Apache Software Foundations, 2007.
12 Hadoop Apache, Hadoop Cluster Setup, The Apache Software Foundation, 2013.
13 Chanwit Kaewkasi, Big Data Processing on ARM Cluster, Cubieboard, 2014.
14 K. O'Dell, How-to: Select Right Hardware for Your New Hadoop Cluster, https://blog.cloudera.com/blog/2013/08/how-to-select-the-right-hardware-for-your-new-hadoop-cluster/, 2013.
15 Jonas Widriksson, How to build a 7 node Raspberry Pi Hadoop Cluster, http://www.widriksson.com/raspberry-pi-hadoop-cluster, 2014.
16 Understanding Hadoop Cluster and the Network, http://bradhedlund.com/2011/09/10/understanding-hadoop-clusters-and-the-network/, 2011.
17 S. Seshachala, Big data - Understanding Hadoop and its Ecosystem, http://devops.com/2015/06/01/bigdata-understanding-hadoop-ecosystem/, 2015.