Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

An Efficient Implementation of Mobile Raspberry Pi Hadoop Clusters for Robust and Augmented Computing Performance

  • Srinivasan, Kathiravan (School of Information Technology and Engineering, Vellore Institute of Technology) ;
  • Chang, Chuan-Yu (Dept. of Computer Science and Information Engineering, National Yunlin University of Science and Technology) ;
  • Huang, Chao-Hsi (Dept. of Computer Science and Information Engineering, National Ilan University) ;
  • Chang, Min-Hao (Dept. of Computer Science and Information Engineering, National Ilan University) ;
  • Sharma, Anant (Dept. of Computer Science and Engineering, The LNM Institute of Information Technology) ;
  • Ankur, Avinash (Dept. of Computer Science and Engineering, The LNM Institute of Information Technology)
  • Received : 2017.11.15
  • Accepted : 2018.01.29
  • Published : 2018.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Rapid advances in science and technology with exponential development of smart mobile devices, workstations, supercomputers, smart gadgets and network servers has been witnessed over the past few years. The sudden increase in the Internet population and manifold growth in internet speeds has occasioned the generation of an enormous amount of data, now termed 'big data'. Given this scenario, storage of data on local servers or a personal computer is an issue, which can be resolved by utilizing cloud computing. At present, there are several cloud computing service providers available to resolve the big data issues. This paper establishes a framework that builds Hadoop clusters on the new single-board computer (SBC) Mobile Raspberry Pi. Moreover, these clusters offer facilities for storage as well as computing. Besides the fact that the regular data centers require large amounts of energy for operation, they also need cooling equipment and occupy prime real estate. However, this energy consumption scenario and the physical space constraints can be solved by employing a Mobile Raspberry Pi with Hadoop clusters that provides a cost-effective, low-power, high-speed solution along with micro-data center support for big data. Hadoop provides the required modules for the distributed processing of big data by deploying map-reduce programming approaches. In this work, the performance of SBC clusters and a single computer were compared. It can be observed from the experimental data that the SBC clusters exemplify superior performance to a single computer, by around 20%. Furthermore, the cluster processing speed for large volumes of data can be enhanced by escalating the number of SBC nodes. Data storage is accomplished by using a Hadoop Distributed File System (HDFS), which offers more flexibility and greater scalability than a single computer system.

Keywords

References

  1. A. Greenberg, J. Hamilton, D. A. Maltz, and P. Patel, "The cost of a cloud: research problems in data center networks," ACM SIGCOMM Computer Communication Review, vol. 39, no. 1, pp. 68-73, 2008. https://doi.org/10.1145/1496091.1496103
  2. J. M. Ross, "Roger Magoulas on big data," 2010 [Online]. Available: https://perma.cc/NXB5-ER87.
  3. P. Zikopoulos, C. Eaton, D. deRoos, T. Deutsch, and G. Lapis, Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data. New York, NY: McGraw-Hill, 2011.
  4. L. Xue, J. Ni, Y. Li, and J. Shen, "Provable data transfer from provable data possession and deletion in cloud storage," Computer Standards & Interfaces, vol. 54, pp. 46-54, 2017. https://doi.org/10.1016/j.csi.2016.08.006
  5. J. Dean and S. Ghemawat, "MapReduce: simplified data processing on large clusters," in Proceedings of the 6th Symposium on Operating System Design and Implementation (OSDI), San Francisco, CA, 2004, pp. 137-150.
  6. C. Lam, "Introducing Hadoop," in Hadoop in Action. Stanford, CT: Manning Publications, 2011
  7. W. P. Birmingham and D. P. Siewiorek, "MICON: a knowledge based single board computer designer," in Proceedings of the 21st Conference on Design Automation, Albuquerque, NM, 1984, pp. 565-571.
  8. P. Abrahamsson, S. Helmer, N. Phaphoom, L. Nicolodi, N. Preda, L. Miori, et al., "Affordable and energyefficient cloud computing clusters: The bolzano raspberry pi cloud cluster experiment," in Proceedings of 2013 IEEE 5th International Conference on Cloud Computing Technology and Science (CloudCom), Bristol, UK, 2013, pp. 170-175.
  9. S. J. Cox, J. T. Cox, R. P. Boardman, S. J. Johnston, M. Scott, and N. S. O'brien, "Iridis-Pi: a low-cost, compact demonstration cluster," Cluster Computing, vol. 17, no. 2, pp. 349-358, 2014. https://doi.org/10.1007/s10586-013-0282-7
  10. J. Kiepert, "Creating a raspberry pi-based Beowulf cluster," 2013 [Online]. Available: http://coen.boisestate.edu/ece/files/2013/05/Creating.a.Raspberry.Pi-Based.Beowulf.Cluster_v2.pdf.
  11. F. P. Tso, D. R. White, S. Jouet, J. Singer, and D. P. Pezaros, "The Glasgow raspberry pi cloud: a scale model for cloud computing infrastructures," in Proceedings of 2013 IEEE 33rd International Conference on Distributed Computing Systems Workshops (ICDCSW), Philadelphia, PA, 2013, pp. 108-112.
  12. N. Schot, "Feasibility of raspberry pi 2 based micro data centers in big data applications," in Proceedings of the 23th University of Twente Student Conference on IT, Enschede, The Netherlands, 2015, pp. 1-9.
  13. C. Kaewkasi and W. Srisuruk, "A study of big data processing constraints on a low-power Hadoop cluster," in Proceedings of 2014 International Computer Science and Engineering Conference (ICSEC), Khon Kaen, Thailand, 2014, pp. 267-272.
  14. B. Qureshi, Y. Javed, A. Koubaa, M. F. Sriti, and M. Alajlan, "Performance of a low cost Hadoop cluster for image analysis in cloud robotics environment," Procedia Computer Science, vol. 82, pp. 90-98, 2016. https://doi.org/10.1016/j.procs.2016.04.013
  15. W. Hajji and F. P. Tso, "Understanding the performance of low power Raspberry Pi Cloud for big data," Electronics, vol. 5, no. 2, article no. 29, 2016.
  16. R. Morabito, "Virtualization on internet of things edge devices with container technologies: a performance evaluation," IEEE Access, vol. 5, pp. 8835-8850, 2017. https://doi.org/10.1109/ACCESS.2017.2704444
  17. H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, "Speeded-up robust features (SURF)," Computer Vision and Image Understanding, vol. 110, no. 3, pp. 346-359, 2008. https://doi.org/10.1016/j.cviu.2007.09.014