Browse > Article
http://dx.doi.org/10.6109/jkiice.2019.23.11.1330

Development of scalable big data storage system using network computing technology  

Park, Jung Kyu (Department of Computer Software Engineering, Changshin University)
Park, Eun Young (Department of Biomedical Laboratory Science, Shinhan University)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.23, no.11, 2019 , pp. 1330-1336 More about this Journal
Abstract
As the Fourth Industrial Revolution era began, a variety of devices are running on the cloud. These various devices continue to generate various types of data or large amounts of multimedia data. To handle this situation, a large amount of storage is required, and big data technology is required to process stored data and obtain accurate information. NAS (Network Attached Storage) or SAN (Storage Area Network) technology is typically used to build high-speed, high-capacity storage in a network-based environment. In this paper, we propose a method to construct a mass storage device using Network-DAS which is an extension technology of DAS (Direct Attached Storage). Benchmark experiments were performed to verify the scalability of the storage system with 76 HDD. Experimental results show that the proposed high performance mass storage system is scalable and reliable.
Keywords
Big Data; Storage; Network-DAS; Scalability; Network Computing;
Citations & Related Records
연도 인용수 순위
  • Reference
1 fio. Flexible I/O tester [Internet]. Available: https://fio.readthedocs.io/en/latest/fio_doc.html.
2 trace-replay. trace-replay [Internet]. Available: https://github.com/yongseokoh/trace-replay.
3 Gluster. Gluster scalable network filesystem. [Internet]. Available: https://www.gluster.org/
4 IDC. DataAge 2025 whitepaper [Internet]. Available: https://www.seagate.com/files/www-content/our-story/trends/files/idc-seagate-dataage-whitepaper.pdf.
5 J. Cha, and S. Kim, "Analysis of I/O Performance for Optimizing Software Defined Storage in Cloud Integration," in Proceeding of the IEEE 3rd International Conference on Communication and Information Systems (ICCIS), Singapore: Singapore, pp. 222-226, 2018.
6 J. Zhou, D. Dai, Y. Mao, X. Chen, Y. Zhuang, and Y. Chen, "I/O Characteristics Discovery in Cloud Storage Systems," in Proceeding of the IEEE 11th International Conference on Cloud Computing (CLOUD), San Francisco: CA, pp. 170-177, 2018.
7 J. Park, Y. Bae, and S. Jung, "Technical analysis of Cloud Storage for Cloud Computing," International Journal of Information and Communication Engineering, vol. 17, no. 5, pp. 1129-1137, May. 2013.
8 S. M. Shin, and V. Roy, "Hybrid key-Based Encryption in Cloud Storage," Asia-pacific Journal of Convergent Research Interchange, vol. 2, no. 3, pp. 29-34, Sep. 2016.   DOI
9 E. Tomes, and N. Altiparmak, "A Comparative Study of HDD and SSD RAIDs' Impact on Server Energy Consumption," in Proceeding of the IEEE International Conference on Cluster Computing (CLUSTER), Honolulu: HI, pp. 625-626, 2017.
10 T. Ariefianto, L. V. Yovita, and D. Olviovitha, "Performance analysis of AoE-SAN using bonding interface over RAID," in Proceeding of the 2nd International Conference on Information and Communication Technology (ICoICT), Bandung: Indonesia, pp. 106-110, 2014.
11 D. Li, Q. Wang, C. Guyot, A. Narasimha, D. Vucinic, Z. Bandic, and Q. Yang, "Hardware accelerator for similarity based data dedupe," in Proceeding of the IEEE International Conference on Networking, Architecture and Storage (NAS), Boston: MA, pp. 224-232, 2015.
12 NDAS. Network Direct Attached Storage [Internet]. Available: https://en.wikipedia.org/wiki/Network_Direct_Attached_Storage.
13 A. Jaikar, S. A. R. Shah, S. Noh, and S, Bae, "Performance Analysis of NAS and SAN Storage for Scientific Workflow," in Proceeding of the International Conference on Platform Technology and Service (PlatCon), Jeju, pp. 1-4, 2016.
14 T. K. Okada, A. Goldman, and G. G. H. Cavalheiro, "Using NAS Parallel Benchmarks to evaluate HPC performance in clouds," in Proceeding of the IEEE 15th International Symposium on Network Computing and Applications (NCA), Cambridge: MA, pp. 27-30, 2016.
15 M. Selvaganesan, and M. A. Liazudeen, "An Insight about GlusterFS and Its Enforcement Techniques," in Proceeding of the 2016 International Conference on Cloud Computing Research and Innovations (ICCCRI), Singapore: Singapore, pp. 120-127, 2016.