Browse > Article
http://dx.doi.org/10.17661/jkiiect.2021.14.4.300

Design of Efficient Big Data Collection Method based on Mass IoT devices  

Choi, Jongseok (Spartan Software Education Institute, Soongsil University)
Shin, Yongtae (School of Computing, Soongsil University)
Publication Information
The Journal of Korea Institute of Information, Electronics, and Communication Technology / v.14, no.4, 2021 , pp. 300-306 More about this Journal
Abstract
Due to the development of IT technology, hardware technologies applied to IoT equipment have recently been developed, so smart systems using low-cost, high-performance RF and computing devices are being developed. However, in the infrastructure environment where a large amount of IoT devices are installed, big data collection causes a load on the collection server due to a bottleneck between the transmitted data. As a result, data transmitted to the data collection server causes packet loss and reduced data throughput. Therefore, there is a need for an efficient big data collection technique in an infrastructure environment where a large amount of IoT devices are installed. Therefore, in this paper, we propose an efficient big data collection technique in an infrastructure environment where a vast amount of IoT devices are installed. As a result of the performance evaluation, the packet loss and data throughput of the proposed technique are completed without loss of the transmitted file. In the future, the system needs to be implemented based on this design.
Keywords
Big Data; Hadoop; IoT; Smart Factory; Clustering;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 J. M. Moon, K. S. Shin, "Measurement of Latency and Uplink Throughput According to Number of NB-IoT Devices", The Journal of Korean Institute of Communications and Information Sciences ,Vol.44 No.06, pp.1188-1192
2 K. Shvachko, H. Kuang, S. Radia, R. Chansler, "The Hadoop Distributed File System. In Mass Storage Systems and Technologies (MSST)," 2010 IEEE 26th symposium on IEEE, Vol.1, No.1, pp.1-10, 2010.
3 K. S. Noh, S. T. Park. K. H. Park, "Convergence Study on Big Data Competency Reference Model", Journal of Digital Convergence, Vol. 13, No. 3, pp.55-63, 2015   DOI
4 B. H. Lee, D. M. Yang, "A Security Log Analysis System using Logstash based on Apache Elasticsearch", Journal of the Korea Institute of Information and Communication Engineering, Vol. 22, No. 2, pp.382-389, Feb, 2018   DOI
5 G. W. Jin, "A Study on the Data Collection Methods based Hadoop Distributed Environment", Journal of the Korea Convergence Society, Vol. 7, No. 5, pp.1-6, Oct, 2016   DOI
6 Y. H. Lee, J. H. Suh, "Big Data Platform for Utilizing and Analyzing Real-Time Sensing Information in Industrial Sites", The Korean Society for Creative Information Culture, Vol. 6, No. 1, pp.15-21, Apr, 2020
7 V. Q. Nguyen, H. N. Nguyen, K. B. Kim, "Design of a Platform for Collecting and Analyzing Agricultural Big Data", Journal of Digital Contents Society, Vol. 18, No. 1, pp. 149-158, Feb. 2017   DOI
8 K. I. Kim, J. S. Kim, "Big Data Processing and Performance Improvement for Ship Trajectory using MapReduce Technique", Journal of The Korea Society of Computer and Information, Vol. 24 No. 10, pp. 65-70, Oct, 2019