Browse > Article
http://dx.doi.org/10.5762/KAIS.2018.19.3.669

Development of Information Technology Infrastructures through Construction of Big Data Platform for Road Driving Environment Analysis  

Jung, In-taek (ICT Convergence and Integration Research Institute, Korea Institute of Civil Engineering and Building Technology)
Chong, Kyu-soo (ICT Convergence and Integration Research Institute, Korea Institute of Civil Engineering and Building Technology)
Publication Information
Journal of the Korea Academia-Industrial cooperation Society / v.19, no.3, 2018 , pp. 669-678 More about this Journal
Abstract
This study developed information technology infrastructures for building a driving environment analysis platform using various big data, such as vehicle sensing data, public data, etc. First, a small platform server with a parallel structure for big data distribution processing was developed with H/W technology. Next, programs for big data collection/storage, processing/analysis, and information visualization were developed with S/W technology. The collection S/W was developed as a collection interface using Kafka, Flume, and Sqoop. The storage S/W was developed to be divided into a Hadoop distributed file system and Cassandra DB according to the utilization of data. Processing S/W was developed for spatial unit matching and time interval interpolation/aggregation of the collected data by applying the grid index method. An analysis S/W was developed as an analytical tool based on the Zeppelin notebook for the application and evaluation of a development algorithm. Finally, Information Visualization S/W was developed as a Web GIS engine program for providing various driving environment information and visualization. As a result of the performance evaluation, the number of executors, the optimal memory capacity, and number of cores for the development server were derived, and the computation performance was superior to that of the other cloud computing.
Keywords
Big data; Cloud computing; Driving environment; Information technology infrastructure; Platform; Public data; Vehicle sensor;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Y. Seo, W. Kim, "Information Visualization Process for Spatial Big Data", Journal of Korea Spatial Information Society, vol. 23, no. 6, pp. 109-116, 2015. DOI: https://doi.org/10.12672/ksis.2015.23.6.109   DOI
2 H. Singh, S. Bawa, "A Survey of Traditional and MapReduce Based Spatial Query Processing Approaches", ACM SIGMOD Record, vol. 46, no. 2, pp. 18-29, 2017. DOI: https://doi.org/10.1145/3137586.3137590   DOI
3 S. Shim, K. Choi, S. Lee, S. Namkoong, "An Expressway Path Travel Time Estimation Using Hi-pass DSRC Off-Line Travel Data", Journal of Korean Society of Transportation, vol. 31, no. 3, pp. 45-54, 2013. DOI: http://doi.org/10.7470/jkst.2013.31.3.045   DOI
4 I. Jung, "AADT Estimation of Unobserved Road Segments Using GPS Vehicle Trip Data", Seoul National University Ph. D thesis, 2016.
5 J. Gantz, D. Reinsel, THE DIGITAL UNIVERSE IN 2020: Big Data, Bigger Digital Shadows, and Biggest Growth in the Far East, p. 1-3, International Data Corporation Analyze the Future, 2012.
6 National Information Society Agency, Open Data Portal, Available From: https://www.data.go.kr/.
7 I. Jung, K. Chong, "Development of Platform for Driving Environment Analysis using Vehicle Sensing and Public Big Data", Transportation Technology and policy, vol. 14, no. 4, pp. 10-19, 2017.
8 J. Kim, "Big data Utilization and related Technique and Technology Analysis", Korea Contents Association Journal, vol. 10, no. 1, pp. 34-40, 2012. DOI: https://doi.org/10.5392/JKCA.2012.12.03.034
9 M. Son, Analysis of the domestic/foreign technology development and market outlook of promising industry related to artificial intelligence/big data, pp. 241-271, Knowledge Industry Information Institute, 2016.
10 J. Lee, "Big Data Technology Trend", Hallym ICT Policy Journal, vol. 2, pp. 14-19, 2015.
11 K. Shvachko, H. Kuang, S. Radia, R. Chansler, "The Hadoop Distributed File System," Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies(MSST), pp. 1-10, 2010. DOI: https://doi.org/10.1109/MSST.2010.5496972
12 A. Lakshman, P. Malik, "Cassandra: a Decentralized Structured Storage System", ACM SIGOPS Operating Systems Review, vol. 44, no. 2, pp. 35-40, 2010. DOI: https://doi.org/10.1145/1773912.1773922   DOI
13 R. Padhy, M. Patra, S. Satapathy, "RDBMS to NoSQL: Reviewing Some Next-Generation Non-Relational Database's", International Journal of Advanced Engineering Science and Technologies, vol. 11, no. 1, pp. 15-30, 2011.