Browse > Article
http://dx.doi.org/10.6109/jkiice.2017.21.11.2067

Interoperability between NoSQL and RDBMS via Auto-mapping Scheme in Distributed Parallel Processing Environment  

Kim, Hee Sung (Analytics & Decision Department, KSTEC Inc.)
Lee, Bong Hwan (Department of Electronics, Information and Communications Engineering, Daejeon University)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.21, no.11, 2017 , pp. 2067-2075 More about this Journal
Abstract
Lately big data processing is considered as an emerging issue. As a huge amount of data is generated, data processing capability is getting important. In processing big data, both Hadoop distributed file system and unstructured date processing-based NoSQL data store are getting a lot of attention. However, there still exists problems and inconvenience to use NoSQL. In case of low volume data, MapReduce of NoSQL normally consumes unnecessary processing time and requires relatively much more data retrieval time than RDBMS. In order to address the NoSQL problem, in this paper, an interworking scheme between NoSQL and the conventional RDBMS is proposed. The developed auto-mapping scheme enables to choose an appropriate database (NoSQL or RDBMS) depending on the amount of data, which results in fast search time. The experimental results for a specific data set shows that the database interworking scheme reduces data searching time by 35% at the maximum.
Keywords
Hadoop; NoSQL; RDBMS; Big data; Auto-mapping;
Citations & Related Records
Times Cited By KSCI : 5  (Citation Analysis)
연도 인용수 순위
1 Y. G. Kim, S. H. Kim, M. H. Jo, and W. J. Kim, "The Bigdata Processing Environment Building for the Learning System," Journal of the Korea Institute of Electronic Communication Sciences, vol. 9, no. 7, pp.791-797, July 2014.   DOI
2 S. R. Kim, G. S. Jang, and C. W. Cho, "Case Study of Design and Implementation for Hadoop-Based Integrated Facility Monitoring System," Journal of the Korea Institute of Industrial Engineers, vol. 40, no.1, pp.34-42, Jan. 2014.   DOI
3 K. S. Kim, S. J. Ham, J. Y. Ha, and T. S. Kim, "Performance Analysis of HDFS based on Heterogeneous Storages," in Proceedings of Korea Computer Congress, Pukyong University, pp.1475-1477, April 2014.
4 H. Y. Ahn, K. H. Lee, S. H. Lee, Y. H. Lee, S. M. Lee, and Y. K. Kim, "An Efficient Method for Enhancing the Storage Efficiency in Hadoop DFS," KIISE Transactions on Computing Practices, vol.19, no.3, pp.144-148, Mar. 2013.
5 H. W. Kim, S. E. Park, and S. Y. Euh, "The Distributed Encryption Processing System for Large Capacity Personal Information based on MapReduce," Journal of the Korea Instituted of Information and Communication Engineering, vol.18, no.3, pp.576-585, Mar. 2014.   DOI
6 K. S. Noh and D. S. Lee, "Bigdata Platform Implementation Model," Indian Journal of Science and Technology, vol.8, no.18, Aug. 2015.
7 A. Abouzeid, K. B. Pawlikowski, D. Abadi, A. Silberschatz, and A. Rasin, "HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads," In Proceedings of the VLDB, Aug. 2009.
8 J. K. Bae, "A Study on Technical Issues and Institutional Issues of BigData Analysis Market: Focusing on the In-depth Interview Method," Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, vol.7, no.5, pp. 885-894, May 2017.
9 K. A. Yang, D. W. Lee, K. H. Kim, and H. J. Yoon, "Analysis of Security Threat and Security Requirements of the Bigdata System," Journal of Security Engineering, vol.13, no.6, pp. 501-514, June 2016.   DOI
10 S. T. Hong, M. Yun, D. H. Choe, H. S. Jo, and J. U Jang, "HadoopX : Hadoop MapReduce-based Iterative Data Processing System," Korea Information Processing Society Review, vol.21, no.3, pp.8-16, Mar. 2014.
11 S. H. Lee and D. W. Lee, "Big Data Processing and Utilization," Journal of Digital Convergence, vol.11, no.4, pp.267-271, April 2013.   DOI
12 K. H. Han et al, "A Study on implementation model for security log analysis system using Big Data platform," Journal of Digital Convergence, vol.12, no.8, pp.351-359, Aug. 2014.   DOI