Browse > Article
http://dx.doi.org/10.9728/dcs.2015.16.2.299

General-purpose Transaction Management Technique for Data Stability of NoSQL on Distributed File System  

Kwon, Younghyun (Emerging Technology R&D Center, WISEnut, Inc.)
Yun, Do-hyun (Emerging Technology R&D Center, WISEnut, Inc.)
Park, Hojin (Emerging Technology R&D Center, WISEnut, Inc.)
Publication Information
Journal of Digital Contents Society / v.16, no.2, 2015 , pp. 299-306 More about this Journal
Abstract
In this paper, we research to secure stability of data storing/searching on NoSQL implemented on Distributed File System. When implementing NoSQL on Distributed File System, we faced that random write on Distributed File System is almost impossible. To solve this problem, a concept of Intermediate-File was employed, and then it has been achieved that our system resist any failure circumstance. Additionally, since we discovered its performance cannot be as fast as general File System, by redefining the file block unit for our NoSQL system, we have prevented a slowdown in system performance. As a result, we are able to develop highly scalable NoSQL as Distributed File System, which fulfills basic conditions of transaction: Atomicity, Consistency, Isolation, and Performance.
Keywords
Big data; Data Stability; Distributed File System; NoSQL; Transaction;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Hilbert, M, Lopez, P., "The World's Technological Capacity to Store, Communicate, and Compute Information," Science 332 (6025): 60-65. doi:10.1126/science.1200970, PMID 21310967, 2011.   DOI   ScienceOn
2 IBM, "What is big data?-Bringing big data to theenterprise," http://www-01.ibm.com/software/data/bigdata/what-is-big-data.html, Retrieved 2013-08-26.
3 Sanjay Ghemawat, Howard Gobioff, Shun-Tak Leung, The Google file system, Proceedings of the nineteenth ACM symposium on Operating systems principles, Bolton Landing, NY, USA [doi>10.1145/945445.945450], October 19-22, 2003   DOI
4 Konstantin Shvachko, Hairong Kuang, Sanjay Radia, Robert Chansler, "The Hadoop Distributed File System," Proceedings of the 2010 IEEE 26th Symposiumon Mass Storage Systems and Technologies (MSST), p.1-10, [doi>10.1109/MSST.2010.5496972], May03-07, 2010.   DOI
5 Jing Han, Haihong, E., Guan Le; Jian Du, "Surveyon NoSQL database," Pervasive Computing and Applications (ICPCA), 2011 6th International Conference on, vol., no., pp.363-366, doi: 10.1109/ICPCA.2011.6106531, 26-28 Oct. 2011.   DOI
6 Younghyun Kwon, Yongseung Kang, Youngmin Ahn, "Business Intelligence Applying Document-TypeBigdata Analysis", Korea information processing society review, vol.19 no.2, pp.86-94, 2012.
7 L.Sudha Rani, K. Sudhakar, S.Vinay Kumar, / (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 5 (3),3716-3721, 2014.
8 Sunita Mahajan"Distributed Computing", Oxford University Press.
9 Jeffrey Dean, Sanjay Ghemawat, MapReduce: simplified data processing on large clusters, Proceedingsof the 6th conference on Symposium on OpeartingSystems Design & Implementation, p.10-10, San Francisco, CA, December 06-08, 2004.
10 Apache, "HDFS Architecture Guide," http://hadoop.apache.org/docs/r1.2.1/hdfs_design.html, Retrieved2015-03-06.
11 Strozzi, Carlo, "NoSQL-A relational database management system," http://www.strozzi.it/cgi-bin/CSA/tw7/I/en_US/nosql/Home%20Page, Retrieved 2015-03-06.
12 Gajendran, Santhosh Kumar. "A survey on nosqldatabases." University of Illinois, 2012.
13 Stonebraker, Michael. "SQL databases v. NoSQLdatabases," Communications of the ACM 53.4, 10-11, 2010.   DOI
14 Peng, Daniel, and Frank Dabek, "Large-scale Incremental Processing Using Distributed Transactions and Notifications," OSDI. Vol. 10. 2010.
15 Wei, Zhou, Guillaume Pierre, and Chi-Hung Chi, "CloudTPS: Scalable transactions for Web applicationsin the cloud," Services Computing, IEEE Transactions on 5.4, 525-539, 2012.   DOI   ScienceOn