Browse > Article
http://dx.doi.org/10.9717/kmms.2016.19.8.1487

Torus Network Based Distributed Storage System for Massive Multimedia Contents  

Kim, Cheiyol (High Performance Computing Research Dept., Electronics and Telecommunications Research Institute)
Kim, Dongoh (High Performance Computing Research Dept., lectronics and Telecommunications Research Institute)
Kim, Hongyeon (High Performance Computing Research Dept., Electronics and Telecommunications Research Institute)
Kim, Youngkyun (High Performance Computing Research Dept., Electronics and Telecommunications Research Institute)
Seo, Daewha (Dept. of Electronics Eng., School of IT, Kyungpook National University)
Publication Information
Journal of Korea Multimedia Society / v.19, no.8, 2016 , pp. 1487-1497 More about this Journal
Abstract
Explosively growing service of digital multimedia data increases the need for highly scalable low-cost storage. This paper proposes the new storage architecture based on torus network which does not need network switch and erasure coding for efficient storage usage for high scalability and efficient disk utilization. The proposed model has to compensate for the disadvantage of long network latency and network processing overhead of torus network. The proposed storage model was compared to two most popular distributed file system, GlusterFS and Ceph distributed file systems through a prototype implementation. The performance of prototype system shows outstanding results than erasure coding policy of two file systems and mostly even better results than replication policy of them.
Keywords
Distributed Storage; Torus Network; Multimedia Storage; Scalability;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Young Jin Nam, Soon Hwan Jeong, and Young Kyun Park. "A Hybrid Storage Architecture with a Content Caching Algorithm for Networked Digital Signage." Journal of Korea Multimedia Society, Vol. 15, No. 5, 2012.05. (pp. 651-663)   DOI
2 J.S. Plank, and C. Huang, "Tutorial: Erasure Coding for Storage Applications," Proceeding of Slides Presented at FAST-2013: 11th Usenix Conference on File and Storage Technologies, Feb. 2013.
3 Torus Interconnect, https://en.wikipedia.org/wiki/Torus_interconnect, (Accessed July, 17, 2016)
4 P. Gill, M. Arlitt, Z. Li, and A. Mahanti, "Youtube traffic characterization: a view from the edge." Proceedings of the 7th ACM SIGCOMM conference on Internet measurement. ACM, 2007. (pp. 15-28)
5 M. Blumrich, D. Chen, P. Coteus, A. Gara, M. Giampapa, and P. Heidelberger, et al, Design and Analysis of the BlueGene/L Torus Interconnection Network, Vol. 3, IBM Research Report RC23025 (W0312- 022), 2003.
6 S. Ghemawat, H. Gobioff, and S.T. Leung, The Google File System, ACM SIGOPS Operating Systems Review, ACM 1-58113-757-5/03/0010, 2003.
7 D. Ford, F. Labelle, F. I. Popovici, M. Stokely, V. A. Truong, L. Barroso et al., Availability in Globally Distributed Storage Systems, OSDI. 2010.
8 GlusterFS, http://www.gluster.com/, (accessed July, 5, 2016).
9 Sage A. Weil, Scott A. Brandt, Ethan L. Miller, Darrell D. E. Long, and Carlos Maltzahn, "Ceph: A Scalable, High- performance Distributed File System," Proceedings of the 7th Symposium on Operating Systems Design and Implementation, USENIX Association, 2006. (pp. 307-320)
10 K. Shvachko, H. Kuang, S. Radia, and R. Chansler, "The Hadoop Distributed File System," Proceeding of Mass Storage Systems and Technologies, 2010 IEEE 26th Symposium on IEEE, 2010. (pp. 1-10)
11 K.V. Rashmi, N.B. Shah, and P.V. Kumar, "Optimal Exact-regenerating Codes for Distributed Storage at the MSR and MBR Points via a Product-matrix Construction," , IEEE Transactions on Information Theory, Vol. 57, No. 8, 2011. (pp. 5227-5239)   DOI
12 C. Huang, M. Chen, and J. Li, "Pyramid Codes: Flexible Schemes to Trade Space for Access Efficiency in Reliable Data Storage Systems," ACM Transactions on Storage, Vol. 9, No. 1, 2013. (pp. 3:1-3:28)
13 FUSE File System, https://github.com/libfuse/libfuse, (Accessed July, 10, 2015)
14 J.S. Plank, S. Simmerman, and C.D. Schuman, Jerasure: A Library in C/C++ Facilitating Erasure Coding for Storage Applications-Version 1.2, Technical Report CS-08-627, University of Tennessee, 2008.
15 Intel ISA-L, https://software.intel.com/en-us/storage/ISA-L, (Accessed July, 20, 2016)
16 Ceph Erasure Coding Introduction, https://software.intel.com/en-us/blogs/2015/04/06/ceph-erasure-coding-introduction, (Accessed July, 6, 2015).
17 IOzone Filesystem Benchmark, http://www.iozone.org/, (Accessed July, 15, 2015)