Browse > Article
http://dx.doi.org/10.4218/etrij.16.0115.0412

Optimal Heterogeneous Distributed Storage Regenerating Code at Minimum Remote-Repair Bandwidth Regenerating Point  

Xu, Jian (School of Information Science and Engineering, Shandong University)
Cao, Yewen (School of Information Science and Engineering, Shandong University)
Wang, Deqiang (School of Information Science and Engineering, Shandong University)
Wu, Changlei (School of Information Science and Engineering, Shandong University)
Yang, Guang (School of Information Science and Engineering, Shandong University)
Publication Information
ETRI Journal / v.38, no.3, 2016 , pp. 529-539 More about this Journal
Abstract
Recently, a product-matrix (PM) framework was proposed to construct optimal regenerating codes for homogeneous distributed storage systems (DSSs). In this paper, we propose an extended PM (EPM) framework for coding of heterogeneous DSSs having different repair bandwidths but identical storage capacities. Based on the EPM framework, an explicit construction of minimum remote-repair bandwidth regenerating (MRBR) codes is presented for a specific heterogeneous DSS, where two geographically different datacenters with associated storage nodes are deployed. The data reconstruction and regeneration properties of the MRBR code are proved strictly. For the purpose of demonstration, an example implementation of MRBR code is provided. The presented MRBR code is the first optimal strict-regenerating code for heterogeneous DSSs. In addition, our proposed EPM framework can be applied to homogeneous systems also.
Keywords
Heterogeneous distributed storage; remoterepair bandwidth; regenerating code; extended productmatrix; strict-regenerating code;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Y.J. Chen, C.H. Liao, and L.C. Wang, "An Eavesdropping Prevention Problem when Repairing Network Coded Data from Remote Distributed Storage," Global Commun. Conf., Atlanta, GA, USA, Dec. 9-13, 2013, pp. 2711-2716.
2 A.G. Dimakis et al., "Network Coding for Distributed Storage Systems," IEEE Trans. Inf. Theory, vol. 56, no. 9, Sept. 2010, pp. 4539-4551.   DOI
3 R. Bhagwan et al., "Total Recall: System Support for Automated Availability Management," Symp. Networked Syst. Des. Implementation, San Francisco, CA, USA, Mar. 29-31, 2004, pp. 337-350.
4 F. Dabek et al., "Designing a DHT for Low Latency and High Throughput," Symp. Networked Syst. Des. Implementation, San Francisco, CA, USA, Mar. 29-31, 2004, pp. 85-98.
5 S. Rhea et al., "Pond: The OceanStore Prototype," USENIX Conf. File Storage Technol., San Francisco, CA, USA, Mar. 31-Apr. 2, 2003, pp. 1-14.
6 H. Weatherspoon and J.D. Kubiatowicz, "Erasure Coding vs. Replication: A Quantitative Comparison," in Peer-to-Peer Syst.: 1st Int. Workshop, IPTPS 2002 Cambridge, MA, USA, Mar. 7-8, 2002, Revised Papers, Heidelberg, Germany: Springer, 2002, pp. 328-337.
7 R. Rodrigues and B. Liskov, "High Availability in DHTs: Erasure Coding vs. Replication," in Peer-to-Peer Syst. IV: Int. Workshop, Ithaca, NY, USA, Feb. 24-25, 2005, Revised Sel. Papers, Heidelberg, Germany: Springer, 2005, pp. 226-239.
8 K.V. Rashmi, N.B. Shah, and P.V. Kumar, "Optimal Exact-Regenerating Codes for the MSR and MBR Points via a Product-Matrix Construction," IEEE Trans. Inf. Theory, vol. 57, no. 8, Aug. 2011, pp. 5227-5239.   DOI
9 K.V. Rashmi et al., "Explicit Construction of Optimal Exact Regenerating Codes for Distributed Storage," Ann. Allerton Conf. Commun., Contr., Comput., Monticello, IL, USA, Sept. 30-Oct. 2, 2009, pp. 1243-1249.
10 O. Olmez and A. Ramamoorthy, "Repairable Replication-Based Storage Systems Using Resolvable Designs," Ann. Allerton Conf. Commun., Contr., Comput., Monticello, IL, USA, Oct. 1-5, 2012, pp. 1174-1181.
11 Y.S. Han et al., "Update-Efficient Error-Correcting Product-Matrix Codes," IEEE Trans. Commun., vol. 63, no. 6, June 2015, pp. 1925-1938.   DOI
12 T. Ernvall, "Codes between MBR and MSR Points with Exact Repair Property," IEEE Trans. Inf. Theory, vol. 60, no. 11, Nov. 2014, pp. 6993-7005.   DOI
13 S. Pawar, S. El Rouayheb, and K. Ramchandran, "On Secure Distributed Data Storage under Repair Dynamics," IEEE Int. Symp. Inf. Theory, Austin, TX, USA, July 13, 2010, pp. 2543-2547.
14 N.B. Shah, K. Rashmi, and P.V. Kumar, "Information-Theoretically Secure Regenerating Codes for Distributed Storage," IEEE Global Telecommun. Conf., Houston, TX, USA, Dec. 5-9, 2011, pp. 1-5.
15 J. Kubiatowicz et al., "OceanStore: An Architecture for Global-Scale Persistent Storage," Int. Conf. Architectural Support Programming Languages Operaing Syst., Cambridge, MA, USA, Nov. 12-15, 2000, pp. 190-201.
16 A. Ha, P2P Startup Space Monkey Raises 2.25 m Led by Google Ventures and Venture 51, Aol TechCrunch, July 11, 2012, Accessed Feb. 25, 2015. http://techcrunch.com/2012/07/11/space-monkey-seed-round
17 H. Zhang et al., "A Distributed Multichannel Demand-Adaptive P2P VoD System with Optimized Caching and Neighbor-Selection," Proc. SPIE, San Diego, CA, USA, Aug. 22-24, 2011, pp. 81350X-1-81350X-19.
18 T. Ernvall et al., "Capacity and Security of Heterogeneous Distributed Storage Systems," IEEE J. Sel. Areas Commun., vol. 31, no. 12, Dec. 2013, pp. 2701-2709.   DOI
19 S. Pawar et al., "Codes for a Distributed Caching Based Videoon-Demand System," Conf. Record Asilomar Conf. Signals, Syst., Comput., Pacific Grove, CA, USA, Nov. 6-9, 2011, pp. 1783-1787.
20 N. Golrezaei, A.G. Dimakis, and A.F. Molisch, "Wireless Deviceto-Device Communications with Distributed Caching," IEEE Int. Symp. Inf. Theory Proc., Cambridge, MA, USA, July 1-6, 2012, pp. 2781-2785.
21 Q. Yu, K.W. Shum, and C.W. Sung, "Tradeoff between Storage Cost and Repair Cost in Heterogeneous Distributed Storage Systems," Trans. Emerg. Telecommun. Technol., vol. 26, no. 10, Oct. 2015, pp. 1201-1211.   DOI
22 K.G. Benerjee and M.K. Gupta, "Tradeoff for Heterogeneous Distributed Storage Systems between Storage and Repair Cost." Preprint, submitted Mar. 8, 2015. http://arxiv.org/abs/1503.02276v1
23 V.T. Van, C. Yuen, and J. Li, "Non-homogeneous Distributed Storage Systems," Ann. Allerton Conf. Commun., Contr., Comput., Monticello, IL, USA, Oct. 1-5, 2012, pp, 1133-1140.
24 Q. Yu, C.W. Sung, and T.H. Chan, "Irregular Fractional Repetition Code Optimization for Heterogeneous Cloud Storage," IEEE J. Sel. Areas Commun., vol. 32, no. 5, May 2014, pp. 1048-1060.   DOI
25 D. Leong, A.G. Dimakis, and T. Ho, "Distributed Storage Allocations," IEEE Trans. Inf. Theory, vol. 58, no. 7, July 2012, pp. 4733-4752.   DOI
26 V. Ntranos, G. Caire, and A.G. Dimakis, "Allocations for Heterogenous Distributed Storage," IEEE Int. Symp. Inf. Theory Proc., Cambridge, MA, USA, July 1-6, 2012, pp. 2761-2765.
27 J. Pernas et al., "Non-homogeneous Two-Rack Model for Distributed Storage Systems," IEEE Int. Symp. Inf. Theory Proc., Istanbul, Turkey, July 7-2, 2013, pp. 1237-1241.
28 C. Huang et al., "Erasure Coding in Windows Azure Storage." USENIX Ann. Tech. Conf., Boston, MA, USA, June 13-15, 2012, pp. 82-96.
29 N.B. Shah, K.V. Rashmi, and P.V. Kumar, "A Flexible Class of Regenerating Codes for Distributed Storage," IEEE Int. Symp. Inf. Theory Proc., Austin, TX, USA, July 13-18, 2010, pp. 1943-1947.