Information and Communications Magazine (정보와 통신)

The Korean Institute of Commucations and Information Sciences (한국통신학회)
권호 표지

차세대 클라우드 저장 시스템을 위한 소실 복구 코딩 기법 동향

  • Published : 2014.01.31
Download PDF
⟨ Previous Next ⟩

Abstract

클라우드 컴퓨팅과 빅데이터 시대의 개막으로 클라우드에 저장되는 데이터가 급속도로 증가함에 따라 최근 클라우드 컴퓨팅의 주요한 요소로 클라우드 저장 시스템이 주목받고 있다. 클라우드 저장 시스템은 크게 두 가지 목적에 의해 동작한다. 첫 번째는 사용자에게 데이터를 소실 없이 정확하게 전달해주는 것이고, 두 번째는 네트워크 상에서 소실된 데이터를 복구해 내는 것이다. 데이터 소실은 분산 노드 내 장비의 결함, 소프트웨어 업데이트 등과 같은 요인에 의해 발생하는데, 이와 같은 데이터 소실에 대응하기 위해 소실 복구 코딩 기법을 사용한다. 본 고에서는 클라우드 저장 시스템의 요구사항들을 토대로 현재 클라우드 저장 시스템에 사용되는 다양한 코딩 기법을 살펴보고 차세대 클라우드 저장 시스템을 위한 코딩 기법에 대해 논의해본다.

Keywords

References

  1. 삼성경제연구소, "클라우드 혁명이 바꾸는 미래," SERI경영노트, 제181호, 2013. 3. 28.
  2. Worl' data more than doubling every two years - Driving big data opportunity, new IT roles, http:// www.emc.com/about/news/press/2011/20110628-01. htm, 2013.
  3. IDC says world's storage is breaking Moore's law, more than doubling every two years, http:// enterprise.media.seagate.com/2011/06/inside-itstorage/ idc-says-worlds-storage-is-breakingmoores- law-more-than-doubling-every-twoyears/,2012.
  4. D. Beaver, S. Kumar, H. C. Li, J. Sobel, and P. Vajgel, "Finding a needle in Haystack: Facebook's photo storage," in Proc. of 9th USENIX Conference on Operating Systems Design and Implementation (OSDI), Oct. 2010.
  5. M. Sathiamoorthy, M. Asteris, D. Papailiopoulos, A. G. Dimakis, R. Vadali, S. Chen, D. Borthakur, "XORing Elephants: Novel Erasure Codes for Big Data," in Proc. of the 39th International Conf. on Very Large Data Bases, Aug. 2013.
  6. C. Huang, H. Simitci, Y. Xu, A. Ogus, B. Calder, P. Gopalan, J. Li, and S. Yekhanin, "Erasure Coding in Windows Azure Storage," in Proc. of 2012 USENIX Annual Technical Conference, June 2012.
  7. P. Gopalan, C. Huang, H. Simitci, S. Yekhanin, "On the locality of codewords symbols", Electronic Colloquium on Computational Complexity (ECCC) vol. 18, 2011.
  8. G. M. Kamath, N. Prakash, V. Lalitha, and P. V. Kumar, "Codes with local regeneration," in Proc. of Information Theory and Applications Workshop (ITA), San Diego, USA, Feb. 2013.
  9. L. P. Juarez, D. L. Henk, and F. Oggier,"locally repairable codes with multiple repair alternatives," in Proc. of International Symposium on Information Theory (ISIT), July 2013.
  10. N. Silberstein, A. S. Rawat, O. O.Koyluoglu, and S. Vishwanath, "Locally-Repairable Codes via Rank- Metric Codes," in Proc. of International Symposium on Information Theory (ISIT), July 2013.
  11. G M. Kamath, N. Silberstein, N. Prakash, A. S. Rawat, V. Lalitha, O. O. Koyluoglu, P. V. Kumar, and S. Vishwanath, "Explicit MBR All-Symbol Locality Codes," in Proc. of International Symposium on Information Theory (ISIT), July 2013.
  12. T. Richardson and R. Urbanke, Modern Coding Theory, Cambridge Univ. Press, 2008.
  13. Jung-Hyun Kim, Jin Soo Park, Ki-Hyeon Park, Inseon Kim, Mi-Young Nam, and Hong-Yeop Song, "Reliability Comparison of Various Regenerating Codes for Cloud Services," in Proc. of ICTC2013, Jeju Island, Korea, Oct. 2013.
  14. Jung-Hyun Kim, and Hong-Yeop Song, "Coding Techniques for Distributed Storage Systems," in Proc. of 2013 CITS 3rd CITW, Samsung Electronics, Seocho, Seoul, Korea, Oct. 2013.
  15. A. G. Dimakis, P. B. Godfrey, Y. Wu, M. J. Wainwright, and K. Ramchandran, "Network Coding for Distributed Storage Systems," IEEE Trans. on Inf. Theory, vol. 56, no. 9, pp. 4539-4551, Sept. 2010. https://doi.org/10.1109/TIT.2010.2054295
  16. N. B. Shah, K. V. Rashmi, P. V. Kumar, and K. Ramchandran, "Interference Alignment in Regenerating Codes for Distributed Storage: Necessity and Code Constructions," IEEE Trans. Inf. Theory, vol. 58, no. 4, pp. 2134-2158, April 2012. https://doi.org/10.1109/TIT.2011.2178588
  17. K. V. Rashmi, N. B. Shah, and P. V. Kumar, "Optimal exact-regenerating codes for the MSR and MBR points via a product-matrix construction," IEEE Trans. Inf. Theory, vol. 57, no. 8, pp. 5227- 5239, Aug. 2011. https://doi.org/10.1109/TIT.2011.2159049
  18. N. B. Shah, K. V. Rashmi, P. V. Kumar, and K. Ramchandran, "Distributed Storage Codes With Repair-by-Transfer and Nonachievability of Interior Points on the Storage-Bandwidth Tradeoff," IEEE Trans. Inf. Theory, vol. 58, no. 3, pp. 1837-1852, March 2012. https://doi.org/10.1109/TIT.2011.2173792
  19. C. Gong and X. Wang, "On partial downloading for wireless distributed storage networks," IEEE Transactions on Signal Processing, vol. 60, no. 6, pp. 3278-3288, 2012. https://doi.org/10.1109/TSP.2012.2189112
  20. T. Ernvall, S. E. Rouayheb, C. Hollanti, and H. V. Poor, "Capacity and security of heterogeneous distributed storage systems," in Proc. of International Symposium on Information Theory (ISIT), July 2013.
  21. Kenneth W. Shum, and Yuchong Hu, "Cooperative Regenerating Codes," IEEE Trans. Inf. Theory, vol. 59, no. 11, pp. 7229-7258, Nov. 2013. https://doi.org/10.1109/TIT.2013.2274265
  22. S. Pawar, S. E. Rouayheb, and K. Ramchandran, "Securing dynamic distributed storage systems against eavesdropping and adversarial attacks," IEEE Transactions on Information Theory, vol. 57, no. 10, pp. 6734-6753, 2011. https://doi.org/10.1109/TIT.2011.2162191
  23. A. S. Rawat, O. O. Koyluoglu, N. Silberstein, and S. Vishwanath, "Secure locally repairable codes for distributed storage systems," in Proc. of International Symposium on Information Theory (ISIT), July 2013.
  24. S. Goparaju, S. E. Rouayheb, R. Calderbank, and H. V. Poor, "Data secrecy in distributed storage systems under exact repair," in Proc. of International Symposium on Network Coding (NetCod), June 2013.
  25. S. Pawar, N. Noorshams, S. El Rouayheb, and K. Ramchandran, "Dress codes for the storage cloud: Simple randomized constructions," in Proc. of International Symposium on Information Theory (ISIT), July 2011.
  26. K. W. Shum, and Y. Hu, "Functional-Repairby- Transfer Regenerating Codes," in Proc. of International Symposium on Information Theory (ISIT), Cambridge, MA, July 2012.
  27. D. Papailiopoulos, J. Luo, A. Dimakis, C. Huang, and J. Li, "Simple regenerating codes: Network coding for cloud storage," in Proc. of International Conference Computing and Communications (INFOCOM), March 2012.
  28. H. Houyx, K. W. Shum, M. Chen and H. Li, "BASIC regenerating code: Binary addition and shift for exact repair," in Proc. of International Symposium on Information Theory (ISIT), July 2013.