Browse > Article
http://dx.doi.org/10.5573/ieie.2016.53.1.097

File Block Management for Energy-Efficient Distributed Storages  

Suh, Min-Kook (Department of Electrical and Computer Engineering, Seoul National University)
Kim, Seong-Woo (Engineering Research Institute, Seoul National University)
Seo, Seung-Woo (Department of Electrical and Computer Engineering, Seoul National University)
Publication Information
Journal of the Institute of Electronics and Information Engineers / v.53, no.1, 2016 , pp. 97-104 More about this Journal
Abstract
Because of rapid growth of data size, the number of data storage has been increased. When using multiple data storages, a distribute file system is essential to insure the availability of data files. The power consumption is a major problem when using a distributed file system with many data storages. Previous works have aimed at reducing the energy consumption with efficient file block layout by changing some data servers into stand-by mode. The file block migration has not been seriously considered because migration causes large cost. But when we consider addition of a new data server or file, file block migration is needed. This paper formulates the minimization of data block migration as an ILP optimization problem and solves it using branch-and-bound method. Using this technique, we can maximize the number of stand-by data servers with the minimum number of file block movement. However, computation time of branch-and-bound method of an ILP optimization problem increases exponentially as the problem size grows. Therefore this paper also proposes a data block and data server grouping method to solve many small ILP problems.
Keywords
a distributed storage; energy efficiency; erasure code; ILP; power proportionality;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. Ghemawat, H. Gobioff, and S. Leung, "The Google file system," in SIGOPS Oper. Syst. Rev. vol 37, no 5, pp. 29-43, Oct. 2003   DOI
2 R. T. Kaushik, M. Bhandarkar, and K. Nahrstedt, "Evaluation and analysis of green HDFS: A self-adaptive, energy- conserving variant of the Hadoop distributed file system," in Cloud Computing Technology and Science (CloudCom), 2010 IEEE Second International Conference on, pp. 274-287, Nov. 2010
3 J. Guerra, W. Belluomini, J. Glider, K. Gupta, and H. Pucha, "Energy proportionality for storage: impact and feasibility," in SIGOPS Oper. Syst. Rev. vol 44, no 1, pp. 35-39, Mar. 2010
4 X. Fan, W. Weber, and L. A. Barroso, "Power provisioning for a warehouse-sized computer," in SIGARCH Comput. Archit. News, vol 35, no 2, pp. 13-23, June 2007
5 T. Bostoen, S. Mullender, and Y. Berbers. "Power-reduction techniques for data-center storage systems." in ACM Comput. Surv. vol 45, issue 3, no 33, pp. 1-38, July 2013
6 S. Gurumurthiy, A. Sivasubramaniamy, M. Kandemiry, and H. Frankez, "DRPM: Dynamic speed control for power management in server class disks," in Proceedings of the International Symposium on Computer Architecture (ISCA), pp. 169-179, Jun. 2003
7 E. Pinheiro and R. Bianchini. "Energy conservation techniques for disk array-based servers," in Proceedings of the 18th annual international conference on Supercomputing (ICS '04), pp. 68-78, ACM, New York, NY, USA, June 2004.
8 E. Thereska, A. Donnelly, and D. Narayanan, "Sierra: Practical power-proportionality for data center storage," in Proceedings of the sixth conference on Computer systems (EuroSys '11), pp. 169-182, ACM, New York, NY, USA, Apr. 2011
9 H. Amur, J. Cipar, V. Gupta, G. R. Ganger, M. A. Kozuch, and K. Schwan, "Robust and flexible power-proportional storage," in Proceedings of the 1st ACM symposium on Cloud computing (SoCC '10), pp. 217-228, ACM, New York, NY, USA, Jun. 2010
10 B. Lin, S. L, X. Liao, Q. Wu, and S. Yang, "eStor: Energy efficient and resilient data center storage," in Cloud and Service Computing (CSC), 2011 International Conference on, pp. 366-371, Dec. 2011
11 H. Goudarzi, M. Ghasemazar, M. Pedram, "SLA-based optimization of power and migration cost in cloud computing," in Cluster, Cloud and Grid Computing (CCGrid), 2012 12th IEEE/ACM International Symposium on, pp. 172-179, May 2012
12 A. G. Dimakis, P. B. Godfrey, Y. Wu, M. J. Wainwright, and K. Ramchandran, "Network coding for distributed storage systems," in Information Theory, IEEE Transactions on, vol 56, no 9, pp. 4539-4551, Sep. 2010   DOI
13 MOSEK ApS, https://www.mosek.com/