Browse > Article

An Efficient Scheduling Method Taking into Account Resource Usage Patterns on Desktop Grids  

Hyun Ju-Ho (삼성전자 DM연구소)
Lee Sung-Gu (포항공과대학교 전자전기공학과)
Kim Sang-Cheol (한국전자통신연구원 임베디드 연구단)
Lee Min-Gu (포항공과대학교 전자전기공학과)
Abstract
A desktop grid, which is a computing grid composed of idle computing resources in a large network of desktop computers, is a promising platform for compute-intensive distributed computing applications. However, due to reliability and unpredictability of computing resources, effective scheduling of parallel computing applications on such a platform is a difficult problem. This paper proposes a new scheduling method aimed at reducing the total execution time of a parallel application on a desktop grid. The proposed method is based on utilizing the histories of execution behavior of individual computing nodes in the scheduling algorithm. In order to test out the feasibility of this idea, execution trace data were collected from a set of 40 desktop workstations over a period of seven weeks. Then, based on this data, the execution of several representative parallel applications were simulated using trace-driven simulation. The simulation results showed that the proposed method improves the execution time of the target applications significantly when compared to previous desktop grid scheduling methods. In addition, there were fewer instances of application suspension and failure.
Keywords
desktop grid; application; total execution time; trace-driven simulation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 G. Fedak, C. Germain, V. Neri, and F. Cappello, 'Xtremweb:A Generic Global Computing System,' CCGRID'01, Brisbane. 2001   DOI
2 Derrick Kondo, Andrew A. Chien, and Henri Casanova. 'Resource Management for Rapid Application Turnaround on Enterprise Desktop Grids.' Proceedings of Supercomputing. SC2OO4, Pittsburgh. Pennsylvania. November 2004   DOI
3 W. T. Sullivan, D. Werthimer, S. Bowyer, J Cobb, G. Gedye, and D. Anderson. 'A new major SETI project based on Project Serendip data and 100,000 personal computers,' Proceedings of the Fifth International Conference on Bioastronomy, 1997
4 Patricio Domingues, Paulo Marques, Luis Silva, 'Resource Usage of Windows Computer Laboratories,' International Conference on Parallel Processing Workshops (ICPPW'05), 2005   DOI
5 R. Wolski, N. Spring, and J. Hayes, 'The network weather service: A distributed resource performance forecasting service for metacomputing,' Future Generation Computer systems, 15(5-6):757-768, October 1999   DOI   ScienceOn
6 D. Kondo, M. Taufer, C. Brooks, H. Casanova, and A. Chien, 'Characterizing and Evaluating Desktop Grids: An Empirical Study,' Proceedings of the International Parallel and Distributed Processing Symposium (IPDPS'04), April 2004   DOI
7 R. Wolski, 'Forecasting network performance to support dynamic scheduling using the network weather service,' Proceedings of the High Performance Distributed Computing Conference, 1997   DOI
8 A. Acharya, G. Edjlali, and J. Saltz, 'The Utility of Exploiting Idle Workstations for Parallel Computation.' Proceedings of SIGMETRICS '97, pp. 225-236, May 1997   DOI
9 M. W. Mutka and M. Livny, 'The Available Capacity of a Privately Owned Workstation Environment,' Performance Evaluation. 12(4) pp. 269-284, July, 1991   DOI   ScienceOn
10 R. Wolski, N. Spring, and J. Hayes, 'Predicting the CPU availability of time-shared unix systems on the computational grid,' Proceedings of 8th IEEE Symposium on High Performance Distributed Computing, 1999
11 M.R. Shirts and V.S. Pande, 'Screen Savers of the World, Unite!,' Science, 290:1903-1904, 2000   DOI   ScienceOn
12 R.H. Arpaci, A.D. Dusseau, A.M. Vahdat, L.T. Liu, T.E. Anderson, and D.A. Patterson. 'The interaction of parallel and sequential workloads on a network of workstations,' Proceedings of the 1995 ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems. pp. 267-278, May 1995   DOI
13 John Brevik, Daniel Nurmi, and Rich Wolski, 'Automatic methods for predicting machine availability in desktop Grid and peer-to-peer systems,' CCGRID 2004: 190-199
14 Ryu, K.D. and J.K. Hollingsworth, 'Exploiting Fine Grained Idle Periods in Networks of Workstations,' IEEE Transactions on Parallel and Distributed Computing, 2000   DOI   ScienceOn
15 P. Wyckoff, T. Johnson, and K. Jeong. 'Finding Idle Periods on Networks of Workstations.' Technical Report CS761. Dept. of Computer Science, New York University, March 1998