Browse > Article

Multi-queue Hybrid Job Scheduling Mechanism in Grid Computing  

Kang, Chang-Hoon (극동정보대학 방송영상미디어과)
Choi, Chang-Yeol (숭실대학교 정보미디어기술연구소)
Park, Kie-Jin (아주대학교 공과대학 산업정보시스템공학부)
Kim, Sung-Soo (아주대학교 정보통신전문대학원)
Publication Information
Journal of KIISE:Computer Systems and Theory / v.34, no.7, 2007 , pp. 304-318 More about this Journal
Abstract
Grid computing is a service that share geographically distributed computing resources through high speed network. In this paper, we propose hybrid scheduling scheme which considers not only meta-scheduling scheme to distribute the job between the nodes of grid computing system but also the job scheduling to distribute the job within the local nodes. According to the number of processors needed and expected execution time, the job with high priority is allocated to job queue while the one with low priority and remote job are allocated to backfill queue. We evaluate the proposing scheme through the various experiments and the results show that the utilization of grid computing system increases and the job slowdown decreases.
Keywords
Grid Computing; Meta-scheduling; Backfill Scheduling; Reservation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. Srinivasan, et al., 'Characterization of Backfilling Strategies for Parallel Jobs Scheduling,' 31st International Conference on Parallel Processing Workshops (ICPP 2002 Workshops), pp. 514-522, Aug. 2002
2 W. A. Ward Jr., et al., 'Scheduling Jobs on Parallel Systems Using a Relaxed Backfill Strategy,' 8th International Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP'2002), pp. 88-102, July 2002
3 B. Lawson, et al., 'Multiple-queue Backfilling Scheduling with Priorities and Reservations for Parallel Systems,' The 8th International Workshop, JSSPP 2002 Edinburgh, Scotland, UK, pp. 72-87, July 2002
4 O. H. Ibarra, et al., 'Heuristic Algorithm for Scheduling Independent Tasks on Nonidentical Processors,' Journal of ACM, Vol. 24, No.2, pp. 280-289, Apr. 1977   DOI
5 K. Li, 'Job Scheduling for Grid Computing on Metacomputers,' The 19th International Parallel and Distributed Processing Symposium (IPDPS 2005), Abstracts Proceedings, Apr. 2005
6 B. Bode, et al., 'The Portable Batch Scheduler and the MauiScheduler on Linux Clusters,' in Proceedings of the 4th Annual Linux Showcase and Conference, Atlanta, Georgia, Oct. 2000
7 R. McCann, et al., 'A Dynamic Processor Allocation Policy for Multiprogrammed Sharedrnemory Multiprocessors,' ACM Trans. on Computer System, Vol. 11, No.2, pp. 146-178, May 1993   DOI   ScienceOn
8 D. Talby, et al., 'Supporting Priorities and Improving Utilization of the IBM SP2 Scheduler Using Slack-based Backfilling,' In Proceedings of the Intemational Parallel Processing Symposium, pp. 513-517, Apr. 1999
9 http://www.legion.org
10 Q. Wang, et al., 'De-centralized Job Scheduling on Computational Grids Using Distributed Backfilling,' Grid and Cooperative Computing - GCC 2004: Third International Conference, LNCS 3251, pp. 285-292, Oct. 2004
11 I. Foster, et al., 'Globus: A Metacomputing Infrastructure Toolkit,' The International Journal of Supercomputer Applications and Performance Computing, Vol. 11, No.2, pp. 115-128, Oct. 1997   DOI
12 K. Krauter, et al., 'A Taxonomy and Survey of Grid Resource Management Systems for Distributed Computing,' Software Practice and Experience Journal, Vol. 32, No.2, pp. 135-164, Feb. 2002   DOI   ScienceOn
13 D. Zotkin, et al., 'Job-Length Estimation and Performance in Backfilling Schedulers,' The 8th IEEE International Symposium on High Performance Distributed Computing (HPDC'99), Aug. 1999
14 D. G. Feitelson, et al., 'Improved Utilization and Responsiveness with Gang Scheduling,' Job Scheduling Strategies for Parallel Processing, IPPS'97 Workshop, Geneva, Switzerland, LNCS 1291, pp. 238-261, Apr. 1997
15 I. Foster, et al., 'Grid Services for Distributed System Integration,' Computer, Vol. 35, No.6, pp. 37-46, 2002
16 V. Subramani, et al., 'Distributed Job Scheduling on Computational Grids Using Multiple Simultaneous Requests,' The 11th IEEE International Symposium on High Performance Distributed Computing (HPDC-11 2002), pp. 359-368, July 2002
17 V. Harnscher, et. al., 'Evaluation of Job-Scheduling Strategies for Grid Computing,' The 1st IEEE/ ACM International Workshop on Grid Computing (Grid 2000) at the 7th International Conference on High Performance Computing (HiPC-2000), LNCS 1971, pp. 191-202, 2000
18 A. Mualem, et al., 'Utilization, Predictability, Workloads and User Run time Estimates in Scheduling the IBM SP2 with Backfilling,' IEEE Trans. Parallel and Distributed System, Vol. 12, No.6, pp. 529-543, June 2001   DOI   ScienceOn
19 D. G. Feitelson, et al., 'Theory and Practice in Parallel Job Scheduling,' Job Scheduling Strategies for Parallel Processing, IPPS'97 Workshop, Geneva, Switzerland, LNCS 1291, pp. 1-34, Apr. 5, 1997
20 D. Feitelson, 'Logs of Real Parallel Workloads from Production Systems,' http://www.cs.huji.ac.il/labs/parallel/workload/logs.html
21 H. Shan, et al., 'Job Superscheduler Architecture and Performance in Computational Grid Environments,' In SC2003 Conference, 2003