Browse > Article
http://dx.doi.org/10.3837/tiis.2013.12.008

SCTTS: Scalable Cost-Time Trade-off Scheduling for Workflow Application in Grids  

Khajehvand, Vahid (Department of Computer Engineering and Information Technology, Qazvin Branch, Islamic Azad University)
Pedram, Hossein (Department of Computer Engineering and Information Technology, Amirkabir University of Technology (Tehran Polytechnic))
Zandieh, Mostafa (Department of Industrial Management, Shahid Beheshti University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.7, no.12, 2013 , pp. 3096-3117 More about this Journal
Abstract
To execute the performance driven Grid applications, an effective and scalable workflow scheduling is seen as an essential. To optimize cost & makespan, in this paper, we propose a Scalable Cost-Time Trade-off (SCTT) model for scheduling workflow tasks. We have developed a heuristic algorithm known as Scalable Cost-Time Trade-off Scheduling (SCTTS) with a lower runtime complexity based on the proposed SCTT model. We have compared the performance of our proposed approach with other heuristic and meta-heuristic based scheduling strategies using simulations. The results show that the proposed approach improves performance and scalability with different workflow sizes, task parallelism and heterogeneous resources. This method, therefore, outperforms other methods.
Keywords
Cost-makespan minimization; cost-time trade-off; workflow scheduling; scalability; utility grids;
Citations & Related Records
연도 인용수 순위
  • Reference
1 J. Yu, R. Buyya, and C. K. Tham, "Cost-based scheduling of scientific workflow application on utility grids," in Proc. of First International Conference on e-Science and Grid Technologies (e-Science'05), Melbourne, Australia, 2005, pp. 140-147.
2 W. Hoschek, J. Jaen-Martinez, A. Samar, H. Stockinger, and K. Stockinger, "Data management in an international data grid project," in Proc. of Grid Computing - GRID 2000: First IEEE/ACM International Workshop, Bangalore, India, 2000, pp. 333-361.
3 U. Lublin and D. G. Feitelson, "The workload on parallel supercomputers: modeling the characteristics of rigid jobs," Journal of Parallel and Distributed Computing, vol. 63, pp. 1105-1122, 2003.   DOI   ScienceOn
4 C. M. Fonseca and P. J. Fleming, "Genetic algorithms for multiobjective optimization: Formulation, discussion and generalization," in Proc. of the 5th International Conference on Genetic Algorithms, Urbana-Champaign, IL, USA, 1993, pp. 416-423.
5 R. Buyya and M. Murshed, "Gridsim: A toolkit for the modeling and simulation of distributed resource management and scheduling for grid computing," Concurrency and Computation: Practice and Experience, vol. 14, pp. 1175-1220, 2002.   DOI   ScienceOn
6 A. Caminero, A. Sulistio, B. Caminero, C. Carri n, and R. Buyya, "Extending GridSim with an architecture for failure detection," 2009, pp. 1-8.
7 A. Sulistio, U. Cibej, S. Venugopal, B. Robic, and R. Buyya, "A toolkit for modelling and simulating data Grids: an extension to GridSim," Concurrency and Computation: Practice and Experience, vol. 20, pp. 1591-1609, 2008.   DOI   ScienceOn
8 J. Yu, R. Buyya, and K. Ramamohanarao, "Workflow scheduling algorithms for grid computing," Metaheuristics for Scheduling in Distributed Computing Environments, vol. 146, pp. 173-214, 2008.   DOI
9 T. D. Braun, H. J. Siegel, N. Beck, L. L. Bölöni, M. Maheswaran, A. I. Reuther, et al., "A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems," Journal of Parallel and Distributed computing, vol. 61, pp. 810-837, 2001.   DOI   ScienceOn
10 G. Falzon and M. Li, "Enhancing list scheduling heuristics for dependent job scheduling in grid computing environments," The Journal of Supercomputing, vol. 59, pp. 104-130, 2012.   DOI
11 J. Yu, R. Buyya, and K. Ramamohanarao, "Workflow scheduling algorithms for grid computing," Technical Report, Grids-TR-2007-10, Grid Computing and Distributed Systems Laboratory, The University of Melbourne, Australia, pp.173-214, 2007.
12 H. Topcuoglu, S. Hariri, and M. Wu, "Performance-effective and low-complexity task scheduling for heterogeneous computing," IEEE Transactions on Parallel and Distributed Systems, vol. 13, pp. 260-274, 2002.   DOI   ScienceOn
13 D. P. Spooner, J. Cao, S. A. Jarvis, L. He, and G. R. Nudd, "Performance-aware workflow management for Grid computing," The Computer Journal, vol. 48, pp. 347-357, 2005.   DOI   ScienceOn
14 E. S. H. Hou, N. Ansari, and H. Ren, "A genetic algorithm for multiprocessor scheduling," Parallel and Distributed Systems, IEEE Transactions on, vol. 5, pp. 113-120, 1994.   DOI   ScienceOn
15 S. Abrishami, M. Naghibzadeh, and D. H. Epema, "Cost-driven scheduling of grid workflows using partial critical paths," Parallel and Distributed Systems, IEEE Transactions on, vol. 23, pp. 1400-1414, 2012.   DOI   ScienceOn
16 G. Falzon and M. Li, "Enhancing genetic algorithms for dependent job scheduling in grid computing environments," The Journal of Supercomputing, vol. 62, pp. 290-314, 2012.   DOI
17 V. Khajevand, H. Pedram, and M. Zandieh, "Provisioning-Based Resource Management for Effective Workflow Scheduling on Utility Grids," in Proc. of Cluster, Cloud and Grid Computing (CCGrid), 2012 12th IEEE/ACM International Symposium on, Ottawa, Canada, 2012, pp. 719-720.
18 V. Khajehvand, H. Pedram, and M. Zandieh, "Cost and Makespan Trade-off Management for Scheduling Workflow on Utility Grids," International Journal of Applied Research on Information Technology and Computing (IJARITAC), vol. 3, pp. 89-98, 2012.
19 S. Abrishami, M. Naghibzadeh, and D. Epema, "Cost-driven scheduling of grid workflows using partial critical paths," in Proc. of Grid Computing (GRID), 2010 11th IEEE/ACM International Conference on, 2010, pp. 81-88.
20 J. J. Dongarra, E. Jeannot, E. Saule, and Z. Shi, "Bi-objective scheduling algorithms for optimizing makespan and reliability on heterogeneous systems," in Proc. of the nineteenth annual ACM symposium on Parallel algorithms and architectures, 2007, pp. 280-288.
21 I. Brandic, S. Benkner, G. Engelbrecht, and R. Schmidt, "QoS support for time-critical grid workflow applications," in Proc. of e-Science and Grid Computing, 2005. First International Conference on, 2005, pp.10 8-115.
22 S. K. Garg, R. Buyya, and H. J. Siegel, "Time and cost trade-off management for scheduling parallel applications on Utility Grids," Future Generation Computer Systems, vol. 26, pp. 1344-1355, 2010.   DOI   ScienceOn
23 G. Singh, C. Kesselman, and E. Deelman, "Application-level resource provisioning on the grid," in Proc. of E-SCIENCE '06 the Second IEEE International Conference on e-Science and Grid Computing Amsterdam, The Netherlands, 2006, pp. 83-91.
24 G. Juve, E. Deelman, K. Vahi, G. Mehta, B. Berriman, B. Berman, et al., "Scientific workflow applications on Amazon EC2," 2010, pp. 59-66.
25 D. Feitelson, L. Rudolph, U. Schwiegelshohn, K. Sevcik, and P. Wong, "Theory and practice in parallel job scheduling," in Proc. of 3rd Workshop on Job Scheduling Strategies for Parallel Processing, Geneva, Switzerland, 1997, pp. 1-34.
26 G. Juve, E. Deelman, K. Vahi, G. Mehta, B. Berriman, B. Berman, et al., "Data Sharing Options for Scientific Workflows on Amazon EC2," 2010, pp. 1-9.
27 J. D. Ullman, "NP-complete scheduling problems," Journal of Computer and System Sciences, vol. 10, pp. 384-393, 1975.   DOI   ScienceOn
28 D. Feitelson and L. Rudolph, "Parallel job scheduling: Issues and approaches," in Proc. of 1st Workshop on Job Scheduling Strategies for Parallel Processing, Santa Barbara, CA, 1995, pp. 1-18.
29 F. Xhafa and A. Abraham, "Computational models and heuristic methods for Grid scheduling problems," Future Generation Computer Systems, vol. 26, pp. 608-621, 2010.   DOI   ScienceOn
30 J. Yu and R. Buyya, "A taxonomy of workflow management systems for grid computing," Journal of Grid Computing, vol. 3, pp. 171-200, 2005.   DOI   ScienceOn
31 M. Wieczorek, A. Hoheisel, and R. Prodan, "Towards a general model of the multi-criteria workflow scheduling on the grid," Future Generation Computer Systems, vol. 25, pp. 237-256, 2009.   DOI   ScienceOn
32 J. Yu, M. Kirley, and R. Buyya, "Multi-objective planning for workflow execution on Grids," in GRID '07 Proc. of the 8th IEEE/ACM International Conference on Grid Austin, Texas, USA, 2007, pp. 10-17.
33 G. Singh, C. Kesselman, and E. Deelman, "A provisioning model and its comparison with best-effort for performance-cost optimization in grids," in Proc. of the 16th international symposium on High performance distributed computing, Monterey, CA, USA, 2007, pp. 117-126.
34 G. Singh, C. Kesselman, and E. Deelman, "An end-to-end framework for provisioning-based resource and application management," Systems Journal, IEEE, vol. 3, pp. 25-48, 2009.   DOI   ScienceOn
35 R. Sakellariou, H. Zhao, E. Tsiakkouri, and M. Dikaiakos, "Scheduling workflows with budget constraints," Integrated Research in Grid Computing, pp. 189-202, 2007.
36 E. Jeannot, E. Saule, and D. Trystram, "Optimizing performance and reliability on heterogeneous parallel systems: Approximation algorithms and heuristics," Journal of Parallel and Distributed computing, vol. 72, pp. 268-280, 2012.   DOI   ScienceOn
37 J. Yu, R. Buyya, and C. K. Tham, "Cost-based scheduling of scientific workflow applications on utility grids," in Proc. of the first International Conference on e-Science and Grid Technologies (e-Science 2005), Melbourne, Australia, 2005, pp. 140-147.
38 J. Yu and R. Buyya, "Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms," Scientific Programming, vol. 14, pp. 217-230, 2006.   DOI
39 R. Prodan and M. Wieczorek, "Bi-criteria scheduling of scientific grid workflows," Automation Science and Engineering, IEEE Transactions on, vol. 7, pp. 364-376, 2010.   DOI   ScienceOn
40 M. Wieczorek, S. Podlipnig, R. Prodan, and T. Fahringer, "Bi-criteria Scheduling of Scientific Workflows for the Grid," in Proc. of Cluster Computing and the Grid, 2008. CCGRID '08. 8th IEEE International Symposium on, 2008, pp. 9-16.
41 E. Deelman, C. Kesselman, G. Mehta, L. Meshkat, L. Pearlman, K. Blackburn, et al., "GriPhyN and LIGO, building a virtual data grid for gravitational wave scientists," in Proc. of 11th IEEE International Symposium on High Performance Distributed Computing (HPDC-11), Edinburgh, Scotland, UK, 2002.
42 T. Eilam, K. Appleby, J. Breh, G. Breiter, H. Daur, S. Fakhouri, et al., "Using a utility computing framework to develop utility systems," IBM Systems Journal, vol. 43, pp. 97-120, 2004.   DOI
43 E. Deelman, S. Callaghan, E. Field, H. Francoeur, R. Graves, N. Gupta, et al., "Managing large-scale workflow execution from resource provisioning to provenance tracking: The cybershake example," in Proc. of the Second IEEE international Conference on E-Science and Grid Computing Amsterdam, Netherlands, 2006.
44 D. S. Katz, J. C. Jacob, G. B. Berriman, J. Good, A. C. Laity, E. Deelman, et al., "A comparison of two methods for building astronomical image mosaics on a grid," in Proc. of the 34th International Conference on Parallel Processing Workshops (ICPP 2005 Workshops), Oslo, Norway, 2005.