Browse > Article
http://dx.doi.org/10.3837/tiis.2016.07.005

Managing Deadline-constrained Bag-of-Tasks Jobs on Hybrid Clouds with Closest Deadline First Scheduling  

Wang, Bo (SPKLSTN Lab, Department of Computer Science and Technology, Xi'an Jiaotong University)
Song, Ying (State Key Laboratory of Computer Architecture, Institute of Computing Technology, Chinese Academy of Sciences)
Sun, Yuzhong (State Key Laboratory of Computer Architecture, Institute of Computing Technology, Chinese Academy of Sciences)
Liu, Jun (SPKLSTN Lab, Department of Computer Science and Technology, Xi'an Jiaotong University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.10, no.7, 2016 , pp. 2952-2971 More about this Journal
Abstract
Outsourcing jobs to a public cloud is a cost-effective way to address the problem of satisfying the peak resource demand when the local cloud has insufficient resources. In this paper, we studied the management of deadline-constrained bag-of-tasks jobs on hybrid clouds. We presented a binary nonlinear programming (BNP) problem to model the hybrid cloud management which minimizes rent cost from the public cloud while completes the jobs within their respective deadlines. To solve this BNP problem in polynomial time, we proposed a heuristic algorithm. The main idea is assigning the task closest to its deadline to current core until the core cannot finish any task within its deadline. When there is no available core, the algorithm adds an available physical machine (PM) with most capacity or rents a new virtual machine (VM) with highest cost-performance ratio. As there may be a workload imbalance between/among cores on a PM/VM after task assigning, we propose a task reassigning algorithm to balance them. Extensive experimental results show that our heuristic algorithm saves 16.2%-76% rent cost and improves 47.3%-182.8% resource utilizations satisfying deadline constraints, compared with first fit decreasing algorithm, and that our task reassigning algorithm improves the makespan of tasks up to 47.6%.
Keywords
Bag-of-tasks; cloud computing; hybrid cloud; task scheduling; resource management;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Duan Li and Xiaoling Sun, “Nonlinear integer programming,” volume 84. Springer Science & Business Media, 2006. Article (CrossRef Link).
2 Wang Zong Jiang and Zheng Qiu Sheng, "A New Task Scheduling Algorithm in Hybrid Cloud Environment," in Proc. of Cloud and Service Computing (CSC), 2012 International Conference on, pages 45-49, Nov 2012. Article (CrossRef Link).
3 Norbert Blum, "A New Approach to Maximum Matching in General Graphs," MichaelS. Paterson, editor, Automata, Languages and Programming, volume 443 of Lecture Notes in Computer Science, pages 586-597. Springer Berlin Heidelberg, 1990. Article (CrossRef Link).
4 Luiz F. Bittencourt and Edmundo R. M. Madeira, “A Performance-oriented Adaptive Scheduler for Dependent Tasks on Grids,” Concurrency and Computation: Practice and Experience, 20(9):1029-1049, 2008. Article (CrossRef Link).   DOI
5 Javid Taheri, Albert Y. Zomaya, Howard Jay Siegel, and Zahir Tari, “Pareto Frontier for Job Execution and Data Transfer Time in Hybrid Clouds,” Future Generation Computer Systems, 37:321 - 334, 2014. Article (CrossRef Link).   DOI
6 VA Leena and MS Rajasree, “Genetic Algorithm Based Bi-Objective Task Scheduling in Hybrid Cloud Platform,” International Journal of Computer Theory and Engineering, 8(1):7, 2016. Article (CrossRef Link).   DOI
7 Wei-Jen Wang, Yue-Shan Chang, Win-Tsung Lo, and Yi-Kang Lee, “Adaptive Scheduling for Parallel Tasks with QoS Satisfaction for Hybrid Cloud Environments,” The Journal of Supercomputing, 66(2):783-811, 2013. Article (CrossRef Link).   DOI
8 Min-Yi Tsai, Ping-Fang Chiang, Yen-Jan Chang, and Wei-Jen Wang, “Heuristic scheduling strategies for linear-dependent and independent jobs on heterogeneous grids,” Grid and Distributed Computing, volume 261, pages 496-505. Springer Berlin Heidelberg, 2011. Article (CrossRef Link).
9 M.R. HoseinyFarahabady, H.R.D. Samani, L.M. Leslie, Young Choon Lee, and A.Y. Zomaya, "Handling Uncertainty: Pareto-Efficient BoT Scheduling on Hybrid Clouds," in Proc. of Parallel Processing (ICPP), 2013 42nd International Conference on, pages 419-428, Oct 2013. Article (CrossRef Link).
10 M.R. HoseinyFarahabady, Young Choon Lee, and A.Y. Zomaya, “Pareto-Optimal Cloud Bursting,” Parallel and Distributed Systems, IEEE Transactions on, 25(10):2670-2682, Oct 2014. Article (CrossRef Link).   DOI
11 MohammadReza HoseinyFarahabady, YoungChoon Lee, and AlbertY. Zomaya, “Randomized Approximation Scheme for Resource Allocation in Hybrid-cloud Environment,” The Journal of Supercomputing, 69(2):576-592, 2014. Article (CrossRef Link).   DOI
12 López, José María, José Luis Díaz, and Daniel F. García, “Utilization Bounds for EDF Scheduling on Real-Time Multiprocessor Systems,” Real-Time Systems, 28(1):39-68, 2004. Article (CrossRef Link).   DOI
13 "Parallel Workloads Archive," http://www.cs.huji.ac.il/labs/parallel/workload/, 2015.
14 "Amazon Elastic Compute Cloud (Amazon EC2)," http://aws.amazon.com/ec2/, 2015.
15 L.A. Barroso and U. Holzle, “The Case for Energy-Proportional Computing,” Computer, 40(12):33-37, Dec 2007. Article (CrossRef Link).   DOI
16 J. Baliga, R.W.A. Ayre, K. Hinton, and RodneyS. Tucker, "Green Cloud Computing: Balancing Energy in Processing, Storage, and Transport," in Proc. of the IEEE, 99(1):149-167, Jan 2011. Article (CrossRef Link)   DOI
17 R. Van den Bossche, K. Vanmechelen, and J. Broeckhove, "Cost-Optimal Scheduling in Hybrid IaaS Clouds for Deadline Constrained Workloads," in Proc. of Cloud Computing (CLOUD), 2010 IEEE 3rd International Conference on, pages 228-235, July 2010. Article (CrossRef Link).
18 Xiaozhu Kang, Hui Zhang, Guofei Jiang, Haifeng Chen, Xiaoqiao Meng, and K. Yoshihira, "Measurement, Modeling, and Analysis of Internet Video Sharing Site Workload: A Case Study," in Proc. of Web Services, 2008. ICWS '08. IEEE International Conference on, pages 278-285, Sept 2008. Article (CrossRef Link).
19 Raouf Boutaba and Nelson LS da Fonseca, “Cloud Architectures, Networks, Services, and Management,” Cloud Services, Networking, and Management, pages 1-22, 2015. Article (CrossRef Link).
20 Ruben Van den Bossche, Kurt Vanmechelen, and Jan Broeckhove, “Online Cost-efficient Scheduling of Deadline-constrained Workloads on Hybrid Clouds,” Future Generation Computer Systems, 29(4):973 - 985, 2013. Article (CrossRef Link).   DOI
21 Ruben Van den Bossche, Kurt Vanmechelen, and Jan Broeckhove, "Cost-Efficient Scheduling Heuristics for Deadline Constrained Workloads on Hybrid Clouds," in Proc. of Cloud Computing Technology and Science (CloudCom), 2011 IEEE Third International Conference on, pages 320-327, Nov 2011. Article (CrossRef Link).
22 LuizFernando Bittencourt and EdmundoRobertoMauro Madeira, “HCOC: a Cost Optimization Algorithm for Workflow Scheduling in Hybrid Clouds,” Journal of Internet Services and Applications, 2(3):207-227, 2011. Article (CrossRef Link).   DOI
23 L.F. Bittencourt, C.R. Senna, and E.R.M. Madeira, "Scheduling Service Workflows for Cost Optimization in Hybrid Clouds," in Proc. of Network and Service Management (CNSM), 2010 International Conference on, pages 394-397, Oct 2010. Article (CrossRef Link).
24 S. Kailasam, N. Gnanasambandam, J. Dharanipragada, and N. Sharma, “Optimizing Ordered Throughput Using Autonomic Cloud Bursting Schedulers,” Software Engineering, IEEE Transactions on, 39(11):1564-1581, Nov 2013. Article (CrossRef Link).   DOI
25 Thiago A. L. Genez, Luiz F. Bittencourt, and Edmundo R. M. Madeira, "On the Performance-Cost Tradeoff for Workflow Scheduling in Hybrid Clouds," in Proc. of the 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing, UCC '13, pages 411-416, Washington, DC, USA, 2013. IEEE Computer Society. Article (CrossRef Link).
26 Hsuan-Yi Chu and Y. Simmhan, "Cost-Efficient and Resilient Job Life-Cycle Management on Hybrid Clouds," in Proc. of Parallel and Distributed Processing Symposium, 2014 IEEE 28th International, pages 327-336, May 2014. Article (CrossRef Link).
27 Hao Wu, Shangping Ren, G. Garzoglio, S. Timm, G. Bernabeu, H.W. Kimy, K. Chadwick, Haengjin Jang and Seo-Young Noh, "Automatic Cloud Bursting under FermiCloud," in Proc. of Parallel and Distributed Systems (ICPADS), 2013 International Conference on, pages 681-686, Dec 2013. Article (CrossRef Link).
28 S. Kailasam, N. Gnanasambandam, J. Dharanipragada, and N. Sharma, "Optimizing Service Level Agreements for Autonomic Cloud Bursting Schedulers," in Proc. of Parallel Processing Workshops (ICPPW), 2010 39th International Conference on, pages 285-294, Sept 2010. Article (CrossRef Link).
29 Rodrigo N. Calheiros, Christian Vecchiola, Dileban Karunamoorthy, and Rajkumar Buyya, “The Aneka Platform and QoS-driven Resource Provisioning for Elastic Applications on Hybrid Clouds,” Future Generation Computer Systems, 28(6):861-870, 2012. Article (CrossRef Link).   DOI
30 Christian Vecchiola, Rodrigo N. Calheiros, Dileban Karunamoorthy, and Rajkumar Buyya, “Deadline-driven Provisioning of Resources for Scientific Applications in Hybrid Clouds with Aneka,” Future Generation Computer Systems, 28(1):58 - 65, 2012. Article (CrossRef Link).   DOI
31 RodrigoN. Calheiros and Rajkumar Buyya, "Cost-Effiective Provisioning and Scheduling of Deadline Constrained Applications in Hybrid Clouds," X.Sean Wang, Isabel Cruz, Alex Delis and Guangyan Huang, editors, Web Information Systems Engineering - WISE 2012, pages 171-184. Springer Berlin Heidelberg, 2012. Article (CrossRef Link).
32 Alexandru Iosup, Mathieu Jan, Ozan Sonmez, and Dick Epema, "The Characteristics and Performance of Groups of Jobs in Grids," in Proc. of Euro-Par 2007 Parallel Processing, pages 382-393. 2007. Article (CrossRef Link).
33 Tran Ngoc Minh, L.Wolters, and D. Epema, "A Realistic Integrated Model of Parallel System Workloads," in Proc. of Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on, pages 464-473, May 2010. Article (CrossRef Link).
34 Persistence of Vision Raytracer Pty Ltd, "Persistence of vision raytracer," http://www.povray.org/, 2013.
35 Stephen Olivier, Jun Huan, Jinze Liu, Jan Prins, James Dinan, P. Sadayappan, and Chau-Wen Tseng, "UTS: An Unbalanced Tree Search Benchmark," in Proc. of Languages and Compilers for Parallel Computing, volume 4382 of Lecture Notes in Computer Science, pages 235-250. Springer Berlin Heidelberg, 2007. Article (CrossRef Link).
36 Stefan Bucur, Vlad Ureche, Cristian Zamfir, and George Candea, "Parallel symbolic execution for automated real-world software testing," in Proc. of the Sixth Conference on Computer Systems, EuroSys '11, pages 183-198, New York, NY, USA, 2011. ACM. Article (CrossRef Link).