Deadline based scheduling for data-intensive applications in clouds

doi:10.1016/S1005-8885(16)60064-X

中国邮电高校学报(英文) ›› 2016, Vol. 23 ›› Issue (6): 8-15.doi: 10.1016/S1005-8885(16)60064-X

• Artificial Intelligence • 上一篇下一篇

Deadline based scheduling for data-intensive applications in clouds

付雄¹,仓业亮¹,朱力鹏²,²,胡斌²,³,邓松¹

1. 南京邮电大学
2.
3. 全球能源互联网研究院

收稿日期:2016-08-12 修回日期:2016-12-16 出版日期:2016-12-31 发布日期:2016-12-30
通讯作者: 仓业亮 E-mail:1036405361@qq.com
基金资助:
中国国家自然科学基金

Deadline based scheduling for data-intensive applications in clouds

Received:2016-08-12 Revised:2016-12-16 Online:2016-12-31 Published:2016-12-30
Supported by:
National Natural Science Foundation of China

摘要/Abstract

摘要： Cloud computing emerges as a new computing pattern that can provide elastic services for any users around the world. It provides good chances to solve large scale scientific problems with fewer efforts. Application deployment remains an important issue in clouds. Appropriate scheduling mechanisms can shorten the total completion time of an application and therefore improve the quality of service (QoS) for cloud users. Unlike current scheduling algorithms which mostly focus on single task allocation, we propose a deadline based scheduling approach for data-intensive applications in clouds. It does not simply consider the total completion time of an application as the sum of all its subtasks’ completion time. Not only the computation capacity of virtual machine (VM) is considered, but also the communication delay and data access latencies are taken into account. Simulations show that our proposed approach has a decided advantage over the two other algorithms.

关键词: virtual machine placement, cloud computing, data intensive, deadline based

Abstract: Cloud computing emerges as a new computing pattern that can provide elastic services for any users around the world. It provides good chances to solve large scale scientific problems with fewer efforts. Application deployment remains an important issue in clouds. Appropriate scheduling mechanisms can shorten the total completion time of an application and therefore improve the quality of service (QoS) for cloud users. Unlike current scheduling algorithms which mostly focus on single task allocation, we propose a deadline based scheduling approach for data-intensive applications in clouds. It does not simply consider the total completion time of an application as the sum of all its subtasks’ completion time. Not only the computation capacity of virtual machine (VM) is considered, but also the communication delay and data access latencies are taken into account. Simulations show that our proposed approach has a decided advantage over the two other algorithms.

Key words: virtual machine placement, cloud computing, data intensive, deadline based

付雄仓业亮朱力鹏胡斌邓松, Wang Dong. Deadline based scheduling for data-intensive applications in clouds[J]. JOURNAL OF CHINA UNIVERSITIES OF POSTS AND TELECOM, 2016, 23(6): 8-15.

参考文献

1. Jamshidi P, Ahmad A, Pahl C. Cloud migration research: a systematic review. IEEE Transactions on Cloud Computing, 2013, 1( 2): 142-157

2. Guo C X, Wu H T, Tan K, et al. DCell: a scalable and fault-tolerant network structure for data centers. ACM SIGCOMM Computer Communication Review, 2008, 38(4): 75-86

3. Ma Z Q, Sheng Z H, Gu L. DVM: a big virtual machine for cloud computing. IEEE Transactions on Computers, 2014, 63( 9): 2245-2258

4. Beloglazov A, Buyya R. Managing overloaded hosts for dynamic consolidation of virtual machines in cloud data centers under quality of service constraints. IEEE Transactions on Parallel and Distributed Systems, 2013, 24(7): 1366-1379

5. Dastjerdi A V, Buyya R. Compatibility-aware cloud service composition under fuzzy preferences of users. IEEE Transactions on Cloud Computing, 2014, 2(1): 1-13

6. Amanatullah Y, Lim C, Ipung H P, et al. Toward cloud computing reference architecture: cloud service management perspective. Proceedings of the International Conference on ICT for Smart Society (ICISS’13), Jun 13-14, 2013, Jakarta, Indonesia. Piscataway, NJ, USA: IEEE, 2013: 4p

7. Alicherry M, Lakshman T V. Optimizing data access latencies in cloud systems by intelligent virtual machine placement. Proceedings of the 32nd IEEE Conference on Computer Communications (INFOCOM’13), Apr 14-19, 2013, Turin, Italy. Piscataway, NJ, USA: IEEE, 2013: 648-655

8. Piao J T, Yan J. A network-aware virtual machine placement and migration approach in cloud computing. Proceedings of the 9th International Conference on Grid and Cloud Computing (GCC’10), Nov 1-5, 2010, Nanjing, China. Piscataway, NJ, USA: IEEE, 2010: 87-92

9. Lin W W, Liang C, Wang J Z, et al. Bandwidth-aware divisible task scheduling for cloud computing. Software Practice and Experience, 2014, 44(2): 163-174

10. Cohen R, Lewin-Eytan L, Naor J, et al. Almost optimal virtual machine placement for traffic intense data centers. Proceedings of the IEEE International Conference on Computer Communications (INFOCOM’13), Apr 14-19, 2013, Turin, Italy. Piscataway, NJ, USA: IEEE, 2013: 355-359

11. Patel S, Bhujade R. K, Khan A U, et al. Deadline based virtual machine provisioning to improve QoS in cloud computing. Proceedings of the International Conference on Advances in Computing, Communications and Informatics (ICACCI’13), Aug 22-25, 2013, Mysore, India. Piscataway, NJ, USA: IEEE, 2013: 219-224

12. Di S, Wang C. Error-tolerant resource allocation and payment minimization for cloud system. IEEE Transactions on Parallel and Distributed Systems, 2013, 24(6): 1097-1106

13. Kalita R, Patnaik H. A novel heuristic resolving deadline-oriented task scheduling in cloud. Proceedings of the 2014 IEEE International Conference on Advanced Communication Control and Computing Technologies (ICACCCT’14), May 8-10, 2014, Ramanathapuram, India. Piscataway, NJ, USA: IEEE, 2014: 1137-1142

14. Fu X, Cang Y L, Zhu X X, et al. Scheduling method of data-intensive applications in cloud computing environments. Mathematical Problems in Engineering, 2015, Article ID 605439/1-8

15. Zhu X Y, Young D, Watson B J, et al. 1000 islands: an integrated approach to resource management for virtualized data centers. Cluster Computing, 2008, 12(1): 45-77

16. Wu H, Tantawi A N, Diao Y, et al. Adaptive memory load management in cloud data centers. IBM Journal of Research and Development, 2011, 55(6):1-10

17. Bourguiba M, Haddadou K, Korbi I E, et al. Improving network I/O virtualization for cloud computing. IEEE Transactions on Parallel and Distributed Systems, 2014, 25(3): 673-681

18. Neumann R, Göltzer E, Dumke R, et al. Caching highly compute-intensive cloud applications: an approach to balancing cost with performance. Proceedings of the Joint Conference of the 21st International Workshop on Software Measurement and the 6th International Conference on Software Process and Product Measurement (IWSM-MENSURA’11), Nov 3-4, 2011, Nara, Japan. Piscataway, NJ, USA: IEEE, 2011: 96-105

19. Lin J, Chen C, Chang J M. QoS-aware data replication for data-intensive applications in cloud computing systems. IEEE Transactions on Cloud Computing, 2013, 1(1): 101-115

20. Wang T T, Liu Z B, Chen Y, et al. Load balancing task scheduling based on genetic algorithm in cloud computing. Proceedings of the IEEE 12th International Conference on Dependable, Autonomic and Secure Computing (DASC’14), Aug 24-27, 2014, Dalian, China. Piscataway, NJ, USA: IEEE, 2014: 146-152

21. Shahapure N H, Jayarekha P. Load balancing with optimal cost scheduling algorithm. Proceedings of the International Conference on Computation of Power, Energy, Information and Communication (ICCPEIC’14), Apr 16-17, 2014, Chennai, India. 2014: 24-31

22. Beloglazov A, Abawajy J, Buyya R. Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Generation Computer Systems, 2012, 28(5): 755-768

23. Nonde L, El-Gorash T E H, Elmirghani J M H. Energy efficient virtual network embedding for cloud networks. Journal of Lightwave Technology, 2015, 33(9): 1828-1849

24. Cao F, Zhu M M. Energy efficient workflow job scheduling for green cloud. Proceedings of the 2013 IEEE International Symposium on Parallel and Distributed Processing, Workshops and Phd Forum (IPDPSW’13), May 20-24, 2013, Cambridge, MA, USA. Piscataway, NJ, USA: IEEE, 2013: 2218-2221

25. Rodriguez M A, Buyya R. Deadline based resource provisioning and scheduling algorithm for scientific workflows on clouds. IEEE Transactions on Cloud Computing, 2014, 2(2): 222-235

26. Zhu Z M, Zhang G X, Li M Q, et al. Evolutionary multi-objective workflow scheduling in cloud. IEEE Transactions on Parallel and Distributed Systems, 2016, 27(5): 1344-1357

27. Jyoti S, Deo P V. Workflow-and-platform aware task clustering for scientific workflow execution in cloud environment. Future Generation Computer Systems, 2016, 64: 61-74

28. Calheiros R N, Ranjan R, Beloglazov A, et al. Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Software: Practice and Experience, 2011, 41(1): 23-50

29. Garg S K, Buyya R. NetworkCloudSim: Modelling parallel applications in cloud simulations. Proceedings of the 4th IEEE/ACM International Conference on Utility and Cloud Computing (UCC’11), Dec 5-8, 2011, Melbourne, Australia. Piscataway, NJ, USA: IEEE, 2011: 105-113

Deadline based scheduling for data-intensive applications in clouds

Deadline based scheduling for data-intensive applications in clouds

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 0

编辑推荐

Metrics

本文评价