Browse > Article
http://dx.doi.org/10.3745/JIPS.01.0079

A Joint Allocation Algorithm of Computing and Communication Resources Based on Reinforcement Learning in MEC System  

Liu, Qinghua (Dept. of Information Technology, Zhejiang Yuying College of Vocational Technology)
Li, Qingping (Dept. of Information Technology, Zhejiang Yuying College of Vocational Technology)
Publication Information
Journal of Information Processing Systems / v.17, no.4, 2021 , pp. 721-736 More about this Journal
Abstract
For the mobile edge computing (MEC) system supporting dense network, a joint allocation algorithm of computing and communication resources based on reinforcement learning is proposed. The energy consumption of task execution is defined as the maximum energy consumption of each user's task execution in the system. Considering the constraints of task unloading, power allocation, transmission rate and calculation resource allocation, the problem of joint task unloading and resource allocation is modeled as a problem of maximum task execution energy consumption minimization. As a mixed integer nonlinear programming problem, it is difficult to be directly solve by traditional optimization methods. This paper uses reinforcement learning algorithm to solve this problem. Then, the Markov decision-making process and the theoretical basis of reinforcement learning are introduced to provide a theoretical basis for the algorithm simulation experiment. Based on the algorithm of reinforcement learning and joint allocation of communication resources, the joint optimization of data task unloading and power control strategy is carried out for each terminal device, and the local computing model and task unloading model are built. The simulation results show that the total task computation cost of the proposed algorithm is 5%-10% less than that of the two comparison algorithms under the same task input. At the same time, the total task computation cost of the proposed algorithm is more than 5% less than that of the two new comparison algorithms.
Keywords
Cellular MEC System; Markov Decision Process; Resource Allocation; Reinforcement Learning; Task Unloading;
Citations & Related Records
연도 인용수 순위
  • Reference
1 T. Q. Dinh, J. Tang, Q. D. La, and T. Q. Quek, "Offloading in mobile edge computing: task allocation and computational frequency scaling," IEEE Transactions on Communications, vol. 65, no. 8, pp. 3571-3584, 2017.   DOI
2 A. Larmo and R. Susitaival, "RAN overload control for machine type communications in LTE," in Proceedings of 2012 IEEE Globecom Workshops, Anaheim, CA, 2012, pp. 1626-1631.
3 Z. Zhang, J. Wu, L. Chen, G. Jiang, and S. K. Lam, "Collaborative task offloading with computation result reusing for mobile edge computing," The Computer Journal, vol. 62, no. 10, pp. 1450-1462, 2019.   DOI
4 T. D. Parker, C. F. Slattery, J. Zhang, J. M. Nicholas, R. W. Paterson, A. J. Foulkes, et al., "Cortical microstructure in young onset Alzheimer's disease using neurite orientation dispersion and density imaging," Human Brain Mapping, vol. 39, no. 7, pp. 3005-3017, 2018.   DOI
5 X. Chen, L. Jiao, W. Li, and X. Fu, "Efficient multi-user computation offloading for mobile-edge cloud computing," IEEE/ACM Transactions on Networking, vol. 24, no. 5, pp. 2795-2808, 2015.   DOI
6 J. Liu, Y. Mao, J. Zhang, and K. B. Letaief, "Delay-optimal computation task scheduling for mobile-edge computing systems," in Proceedings of 2016 IEEE International Symposium on Information Theory (ISIT), Barcelona, Spain, 2016, pp. 1451-1455.
7 D. Ramachandran and R. Gupta, "Smoothed sarsa: reinforcement learning for robot delivery tasks," in Proceedings of 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan, 2009, pp. 2125-2132.
8 Y. Mao, C. You, J. Zhang, K. Huang, and K. B. Letaief, "A survey on mobile edge computing: the communication perspective," IEEE Communications Surveys & Tutorials, vol. 19, no. 4, pp. 2322-2358, 2017.   DOI
9 P. Mach and Z. Becvar, "Mobile edge computing: a survey on architecture and computation offloading," IEEE Communications Surveys & Tutorials, vol. 19, no. 3, pp. 1628-1656, 2017.   DOI
10 C. Li, J. Tang, and Y. Luo, "Dynamic multi-user computation offloading for wireless powered mobile edge computing," Journal of Network and Computer Applications, vol. 131, pp. 1-15, 2019.   DOI
11 Z. Wei, B. Zhao, J. Su, and X. Lu, "Dynamic edge computation offloading for internet of things with energy harvesting: a learning method," IEEE Internet of Things Journal, vol. 6, no. 3, pp. 4436-4447, 2018.   DOI
12 M. H. Chen, B. Liang, and M. Dong, "Joint offloading decision and resource allocation for multi-user multi-task mobile cloud," in Proceedings of 2016 IEEE International Conference on Communications (ICC), Kuala Lumpur, Malaysia, 2016, pp. 1-6.
13 M. H. Chen, B. Liang, and M. Dong, "Joint offloading and resource allocation for computation and communication in mobile cloud with computing access point," in Proceedings of the IEEE Conference on Computer Communications (INFOCOM), Atlanta, GA, 2017, pp. 1-9.
14 J. Li, H. Gao, T. Lv, and Y. Lu, "Deep reinforcement learning based computation offloading and resource allocation for MEC," in Proceedings of 2018 IEEE Wireless Communications and Networking Conference (WCNC), Barcelona, Spain, 2018, pp. 1-6.
15 T. Alfakih, M. M. Hassan, A. Gumaei, C. Savaglio, and G. Fortino, "Task offloading and resource allocation for mobile edge computing by deep reinforcement learning based on SARSA," IEEE Access, vol. 8, pp. 54074-54084, 2020.   DOI
16 W. Chen, Y. He, and J. Qiao, "Cost minimization for cooperative mobile edge computing systems," in Proceedings of 2019 28th Wireless and Optical Communications Conference (WOCC), Beijing, China, 2019, pp. 1-5.