Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

A Joint Allocation Algorithm of Computing and Communication Resources Based on Reinforcement Learning in MEC System

  • Liu, Qinghua (Dept. of Information Technology, Zhejiang Yuying College of Vocational Technology) ;
  • Li, Qingping (Dept. of Information Technology, Zhejiang Yuying College of Vocational Technology)
  • Received : 2020.05.14
  • Accepted : 2020.10.11
  • Published : 2021.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

For the mobile edge computing (MEC) system supporting dense network, a joint allocation algorithm of computing and communication resources based on reinforcement learning is proposed. The energy consumption of task execution is defined as the maximum energy consumption of each user's task execution in the system. Considering the constraints of task unloading, power allocation, transmission rate and calculation resource allocation, the problem of joint task unloading and resource allocation is modeled as a problem of maximum task execution energy consumption minimization. As a mixed integer nonlinear programming problem, it is difficult to be directly solve by traditional optimization methods. This paper uses reinforcement learning algorithm to solve this problem. Then, the Markov decision-making process and the theoretical basis of reinforcement learning are introduced to provide a theoretical basis for the algorithm simulation experiment. Based on the algorithm of reinforcement learning and joint allocation of communication resources, the joint optimization of data task unloading and power control strategy is carried out for each terminal device, and the local computing model and task unloading model are built. The simulation results show that the total task computation cost of the proposed algorithm is 5%-10% less than that of the two comparison algorithms under the same task input. At the same time, the total task computation cost of the proposed algorithm is more than 5% less than that of the two new comparison algorithms.

Keywords

References

  1. P. Mach and Z. Becvar, "Mobile edge computing: a survey on architecture and computation offloading," IEEE Communications Surveys & Tutorials, vol. 19, no. 3, pp. 1628-1656, 2017. https://doi.org/10.1109/COMST.2017.2682318
  2. C. Li, J. Tang, and Y. Luo, "Dynamic multi-user computation offloading for wireless powered mobile edge computing," Journal of Network and Computer Applications, vol. 131, pp. 1-15, 2019. https://doi.org/10.1016/j.jnca.2019.01.020
  3. Y. Mao, C. You, J. Zhang, K. Huang, and K. B. Letaief, "A survey on mobile edge computing: the communication perspective," IEEE Communications Surveys & Tutorials, vol. 19, no. 4, pp. 2322-2358, 2017. https://doi.org/10.1109/COMST.2017.2745201
  4. J. Liu, Y. Mao, J. Zhang, and K. B. Letaief, "Delay-optimal computation task scheduling for mobile-edge computing systems," in Proceedings of 2016 IEEE International Symposium on Information Theory (ISIT), Barcelona, Spain, 2016, pp. 1451-1455.
  5. M. H. Chen, B. Liang, and M. Dong, "Joint offloading decision and resource allocation for multi-user multi-task mobile cloud," in Proceedings of 2016 IEEE International Conference on Communications (ICC), Kuala Lumpur, Malaysia, 2016, pp. 1-6.
  6. M. H. Chen, B. Liang, and M. Dong, "Joint offloading and resource allocation for computation and communication in mobile cloud with computing access point," in Proceedings of the IEEE Conference on Computer Communications (INFOCOM), Atlanta, GA, 2017, pp. 1-9.
  7. J. Li, H. Gao, T. Lv, and Y. Lu, "Deep reinforcement learning based computation offloading and resource allocation for MEC," in Proceedings of 2018 IEEE Wireless Communications and Networking Conference (WCNC), Barcelona, Spain, 2018, pp. 1-6.
  8. Z. Wei, B. Zhao, J. Su, and X. Lu, "Dynamic edge computation offloading for internet of things with energy harvesting: a learning method," IEEE Internet of Things Journal, vol. 6, no. 3, pp. 4436-4447, 2018. https://doi.org/10.1109/jiot.2018.2882783
  9. W. Chen, Y. He, and J. Qiao, "Cost minimization for cooperative mobile edge computing systems," in Proceedings of 2019 28th Wireless and Optical Communications Conference (WOCC), Beijing, China, 2019, pp. 1-5.
  10. T. Q. Dinh, J. Tang, Q. D. La, and T. Q. Quek, "Offloading in mobile edge computing: task allocation and computational frequency scaling," IEEE Transactions on Communications, vol. 65, no. 8, pp. 3571-3584, 2017. https://doi.org/10.1109/TCOMM.2017.2699660
  11. Z. Zhang, J. Wu, L. Chen, G. Jiang, and S. K. Lam, "Collaborative task offloading with computation result reusing for mobile edge computing," The Computer Journal, vol. 62, no. 10, pp. 1450-1462, 2019. https://doi.org/10.1093/comjnl/bxz027
  12. T. Alfakih, M. M. Hassan, A. Gumaei, C. Savaglio, and G. Fortino, "Task offloading and resource allocation for mobile edge computing by deep reinforcement learning based on SARSA," IEEE Access, vol. 8, pp. 54074-54084, 2020. https://doi.org/10.1109/ACCESS.2020.2981434
  13. T. D. Parker, C. F. Slattery, J. Zhang, J. M. Nicholas, R. W. Paterson, A. J. Foulkes, et al., "Cortical microstructure in young onset Alzheimer's disease using neurite orientation dispersion and density imaging," Human Brain Mapping, vol. 39, no. 7, pp. 3005-3017, 2018. https://doi.org/10.1002/hbm.24056
  14. D. Ramachandran and R. Gupta, "Smoothed sarsa: reinforcement learning for robot delivery tasks," in Proceedings of 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan, 2009, pp. 2125-2132.
  15. A. Larmo and R. Susitaival, "RAN overload control for machine type communications in LTE," in Proceedings of 2012 IEEE Globecom Workshops, Anaheim, CA, 2012, pp. 1626-1631.
  16. X. Chen, L. Jiao, W. Li, and X. Fu, "Efficient multi-user computation offloading for mobile-edge cloud computing," IEEE/ACM Transactions on Networking, vol. 24, no. 5, pp. 2795-2808, 2015. https://doi.org/10.1109/TNET.2015.2487344