Browse > Article
http://dx.doi.org/10.6109/jkiice.2022.26.7.1026

Reinforcement Learning based Multi-Channel MAC Protocol for Cognitive Radio Ad-hoc Networks  

Park, Hyung-Kun (School of Electrical Electronic and Communication Engineering, KOREATECH)
Abstract
Cognitive Radio Ad-Hoc Networks (CRAHNs) enable to overcome the shortage of frequency resources due to the increase of radio services. In order to avoid interference with the primary user in CRANH, channel sensing to check the idle channel is required, and when the primary user appears, the time delay due to handover should be minimized through fast idle channel selection. In this paper, throughput was improved by reducing the number of channel sensing and preferentially sensing a channel with a high probability of being idle, using reinforcement learning. In addition, we proposed a multi-channel MAC (Medium Access Control) protocol that can minimize the possibility of collision with the primary user by sensing the channel at the time of data transmission without performing periodic sensing. The performance was compared and analyzed through computer simulation.
Keywords
cognitive radio ad-hoc networks; medium access control; channel sensing; reinforcement learning; Q-learning;
Citations & Related Records
연도 인용수 순위
  • Reference
1 T. N. Tran, T. -V. Nguyen, K. Shim, and B. An, "DQR: A Deep Reinforcement Learning-based QoS Routing Protocol in Cognitive Radio Mobile Ad Hoc Networks," in 2021 International Conference on Electronics, Information, and Communication (ICEIC), Jeju, Korea, pp. 1-4, 2021.
2 S. Abdzaher, M. Abdrabou, A. Al-shami, and I. Saroit, "Performance Evaluation of Medium Access Control Protocols for Cognitive Radio Ad Hoc Networks," in 2019 International Conference on Innovative Trends in Computer Engineering (ITCE), Aswan, Egypt, pp. 76-79, 2019.
3 S. Sharmila and T. Shanthi, "A survey on wireless ad hoc network: Issues and implementation," in 2016 International Conference on Emerging Trends in Engineering, Technology and Science (ICETETS), Pudukkottai, India, pp. 1-6, 2016.
4 Y. Zhang, Y. Wang, J. Chen, B. Zhao, C. Gao, and J. Dong, "Spectrum Reallocation Algorithm Based on the Mobile Model for Cognitive Radio Networks," in 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), Chongqing, China, pp. 11-14, 2020.
5 F. F. Qureshi, "Energy efficient cognitive radio MAC protocol for adhoc networks," in Wireless Telecommunications Symposium, London, UK, pp. 1-5, 2012.
6 F. F. Qureshi and A. G. Baksh, "Reliable Cognitive Radio multi-channel MAC protocol for Adhoc networks," in 2015 International Conference on Communications, Signal Processing, and their Applications (ICCSPA'15), Sharjah, United Arab Emirates, pp. 1-6, 2015.
7 M. -X. Wu, Y. -J. Yang, C. -Y. Xie, and C. -M. Wu, "Distributed Multichannel MAC Protocol in Cognitive Radio Ad Hoc Networks," in 2018 1st International Cognitive Cities Conference (IC3), Okinawa, Japan, pp. 260-261, 2018.
8 J. M. Kumbhar and V. P. Kulkarni, "Channel Selection in Multi-channel Multi-user RF Energy Harvesting Cognitive Radio Networks," in 2018 4th International Conference for Convergence in Technology (I2CT), Mangalore, India, pp. 1-5 , 2018.
9 P. Rungsawang and A. Khawne, "The implementation of spectrum sensing and spectrum allocation on cognitive radio," in 2017 19th International Conference on Advanced Communication Technology (ICACT), PyeongChang, Korea, pp. 817-821 2017.