Browse > Article
http://dx.doi.org/10.20465/KIOTS.2022.8.4.001

A Research on Low-power Buffer Management Algorithm based on Deep Q-Learning approach for IoT Networks  

Song, Taewon (Department of IoT, Soonchunhyang University)
Publication Information
Journal of Internet of Things and Convergence / v.8, no.4, 2022 , pp. 1-7 More about this Journal
Abstract
As the number of IoT devices increases, power management of the cluster head, which acts as a gateway between the cluster and sink nodes in the IoT network, becomes crucial. Particularly when the cluster head is a mobile wireless terminal, the power consumption of the IoT network must be minimized over its lifetime. In addition, the delay of information transmission in the IoT network is one of the primary metrics for rapid information collecting in the IoT network. In this paper, we propose a low-power buffer management algorithm that takes into account the information transmission delay in an IoT network. By forwarding or skipping received packets utilizing deep Q learning employed in deep reinforcement learning methods, the suggested method is able to reduce power consumption while decreasing transmission delay level. The proposed approach is demonstrated to reduce power consumption and to improve delay relative to the existing buffer management technique used as a comparison in slotted ALOHA protocol.
Keywords
IoT; Artificial intelligence; Deep reinforcement learning; Deep Q learning; Buffer management;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. Merlin, G. Barriac, H. Sampath, L. Cariou, T. Derham, J.-P. L. Rouzic, R. Stacey, M. Park, C. Ghosh, R. Porat, N. Jindal, Y. Inoue, Y. Asai, Y. Takatori, A. Kishida, A. Yamada, R. Hedayat, S. Choudhury, K. Doppler, J. Kneckt, E.-H. Rantala, D. X. Yang, Y. (Ross), Z. Lan, J. Zhang, Y. Li, Y. Li, J. Pang, H. Su, Y. Lin, W. Lee, H. Cho, S. Kim, H. Choi, J. Levy, F. L. Sita, J. Jiang, L. Chu, Y. Sun, F. Mestanov, G. Li, S. Marin, E. Sakai, W. Carney, B. Sun, K. Lv, Y. Ke, H. Zhiqiang, C.-C. Wang, R. Huang, C. Yu, J. Yee, E. Wong, J. Kim, and X. Wang, "TGax Simulation Scenarios." [Online]. Available: https://mentor.ieee.org/802.11/dcn/14/11-14-0980-16-00ax-simulation-scenarios.docx
2 "Gym Documentation." [Online]. Available: https://www.gymlibrary.ml
3 "PyTorch." [Online]. Available: https://pytorch.org
4 T. J. Ott, T. V. Lakshman, and L. H. Wong, "Sred: Stabilized red," IEEE INFOCOM'99, Vol.3, pp.1346-1355, 1999.
5 I. Gupta, D. Riordan, and S. Sampalli, "Cluster-head election using fuzzy logic for wireless sensor networks," IEEE 3rd Annual Communication Networks and Services Research Conference (CNSR'05), 2005.
6 B. Manzoor, N. Javaid, O. Rehman, M. Akbar, Q. Nadeem, A. Iqbal, and M. Ishfaq, "Q-LEACH: A new routing protocol for WSNs," Vol.19. pp.926-931, 2013.
7 M. E. Haque, T. Hossain, M. R. Sarker, M. Paul, M. S. Hoque, S. Uddin, A. A. Suman, M. H. M. Saad, and T. U. Huque, "A hybrid approach to enhance the lifespan of wsns in nuclear power plant monitoring system," Scientific Reports, Vol.12(1), pp.1-14, 2022.   DOI
8 A. K. Dwivedi and A. K. Sharma, "EE-LEACH: energy enhancement in LEACH using fuzzy logic for homogeneous WSN," Wireless Personal Communications, Vol.120, pp.3035-3055, 2021.   DOI
9 G. A. Senthil, A. Raaza, and N. Kumar, "Internet of things energy efficient cluster-based routing using hybrid particle swarm optimization for wireless sensor network," Wireless Personal Communications, Vol.122, pp.2603-2619, 2022.   DOI
10 R. Maheswar, P. Jayarajan, S. Vimalraj, G. Sivagnanam, V. Sivasankaran, and I. S. Amiri, "Energy efficient real time environmental monitoring system using buffer management protocol; energy efficient real time environmental monitoring system using buffer management protocol," IEEE 2018 9th International Conference on Computing, Communication and Networking Technologies (ICCCNT), 2018.
11 W. R. Heinzelman, A. Chandrakasan, and H. Balakrishnan, "Energy-efficient communication protocol for wireless microsensor networks." IEEE Proceedings of the 33rd annual Hawaii international conference on system sciences, p.223, 2000.
12 "NumPy." [Online]. Available: https://numpy.org
13 D. P. Kingma and J. Ba, "Adam: A method for stochastic optimization," 2014. [Online]. Available: https://arxiv.org/abs/1412.6980
14 H. A. Alwasef, "An energy-efficient buffer management scheme based on data integrity and multivariate data reduction for wireless sensor networks," Journal of Control Engineering and Applied Informatics, Vol.23, No.3, pp.53-61, 2021.
15 M. T. Lazarescu, "Design of a wsn platform for long-term environmental monitoring for iot applications," IEEE Journal on emerging and selected topics in circuits and systems, Vol.3, No.1, pp.45-54, 2013.   DOI
16 D. Hosahalli and K. G. Srinivas, "Enhanced reinforcement learning assisted dynamic power management model for internet-of-things centric wireless sensor network," IET Communications, Vol.14, pp.3748-3760, 2020.   DOI