Browse > Article
http://dx.doi.org/10.4218/etrij.16.0115.1030

Practical Implementation and Stability Analysis of ALOHA-Q for Wireless Sensor Networks  

Kosunalp, Selahattin (Department of Electrical and Energy, Bayburt University)
Mitchell, Paul Daniel (Department of Electronics, University of York)
Grace, David (Department of Electronics, University of York)
Clarke, Tim (Department of Electronics, University of York)
Publication Information
ETRI Journal / v.38, no.5, 2016 , pp. 911-921 More about this Journal
Abstract
This paper presents the description, practical implementation, and stability analysis of a recently proposed, energy-efficient, medium access control protocol for wireless sensor networks, ALOHA-Q, which employs a reinforcement-learning framework as an intelligent transmission strategy. The channel performance is evaluated through a simulation and experiments conducted using a real-world test-bed. The stability of the system against possible changes in the environment and changing channel conditions is studied with a discussion on the resilience level of the system. A Markov model is derived to represent the system behavior and estimate the time in which the system loses its operation. A novel scheme is also proposed to protect the lifetime of the system when the environment and channel conditions do not sufficiently maintain the system operation.
Keywords
Q-learning; medium access control; resilience level; wireless sensor networks;
Citations & Related Records
연도 인용수 순위
  • Reference
1 I.F. Akyildiz et al., "A Survey on Sensor Networks," Commun. Mag., vol. 40, no. 8, 2002, pp. 102-114.
2 I. Demirkol, C. Ersoy, and F. Alagoz, "MAC Protocols for Wireless Sensor Networks: A Survey," Commun. Mag., vol. 44, no. 4, 2006, pp. 115-121.
3 M.A. Yigitel, O.D. Incel, and C. Ersoy, "QoS-Aware Mac Protocols for Wireless Sensor Networks: A Survey," Comput. Netw., vol. 55, no. 8, 2011, pp. 1982-2004.   DOI
4 Y. Chu, P.D. Mitchell, and D. Grace, "ALOHA and Q-Learning Based Medium Access Control for Wireless Sensor Networks," Int. Symp. Wireless Commun. Syst., Paris, France, Aug. 28-31, 2012, pp. 511-515.
5 Y. Yan et al., "Distributed Frame Size Selection for Q Learning Based Slotted ALOHA Protocol," Proc. Int. Symp. Wireless Commun. Syst., Ilmenau, Germany, Aug. 2013, pp. 733-737.
6 T.V. Dam and K. Langendoen, "An Adaptive Energy-Efficient MAC Protocol for Wireless Sensor Networks," Proc. Int. Conf. Embedded Netw. Sensor Syst., Los Angeles, CA, USA, Nov. 5-7, 2003, pp. 171-180.
7 S. Kosunalp et al., "Practical Implementation Issues of Reinforcement Learning Based ALOHA for Wireless Sensor Networks," Proc. Int. Symp. Wireless Commun. Syst., Ilmenau, Germany, Aug. 27-30, 2013, pp. 360-364.
8 Y. Chu et al., "Application of Reinforcement Learning to Medium Access Control for Wireless Sensor Networks," Eng. Appl. Artif. Intell., vol. 46, Nov. 2015, pp. 23-32.   DOI
9 R.S. Sutton and A.G. Barto, Reinforcement Learning: An Introduction, Cambridge, MA, USA: MIT Press, 1998.
10 W. Ye, J. Heidemann, and D. Estrin, "An Energy-Efficient MAC Protocol for Wireless Sensor Networks," Ann. Joint Conf. IEEE Comput. Commun. Soc., New York, USA, 2002, pp. 1567-1576.
11 Z. Liu and I. Elhanany, "RL-MAC: A QoS-Aware Reinforcement Learning Based MAC Protocol for Wireless Sensor Networks," Proc. IEEE Int. Conf. Netw. Sens. Contr., Lauderdale, FL, USA, Apr. 23-25, 2006, pp. 768-773.
12 W.R. Heinzelman, A. Chandrakasan, and H. Balakrishnan, "Energy-Efficient Communication Protocol for Wireless Microsensor Networks," Proc. Ann. Hawaii Int. Conf. Syst. Sci., Hawaii, HI, USA, Jan. 7, 2000, pp. 1-10.
13 V. Rajendran, K. Obraczka, and J.J. Garcia-Luna-Aceves, "Energy-Efficient, Collision-Free Medium Access Control for Wireless Sensor Networks," Wireless Netw., vol. 12, no. 1, Feb. 2006, pp. 63-78.   DOI
14 I. Rhee et al., "Z-MAC: A Hybrid MAC for Wireless Sensor Networks," IEEE/ACM Trans. Netw., vol. 16, no. 3, June 2008, pp. 511-524.   DOI
15 Datasheet for MicaZ wireless measurement system, Accessed Nov. 2015. http://www.openautomation.net/uploadsproductos/micaz_datasheet.pdf
16 Datasheet for CC2420 IEEE 802.15.4-compliant RF Transceiver, Accessed Nov. 2015. http://www.ti.com/lit/ds/symlink/cc2420.pdf
17 P. Levis et al., "TinyOS: An Operating System for Wireless Sensor Networks," in Ambient Intelligence, Berlin, Germany: Springer, 2005, pp. 115-148.
18 J. Zhao and R. Govindan, "Understanding Packet Delivery Performance in Dense Wireless Sensor Networks," Proc. Int. Conf. Embedded Netw. Sensor Syst., Los Angeles, CA, USA, Nov. 5-7, 2003, pp. 1-13.
19 N. Abramson, "The Throughput of Packet Broadcasting Channels," IEEE Trans. Commun., vol. 25, no. 1, Jan. 1977, pp. 117-128.   DOI