Browse > Article

A Localized Adaptive QoS Routing using TD(${\lambda}$) method  

Han Jeong-Soo (신구대학 인터넷정보과)
Publication Information
The Journal of Korean Institute of Communications and Information Sciences / v.30, no.5B, 2005 , pp. 304-309 More about this Journal
Abstract
In this paper, we propose a localized Adaptive QoS Routing using TD method and evaluate performance of various exploration methods when path is selected. Expecially, through extensive simulation, the proposed routing algorithm and exploration method using Exploration Bonus are shown to be effective in significantly reducing the overall blocking probability, when compared to the other path selection method(exploration method), because the proposed exploration method is more adaptive to network environments than others when path is selected.
Keywords
Localized QoS Routing; Reinforcement Learning; Q-Learning; Temporal Differences; Exploration method;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P.Marbach, O.Mihatsch, and J.N. Tsitsildis, 'Call Admission Control and Routing in Integrated Service Networks Using Neuro-Dynamic Programming', IEEE Journal on Selected Areas in Communications, Vol. 18, No.2, Feb 2000, pp.197-208   DOI   ScienceOn
2 Leslie Pack Kaelbling, Michael L. Littman, Andrew W.Moore, 'Reinforcement Learning: A Survey', Journal of Artificial Intelligence Research 4, 1996, pp 237-285
3 Yvn Tpac Valdivia, Marley M. Vellasco, Marco A. Pacheco 'An Adaptive Network Routing Strategy with Temporal Differences', Inteligencia Artificial, Revista Lberoamericana de Inteligencia Aritificial, No 12(2001), pp. 85-91
4 Y.Liu, C.K. Tham and TCK. Hui, 'MAPS: A Localized and Distributed Adaptive Path Selection in MPLS Networks' in Proceedings of 2003 IEEE Workshop on High Performance Switching and Routing, Torino, Italy, June 2003, pp.24-28
5 Sutton, R.S. 'Learning to predict by the method of temporal differences' Machine Learning 3. 1988, pp.9-44
6 Srihari Nelakuditi, Zhi-Li Zhang, 'A Localized Adaptive Proportioning Approach to QoS Routing', IEEE Communications Magazine, June 2002
7 X.Yuan and A.Saifee, 'Path Selection Methods for Localized Quality of Service Routing', Technical Report, TR-010801, Dept of Computer Science, Florida State University, July, 2001
8 Srihari Nelakuditi, Zhi-Li Zhang and Rose P.Tsang, 'Adaptive Proportional Routing: A Localized QoS Routing Approach', In IEEE Infocom, April 2000