A Localized Adaptive QoS Routing using TD(${\lambda}$) method

TD(${\lambda}$) 기법을 사용한 지역적이며 적응적인 QoS 라우팅 기법

  • 한정수 (신구대학 인터넷정보과)
  • Published : 2005.05.01

Abstract

In this paper, we propose a localized Adaptive QoS Routing using TD method and evaluate performance of various exploration methods when path is selected. Expecially, through extensive simulation, the proposed routing algorithm and exploration method using Exploration Bonus are shown to be effective in significantly reducing the overall blocking probability, when compared to the other path selection method(exploration method), because the proposed exploration method is more adaptive to network environments than others when path is selected.

본 논문에서는 TD(temporal differences) 기법을 사용한 localized QoS 라우팅 기법을 제안하였다. 이 기법은 이웃노드로부터 얻어지는 성공 기댓값을 통해 라우팅 정책을 결정하는 기법이다. 이에 본 논문에서는 라우팅 성공 기댓값을 기반으로 한 다양한 탐색기법으로 경로 선택 시 라우팅 성능을 비교 평가하였으며, 특히 Exploration Bonus를 적용한 탐색 기법이 다른 탐색 기법에 비해 더욱 우수한 성능을 보여주고 있는데, 이는 다른 탐색 기법에 비해 네트워크 상황에 더 적응적으로 경로를 선택할 수 있기 때문이다.

Keywords

References

  1. X.Yuan and A.Saifee, 'Path Selection Methods for Localized Quality of Service Routing', Technical Report, TR-010801, Dept of Computer Science, Florida State University, July, 2001
  2. Srihari Nelakuditi, Zhi-Li Zhang and Rose P.Tsang, 'Adaptive Proportional Routing: A Localized QoS Routing Approach', In IEEE Infocom, April 2000
  3. Srihari Nelakuditi, Zhi-Li Zhang, 'A Localized Adaptive Proportioning Approach to QoS Routing', IEEE Communications Magazine, June 2002
  4. Y.Liu, C.K. Tham and TCK. Hui, 'MAPS: A Localized and Distributed Adaptive Path Selection in MPLS Networks' in Proceedings of 2003 IEEE Workshop on High Performance Switching and Routing, Torino, Italy, June 2003, pp.24-28
  5. Yvn Tpac Valdivia, Marley M. Vellasco, Marco A. Pacheco 'An Adaptive Network Routing Strategy with Temporal Differences', Inteligencia Artificial, Revista Lberoamericana de Inteligencia Aritificial, No 12(2001), pp. 85-91
  6. Leslie Pack Kaelbling, Michael L. Littman, Andrew W.Moore, 'Reinforcement Learning: A Survey', Journal of Artificial Intelligence Research 4, 1996, pp 237-285
  7. P.Marbach, O.Mihatsch, and J.N. Tsitsildis, 'Call Admission Control and Routing in Integrated Service Networks Using Neuro-Dynamic Programming', IEEE Journal on Selected Areas in Communications, Vol. 18, No.2, Feb 2000, pp.197-208 https://doi.org/10.1109/49.824797
  8. Sutton, R.S. 'Learning to predict by the method of temporal differences' Machine Learning 3. 1988, pp.9-44