DOI QR코드

DOI QR Code

Object Search Algorithm under Dynamic Programming in the Tree-Type Maze

  • Jang In-Hun (School of Electrical and Electronic Engineering, Chung-Ang University) ;
  • Lee Dong-Hoon (School of Electrical and Electronic Engineering, Chung-Ang University) ;
  • Sim Kwee-Bo (School of Electrical and Electronic Engineering, Chung-Ang University)
  • Published : 2005.12.01

Abstract

This paper presents the target object search algorithm under Dynamic Programming (DP) in the Tree-type maze. We organized an experimental environment with the concatenation of Y-shape diverged way, small mobile robot, and a target object. By the principle of optimality, the backbone of DP, an agent recognizes that a given whole problem can be solved whether the values of the best solution of certain ancillary problem can be determined according to the principle of optimality. In experiment, we used two different control algorithms: a left-handed method and DP. Finally we verified the efficiency of DP in the practical application using our real robot.

Keywords

References

  1. R. Kurozumi, S. Fujisawa, T. Yamamoto, and Y. Suita, 'Path planning for mobile robots using an improved reinforcement learning scheme,' in Proc. of the Society of Instrument and Control Engineers, 2002, pp. 2178-2183 https://doi.org/10.1109/SICE.2002.1195737
  2. P. L. Lanzi, 'A study of generalization capabilities of XCS,' in Proc. of the 7th International Conference on Genetic Algorithms, 1997, pp. 418-425
  3. S. Russell and P. Norvig, Artificial Intelligence: a Modern Approach, New Jersey: Prentice Hall, 2003, pp. 287-295
  4. Richard S. Sutton and Andrew G. Barto, Reinforcement Learning, MIT press
  5. J. Jang, C. Sun, and E. Mizutani, Neuro-Fuzzy and Soft Computing, New Jersey: Prentice Hall, 1997, pp. 258-273
  6. H.-U. Yoon, S.-H. Whang, D.-W. Kim, and K.-B. Sim, 'Strategy of cooperative behaviors for distributed autonomous robotics systems,' in Proc. of the 10th International Symposium on Artificial Life and Robotics, 2005,pp.151-154
  7. H.-U. Yoon and K.-B. Sim, 'Hexagon-based Q-Iearning for object search with multiple robots,' in Proc. of the 1st international Conference on Natural Computation, 2005, pp.713-722