Learning Behavior of Virtual Robot using Compensation Signal

보상신호를 수반하는 가상로봇의 학습행위 연구

  • Hwang, Su-Chul (Dept. of Computer Engineering and Systems, Inha Technical College)
  • 황수철 (인하공업전문대학 컴퓨터시스템과)
  • Published : 2007.09.25

Abstract

In this paper we suggest a model that the virtual robot based on artificial intelligence performs learning with compensation signals and compare the leaning speed of the virtual robot according to the compensation method after applying it to three type environments. As a result our model has showed that positive compensation is superior to hybrid one mixed positive and negative if there are enough time for learning in case of more or less complicated environment with the numerous foods, obstacles and robots. Otherwise hybrid method is better than positive one.

본 논문에서는 보상신호를 수반하는 인공지능 기반의 가상 로봇 학습 행위 모델을 제안하고 이 모델을 3가지 환경에 적용시킨 후에 보상 방법에 따른 가상 로봇의 학습 속도를 비교 검토하였다. 결과로서 환경이 다소 복잡하면 즉, 로봇 집단의 크기, 먹이 수, 장애물 수가 다소 많은 경우 학습 세대가 충분하다면 강화 보상 방법이 강화와 억제를 혼합한 보상 방법 보다 우월함을 알 수 있었다. 하지만 복잡하지 않은 환경에서는 혼합 보상 방법이 우수했다.

Keywords

References

  1. Silva,A., Neves, A., Costa, E., 'Polymorphy and Hybridization in Genetically Programmed Networks', Parallel Problem Solving from Nature - PPSN VI 6th International Conference, 2000
  2. Aharonov-Barki, R., Beker, T. , Ruppin, E., 'Emergence of memory-DrivenCommandNeurons in EvolvedArtificialAgents', Neural Computation 13(3), pp. 691-716, 2001 https://doi.org/10.1162/089976601300014529
  3. Collins, R.J., 'Studies in Artificial Evolution', Phd Thesis, Philosophy in Computer Science, University of California, Los Angeles, 1992
  4. iRobot, iRobot Create Owner's Guide, 2007
  5. Hwang, S. C, Cho, K. D., Gordon,V. S., 'The Evolving Model and Application of Virtual Robots', The 2005 IEEE Int'l Conference on IRI, pp392-397, Las Vegas, USA, Aug.15-17,2005
  6. Parisi, D., Nolfi, S. and Cecconi, F., 'Learning, Behavior and Evolution', Toward a Practice of Autonomous systems, MIT Press, 1991
  7. Yao, X., 'Evolving Artificial Neural Networks', Proceedings of the IEEE, 87(9), pp.1423-1447, 1999
  8. David E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning, Addison Wesley, 1989
  9. Jeannette Stanley, Introduction to Neural Networks, California Sceinticfic Software, 1989