Browse > Article
http://dx.doi.org/10.5391/JKIIS.2006.16.3.259

Implementation of Intelligent Virtual Character Based on Reinforcement Learning and Emotion Model  

Woo Jong-Ha (LG전자 MC사업본부 단말연구소)
Park Jung-Eun (서강대학교 컴퓨터학과)
Oh Kyung-Whan (서강대학교 컴퓨터학과)
Publication Information
Journal of the Korean Institute of Intelligent Systems / v.16, no.3, 2006 , pp. 259-265 More about this Journal
Abstract
Learning and emotions are very important parts to implement intelligent robots. In this paper, we implement intelligent virtual character based on reinforcement learning which interacts with user and have internal emotion model. Virtual character acts autonomously in 3D virtual environment by internal state. And user can learn virtual character specific behaviors by repeated directions. Mouse gesture is used to perceive such directions based on artificial neural network. Emotion-Mood-Personality model is proposed to express emotions. And we examine the change of emotion and learning behaviors when virtual character interact with user.
Keywords
Reinforcement Learning; Emotion Model; Intelligent Virtual Character; Emotion-Mood-Personality; Artificial Neural Network;
Citations & Related Records
연도 인용수 순위
  • Reference
1 M. El-Nasr, Thomas R. loerger, John Yen, 'Emotionally Expressive Agents', 1998
2 Elliott C.D, 'The Affective Reasoner: A process model of emotions in a multi-agent system', Northwestern University, Evanston, IL, Ph.D Thesis, 1992
3 N. Kubota, Y. Nojima, N. Baba, F. Kojima, T. Fukuda, 'Evolving Pet Robot with Emotional Model', Proceedings of the CEC, pp.1231-1237, 2000
4 N. Kubota, F. Kojima, T. Fukuda, 'Self-Consciousness and Emotion for A Pet Robot with Structured Intelligence', IFSA World Congress and 20th NAFIPS International Conference, pp.2786-2791, 2001
5 L. P. Kaelbling and M. L. Littman 'Reinforcement Learning: A survey', Journal of Artificial Intelligence Research 4, pp.237-285, 1996   DOI
6 R. S. Sutton and A. G. Barto, 'An Introduction to Reinforcement Learning: An Introduction', MIT Press, 1998
7 D. P. Bertsekas and D. A. Tsitsiklis, 'Adaptive aggregation for infinite horizon dynamic programming', IEEE Transactions on Automatic Control. 34, pp.589-598, 1989   DOI   ScienceOn
8 Song-Yee Yoon, 'Interactive Training for Synthetic Characters', Proceedings of American Association for Artificial Intelligence, 2000
9 Kenji Suzuki, 'Intelligent Agent System for Human- Robot Interaction through Artificial Emotion', IEEE International Conference. Vol 2, pp.1055-1060, 1998
10 Damian A. Isla, 'Object Persistence for Synthetic Creatures', Proceedings of the first international joint conference on Autonomous agents and multiagent systems. Part 3, pp.1356-1368, 2002
11 Bruce Blumberg, 'Integrated Learning for Interactive Synthetic Characters', Proceedings of the 29th annual conference on Computer graphics and interactive techniques. SIGGRAPH, 2002
12 Mat Buckland, 'AI Techniques for Game Programming', Thomson Learning, 2002
13 A. Ortony, G. Clore, A. Collins, 'The Cognitive Structure of Emotions', Chicago University Press, 1998