Browse > Article

An Emotional Gesture-based Dialogue Management System using Behavior Network  

Yoon, Jong-Won (연세대학교 컴퓨터과학과)
Lim, Sung-Soo (연세대학교 컴퓨터과학과)
Cho, Sung-Bae (연세대학교 컴퓨터과학과)
Publication Information
Journal of KIISE:Software and Applications / v.37, no.10, 2010 , pp. 779-787 More about this Journal
Abstract
Since robots have been used widely recently, research about human-robot communication is in process actively. Typically, natural language processing or gesture generation have been applied to human-robot interaction. However, existing methods for communication among robot and human have their limits in performing only static communication, thus the method for more natural and realistic interaction is required. In this paper, an emotional gesture based dialogue management system is proposed for sophisticated human-robot communication. The proposed system performs communication by using the Bayesian networks and pattern matching, and generates emotional gestures of robots in real-time while the user communicates with the robot. Through emotional gestures robot can communicate the user more efficiently also realistically. We used behavior networks as the gesture generation method to deal with dialogue situations which change dynamically. Finally, we designed a usability test to confirm the usefulness of the proposed system by comparing with the existing dialogue system.
Keywords
Humanoid; Dialogue management; Emotional robot; Gesture generation;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 I. Bulyko and M. Ostendorf, "Efficient integrated response generation from multiple targets using weighted finite state transducers," Computer Speech and Language, vol.16, no.3-4, pp.533-550, 2002.   DOI   ScienceOn
2 B. R. Steunebrink, M. Dastani, and J.-J. Ch. Meyer, "A formal model of emotion-based action tendency for intelligent agents," Lecture Notes in Computer Science, vol.5816, pp.174-186, 2009.
3 J. Brooke, "SUS: A quick and dirty usability scale," Usability evaluation in industry, 1996.
4 M. N. Nicolescu and M. J. Mataric, "A hierarchical architecture for behavior-based robots," In Proc. of First Int. Joint Conf. on Autonomous Agents and Multi-Agent Systems, pp.227-233, 2002.
5 A. Khoo and R. Zubek, "Applying inexpensive AI techniques to computer games," IEEE Intelligent Systems, vol.17, no.4, pp.48-53, 2002.
6 D. Evans, "Emotion," Oxford University Press, 2001.
7 A. Ortony, G. Clore, and A. Collins, "The cognitive structure of emotions," Chicago University Press, 1998.
8 C. D. Elliott, "The affective reasoner: A process model of emotions in a multi-agent system," Northwestern University, 1992.
9 M. El-Nasr, T. R. Loerger, and J. Yen, "Emotionally Expressive Agents," 1998.
10 C.-T. Cheng, Y.-T. Yang, S.-H. Miao, and C.-C. Wong, "Motion and emotional behavior design for pet robot dog," Lecture Notes in Computer Science, vol.5744, pp.13-22, 2009.
11 N. Mitsunaga, C. Smith, T. Kanda, H. Ishiguro, and N. Hagita, "Adapting robot behavior for human- robot interaction," IEEE Trans. on robotics, vol.24, no.4, pp.911-916, 2008.   DOI
12 S.-S. Lim, S.-B. Cho, "Automatic construction of hierarchical Bayesian networks for topic inference of conversational agent," Journal of Korea Information Science Society: Software and Applications, vol.33, no.10, pp.877-885, Oct. 2006.   과학기술학회마을
13 E. Horvitz and T. Paek, "A computational architecture for conversation," Proc. 7th Int. Conf. User Modeling, pp.201-210, 1999.
14 C. Bartneck, "Integrating the OCC model of emotions in embodied characters," In Proc. of the Workshop on Virtual Conversational Characters: Applications, Methods, and Research Challenges, 2002.
15 W. Breitfuss, H. Prendinger, and M. Ishizuka, "Automatic generation of gaze and gestures for dialogues between embodied conversational agents," International Journal of Semantic Computing, vol. 2, no.1, pp.71-90, 2008.   DOI   ScienceOn
16 S. Franklin, and A. Graesser, "Is it an agent, or just a program? : A taxonomy for autonomous agents," Lecture Notes in Computer Science, vol.1193, pp.21-35, 1997.
17 S. Macskassy and S. Stevenson, "A conversational agent," Master essay, Rutgers University, 1996.
18 P. Nuguesm et al., "A conversational agent to navigate in virtual worlds," Proc. of the 11th Workshop on Language Technology, pp.23-33, 1996.
19 C.-J. Lee, S.-K. Jung, S.-H. Kim, and G. C.-B. Lee, "Example-based dialog modeling for practical multi-domain dialog system," Speech Communication, vol.51, no.5, pp.466-484, 2009.   DOI   ScienceOn
20 J.-H. Hong and S.-B. Cho, "A two-stage bayesian network for effective development of conversational agent," Lecture Notes in Computer Science, vol.2690, pp.1-9, 2003.
21 P. Maes, "How to do the right thing," Connection Science Journal, vol.1, no.3, pp.291-323, 1989.   DOI   ScienceOn
22 M. N. Nicolescu and M. J. Mataric, "Extending behavior-based systems capabilities using an abstract behavior representation," AAAI Fall Symposium on Parallel Cognition, pp.27-34, 2000.
23 T. Fong, C. Thorpe, and C. Baur, "Robot, asker of questions," Robot. Auton. Syst., vol.42, no.3-4, pp.235-243, 2003.   DOI   ScienceOn
24 H. Prendinger and M. Ishizuka, "Let's talk! Socially intelligent agents for language conversation training," IEEE Trans. Syst., Man, Cybern. A, Syst. Humans, vol.31, no.5, pp.465-471, 2001.   DOI   ScienceOn
25 D. Sanford and J. Roach, "A theory of dialogue structures to help manage human-computer interaction," IEEE Trans. Syst., Man, Cybern., vol.18, no.4, pp.567-574, 1988.   DOI   ScienceOn
26 A. Green and K. Eklundh, "Designing for learnability in human-robot communication," IEEE Trans. Ind. Electron., vol.50, no.4, pp.644-650, 2003.   DOI   ScienceOn
27 A. Ratnaparkhi, "Trainable approaches to surface natural language generation and their application to conversational dialog systems," Computer Speech and Language, vol.16, no.3-4, pp.435-455, 2002.   DOI   ScienceOn
28 M. A. Walker, O. C. Rambow and M. Rogati, "Training a sentence planner for spoken dialogue using boosting," Computer Speech and Language, vol.16, no.3-4, pp.409-433, 2002.   DOI   ScienceOn
29 E. Levin, R. Pieraccini and W. Eckert, "A stochastic model of human-machine interaction for learning dialog strategies," IEEE Trans. on Speech and Audio Processing, vol.8, no.1, pp.11-23, 2000.   DOI   ScienceOn