Browse > Article
http://dx.doi.org/10.5302/J.ICROS.2006.12.3.255

Recognition and Generation of Facial Expression for Human-Robot Interaction  

Jung Sung-Uk (한국전자통신연구원)
Kim Do-Yoon (한국과학기술원 전자전산학과)
Chung Myung-Jin (한국과학기술원 전자전산학과)
Kim Do-Hyoung (한국과학기술원 전자전산학과)
Publication Information
Journal of Institute of Control, Robotics and Systems / v.12, no.3, 2006 , pp. 255-263 More about this Journal
Abstract
In the last decade, face analysis, e.g. face detection, face recognition, facial expression recognition, is a very lively and expanding research field. As computer animated agents and robots bring a social dimension to human computer interaction, interest in this research field is increasing rapidly. In this paper, we introduce an artificial emotion mimic system which can recognize human facial expressions and also generate the recognized facial expression. In order to recognize human facial expression in real-time, we propose a facial expression classification method that is performed by weak classifiers obtained by using new rectangular feature types. In addition, we make the artificial facial expression using the developed robotic system based on biological observation. Finally, experimental results of facial expression recognition and generation are shown for the validity of our robotic system.
Keywords
facial expression recognition; rectangle feature; AdaBoost; facial expression generation; active vision; human-robot interaction;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Ekman and W. V. Friesen, Unmasking the Face, Malor Books, Cambridge, 2003
2 http://www.takanishi.mech.waseda.ac.jp/reserach/
3 http://www-2.cs.cmu.edu/~nursebot/
4 http://www.research.philips.com/technologies/syst_softw/robotics
5 A. J. N. van Breemen, 'Animation engine for believable interactive user-interface robots,' Proc. of IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems, 2004   DOI
6 정성욱, AdaBoost 기반 실시간 얼굴 표정 인식을 위한 효과적인 사각 특징점 추출, 석사학위논문, 한국과학기술원, 2005
7 P. Viola and M. Jones, 'Rapid object detection using a boosted cascade of simple features,' Proc. of IEEE Int'l Conf. on Computer Vision and Pattern Recognition, pp. 511-518, 2001   DOI
8 D. H. Kim, D. Kim and M. J. Chung, 'An active vision system with facial expressions,' Proc. of 8th Int'l Conf. on Control, Automation, Robotics and Vision, pp. 1553-1558, Dec. 2004   DOI
9 http://www.ai.mit.edu/projects/humanoid-robotics-group/kismet/kismet.html
10 A. Takanishi, H. Takanobu, I. Kato, and T. Umetsu, 'Development of the anthropomorphic head-eye robot WE-3RII with an autonomous facial expression mechanism,' Proc. of IEEE Int'l Conf. on Robotics and Automation, pp. 3255-3260, 1999   DOI
11 H. Miwa, T. Okuchi, K. Itoh, H. Takanobu and A. Takanishi, 'A new mental model for humanoid robots for human friendly communication,' Proc. of the 2003 IEEE Int'l Conf. on Robotics and Automation, pp. 3588-3593, Sept. 2003   DOI
12 H. Miwa, T. Okuchi, H. Takanobu, and A. Takanishi, 'Development of a new human-like head robot WE-4,' Proc. of 2002 IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems, pp. 2443-2448, Oct. 2002   DOI
13 http://robotic.media.mit.edu/projects/Leonardo/Leo-intro.html
14 H. Miwa, K. Itoh, M. Matsumoto, M. Zecca, H. Takanobu, S. Roccella, M. C. Carrozza, P. Dario, and A. Takanishi, 'Effective emotional expressions with emotion expression humanoid robot WE-4RII,' Proc. of 2004 IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems, pp. 2203-2208, Oct. 2004   DOI
15 F. Hara, H. Akazawa and H. Kobayashi, 'Realistic facial expressions by SMA driven face robot,' Proc. of IEEE Int'l Workshop on Robot and Human Interactive Communication, pp. 504-511, 2001   DOI
16 http://www.kobalab.com
17 http://iiae.utdallas.edu/projects/hanson.htm
18 C. Breazeal, Designing Sociable Robots, The MIT Press, Cambridge, 2002
19 C. Breazeal, 'How to build robots that make friends and influence people,' Proc. of the 1999 IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems, Kyongju, Korea, Oct. 1999, pp. 858-863   DOI
20 D. Evans, Emotion, Oxford University Press, New York, 2001
21 C. Darwin and P. Ekman, The Expression of The Emotions in Man and Animals, Oxford University Press, New York, 1998
22 M. Pantic and L. J. M. Rothkrantz, 'Automatic analysis of facial expressions: the state of the art,' IEEE Trans. on Pattern Recognition and Machine Intelligence, vol. 21, no. 12, pp. 1357-1362, 1999   DOI   ScienceOn
23 정명진, 이희승, 김도형, '로봇의 얼굴 표정을 통한 감정 표현 기법,' 로봇공학회지, 제2권, 제3호, pp. 68-76, Summer 2005
24 Y. Wang, H. AI, B. Wu, and C. Huang, 'Real time facial expression recognition with adaboost,' Proc. of the 17th Int'l Conf. on Pattern Recognition, vol. 3, no. 3, pp. 926-929, Cambridge, UK, August 2004   DOI