Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Generation of Robot Facial Gestures based on Facial Actions and Animation Principles

Facial Actions 과 애니메이션 원리에 기반한 로봇의 얼굴 제스처 생성

  • Received : 2014.02.15
  • Accepted : 2014.03.30
  • Published : 2014.05.01
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a method to generate diverse robot facial expressions and facial gestures in order to help long-term HRI. First, nine basic dynamics for diverse robot facial expressions are determined based on the dynamics of human facial expressions and principles of animation for even identical emotions. In the second stage, facial actions are added to express facial gestures such as sniffling or wailing loudly corresponding to sadness, laughing aloud or smiling corresponding to happiness, etc. To evaluate the effectiveness of our approach, we compared the facial expressions of the developed robot when the proposed method is used or not. The results of the survey showed that the proposed method can help robots generate more realistic facial expressions.

Keywords

References

  1. P. Salvine, M. Nicolescu, and H. Ishiguro, "Benefits of humanrobot interactions," IEEE Robotics & Automation Magazine, vol. 18, no. 4, pp. 98-99, 2011. https://doi.org/10.1109/MRA.2011.943237
  2. J.-C. Martin, R. Niewiadomski, L. Devillers, S. Buisine, and C. Pelachaud, "Multimodal complex emotions: gesture expressivity and blended facial expressions," International Journal of Humanoid Robotics, vo. 3, no. 3, pp. 269-291, 2006. https://doi.org/10.1142/S0219843606000825
  3. Z. Liu and Z. G. Pan, "An emotion model of 3D virtual ch aracters in intelligent virtual environment," International Conf. Affective Computing and Intelligent Interaction (ACII 2005), pp. 629-636, 2005.
  4. C. Becker-Asano and I. Wachsmuth, "Affective computing with primary and secondary emotions in a virtual human," Autonomous Agents and Multi-agent Systems, vol. 20, no. 1, pp. 32-49, 2010. https://doi.org/10.1007/s10458-009-9094-9
  5. E. Tanguy, P. J. Willis, and J. J. Bryson, "A dynamic emotion representation model within a facial animation system," International Journal of Humanoid Robotics, vol. 3, no. 3, pp. 293-300, 2006. https://doi.org/10.1142/S0219843606000758
  6. T. Fukuda, M.-J. Jung, M. Nakashima, F. Arai, and Y. Hasegawa, "Facial expressive robotics head system for humanrobot communication and its application in home environment," Proceedings of the IEEE, vol. 92, no. 11, pp. 1851-1865, 2004. https://doi.org/10.1109/JPROC.2004.835355
  7. P. Ekman, W. V. Friesen, and J. C. Hager, Facial Action Coding System/The manual on CD Rom, Research Nexus division of network information research corporation, Salt Lake City, UT, 2002.
  8. C. L. Breazeal, Designing Sociable Robots, The MIT Press, Cambridge, Massachusetts, 2002.
  9. H. Miwa, T. Okuchi, K. Itoh, H. Takanobu, and A. Takanishi, "A new mental model for humanoid robots for human friendly communication - Introduction of learning system, mood vector and second order equations of emotion -," IEEE Int. Conf. Robotics Automation (ICRA), pp. 3588-3593, 2003.
  10. S. Sosnowski, A. Bittermann, K. Kuhnlenz, and M. Buss, "Design and evaluation of emotion-display EDDIE," Int. Conf. Intelligent Robots and Systems (IROS), pp. 3113-3118, 2006.
  11. K.-G. Oh, M.-S. Jang, and S.-J. Kim, "Automatic emotional expression of a face robot by using a reactive behavior decision model," Journal of Mechanical Science and Technology, vol. 24, no. 3, pp. 769-774, 2010. https://doi.org/10.1007/s12206-010-0118-9
  12. B.-S. Yoo, S.-H. Cho, and J.-H. Kim, "Fuzzy integral-based composite facial expression generation for a robotic head," IEEE Int. Conf. Fuzzy Systems (FUZZ), pp. 917-923, 2011.
  13. A. J. N. van Breemen, "Animation engine for believable interactive user-interface robots," IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS), pp. 2873-2878, 2004.
  14. H. S. Lee, J. W. Park, and M. J. Chung, "A linear affectexpression space model and control points for mascot-type facial robots," IEEE Transactions on Robotics, vol. 23, no. 5, pp. 863-873, 2007. https://doi.org/10.1109/TRO.2007.907477
  15. Y. Matsui, M. Kanoh, S. Kato, T. Nakamura, and H. Itoh, "A model for generating facial expressions using virtual emotion based on simple recurrent network," Journal of Advanced Computational Intelligence and Intelligent Informatics, vol. 14, no. 5, pp. 453-463, 2010. https://doi.org/10.20965/jaciii.2010.p0453
  16. T. Riberio and A. Paiva, "The illusion of robotic life: Principles and practice of animation for robots," ACM/IEEE Int. Conf. Human-Robot Interaction (HRI), pp. 383-390, 2012.
  17. T. Minato, M. Shimada, H. Ishiguro, and S. Itakura, "Development of an android robot for studying human-robot interaction," Int. Conf. Industrial and Engineering Applications of Artificial Intelligence and Expert Systems (IEA/AIE), pp. 424-434, 2004.
  18. S. Hitramatsu, T. Tsuji, and H. Kobayashi, "Development of the face robot SAYA for rich facial expressions," Int. Joint Conf. SICE-ICASE, pp. 5423-5428, 2006.
  19. J.-H. Oh, D. Hanson, W.-S. Kim, I. Y. Han, J.-Y. Kim, and I.-W. Park, "Design of android type humanoid robot Albert HUBO," IEEE/RSJ Int. Con. Intelligent Robots and Systems (IROS), pp. 1423-1433, 2006.
  20. D.-W. Lee, T.-G. Lee, B. R. So, M. Choi, E.-C. Shin, K. W. Yang, M.-H. Baek, H.-S. Kim, and H.-G. Lee, "Development of an android for emotional expression and human Interaction," Proc. of Int. Federation of Automatic Control, pp. 4336-4337, 2008.
  21. H.-R. Kim and D.-S. Kwon, "Computational model of emotion generation for human-robot interaction based on the cognitive appraisal theory," Journal of Intelligent & Robotic Systems, vol. 60, no. 2, pp. 263-283, 2010. https://doi.org/10.1007/s10846-010-9418-7
  22. M. Mori, K. F. MacDorman, and N. Kageki, "The uncanny valley," IEEE Robotics & Automation Magazine, vol. 19, no. 2, pp. 98-100, 2012.
  23. N. Kageki, "An uncanny mind," IEEE Robotics & Automation Magazine, vo. 19, no. 2, pp. 112-108, 2012.
  24. M. Zecca, N. Endo, S. Momoki, K. Itoh, and A. Takanishi, "Design of the humanoid robot KOBIAN - preliminary analysis of facial and whole body emotion expression capabilities-," IEEE-RAS Int. Conf. Humanoid Robots, pp. 487-492, 2008.
  25. K.-G. Oh, C.-Y. Jung, M.-T. Choi, and S.-J. Kim, "Eye motion generation in a mobile service robot 'SILBOT II'," IEEE Int. Conf. Advanced Robotics and its Social Impacts (ARSO), pp. 59-64, 2010.
  26. P. Ekman, "An argument for basic emotions," Cognition & Emotion, vo. 6, no. 3-4, 169-200, 1992. https://doi.org/10.1080/02699939208411068
  27. K. Waters, and D. Terzopoulos, "A physical model of facial tissue and muscle articulation," IEEE Int. Conf. Visualization in Biomedical Computing, pp. 77-82, 1990.
  28. D. Terzopoulos, K. Waters, "Physically-based facial modeling, analysis, and animation," Journal of Visualization and Computer Animation, vol. 1, no. 2, pp.73-80, 1990. https://doi.org/10.1002/vis.4340010208
  29. H. S. Lee, J. W. Park, S. H. Jo, and M. J. Chung "A linear dynamic affect-expression model: facial expressions according to perceived emotions in mascot-type facial robots," IEEE Int. Symposium on Robot and Human Interactive Communication (ROMAN), pp. 619-624, 2007.
  30. R. C. Dorf and R. H. Bishop, Mordern Control Systems, 9th Ed., Prentice Hall, Upper Saddle River, New Jersey, 2001.
  31. J. Lasseter, "Principle of traditional animation applied to 3D computer animation," Computer Graphics, vol. 21, no. 4, pp. 35-44, 1987. https://doi.org/10.1145/37402.37407
  32. P. Ekman and Y. I. Yun, Telling Lies, (Korean Translation) Dongin Publishing, Seoul, Korea, 1997.
  33. J. W. Park, H. S. Lee, S. H. Jo, M. G. Kim, and M. J. Chung, "Emotional boundaries for choosing modalities according to the intensity of emotion in a linear affect-expression space," IEEE Int. Symposium on Robot and Human Interactive Communication (ROMAN), pp. 225-230, 2008.
  34. J. S. Elston, F. C. Granje, and A. J. Lees, "The relationship between eye-winking tics, frequent eye-blinking and blepharospasm," Journal of Neurology, Neurosurgery, and Psychiatry, vol. 52, no. 4, pp. 477-480, 1989. https://doi.org/10.1136/jnnp.52.4.477
  35. I. Leite, C. Marinoh, and A. Paiva, "Social robots for long-term interaction: A survey," International Journal of Social Robot, vol. 5, no. 2, pp. 291-308, 2013. https://doi.org/10.1007/s12369-013-0178-y