Browse > Article

A Comic Facial Expression Method for Intelligent Avatar Communications in the Internet Cyberspace  

이용후 (명지대학교 컴퓨터공학과)
김상운 (명지대학교 컴퓨터공학과)
청목유직 (북해도대학)
Publication Information
Journal of the Institute of Electronics Engineers of Korea CI / v.40, no.1, 2003 , pp. 59-73 More about this Journal
Abstract
As a means of overcoming the linguistic barrier between different languages in the Internet, a new sign-language communication system with CG animation techniques has been developed and proposed. In the system, the joint angles of the arms and the hands corresponding to the gesture as a non-verbal communication tool have been considered. The emotional expression, however, could as play also an important role in communicating each other. Especially, a comic expression is more efficient than real facial expression, and the movements of the cheeks and the jaws are more important AU's than those of the eyebrow, eye, mouth etc. Therefore, in this paper, we designed a 3D emotion editor using 2D model, and we extract AU's (called as PAU, here) which play a principal function in expressing emotions. We also proposed a method of generating the universal emotional expression with Avatar models which have different vertex structures. Here, we employed a method of dynamically adjusting the AU movements according to emotional intensities. The proposed system is implemented with Visual C＋＋ and Open Inventor on windows platforms. Experimental results show a possibility that the system could be used as a non-verbal communication means to overcome the linguistic barrier.
Keywords
sign-language; intelligent avatar communication; comic emotional expression;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 S.-W. Kim, J.-Y. Oh, S. Tanahashi, and Y. Aoki, 'Preliminary study on a sign-language chatting system between Korea and Japan for avatar communication on Internet.' IEICE Trans., vol. E83-A, no. 2, pp. 386-389, 2000
2 金商雲, 吳芝英, 靑木由直, '인터넷상에 3차원 모델을 이용한 한-일 실시간 수화 통신 시스템의 구축을 위한 기초적인 검토', 대한전자공학회논문지-S, vol. 36,no. 7, pp. 811-820, 1999   과학기술학회마을
3 S.-W. Kim, Y.-W. Lee, Y. Aoki, and Y. Arakawa, 'A comic expression method of universal emotions for intelligent avatar communications using principal action units' Proc, of ITC-CSCC, Tokushima, Japan, pp. 240-243, 2001
4 金商雲, 李種雨, 靑木由直, '3D 수화 애니메이션을 위한 팔과 손의 통합된 키 프레임 에디터,' 대한전자공학회논문지-SP, vol. 37, no. 9, pp. 371-380, 2000
5 P. Ekman and W.V. Friesen, Unmasking the Face, New Jersey: Prentice Hall, 1975
6 P. Essa and A. Pentland, 'Coding, Analysis Interpretation, Recognition of Facial Expressions,' IEEE Trans, Pattern Analysis and Machine Intelligence, vol, 19, no.7, pp. 757-763, 1997   DOI   ScienceOn
7 Y. Tian, T. Kanade, and J. Cohn 'Recognizing action units for facial expression analysis' IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.23, No.2, pp. 97-115, 2001   DOI   ScienceOn
8 S. Morishima, F. Kawakami, H Yamada, and H. Harashima, 'A Modelling of Facial Expression and Emotion for Recognition and Synthesis,' Symbiosis of Human and Artifact, Y. Anzai, K. Ogawa and H.Mori, eds., pp. 251-256, Amsterdam: Elsevier Science BV, 1995
9 표정/제스처 DB기반 감성인식 및 표현 시스템 개발 http://psylab.yonsei.ac.kr/~vision/cschung/표정_국문/index.htm