Browse > Article

Emotion-based Gesture Stylization For Animated SMS  

Byun, Hae-Won (성신여자대학교 IT학부)
Lee, Jung-Suk (성신여자대학교 일반대학원 전산학과)
Publication Information
Journal of Korea Multimedia Society / v.13, no.5, 2010 , pp. 802-816 More about this Journal
Abstract
To create gesture from a new text input is an important problem in computer games and virtual reality. Recently, there is increasing interest in gesture stylization to imitate the gestures of celebrities, such as announcer. However, no attempt has been made so far to stylize a gestures using emotion such as happiness and sadness. Previous researches have not focused on real-time algorithm. In this paper, we present a system to automatically make gesture animation from SMS text and stylize the gesture from emotion. A key feature of this system is a real-time algorithm to combine gestures with emotion. Because the system's platform is a mobile phone, we distribute much works on the server and client. Therefore, the system guarantees real-time performance of 15 or more frames per second. At first, we extract words to express feelings and its corresponding gesture from Disney video and model the gesture statistically. And then, we introduce the theory of Laban Movement Analysis to combine gesture and emotion. In order to evaluate our system, we analyze user survey responses.
Keywords
Mobile 3D animation; Emotional gesture generation; Laban Movement Analysis;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Emura K., Yasugi M, Tanaka T, Miyazaki S., and Motoike S., "Personal Media Producer: A System for Creating 3D CG Animation from Mobile Phone E-mail," Journal of Multimedia, Vol.1, No.2, 2006.
2 Per Persson, "ExMS: an Animated and Avatar-based Messaging System for Expressive peer Communication," Proceedings of the International ACM SIGGROUP Conference on Supporting Group Work, pp.31-39, 2003.
3 최승혁, 김재경, 임순범, 최윤철, "모바일 환경에서 스크립트를 이용한 3차원 아바타 동작 제어" 한국정보과학회 한국컴퓨터종합학술대회 논문집 (B), pp.574-576, 2005.
4 윤재홍, 송용규, 김은석, 허기택, "SMS 메시지에 따른 모바일 3D 아바타의 입술 모양과 음성 동기화" 한국콘텐츠학회 추계종합학술대회 논문집, 제4권 제2호, pp.682-686, 2006
5 Chi D, Costa M, Zhao L, and Badler N, "The EMOTE Model for Effort and Shape," ACM SIGGRAPH Proceedings, pp 173-182, 2000.
6 Sergey Levine, Christian Theobalt, and Vladlen Koltun, "Real-time Prosody-driven Synthesis of Body Language," ACM SIGGRAPH ASIA Proceedings, 2009.
7 Fagerberg P., Stahl A., and Hook K., "Designing Gestures for Affective Input: An Analysis of Shape, Effort and Valence." ACM 1-58113-826-1/01/12, 2003.
8 Noma, T., Zhao, L., and Badler, N., "Design of a Virtual Human Presenter," IEEE Computer Graphics and Applications, Vol.4, pp. 79-85, 2000.
9 Cassell H.. Vilhjalmsson T., and Bickmore. "BEAT: the Behavior Expression Animation Toolkit," ACM SIGGRAPH Proceedings, 2001.
10 Catherine Pelachaud, "Studies on Gesture Expressivity for a Virtual Agent," Speech Communication, Vol.51, Issue7, pp.630-639, 2009.   DOI   ScienceOn
11 Michael N, Michael K, Irene A, and Hans-peter S, "Gesture Modeling and Animation Based on a Probabilistic Re-Creation of Speaker Style," ACM Transactions on Graphics, Vol.27. 2008.
12 Juan Abadia, Alun Evans, Eduard Gonzales, Sergi Gonzales, Daniel Soto, Santi Fort, Marco Romeo, and Josep Blat, "Assisted animated production creation and programme generation," Proceedings of the International Conference on Advances in Computer Entertainment Technology, pp. 207-214, 2009.
13 Stone, M., Decarlo, D., Oh, I., Rodriguez, C., Stere, A., Lees, A., and Bregler, C., "Speaking with Hands: Creating Animated Convertsational Characters from Recordings of Human Performance," ACM SIGGRAPH proceedings, pp.506-513, 2004.
14 Hartmann, B., Mancini, M., and Pelachaud, C., "Implementing Expressive Gesture Synthesis for Embodied Conversational Agents," Lecture Notes Artificial Intelligence, Vol.3881, pp. 45-55, 2006.
15 McNeil, D., "Hand and Mind: What Gestures Reveal about Thought." University of Chicago, 1992.
16 Cassel, J. Pelachaud, C., Badler, N., Steedman, M., Achorn, B., Becket, T., Douville, B., Prevost, S., and Stone, M., "Animated Conversation: Rule-based Generation of Facial Expression, Gesture and Spoken Intonation for Multiple Conversational Agents," ACM SIGGRAPH Proceedings, 413-420, 1994.
17 이정윤, 이경진, 송왕철, "휴대폰에서 Avata컨텐츠 기반의 E-mail Client / Server 모델 설계 및 구현" 한국콘텐츠학회 춘계종합학술대회 논문집, 제2권 제1호, pp.385-391, 2004.