Browse > Article
http://dx.doi.org/10.5392/JKCA.2016.16.05.021

The Congruent Effects of Gesture and Facial Expression of Virtual Character on Emotional Perception: What Facial Expression is Significant?  

Ryu, Jeeheon (전남대학교 사범대학 교육학과)
Yu, Seungbeom (전남대학교 사범대학 교육학과)
Publication Information
The Journal of the Korea Contents Association / v.16, no.5, 2016 , pp. 21-34 More about this Journal
Abstract
In the design and develop a virtual character, it is important to correctly deliver target emotions generated by the combination of facial expression and gesture. The purpose of this study is to examine the effect of congruent/incongruent between gesture and facial expression on target emotion. In this study four emotions, joy, sadness, fear, and anger, are applied. The results of study showed that sadness emotion were incorrectly perceived. Moreover, it was perceived as anger instead of sadness. Sadness can be easily confused when facial expression and gestures were simultaneously presented. However, in the other emotional status, the intended emotional expressions were correctly perceived. The overall evaluation of virtual character's emotional expression was significantly low when joy gesture was combined with sad facial expression. The results of this study suggested that emotional gesture is more influential correctly to deliver target emotions to users. This study suggested that social cues like gender or age of virtual character should be further studied.
Keywords
Virtual Character; Emotional Status; Emotional Perception; Gesture; Facial Expression;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 W. L. Johnson, J. W. Rickel, and J. C. Lester, "Animated pedagogical agents: Face-to-face interaction in interactive learning environments," International Journal of Artificial Intelligence in Education, Vol.41, pp.41-78, 2000.
2 H. van der Meij, J. van der Meij, and R. Harmsen, "Animated pedagogical agents effects on enhancing student motivation and learning in a science inquiry learning environment," Educational Technology Research and Development, Vol.63, No.3, pp.381-403, 2015.   DOI
3 S. Domagk, "Do Pedagogical Agents Facilitate Learner Motivation and Learning Outcomes?," J. of Media Psychology: Theories, Methods, and Applications, Vol.22, No.2, pp.84-97, 2010.   DOI
4 S. H. Chen and S. Y. Chen, "When educational agents meet surrogate competition: Impacts of competitive educational agents on students' motivation and performance," Computers & Education, Vol.75, pp.274-281, 2014.   DOI
5 김진옥, "가상 인간의 감정 표현 인식을 위한 비언어적 다중모달 영향 분석," 인터넷정보학회지, Vol.13, No.5, pp.9-19, 2012.
6 F. D. Schonbrodt and J. B. Asendorpf, "The challenge of constructing psychologically believable agents," J. of Media Psychology: Theories, Methods, and Applications, Vol.23, No.2, pp.100-107, 2011.   DOI
7 Dael, N..Mortillaro and K. R. M..Scherer, "Emotion expression in body action and posture," Emotion, Vol.12, No.5, pp.1085-1101, 2012.   DOI
8 J. K. Hietanen and J. M. Leppanen, "Judgment of other people's facial expressions of emotions is influenced by their concurrent affective hand movements," J. of Psychology, Vol.49, No.3, pp.221-230, 2008.
9 M. Courgeon, C. Clavel, N. Tan, and J. C. Martin, "Front View vs. Side View of Facial and Postural Expressions of Emotions in a Virtual Character," Springer Berlin Heidelberg, In Z. Pan, A. Cheok, & W. Muller (Eds.), Transactions on Edutainment VI, Vol.6758, pp.132-143, 2011.
10 C. Clavel, J. Plessier, J. C. Martin, L. Ach, and B. Morel, "Combining Facial and Postural Expressions of Emotions in a Virtual Character," Springer Berlin Heidelberg, In Z. Ruttkay, M. Kipp, A. Nijholt, & H. Vilhjalmsson (Eds.), Intelligent Virtual Agents, Vol.5773, pp.287-300, 2009.
11 R. Reisenzein, M. Studtmann, and G. Horstmann, "Coherence between Emotion and Facial Expression: Evidence from Laboratory Experiments," Emotion Review, Vol.5, No.1, pp.16-23, 2013.   DOI
12 H. K. Meeren, C. C. van Heijnsbergen, and B. de Gelder, "Rapid perceptual integration of facial expression and emotional body language," Proceedings of the National Academy of Sciences of the United States of America, Vol.102, No.45, pp.16518-16523, 2005.
13 M. A. H. Rot, K. Hogenelst, and C. M. Gesing, "Communal and agentic behaviour in response to facial emotion expressions," British Journal of Psychology, Vol.105, No.2, pp.173-186, 2014.   DOI
14 E. Gilboa-Schechtman and I. Shachar-Lavie, "More than a face: a unified theoretical perspective on nonverbal social cue processing in social anxiety," Frontiers in Human Neuroscience, Vol.7, No.904, pp.1-13, 2013.
15 M. Kipp and J. C. Martin, Gesture and Emotion: Can basic gestural form features discriminate emotions?, Affective Computing and Intelligent Interaction and Workshops, Amsterdam, 2009.
16 R. Plutchik, Emotions and Life Perspectives from Psychology, Biology, and Evolution, Translated by Park. K, Seoul: Hakjisa, 2004. (Original work published 2002).
17 S. Sumpeno, M. Hariadi, and M. H. Purnomo, "Facial emotional expressions of life-like character based on text classifier and fuzzy logic," IAENG International Journal of Computer Science, Vol.38, No.2, pp.122-133, 2011.
18 J. L. Tracy and R. W. Robins, "The nonverbal expression of pride: evidence for cross-cultural recognition," J. of personality and social psychology, Vol.94, No.3, pp.516-530, 2008.   DOI
19 이노미, "문화 간 비언어적 커뮤니케이션에서의 한국과 아시아 지역 손짓언어의 비교 연구," 커뮤니케이션학 연구, Vol.16, No.2, pp.5-34, 2008.
20 A. Bailey and S. Kelly, "Picture power: Gender versus body language in perceived status," J. of Nonverbal Behavior, Vol.39, No.4, pp.317-337, 2015.   DOI
21 A. S. Won, L. Yu, J. H. Janssen, and J. N. Bailenson, "Tracking Gesture to Detect Gender," International Society for Presence Research Annual Conference, Philadelphia, PA, USA, 2012.