Browse > Article

Posture features and emotion predictive models for affective postures recognition  

Kim, Jin-Ok (대구한의대학교 국제문화정보대학 모바일콘텐츠학부)
Publication Information
Journal of Internet Computing and Services / v.12, no.6, 2011 , pp. 83-94 More about this Journal
Abstract
Main researching issue in affective computing is to give a machine the ability to recognize the emotion of a person and to react it properly. Efforts in that direction have mainly focused on facial and oral cues to get emotions. Postures have been recently considered as well. This paper aims to discriminate emotions posture by identifying and measuring the saliency of posture features that play a role in affective expression. To do so, affective postures from human subjects are first collected using a motion capture system, then emotional features in posture are described with spatial ones. Through standard statistical techniques, we verified that there is a statistically significant correlation between the emotion intended by the acting subjects, and the emotion perceived by the observers. Discriminant Analysis are used to build affective posture predictive models and to measure the saliency of the proposed set of posture features in discriminating between 6 basic emotional states. The evaluation of proposed features and models are performed using a correlation between actor-observer's postures set. Quantitative experimental results show that proposed set of features discriminates well between emotions, and also that built predictive models perform well.
Keywords
Affective Computing; Posture recognition; Emotion Recognition; Discriminant Analysis; Motion Capture System; Posture features;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 R. J. Neagle, K. C. Ng, R. A. Ruddle, Studying the fidelity requirements for a virtual ballet dancer, In Proceedings of Vision, Video and Graphics Conference (VVG2003), pp. 181-188, 2003.
2 F. E. Pollick, H. Patterson, A. Bruderlin, A. J. Sanford, Perceiving affect from arm movement, Cognition, Vol. 82, pp.51-61, 2001.   DOI   ScienceOn
3 W. Woo, J. Park, Y. Iwadate, Emotion analysis from dance performance using time-delay neural networks, Proceedings of the JCIS-CVPRIP''00, Vol. 2, pp. 374-377, 2000.
4 R. von Laban, The Mastery of Movement, Plays Inc., 1971.
5 E. Back, T. R. Jordan, S. M. Thomas, The recognition of mental states from dynamic and static facial expressions, Visual Cognition, Vol. 17, No. 8 pp. 1271-1286, 2009.   DOI   ScienceOn
6 Z. Zeng, M. Pantic, G. Roisman, T. Huang, A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 31, No. 1, pp, 39-48, 2009.   DOI
7 M. Minsky, The Society of Mind, Simaon and Shuster, New York, 1985.
8 M. Minsky, The Eomotion Machine: Commonsense Thinking, Artificial Intelligence and the Future of the Human Mind, Simon and Schuster, New York, 2006.
9 P. Ekman, An argument for basic emotions. Cognition and Emotion, pp. 169-2000, 1992.
10 J. A. Panksepp, A critical role for effective neuron science in resolving what is basic about basic emotion. Psychological Review, pp 554-560, 1992.
11 S. Kimihiro, N. Kenichi, Useful information for face perception is described with FACS. Journal of Nonverbal Behavior, Vol. 27, pp. 43-55, 2003.   DOI   ScienceOn
12 김진옥, 사용자 행동 자세를 이용한 시각계 기반의 감정 인식 연구, 한국정보처리학회논문지 B, 제 18-B권, 5호, pp. 1-10, 2011.
13 M. M. Coulson, Attributing emotion to static body postures: recognition accuracy, confusions and viewpoint dependence, Journal of Nonverbal Behavior, Vol. 28, No. 2, pp. 117-139, 2004.   DOI
14 S. Mota, R. Picard, Automated posture analysis for detecting Learner's Interest Level, Proceedings of the IEEE Workshop on Computer Vision and Pattern Recognition for Human Computer Interaction, pp. 49-50, 2003.
15 J. A. Beintema, M. Lappe, Perception of biological motion without local image motion. Proceedings of the National Academy of Sciences, Vol. 99, pp. 5661-5663, 2002.   DOI   ScienceOn
16 M. Coulson, Attributing emotion to static body postures : Recognition accuracy, Confusions and viewpoint dependence, Journal of Nonverbal Behavior, Vol. 28, No. 2, pp. 117-139, 2004.
17 P. Fagerberg, A. Stahl, K. Hook, Designing gestures for affective input: an analysis of shape, effort and valence, Proceedings of the National Academy of Science, Vol. 102, No. 45, pp. 16518-16523, 2005.   DOI   ScienceOn
18 Salovey, J.D. Mayer, Emotional Intelligence, Imagination, Cognition and Personality, Vol. 9, No. 3, pp. 185-211, 1990.
19 R. W. Picard, Affective Computing, MIT Press, 2000M. Pantic, Toward an Affect- Sensitive Multimodal Human-Computer Interaction, Proc, of the IEEE, Vol. 91, No. 9, 2003.
20 H. M. Paterson, F. E. Pollick, A. J. Sanford, The role of velocity in affect discrimination. In Proceedings of the Twenty-third Annual Conference of the Cognitive Science Society, 2000.
21 A. Vinciarelli, M. Pantic, H. Bourlard, A. Pentland, Social Signal Processing : State-of-the Art and Future Perspectives of an Emerging Domain, Proceedings of the ACM International Conference on Multimedia, pp. 1061-1070, 2008.
22 B. de Gelder, j. Snyder, G. Gerard, N. Hadjikhani, Fear fosters fight: A mechanism for fear contagion when perceiving emotion expressed by a whole body, Proceedings of the National Academy of Science, Vol. 101, No. 47, pp. 16701-16706, 2003.