Browse > Article
http://dx.doi.org/10.9708/jksci.2015.20.2.047

A System for Extraction of Audience Reaction Based on Neural Network  

Baek, Yeong-Tae (Dept. of Smart Contents, Kimpo University)
You, Eun-Soon (Institute of Media Content, Dankook University)
Park, Seung-Bo (IUT, Inha University)
Abstract
Emotional reaction of audience can be decided by observing reaction of audience for content. We can use a method to analyze visual data from video camera to detect reaction of audience fast and economically. This paper proposes the method and system to observe audience reaction from visual data of audience and define via neural network. Also we propose a new method to detect automatically an area for audience reaction with face detection to improve a fixed area assignment method which has a limitation not to adapt depending on audiences. Additionally, the evaluation is implemented to show that the proposed method and system is effective. The proposed method showed the performance elevation of 10.5 % (7.75 hit ration) compared to a fixed area assignment method.
Keywords
Audience reaction; Neural network; Audience area; Performance; Face detection;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 S. G. Barsade, and D. E. Gibson, "Group emotion: A view from top and bottom," Research on Managing Groups and Teams, Stanford, CT: JAI Press, Vol.1, pp. 81-102, 1998.
2 J. M. Ryu, S.-B. Park, J. K. Kim, "A Study of the Reactive Movement Synchronization for Analysis of Group Flow," Journal of Intelligent Information System, Vol. 19, No. 1, pp. 79-94, March 2013.   DOI   ScienceOn
3 N. Ambady, and R. Rosenthal, "Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis," Psychological Bulletin, Vol. 111, No. 2, pp. 256-274, 1992.   DOI
4 M. Coulson, "Attributing emotion to static body postures: recognition accuracy, confusions, and viewpoint dependence," Journal of Nonverbal Behavior, Vol. 28, No. 2, pp. 117-139, 1992.   DOI
5 R. Laban, "Modern Educational Dance," Macdonald & Evans, 1968.
6 E. C. Ryoo, H. Ahn, J. K. Kim, "The Audience Behavior-based Emotion Prediction Model for Personalized Service," Journal of Intelligent Information System, Vol. 19, No. 2, pp. 73-85, June 2013.
7 M. K. Leung, and Y. H. Yang, "Human Body Motion Segmentation in A Complex Scene," Pattern Recognition, Vol. 20, pp. 55-64, 1987.   DOI   ScienceOn
8 J. S. Lee, and M. G. Lee, "A Study on Pattern Recognition using DCT and Neural Network," The Korean Institute of Communications and Information Sciences, Vol. 22, pp. 481-492, 1997.
9 J. W. Davis, "Appearance-Based Motion Recognition of Human Actions," Technical Report, MIT, 1996.
10 A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum-likelihood from incomplete data via the EM algorithm," Journal of the Royal Statistical Society, Series B, Vol. 39, No. 1, pp. 1-38, 1977.
11 Y. Zhu, Y. Huang, G. Xu, H. Ren, and Z. Wen, "Vision-based Interpretation of Hand Gestures by Modeling Appearance Changes in Image Sequences," Proceedings of MVA'98 IAPR Workshop on Machine Vision Applications, pp. 573-576, 1998.
12 M. Coulson, "Attributing emotion to static body postures: recognition accuracy, confusions, and viewpoint dependence," Journal of Nonverbal Behavior, Vol. 28, No. 2, pp. 117-139, 1992.   DOI
13 C. Lee, K. Um, and K. Cho, "Design of a Character's System to Express Mixed-Emotion by Gesture and Posture," The Proceedings of Spring on Korea Multimedia Society 2009, pp. 191-194, 2009.
14 W. S. McCulloch, and W. Pitts, "A Logical Calculus of the Ideas Immanent in Nervous Activity," The Bulletin of Mathematical Biophysics, Vol. 5, No. 4, pp. 15-33, 1943.   DOI
15 S.-B. Park, "The Controller Design for Truck Backer-Upper By ART2 Neural Network," Master Thesis, Inha University, February 1997.
16 Y. T. Baek, S.-B. Park, "Shot Type Detecting System using Face Detection," Journal of The Korea Society of Computer and Information, Vol. 17 No. 9, pp. 49-56, September 2012.   과학기술학회마을   DOI   ScienceOn
17 D. Kim, "Theory and Appication of Neutal Network," Hitech Information, 1993.
18 D. Hong, and W. Woo, "Emotional User Interface of Based on Augmented Reality for I2-NEXT," The Proceedings of Korea HCI Society 2005, pp. 96-101, 2005.
19 J.-G. Jeong, S.-S. Park, and D.-S. Jang, "Real-Time face detection using the Skin color and Haar-like feature," Journal of the Korea society of computer and information, Vol. 10, No. 4, pp. 113-121, September 2005.   과학기술학회마을
20 S.-B. Park, J. M. Ryu, J. K. Kim, "A Group Arousal Analysis Based on the Movement Synchronization of Audiences," Multimedia Tools and Applications, Online published, 2014.