Browse > Article

The interaction between emotion recognition through facial expression based on cognitive user-centered television  

Lee, Jong-Sik (성균관대학교 인터렉션사이언스학과)
Shin, Dong-Hee (성균관대학교 인터렉션사이언스학과)
Publication Information
Journal of the HCI Society of Korea / v.9, no.1, 2014 , pp. 23-28 More about this Journal
Abstract
In this study we focus on the effect of the interaction between humans and reactive television when emotion recognition through facial expression mechanism is used. Most of today's user interfaces in electronic products are passive and are not properly fitted into users' needs. In terms of the user centered device, we propose that the emotion based reactive television is the most effective in interaction compared to other passive input products. We have developed and researched next generation cognitive TV models in user centered. In this paper we present a result of the experiment that had been taken with Fraunhofer IIS $SHORE^{TM}$ demo software version to measure emotion recognition. This new approach was based on the real time cognitive TV models and through this approach we studied the relationship between humans and cognitive TV. This study follows following steps: 1) Cognitive TV systems can be on automatic ON/OFF mode responding to motions of people 2) Cognitive TV can directly select channels as face changes (ex, Neutral Mode and Happy Mode, Sad Mode, Angry Mode) 3) Cognitive TV can detect emotion recognition from facial expression of people within the fixed time and then if Happy mode is detected the programs of TV would be shifted into funny or interesting shows and if Angry mode is detected it would be changed to moving or touching shows. In addition, we focus on improving the emotion recognition through facial expression. Furthermore, the improvement of cognition TV based on personal characteristics is needed for the different personality of users in human to computer interaction. In this manner, the study on how people feel and how cognitive TV responds accordingly, plus the effects of media as cognitive mechanism will be thoroughly discussed.
Keywords
Emotion based on Reactive TV; Emotion Recognition through Facial Expression; Cognitive TV;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Nakano, T., Ando, H., Ishizu, H., Morie, T., &Iwata, A. "Coarse image region segmentation using resistive-fuse networks implemented in FPGA." 7th World Multiconference on Systemics, Cybernetics and Informatics. Vol. 4, pp. 186-191. 2003.
2 T.Nakano, T.Morie,and A.Iwata "A Face/Object Recognition System Using FPGA Implementation of Carse Region Segmentation. (SICE Annual Conference in Fukui, Fukui University, Japan, 2003.
3 Morizet, N., Amiel, F., Hamed, I. D., &Ea, T. "A comparative implementation of PCA face recognition algorithm." Electronics, Circuits and Systems, 2007. ICECS 2007. 14th IEEE International Conference on. IEEE, pp. 865-868. 2007.
4 Sannella, Michael John. Constraint satisfaction and debugging for interactive user interfaces. Diss. University of Washington, 1994.
5 Morizet, N., Amiel, F., Hamed, I. D., &Ea, T. "A comparative implementation of PCA face recognition algorithm." Electronics, Circuits and Systems, 2007. ICECS 2007. 14th IEEE International Conference on. IEEE, p. 865-868. 2007.
6 Sharma, Sudhir, and Wang Chen. "Using modelbased design to accelerate FPGA development for automotive applications." The MathWorks (2009).
7 Madi, R., Lahoud, R., Sawan, B., &Saghir, M. "Face Recognition on FPGA." Spring Term Report, EECE 501 (2006).
8 Veloso, M. Pinkal H. Uszkoreit M., W. Wahlster, and M. J. Wooldridge. "Cognitive Technologies." 2007.
9 Stork, Hans-Georg. "Towards a Scientific Foundation for Engineering Cognitive Systems-an interim report." 2007.
10 Dan BurnsAir Force Research Laboratory (AFRL) FPGA Hardware Acceleration of DNA Code Library Design (and Cognitive Models)2008.
11 Farabet, Cl　ment, Cyril Poulet, and Yann LeCun. "An fpga-based stream processor for embedded real-time vision with convolutional networks." Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference on. pp. 878-885, IEEE, 2009.
12 Jiang, Jintao, et al. "On the relationship between face movements, tongue movements, and speech acoustics." EURASIP Journal on Applied Signal Processing 11, pp. 1174-1188. 2002
13 Oviatt, Sharon. "Human-centered design meets cognitive load theory: designing interfaces that help people think." Proceedings of the 14th annual ACM international conference on Multimedia. pp 871-880. 2006.
14 So, Hayden Kwok-Hay, and Robert Brodersen. "A unified hardware/software runtime environment for FPGA-based reconfigurable computers using BORPH." ACM Transactions on Embedded Computing Systems (TECS) 7.2. 14 2008
15 Deivamani, M., R. Baskaran, and P. Dhavachelvan. "Improving Emotion Recognition with a Learning Multi-agent system." Department of Computer Science &Engineering, Anna University, Chennai, India
16 Vogt, Thurid, and Elisabeth Andr. "Improving automatic emotion recognition from speech via gender differentiation." Proc. Language Resources and Evaluation Conference (LREC 2006), Genoa. 2006.
17 Stephen M. Fiore, Ph.D. Editor, Cognitive Technology http://www.cognitivetechnologyjournal.com/Default.aspx.html Apr.20 .2014
18 Richard E. Mayer and Roxana Moreno University of California, Santa Barbara "A Cognitive Theory of Multimedia Learning: Implications for Design Principles." 2000
19 Jim Sullivan University of Colorado 2003 http://portal.acm.org/citation.cfm?id=957205.957232.html Apr.23 2014
20 Chapter 11: Cognitive Theory http://allpsych.com/personalitysynopsis/cognitive.html Apr.23 2014
21 Social cognitive theory http://en.wikipedia.org/wiki/Social_cognitive_theory.html Apr.23 2014
22 Fraunhofer IIS $SHORE^{TM}$ http://www.iis.fraunhofer.de/bf/bsy/produkte/shore/.html Apr.25 2014
23 Pao Chung and Chao "Face recognition system based on front-end facial feature extraction using FPGA." 2009
24 Sex-related differences in spatial cognition http://en.wikipedia.org/wiki/Sex-related_differences_in_spatial_cognition. html Apr.23 2014