Browse > Article
http://dx.doi.org/10.5391/JKIIS.2007.17.3.322

Emotion Recognition Method using Physiological Signals and Gestures  

Kim, Ho-Duck (중앙대학교 전자전기공학부)
Yang, Hyun-Chang (중앙대학교 전자전기공학부)
Sim, Kwee-Bo (중앙대학교 전자전기공학부)
Publication Information
Journal of the Korean Institute of Intelligent Systems / v.17, no.3, 2007 , pp. 322-327 More about this Journal
Abstract
Researchers in the field of psychology used Electroencephalographic (EEG) to record activities of human brain lot many years. As technology develope, neural basis of functional areas of emotion processing is revealed gradually. So we measure fundamental areas of human brain that controls emotion of human by using EEG. Hands gestures such as shaking and head gesture such as nodding are often used as human body languages for communication with each other, and their recognition is important that it is a useful communication medium between human and computers. Research methods about gesture recognition are used of computer vision. Many researchers study emotion recognition method which uses one of physiological signals and gestures in the existing research. In this paper, we use together physiological signals and gestures for emotion recognition of human. And we select the driver emotion as a specific target. The experimental result shows that using of both physiological signals and gestures gets high recognition rates better than using physiological signals or gestures. Both physiological signals and gestures use Interactive Feature Selection(IFS) for the feature selection whose method is based on a reinforcement learning.
Keywords
Interactive Feature Selection(IFS); EEG;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Ekman, P, 'Universals and cultural differences in facial expressions of emotion,' Int. J. Cole (Ed,), Nebraska Symposium on Motivation 1971. 19. 207-283. Lincoln, NE: University of Nebraska Press
2 Hojjat Adeli, Samanwoy Ghosh-Dastidar, Nahid Dadmelr, 'A wavelet-Chaos Methodology for Analysis of EEGs and EEG Subbands to Detect Seizure and Epilepsy,' IEEE Transactions on Biomedical Engineering, Vol. 54, no. 2, February 2007
3 R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, A bradford book, London, 1998
4 Zhihong Zeng, Jilin Tu, Ming Liu, Thomas S. Huang, Brian Pianfetti, Dan Roth, and Stephen Levinson, 'Audio-Visual Affect Recognition,' IEEE Transactions on Multimedia, Vol. 9, No 2, February, 2007
5 Russell, J.A., 'Evidence of convergent validity on the dimensions of affect,' Journal of Personality and Social Psychology, 36, 1152-1168   DOI
6 Anna Caterina Merzagora, Scott Bunce, Meltem Izzetoglu, Banu Onaral, 'Wavelet analysis for EEG feature extraction in deception detection,' Proc. of the 28th IEEE EMBS Annual International Conference, USA, August 2006
7 Mark D. Korhonen, and David A. Clausi, 'Modeling Emotional Content of Nusic Using System Identification,' IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybemetics, Vol. 36, No 3, June, 2002
8 R. W. Picard. AFFECTIVE COMPUTING. The MIT PHESS, 1997
9 양현창, 김호덕, 박창현, 심귀보, '감정인식을 위한 Interactive Feature Selection(IFS) 알고리즘,' 퍼지 및 지능정보시스템학회 논문지, 제16권, 제6호, pp 647-652, 2006   과학기술학회마을   DOI
10 Shusaxu shigemura, Toshihiro Nishimura, Masayoshi tsubai, Hirokazu yokoi, 'An Investigation of EEG Artifacts Elimination using a Neural Network with Non-recursive 2nd order Volterra filters,' Proc. of the 286th IEEE EMBS Annual International Conference, USA, September 2004
11 Masumi Ishikawa and Naohiro Sasaki, 'Gesture Recognition based on SOM using Multiple Sensors,' Proc. of the 9th International Conference on Neural Information Processing, Vol. 3, pp 1300-1304, November, 2002
12 Elif Dcrya Ubeyli, 'Fuzzy Similarity Index For Discrimination Of EEG Signals,' Proc. of the 28th IEEE EMBS Annual International Conference, USA, August 2006
13 Kazuhiko, Takahashi, 'Remarks on Emotion Recognition from Multi-Modal Bio-Potential Signal,' IEEE International Conference on Industrial Technology(ICIT), 2004