Browse > Article
http://dx.doi.org/10.5302/J.ICROS.2007.13.9.832

Emotion Recognition Method using Gestures and EEG Signals  

Kim, Ho-Duck (중앙대학교 전자전기공학부)
Jung, Tae-Min (중앙대학교 전자전기공학부)
Yang, Hyun-Chang (중앙대학교 전자전기공학부)
Sim, Kwee-Bo (중앙대학교 전자전기공학부)
Publication Information
Journal of Institute of Control, Robotics and Systems / v.13, no.9, 2007 , pp. 832-837 More about this Journal
Abstract
Electroencephalographic(EEG) is used to record activities of human brain in the area of psychology for many years. As technology develope, neural basis of functional areas of emotion processing is revealed gradually. So we measure fundamental areas of human brain that controls emotion of human by using EEG. Hands gestures such as shaking and head gesture such as nodding are often used as human body languages for communication with each other, and their recognition is important that it is a useful communication medium between human and computers. Research methods about gesture recognition are used of computer vision. Many researchers study Emotion Recognition method which uses one of EEG signals and Gestures in the existing research. In this paper, we use together EEG signals and Gestures for Emotion Recognition of human. And we select the driver emotion as a specific target. The experimental result shows that using of both EEG signals and gestures gets high recognition rates better than using EEG signals or gestures. Both EEG signals and gestures use Interactive Feature Selection(IFS) for the feature selection whose method is based on a reinforcement learning.
Keywords
Electroencephalographic(EEG); gesture; emotion recognition; Interactive Feature Selection(IFS);
Citations & Related Records
연도 인용수 순위
  • Reference
1 M. D. Korhonen, and D. A. Clausi, 'Modeling emotional content of nusic using system identification,' IEEE Transactions on Systems, Man, and Cybernetics- Part B: Cybernetics, vol. 36, no 3, June, 2002
2 Z. Zeng, J. Tu, M. Liu, T. S. Huang, B. Pianfetti, Dan Roth, and Stephen Levinson, 'Audio-visual affect recognition,' IEEE Transactions on Multimedia, vol. 9, no 2, February 2007
3 J. A. Russell, 'Evidence of convergent validity on the dimensions of affect,' Journal of Personality and Social Psychology. 36. 1152-1168   DOI
4 P. Ekman, 'Universals and cultural differences in facial expressions of emotion,' In J. Cole (Ed.), Nebraska Symposium on Motivation 1971. 19. 207-283. Lincoln, NE: University of Nebraska Press
5 Kazuhiko, Takahashi, 'Remarks on emotion recognition from Multi-modal Bio-potential signal,' IEEE International Conference on Industrial Technology(ICIT), 2004
6 R. W. Picard. AFFECTIVE COMPUTING. The MIT PRESS. 1997
7 양현창, 김호덕, 박창현, 심귀보 '감정인식을 위한 Interactive Feature Selection(IFS) 알고리즘,' 퍼지 및 지능정보시스템 학회 논문지, vol 16, no 6, pp 647-652, 2006
8 A. C. Merzagora, S. Bunce, M. Izzetoglu, and B. Onaral, 'Wavelet analysis for EEG feature extraction in deception detection,' Proc. of the 28th IEEE EMBS Annual International Conference, USA, August 2006
9 E. D. Ubeyli, 'Fuzzy similarity index for discrimination of EEG signals,' Proc. of the 28th IEEE EMBS Annual International Conference, USA, August 2006
10 S. Shigemura, T. Nishimura, M. tsubai, and H. yokoi, 'An investigation of EEG artifacts elimination using a neural network with Non-recursive 2nd order volterra filters,' Proc. of the 26th IEEE EMBS Annual International Conference, USA, September 2004
11 H. Adeli, Samanwoy Ghosh-Dastidar, and Nahid Dadmehr, 'A wavelet-Chaos methodology for anlysis of EEGs and EEG subbands to detect seizure and epilepsy,' IEEE Transactions on Biomedical Engineering, vol. 54, no. 2, February 2007
12 M. Ishikawa and N. Sasaki, 'Gesture recognition based on SOM using multiple sensors,' Proc. of the 9th International Conference on Neural Information Processing, vol. 3, pp 1300-1304, November 2002
13 R. S. Sutton and A. G. Barto, Reinforcement Learning : An Introduction, A bradford book, London, 1998