Browse > Article
http://dx.doi.org/10.14695/KJSOS.2017.20.2.161

Neural-network based Computerized Emotion Analysis using Multiple Biological Signals  

Lee, Jee-Eun (Department of Medical Engineering, Yonsei University College of Medicine)
Kim, Byeong-Nam (Department of Medical Engineering, Yonsei University College of Medicine)
Yoo, Sun-Kook (Department of Medical Engineering, Yonsei University College of Medicine)
Publication Information
Science of Emotion and Sensibility / v.20, no.2, 2017 , pp. 161-170 More about this Journal
Abstract
Emotion affects many parts of human life such as learning ability, behavior and judgment. It is important to understand human nature. Emotion can only be inferred from facial expressions or gestures, what it actually is. In particular, emotion is difficult to classify not only because individuals feel differently about emotion but also because visually induced emotion does not sustain during whole testing period. To solve the problem, we acquired bio-signals and extracted features from those signals, which offer objective information about emotion stimulus. The emotion pattern classifier was composed of unsupervised learning algorithm with hidden nodes and feature vectors. Restricted Boltzmann machine (RBM) based on probability estimation was used in the unsupervised learning and maps emotion features to transformed dimensions. The emotion was characterized by non-linear classifiers with hidden nodes of a multi layer neural network, named deep belief network (DBN). The accuracy of DBN (about 94 %) was better than that of back-propagation neural network (about 40 %). The DBN showed good performance as the emotion pattern classifier.
Keywords
Emotion; Biological Signal; Restricted Boltzmann Machine (RBM); Multilayer Neural Network (MNN); Deep Belief Network (DBN);
Citations & Related Records
연도 인용수 순위
  • Reference
1 Chen, H., & Murray, A. F. (2003). Continuous Restricted Boltzmann Machine with an Implementable Training Algorithm. In Vision, Image and Signal Processing, IEEE Proceeding-, 150(3), 153-158.   DOI
2 Choi, W. (2011). A Classification Analysis of Negative Emotion Based on PPG Signal Using Fuzzy-Ga. master's thesis, Yonsei University, Seoul.
3 Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. G. (2001). Emotion Recognition in Human-Computer Interaction. Signal Processing Magazine, IEEE, 18(1), 32-80.   DOI
4 Guang-yuan, L., & Min, H. (2009). Emotion Recognition of Physiological Signals Based on Adaptive Hierarchical Genetic Algorithm. In 2009 World Congress on Computer Science and Information Engineering, 670-674.
5 Haag, A., Goronzy, S., Schaich, P., & Williams, J. (2004). Emotion Recognition Using Bio-Sensors: First Steps Towards an Automatic System. In Tutorial and Research Workshop on Affective Dialogue Systems, 36-48.
6 Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006). A Fast Learning Algorithm for Deep Belief Nets. Neural Computation, 18(7), 1527-1554.   DOI
7 Jerritta, S., Murugappan, M., Nagarajan, R., & Wan, K. (2011). Physiological Signals Based Human Emotion Recognition: A Review. In Signal Processing and its Applications (CSPA), 2011 IEEE 7th International Colloquium on, 410-415.
8 Khashman, A. (2008). A Modified Backpropagation Learning Algorithm with Added Emotional Coefficients. Neural Networks, IEEE Transactions on, 19(11), 1896-1909.   DOI
9 Kleinginna, P. R., & Kleinginna, A. M. (1985). Cognition and affect: A reply to Lazarus and Zajonc. American Psychologist, 40(4), 470-471.   DOI
10 Krause, R. (1987). Universals and Cultural Differences in the Judgments of Facial Expressions of Emotion. Journal of Personality and Social Psychology, 53(4), 712-717.   DOI
11 Lang, P. J. (1995). The Emotion Probe: Studies of Motivation and Attention. American Psychologist, 50(5), 372-385.   DOI
12 LeCun, Y., & Ranzato, M. (2013). Deep Learning Tutorial. In Tutorials in International Conference on Machine Learning (ICML13), Citeseer.
13 Lisetti, C. L., & Nasoz, F. (2004). Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological Signals. EURASIP Journal on Advances in Signal Processing, 11, 1-16.
14 Malik, M., & Camm, A. J. (1990). Heart Rate Variability. Clinical Cardiology, 13(8), 570-576.   DOI
15 Moretti, D. V., Babiloni, C., Binetti, G., Cassetta, E., Dal Forno, G., Ferreric, F., & Nobili, F. (2004). Individual Analysis of Eeg Frequency and Band Power in Mild Alzheimer's Disease. Clinical Neurophysiology, 115(2), 299-308.   DOI
16 Wang, D., & Shang, Y. (2013). Modeling Physiological Data with Deep Belief Networks. International of Journal Information and Education Technology (IJIET), 3(5), 505-511.
17 Murugappan, M., Ramachandran, N., & Sazali, Y. (2010). Classification of Human Emotion from Eeg Using Discrete Wavelet Transform. Journal of Biomedical Science and Engineering, 3, 390-396.   DOI
18 Niu, X., Chen, L., & Chen, Q. (2011). Research on Genetic Algorithm Based on Emotion Recognition Using Physiological Signals. In 2011 International Conference on Computational Problem-Solving, 614-618.
19 Peng, Y., Zhu, J.-Y., Zheng, W.-L., & Lu, B.-L. (2014). Eeg-Based Emotion Recognition with Manifold Regularized Extreme Learning Machine. In Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE, 974-977.
20 Schaaff, K., & Schultz, T. (2009). Towards Emotion Recognition from Electroencephalographic Signals. In 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, 1-6.