Browse > Article
http://dx.doi.org/10.4218/etrij.13.0112.0751

Design of Prototype-Based Emotion Recognizer Using Physiological Signals  

Park, Byoung-Jun (IT Convergence Technology Research Laboratory, ETRI)
Jang, Eun-Hye (IT Convergence Technology Research Laboratory, ETRI)
Chung, Myung-Ae (Creative Future Research Laboratory, ETRI)
Kim, Sang-Hyeob (IT Convergence Technology Research Laboratory, ETRI)
Publication Information
ETRI Journal / v.35, no.5, 2013 , pp. 869-879 More about this Journal
Abstract
This study is related to the acquisition of physiological signals of human emotions and the recognition of human emotions using such physiological signals. To acquire physiological signals, seven emotions are evoked through stimuli. Regarding the induced emotions, the results of skin temperature, photoplethysmography, electrodermal activity, and an electrocardiogram are recorded and analyzed as physiological signals. The suitability and effectiveness of the stimuli are evaluated by the subjects themselves. To address the problem of the emotions not being recognized, we introduce a methodology for a recognizer using prototype-based learning and particle swarm optimization (PSO). The design involves two main phases: i) PSO selects the P% of the patterns to be treated as prototypes of the seven emotions; ii) PSO is instrumental in the formation of the core set of features. The experiments show that a suitable selection of prototypes and a substantial reduction of the feature space can be accomplished, and the recognizer formed in this manner is characterized by high recognition accuracy for the seven emotions using physiological signals.
Keywords
Emotion recognition; physiological signal; prototypes; feature selection; particle swarm optimization;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 E.L. Meerwijk and S.J. Weiss, "Toward a Unifying Definition of Psychological Pain," J. Loss Trauma, vol. 16, no. 5, 2011, pp. 402-412.   DOI   ScienceOn
2 J. Wagner, J. Kim, and E. Andre, "From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification," IEEE Int. Conf. Multimedia Expo, Amsterdam, July 2005, pp. 940-943.
3 N. Sebe, I. Cohen, and T.S. Huang, "Multimodal Emotion Recognition," Handbook of Pattern Recognition and Computer Vision, Amsterdam: Publications of the Universiteit van Amsterdam, 2005.
4 L. Li and J. Chen, "Emotion Recognition Using Physiological Signals," ICAT, 2006, pp. 437-446.
5 S.D. Kreibig, "Autonomic Nervous System Activity in Emotion: A Review," Bio. Psychology, vol. 84, 2010, pp. 394-421.   DOI   ScienceOn
6 T. Verhoef et al., "Bio-sensing for Emotional Characterization without Word Labels," 13th Int. Conf. Human-Comput. Interaction: Ambient, Ubiquitous, Intell. Interaction, San Diego, CA, USA, July 2009, pp. 693-702.
7 B.-J. Park et al., "Seven Emotion Recognition by Means of Particle Swarm Optimization on Physiological Signals," Proc. 9th IEEE Int. Conf. Netw., Sensing, Control, 2012, pp. 277-282.
8 C. Maaoui and A. Pruski, "Emotion Recognition through Physiological Signals for Human-Machine Communication," Cutting Edge Robotics 2010, Vedran Kordic, Ed., 2010, pp. 317-322.
9 C.L. Stephens, I.C. Christie, and B.H. Friedman, "Autonomic Specificity of Basic Emotions: Evidence from Pattern Classification and Cluster Analysis," Bio. Psychology, vol. 84, 2010, pp. 463-473.   DOI   ScienceOn
10 E.-H. Jang et al., "Emotion Recognition by Machine Learning Algorithms Using Psychophysiological Signals," Int. J. Eng. Industries, vol. 3, no. 1, 2012, pp. 55-66.   DOI
11 C.M. Bishop, Neural Networks for Pattern Recognition, New York: Oxford University Press Inc., 1995.
12 J. Kennedy, "The Particle Swarm: Social Adaptation of Knowledge," Proc. IEEE Int. Conf. Evolutionary Comput., 1997, pp. 303-308.
13 K.E. Parsopoulos and M.N. Vrahatis, "On the Computation of All Global Minimizers through Particle Swarm Optimization," IEEE Trans. Evolutionary Comput., vol. 8, 2004, pp. 211-224.   DOI   ScienceOn
14 C.L. Huang and C.J. Wang, "A GA-Based Feature Selection and Parameters Optimization for Support Vector Machines," Expert Syst. Appl., vol. 31, 2006, pp. 231-240.   DOI   ScienceOn
15 H. Cheng et al., "Conditional Mutual Information-Based Feature Selection Analyzing for Synergy and Redundancy," ETRI J., vol. 33, no. 2, Apr. 2011, pp. 210-218.   DOI   ScienceOn
16 J.X. Huang et al., "Feature-Based Relation Classification Using Quantified Relatedness Information," ETRI J., vol. 32, no. 3, June 2010, pp. 482-485.   DOI   ScienceOn
17 D.W. Aha, D. Kibler, and M.K. Albert, "Instance-Based Learning Algorithms," Machine Learning, vol. 6, 1991, pp. 37-66.
18 D. Palomba et al., "Cardiac Responses Associated with Affective Processing of Unpleasant Film Stimului," Int. J. Psychophysiology, vol. 36, 2000, pp. 45-57.   DOI   ScienceOn
19 A. Gorini and G. Riva, "The Potential of Virtual Reality as Anxiety Management Tool: A Randomized Controlled Study in a Sample of Patients Affected by Generalized Anxiety Disorder," Trials, vol. 9, 2008, pp. 1-9.   DOI   ScienceOn
20 C. Gonzalez and V. Dutt, "Instance-Based Learning: Integrating Sampling and Repeated Decisions from Experience," Psychological Rev., vol. 118, 2011, pp. 523-551.   DOI   ScienceOn
21 J.J. Gross and R.W. Levenson, "Emotion Elicitation Using Films," Cognition Emotion, vol. 9, 1995, pp. 87-108.   DOI   ScienceOn
22 J. Arroyo-Palacios and D.M. Romano, "Towards a Standardization in the Use of Physiological Signals for Affective Recognition Systems," Proc. Meas. Behavior, Aug. 2008, pp. 121-124.
23 M. Toichi et al., "The Influence of Psychotic States on the Autonomic Nervous System in Schizophrenia," Int. J. Psychophysiology, vol. 31, 1999, pp. 147-154.   DOI   ScienceOn
24 M.A. Abido, "Optimal Design of Power-System Stabilizers Using Particle Swarm Optimization," IEEE Trans. Energy Conversion, vol. 17, 2002, pp. 406-413.   DOI   ScienceOn
25 B. Liu et al., "Improved Particle Swarm Optimization Combined with Chaos," Chaos, Solitons, Fractals, vol. 25, 2005, pp. 1261-1271.   DOI   ScienceOn
26 A.E. Yilmaz and M. Kuzuoglu, "Calculation of Optimized Parameters of Rectangular Microstrip Patch Antenna Using Particle Swarm Optimization," Microw. Opt. Technol. Lett., vol. 49, 2007, pp. 2905-2907.   DOI   ScienceOn
27 Z.L. Gaing, "A Particle Swarm Optimization Approach for Optimum Design of PID Controller in AVR System," IEEE Trans. Energy Conversion, vol. 19, 2004, pp. 384-391.   DOI   ScienceOn
28 R. Eberhart and Y. Shi, "Particle Swarm Optimization: Developments, Applications and Resources," Proc. IEEE Int. Conf. Evolutionary Comput., 2001, pp. 81-86.
29 W.-Y. Loh, "Classification and Regression Trees," Wiley Interdisciplinary Rev: Data Mining Knowl. Discovery, vol. 1, 2011, pp. 14-23.   DOI
30 J.M. Keller, M.R. Gray, and J.A. Givens, Jr., "A Fuzzy K-Nearest Neighbor Algorithm," IEEE Trans. Syst., Man, Cybern., vol. 15, no. 4, 1985, pp. 580-585.
31 J.R. Quinlan, C4.5: Programs for Machine Learning, San Mateo, CA: Morgan Kaufmann, 1992.
32 R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, 2nd ed., New York: Wiley-Interscience, 2000.
33 M.M Van Hulle, "Self-Organizing Maps," Handbook of Natural Computing: Theory, Experiments, and Applications, Springer-Verlag, 2010.