Browse > Article
http://dx.doi.org/10.5143/JESK.2012.31.2.271

Classification of Three Different Emotion by Physiological Parameters  

Jang, Eun-Hye (BT Convergence Technology Research Department, Electronics and Telecommunications Research Institute)
Park, Byoung-Jun (BT Convergence Technology Research Department, Electronics and Telecommunications Research Institute)
Kim, Sang-Hyeob (BT Convergence Technology Research Department, Electronics and Telecommunications Research Institute)
Sohn, Jin-Hun (Department of Psychology/Brain Research Institute, Chungnam National University)
Publication Information
Journal of the Ergonomics Society of Korea / v.31, no.2, 2012 , pp. 271-279 More about this Journal
Abstract
Objective: This study classified three different emotional states(boredom, pain, and surprise) using physiological signals. Background: Emotion recognition studies have tried to recognize human emotion by using physiological signals. It is important for emotion recognition to apply on human-computer interaction system for emotion detection. Method: 122 college students participated in this experiment. Three different emotional stimuli were presented to participants and physiological signals, i.e., EDA(Electrodermal Activity), SKT(Skin Temperature), PPG(Photoplethysmogram), and ECG (Electrocardiogram) were measured for 1 minute as baseline and for 1~1.5 minutes during emotional state. The obtained signals were analyzed for 30 seconds from the baseline and the emotional state and 27 features were extracted from these signals. Statistical analysis for emotion classification were done by DFA(discriminant function analysis) (SPSS 15.0) by using the difference values subtracting baseline values from the emotional state. Results: The result showed that physiological responses during emotional states were significantly differed as compared to during baseline. Also, an accuracy rate of emotion classification was 84.7%. Conclusion: Our study have identified that emotions were classified by various physiological signals. However, future study is needed to obtain additional signals from other modalities such as facial expression, face temperature, or voice to improve classification rate and to examine the stability and reliability of this result compare with accuracy of emotion classification using other algorithms. Application: This could help emotion recognition studies lead to better chance to recognize various human emotions by using physiological signals as well as is able to be applied on human-computer interaction system for emotion recognition. Also, it can be useful in developing an emotion theory, or profiling emotion-specific physiological responses as well as establishing the basis for emotion recognition system in human-computer interaction.
Keywords
Emotion; Physiological signals; Classification; Discriminant analysis;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Miura, U., "The effect of variations in relative humidity upon skin temperature and sense of comfort", American Journal of Hygiene, 13, 432, 1931.
2 Nasoz, F., Alvarez, K., Lisetti, C. L. and Finkelstein, N., "Emotion recognition from physiological signals using wireless sensors for presence technologies", Cognition, Technology and Work, 6, 4-14, 2004.   DOI   ScienceOn
3 Peter, C. and Herbon, A., "Emotion representation and physiology assignments in digital systems", Interacting with Computers, 18, 139 -170, 2006.   DOI   ScienceOn
4 Picard, R. W., Vyzas, E. and Healey, J., "Toward Machine Emotional Intelligence: Analysis of Affective Physiological State", IEEE Transactions of Pattern Analysis and Machine Intelligence, 23(10), 2001.
5 Rainville, P., Carrier, B., Hofbauer, R. K., Bushnell, M. C. & Duncan, G. H., "Dissociation of sensory and affective dimensions of pain using hypnotic modulation", Pain, 82, 159-171, 1999.   DOI   ScienceOn
6 Sohn, J. H., Sokhadze, E. and Watanuki, S., "Eletrodermal and cardiovascular manifestations of emotions in children", Journal of Physiological Anthropology and Applied Human Science, 55-64, 2001.
7 Sokolov, E. N., "The orienting response, and future directions of its development", The Pavlovian Journal of Biological Science, 25, 142 -150, 1990.
8 Sternbach, R. A., The Psychology of Pain, Raven Press, New York, 1978.
9 Storm, H., "Changes in skin conductance as a tool to monitor nociceptive stimulation and pain", Current Opinion in Anaesthesiology, 21, 796 -804, 2008.   DOI   ScienceOn
10 Sylvia D. Kreibig, "Autonomic Nervous System Activity in Emotion: A Review", Biological Psychology, 2010.
11 Tefas, A., Kotropoulos, C. and Pitas, I., "Using support vector machines to enhance the performance of elastic graph matching for frontal face authentication", IEEE Transactions of Pattern Analysis and Machine Intelligence, 23(7), 735-746, 2001.   DOI   ScienceOn
12 Harrison, L. K., Carroll, D., Burns, V. E., Corkill, A. R., Harrison, C. M., Ring, C. and Drayson, M., "Cardiovascular and secretory immunoglobulin A reactions to humorous, exciting, and didactic film presentations", Biological Psychology, 52, 113-126, 2000.   DOI   ScienceOn
13 Hassett, J., A primer of psychophysiology, San Francisco: W. H. Freeman and Company, 1978.
14 Helson, H. and Quantius, L., "Changes in skin temperature following intense stimulation", Journal of Experimental Psychology, 77, 20, 1934.
15 Jolliffe, C. D. and Nicholas, M. K., "Verbally reinforcing pain reports: an experimental test of the operant model of chronic pain", Pain, 107(1-2), 167-175, 2004.   DOI   ScienceOn
16 Kim, K., Bang, S. and Kim, S., "Emotion recognition system using shortterm monitoring of physiological signals", Medical and Biological Engineering and Computing, 42, 419-427, 2004.   DOI   ScienceOn
17 Leary, M. R., Rogers, P. A., Canfield, R. W. and Coe, C., "Boredom in interpersonal encounters: Antecedents and social implications", Journal of Personality and Social Psychology, 51, 968-975, 1986.   DOI
18 Lee, S. J. and Bai, S. J., "New Trend of Pain Evaluation by Brain Imaging Devices", Korean Journal of the Science of Emotion and Sensibility, 8(4), 365-374, 2005.   과학기술학회마을
19 Lerner, J. S. and Keltner, D, "Beyond valence: Toword a model of emotion-specific influences of judgment and choice", Cognition & Emotion, 14, 473-493, 2000.   DOI   ScienceOn
20 Levenson, R. W., Ekman, P. and Friesen W. V., "Voluntary facial action generates emotion-specific autonomic nervous system activity. Psychophysiology", 27, 363-384, 1990.   DOI   ScienceOn
21 Mannheimer, J. S. and Lampe, N., Clinical transcutaneous electrical nerve stimulation, FA Davis, Philadelphia. 1984.
22 Merskey, H. and Bogduk, N., Classification of Chronic Pain, IASP Task Force on Taxonomy. Seattle, IASP Press, 1994.
23 Chapman, C. R., Nakamura, Y., Donaldson, G. W., Jaconson, R. C., Bradshaw, D. H., Flores, L. and Chpman, C. N., "Sensory and Affective Dimensions of Phasic Pain Are Indistinguishable in the Self-Report and Psychophysiology of Normal Laboratory Subjects", The Journal of Pain, 2(5), 279-294, 2001.   DOI   ScienceOn
24 Cheyne, J. A., Carriere, J. S. A. and Smilek, D., "Absent-mindedness: Lapses in conscious awareness and everyday cognitive failures", Consciousness and Cognition, 15 (3), 578-592, 2006.   DOI   ScienceOn
25 Choi, A. and Woo, W., "Feature extraction for emotion analysis based on physiological signal", KHCI 2005, 1(pp. 624-629), 2005.
26 Coon, D., Introduction to Psychology: Gateways to Mind and Behavior (10th Edi.), Philadelphia: Thomson Wadsworth, 2004.
27 Duda, R. O., Hart, P. E. and Stork, D. G., Pattern Classification, 2nd ed., Wiley-Interscience, 2000.
28 Ekman, P., Levenson, R. W. and Friesen, W. V., "Autonomic nervous system activity distinguishes among emotions", Science, 221, 1208-1210, 1983.   DOI
29 Eom, J. S., Park, H. J., Noh, J. H. and Sohn, J. H., "Cardiovascular response to surprise stimulus", Korean Journal of the Science of Emotion and Sensibility, 14(1), 147-156, 2011.   과학기술학회마을
30 Ekman, P. and Friesen, W. V., Unmasking the face, Englewood Cliffs, NJ: Prentice Hall, Inc., 1975.
31 Allen, R. A. and Mills, G. K., "The effects of unilateral plethysmographic feedback of temporal artery activity during migraine head pain", Journal of Psychosomatic Research, 26, 133-140, 1982.   DOI   ScienceOn
32 Fisher, C. D., "Boredom at work: A neglected concept", Human Relations, 46, 395-417, 1993.   DOI
33 Flor, H., Knost, B. and Birbaumer, N., "The role of operant conditioning in chronic pain: an experimental investigation Pain", Pain, 95(1-2), 111-118, 2002.   DOI
34 Gunes, H. and Piccardi, M., "Affect Recognition from Face and Body: Early Fusion vs. Late Fusion", IEEE Transactions on Systems, Man, and Cybernetics, 1-7, 2007.
35 Arroyo-Palacios, J. and Romano, D. M., "Towards a standardization in the use of physiological signals for affective recognition systems", Proceedings of Measuring Behavior 2008, 2008.
36 Chanel, G., Kierkels, J. J. M., Soleymani, M. and Pun, T., "Short-term emotion assessment in a recall paradigm", International Journal of Human-Computer Studies, 67, 607-627, 2009.   DOI   ScienceOn
37 Bowsher, D., "Physiology and Pathophysiology of Pain", Journal of British Medical Acupuncture Society, 7, 17-20, 1990.   DOI
38 Broek, van den E. L., Janssen, J. H. and Westerink, J. H. D. M., "Guidelines for Affective Signal Processing (ASP): From Lab to Life", 3rd International Conference on Affective Computing & Intelligent Interaction, 2009.