• International Journal of Contents
• /
• v.18 no.3
• /
• pp.11-20
• /
• 2022

Human Emotion Recognition is an exciting topic that has been attracting many researchers for a lengthy time. In recent years, there has been an increasing interest in exploiting contextual information on emotion recognition. Some previous explorations in psychology show that emotional perception is impacted by facial expressions, as well as contextual information from the scene, such as human activities, interactions, and body poses. Those explorations initialize a trend in computer vision in exploring the critical role of contexts, by considering them as modalities to infer predicted emotion along with facial expressions. However, the contextual information has not been fully exploited. The scene emotion created by the surrounding environment, can shape how people perceive emotion. Besides, additive fusion in multimodal training fashion is not practical, because the contributions of each modality are not equal to the final prediction. The purpose of this paper was to contribute to this growing area of research, by exploring the effectiveness of the emotional scene gist in the input image, to infer the emotional state of the primary target. The emotional scene gist includes emotion, emotional feelings, and actions or events that directly trigger emotional reactions in the input image. We also present an attention-based fusion network, to combine multimodal features based on their impacts on the target emotional state. We demonstrate the effectiveness of the method, through a significant improvement on the EMOTIC dataset.

• Science of Emotion and Sensibility
• /
• v.20 no.2
• /
• pp.161-170
• /
• 2017

Emotion affects many parts of human life such as learning ability, behavior and judgment. It is important to understand human nature. Emotion can only be inferred from facial expressions or gestures, what it actually is. In particular, emotion is difficult to classify not only because individuals feel differently about emotion but also because visually induced emotion does not sustain during whole testing period. To solve the problem, we acquired bio-signals and extracted features from those signals, which offer objective information about emotion stimulus. The emotion pattern classifier was composed of unsupervised learning algorithm with hidden nodes and feature vectors. Restricted Boltzmann machine (RBM) based on probability estimation was used in the unsupervised learning and maps emotion features to transformed dimensions. The emotion was characterized by non-linear classifiers with hidden nodes of a multi layer neural network, named deep belief network (DBN). The accuracy of DBN (about 94 %) was better than that of back-propagation neural network (about 40 %). The DBN showed good performance as the emotion pattern classifier.

• Proceedings of the ESK Conference
• /
• 1997.04a
• /
• pp.3-9
• /
• 1997

EEG(electroencephalogram) is attempted to determination of human emotion. Ten university students were participated in this study. Ten auditory stimuli were presented for a subject to evoke emotion. Data homogeneity according to brain local area and basic mechanism of relative variation for combinational delta, theta, alpha and beta waves were analyzed. As the result, the local area characterized by factor analysis and the relative variation of alpha-delta wave can be considered as the determinants of human emotion.

• Proceedings of the ESK Conference
• /
• 1997.10a
• /
• pp.473-476
• /
• 1997

Human visual emotion were investigated by analyzing HRV from ECG signals, which were varied by the visual stimuli. In this paper, twelve university students experienced visual emotion by pictures from IAPS. ECG and subjective rating were obtained for human emotion evaluation. For determination of HRV, ECG was extracted into HF and LF via power spectrum analysis. The results showed that HRV is good for discrimination between positive and negative emotions.

• Journal of Institute of Control, Robotics and Systems
• /
• v.16 no.1
• /
• pp.33-39
• /
• 2010

The interaction of emotion is an important factor in Human-Robot Interaction(HRI). This requires a contextual appraisal of emotion extracting the emotional information according to the events happened from past to present. In this paper an emotion appraisal system based on the cognitive context is presented. Firstly, a conventional emotion appraisal model is simplified to model a contextual emotion appraisal which defines the types of emotion appraisal, the target of the emotion induced from analyzing emotional verbs, and the transition of emotions in the context. We employ a language based cognitive system and its sentential memory and object descriptor to define the type and target of emotion and to evaluate the emotion varying with the process of time with the a priori emotional evaluation of targets. In a experimentation, we simulate the proposed emotion appraisal system with a scenario and show the feasibility of the system to HRI.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 1997.11a
• /
• pp.85-89
• /
• 1997

We present several biosignal measurement results and analysis algorithms for the visual stimulus from International Affective Picture Sytem. Sine human body is nonlinear dynamic system, we investigated both linear and nonlinear methods. We found that the alpha wave of EEG, the chaos of peripheral blood pressure, the LF/HF of HRV and thd retutn map of RR interval were good parameters for the measuremet of human sensibility. These can be used as the parameters for the measurement of human sensibility.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 1997.11a
• /
• pp.11-15
• /
• 1997

This study deals with the method for modeling relationship between human sensibility and design dldments of a product for applying human sensibility to product development, Inorder to extract sensibility characteeristics concerning a product, we figured out the relationship between xensibilith and design elements using corrdlation analysis and multiple regression analysis, and then modeled the realtionship between then through multiple objective linert programming. The results of this study can be effectively applied to develop a product based on human sensibility

• Journal of Korean Institute of Industrial Engineers
• /
• v.31 no.1
• /
• pp.68-78
• /
• 2005

A new emotion-based image retrieval method is proposed in this paper. The research was motivated by Soen's evaluation of human emotion on color patterns. Thirteen pairs of adjective words expressing emotion pairs such as like-dislike, beautiful-ugly, natural-unnatural, dynamic-static, warm-cold, gay-sober, cheerful-dismal, unstablestable, light-dark, strong-weak, gaudy-plain, hard-soft, heavy-light are modeled by 19-dimensional color array and $4{\times}3$ gray matrix in off-line. Once the query is presented in text format, emotion model-based query formulation produces the associated color array and gray matrix. Then, images related to the query are retrieved from the database based on the multiplication of color array and gray matrix, each of which is extracted from query and database image. Experiments over 450 images showed an average retrieval rate of 0.61 for the use of color array alone and an average retrieval rate of 0.47 for the use of gray matrix alone.

• MALSORI
• /
• no.56
• /
• pp.173-183
• /
• 2005

We propose a speech emotion recognition method for affective human-robot interface. In the Proposed method, emotion is classified into 6 classes: Angry, bored, happy, neutral, sad and surprised. Features for an input utterance are extracted from statistics of phonetic and prosodic information. Phonetic information includes log energy, shimmer, formant frequencies, and Teager energy; Prosodic information includes Pitch, jitter, duration, and rate of speech. Finally a pattern classifier based on Gaussian support vector machines decides the emotion class of the utterance. We record speech commands and dialogs uttered at 2m away from microphones in 5 different directions. Experimental results show that the proposed method yields $48\%$ classification accuracy while human classifiers give $71\%$ accuracy.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2002.11b
• /
• pp.762-766
• /
• 2002

This paper describes the emotion recognition algorithm using HMM(Hidden Markov Model) method. The relation between the mechanic system and the human has just been unilateral so far. This is the why people don't want to get familiar with multi-service robots of today. If the function of the emotion recognition is granted to the robot system, the concept of the mechanic part will be changed a lot. Pitch and Energy extracted from the human speech are good and important factors to classify the each emotion (neutral, happy, sad and angry etc.), which are called prosodic features. HMM is the powerful and effective theory among several methods to construct the statistical model with characteristic vector which is made up with the mixture of prosodic features