• Journal of the Korean Institute of Intelligent Systems
• /
• v.21 no.3
• /
• pp.395-400
• /
• 2011

In this paper, we propose an study of the facial emotion recognition considering the dynamical variation of emotional state in facial image sequences. The proposed system consists of two main step: facial image based emotional feature extraction and emotional state classification/recognition. At first, we propose a method for extracting and analyzing the emotional feature region using a combination of Active Shape Model (ASM) and Facial Action Units (FAUs). And then, it is proposed that emotional state classification and recognition method based on Hidden Markov Model (HMM) type of dynamic Bayesian network. Also, we adopt a Harmony Search (HS) algorithm based heuristic optimization procedure in a parameter learning of HMM in order to classify the emotional state more accurately. By using all these methods, we construct the emotion recognition system based on variations of the dynamic facial image sequence and make an attempt at improvement of the recognition performance.

• 제어로봇시스템학회:학술대회논문집
• /
• 1997.10a
• /
• pp.652-655
• /
• 1997

An exploration for an intelligence paradigm has been delineated. Artificial intelligence and artificial life paradigms seem to fail to show the whole picture of human intelligence. We may understand the human intelligence better by adding the emotional part of human intelligence to the intellectual part of human intelligence. Emotional intelligence is investigated in terms of composing machine as a modern abstract art. Various algorithmic composition and performance concepts are currently being investigated and implemented. Intelligent mapping algorithms restructure the traditional predetermined composition algorithms. Music based on fractals and neural networks is being composed. Also, emotional intelligence and aesthetic aspects of Korean traditional music are investigated in terms of fractal relationship. As a result, this exploration will greatly broaden the potentials of the intelligence research. The exploration of art in the view of intelligence, information and structure will restore the balanced sense, of art and science which seeks happiness in life. The investigations of emotional intelligence will establish the foundations of intelligence, information and control technologies.

• Journal of Intelligence and Information Systems
• /
• v.20 no.1
• /
• pp.1-14
• /
• 2014

Both researchers and practitioners are showing an increased interested in interactive exhibition services. Interactive exhibition services are designed to directly respond to visitor responses in real time, so as to fully engage visitors' interest and enhance their satisfaction. In order to install an effective interactive exhibition service, it is essential to adopt intelligent technologies that enable accurate estimation of a visitor's emotional state from responses to exhibited stimulus. Studies undertaken so far have attempted to estimate the human emotional state, most of them doing so by gauging either facial expressions or audio responses. However, the most recent research suggests that, a multimodal approach that uses people's multiple responses simultaneously may lead to better estimation. Given this context, we propose a new multimodal emotional state estimation model that uses various responses including facial expressions, gestures, and movements measured by the Microsoft Kinect Sensor. In order to effectively handle a large amount of sensory data, we propose to use stratified sampling-based MRA (multiple regression analysis) as our estimation method. To validate the usefulness of the proposed model, we collected 602,599 responses and emotional state data with 274 variables from 15 people. When we applied our model to the data set, we found that our model estimated the levels of valence and arousal in the 10~15% error range. Since our proposed model is simple and stable, we expect that it will be applied not only in intelligent exhibition services, but also in other areas such as e-learning and personalized advertising.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.21 no.4
• /
• pp.512-517
• /
• 2011

In this paper, we propose an Active Shape Model (ASM) and Lucas-Kanade (LK) optical flow-based feature extraction and analysis method for analyzing the emotional features from facial images. Considering the facial emotion feature regions are described by Facial Action Coding System, we construct the feature-related shape models based on the combination of landmarks and extract the LK optical flow vectors at each landmarks based on the centre pixels of motion vector window. The facial emotion features are modelled by the combination of the optical flow vectors and the emotional states of facial image can be estimated by the probabilistic estimation technique, such as Bayesian classifier. Also, we extract the optimal emotional features that are considered the high correlation between feature points and emotional states by using common spatial pattern (CSP) analysis in order to improvise the operational efficiency and accuracy of emotional feature extraction process.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.20 no.4
• /
• pp.528-533
• /
• 2010

This paper studied the training methods less affected by the emotional variation for the development of the robust speech recognition system. For this purpose, the effect of emotional variation on the speech signal and the speech recognition system were studied using speech database containing various emotions. The performance of the speech recognition system trained by using the speech signal containing no emotion is deteriorated if the test speech signal contains the emotions because of the emotional difference between the test and training data. In this study, it is observed that vocal tract length of the speaker is affected by the emotional variation and this effect is one of the reasons that makes the performance of the speech recognition system worse. In this paper, a training method that cover the speech variations is proposed to develop the emotionally robust speech recognition system. Experimental results from the isolated word recognition using HMM showed that propose method reduced the error rate of the conventional recognition system by 28.4% when emotional test data was used.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.18 no.5
• /
• pp.586-591
• /
• 2008

This paper studied the emotion recognition system combined with robust speech recognition system in order to improve the performance of emotion recognition system. For this purpose, the effect of emotional variation on the speech recognition system and robust feature parameters of speech recognition system were studied using speech database containing various emotions. Final emotion recognition is processed using the input utterance and its emotional model according to the result of speech recognition. In the experiment, robust speech recognition system is HMM based speaker independent word recognizer using RASTA mel-cepstral coefficient and its derivatives and cepstral mean subtraction(CMS) as a signal bias removal. Experimental results showed that emotion recognizer combined with speech recognition system showed better performance than emotion recognizer alone.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.15 no.1
• /
• pp.18-23
• /
• 2005

It is difficult to define and classify human emotion. These vague human emotion appear not in single emotion, but in combination of various emotion. And among them, a remarkable emotion is expressed. This paper proposes a emotional expression algorithm using dynamic emotion space, which give facial expression in similar with vague human emotion. While existing avatar express several predefined emotions from database, our emotion expression system can give unlimited various facial expression by expressing emotion based on dynamically changed emotion space. In order to see whether our system practically give complex and various human expression, we perform real implementation and experiment and verify the efficacy of emotional expression system based on dynamic emotion space.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.19 no.6
• /
• pp.834-839
• /
• 2009

It is a key element that the problem of emotional feature extraction based on facial image to recognize a human emotion status. In this paper, we propose an Advanced AAM that is improved version of proposed Facial Expression Recognition Systems based on Bayesian Network by using FACS and AAM. This is a study about the most efficient method of optimal facial feature area for human emotion recognition about random user based on generalized HCI system environments. In order to perform such processes, we use a Statistical Shape Analysis at the normalized input image by using Advanced AAM and FACS as a facial expression and emotion status analysis program. And we study about the automatical emotional feature extraction about random user.

• Korean Journal of Child Studies
• /
• v.36 no.2
• /
• pp.145-166
• /
• 2015

The main purpose of this study was to examine the direct and indirect effects of maternal meta-emotion on preschoolers' emotional intelligence through mothers' emotion socialization. A total of 252 preschool-aged children and their mothers residing in the Seoul Metropolitan and Gyeonggi-do areas participated in this study. The mothers completed questionnaires regarding their meta-emotion, emotion socialization and preschoolers' emotional intelligence. The results of the study indicated that maternal meta-emotion did not have a direct effect on preschoolers' emotional intelligence. However, maternal meta-emotion did indeed have an indirect effect on preschoolers' emotional intelligence through emotion socialization styles. That is, mothers who had desirable beliefs about emotions provided supportive reactions to children's negative emotion expression and showed positive emotions more frequently in the family. In addition, the preschoolers of mothers who showed positive emotion socialization styles were reported to be more emotionally intelligent. The findings of this study suggest that maternal meta-emotion and emotion socialization are important in predicting preschoolers' emotional intelligence.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.360-365
• /
• 2003

In this paper, we have developed a general purpose motion controller using an FPGA(Field Programmable Gate Array). The multi-PID controllers on a single chip are implemented as a system-on-chip for multi-axis motion control. We also develop a PC GUI for an efficient interface control. Comparing with the commercial motion controller LM 629 it has multi-independent PID controllers so that it has several advantages such as space effectiveness, low cost and lower power consumption. In order to test the performance of the proposed controller, robot finger is controlled. The robot finger has three fingers with 2 joints each. Finger movements show that position tracking was very effective. Another experiment of balancing an inverted pendulum on a cart has been conducted to show the generality of the proposed FPGA PID controller. The controller has well maintained the balance of the pendulum.