• Title/Summary/Keyword: Facial Emotions

Search Result 159, Processing Time 0.022 seconds

Toward an integrated model of emotion recognition methods based on reviews of previous work (정서 재인 방법 고찰을 통한 통합적 모델 모색에 관한 연구)

  • Park, Mi-Sook;Park, Ji-Eun;Sohn, Jin-Hun
    • Science of Emotion and Sensibility
    • /
    • v.14 no.1
    • /
    • pp.101-116
    • /
    • 2011
  • Current researches on emotion detection classify emotions by using the information from facial, vocal, and bodily expressions, or physiological responses. This study was to review three representative emotion recognition methods, which were based on psychological theory of emotion. Firstly, literature review on the emotion recognition methods based on facial expressions was done. These studies were supported by Darwin's theory. Secondly, review on the emotion recognition methods based on changes in physiology was conducted. These researches were relied on James' theory. Lastly, a review on the emotion recognition was conducted on the basis of multimodality(i.e., combination of signals from face, dialogue, posture, or peripheral nervous system). These studies were supported by both Darwin's and James' theories. In each part, research findings was examined as well as theoretical backgrounds which each method was relied on. This review proposed a need for an integrated model of emotion recognition methods to evolve the way of emotion recognition. The integrated model suggests that emotion recognition methods are needed to include other physiological signals such as brain responses or face temperature. Also, the integrated model proposed that emotion recognition methods are needed to be based on multidimensional model and take consideration of cognitive appraisal factors during emotional experience.

  • PDF

A Comic Facial Expression Method for Intelligent Avatar Communications in the Internet Cyberspace (인터넷 가상공간에서 지적 아바타 통신을 위한 코믹한 얼굴 표정의 생성법)

  • 이용후;김상운;청목유직
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.40 no.1
    • /
    • pp.59-73
    • /
    • 2003
  • As a means of overcoming the linguistic barrier between different languages in the Internet, a new sign-language communication system with CG animation techniques has been developed and proposed. In the system, the joint angles of the arms and the hands corresponding to the gesture as a non-verbal communication tool have been considered. The emotional expression, however, could as play also an important role in communicating each other. Especially, a comic expression is more efficient than real facial expression, and the movements of the cheeks and the jaws are more important AU's than those of the eyebrow, eye, mouth etc. Therefore, in this paper, we designed a 3D emotion editor using 2D model, and we extract AU's (called as PAU, here) which play a principal function in expressing emotions. We also proposed a method of generating the universal emotional expression with Avatar models which have different vertex structures. Here, we employed a method of dynamically adjusting the AU movements according to emotional intensities. The proposed system is implemented with Visual C++ and Open Inventor on windows platforms. Experimental results show a possibility that the system could be used as a non-verbal communication means to overcome the linguistic barrier.

Application of Support Vector Regression for Improving the Performance of the Emotion Prediction Model (감정예측모형의 성과개선을 위한 Support Vector Regression 응용)

  • Kim, Seongjin;Ryoo, Eunchung;Jung, Min Kyu;Kim, Jae Kyeong;Ahn, Hyunchul
    • Journal of Intelligence and Information Systems
    • /
    • v.18 no.3
    • /
    • pp.185-202
    • /
    • 2012
  • .Since the value of information has been realized in the information society, the usage and collection of information has become important. A facial expression that contains thousands of information as an artistic painting can be described in thousands of words. Followed by the idea, there has recently been a number of attempts to provide customers and companies with an intelligent service, which enables the perception of human emotions through one's facial expressions. For example, MIT Media Lab, the leading organization in this research area, has developed the human emotion prediction model, and has applied their studies to the commercial business. In the academic area, a number of the conventional methods such as Multiple Regression Analysis (MRA) or Artificial Neural Networks (ANN) have been applied to predict human emotion in prior studies. However, MRA is generally criticized because of its low prediction accuracy. This is inevitable since MRA can only explain the linear relationship between the dependent variables and the independent variable. To mitigate the limitations of MRA, some studies like Jung and Kim (2012) have used ANN as the alternative, and they reported that ANN generated more accurate prediction than the statistical methods like MRA. However, it has also been criticized due to over fitting and the difficulty of the network design (e.g. setting the number of the layers and the number of the nodes in the hidden layers). Under this background, we propose a novel model using Support Vector Regression (SVR) in order to increase the prediction accuracy. SVR is an extensive version of Support Vector Machine (SVM) designated to solve the regression problems. The model produced by SVR only depends on a subset of the training data, because the cost function for building the model ignores any training data that is close (within a threshold ${\varepsilon}$) to the model prediction. Using SVR, we tried to build a model that can measure the level of arousal and valence from the facial features. To validate the usefulness of the proposed model, we collected the data of facial reactions when providing appropriate visual stimulating contents, and extracted the features from the data. Next, the steps of the preprocessing were taken to choose statistically significant variables. In total, 297 cases were used for the experiment. As the comparative models, we also applied MRA and ANN to the same data set. For SVR, we adopted '${\varepsilon}$-insensitive loss function', and 'grid search' technique to find the optimal values of the parameters like C, d, ${\sigma}^2$, and ${\varepsilon}$. In the case of ANN, we adopted a standard three-layer backpropagation network, which has a single hidden layer. The learning rate and momentum rate of ANN were set to 10%, and we used sigmoid function as the transfer function of hidden and output nodes. We performed the experiments repeatedly by varying the number of nodes in the hidden layer to n/2, n, 3n/2, and 2n, where n is the number of the input variables. The stopping condition for ANN was set to 50,000 learning events. And, we used MAE (Mean Absolute Error) as the measure for performance comparison. From the experiment, we found that SVR achieved the highest prediction accuracy for the hold-out data set compared to MRA and ANN. Regardless of the target variables (the level of arousal, or the level of positive / negative valence), SVR showed the best performance for the hold-out data set. ANN also outperformed MRA, however, it showed the considerably lower prediction accuracy than SVR for both target variables. The findings of our research are expected to be useful to the researchers or practitioners who are willing to build the models for recognizing human emotions.

The Effects of Regulatory Focus and Donees' Facial Expression on Intention of Doing a Charitable Deed (기부자의 조절초점과 기부수혜자의 표정제시방식이 기부의도에 미치는영향)

  • Park, Kikyoung;O, Min-Jeong;park, jong chul
    • (The) Korean Journal of Advertising
    • /
    • v.28 no.2
    • /
    • pp.7-25
    • /
    • 2017
  • The previous studies regarding prosocial behavior have been researched based on donors' personal traits and the effects of donees emotions. However, studies in identifying the effects of regulatory focus as motivational traits and the emotions resulting from donees' expression on prosocial behaviors have not been researched as much thoroughly. Specifically, consumers with prevention-focus perceive fit as the goal attainability process by avoiding negative factors. Thus, it is expected that the intentions of doing a charitable deed greater will more increase when the donees look sad than when they look happy. On the other hand, consumers with promotion-focus perceive fit as the consequential benefits of goal attainability when they are in the condition of a positive emotion. As a result, the intention of doing a charitable deed is expected to be increased greater when the donees have happier faces than sad faces. According to the experimental results, consumers with prevention focus more intended to do a charitable deed when the donees' expression was presented with a sad expression by mediating sadness. On the contrary, consumers with promotion focus show higher intention of doing a charitable deed when the donees looked happier by mediating happy feelings. This study has a theoretical meaningfulness in respect to expanding previous research concerning regulatory focus into donation contexts. Furthermore, this study has practical implications by presenting the donation strategies on information presentations of donees.

How facial emotion affects switching cost: Eastern and Western cultural differences (얼굴 표정 정서가 전환 과제 수행에 미치는 영향: 동서양 문화차)

  • Jini Tae;Yeeun Nam;Yoonhyoung Lee;Myeong-ho Sohn;Tae-hoon Kim
    • Korean Journal of Cognitive Science
    • /
    • v.34 no.3
    • /
    • pp.227-241
    • /
    • 2023
  • This study aimed to examine the influence of emotional information on task switching performance from a cross-cultural perspective. Specifically we investigated whether the impact of affective information differs between Koreans and Caucasian when they perform a switching task using pictures that express positive and negative emotions. In this study, Korean and Caucasian college students were presented with either positive or negative faces and asked to perform either an emotion or a gender judgment task based on the color of the picture frame. The results showed that the switching cost from the gender judgment task to the emotion task was significantly larger than the switching cost from the gender task to the emotion task for both Koreans and Caucasians. This asymmetric switching cost was maintained when the previous and current pictures showed the same emotion but disappeared when two images presented different emotions. Regardless of the participant's cultural background, switching costs were greater for emotional tasks where the emotion was directly related to the task than for gender tasks. However, the effect of emotional switching on switching costs varied by the individual's background. Koreans were less sensitive to whether poser's emotion was changed than Americans. These results demonstrate that emotional information affects cognitive task performance and suggest that the effects of emotion may differ depending on the individual's cultural background.

A Study on Directionality in Modern Utilization of 『Natya sastra』 -Focused on Facial Expression Acting Techniques- (『나띠야 샤스뜨라』의 현대적 활용에 대한 방향성 고찰 -표정연기술을 중심으로-)

  • Ahn, Jae-Beom
    • The Journal of the Korea Contents Association
    • /
    • v.17 no.12
    • /
    • pp.408-416
    • /
    • 2017
  • This researcher looked at the characteristics of "$N\bar{a}tya$ $\acute{s}\bar{a}stra$" acting techniques focused on body expressions and sought to utilize it as training method for modern actors. 'Body postponement as a symbol' is a key characteristic of "$N\bar{a}tya$ $\acute{s}\bar{a}stra$" acting techniques, and each facial expression, gesture, and movement performed by an actor has a specific meaning. Therefore, the study on "$N\bar{a}tya$ $\acute{s}\bar{a}stra$" has been treated as a major study mainly in the non-realistic expression style or the body-centered acting theory. Therefore, a study on "$N\bar{a}tya$ $\acute{s}\bar{a}stra$" acting techniques was mainly dealt with as a major research subject in the nonrealistic expression style or body-centered acting theory. This study, on the other hand, emphasized the importance of research on the utilization plan of actor training, which can be usually used in realistic plays as well as non-realistic plays. According to psychologists such as Damasio and Eckman, internal impulses can also be triggered through expressions and actions associated with emotions. In addition, not only acting through the actor's inner impulse, but also expression of the actor's faithful external emotion can trigger the emotion of the audience. Such a case can be a psychological basis that "$N\bar{a}tya$ $\acute{s}\bar{a}stra$" acting techniques, which defines rasa and expresses it physically, can be used as a methodology to enhance inner truth. Therefore, the study on the actor training utilizing ing "$N\bar{a}tya$ $\acute{s}\bar{a}stra$" can be applied as an effective approach in the study of contemporary acting theory which intends to integrate inner impulse and external expression.

Fashion-cultural Products Design Development Based on the Lian Pu of Chinese Beijing Opera: Focused on Chinese Four Major Novels of Wonder (중국 경극 검보를 활용한 패션문화상품 디자인개발: 중국의 사대기서를 중심으로)

  • Zho, Xu;Kim, Jiyoung
    • Journal of Fashion Business
    • /
    • v.19 no.2
    • /
    • pp.53-68
    • /
    • 2015
  • The Beijing Opera is one of the leading representatives of Chinese culture, which includes literature, music, dance, martial arts, and a type of performance that stems from the Chinese cultural history that is still relevant today. The purpose of this study is to develop fashion-cultural products from the Lian Pu of the Beijing Opera, a Chinese cultural tradition that receives abundant positive feedback from around the world, showing its value in both academic and practical fields. This study was carried out first as a theoretical study of the literature, definition and types of facial make up used in the Opera, as a way of examining the formative aspect. Secondly, an analysis was conducted on the main characters, 'Guan Yu' and 'Zhang Fei' of "The Romance of the Three Kingdoms", 'Li Kiu' and 'Lu Zhishen' of "All Men are Brothers" and 'Monkey King' of "Journey to West", employing the collection belonging to 'Yongqi Zhao' who is an expert on the Chinese Beijing Opera. Thirdly, two concepts were categorized, based on the analytic results of the abovementioned characters, each of which were then further categorized into three sub concepts. In regard to cultural development designs, the results of an analysis on the facial make-up color, form, and texture of the four main characters were utilized to construct the themes, "Modern Chic" and "Traditional Splendor". The simplest form that has been represented in the four figures has been applied to "Modern Chic" to show a modern image in which black, white and light blue has been used alongside the vivid red, which is a Chinese favorite, to highlight the characters. In "Traditional Splendor", which is focused on the stage art of the Opera, we see more artistic traditions and colors, to further appeal to our emotions. Traditional motifs have been applied using traditional Chinese arts, in order to develop strong and brilliant colors. The two styles of cultural products were developed in the form of women's scarves and men's ties; a total of 24 designs were expressed, using Illustrator CS6. In the final step, 4 scarves and 6 ties were produced as a sample, using high quality silk. The development of these cultural fashion products will bring an opportunity to show how Chinese traditional culture can be widely utilized in commercial market design.

The Effects of Priming Emotion among College Students at the Processes of Words Negativity Information (유발된 정서가 대학생의 부정적 어휘정보 처리에 미치는 효과)

  • Kim, Choong-Myung
    • Journal of Convergence for Information Technology
    • /
    • v.10 no.10
    • /
    • pp.318-324
    • /
    • 2020
  • The present study was conducted to investigate the influences of emotion priming and the number of negation words on the task of sentential predicate reasoning in groups with or without anxiety symptoms. 3 types of primed emotions and 2 types of stimulus and 3 conditions of negation words were used as a within-subject variable. The subjects were instructed to make facial expressions that match the directions, and were asked to choose the correct answer from the given examples. Mixed repeated measured ANOVA analyses on reaction time first showed main effects for the variables of emotion, stimulus, number of negation words and anxiety level, and the interaction effects for the negation words x anxiety combination. These results are presumably suggested to reflect that externally intervening emotion works on language comprehension in a way that anxiety could delay task processing speed regardless of the emotion and stimulus type, meanwhile the number of negation words can slower language processing only in a anxiety group. Implications and limitations were discussed for the future work.

A Study on The Expression of Digital Eye Contents for Emotional Communication (감성 커뮤니케이션을 위한 디지털 눈 콘텐츠 표현 연구)

  • Lim, Yoon-Ah;Lee, Eun-Ah;Kwon, Jieun
    • Journal of Digital Convergence
    • /
    • v.15 no.12
    • /
    • pp.563-571
    • /
    • 2017
  • The purpose of this paper is to establish an emotional expression factors of digital eye contents that can be applied to digital environments. The emotion which can be applied to the smart doll is derived and we suggest guidelines for expressive factors of each emotion. For this paper, first, we research the concepts and characteristics of emotional expression are shown in eyes by the publications, animation and actual video. Second, we identified six emotions -Happy, Angry, Sad, Relaxed, Sexy, Pure- and extracted the emotional expression factors. Third, we analyzed the extracted factors to establish guideline for emotional expression of digital eyes. As a result, this study found that the factors to distinguish and represent each emotion are classified four categories as eye shape, gaze, iris size and effect. These can be used as a way to enhance emotional communication effects such as digital contents including animations, robots and smart toys.

Facial Detection using Haar-like Feature and Bezier Curve (Haar-like와 베지어 곡선을 이용한 얼굴 성분 검출)

  • An, Kyeoung-Jun;Lee, Sang-Yong
    • Journal of Digital Convergence
    • /
    • v.11 no.9
    • /
    • pp.311-318
    • /
    • 2013
  • For face detection techniques, the correctness of detection decreases with different lightings and backgrounds so such requires new methods and techniques. This study has aimed to obtain data for reasoning human emotional information by analyzing the components of the eyes and mouth that are critical in expressing emotions. To do this, existing problems in detecting face are addressed and a detection method that has a high detection rate and fast processing speed good at detecting environmental elements is proposed. This method must detect a specific part (eyes and a mouth) by using Haar-like Feature technique with the application of an integral image. After which, binaries detect elements based on color information, dividing the face zone and skin zone. To generate correct shape, the shape of detected elements is generated by using a bezier curve-a curve generation algorithm. To evaluate the performance of the proposed method, an experiment was conducted by using data in the Face Recognition Homepage. The result showed that Haar-like technique and bezier curve method were able to detect face elements more elaborately.