• Journal of Broadcast Engineering
• /
• v.18 no.5
• /
• pp.713-721
• /
• 2013

This paper describes an efficiency of chroma based tonal features for speech emotion recognition. As the tonality caused by major or minor keys affects to the perception of musical mood, so the speech tonality affects the perception of the emotional states of spoken utterances. In order to justify this assertion with respect to tonality and emotion, subjective hearing tests are carried out by using synthesized signals generated from chroma features, and consequently show that the tonality contributes especially to the perception of the negative emotion such as anger and sad. In automatic emotion recognition tests, the modified chroma-based tonal features are shown to produce noticeable improvement of accuracy when they are supplemented to the conventional log-frequency power coefficient (LFPC)-based spectral features.

• Journal of the Ergonomics Society of Korea
• /
• v.31 no.6
• /
• pp.715-723
• /
• 2012

Objective: The aim of this study is to investigate haptic perception related researches into three perspectives: cutaneous & proprioceptive sensations, active & passive touch, and cognition & emotion, then to identify issues for implementing haptic interactions. Background: Although haptic technologies had improved and become practical, more research on the method of application is still needed to actualize the multimodal interaction technology. Systematical approached to explore haptic perception is required to understand emotional experience and social message, as well as tactile feedback. Method: Content analysis were conducted to analyze trend in haptic related research. Changes in issues and topics were investigated using sensational dimensions and the different contents delivered via tactile perception. Result: The found research opportunities were haptic perception in various body segments and emotion related proprioceptive sensation. Conclusion: Once the mechanism of how users perceives haptic stimuli would help to develop effective haptic interactrion and this study provide insights of what to focus for the future of haptic interaction. Application: This research is expected to provide presence, and emotional response applied by haptic perception to fields such as human-robot, human-device, and telecommunication interaction.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2003.05a
• /
• pp.101-106
• /
• 2003

This paper introduces the basic concept of computational modeling of perception processes for multimedia data. Such processes are modeled as hierarchical inter-and relationships amongst information in physical, physiological, psychological and cognitive layers in perception. Based on our framework, this paper gives the , algorithms for content-based retrieval for multimedia database systems.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2012.05a
• /
• pp.61-62
• /
• 2012

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2012.05a
• /
• pp.43-44
• /
• 2012

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2002.05a
• /
• pp.3-8
• /
• 2002

This paper introduces the basic concept of computational modeling of perception processes for multimedia data. Such processes are modeled as hierarchical inter- and intra- relationships amongst information in physical, physiological, psychological and cognitive layers in perception. Based on our framework, this paper gives the algorithms for content-based retrieval for multimedia database systems.

• Science of Emotion and Sensibility
• /
• v.22 no.2
• /
• pp.37-48
• /
• 2019

Current research explores the effect of language on the perception of facial emotion as suggested by the psychological construction theory of emotion by using a psychophysical method. In this study, we hypothesize that the perception of facial expression may be influenced if the observer is shown an affective word before he/she judges an expression. Moreover, we suggest that his/her understanding of a facial emotion will be in line with the conceptual context that the word denotes. During the two experiments conducted for this project, a control stimulus or words representing either angry or happy emotions were briefly presented to participants before they were shown a target face. These target faces were randomly selected from seven faces that were gradually morphed to show neutral to angry (in Experiment 1) and neutral to happy (in Experiment 2) expressions. The participants were asked to perform a two-alternative forced choice (2AFC) task to judge the emotion of the target face (i.e., decide whether it is angry or neutral, or happy or neutral). The results of Experiment 1 (when compared with the control condition) showed that words denoting anger decreased the point of subjective equality (PSE) for judging the emotion of the target as anger, whereas words denoting happiness increased the PSE. Experiment 2, in which participants had to judge expressions on a scale from happy to neutral, produced a contrasting pattern of results. The outcomes of this study support the claim of the psychological construction theory of emotion that the perception of facial emotion is an active construction process that may be influenced by information (such as affective words) that provide conceptual context.

• 한국노년학
• /
• v.36 no.4
• /
• pp.1109-1124
• /
• 2016

We examined the effect of stereotype threat (STT) on spatial working memory and facial emotion recognition in Korean elderly. In addition, we investigated the role of expected moderator such as self-perception of aging. Seventeen seniors (male=7) received basic cognitive tests including K-WMS-IV, MMSE and answered self-report questionnaires including self-perception of aging, anxiety of aging, attitude toward aging and age identity on the first visit. On the second visit, they were exposed to negative stereotype by reading a script detailing cognitive decline related to aging while a control group was exposed to a neutral content. Following the exposure, they were tested on a spatial-working memory task (Corsi-block tapping task) and emotion recognition task (facial expression identification task). The results showed that the seniors exposed to STT showed significantly lower performance on emotion recognition task (p < .05) (i.e., especially on the more difficult facial stimuli). In addition, there was a significant interaction between STT and self-perception of aging (p< .05), indicating that those who have positive self-perception of aging did not show impairment in emotion recognition task and difficult spatial working memory task under STT. On the other hand, those with negative self-perception of aging showed impaired performance under STT. Taken together, the current study suggests that being exposed to STT could negatively influence cognitive and emotional functioning of elderly. Interestingly, having a positive self-perception of aging could protect the underperformance caused by STT.

• Science of Emotion and Sensibility
• /
• v.21 no.4
• /
• pp.77-90
• /
• 2018

Behavioral studies of emotion recognition in autism spectrum disorders (ASD) have yielded mixed results. Most of the studies focused on emotion recognition abilities with regard to ASD using stimuli with unisensory modality, making it difficult to determine difficulties in real life emotion perception in ASD. Herein, we review the recent behavioral and cognitive neuroscience studies on emotion recognition functions in ASD, including both unisensory and multisensory emotional information, to elucidate the possible difficulties in emotion recognition in ASD. In our study, we discovered that people with ASD have problems in the process of integrating emotional information during emotion recognition tasks. The following four points are discussed: (1) The restrictions of previous studies, (2) deficits in emotion recognition in ASD especially in recognizing multisensory information, (3) possible compensation mechanisms for emotion recognition in ASD, and (4) the possible roles of attention and language functions in emotion recognition in ASD. The compensatory mechanisms proposed herein for ASD with regard to emotion recognition abilities could contribute to a therapeutic approach for improving emotion recognition functions in ASD.

• The KIPS Transactions:PartB
• /
• v.18B no.5
• /
• pp.305-314
• /
• 2011

Research into the visual perception of human emotion to recognize an intention has traditionally focused on emotions of facial expression. Recently researchers have turned to the more challenging field of emotional expressions through body posture or activity. Proposed work approaches recognition of basic emotional categories from body postures using neural model applied visual perception of neurophysiology. In keeping with information processing models of the visual cortex, this work constructs a biologically plausible hierarchy of neural detectors, which can discriminate 6 basic emotional states from static views of associated body postures of activity. The proposed model, which is tolerant to parameter variations, presents its possibility by evaluating against human test subjects on a set of body postures of activities.