• Science of Emotion and Sensibility
• /
• v.13 no.3
• /
• pp.501-510
• /
• 2010

The knowledge base on emotional information is one of the key elements in the implementation of emotion retrieval systems for contents design of Mobile devices. This study proposed a new approach to the knowledge base implementation by automatically extracting color components from full-color images. In this study, the validity of the proposed method was empirically tested. Database was developed using 100 interior images as visual stimuli and a total of 48 subjects participated in the experiment. In order to test the reliability of the proposed 'emotional information knowledge base', firstly 'recall ratio' that refers to frequencies of correct images from the retrieved images was derived. Secondly, correlation Analysis was performed to compare the ratings by the subjects to what the system calculated. Finally, the rating comparison was used to run a paired-sample t-test. The analysis demonstrated satisfactory recall ration of 62.1%. Also, a significant positive correlation (p<.01) was observed from all the emotion keywords. The paired Sample t-test found that all the emotion keywords except "casual" retrieved the images in the order from more relevant to less relevant images and the difference was statistically significant (t(9)=5.528, p<.05). Findings of this study support that the proposed 'emotional information knowledge base' established only with color information automatically extracted from images can be effectively used for such visual stimuli search tasks as commercial interior images.

• International Journal of Internet, Broadcasting and Communication
• /
• v.9 no.1
• /
• pp.51-55
• /
• 2017

LINE, an instant message App with a powerful capability of transmitting various forms of data, has been overwhelmed in Asia since launched in 2011. Due to its popularity, LINE was first used in the 2016 Taiwanese presidential election. This research utilized a functional approach of campaign communication discourse and political visual images to analyze how candidates managed and presented themselves by textual and visual information on LINE. Regarding the textual information, results revealed their strategy inclined to reverse gender stereotype because the female candidate emphasized policy over character, while the male emphasized character over policy. Both candidates did not fully employ ten image functions because they utilized mostly the emotional and image building functions. The female candidate message achieved the largest total amount of 'like' and 'share'. This study probes into the App campaigning and improve the feasibility and practicability to share knowledge of political communication by new media.

• Science of Emotion and Sensibility
• /
• v.21 no.3
• /
• pp.151-164
• /
• 2018

The appropriate interpretation of social cues is a crucial ability for everyday life. While processing socially relevant information, beyond the low-level physical features of the stimuli to emotional information is known to influence human cognition in various stages, from early perception to later high-level cognition, such as working memory (WM). However, it remains unclear how the influence of each type of emotional information on cognitive processes changes in response to what has occurred in the processing stage. Past studies have largely adopted face stimuli to address this type of research question, but we used a unique class of socially relevant motion stimuli, called biological motion (BM), which depicts various human actions and emotions with moving dots to exhibit the effects of anger, happiness, and neutral emotion on task performance in perceptual and working memory. In this study, participants determined whether two BM stimuli, sequentially presented with a delay between them (WM task) or one immediately after the other (perceptual task), were identical. The perceptual task showed that discrimination accuracies for emotional stimuli (i.e., angry and happy) were lower than those for neutral stimuli, implying that emotional information has a negative impact on early perceptual processes. Alternatively, the results of the WM task showed that the accuracy drop as the interstimulus interval increased was actually lower in emotional BM conditions than in the neutral condition, which suggests that emotional information benefited maintenance. Moreover, anger and happiness had distinct impacts on the performance of perception and WM. Our findings have significance as we provide evidence for the interaction of type of emotion and information-processing stage.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2000.04a
• /
• pp.58-61
• /
• 2000

The purpose of this study is to investigate the characteristics of electroencephalogram (EEG) during emotional occurrence of likes and dislikes in humans subjected to visual stimuli. Fifteen healthy male subjects participated in the study. Portrayals of females and cars on a visual screen, one photographic display at a time. were used as the stimulus. The subjects, with their EEGs concomitantly monitored, were asked to record their likes and dislikes for each portrayal of a total of 50 sequential displays. The results indicated that beta ($\beta$)=wave was more prevalent with dislikes than likes, and the arousal level was higher when dislikes predominated over likes, implying that more cerebral information processing activity was involved in answering dislikes than likes. In the case of cars, the difference between likes and dislikes was focused within a frequency band of 15-20 Hz in the right cerebral hemisphere. Our findings suggest that the activity in the right brain predominates with increases in negative emotion.

• Journal of Information Processing Systems
• /
• v.17 no.4
• /
• pp.754-771
• /
• 2021

In the task of continuous dimension emotion recognition, the parts that highlight the emotional expression are not the same in each mode, and the influences of different modes on the emotional state is also different. Therefore, this paper studies the fusion of the two most important modes in emotional recognition (voice and visual expression), and proposes a two-mode dual-modal emotion recognition method combined with the attention mechanism of the improved AlexNet network. After a simple preprocessing of the audio signal and the video signal, respectively, the first step is to use the prior knowledge to realize the extraction of audio characteristics. Then, facial expression features are extracted by the improved AlexNet network. Finally, the multimodal attention mechanism is used to fuse facial expression features and audio features, and the improved loss function is used to optimize the modal missing problem, so as to improve the robustness of the model and the performance of emotion recognition. The experimental results show that the concordance coefficient of the proposed model in the two dimensions of arousal and valence (concordance correlation coefficient) were 0.729 and 0.718, respectively, which are superior to several comparative algorithms.

• Science of Emotion and Sensibility
• /
• v.26 no.3
• /
• pp.3-14
• /
• 2023

This study used intersubject representational similarity analysis (IS-RSA) to identify participant-response consistency patterns in previously published data. Additionally, analysis of variance (ANOVA) was utilized to detect any variations in the conditions of each experiment. In each experiment, a combination of ASMR stimulation, visual and auditory stimuli, and time-series emotional video stimulation was employed, and emotional ratings and physiological measurements were collected in accordance with the respective experimental conditions. Every pair of participants' measurements for each stimulus in each experiment was correlated using Pearson correlation coefficient as part of the IS-RSA. The results of study revealed a consistent response pattern among participants exposed to ASMR, visual, and auditory stimuli, in contrast to those exposed to time-series emotional video stimulation. Notably, the ASMR experiment demonstrated a high level of response consistency among participants in positive conditions. Furthermore, both auditory and visual experiments exhibited remarkable consistency in participants' responses, especially when subjected to high arousal levels and visual stimulation. The findings of this study confirm that IS-RSA serves as a valuable tool for summarizing and presenting multidimensional data information. Within the scope of this study, IS-RSA emerged as a reliable method for analyzing multidimensional data, effectively capturing and presenting comprehensive information pertaining to the participants.

• Journal of the Ergonomics Society of Korea
• /
• v.19 no.1
• /
• pp.23-36
• /
• 2000

In conventional ergonomics, consumer product can be made based on anthropometric data and specific design guideline. However, the product may not satisfy consumers because their emotional preference have not been properly considered in design phase. Therefore, in this study a new chair design process was introduced by which both consumer's emotional need and traditional ergonomic requirement can be satisfied. As a part of the process, the traditional Kansei engineering technique was modified to collect quantitative information of consumer's visual appreciation and physical feedback of various types of chairs. Furthermore, we developed an interface, so called, KADAS(Kamsung Analysis and Design Assistance System), for designers to use the technique in chair design. This software can help designers to understand what should be the most suitable shape in designing items such as seat, back and arm rest, etc. to meet the emotional need of consumers. This software displays the result of modified quantification theory I, and explains how to use the statistics. This study suggested a new approach for ergonomic design incorporated with Kansei Engineering technique. This technique can be also applied to other products by extending the database of KADAS.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.13 no.2
• /
• pp.71-76
• /
• 2017

In this study, we learned about the emergence of on-line communications originating from peoseuteol Computer Communications, the limitations of online communication, and the definition, traits and development of emoticons that serve as complementary roles, such as emotion and status. After analyzing various literacture and references, it was found that the emoticons functioned as a function of communicating the visual language of the digital era and communicating more sensitively to emotional factors. In a multimedia environment, emoticons are developed at a more advanced stage as the users' own icons due to a stronger tendency to pursue particularity and uniqueness. It is expected that eomotions added with multimedia functions will be more popular and vary in type. However, although the diversification of emotions as a commercial tool is already actively progressing, there appears a reverse effect in which an excessive use of emoticons is considered insincere in online communications. In such a background, research should be conducted that can support a systematic and effective development of emoticons through visual research rather than producing multimedia emoticons indiscreetly.

• International Journal of Contents
• /
• v.17 no.1
• /
• pp.1-10
• /
• 2021

Visual analytics is an emerging research field that combines the strength of electronic data processing and human intuition-based social background knowledge. This study demonstrates useful visual analytics with Tableau in conjunction with semantic network analysis using examples of sentiment flow and strategic communication strategies via Twitter in a blockchain domain. We comparatively investigated the sentiment flow over time and language usage patterns between companies with a good reputation and firms with a poor reputation. In addition, this study explored the relations between reputation and marketing communication strategies. We found that cryptocurrency firms more actively produced information when there was an increased public demand and increased transactions and when the coins' prices were high. Emotional language strategies on social media did not affect cryptocurrencies' reputations. The pattern in semantic representations of keywords was similar between companies with a good reputation and firms with a poor reputation. However, the reputable firms communicated on a wide range of topics and used more culturally focused strategies, and took more advantages of social media marketing by expanding their outreach to other social media networks. The visual big data analytics provides insights into business intelligence that helps informed policies.

• Science of Emotion and Sensibility
• /
• v.21 no.2
• /
• pp.3-14
• /
• 2018

For satisfying consumer needs, commercial facilities require a variety of sale-related space expressions and eye-catching product arrangements; space composition can also be a direct marketing strategy. The human eye is the sensory organ that acquires the largest amount of information, and an analysis of visual information helps in understanding visual relations between . However, the existing studies are mostly focused on analysis of still frames in experimental images, and there is a lack of studies analyzing gaze information based on mobile images of commercial spaces. Therefore, this study analyzed emotional responses through gaze information of space users in reality using a video of a movement route through a commercial facility. The analysis targeted straight sections of the moving route; based on the data acquired, sectional characteristics of five gaze intensity ranges were examined. As a result, section A, the starting point of the route, had a low gaze intensity, while section B had the highest gaze intensity. This indicates that, starting in section B, the subjects explored the space in a stable way and needed time to adapt to the experimental video. In relation to space characteristics of the gaze-concentrated area, display formats of the right stores in 4 of 6 sections received greater attention. The gaze of consumers was mostly focused on props, and big gaze information was revealed in showcase display formats of the stores. In conclusion, this analysis method can provide highly useful direct design data about merchandise display and merchandise component arrangement based on consumer visual preference.