• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.15 no.4
• /
• pp.1464-1485
• /
• 2021

Emotional style of multimedia art works are abstract content information. This study aims to explore emotional style transfer method and find the possible way of matching music with appropriate images in respect to emotional style. DCNNs (Deep Convolutional Neural Networks) can capture style and provide emotional style transfer iterative solution for affective image generation. Here, we learn the image emotion features via DCNNs and map the affective style on the other images. We set image emotion feature as the style target in this style transfer problem, and held experiments to handle affective image generation of eight emotion categories, including dignified, dreaming, sad, vigorous, soothing, exciting, joyous, and graceful. A user study was conducted to test the synesthesia emotional image style transfer result with ground truth user perception triggered by the music-image pairs' stimuli. The transferred affective image result for music-image emotional synesthesia perception was proved effective according to user study result.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.12 no.3
• /
• pp.167-179
• /
• 2016

Online games, by a massive influx of many players, it has diverse situations in which emotion is generated. Emotion plays an important role that helps players to interact and immerse in game. In the previous games, simple structures are used to express emotion. By increasing the user's needs of emotion in the game, it is necessary to structure a various type of emotion. In this paper, the game components were classified as background, object, and character in order to analyze emotion structurally in game. We defined how to use the rule of emotion, and applied to League of legend, Cyphers and World of Warcraft which belong to the AOS genre. The AOS game is well-suited for analyzing emotion structure, because a various emotional changes and situations can arise in the game. Through this paper, it was discovered similarities emotion to be used in online games. It is expected to generalize the emotion in the game by analyzing the emotional structure of more games in future.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2001.05a
• /
• pp.131-135
• /
• 2001

Recently, Internet is used widely. Many Web sites, however, are not designed based on user's view. So, this research aimed at grasping the user needs and structure of Web site which user used easily. First, to grasp user needs, questionnaires about the motivation, the purpose and the evaluation items of Web page were done. As a result, we found the easiness for the user. Next, we made subjects operated test pages in which the number of classes and the amount of information were changed. We collected the quantitative data of the optimum number of classes, amount of information and retrieval time. As a result, there was a significant difference in each numerical value. The results of this research are available when constructing a web site. so, usability of Web site can be improved by them.

• Journal of the Korea Convergence Society
• /
• v.9 no.11
• /
• pp.69-74
• /
• 2018

Through the convergence of Internet technology and various information technologies, it is possible to collect and process vast amount of information and to exchange various knowledge according to user's personal preference. Especially, there is a tendency to prefer intimate contents connected with the user's preference through the flow of emotional changes contained in the movie media. Based on the information presented in the script, the user seeks to visualize the flow of the entire emotion, the flow of emotions in a specific scene, or a specific scene in order to understand it more quickly. In this paper, after obtaining the raw data from the movie web page, it transforms it into a standardized scenario format after refining process. After converting the refined data into an XML document to easily obtain various information, various sentences are predicted by inputting each paragraph into the emotion prediction system. We propose a system that can easily understand the change of the emotional state between the characters in the whole or a specific part of the various emotions required by the user by mixing the predicted emotions flow and the amount of information included in the script.

• Journal of the Korea Society of Computer and Information
• /
• v.14 no.5
• /
• pp.11-17
• /
• 2009

It's a trend that the proportion of using an internet messenger among on-line communication methods is getting increased. However, there are not many applications which efficiently utilize these messenger communication data. Messenger communication data have specific characteristics that reflect the user's linguistic habits. The linguistic habits are revealed through frequently used words and emoticons, and user's emotions can be grasped by these. This paper proposes the method that efficiently classifies the emotions of a messenger user using frequently used words or symbols. The emotion classifier from repeated experiments achieves high accuracy of more than 95%.

• Journal of the Korea Society of Computer and Information
• /
• v.23 no.8
• /
• pp.37-43
• /
• 2018

In this paper, we propose a framework that automatically suggests emotion using emotion analysis method based on facial expression change. We use Microsoft's Emotion API to calculate and analyze emotion values in facial expressions to recognize emotions that change over time. In this step, we use standard deviations based on peak analysis to measure and classify emotional changes. The difference between the classified emotion and the normal emotion is calculated, and the difference is used to recognize the emotion abnormality. We match user's emotions to relatively relaxed emotions using histograms and emotional meshes. As a result, we provide relaxed emotions to users through images. The proposed framework helps users to recognize emotional changes easily and to train their emotions through emotional relaxation.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2004.11a
• /
• pp.26-26
• /
• 2004

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2012.05a
• /
• pp.3-4
• /
• 2012

• The KIPS Transactions:PartB
• /
• v.17B no.2
• /
• pp.169-176
• /
• 2010

This paper proposes color transformation of images based on user's preference. Traditional color transformation method transforms only hue based on existing templates that define range of harmonious hue. It does not change saturation and intensity. Users would appreciate the resulting images that adjusted unnatural hue of images. Since color is closely related to peoples' emotion, we can enhance interaction of emotion-based contents and technologies. Therefore, in this paper, we define the range of color of each emotion for the transformation of color and perform the transformation of hue, saturation and intensity. However, the relationship of color and emotion depends on the culture and environment. To reflect these characteristics in color transformation, we propose the transformation of color that is based on user's preference and as a result, people would be more satisfied. We adopt interactive genetic algorithm to learn about user's preference. We surveyed the subject to analyze user's satisfaction about transformed images that are based on preference, and we found that people prefer transformed images to original images. Therefore, we conclude that people are more satisfied with the transformation of the templates which reflected user's preference than the one that did not.

• Proceedings of the Korea Contents Association Conference
• /
• 2008.05a
• /
• pp.43-48
• /
• 2008

And this study intends to discuss especially the one using emotional filter among various information processing methods. The existing music recommendation service on the web has a weak point that it makes the user feel bored by recommending songs only with similar feeling of the same genre, because music is classified by tune, melody, atmosphere and genre before recommendation. The service using emotion filter, suggested in this study, recommends the song and lyrics appropriate to the current emotional state of the user by abstracting emotional words that could reflect the sensitivity of human and then search the words within lyrics to match in order to overcome the weak point of the existing service. This study starts where the current emotional status for the user is being input. As for the range to choose, there are the seven representatives of emotion which are, love, separation, joy, sorrow-gloom, happiness-lonesome, and anger. As the service receives input of user's emotion, it matches the emotional words appropriate for the emotion input with the lyrics, and ranks the lyrics in the order of priority, so that it recommends the song and it lyrics to the user.