• Journal of Korea Multimedia Society
• /
• v.18 no.3
• /
• pp.376-386
• /
• 2015

Since affective computing has been introduced in 90s, affect recognition technology has achieved substantial progress recently. However, the application of user emotion recognition into software user interface is in its early stages. In this paper, we describe a new approach for developing mobile user interface which could react differently depending on user emotion states. First, an emotion reaction model is presented which determines user interface reactions for each emotional state. We introduce a pair of mappings from user states to different user interface versions. The reacting versions are implemented by a set of variations for a view. Further, we present an authoring framework to help developers/designers to create emotion-aware reactions based on the proposed emotion reaction model. The authoring framework is necessary to alleviate the burden of creating and handling multi versions for views at the development process. A prototype implementation is presented as an extension of the existing authoring tool DAT4UX. Moreover, a proof-of-concept application featuring an emotion-aware interface is developed using the tool.

• The Journal of the Korea Contents Association
• /
• v.12 no.1
• /
• pp.103-111
• /
• 2012

This paper is a basic study for making a system that can predict the success and failure of entertainment contents at the initial stage of production. It proposes the user's emotion modeling of dynamic narrative on entertainment contents. To make this possible, 1) dynamic narrative emotion model is proposed based on theoretical research of narrative structure and cognitive emotion model. 2) configuring the emotion types and emotion value, proposed model of three emotion parameter(desire, expectation, emotion type) are derived. 3)To measure user's emotion in each story event of dynamic narrative, cognitive behavior and description of user(film, game) is established. The earlier studies on the user research of conceptual, analytic approach is aimed of predicting on review of the media and user's attitude, and consequently these results is delineated purely descriptive. In contrast, this paper is proposed the method of user's emotion modeling on dynamic narrative. It would be able to contributed to the emotional evaluation of entertainment contents using specific information.

• Journal of Institute of Control, Robotics and Systems
• /
• v.13 no.4
• /
• pp.371-376
• /
• 2007

This paper presents an emotion recognition and its expression system of an intelligent robot like a home robot or a service robot. Emotion recognition method in the robot is used by a facial image. We use a motion and a position of many facial features. apply a tracking algorithm to recognize a moving user in the mobile robot and eliminate a skin color of a hand and a background without a facial region by using the facial region detecting algorithm in objecting user image. After normalizer operations are the image enlarge or reduction by distance of the detecting facial region and the image revolution transformation by an angel of a face, the mobile robot can object the facial image of a fixing size. And materialize a multi feature selection algorithm to enable robot to recognize an emotion of user. In this paper, used a multi layer perceptron of Artificial Neural Network(ANN) as a pattern recognition art, and a Back Propagation(BP) algorithm as a learning algorithm. Emotion of user that robot recognized is expressed as a graphic LCD. At this time, change two coordinates as the number of times of emotion expressed in ANN, and change a parameter of facial elements(eyes, eyebrows, mouth) as the change of two coordinates. By materializing the system, expressed the complex emotion of human as the avatar of LCD.

• Journal of Digital Convergence
• /
• v.10 no.2
• /
• pp.287-292
• /
• 2012

In this paper, user personalized services through the emotion perception required to support location-based sensing data preprocessing techniques and emotion data preprocessing techniques is studied for user's emotion data building and preprocessing in V-A emotion model. For this purpose the granular context tree and string matching based emotion pattern matching techniques are used. In addition, context-aware and personalized recommendation services technique using probabilistic reasoning is studied for personalized services based on context awareness.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2011.11a
• /
• pp.39-40
• /
• 2011

• Science of Emotion and Sensibility
• /
• v.16 no.2
• /
• pp.167-176
• /
• 2013

User-created text data are increasing rapidly caused by development of social media. In opinion mining, User's opinions are extracted by analyzing user's text. A primary goal of sentiment analysis as a branch of opinion mining is to extract user's opinions from a text that is required to build a list of emotion terms. In this paper, we built a list of emotion terms to analyse a sentiment of social media using Facebook as a representative social media. We collected data from Facebook and selected a emotion terms, and measured the dimensions of valence and activation through a survey. As a result, we built a list of 267 emotion terms including the dimension of valence and activation.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.18 no.1
• /
• pp.155-161
• /
• 2014

This study presents the real-time emotion image contents player to induce the user's emotion efficiently. The emotion image contents player was designed to efficiently induce by giving a change in the color, brightness, saturation of image contents corresponded to the user's emotion. In the emotion recognition module, physiological signal of pulse, skin temperature, skin resistance which based on autonomic nervous system were used. The emotion recognition part used physiological signal of pulse, skin temperature, skin resistance based on autonomic nervous system. The image as emotional contents was used with the 9 kinds emotion area classified in international affective picture system(IAPS). As experimental results, the use's emotion that match the image's emotion with the emotion image contents player was derived 10% more accurately. The emotion contents player is expected to increase emotional feeling between users's emotion and contents emotion duo to the real-time emotion reflection.

• Journal of Internet Computing and Services
• /
• v.16 no.6
• /
• pp.133-141
• /
• 2015

Mass multimedia contents are shared through various social media servies including social network service. As social network reveals user's current situation and interest, highly satisfactory personalized recommendation can be made when such features are applied to the recommendation system. In addition, classifying the music by emotion and using analyzed information about user's recent emotion or current situation by analyzing user's social network, it will be useful upon recommending music to the user. In this paper, we propose a music recommendation method that makes an emotion model to classify the music, classifies the music according to the emotion model, and extracts user's current emotional state represented on the social network to recommend music, and evaluates the validity of our method through experiments.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2011.04a
• /
• pp.689-691
• /
• 2011

Due to the rapid development of Information and communication, the technology of multimedia presentation technology is evolving into the service that user can actively, realistically enjoy and play based on user's preference and taste not only for User's passive service. Especially, the industry related the realistic multimedia service that supports targeting Human emotion with the property of Human hearing is expected to be formed of the high value-added premium market. Audio technology is affected on human's emotion and the viewing environment around than video technology. Also the audio technology compared to video technology is a research part that appeals to human emotion and emphasize on psychological aspects. With this viewpoint, the development of intelligent and realistic audio technology needs highly specialty. In this study, "intelligent real-sound presentation technology" that support high quality and realistic audio and the "core technologies" that are composing of this will be introduced.

• Science of Emotion and Sensibility
• /
• v.18 no.4
• /
• pp.47-58
• /
• 2015

Due to recent interest in user experience and its significance, much research surrounding this theme is now being conducted. If user experience is defined as the emotions and satisfaction the user feels while using the product, how much of such experience will contribute to the overall satisfaction of using the product? In this research, user experience during usage of a product and the satisfaction acquired by it were investigated. The same experiment was conducted in South Korea and the United States of America in order to get more generalized experimental results. Amongst the six representative user emotions expressed while using a product, 'Satisfaction in Usability', 'Discomfort or Displeasure', and 'Excellence' correlated the most. The above three factors were found to be of the most influence concerning satisfaction of the product. The significance of this finding is that aside from focusing on the attractiveness of the product's exteriors and design, one should be concerned on the ease of usage and effectiveness as well as usability of the product, all of which contribute to how efficiently a consumer will utilize the product.