• The Journal of Korea Robotics Society
• /
• v.5 no.1
• /
• pp.7-13
• /
• 2010

This paper presents the sound-based emotion estimation method and the growing HRI (human-robot interaction) system for a Mon-E robot. The method of emotion estimation uses the musical element based on the law of harmony and counterpoint. The emotion is estimated from sound using the information of musical elements which include chord, tempo, volume, harmonic and compass. In this paper, the estimated emotions display the standard 12 emotions including Eckman's 6 emotions (anger, disgust, fear, happiness, sadness, surprise) and the opposite 6 emotions (calmness, love, confidence, unhappiness, gladness, comfortableness) of those. The growing HRI system analyzes sensing information, estimated emotion and service log in an edutainment robot. So, it commands the behavior of the robot. The growing HRI system consists of the emotion client and the emotion server. The emotion client estimates the emotion from sound. This client not only transmits the estimated emotion and sensing information to the emotion server but also delivers response coming from the emotion server to the main program of the robot. The emotion server not only updates the rule table of HRI using information transmitted from the emotion client and but also transmits the response of the HRI to the emotion client. The proposed system was applied to a Mon-E robot and can supply friendly HRI service to users.

• Science of Emotion and Sensibility
• /
• v.20 no.1
• /
• pp.67-74
• /
• 2017

The goal of this study is to present quantification method for empathy. The micro-movement technology (non-contact sensing method) was used to identify empathy level. Participants were first divided into two groups: Empathized and not empathized. Then, the upper body data of participants were collected utilizing web-cam when participants carried expression tasks. The data were analyzed and categorized into 0.5 Hz, 1 Hz, 3 Hz, 5 Hz, 15 Hz. The average movement, variation, and synchronization of the movement were then compared. The results showed a low average movement and variation in a group who empathized. Also, the participants, who empathized, synchronized their movement during the task. This indicates that the people concentrates with each other when empathy has been established and show different levels of movement. These findings suggest the possibility of empathy quantification using non-contact sensing method.

• Journal of Digital Convergence
• /
• v.10 no.2
• /
• pp.287-292
• /
• 2012

In this paper, user personalized services through the emotion perception required to support location-based sensing data preprocessing techniques and emotion data preprocessing techniques is studied for user's emotion data building and preprocessing in V-A emotion model. For this purpose the granular context tree and string matching based emotion pattern matching techniques are used. In addition, context-aware and personalized recommendation services technique using probabilistic reasoning is studied for personalized services based on context awareness.

• Journal of Institute of Convergence Technology
• /
• v.1 no.2
• /
• pp.1-5
• /
• 2011

It is known that as many as 15-20 in 10,000 children are diagnosed with autistic spectrum disorder. A framework of the treatment system for children with autism using affective computing technologies was proposed by Chung and Yoon. In this paper, a prototype for the framework is proposed. It consists of emotion stimulating module, multi-modal bio-signal sensing module, treatment module using virtual reality, and emotion recognition module. Primitive experiments on emotion recognition show the usefulness of the proposed system.

• Science of Emotion and Sensibility
• /
• v.11 no.3
• /
• pp.419-426
• /
• 2008

In order to develop "textile electrode - sensing clothing" which is a sort of smart clothing to measure electric activities of heart, we propose possible ways to develop textile electrode and design of sensing clothing, ultimately aiming to develop "ECG sensing clothing for lifestyle monitoring". Conventional sensors for measuring typical electric activities of heart keep certain distance between measuring electrodes to measure signals for electric activities of heart, but these sensors often cause inappropriate factors (e.g. motional artifacts, inconvenience of use, etc) for monitoring natural cardiac activities in our daily life. In addition, most of textile electrodes have made it difficult to collect data due to high impedance and unstable contact between skin and electrodes. To overcome these questions, we minimized distance between electrodes and skin to maximize convenience of use. And in order to complement contact between skin electrodes, we modified textile electrode's form and developed ways to design clothing. As a result, we could find out clinical significance by investigating possible associations of clinical electrocardiogram (ECG) with variation of distance between electrodes, and could also demonstrate clinically significant associations between textile electrode developed herein and clothing.

• Science of Emotion and Sensibility
• /
• v.13 no.1
• /
• pp.235-242
• /
• 2010

Emotion science is one of the rapidly expanding engineering/scientific disciplines which has a major impact on human society. Such growing interests in emotion science and engineering owe the recent trend that various academic fields are being merged. In this paper we review the recent techniques in the measuring the emotion related elements and applications which include animal model system to investigate the neural network and behaviour, artificial nose/neuronal chip for in-depth understanding of sensing the outer stimuli, metabolic controlling using emotional stimulant such as sounds. In particular, microfabrication techniques made it possible to construct nano/micron scale sensing parts/chips to accommodate the olfactory cells and neuron cells and gave us a new opportunities to investigate the emotion precisely. Recent developments in the measurement techniques will be able to help combine the social sciences and natural sciences, and consequently expand the scope of studies.

• Journal of the Korea Convergence Society
• /
• v.8 no.6
• /
• pp.163-170
• /
• 2017

In this paper want to recognize competition and cooperation as a non-contact sensing method among the social emotion that are caused by interaction. Experiments were conducted in a pattern matching task divided into competition and cooperation situations. Data collection was performed by extracting the micro-movement data of 15Hz component from the upper body image. We compared and analyzed the amount and the variation and synchronization. As a result, Amount and variation are bigger in competition than cooperation. Synchronization was higher in cooperation than competition. This can be seen as the difference between two people trying to win when they are in competition and trying to breathe each other in cooperation. This study is significant in confirming the possibility of competition and cooperation through non contact sensing method based on physiological response.

• The Transactions of the Korean Institute of Electrical Engineers P
• /
• v.67 no.2
• /
• pp.100-105
• /
• 2018

In this paper, we determined the driver's stress and fatigue level through physiological signals of a driver in the connected car environment, accordingly designing and implementing the architecture of the connected cars' platforms needed to provide services to make the driving environments comfortable and reduce the driver's fatigue level. It includes a gateway between AVN and ECU for the vehicle control, a framework for native applications and web applications based on AVN, and a sensing device and an emotion estimation engine for application services. This paper will provide the element technologies for the connected car-based convergence services and their implementation methods, and reference models for the service design.

• Science of Emotion and Sensibility
• /
• v.20 no.3
• /
• pp.141-150
• /
• 2017

The purpose of this study was to analyze the effect of the shape and attached position of E-textile-based stretchable sensors on motion-sensing performance and to investigate the requirements for the optimal structure of clothes for sensing limb motions. An experimental garment was prepared with different sensor shapes, and attachment positions. A child subject, wearing the experimental garment, performed arm and leg bending and extension motions at $60^{\circ}$, $90^{\circ}$ and $120^{\circ}$ motion angles, at a rate of 60 deg/sec. The changes in voltage triggered by the stretching and contracting of the fabric-sensor were measured, and an acceleration sensor was utilized to verify that the experimental motions were correctly performed. Dummy arms and legs of a child were manufactured to perform an identical test, in order to compare the dummy results with the actual human body experiment results. The analysis showed that the reproducibility and reliability of the rectangular sensor, showing uniform and stable were higher than those of the boat-shaped sensor, in both the dummy and the human body experiments. The attachment position of the sensor was more reproducible and reliable when placed on 4 cm below the elbow and knee joints in the dummy test, when placed in the joints of the elbow and knee, in children experiment. The appropriate shapes and attached positions of the sensor for sensing the motions were analyzed, and the results proved that motion-sensing of the human body is possible by utilizing flexible fabric-sensors integrated into clothes.

• Science of Emotion and Sensibility
• /
• v.14 no.2
• /
• pp.221-226
• /
• 2011

Although diverse researches on sensing method of human movement have been performed, there are still many limitations to the existing methods. As a part of supplementing the limitations to the existing motion sensing methods, this study aimed to execute an exploratory examination on a POF-based sleeve-shaped motion sensor for less restrictive sensing of human movement. In this study, a set of POF-based motion sensor, which was embedded in a sleeve-shaped platform was devised, and a set of exploratory experiments was performed on the possibility of sensing of human movement as diverse as in daily life, through this device. The scope of this research was limited to an exploration on the possibility and basic elements of POF-based sleeve-shaped motion sensor, while the influence of sleeve patterns, those of wearer's somatotype, those of sewing method were not studied in this study. When compared to the pre-existing methods, the POF-based motion sensor platformed on sleeve in this study, which was purposively devised to be applied to the motion sensing clothing shows some beneficial characteristics : more sensitive measurement on human motion, low cost, no timely restriction in sensing, no request for gigantic apparatus and space for sensing.