• Journal of Korea Multimedia Society
• /
• v.20 no.10
• /
• pp.1646-1654
• /
• 2017

Pupil size variation can not be controlled intentionally by the user and includes various features such as the blinking frequency and the duration of a blink, so it is suitable for understanding the user's emotional state. In addition, an ocular feature based emotion classification method should be studied for virtual and augmented reality, which is expected to be applied to various fields. In this paper, we propose a novel emotion classification based on CNN with pupil size variation signals which include not only various ocular feature information but also time information. As a result, compared to previous studies using the same database, the proposed method showed improved results of 5.99% and 12.98% respectively from arousal and valence emotion classification.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.12 no.3
• /
• pp.438-444
• /
• 2008

In this study, we propose a automatic facial expression generation tool which can generate various facial expressions efficiently for animation characters expressing various emotion. For this purpose, 9 types of facial expressions were defined by adopting Russell's pleasure-displeasure and arousal-sleep coordinate values of infernal states. And by rendering specific coordinate values consisted of the two basic dimensions of emotion(i.e., dimensions of pleasure-displeasure and arousal-sleep) and their combination, the proposed automatic facial expression generation tool could yield various facial expressions which reflected subtle changes in characters' emotion. It is expected that the tool could provide useful method of generating character face with various emotion.

• Asia Marketing Journal
• /
• v.13 no.2
• /
• pp.99-130
• /
• 2011

In recent years, a new way of differentiating product design has emerged -better known as 'masterpiece marketing,' this is a strategy where famous art pieces are borrowed on to product designs. Because the recent trends of well-being and LOHAS have encouraged the consumers' desires to enjoy culture and live a more opulent lifestyle, famous and notable paintings have grown to be more of "approachable masterpieces" to the public. As a strategy intended to develop a new consumerism, while still prioritizing customers' values and their satisfaction, companies have been drawn to this new type of marketing. The current consumption society has converted renowned art pieces from simply works of 'high culture' to a further way of marketing, aimed to differentiate products and dominate the market. Though many products have had masterpieces applied to their designs and have been noticed for their marketability, there has been less systematic research done on the scientific background behind this marketing approach. This research focused on the art pieces' fundamental nature of inducing emotions in the viewer, and hypothesized about how the evaluation of a product may be influenced by the affect provoked by the art piece used. To be more specific, if art pieces with different levels of pleasure and arousal -the two axis of emotion suggested by existing research on emotion -were used on each product, the goal was to see how the different levels influenced the consumer's assessment of the products, focusing on product's type as well as the evaluation of their attributes. First, a pretest was done to verify the relationship between the emotion provoked by the art piece and the consumer's preference. There were two types of surveys, each with five drawings from the ten that were assumed to differ in levels of the two axis of emotion. The survey was composed of questions asking for positive emotion, negative emotion, level of arousal, and preference. The correlation between the measurements of positive and negative emotions was -0.792, so an integrated entry was used in the analysis by subtracting the measurement of negative emotions from that of positive emotions. The first hypothesis that paintings that provoke positive emotions will be more preferred than paintings that bring out negative emotions was supported; and through this research, paintings that were to be used for the products were selected. The second pretest was conducted to settle on an item that would be used in the research. Items meant to measure utilitarian and hedonic attributes of milk and chocolate, the two products to be used in the research, were extracted. Because milk is a utilitarian product with strong practical attributes while chocolate is a hedonic product with strong hedonic attributes, these two were selected to be used in this research. The first study was executed to see if there is a difference in attitude about products that have different painting on their designs, which either induces positive or negative emotions. It was also to verify whether this difference in attitude was mediated by the viewer's preference for the art piece. This study showed that when positive emotion inducing painting was used, the product was better evaluated compared to the product with a painting that provokes a negative emotion, thus supporting the second hypothesis. It was also supported that the effect of affect on product evaluation was mediated by preference for the art piece. The second study was done to see the influence of the level of arousal on the evaluation of the product's attributes. Art pieces that differ in the level of arousal were selected through the pretest, and later it verified the hypothesis that the level of arousal has an effect on the assessment of the attributes of the product. In the case of milk, a utilitarian product, the fourth hypothesis that a high-arousal painting will better evaluated for its hedonic attributes was supported, as well as the fifth, which hypothesized that a low-arousal painting will receive a higher assessment for its utilitarian attributes. However, for chocolate, a hedonic product, both fourth and fifth hypotheses were not supported. This study is significant for the following basis: first, it verified the importance of the emotion induced by the painting on the evaluation of the product's attributes, by applying a systematic and scientific method. Second, it expanded from the existing research on positive/negative emotions to confirm the additional influence of the state of arousal on product evaluation.

• Journal of Broadcast Engineering
• /
• v.27 no.5
• /
• pp.738-750
• /
• 2022

In this study, we reviewed and discussed whether auditory stimuli with short length can evoke emotion-related neurological responses. The findings implicate that if personalized sound tracks are provided to XR users based on machine learning or probability network models, user experiences in XR environment can be enhanced. We also investigated that the arousal-relaxed factor evoked by short auditory sound can make distinct patterns in functional connectivity characterized from background EEG signals. We found that coherence in the right hemisphere increases in sound-evoked arousal state, and vice versa in relaxed state. Our findings can be practically utilized in developing XR sound bio-feedback system which can provide preference sound to users for highly immersive XR experiences.

• Korean Journal of Child Studies
• /
• v.16 no.2
• /
• pp.97-112
• /
• 1995

The purpose of this study was to investigate the effect of selected internal and situational factors on children's prosocial behaviors. While child's sex and trait empathy were chosen as internal factors, state empathy and social evaluation were regarded as situational factors. The subjects were 72 bays and 72 girls chosen from 288 eleven-year-olds. This selection was based on their emplathic scores measured by the Bryant Empathy Scale (1982). Half of the 144 children belonged to the high-trait empathic group and the other half to the low-trait empathic group. Within each of the high-and the low-trait empathic groups, equal numbers of boys and girls were randomly assigned to one of the two state empathy conditions and two social evaluation conditions. The state empathy conditions were divided into the arousal condition and the disregarding condition. To control social evaluation, subjects were led to believe that the experimenter either would or would not evaluate their donation of colorful ball-point pens to handicapped children. The data was analyzed by 4-way ANOVA [sex(2)${\times}$trait empathy(2)${\times}$state empathy(2)${\times}$social evaluation(2)]. The results were that (1) children's prosocial behaviors were significantly different by sex, state empathy, and social evaluation, and (2) children's prosocial behaviors were not significantly different by their trait empathy level.

• Sleep Medicine and Psychophysiology
• /
• v.4 no.1
• /
• pp.49-56
• /
• 1997

Nocturnal panic involves sudden awakening from sleep in a state of panic characterized by various somatic sensation of sympathetic arousal and intense fear. Many(18-71%) of the spontaneous panic attacks tend to occur from a sleeping state unrelated to the situational and cognitive context. Nocturnal panickers experienced daytime panics and general somatic sensation more frequently than other panickers. Despite frequent distressing symptoms, these patients tend to exhibit little social or occupational impairment and minimal agoraphobia and have a high lifetime incidence of major depression and a good response to tricyclic antidepressants. Sleep panic attacks arise from non-REM sleep, late stage 2 or early stage 3. The pathophysiology and the similarity of nocturnal panic to sleep apnea, dream-induced anxiety attacks, night terrors, sleep paralysis, and temporal lobe epilepsy are discussed.

• Journal of Intelligence and Information Systems
• /
• v.20 no.1
• /
• pp.1-14
• /
• 2014

Both researchers and practitioners are showing an increased interested in interactive exhibition services. Interactive exhibition services are designed to directly respond to visitor responses in real time, so as to fully engage visitors' interest and enhance their satisfaction. In order to install an effective interactive exhibition service, it is essential to adopt intelligent technologies that enable accurate estimation of a visitor's emotional state from responses to exhibited stimulus. Studies undertaken so far have attempted to estimate the human emotional state, most of them doing so by gauging either facial expressions or audio responses. However, the most recent research suggests that, a multimodal approach that uses people's multiple responses simultaneously may lead to better estimation. Given this context, we propose a new multimodal emotional state estimation model that uses various responses including facial expressions, gestures, and movements measured by the Microsoft Kinect Sensor. In order to effectively handle a large amount of sensory data, we propose to use stratified sampling-based MRA (multiple regression analysis) as our estimation method. To validate the usefulness of the proposed model, we collected 602,599 responses and emotional state data with 274 variables from 15 people. When we applied our model to the data set, we found that our model estimated the levels of valence and arousal in the 10~15% error range. Since our proposed model is simple and stable, we expect that it will be applied not only in intelligent exhibition services, but also in other areas such as e-learning and personalized advertising.

• Journal of Intelligence and Information Systems
• /
• v.18 no.1
• /
• pp.39-57
• /
• 2012

Recently, due to the introduction of high-tech equipment in interactive exhibits, many people's attention has been concentrated on Interactive exhibits that can double the exhibition effect through the interaction with the audience. In addition, it is also possible to measure a variety of audience reaction in the interactive exhibition. Among various audience reactions, this research uses the change of the facial features that can be collected in an interactive exhibition space. This research develops an artificial neural network-based prediction model to predict the response of the audience by measuring the change of the facial features when the audience is given stimulation from the non-excited state. To present the emotion state of the audience, this research uses a Valence-Arousal model. So, this research suggests an overall framework composed of the following six steps. The first step is a step of collecting data for modeling. The data was collected from people participated in the 2012 Seoul DMC Culture Open, and the collected data was used for the experiments. The second step extracts 64 facial features from the collected data and compensates the facial feature values. The third step generates independent and dependent variables of an artificial neural network model. The fourth step extracts the independent variable that affects the dependent variable using the statistical technique. The fifth step builds an artificial neural network model and performs a learning process using train set and test set. Finally the last sixth step is to validate the prediction performance of artificial neural network model using the validation data set. The proposed model is compared with statistical predictive model to see whether it had better performance or not. As a result, although the data set in this experiment had much noise, the proposed model showed better results when the model was compared with multiple regression analysis model. If the prediction model of audience reaction was used in the real exhibition, it will be able to provide countermeasures and services appropriate to the audience's reaction viewing the exhibits. Specifically, if the arousal of audience about Exhibits is low, Action to increase arousal of the audience will be taken. For instance, we recommend the audience another preferred contents or using a light or sound to focus on these exhibits. In other words, when planning future exhibitions, planning the exhibition to satisfy various audience preferences would be possible. And it is expected to foster a personalized environment to concentrate on the exhibits. But, the proposed model in this research still shows the low prediction accuracy. The cause is in some parts as follows : First, the data covers diverse visitors of real exhibitions, so it was difficult to control the optimized experimental environment. So, the collected data has much noise, and it would results a lower accuracy. In further research, the data collection will be conducted in a more optimized experimental environment. The further research to increase the accuracy of the predictions of the model will be conducted. Second, using changes of facial expression only is thought to be not enough to extract audience emotions. If facial expression is combined with other responses, such as the sound, audience behavior, it would result a better result.

• Journal of Distribution Research
• /
• v.17 no.2
• /
• pp.63-92
• /
• 2012

This study investigated consumer intention to use a location-based mobile shopping service (LBMSS) that integrates cognitive and affective responses. Information relevancy was integrated into pleasure-arousal-dominance (PAD) emotional state model in the present study as a conceptual framework. The results of an online survey of 335 mobile phone users in the U.S. indicated the positive effects of arousal and information relevancy on pleasure. In addition, there was a significant relationship between pleasure and intention to use a LBMSS. However, the relationship between dominance and pleasure was not statistically significant. The results of the present study provides insight to retailers and marketers as to what factors they need to consider to implement location-based mobile shopping services to improve their business performance. Extended Abstract : Location aware technology has expanded the marketer's reach by reducing space and time between a consumer's receipt of advertising and purchase, offering real-time information and coupons to consumers in purchasing situations (Dickenger and Kleijnen, 2008; Malhotra and Malhotra, 2009). LBMSS increases the relevancy of SMS marketing by linking advertisements to a user's location (Bamba and Barnes, 2007; Malhotra and Malhotra, 2009). This study investigated consumer intention to use a location-based mobile shopping service (LBMSS) that integrates cognitive and affective response. The purpose of the study was to examine the relationship among information relevancy and affective variables and their effects on intention to use LBMSS. Thus, information relevancy was integrated into pleasure-arousal-dominance (PAD) model and generated the following hypotheses. Hypothesis 1. There will be a positive influence of arousal concerning LBMSS on pleasure in regard to LBMSS. Hypothesis 2. There will be a positive influence of dominance in LBMSS on pleasure in regard to LBMSS. Hypothesis 3. There will be a positive influence of information relevancy on pleasure in regard to LBMSS. Hypothesis 4. There will be a positive influence of pleasure about LBMSS on intention to use LBMSS. E-mail invitations were sent out to a randomly selected sample of three thousand consumers who are older than 18 years old and mobile phone owners, acquired from an independent marketing research company. An online survey technique was employed utilizing Dillman's (2000) online survey method and follow-ups. A total of 335 valid responses were used for the data analysis in the present study. Before the respondents answer any of the questions, they were told to read a document describing LBMSS. The document included definitions and examples of LBMSS provided by various service providers. After that, they were exposed to a scenario describing the participant as taking a saturday shopping trip to a mall and then receiving a short message from the mall. The short message included new product information and coupons for same day use at participating stores. They then completed a questionnaire containing various questions. To assess arousal, dominance, and pleasure, we adapted and modified scales used in the previous studies in the context of location-based mobile shopping service, each of the five items from Mehrabian and Russell (1974). A total of 15 items were measured on a seven-point bipolar scale. To measure information relevancy, four items were borrowed from Mason et al. (1995). Intention to use LBMSS was captured using two items developed by Blackwell, and Miniard (1995) and one items developed by the authors. Data analyses were conducted using SPSS 19.0 and LISREL 8.72. A total of usable 335 data were obtained after deleting the incomplete responses, which results in a response rate of 11.20%. A little over half of the respondents were male (53.9%) and approximately 60% of respondents were married (57.4%). The mean age of the sample was 29.44 years with a range from 19 to 60 years. In terms of the ethnicity there were European Americans (54.5%), Hispanic American (5.3%), African-American (3.6%), and Asian American (2.9%), respectively. The respondents were highly educated; close to 62.5% of participants in the study reported holding a college degree or its equivalent and 14.5% of the participants had graduate degree. The sample represents all income categories: less than $24,999 (10.8%), $25,000-$49,999 (28.34%), $50,000-$74,999 (13.8%), and $75,000 or more (10.23%). The respondents of the study indicated that they were employed in many occupations. Responses came from all 42 states in the U.S. To identify the dimensions of research constructs, Exploratory Factor Analysis (EFA) using a varimax rotation was conducted. As indicated in table 1, these dimensions: arousal, dominance, relevancy, pleasure, and intention to use, suggested by the EFA, explained 82.29% of the total variance with factor loadings ranged from .74 to .89. As a next step, CFA was conducted to validate the dimensions that were identified from the exploratory factor analysis and to further refine the scale. Table 1 exhibits the results of measurement model analysis and revealed a chi-square of 202.13 with degree-of-freedom of 89 (p =.002), GFI of .93, AGFI = .89, CFI of .99, NFI of .98, which indicates of the evidence of a good model fit to the data (Bagozzi and Yi, 1998; Hair et al., 1998). As table 1 shows, reliability was estimated with Cronbach's alpha and composite reliability (CR) for all multi-item scales. All the values met evidence of satisfactory reliability in multi-item measure for alpha (>.91) and CR (>.80). In addition, we tested the convergent validity of the measure using average variance extracted (AVE) by following recommendations from Fornell and Larcker (1981). The AVE values for the model constructs ranged from .74 through .85, which are higher than the threshold suggested by Fornell and Larcker (1981). To examine discriminant validity of the measure, we again followed the recommendations from Fornell and Larcker (1981). The shared variances between constructs were smaller than the AVE of the research constructs and confirm discriminant validity of the measure. The causal model testing was conducted using LISREL 8.72 with a maximum-likelihood estimation method. Table 2 shows the results of the hypotheses testing. The results for the conceptual model revealed good overall fit for the proposed model. Chi-square was 342.00 (df = 92, p =.000), NFI was .97, NNFI was .97, GFI was .89, AGFI was .83, and RMSEA was .08. All paths in the proposed model received significant statistical support except H2. The paths from arousal to pleasure (H1: ${\ss}$=.70; t = 11.44), from information relevancy to intention to use (H3 ${\ss}$ =.12; t = 2.36), from information relevancy to pleasure (H4 ${\ss}$ =.15; t = 2.86), and pleasure to intention to use (H5: ${\ss}$=.54; t = 9.05) were significant. However, the path from dominance to pleasure was not supported. This study investigated consumer intention to use a location-based mobile shopping service (LBMSS) that integrates cognitive and affective responses. Information relevancy was integrated into pleasure-arousal-dominance (PAD) emotional state model as a conceptual framework. The results of the present study support previous studies indicating that emotional responses as well as cognitive responses have a strong impact on accepting new technology. The findings of this study suggest potential marketing strategies to mobile service developers and retailers who are considering the implementation of LBMSS. It would be rewarding to develop location-based mobile services that integrate information relevancy and which cause positive emotional responses.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.18 no.2
• /
• pp.374-382
• /
• 2017

The aim of this study was to evaluate the effectiveness of belly button healing by measuring the EEG activity after developing and applying belly button healing to high school students. This study was conducted on 19 high school students (8 boys and 11 girls). The students who participated in this study underwent belly button healing for about 5 minutes twice per daily (morning and evening) for 2 weeks. In this experiment, an electroencephalogram (EEG) of the subject was measured in a state of arousal and steady state and the change in EEG was observed during the stroop task. Subsequently, belly button healing was performed for about 5 minutes with a one minute break and the same procedure was then repeated. As a result of the study, the reduction of the M-Beta wave, H-Beta wave and Gamma wave was lower compared to the arousal state due to the navel healing program. The reduction of the Alpha wave and SMR wave also was decreased compared to the steady state by the navel healing program. This suggests that belly button healing has improved the concentration, immersion, and psychological stability of the subjects in stress situations. This is consistent with the participants' interviews after the research. The conclusions of this study are as follows. First, because belly button healing is effective in relieving stress in high school students, such a program will be needed for students who are experiencing academic stress. Second, because belly button healing can help increase high school students' concentration, it is recommended to implement belly button healing before addressing certain complex or difficult tasks.