• Journal of the Korea Society of Computer and Information
• /
• v.20 no.2
• /
• pp.47-54
• /
• 2015

Emotional reaction of audience can be decided by observing reaction of audience for content. We can use a method to analyze visual data from video camera to detect reaction of audience fast and economically. This paper proposes the method and system to observe audience reaction from visual data of audience and define via neural network. Also we propose a new method to detect automatically an area for audience reaction with face detection to improve a fixed area assignment method which has a limitation not to adapt depending on audiences. Additionally, the evaluation is implemented to show that the proposed method and system is effective. The proposed method showed the performance elevation of 10.5 % (7.75 hit ration) compared to a fixed area assignment method.

• Journal of Intelligence and Information Systems
• /
• v.19 no.1
• /
• pp.79-94
• /
• 2013

Recently, the high value added business is steadily growing in the culture and art area. To generated high value from a performance, the satisfaction of audience is necessary. The flow in a critical factor for satisfaction, and it should be induced from audience and measures. To evaluate interest and emotion of audience on contents, producers or investors need a kind of index for the measurement of the flow. But it is neither easy to define the flow quantitatively, nor to collect audience's reaction immediately. The previous studies of the group flow were evaluated by the sum of the average value of each person's reaction. The flow or "good feeling" from each audience was extracted from his face, especially, the change of his (or her) expression and body movement. But it was not easy to handle the large amount of real-time data from each sensor signals. And also it was difficult to set experimental devices, in terms of economic and environmental problems. Because, all participants should have their own personal sensor to check their physical signal. Also each camera should be located in front of their head to catch their looks. Therefore we need more simple system to analyze group flow. This study provides the method for measurement of audiences flow with group synchronization at same time and place. To measure the synchronization, we made real-time processing system using the Differential Image and Group Emotion Analysis (GEA) system. Differential Image was obtained from camera and by the previous frame was subtracted from present frame. So the movement variation on audience's reaction was obtained. And then we developed a program, GEX(Group Emotion Analysis), for flow judgment model. After the measurement of the audience's reaction, the synchronization is divided as Dynamic State Synchronization and Static State Synchronization. The Dynamic State Synchronization accompanies audience's active reaction, while the Static State Synchronization means to movement of audience. The Dynamic State Synchronization can be caused by the audience's surprise action such as scary, creepy or reversal scene. And the Static State Synchronization was triggered by impressed or sad scene. Therefore we showed them several short movies containing various scenes mentioned previously. And these kind of scenes made them sad, clap, and creepy, etc. To check the movement of audience, we defined the critical point, ${\alpha}$and ${\beta}$. Dynamic State Synchronization was meaningful when the movement value was over critical point ${\beta}$, while Static State Synchronization was effective under critical point ${\alpha}$. ${\beta}$ is made by audience' clapping movement of 10 teams in stead of using average number of movement. After checking the reactive movement of audience, the percentage(%) ratio was calculated from the division of "people having reaction" by "total people". Total 37 teams were made in "2012 Seoul DMC Culture Open" and they involved the experiments. First, they followed induction to clap by staff. Second, basic scene for neutralize emotion of audience. Third, flow scene was displayed to audience. Forth, the reversal scene was introduced. And then 24 teams of them were provided with amuse and creepy scenes. And the other 10 teams were exposed with the sad scene. There were clapping and laughing action of audience on the amuse scene with shaking their head or hid with closing eyes. And also the sad or touching scene made them silent. If the results were over about 80%, the group could be judged as the synchronization and the flow were achieved. As a result, the audience showed similar reactions about similar stimulation at same time and place. Once we get an additional normalization and experiment, we can obtain find the flow factor through the synchronization on a much bigger group and this should be useful for planning contents.

• The Journal of the Korea Contents Association
• /
• v.13 no.3
• /
• pp.54-64
• /
• 2013

This study is on Hollywood's latest romantic comedy movie , attempted to identify whether nationality or gender difference of the movie audience is affecting on their acceptance to the genre characteristics of Hollywood's romantic comedy. Most of Hollywood's romantic comedy movies are centered on attraction of female and male actors and its' formulated plot (boy-meets-girl, boy-loses-girl, boy-gets-girl structure). Although the movie is following the formulated romantic comedy plot, it shows a variation from the typical romantic comedy genre. In this thesis, based on audience research data, statistics and interrelationship analysis on audience value orientation, we elucidate how Korean and American, Female and Male movie audience have different preference to actors and characters in the movie and representation of archetypal Hollywood romantic comedy happy ending such as propose and wedding scenes.

• Journal of Intelligence and Information Systems
• /
• v.17 no.2
• /
• pp.109-117
• /
• 2011

The exhibition industry, as technology-intensive, eco-friendly industry, contributes to regional and national development and enhancement of its image as well, if it joins cultural and tourist industry. Therefore, We need to revitalize the exhibition industry, as actively holding an exhibition event. However, to attract a number of exhibition audience, the work of enhancing audience satisfaction and awareness of value for participation should be prioritized after improving quality of service within exhibition hall. As one way to enhance the quality of service, it is thought that the way providing personalized service geared toward each audience is needed. that is, if audience avoids the complexity in exhibition space and it affords them service to enable effective time and space management, it will improve the satisfaction. All such personalized service affordable lets the audience's preference on the basis of each audience profile registered in advance online grasp. and Based on this information, it is provided with exhibition-related information suited their purpose that is the booth for the interesting audience, the shortest path to go to the booth and event via audience's smart phone. and it collects audience's reaction information, such as visiting the booth, participating the event through offered the information in this way and location information for the flow of movement, the present position so that it makes revision of existing each audience profile. After correcting the information, it extracts the individual's preference. hereunder, it provides recommend booth and event information. in other words, it provides optimal information for individual by amendment based on reaction information about recommending information built on basic profile. It provides personalized service dynamic and interactive with audience. This paper will be able to provide the most suitable information for each audience through circular and interactive structure and designed smart-phone application supportable for updating dynamic and interactive personalized service that is able to afford surrounding information in real time, as locating movement position through sensing. The proposed application collects user‘s context information and carrys information gathering function collecting the reaction about searched or provided information via sensing. and it also carrys information gathering function providing needed data for user in exhibition hall. In other words, it offers information about recommend booth of position foundation for user, location-based services of recommend booth and involves service providing detailed information for inside exhibition by using service of augmented reality, the map of whole exhibition as well. and it is also provided with SNS service that is able to keep information exchange besides intimacy. To provide this service, application is consisted of several module. first of all, it includes UNS identity module for sensing, and contain sensor information gathering module handling and collecting the perceived information through this module. Sensor information gathered like this transmits the information gathering server. and there is exhibition information interfacing with user and this module transmits to interesting information collection module through user's reaction besides interface. Interesting information collection module transmits collected information and If valid information out of the information gathering server that brings together sensing information and interesting information is sent to recommend server, the recommend server makes recommend information through inference with gathered valid information. If this server transmit by exhibition information process, exhibition information process module is provided with user by interface. Through this system it raises the dynamic, intelligent personalized service for user.

• Journal of Intelligence and Information Systems
• /
• v.18 no.1
• /
• pp.39-57
• /
• 2012

Recently, due to the introduction of high-tech equipment in interactive exhibits, many people's attention has been concentrated on Interactive exhibits that can double the exhibition effect through the interaction with the audience. In addition, it is also possible to measure a variety of audience reaction in the interactive exhibition. Among various audience reactions, this research uses the change of the facial features that can be collected in an interactive exhibition space. This research develops an artificial neural network-based prediction model to predict the response of the audience by measuring the change of the facial features when the audience is given stimulation from the non-excited state. To present the emotion state of the audience, this research uses a Valence-Arousal model. So, this research suggests an overall framework composed of the following six steps. The first step is a step of collecting data for modeling. The data was collected from people participated in the 2012 Seoul DMC Culture Open, and the collected data was used for the experiments. The second step extracts 64 facial features from the collected data and compensates the facial feature values. The third step generates independent and dependent variables of an artificial neural network model. The fourth step extracts the independent variable that affects the dependent variable using the statistical technique. The fifth step builds an artificial neural network model and performs a learning process using train set and test set. Finally the last sixth step is to validate the prediction performance of artificial neural network model using the validation data set. The proposed model is compared with statistical predictive model to see whether it had better performance or not. As a result, although the data set in this experiment had much noise, the proposed model showed better results when the model was compared with multiple regression analysis model. If the prediction model of audience reaction was used in the real exhibition, it will be able to provide countermeasures and services appropriate to the audience's reaction viewing the exhibits. Specifically, if the arousal of audience about Exhibits is low, Action to increase arousal of the audience will be taken. For instance, we recommend the audience another preferred contents or using a light or sound to focus on these exhibits. In other words, when planning future exhibitions, planning the exhibition to satisfy various audience preferences would be possible. And it is expected to foster a personalized environment to concentrate on the exhibits. But, the proposed model in this research still shows the low prediction accuracy. The cause is in some parts as follows : First, the data covers diverse visitors of real exhibitions, so it was difficult to control the optimized experimental environment. So, the collected data has much noise, and it would results a lower accuracy. In further research, the data collection will be conducted in a more optimized experimental environment. The further research to increase the accuracy of the predictions of the model will be conducted. Second, using changes of facial expression only is thought to be not enough to extract audience emotions. If facial expression is combined with other responses, such as the sound, audience behavior, it would result a better result.

• Journal of Intelligence and Information Systems
• /
• v.20 no.3
• /
• pp.45-58
• /
• 2014

The Korean Culture Contents spread out to Worldwide, because the Korean wave is sweeping in the world. The contents stand in the middle of the Korean wave that we are used it. Each country is ongoing to keep their Culture industry improve the national brand and High added value. Performing contents is important factor of arousal in the enterprise industry. To improve high arousal confidence of product and positive attitude by populace is one of important factor by advertiser. Culture contents is the same situation. If culture contents have trusted by everyone, they will give information their around to spread word-of-mouth. So, many researcher study to measure for person's arousal analysis by statistical survey, physiological response, body movement and facial expression. First, Statistical survey has a problem that it is not possible to measure each person's arousal real time and we cannot get good survey result after they watched contents. Second, physiological response should be checked with surround because experimenter sets sensors up their chair or space by each of them. Additionally it is difficult to handle provided amount of information with real time from their sensor. Third, body movement is easy to get their movement from camera but it difficult to set up experimental condition, to measure their body language and to get the meaning. Lastly, many researcher study facial expression. They measures facial expression, eye tracking and face posed. Most of previous studies about arousal and interest are mostly limited to reaction of just one person and they have problems with application multi audiences. They have a particular method, for example they need room light surround, but set limits only one person and special environment condition in the laboratory. Also, we need to measure arousal in the contents, but is difficult to define also it is not easy to collect reaction by audiences immediately. Many audience in the theater watch performance. We suggest the system to measure multi-audience's reaction with real-time during performance. We use difference image analysis method for multi-audience but it weaks a dark field. To overcome dark environment during recoding IR camera can get the photo from dark area. In addition we present Multi-Audience Engagement Index (MAEI) to calculate algorithm which sources from sound, audience' movement and eye tracking value. Algorithm calculates audience arousal from the mobile survey, sound value, audience' reaction and audience eye's tracking. It improves accuracy of Multi-Audience Engagement Index, we compare Multi-Audience Engagement Index with mobile survey. And then it send the result to reporting system and proposal an interested persons. Mobile surveys are easy, fast, and visitors' discomfort can be minimized. Also additional information can be provided mobile advantage. Mobile application to communicate with the database, real-time information on visitors' attitudes focused on the content stored. Database can provide different survey every time based on provided information. The example shown in the survey are as follows: Impressive scene, Satisfied, Touched, Interested, Didn't pay attention and so on. The suggested system is combine as 3 parts. The system consist of three parts, External Device, Server and Internal Device. External Device can record multi-Audience in the dark field with IR camera and sound signal. Also we use survey with mobile application and send the data to ERD Server DB. The Server part's contain contents' data, such as each scene's weights value, group audience weights index, camera control program, algorithm and calculate Multi-Audience Engagement Index. Internal Device presents Multi-Audience Engagement Index with Web UI, print and display field monitor. Our system is test-operated by the Mogencelab in the DMC display exhibition hall which is located in the Sangam Dong, Mapo Gu, Seoul. We have still gotten from visitor daily. If we find this system audience arousal factor with this will be very useful to create contents.

• The Journal of the Korea Contents Association
• /
• v.16 no.9
• /
• pp.600-611
• /
• 2016

This study examined the impacts of types of titles of artworks, especially 'untitled', on audience reponse. Generally, naming can be a tool to represent characteristics of objects, affecting their market value and price. Since contemporary artworks are often untitled, this study aimed to investigate how naming 'untitled' would affect audience response. As the size of arts market increasing, how the audience, potential buyer of artworks, responds to artworks is important. Based on prior research, we hypothesized that the audience would have different level of understanding, attention, attractiveness and curiosity to untitled artworks, controlling other factors. In the regression results from the data of 305 respondents, we found that people had significantly lower level of understanding and attention on untitled artworks than on artworks of explanatory or associative titles. In addition, respondents showed significantly higher level of curiosity when the artwork was an painting. This study confirmed the assertions of prior research that titles are indeed important, and further implied that artwork creators should be more concerned on naming their artworks since titles as well as artworks themselves could actually affect audience response.

• The Journal of the Korea Contents Association
• /
• v.18 no.5
• /
• pp.311-318
• /
• 2018

This paper presents the artistic background and implementation structure of a conversational artificial intelligence interactive artwork, "An Evolving GAIA". Recent artworks based on artificial intelligence technology are introduced. Development of biomimetics and artificial life technology has burred differentiation of machine and human. In this paper, artworks presenting machine-life metaphor are shown, and the distinct implementation of conversation system is emphasized in detail. The artwork recognizes and follows the movement of audience using its eyes for natural interaction. It listens questions of the audience and replies appropriate answers by text-to-speech voice, using the conversation system implemented with an Android client in the artwork and a webserver based on the question-answering dictionary. The interaction gives to the audience discussion of meaning of life in large scale and draws sympathy for the artwork itself. The paper shows the mechanical structure, the implementation of conversational system of the artwork, and reaction of the audience which can be helpful to direct and make future artificial intelligence interactive artworks.

• The Journal of the Korea Contents Association
• /
• v.21 no.7
• /
• pp.13-19
• /
• 2021

While watching the movie, the audience shows various emotional reactions. Emotional reactions such as sadness and anger, joy and anger appear depending on the storyline of the film. This aspect can be seen through the audience's brain wave response. This study is to examine the relationship between the movie story development and the movie story development through brain wave measurement of the emotional reaction of the audience in situations and events occurring in the movie development. Four American films, which represent each genre and are well known to many people, were selected for the study. These are of the adventure genre, of the animation genre, of the action genre, and of the drama genre. In order to measure the emotional response of these movies, four cases were set centered on the PPG of EEG and analyzed as a time series graph pattern. It can be seen that the emotional response on the graph has a certain relationship with the story development. It is expected that this study will help in selecting a genre when making a movie in the future, especially when deciding how to compose and develop a story, and it will help to induce the emotions of the audience.

• Journal of Digital Convergence
• /
• v.18 no.12
• /
• pp.533-541
• /
• 2020

This study aims for investigating the consumers' reaction to the New Hanbok Style of K-pop idol groups. We collected YouTube videos and user comments that include 'Black Pink New Hanbok' as a keyword, applying social network analysis and sentiment analysis. First, the New Hanbok of Black Pink was designed as a mini-dress to make it easier to dance and turned out that it reinterpreted traditional elements modernly. Second, the issue about revealing costumes appeared as a keyword in domestic reactions, it did not appear in international reaction. Third, as a result of sentiment analysis, international audience viewed New Hanbok outfit more positively than domestic audience. This study is significant in that it suggests the direction to which New Hanbok should head to by investigating extensive consumers' reaction and finding out the positive and negative elements of New Hanbok.