System Development for Measuring Group Engagement in the Art Center

The Korean Culture Contents spread out to Worldwide, because the Korean wave is sweeping in the world. The contents stand in the middle of the Korean wave that we are used it. Each country is ongoing to keep their Culture industry improve the national brand and High added value. Performing contents is important factor of arousal in the enterprise industry. To improve high arousal confidence of product and positive attitude by populace is one of important factor by advertiser. Culture contents is the same situation. If culture contents have trusted by everyone, they will give information their around to spread word-of-mouth. So, many researcher study to measure for person's arousal analysis by statistical survey, physiological response, body movement and facial expression. First, Statistical survey has a problem that it is not possible to measure each person's arousal real time and we cannot get good survey result after they watched contents. Second, physiological response should be checked with surround because experimenter sets sensors up their chair or space by each of them. Additionally it is difficult to handle provided amount of information with real time from their sensor. Third, body movement is easy to get their movement from camera but it difficult to set up experimental condition, to measure their body language and to get the meaning. Lastly, many researcher study facial expression. They measures facial expression, eye tracking and face posed. Most of previous studies about arousal and interest are mostly limited to reaction of just one person and they have problems with application multi audiences. They have a particular method, for example they need room light surround, but set limits only one person and special environment condition in the laboratory. Also, we need to measure arousal in the contents, but is difficult to define also it is not easy to collect reaction by audiences immediately. Many audience in the theater watch performance. We suggest the system to measure multi-audience's reaction with real-time during performance. We use difference image analysis method for multi-audience but it weaks a dark field. To overcome dark environment during recoding IR camera can get the photo from dark area. In addition we present Multi-Audience Engagement Index (MAEI) to calculate algorithm which sources from sound, audience' movement and eye tracking value. Algorithm calculates audience arousal from the mobile survey, sound value, audience' reaction and audience eye's tracking. It improves accuracy of Multi-Audience Engagement Index, we compare Multi-Audience Engagement Index with mobile survey. And then it send the result to reporting system and proposal an interested persons. Mobile surveys are easy, fast, and visitors' discomfort can be minimized. Also additional information can be provided mobile advantage. Mobile application to communicate with the database, real-time information on visitors' attitudes focused on the content stored. Database can provide different survey every time based on provided information. The example shown in the survey are as follows: Impressive scene, Satisfied, Touched, Interested, Didn't pay attention and so on. The suggested system is combine as 3 parts. The system consist of three parts, External Device, Server and Internal Device. External Device can record multi-Audience in the dark field with IR camera and sound signal. Also we use survey with mobile application and send the data to ERD Server DB. The Server part's contain contents' data, such as each scene's weights value, group audience weights index, camera control program, algorithm and calculate Multi-Audience Engagement Index. Internal Device presents Multi-Audience Engagement Index with Web UI, print and display field monitor. Our system is test-operated by the Mogencelab in the DMC display exhibition hall which is located in the Sangam Dong, Mapo Gu, Seoul. We have still gotten from visitor daily. If we find this system audience arousal factor with this will be very useful to create contents.

공연장에서 다중 몰입도 측정을 위한 시스템 개발

몰입은 관람객이 콘텐츠를 관람할 때 관람객들이 콘텐츠에 몰두하고 있는 심리적 상태를 의미하는 것으로, 관람객의 몰입경험은 콘텐츠의 만족도에 긍정적인 영향을 미친다. 따라서 공연 같은 콘텐츠를 제공하는 기업들은 콘텐츠의 흥행을 위해 관람객의 몰입도를 측정하는 것은 매우 중요하다. 설문 등의 표본조사 방법을 통해 관람객의 몰입도를 측정 연구는 방송분야 등 에서 널리 사용되고 있다. 이러한 몰입도 측정방법은 콘텐츠 관람 이후 설문을 실시하기 때문에 몰입도를 실시간으로 측정할 수 없을 뿐만 아니라 몰입도 측정의 정확성이 저하되는 문제 등이 있다. 이러한 문제를 해결하기 위하여 생리적 반응이나 얼굴 표정 분석, 그리고 움직임 관찰 방법 등을 이용하여 몰입도를 측정하는 연구가 수행되고 있다. 생체 신호를 이용하여 몰입도를 측정하는 연구의 경우, 1인을 대상으로 생체신호를 측정할 뿐만 아니라, 많은 데이터 처리 시간과 비용이 소모되는 단점이 있어 많은 관람객이 관람하는 공연장에 적용하기에는 한계가 있다. 얼굴 표정인식 통해 몰입도를 측정하는 경우도 1인을 대상으로 하고 있으며, 밝은 조명의 실험실 환경에서만 가능하다는 단점이 존재한다. 또한 관람객들의 움직인 동기화를 이용하여 몰입도를 특정한 연구는 다중관객을 대상으로 하였지만, 이는 실험실 환경에 한정하여 적용된 사례이다. 따라서 본 연구에서는 공연장, 시사회관 등 많은 관람객들이 콘텐츠를 관람하는 실제 환경에서 다중관람객이 다중몰입도의 정량적 평가를 위한 시스템을 설계하고 개발하였다. 제안된 시스템은 외부장치, 서버, 내부장치 등의 3부분으로 구성되어 있다. 서울시 마포구 상암동에 위치한 DMC 홍보관에 상설 전시장으로 운영하고 있으며, 관람객들을 대상으로 데이터를 획득하고 있다. 제안하고 있는 시스템을 활용하면 콘텐츠의 어느 구간에서 관객들이 몰입을 하고 있는지, 어느 구간에서 몰입을 하고 있지 못한지 분석가능하기 때문에, 향후 콘텐츠 제작 및 마케팅에 유용하게 활용할 수 있을 것으로 기대된다.