DOI QR코드

DOI QR Code

공연장에서 다중 몰입도 측정을 위한 시스템 개발

System Development for Measuring Group Engagement in the Art Center

  • 투고 : 2014.02.28
  • 심사 : 2014.07.04
  • 발행 : 2014.09.30

초록

몰입은 관람객이 콘텐츠를 관람할 때 관람객들이 콘텐츠에 몰두하고 있는 심리적 상태를 의미하는 것으로, 관람객의 몰입경험은 콘텐츠의 만족도에 긍정적인 영향을 미친다. 따라서 공연 같은 콘텐츠를 제공하는 기업들은 콘텐츠의 흥행을 위해 관람객의 몰입도를 측정하는 것은 매우 중요하다. 설문 등의 표본조사 방법을 통해 관람객의 몰입도를 측정 연구는 방송분야 등 에서 널리 사용되고 있다. 이러한 몰입도 측정방법은 콘텐츠 관람 이후 설문을 실시하기 때문에 몰입도를 실시간으로 측정할 수 없을 뿐만 아니라 몰입도 측정의 정확성이 저하되는 문제 등이 있다. 이러한 문제를 해결하기 위하여 생리적 반응이나 얼굴 표정 분석, 그리고 움직임 관찰 방법 등을 이용하여 몰입도를 측정하는 연구가 수행되고 있다. 생체 신호를 이용하여 몰입도를 측정하는 연구의 경우, 1인을 대상으로 생체신호를 측정할 뿐만 아니라, 많은 데이터 처리 시간과 비용이 소모되는 단점이 있어 많은 관람객이 관람하는 공연장에 적용하기에는 한계가 있다. 얼굴 표정인식 통해 몰입도를 측정하는 경우도 1인을 대상으로 하고 있으며, 밝은 조명의 실험실 환경에서만 가능하다는 단점이 존재한다. 또한 관람객들의 움직인 동기화를 이용하여 몰입도를 특정한 연구는 다중관객을 대상으로 하였지만, 이는 실험실 환경에 한정하여 적용된 사례이다. 따라서 본 연구에서는 공연장, 시사회관 등 많은 관람객들이 콘텐츠를 관람하는 실제 환경에서 다중관람객이 다중몰입도의 정량적 평가를 위한 시스템을 설계하고 개발하였다. 제안된 시스템은 외부장치, 서버, 내부장치 등의 3부분으로 구성되어 있다. 서울시 마포구 상암동에 위치한 DMC 홍보관에 상설 전시장으로 운영하고 있으며, 관람객들을 대상으로 데이터를 획득하고 있다. 제안하고 있는 시스템을 활용하면 콘텐츠의 어느 구간에서 관객들이 몰입을 하고 있는지, 어느 구간에서 몰입을 하고 있지 못한지 분석가능하기 때문에, 향후 콘텐츠 제작 및 마케팅에 유용하게 활용할 수 있을 것으로 기대된다.

The Korean Culture Contents spread out to Worldwide, because the Korean wave is sweeping in the world. The contents stand in the middle of the Korean wave that we are used it. Each country is ongoing to keep their Culture industry improve the national brand and High added value. Performing contents is important factor of arousal in the enterprise industry. To improve high arousal confidence of product and positive attitude by populace is one of important factor by advertiser. Culture contents is the same situation. If culture contents have trusted by everyone, they will give information their around to spread word-of-mouth. So, many researcher study to measure for person's arousal analysis by statistical survey, physiological response, body movement and facial expression. First, Statistical survey has a problem that it is not possible to measure each person's arousal real time and we cannot get good survey result after they watched contents. Second, physiological response should be checked with surround because experimenter sets sensors up their chair or space by each of them. Additionally it is difficult to handle provided amount of information with real time from their sensor. Third, body movement is easy to get their movement from camera but it difficult to set up experimental condition, to measure their body language and to get the meaning. Lastly, many researcher study facial expression. They measures facial expression, eye tracking and face posed. Most of previous studies about arousal and interest are mostly limited to reaction of just one person and they have problems with application multi audiences. They have a particular method, for example they need room light surround, but set limits only one person and special environment condition in the laboratory. Also, we need to measure arousal in the contents, but is difficult to define also it is not easy to collect reaction by audiences immediately. Many audience in the theater watch performance. We suggest the system to measure multi-audience's reaction with real-time during performance. We use difference image analysis method for multi-audience but it weaks a dark field. To overcome dark environment during recoding IR camera can get the photo from dark area. In addition we present Multi-Audience Engagement Index (MAEI) to calculate algorithm which sources from sound, audience' movement and eye tracking value. Algorithm calculates audience arousal from the mobile survey, sound value, audience' reaction and audience eye's tracking. It improves accuracy of Multi-Audience Engagement Index, we compare Multi-Audience Engagement Index with mobile survey. And then it send the result to reporting system and proposal an interested persons. Mobile surveys are easy, fast, and visitors' discomfort can be minimized. Also additional information can be provided mobile advantage. Mobile application to communicate with the database, real-time information on visitors' attitudes focused on the content stored. Database can provide different survey every time based on provided information. The example shown in the survey are as follows: Impressive scene, Satisfied, Touched, Interested, Didn't pay attention and so on. The suggested system is combine as 3 parts. The system consist of three parts, External Device, Server and Internal Device. External Device can record multi-Audience in the dark field with IR camera and sound signal. Also we use survey with mobile application and send the data to ERD Server DB. The Server part's contain contents' data, such as each scene's weights value, group audience weights index, camera control program, algorithm and calculate Multi-Audience Engagement Index. Internal Device presents Multi-Audience Engagement Index with Web UI, print and display field monitor. Our system is test-operated by the Mogencelab in the DMC display exhibition hall which is located in the Sangam Dong, Mapo Gu, Seoul. We have still gotten from visitor daily. If we find this system audience arousal factor with this will be very useful to create contents.

키워드

참고문헌

  1. Bong, Y. K., "Complement of the Evaluation Indicators on Advertisement Effectiveness through Program Engagement Index," Proceedings of the 2012 Fall Conference of Korean Speech & Communication Association, (2012), 195-211.
  2. Camurri, A., I. Lagerlof, and G. Volpe, "Recognizing Emotion from Dance Movement: Comparison of Spectator Recognition and Automated Techniques," International Journal of Human-Computer Studies, Vol.59, No.1-2 (2003), 213-225. https://doi.org/10.1016/S1071-5819(03)00050-8
  3. Castellano, G., S. D. Villalba, and A. Camurri, "Recognizing Human Emotions from Body Movement and Gesture Dynamics," ACII '07 Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction, (2007), 71-82.
  4. Chebat, J. C. and R. Michon, "Impact of Ambient Odors on Mall Shoppers' Emotions, Cognition, and Spending: a Test of Competitive Causal Theories," Journal of Business Research, Vol. 56, No.7(2003), 529-539. https://doi.org/10.1016/S0148-2963(01)00247-8
  5. Cho, S. H. "(The) Relationship between Perceived Service Quality and Customer Loyalty in Participant Sport," Ph.D. Dissertation, Dept. of Physical Education, Graduate School Seoul National Univ., 2002.
  6. Choi, A. Y. and W. T. Woo, "A Study on Realtime Emotion Recognition of Body Expression," Proceedings of HCI Korea 2005, (2005), 624-629.
  7. Choi, N. H., J. R. Lee, and K. J. Na, "Mediating Roles of General-Satisfaction Trust and Commitment on Word of Mouth and Repurchasing Intention of Relationship - Oriented Customers," Asia Marketing Journal, Vol.2, No.4(2000), 13-35.
  8. Clarke, S. G. and J. T. Haworth, "Flow Experience in the Daily Lives of Sixth-Form Collect Students," British Journal of Psychology, Vol.85, No.4(1994), 511-523. https://doi.org/10.1111/j.2044-8295.1994.tb02538.x
  9. Csikszentmihalyi, M., Flow : The Psychology of Optimal Experience, Harper & Row Publisher, New York, 1990.
  10. Fornell, C., "A National Customer Satisfaction Barometer: the Swedish Experience," Journal of Marketing, Vol.56, No.1(1992), 6-21. https://doi.org/10.2307/1252129
  11. Graefe, A. and K. W. Hong, "Predicting Event Satisfaction by using SERVPERF and the Circumflex Model of Affect," Journal of Tourism and Leisure Research, Vol.16, No.4(2004), 7-25.
  12. Heo, G. and I. J. Rha, "Optimal Flow Experience in Web Based Instruction," THE JOURNAL OF KOREAN ASSOCIATION OF COMPUTER EDUCATION, Vol.6, No.2(2003), 71-79.
  13. Hong, K. W., W. I. Kim, and I. H. Kang, "Flow in Art Festival: Intrinsic Motivation, Flow, Revisit Intention," Korean Journal of Tourism Research, Vol.22, No.1(2007), 115-131.
  14. Jang, H. W. and B. K. Choi, "A Study on Self Congruity of Performance Arts Tourism: Focus on JeJu "Nanta"," Korea Tourism Research Association, Vol.25, No.5(2011), 227-242.
  15. Jang, J. J., I. S. Ko, and C. Jeong, "The Impact of E-Learning System Characteristics on Learner Committment and Satisfaction," JITAM(Journal of Information Technology Applications and Management, Vol.15, No.1(2008), 99-116.
  16. Jeon, H. S., "The Relationship between Sport Flow Experience and Life Satisfaction in Sport for All," Journal of Sport and Leisure Studies, Vol.19, No.2(2003), 1001-1010.
  17. Jung, M. K. and J. K. Kim, "The Intelligent Determination Model of Audience Emotion for Implementing Personalized Exhibition," Journal of Intelligence and Information Systems, Vol.18, No.1(2012), 39-57.
  18. Kelley, S. W. and M. A. Davis, "Antecedents to Customer Expectations for Service Recovery," Journal of the Academy of Marketing Science, Vol.22, No.1(1994), 52-61. https://doi.org/10.1177/0092070394221005
  19. Kim, S. Y. and H.-J. Min, "The Relationship between Spectators Tendency and Absorption and Spectatorship Value in Dance Performances," The Korea Journal of Sports Science, Vol.19, No.3(2010), 911-922.
  20. Kim, Y. M., "The Effect of Spectatorship Satisfaction of Sports Event on Trustworthiness of Event, Commitment of Event and Re-spectatorship Intention," Korean Journal of Sport Science, Vol.16, No.2(2005), 106-118.
  21. Ko, K. E. and K. B. Sim, "Development of Facial Expression Recognition System based on Bayesian Network using FACS and AAM," Journal of The Korean Institute of Intelligent Systems, Vol.19, No.4(2009), 562-567. https://doi.org/10.5391/JKIIS.2009.19.4.562
  22. Lee, J. Y., "Research on the Emotion Recognition Agent based on Biometrics," Master's Thesis, Dept. of Computer Engineering, The Graduate School of Sejong Univ., 2008.
  23. Lee, Y. S. and H. B. Choi, "The Relationships among Inspection Value, Inspection Flow and Inspection Satisfaction of Dance Performance Audience," Official Journal of the Korean Society of Dance Science, Vol.27(2012), 61-79.
  24. Lim, S. H., K. S. Bae, S. J. Kwak, I.-S. Park, and J. S. Park, "The Measurement of the Subjective Experience for Analysis the Flow Experience Degree in the Interactive Exhibit Contents," Archives of Design Research, Vol.22, No.4(2009), 19-30.
  25. Moon, J. -Y., "The Effect of Flow and Addiction upon Satisfaction and Customer Loyalty in Online Games," Master Thesis, Dept. of Business Administration, Graduate School of Kyung Hee Univ., 2003.
  26. Morgan, R. M. and S. D. Hunt, "The Commitmenttrust Theory of Relationship Marketing," Journal of Marketing, Vol.58, No.3(1994), 20-38.
  27. Rosenblum, M., Y. Yacoob, and L. S. Davis, "Human Expression Recognition from Motion Using : A Radial Basis Function Network Architecture," IEEE Transactions on Neural Networks, Vol.7, No.5(1996), 1121-1138. https://doi.org/10.1109/72.536309
  28. Park, J. S., "A Psychophysiological Approach to Measuring the User Experience," Journal of Korea Design Knowledge, Vol.15(2010), 1-10.
  29. Park, J. S., "Measuring the Flow Experiences based on the Physiological Responses," Journal of Digital Design, Vol.10, No.2 (2010), 157-166.
  30. Park, H. H., "A Study on Realtime Emotion Recognition of Body Expression," Master Thesis, Dept. of Electronics & Computer Eng., Han-Yang Univ., 2001.
  31. Park, H. H., J. -I. Park, and W. T. Woo, "Emotion Recognition from Body Movement," Proceeding of Signal Processing Society & IEEK Conference 2001, Vol.14, No.1(2001), 157-160.
  32. Park, M. H., H. D. Ko, and H. R. Byun, "Analysis and Synthesis of Facial Expression using Base Faces," Korean Institute of Information Scientists and Engineers, Vol.27, No.8(2000), 827-833
  33. Ryu, J. M., S.-B. Park, and J. K. Kim, "A Study of the Reactive Movement Synchronization for Analysis of Group Flow," Journal of Intelligence and Information Systems, Vol.19, No.1(2013), 79-94. https://doi.org/10.13088/jiis.2013.19.1.079
  34. Shaarani, A. S. and D. M. Romano, "Basic Emotions from Body Movements," Proceeding of CCID, (2006).
  35. Smith, J. B., "Buyer-Seller Relationships: Similarity, Relationship Management, and Quality," Psychology & Marketing, Vol.15, No.1(1998), 3-21. https://doi.org/10.1002/(SICI)1520-6793(199801)15:1<3::AID-MAR2>3.0.CO;2-I
  36. Yoo, J. K., "A Study on the Effects of the Flow Experience on Satisfaction Level: The Case of Tourist Visiting TV Drama Location," International Journal of Tourism and Hospitality Research, Vol.21, No.1(2007), 389-400.