Journal of Korea Game Society (한국게임학회 논문지)

Korea Game Society (한국게임학회)
권호 표지
DOI QR코드

DOI QR Code

Developing Affective Computing Game with Player's Bio-Signal

사용자의 생체 신호를 이용한 감성 컴퓨팅 게임 개발

  • Received : 2016.10.13
  • Accepted : 2016.12.06
  • Published : 2016.12.20
Download PDF
⟨ Previous Next ⟩

Abstract

In this research, Affective computing game has been developed which reacts with a player's bio-signals. A modified computer mouse will be used to collect bio-signals by GSR, FSR, and infrared thermometer. This modified computer mouse collect human bio-signals in non-intrusive way. The collected data is complementary reflected in 3 level of tension of a player. The player's tension affects on the game and the reaction for NPC will be followed. Then this leads to plot changes individually. To let diverse NPC reaction and interactive story telling, Live 2d and Inkle Script have been used. This research can be alternative method on the game development using Affective computing.

본 연구에서는 사용자의 생체 신호를 반영한 감성 컴퓨팅 게임을 개발하였다. 생체 신호 측정을 위해 GSR(Galvanic Skin Response), FSR(Force Sensing Resistor), 온도 센서(Infrared Thermometer)를 장착한 마우스를 제작하였다. 해당 마우스를 통해 게임을 하는 사용자의 생체 신호를 비침투적으로 측정한다. 측정된 데이터는 실시간으로 처리되어 사용자의 긴장도를 3단계로 구분하며 구분된 긴장도는 반영되어 NPC(Non-Player Character)의 정서 반응과 스토리 분기의 변화를 가능하게 한다. NPC의 반응과 스토리 분기의 제작을 위해 Live 2d, Inkle Script를 사용하였다. 본 연구를 통해 사용자의 생체 신호를 이용한 감성 컴퓨팅 게임 제작에 하나의 방법론을 제시한다.

Keywords

References

  1. J, Tao and T, Tan, "Affective computing: A review." International Conference on Affective Computing and Intelligent Interaction, pp. 981-995, 2005.
  2. P, Helmut, "Using human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game", Int. J. Human-Computer Studies 62, pp. 231-245, 2005. https://doi.org/10.1016/j.ijhcs.2004.11.009
  3. H, Heo, "A realistic game system using multi-modal user interfaces", IEEE Transactions on Consumer Electronics, Vol. 56, No. 3, pp. 1364-1372, 2010. https://doi.org/10.1109/TCE.2010.5606271
  4. H, Eva, "Affective computing for game design", In Proceedings of the 4th Intl. North American Conference on Intelligent Games and Simulation (GAMEON-NA),pp. 5-12, 2008.
  5. F, Dellaert and T, Polzin and A, Waibel, "Recognizing emotion in speech", In Proc. Of ICSLP 1996, Philadelphia, PA, pp. 1970-1973, 1996.
  6. Petrushin, "Emotion recognition in speech signal: experimental study, development, and application", studies, 3, 4, 2000.
  7. CG, Kohler, et al, "Facial emotion recognition in schizophrenia: intensity effects and error pattern.", American Journal of Psychiatry 160.10, pp. 1768-1774, 2003. https://doi.org/10.1176/appi.ajp.160.10.1768
  8. Z, Zeng, et al. "Audio-visual affect recognition." IEEE Transactions on multimedia Vol. 9,No. 2, pp.424-428, 2007. https://doi.org/10.1109/TMM.2006.886310
  9. AC, Merzagora, et al, "Wavelet analysis for EEG feature extraction in deception detection." EMBS'06. 28th Annual International Conference of the IEEE, pp. 2434-2437, 2006.
  10. WU, Guanghua and LIU, Guangyuan and HAO, Min. "The analysis of emotion recognition from GSR based on PSO", International Symposium on. IEEE, pp. 360-363. 2010.
  11. HD, Kim and HC, Yang and KB, Sim, "Emotion Recognition Method for Driver Services.", Korean Institute of Intelligent Systems, pp. 438-442, 2007.
  12. Electroencephalography setup image, https://en.wikipedia.org/wiki/Electroencephalography
  13. Facade, http://www.interactivestory.net/
  14. HS, Jang and WH, Lee, "Using Biofeedback and an observational learning theory for intelligent game NPC Design", Korean Society For Internet Information, Vol. 9, No. 2, pp.409-412, 2008.
  15. MY, Kim, et al, "Korean Society For Internet Information", The Korean Society for Computer game, Vol. 24, No. 4, pp. 73-80, 2011.
  16. Inkle Script, http://www.inklestudios.com/
  17. Live 2d, http://www.live2d.com