Journal of the Korea Convergence Society (한국융합학회논문지)

Korea Convergence Society (한국융합학회)
권호 표지
DOI QR코드

DOI QR Code

Predicting Sensitivity of Motion Sickness using by Pattern of Cardinal Gaze Position

기본 주시눈 위치의 패턴을 이용한 영상멀미의 민감도 예측

  • Park, Sangin (Industry-Academy Cooperation Team, Sangmyung University) ;
  • Lee, Dong Won (Department of Emotion Engineering, Sangmyung University) ;
  • Mun, Sungchul (Future Engine Lab., CJ Hello) ;
  • Whang, Mincheol (Department of Intelligent Engineering Informations for Human, Sangmyung University)
  • Received : 2018.09.12
  • Accepted : 2018.11.20
  • Published : 2018.11.28
Download PDF
⟨ Previous Next ⟩

Abstract

The aim of this study is to predict the sensitivity of motion sickness (MS) using pattern of cardinal gaze position (CGP) before experiencing the virtual reality (VR) content. Twenty volunteers of both genders (8 females, mean age $28.42{\pm}3.17$) participated in this experiment. They was required to measure the pattern of CGP for 5 minute, and then watched VR content for 15 minute. After watching VR content, subjective experience for MS reported from participants using by 'Simulator Sickness Questionnaire (SSQ)'. Statistical significance between CGP and SSQ score were confirmed using Pearson correlation analysis and independent t-test, and prediction model was extracted from multiple regression model. PCPA & PCPR indicators from CGP revealed significantly difference and strong or moderate positive correlation with SSQ score. Extracted prediction model was tested using correlation coefficient and mean error, SSQ score between subjective rating and prediction model showed strong positive correlation and low difference.

본 연구는 가상현실 콘텐츠 경험 이전에 기본 주시눈 위치의 패턴을 이용해 영상멀미의 민감도를 예측할 수 있는 방법론 개발에 그 목적이 있다. 본 실험에는 20명 (여자 10명, 평균 나이: $28.42{\pm}3.17$세)의 피험자가 참여하였다. 실험 참가자들은 5분 동안 기본 주시눈 위치의 패턴을 측정하고 가상현실 콘텐츠를 15분 동안 시청하였다. VR 콘텐츠 시청 후에 'Simulator Sickness Questionnaire (SSQ)' 설문을 통해 영상멀미에 대한 주관적인 경험을 실험 참가들로부터 보고 받았다. 기본 주시눈 패턴과 SSQ 점수는 피어슨 상관분석 및 독립성분 t검정을 통해 유의성을 확인하고 다중회귀분석을 통해 예측모델을 도출하였다. 분석결과, 기본 주시눈 위치의 패턴 (PCPA & PCPR)은 SSQ 점수와 통계적으로 유의한 차이가 있었고 강한 혹은 중간 양의 상관관계가 있음을 확인하였다. 또한, 도출된 예측모델은 새로운 실험참가자 10명을 대상으로 정확도를 검증하였고 설문과 예측모델에 의한 SSQ 점수 사이에 강한 양의 상관관계와 낮은 편차가 있음을 확인하였다.

Keywords

OHHGBW_2018_v9n11_227_f0001.png 이미지

Fig. 1. Experimental design and environment

OHHGBW_2018_v9n11_227_f0002.png 이미지

Fig. 2. Procedure for signal processing and indicators definition. (A) Procedure for detecting the pupil area: (a) Gray scale image, (b) Binarization image, (c) Detecting the pupil area by CED algorithm. (B) Coordinate of X and Y axes at 30 fps. (C) Re-sampled coordinate of X and Y axes at 1 fps. (D) Definition of PCPA and PCPR.

OHHGBW_2018_v9n11_227_f0003.png 이미지

Fig. 3. An examples patterns in PCPA and PCPR for participant 6 (top) and 14 (bottom).

OHHGBW_2018_v9n11_227_f0004.png 이미지

Fig. 4. Results for PCPA and PCPR between low and high motion sickness groups using independent t-test.

OHHGBW_2018_v9n11_227_f0005.png 이미지

Fig. 5. Results for correlation analysis between PCPA and SSQ score / PCPR and SSQ score.

OHHGBW_2018_v9n11_227_f0006.png 이미지

Fig. 6. Results for correlation analysis between the SSQ score of observed and expected.

Table 1. Results of the multiple linear regression analyses on SSQ score for motion sickness in response to indicators of PCPA and PCPR (N = 20).

OHHGBW_2018_v9n11_227_t0001.png 이미지

Table 2. Results for verification experiment of regression model (Sub: Subject, Maj: Major axis, Min: Minor axis, Ob: Observed, Ex: Expected).

OHHGBW_2018_v9n11_227_t0002.png 이미지

References

  1. J. Bailenson, K. Patel, A. Nielsen, R. Bajscy, S. H. Jung & G. Kurillo. (2008). The effect of interactivity on learning physical actions in virtual reality. Media Psychology, 11(3), 354-376. DOI: 10.1080/15213260802285214
  2. J. E. Bos, W. Bles & E. L. Groen. (2008). A theory on visually induced motion sickness. Displays, 29(2), 47-57. https://doi.org/10.1016/j.displa.2007.09.002
  3. J. D. Moss & E. R. Muth. (2011). Characteristics of head-mounted displays and their effects on simulator sickness. Human factors, 53(3), 308-319. DOI: 10.1177/0018720811405196
  4. M. Kesim & Y. Ozarslan. (2012). Augmented reality in education: current technologies and the potential for education. Procedia-Social and Behavioral Sciences, 47, 297-302. DOI: 10.1016/j.sbspro.2012.06.654
  5. S. Sharples, S. Cobb, A. Moody & J. R. Wilson. (2008). Virtual reality induced symptoms and effects (VRISE): Comparison of head mounted display (HMD), desktop and projection display systems. Displays, 29(2), 58-69. DOI: 10.1016/j.displa.2007.09.005
  6. J. Hakkinen, T. Vuori & M. Paakka. (2002, October). Postural stability and sickness symptoms after HMD use. In IEEE International Conference on Systems, Man and Cybernetics (Vol. 1, pp. 147-152). DOI: 10.1109/ICSMC.2002.1167964
  7. A. S. Fernandes & S. K. Feiner. (2016, March). Combating VR sickness through subtle dynamic field-of-view modification. In 3D User Interfaces (3DUI), 2016 IEEE Symposium on (pp. 201-210). IEEE. DOI: 10.1109/3DUI.2016.7460053
  8. G. Nie, Y. Liu & Y. Wang. (2017, October). [POSTER] Prevention of Visually Induced Motion Sickness Based on Dynamic Real-Time Content-Aware Non-salient Area Blurring. In Mixed and Augmented Reality (ISMAR-Adjunct), 2017 IEEE International Symposium on (pp. 75-78). IEEE. DOI: 10.1109/ISMAR-Adjunct.2017.35
  9. N. Padmanaban, T. Ruban, V. Sitzmann, A. M. Norcia & G. Wetzstein. (2018). Towards a Machine-Learning Approach for Sickness Prediction in $360^{\circ}$ Stereoscopic Videos. IEEE Transactions on Visualization & Computer Graphics, (1), 1594-1603. DOI: 10.1109/TVCG.2018.2793560
  10. C. M. Oman. (1990). Motion sickness: a synthesis and evaluation of the sensory conflict theory. Canadian journal of physiology and pharmacology, 68(2), 294-303. DOI: 10.1139/y90-044
  11. T. A. Stoffregen, K. Yoshida, S. Villard, L. Scibora & B. G. Bardy. (2010). Stance width influences postural stability and motion sickness. Ecological Psychology, 22(3), 169-191. DOI: 10.1080/10407413.2010.496645
  12. J. E. Roy & K. E. Cullen. (1998). A neural correlate for vestibulo-ocular reflex suppression during voluntary eye-head gaze shifts. Nature neuroscience, 1(5), 404. DOI: https://doi.org/10.1038/1619
  13. S. Mun, M. C. Park, S. Park & M. Whang. (2012). SSVEP and ERP measurement of cognitive fatigue caused by stereoscopic 3D. Neuroscience letters, 525(2), 89-94. DOI: 10.1016/j.neulet.2012.07.049
  14. J. Daugman. (2004). Iris recognition border-crossing system in the UAE. International Airport Review, 8(2), 49-53.
  15. E. C. Lee, K. R. Park, M. Whang & K. Min. (2009). Measuring the degree of eyestrain caused by watching LCD and PDP devices. International Journal of Industrial Ergonomics, 39(5), 798-806. DOI: 10.1016/j.ergon.2009.02.008
  16. S. Park, M. J. Won, D. W. Lee & M. Whang. (2018). Non-contact measurement of heart response reflected in human eye. International Journal of Psychophysiology, 123, 179-198. DOI: 10.1016/j.ijpsycho.2017.07.014
  17. M. Saglam & N. Lehnen. (2014). Gaze stabilization in chronic vestibular-loss and in cerebellar ataxia: Interactions of feedforward and sensory feedback mechanisms. Journal of Vestibular Research, 24(5, 6), 425-431. DOI: 10.3233/VES-140538
  18. E. J. Song & A. L. Jung. (2017). A Study for Reducing of Cyber Sickness on Virtual Reality. Journal of Digital Contents Society, 18(3), 429-434. https://doi.org/10.9728/DCS.2017.18.3.429
  19. S. Park, M. J. Won, S. Mun, E. C. Lee & M. Whang. (2014). Does visual fatigue from 3D displays affect autonomic regulation and heart rhythm?. International Journal of Psychophysiology, 92(1), 42-48. DOI: 10.1016/j.ijpsycho.2014.02.003
  20. S. Park, M. J. Won, E. C. Lee, S. Mun, M. C. Park & M. Whang. (2015). Evaluation of 3D cognitive fatigue using heart-brain synchronization. International Journal of Psychophysiology, 97(2), 120-130. DOI: 10.1016/j.ijpsycho.2015.04.006
  21. S. Mun, M. Whang, S. Park & M. C. Park (2017). Effects of mental workload on involuntary attention: A somatosensory ERP study. Neuropsychologia, 106, 7-20. DOI: 10.1016/j.neuropsychologia.2017.08.021
  22. J. Kang & C. Kim. (2018). A convergence study on the influence of full immersion virtual reality on the autonomic nervous system of healthy adults. Journal of the Korea Convergence Society, 9(3), 131-135. DOI: 10.15207/JKCS.2018.9.3.131