KIPS Transactions on Software and Data Engineering (정보처리학회논문지:소프트웨어 및 데이터공학)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Subject Test Using Electroencephalogram According to Variation of Autostereoscopic Image Quality

무안경 입체영상의 화질변화에 따른 뇌파 기반 사용자 반응 분석

  • 문재철 (서울미디어대학원대학교 뉴미디어학부) ;
  • 홍종의 (서울미디어대학원대학교 입체영상미디어학과/(주)다림비전) ;
  • 최유주 (서울미디어대학원대학교 뉴미디어콘텐츠학과/서울미디어대학원대학교 실감미디어연구소) ;
  • 서정근 (서울미디어대학원대학교 뉴미디어콘텐츠학과/서울미디어대학원대학교 실감미디어연구소)
  • Received : 2015.12.21
  • Accepted : 2016.04.05
  • Published : 2016.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

There have been many studies on subject tests for 3D contents using 3D glasses, but there is a limited research for 3D contents using autostereoscopic display. In this study, we investigated to assess usability of electroencephalogram (EEG) as an objective evaluation for 3D contents with different quality using autosteroscopic display, especially for lenticular lens type. The image with optimal quality and the image with distorted quality were separately generated for autostereosopic display with lenticular lens type and displayed sequentially through lenticular lens for 26 subjects. EEG signals of 8 channels from 26 subjects exposed to those images were detected and correlation between EEG signal and the quality of 3D images were statistically evaluated to check differences between optimal and distorted 3D contents. What we found was that there was no statistical significance for a wave vibration, however b wave vibration shows statistically significant between optimal and distorted 3D contents. b wave vibration observed for the distorted 3D image was stronger than that for the optimal 3D image. This results suggest that subjects viewing the distorted 3D contents through lenticular lens experience more discomfort or fatigue than those for the optimum 3D contents, which resulting in the greater b wave activity for those watching the distorted 3D contents. In conclusion, these results confirm that electroencephalogram (EEG) analysis can be used as a tool for objective evaluation of 3D contents using autosteroscopic display with lenticular lens type.

안경식 3차원 입체영상 콘텐츠에 대한 사용자 평가는 객관적/주관적 평가 방법을 활용하여 많은 연구가 이루어지고 있지만 무안경식 3차원 입체 영상 콘텐츠에 대한 사용자 평가는 미비한 실정이며 특히 생체신호를 적용한 객관적 평가에 대한 연구는 거의 이루어지지 않고 있다. 이에 본 연구에서는 무안경 입체 영상 화질에 대한 객관적 사용자 평가 도구개발을 위한 사전연구로서 무안경 입체영상 화질 변화에 따른 뇌파(Electroencephalogram, EEG)의 변화를 분석하였다. 이를 위하여 무안경식 입체영상 시스템의 디스플레이로 활용되고 있는 렌티큘러 방식 입체 영상을 최적입체영상과 왜곡입체영상으로 구분하여 제작하고, 이를 총 26명의 피험자에게 차례로 제시하며 8개 채널의 뇌파를 측정하였다. 각 영상 시청시 획득한 뇌파를 채널별과 주파수별로 분류하여 통계적 상관관계를 분석하였다. 분석 결과 뇌파진동 중 알파파의 경우 최적입체영상과 왜곡입체영상 사이에서 통계적으로 유의미한 차이가 확인되지 않았으나 베타파의 경우 통계적으로 유의미한 차이가 확인되었다. 베타파의 경우 왜곡입체영상에서 최적입체영상보다 통계적으로 유의미하게 높게 나타났으며 이는 왜곡입체영상 시청 시 피로감 또는 불안감 증폭에 따른 베타파의 뇌파활동이 높아진 것으로 해석된다. 본 연구결과를 바탕으로 뇌파분석 기법이 렌티큘러 방식의 무안경 입체영상 화질 평가를 위한 객관적 평가 수단으로 활용될 수 있는 가능성을 확인하였다.

Keywords

References

  1. J. G. Ahn and J. W. Kim, "A GPU based rendering method for multiple view autostereoscopic display," Journal of the HCI Society of Korea, Vol.4, No.2, pp.9-16, 2009. www.dbpia.co.kr/Article/NODE01851161. https://doi.org/10.17210/jhsk.2009.11.4.2.9
  2. D. M. Hoffman, A. R. Girshick, K. Akeley, and M. S. Banks, "Vergence-accommodation conflicts hinder visual performance and cause visual fatigue," Journal of Vision, Vol.8, No.3, 33, pp.1-30, 2008. DOI: 10.1167/8.3.33.
  3. M. Torii, Y. Okada, K. Ukai, J. S. Wolffsohn, and G Gilmartin, "Dynamic measurement of accommodative responses while viewing stereoscopic images," Journal of Modern Optics, Vol.55, pp.557-567, 2008. DOI:10.1080/09500340701467652.
  4. J. Hong, H. B. Shim, and Y. J. Choi, "Adaptive multiview subpixel interlacing for autostereoscopic display," in Proceedings of the Domestic Summer Conference of the Korean Society of Broadcast Engineers, pp.450-451, 2015. www.dbpia.co.kr/Article/NODE06396403.
  5. H. C. Lee, "Human factor research on the measurement of subjective three diimensional fatigue," Journal of Broadcast Engineering, Vol.15, No.5:56, pp.607-616, 2010. www.dbpia.co.kr/Article/NODE01535096. https://doi.org/10.5909/JBE.2010.15.5.607
  6. D. S. Kim, W. J. Lee, J. D. Kim, Do. S. Yu, E. T. Jeong, and J. S. Son, "Change of Phoria and Subjective Symptoms after Watching 2D and 3D Image," Journal of Korean Ophthalmic Optics Society, Vol.17, No.2, pp.185-194, 2012. UCI: I410-ECN-0102-2012-510-003096837.
  7. J. Y. Kim, H. C. Li, and S. W. Kim, "Measuring visual fatigue of glasses-free Interactive 3D system under various viewing conditions," Journal of Boradcast and Engineering, Vol.18, No.3, pp.425-434, 2013. DOI:10.5909/JBE.2013.18.3.425.
  8. D. Palomba, M. Sarlo, A. Angrilli, A. Mini, and L. Stegagno, "Cardiac responses associated with affective processing of unpleasant film stimuli," Int. J.Psychophysiiol. Vol.36, pp. 45-57. 2000. DOI:10.1016/S0167-8760(99)00099-9.
  9. Ho-Duck Kim and Kwee-Bo-Sim, "Brain-wave analysis using fMRI, TRS and EEG for human emotion recognition," Journal of Korean Institute of Intelligent Systems, Vol.17, Issue 6, pp.832-837, 2007. DOI: 10.5391/JKIIS.2007.17.6.832.
  10. S. H. Kim and D. Y. Kim, "Comparative EEG study of the 2.5D and 3D motion picture viewers," The Korean Journal of Vision science, Vol.15, No.1, pp.75-82, 2013. DOI: 10.5391/JKIIS.2007.17.6.832
  11. S. H. Kweon and E. Y. Bang, "A study of human fact analysis in program genres: Comparison of 2D and 3D receptions difference by measuring brainwaves," Review of Cultural Economics, Vol.15, No.3, pp.29-51, 2012. UCI : I410-ECN-0102-2013-600-002088563.
  12. D.-J. Kim, H.-C. O. Li, and S. W. Kim, "Glasses-free Interactive 3D Display: The Effects of Viewing Distance, Orientation and Manual Interaction on Visual Fatigue," Journal of Broadcast Engineering, Vol.17, No.4, pp.572-583, 2012. DOI: 10.5909 /JBE.2012.17.4.572. https://doi.org/10.5909/JBE.2012.17.4.572
  13. J. Y. Kim, H.-C. O. Li, and S. W. Kim, "Measuring visual fatigue of glasses-free interactive 3D system under various viewing conditions," Journal of Broadcast Engineering, Vol.18, No.3, pp.425-434, 2013. www.dbpia.co.kr/Journal/ArticleDetail/NODE02183042. https://doi.org/10.5909/JBE.2013.18.3.425
  14. J. K. Jang and H. S. Kim, "EEG analysis of learning attitude change of female college student on e-Learning," Journal of the Korea Contents Association, Vol.11. No.4, pp.42-50, 2011. www.dbpia.co.kr/Journal/ArticleDetail/NODE01631972. https://doi.org/10.5392/JKCA.2011.11.4.042
  15. G. H. Klem, H. O. Luders, H. H. Jasper, and C. Elger, "The ten-twenty electrode system of the International Federation," Electroencephalography and Clinical Neurophysiology Supplement, No.52, pp.3-6, 1999. www.clinph-journal.com/pb/assets/raw/Health%20Advance/journals/clinph/Chapter1-1.pdf.
  16. Y. M. Kim, "The effects of brain respiration program on children's learning ability and emotional stability," Journal of Child Education, Vol.16, No.1, pp.5-17, 2007. UCI: G704-001652.2007.16.1.017.
  17. J. Y. Shim and I. J. Seung, "Influences of brain education program on concentration and prefrontal EEG activation of children's," Journal of Child Education, Vol.18, No.3, pp. 19-36, 2009. UCI: G704-001652.2009.18.3.002.
  18. S. I. Choi, "Change analysis on EEG data with localized moving averages," Master thesis, Busan University of Foreign Studies, 2011. www.riss.kr/link?id=T12512631.
  19. M. J. Im, "Changes of activated electroencephalogram by brain areas from manifestation of heightened sensory perception," Master thesis, University of Brain Education, 2010. www.data.riss.kr/sam_lod/resource/Thesis/000013059296.
  20. W. A. Ijsselsteijn, H. de Ridder, R. Hamberg, D. Bouwhuis, and J. Freeman, "Perceived depth and the feeling of presence in 3DTV," Displays, Vol.18, pp.207-214, 1998. DOI:10.1016/S0141-9382(98)00022-5.
  21. D. R. A. Incisa and B. Milner, "Strategic seach and retrieval inhibition the role of the frontal lobe," Neuropsychologia, Vol. 31, Nol.6, pp.503-524, 1993. www.ncbi.nlm.nih.gov/pubmed/8341411. https://doi.org/10.1016/0028-3932(93)90049-6
  22. dug-Chun Park, "Correlation between genre and image expression technique of TV drama," Journal of the Korea Contents Association, Vol.9, No.10, pp.159-167, 2009. www.dbpia.co.kr/Article/NODE01270407. https://doi.org/10.5392/JKCA.2009.9.10.159