DOI QR코드

DOI QR Code

시차 분포 특성을 이용한 오토스테레오스코픽 3차원 디스플레이 시청 피로도 개선 방법

Visual Comfort Enhancement of Auto-stereoscopic 3D Display using the Characteristic of Disparity Distribution

  • 김동현 (연세대학교 전기전자공학과) ;
  • 손광훈 (연세대학교 전기전자공학과)
  • Kim, Donghyun (School of Electrical and Electronic Engineering, Yonsei University) ;
  • Sohn, Kwanghoon (School of Electrical and Electronic Engineering, Yonsei University)
  • 투고 : 2015.09.18
  • 심사 : 2016.03.08
  • 발행 : 2016.03.25

초록

시청 피로 정도는 3차원 디스플레이의 성능을 평가할 수 있는 여러 요소 중 하나이다. 3차원 디스플레이의 시청 피로도를 개선하기 위한 많은 연구 중 시차 조정 방법은 3차원 영상의 시차를 적절한 분포를 가지도록 하는 간단한 방법으로써 많은 연구가 진행되고 있다. 본 논문에서는 시차 장벽 방식의 오토스테레오스코픽 3차원 디스플레이에서 시차 분포가 시청 피로에 미치는 영향을 기반으로 수평 영상 이동 방식을 이용하여 시차 조정하는 방법을 제안한다. 제안하는 방법은 Speeded-Up Robust Feature(SURF)를 이용하여 3차원 영상의 시차 분포를 구하고, 이전 연구를 통해 구한 시차 분포가 시청 피로에 미치는 영향을 토대로 시차 조정 정도를 결정하고 3차원 영상의 시차를 조정한다. 제안 방법의 성능을 평가하기 위하여, 우리는 실제 제작된 시차 장벽 방식의 오토스테레오스코픽 3차원 디스플레이를 사용하여 최적 시청 거리에서 주관 평가를 실시한다. 실험 결과는 다양한 시차 분포를 가지는 3차원 영상에 대하여 제안 방법을 적용 한 후 시청 피로 정도가 감소함을 보여준다.

Visual discomfort is a common problem in three-dimensional videos. Among the methods to overcome visual discomfort presented in current research, disparity adjustment methods provide little guidance in determining the condition for disparity control. We propose a diaprity adjustment based on the characteristics of disparity distribution on visual comfort, where the visual comfort level is used as the adjustment paramter, in parallax barrier type auto-stereoscopic 3D display. In this paper, we use the horizontal image shift method for disparity adjustment to enhance visual comfort. The speeded-up robust feature is used to estimate the disparity distribution of 3D sequences, and the required amount for disparity control is chosen based on the pre-defined characteristics of disparity distribution on visual comfort. To evaluate the performance of the proposed method, we used a 3D equipment. Subjective tests were conducted at the fixed optimal viewing distance. The results show that comfortable videos were generated based on the proposed disparity adjustment method.

키워드

참고문헌

  1. I. Sexton and P. Surman, "Stereoscopic and autostereoscopic display systems," IEEE Signal Processing Magazine, Vol. 16, no. 3, pp. 85-99, May 1999. https://doi.org/10.1109/79.768575
  2. T. Shibata, J. Kim, D. M. Hoffman, and M. S. Banks, "The zone of comfort: Predicting visual discomfort with stereo displays," Journal of Vision, Vol. 11, no. 8, pp. 1-29, July 2011.
  3. A. Benoit, P. L. Callet, P. Campisi, and R. Cousseau, "Quality assessment of stereoscopic images," EURASIP Journal on Image and Video Processing, Vol. 659024, 2008.
  4. H. Urey, K. V. Chellappan, E. Erden, and P. Surman, "State of the art in stereoscopic and autostereoscopic displays," Proceedings of the IEEE, Vol. 99, no. 4, pp. 540-555, April 2011. https://doi.org/10.1109/JPROC.2010.2098351
  5. A. J. Woods, "Crosstalk in stereoscopic displays: a review," Journal of Electronic Imaging, Vol. 21, no. 4, pp. 040902, 2012. https://doi.org/10.1117/1.JEI.21.4.040902
  6. M. Lambooij, M. Fortuin, I. Heynderickx, and W. IJsselsteijn, "Visual discomfort and visual fatigue of stereoscopic displays: a review," Journal of Imaging Science and Technology, Vol. 53, no. 3, pp. 30201-1-30201-14, May 2009. https://doi.org/10.2352/J.ImagingSci.Technol.2009.53.3.030201
  7. K. Akeley, S. J. Watt, A. R. Girshick, and M. S. Banks, "A stereo display prototype with multiple focal distances," ACM Transactions on Graphics, Vol. 23, no. 3, pp. 804-813, August 2004. https://doi.org/10.1145/1015706.1015804
  8. D. M. Hoffman, A. R. Girshick, K. Akeley, and M. S. Banks, "Vergence-accommodation conflicts hinder visual performance and cause visual fatigue," Journal of Vision, Vol. 8, no. 3, pp. 1-30, March 2008.
  9. D. Kim, S. Choi, and K. Sohn, "Effect of vergence-accommodation conflict and parallax difference on binocular fusion for random dot stereogram," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 22, no. 5, pp. 811-816, May 2012. https://doi.org/10.1109/TCSVT.2012.2186738
  10. D. Kim and K. Sohn, "Guideline for comfortable autostereoscopic 3D watching," Global 3D Forum, Oct. 2014.
  11. J. Konrad, "Enhancement of viewer comfort in stereoscopic viewing: parallax adjustment," IS&T/SPIE Electronic Imaging, Vol. 3639, 1999.
  12. F. Devernay, S. Duchene, and A. Ramos-Peon, "Adapting stereoscopic movies to the viewing conditions using depth-preserving and artifact-free novel view synthesis," IS&T/SPIE Electronic Imaging, Vol. 7863, 2011.
  13. H. Pan, C. Yuan, and S. Daly, "3D video disparity scaling for preference and prevention of discomfort," IS&T/SPIE Electronic Imaging, Vol 7863, 2011.
  14. D. K. Broberg, "Guidance for horizontal image translation (HIT) of high definition stereoscopic video production," IS&T/SPIE Electronic Imaging, Vol. 7863, 2011.
  15. S. He, T. Zhang, and D. Doyen, "Visual discomfort prediction for stereo contents," IS&T/SPIE Electronic Imaging, Vol. 7863, 2011.
  16. D. Kim, S. Choi, and K. Sohn, "Visual comfort enhancement for stereoscopic video based on binocular fusion characteristics," IEEE Transactions on Circuits and System for Video Technology, Vol. 23, no. 3, pp. 482-487, March 2013. https://doi.org/10.1109/TCSVT.2012.2210658
  17. S. K. Kim and D. W. Kim, "Apparatus and method for displaying three-dimensional images," US Patent 8,994,791, Mar. 2015.
  18. D. Min, S. Yea, Z. Arican, and A. Vetro, "Disparity search range estimation: enforcing termporal consistency," IEEE Int. Conf. on Acoustics Speech and Signal Processing, pp. 2366-2369, 2010.
  19. H. Schwarz, D. Marpe, and T. Wiegand, "Description of exploration experiments in 3D video coding," ISO/IEC JTC1/SC29/WG11 MPEG2010/N11274, Dresden, Germany, Apr. 2010.
  20. 3DTV.at, http://www.3dtv.at