Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Transformation of Stereoscopic Images for 3D Perception Improvement

입체영상의 3D 증강을 위한 입체영상 변환

  • 길종인 (강원대학교 컴퓨터정보통신공학과) ;
  • 최황규 (강원대학교 컴퓨터정보통신공학과) ;
  • 김만배 (강원대학교 컴퓨터정보통신공학과)
  • Received : 2012.08.24
  • Accepted : 2012.10.22
  • Published : 2012.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, 3DTV and 3D displays have been released in the market. Accordingly, the production of stereoscopic images has gained much interest. Stereoscopic image being composed of left and right images are currently delivered to viewers without any modifications. The researches on the enhancement of depth perception using high-frequency components and the re-production of natural color by color compensation have been carried out for 2D images. The application of such 2D technologies to 3D stereoscopic images is an aim of this paper. This paper proposes the enhancement of 3D perception by color transformation. For this, we propose a stereo matching method for obtaining a depth map and two color transformation methods such as contrast transformation and background darkening. The effectiveness of the proposed method was verified through experiments.

최근 3DTV 및 3D 디스플레이가 공급되면서 입체영상 제작도 활발히 진행되고 있다. 입체영상은 좌영상과 우영상으로 만들어지는데, 제작된 입체영상은 수정 없이 그대로 시청자에게 공급되고 있다. 2D 영상도 고주파 성분을 이용하여 깊이감을 높이고, 색보정을 거처 자연색과 유사한 색을 재현하는 등의 연구는 오랫동안 진행되어 왔다. 이 기술을 입체영상에 적용하고자 하는 것이 본 논문의 목적이다. 기 제작된 입체영상의 컬러를 변환함으로써 3D 입체감을 개선하는 방법을 제안한다. 이를 위해서 본 논문에서는 스테레오 영상으로부터 깊이맵을 획득하고, 기존 컬러 변환을 통한 2D 영상의 지각 깊이감 개선을 입체영상에 적용하여, 3D 입체감을 향상시키는 방법을 제안한다. 이를 위해 스테레오 정합 방법과 컬러 변환 방법으로 대조 변환 및 배경 다크닝 방법을 제안하고, 실험을 통해 제안 방법이 상기 목적을 얻을 수 있는 것을 검증하였다.

Keywords

References

  1. C. Fehn, R. de la Barre and S. Pastoor, "Interactive 3DTV-concepts and key technologies," Proceedings of the IEEE, Special Issue on 3D Technologies for Imaging & Display, 94(3):524-539, March 2006.
  2. Woontack Woo, Namgyu Kim, Iwadate, Y, "Stereo imaging using a camera with stereoscopic adapter," Systems, Man, and Cybernetics, 2000 IEEE International Conference on, Volume 2, 2000, pp. 1512-1517.
  3. J. Seo, C. Kim, "Stereo camera image processing technique and trend", The Magazine of the IEEK, Vol. 38, No. 2, pp. 31-36, 2011.
  4. Liang Zhang and James Tam, "Stereoscopic image generation based on depth images for 3DTV," Broadcasting, IEEE Transactions on Volume 51, Issue 2, June 2005, pp. 191-199. https://doi.org/10.1109/TBC.2005.846190
  5. Wa James Tam, Liang Zhang, "3D-TV Content Generation: 2D-to-3D Conversion," ICME 2006, pp. 1869-1872, 2006.
  6. W. Li, H. Yao, R. Ji, P. Xu, X. Liu, D. Zhao, "Robust Stereo Matching Combining SIFT Descriptor with NCC under MRF Framework," Pervasive Computing Signal Processing and Applications (PCSPA), 2010 First International Conference on, pp. 1018-1021, 2010.
  7. M. Kim, "A method of converting 2D video to 3D", Korea Society Broadcast Enginners Magazine, vol. 5, No. 1, March 2001.
  8. M. Sung, S. Lee, N. Cho, "Stereo matching using multi-directional dynamic programming and edge orientations," ICIP 2007. IEEE International Conference on, pp. 233-236.
  9. Zhuoyun Zhang, Chunping Hou, Jing Shi, "A Research on Stereo Matching Algorithm based on Edge Detection and Gaussian Disparity Distribution model," ICCSIT 2009. 2nd IEEE International Conference on, pp. 650-653, 2009.
  10. Kuk-Jin Yoon, In So Kweon, "Adaptive Support-Weight Approach for Correspondence Search," Pattern Analysis and Machine Intelligence, IEEE Transactions on, Volume 28, Issue 4, pp. 650-656, 2006. https://doi.org/10.1109/TPAMI.2006.70
  11. C. Jo, M. Kim, K. Eom, N. Heo, J. Kim, "Disparity-based Depth Scaling of Multiview Images", Journal of Broadcast Engineering, Vol. 13, No 6, pp. 796-803, November 2008. https://doi.org/10.5909/JBE.2008.13.6.796
  12. J. Gil, M. Kim, "Stereoscopic Perception Improvement Using Color and Depth Transformation", Journal of Broadcast Engineering, Vol. 16, No. 4, pp. 584-595, 2011. 7. https://doi.org/10.5909/JEB.2011.16.4.584
  13. M. Bao, M. Fujiyoshi, H. Kiya, "Seam Carving Using Weighted Luminance Gradient and Color Saliency," IWAIT 2012, pp. 222-225, 2012.
  14. R. Achanta and S. Susstrunk, "Saliency detection for content-aware image resizing," in Proc. IEEE ICIP, 2009, pp. 256-259.
  15. M. Sonka and V. Hlavac and R. Boyle, Image processing, Analysis, and Machine Vision, 3rd Ed., Thomson Press, 2008.
  16. T. Luft, C. colditz, and O. Deussen, "Image enhancement by unsharp masking the depth buffer," In Proceedings of ACM SIGGRAPH, pp. 1206-1213, 2006.
  17. N. A. Svakhine, D. S. Ebert, and W. M. Andrews, "Illustration-inspired depth enhanced volumetric medical visualization," IEEE Trans. on Visualization and Computer Graphics, Vol. 15, No. 1, Jan/Feb. 2009.
  18. S. Bruckner and M. E. Groller, "Enhancing depth-perception with flexible volumetric halos," IEEE Trans. on Visualization and Computer Graphics, Vol. 13, Issue 6, pp. 1344-1351. Nov. 2007. https://doi.org/10.1109/TVCG.2007.70555
  19. J. Gil, M. Kim "Depth Map Processing for Improving Stereoscopic Image and CGH", 2010 KSBE Fall Conference, pp. 27-29, Nov. 2010.
  20. http://vision.middlebury.edu/stereo/
  21. "Subjective assessment of stereoscopic television picture," ITU-R Recommendation BT. 1438, 2000.