Browse > Article

Near-lossless Coding of Multiview Texture and Depth Information for Graphics Applications  

Yoon, Seung-Uk (Gwangju Institute of Science and Technology, Department of Information and Communications)
Ho, Yo-Sung (Gwangju Institute of Science and Technology, Department of Information and Communications)
Publication Information
Abstract
This Paper introduces representation and coding schemes of multiview texture and depth data for complex three-dimensional scenes. We represent input color and depth images using compressed texture and depth map pairs. The proposed X-codec encodes them further to increase compression ratio in a near-lossless way. Our system resolves two problems. First, rendering time and output visual quality depend on input image resolutions rather than scene complexity since a depth image-based rendering techniques is used. Second, the random access problem of conventional image-based rendering could be effectively solved using our image block-based compression schemes. From experimental results, the proposed approach is useful to graphics applications because it provides multiview rendering, selective decoding, and scene manipulation functionalities.
Keywords
다시점 데이터 부호화;삼차원 장면 표현;영상 기반 렌더링;
Citations & Related Records
연도 인용수 순위
  • Reference
1 M. Levoy, K. Pulli, B. Curless, S. Rusinkiewicz, D. Koller, L. Pereira, M. Ginzton, S. Anderson, J. Davis, J. Ginsberg, J. Shade, and D. Fulk, "The digital Michelangelo project: 3D scanning of large statues," in Proc. Annu. Conf. Computer Graphics (SIGGRAPH'00), pp. 131-144, July 2000
2 "Weta: rendering Lord of the Rings," DIGIT, http://www.digitmag.co.uk, 2004
3 J. Shade, S. Gortler, L. He, and R. Szeliski, "Layered depth images," in Proc. Annu. Conf. Computer Graphics (SIGGRAPH'98), pp. 231-242, Jul. 1998   DOI
4 P. Verlani, A. Goswami, P. Narayanan, S. Dwivedi, and S. Penta, "Depth images: representation and real-time rendering," in Proc. Int. Symp. 3D Data Processing, Visualization and Transmission, June 2006
5 H. Shum, S. Kang, and S. Chan, "Survey of image-based representations and compression techniques," IEEE Trans. Circuits and Systems for Video Technology, vol. 13, no. 11, pp. 1020-1037, Nov. 2003   DOI   ScienceOn
6 Y. Linde, A. Buzo, and R. Gray, "An algorithm for vector quantizer design," IEEE Trans. Communications, vol. COM-28, no. 1, pp. 84-95, Jan. 1980
7 Interactive visual media group at Microsoft Research, http://research.microsoft.com/vision/InteractiveVisualMediaGroup/3DVideoDownload, 2004
8 C. Zitnick, S. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-quality video view interpolation using a layered representation," ACM Trans. Graphics, vol. 23, no. 3, pp. 600-608, Aug. 2004   DOI   ScienceOn
9 M. Uyttendaele, A. Criminisi, S. Kang, S. Winder, R. Szeliski, and R. Hartley, "Image-based interactive exploration of real-world environments," IEEE Computer Graphics and Applications, vol. 24, no. 3, pp. 52-63, May/June 2004   DOI   ScienceOn
10 M. Halle, "Multiple viewpoint rendering," in Proc. Annu. Conf. Computer Graphics (SIGGRAPH'98), pp. 243-254, July 1998   DOI
11 T. Kanade, P. Rander, and P. Narayanan, "Virtualized reality: constructing virtual worlds from real scenes," IEEE Multimedia Mag., vol. 1, no. 1, pp. 34-47, 1997
12 Akozak, "3Dc white paper," ATI Technologies, INC., May 2004
13 S. Chen, "QuickTime VR: an image-based approach to virtual environment navigation," in Proc. Annu. Conf. Computer Graphics (SIGGRAPH'95), pp. 29-38, Aug. 1995   DOI
14 J. Shade, D. Lischinski, D. Salesin, T. DeRose, and J. Snyder, "Hierarchical image caching for accelerated walkthroughs of complex environments," in Proc. Annu. Conf. Computer Graphics (SIGGRAPH'96), pp. 75-82, Aug. 1996   DOI
15 P. Benzie, N. Grammalidis, S. Malassiotis, J. Ostermann, S. Piekh, V. Sainow, C. Theobalt, T. Thevar, and X. Zabulis, "3-D time-varying scene capture technologies—survey," IEEE Trans. Circuits and Systems for Video Technology, vol. 17, no. 11, pp. 1568-1586, Nov. 2007   DOI   ScienceOn