Browse > Article
http://dx.doi.org/10.5909/JBE.2010.15.2.163

Stereoscopic Free-viewpoint Tour-Into-Picture Generation from a Single Image  

Kim, Je-Dong (Kangwon National University, Dept. of Computer and Communications)
Lee, Kwang-Hoon (Kangwon National University, Dept. of Computer and Communications)
Kim, Man-Bae (Kangwon National University, Dept. of Computer and Communications)
Publication Information
Journal of Broadcast Engineering / v.15, no.2, 2010 , pp. 163-172 More about this Journal
Abstract
The free viewpoint video delivers an active contents where users can see the images rendered from the viewpoints chosen by them. Its applications are found in broad areas, especially museum tour, entertainment and so forth. As a new free-viewpoint application, this paper presents a stereoscopic free-viewpoint TIP (Tour Into Picture) where users can navigate the inside of a single image controlling a virtual camera and utilizing depth data. Unlike conventional TIP methods providing 2D image or video, our proposed method can provide users with 3D stereoscopic and free-viewpoint contents. Navigating a picture with stereoscopic viewing can deliver more realistic and immersive perception. The method uses semi-automatic processing to make foreground mask, background image, and depth map. The second step is to navigate the single picture and to obtain rendered images by perspective projection. For the free-viewpoint viewing, a virtual camera whose operations include translation, rotation, look-around, and zooming is operated. In experiments, the proposed method was tested eth 'Danopungjun' that is one of famous paintings made in Chosun Dynasty. The free-viewpoint software is developed based on MFC Visual C++ and OpenGL libraries.
Keywords
Free viewpoint video; TIP (Tour-Into-Picture); stereoscopic image; depth map;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 J. Michels, A. Saxena, and A. Y. Ng, "High speed obstacle avoidance using monocular vision and reinforcement learning," Proc. of International Conference on Machine Learning, ACM, 2005.
2 N. S. Chu and C. Tai, "Animating Chinese landscape paintings and panorama using multi-perspective modeling," Proceedings of International Conference on Computer Graphics, IEEE, pp. 107-113, 2001.
3 D. F. McAllister (editor), Stereo computer graphics and other true 3D technologies, Princeton, NJ:Princeton University Press, 1993.
4 E. R. Davies, Laws' texture energy in Texture. In Machine Vision: Theory, Algorithms, Practicalities, 2nd Ed., Academic Press, San Diego, 1997.
5 F. S. Hill, Jr, Computer graphics using OpenGL, 2nd Ed. Prentice-Hall, 1990.
6 R. Seidel, "A simple and fast randomized algorithm for computing trapezoidal decompositions and for triangulating polygons," Computational Geometry Theory & Application, Vol. 1, pp. 51-64, 1991.   DOI   ScienceOn
7 K. Boulanger, K. Bouatouch, S. Pattanaik, "ATIP: A Tool for 3D Navigation inside a Single Image with Automatic Camera Calibration," EG UK Theory and Practice of Computer Graphics 2006.
8 조철용, 김만배, "3DTIP: 한국 고전화의 3차원 입체 Tour-Into- Picture," 방송공학회논문지, 제14권 제5호, pp. 616-624, 2009년 9월.   과학기술학회마을   DOI
9 A. Criminisi, P. Perez and K. Toyama, "Region filling and object removal by exemplar-based image inpainting," IEEE Trans. Image Processing, Vol. 13, No. 9, pp. 1200-1212, 2004.   DOI   ScienceOn
10 H. Yamanoue, M. Okui and F. Okano, "Geometrical analysis of puppet-theater and cardboard effects in stereoscopic HDTV Images," IEEE Trans. On Circuits and Systems for Video Technology, Vol. 16, No. 6, June 2006.
11 H. Yamanoue, M. Okui and I. Yuyama, "A study on the relationship between shooting conditions and cardboard effect of stereoscopic Images," IEEE Trans. On Circuits and Systems for Video Technology, Vol. 10, No. 3, Apr. 2000.
12 A. Smolic, and P. Kauff, "Interactive 3D Video Representation and Coding Technologies", Proceedings of the IEEE, Special Issue on Advances in Video Coding and Delivery, vol. 93, no. 1, Jan. 2005.
13 Y. Horry, K. Anjyo, and K. Arai, "Tour Into the Picture: Using a Spidery Mesh Interface to Make Animation from a Single Image," Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, pp. 225-232, 1997.
14 Masayuki Tanimoto, "Free Viewpoint Television - FTV", Proc. PCS 2004, Picture Coding Symposium, San Francisco, CA, USA, December 15.-17. 2004.
15 A. Smolic, and D. McCutchen, "3DAV Exploration of Video-Based Rendering Technology in MPEG", IEEE Trans. on Circuits and Systems for Video Technology, Vol. 14, No. 3, pp. 348-356, March 2004.   DOI   ScienceOn