Browse > Article
http://dx.doi.org/10.3807/HKH.2009.20.1.016

Three-Dimensional Conversion of Two-Dimensional Movie Using Optical Flow and Normalized Cut  

Jung, Jae-Hyun (School of Electrical Engineering, Seoul National University)
Park, Gil-Bae (School of Electrical Engineering, Seoul National University)
Kim, Joo-Hwan (School of Electrical Engineering, Seoul National University)
Kang, Jin-Mo (School of Electrical Engineering, Seoul National University)
Lee, Byoung-Ho (School of Electrical Engineering, Seoul National University)
Publication Information
Korean Journal of Optics and Photonics / v.20, no.1, 2009 , pp. 16-22 More about this Journal
Abstract
We propose a method to convert a two-dimensional movie to a three-dimensional movie using normalized cut and optical flow. In this paper, we segment an image of a two-dimensional movie to objects first, and then estimate the depth of each object. Normalized cut is one of the image segmentation algorithms. For improving speed and accuracy of normalized cut, we used a watershed algorithm and a weight function using optical flow. We estimate the depth of objects which are segmented by improved normalized cut using optical flow. Ordinal depth is estimated by the change of the segmented object label in an occluded region which is the difference of absolute values of optical flow. For compensating ordinal depth, we generate the relational depth which is the absolute value of optical flow as motion parallax. A final depth map is determined by multiplying ordinal depth by relational depth, then dividing by average optical flow. In this research, we propose the two-dimensional/three-dimensional movie conversion method which is applicable to all three-dimensional display devices and all two-dimensional movie formats. We present experimental results using sample two-dimensional movies.
Keywords
Three-dimensional display; 2D/3D conversion; Optical flow; Normalized cut;
Citations & Related Records
연도 인용수 순위
  • Reference
1 T. Okoshi, “Three-dimensional displays,” Proc. IEEE, vol. 68, no. 5, pp. 548-564, 1980   DOI   ScienceOn
2 J.-H. Park, H.-R. Kim, Y. Kim, J. Kim, J. Hong, S.-D. Lee, and B. Lee, “Depth-enhanced three-dimensional-twodimensional convertible display based on modified integral imaging,” Opt. Lett., vol. 29, no. 23, pp. 2734-2736, 2004   DOI   ScienceOn
3 T. Okino, G. Murata, K. Taima, T. Iinuma, and K. Oketani, “New television with 2D/3D image conversion technologies,” Proc. SPIE, vol. 2653, pp. 96-103, 1996   DOI
4 B. J. Garcia, “Approaches to stereoscopic video based on spatiotemporal interpolation,” Proc. SPIE, vol. 2653, pp. 85-95, 1996   DOI
5 Y. Matsumoto, H. Terasaki, K. Sugumoto, and T. Arakawa, “Conversion system of monocular image sequence to stereo using motion parallax,” Proc. SPIE, vol. 3012, pp. 108-115, 1997   DOI
6 M. B. Kim, M. S. Song, D. K. Kim, and K. C. Choi, “Stereoscopic conversion of monoscopic video by the transformation of vertical-to-horizontal disparity,” Proc. SPIE, vol. 3295, pp. 65-75, 1998   DOI
7 L. Vincent and P. Soille, “Watersheds in digital spaces: an efficient algorithm based on immersion simulations,” IEEE Transactions of Pattern Analysis and Machine Intelligence, vol. 13, no. 6, pp. 583-598, 1991   DOI   ScienceOn
8 A. S. Ogale, C. Fermuller, and Y. Aloimonos, “Motion segmentation using occlusions,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 6, pp. 988-992, 2005   DOI   ScienceOn
9 J. Ross, “Stereopsis by binocular delay,” Nature, vol. 248, pp. 363-364, 1974   DOI   ScienceOn
10 H. Choi, J. Kim, S.-W. Cho, Y. Kim, J. B. Park, and B. Lee, “Three-dimensional-two-dimensional mixed display system using integral imaging with an active pinhole array on a liquid crystal panel,” Appl. Opt., vol. 47, no. 13, pp. 2207-2214, 2008   DOI
11 B. K. P. Horn and B. G. Schunck, “Determining optical flow,” Artificial Intelligence, vol. 17, no. 1-3, pp. 185-204, 1981   DOI   ScienceOn
12 장세일, 황선규, 김회율, “Markov Random Fields를 이용한 움직이는 객체 추출 및 추적,” 대한 전자공학회 하계학술대회, vol. 26, no. 1, pp. 2100-2103, 2003   과학기술학회마을
13 J. Shi and J. Malik, “Normalized cuts and image segmentation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, 2000   DOI   ScienceOn