Browse > Article

A Novel Segment Extraction and Stereo Matching Technique using Color, Motion and Initial Depth from Depth Camera  

Um, Gi-Mun (한국전자통신연구원 방통미디어연구본부)
Park, Ji-Min (한국과학기술원 CI(Compuational Imaging) 연구실)
Bang, Gun (한국전자통신연구원 방통미디어연구본부)
Cheong, Won-Sik (한국전자통신연구원 방통미디어연구본부)
Hur, Nam-Ho (한국전자통신연구원 방통미디어연구본부)
Kim, Jin-Woong (한국전자통신연구원 방통미디어연구본부)
Publication Information
The Journal of Korean Institute of Communications and Information Sciences / v.34, no.12C, 2009 , pp. 1147-1153 More about this Journal
Abstract
We propose a novel image segmentation and segment-based stereo matching technique using color, depth, and motion information. Proposed technique firstly splits reference images into foreground region or background region using depth information from depth camera. Then each region is segmented into small segments with color information. Moreover, extracted segments in current frame are tracked in the next frame in order to maintain depth consistency between frames. The initial depth from the depth camera is also used to set the depth search range for stereo matching. Proposed segment-based stereo matching technique was compared with conventional one without foreground and background separation and other conventional one without motion tracking of segments. Simulation results showed that the improvement of segment extraction and depth estimation consistencies by proposed technique compared to conventional ones especially at the static background region.
Keywords
Image Segmentation; Segment-based Stereo Matching; Depth Estimation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 http://www.3dvsystems.com/technology/tech.html
2 http://www.pmdtec.com/products-services/pmdvisionr-cameras/pmdvisionr-camcube-20/
3 http://www.mesa-imaging.ch/prodview4k.php
4 J. B. MacQueen, 'Some Methods for classification and Analysis of Multivariate Observations, ' Proceedings of 5-th Berkeley Symposium on Mathematical Statistics and Probability, Berkeley, University of California Press, vol. 1, pp.281-297, 1967
5 Xuizhi Zhou and Runsheng Wang, 'Stereo matching based on color and disparity segmentation by belief propagation', SPIE Journal of Optical Engineering, vol. 46, no. 4, April, 2007
6 Sang-Beom Lee, Kwan-Jung Oh, and Yo-Sung Ho, 'Segment-Based Multi-View Depth Estimation Using Belief Propagation From Dense Multi-View Video', IEEE 3DTV Conference, pp. 193-196, May 2008
7 http://www.3d4you.eu/index.php?option=com_content&view=article&id=55&Itemid=53
8 D. Comaniciu, P. Meer, 'Mean shift: a robust approach toward feature space analysis,' IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-24, no. 5, pp. 603-619, May 2002
9 ISO/IEC JTC1/SC29/WG11, m15419, Multiview Video Test Sequence and Camera Parameters, April 2008
10 H. Tao, H. S. Sawhney, and R. Kumar, 'Dynamic Depth Recovery from Multiple Synchronized Video Streams,' Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '03), vol. 2, pp.351, 2003
11 http://www.vision.caltech.edu/bouguetj/ calib_doc/