Browse > Article

Depth Generation Method Using Multiple Color and Depth Cameras  

Kang, Yun-Suk (Realistic Broadcasting Research Center, Gwangju Institute of Science and Technology)
Ho, Yo-Sung (Realistic Broadcasting Research Center, Gwangju Institute of Science and Technology)
Publication Information
Journal of the Institute of Electronics Engineers of Korea SP / v.48, no.3, 2011 , pp. 13-18 More about this Journal
Abstract
In this paper, we explain capturing, postprocessing, and depth generation methods using multiple color and depth cameras. Although the time-of-flight (TOF) depth camera measures the scene's depth in real-time, there are noises and lens distortion in the output depth images. The correlation between the multi-view color images and depth images is also low. Therefore, it is essential to correct the depth images and then we use them to generate the depth information of the scene. The results of stereo matching based on the disparity information from the depth cameras showed the better performance than the previous method. Moreover, we obtained the accurate depth information even at the occluded or textureless regions which are the weaknesses of stereo matching.
Keywords
Depth generation; Multi-view camera; TOF camera; 3DTV;
Citations & Related Records
연도 인용수 순위
  • Reference
1 A. Smolic and P. Kauff, "Interactive 3D Video Representation and Coding Technologies," Proceedings of the IEEE, Spatial Issue on Advances in Video Coding and Delivery, vol. 93, no. 1, pp. 99-110, Jan. 2005.
2 J. Zhu, L. Wang, R. Yang, and J. Davis, "Fusion of Time-of-Flight Depth and Stereo for High Accuracy Depth Maps," Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp. 231-236, June 2008.
3 B. Bartczak and R. Koch, "Dense Depth Maps from Low Resolution Time-of-Flight Depth and High Resolution Color Views," Proc. of 5th International Symposium on Visual Computing, pp. 1-12, Nov. 2009.
4 http://www.vision.caltech.edu/bouguetj, Camera Calibration Toolbox for MATLAB.
5 Y.S. Kang and Y.S. Ho, "Geometrical Compensation for Multi-view Video in Multiple Camera Array," Proc. of Int'l Symposium on Electronics and Marine, pp. 83-86, Sept. 2008.
6 A. Ilie and G. Welch, "Ensuring color consistency across multiple cameras," Proc. of IEEE international Conference on Computer Vision, pp. II: 1268-1275, Oct. 2005.
7 P.F. Felzenszwalb and D.P. Huttenlocher, "Efficient Belief Propagation for Early Vision," International Journal of Computer Vision, vol. 70, no. 1, pp. 41-54, Oct. 2006.   DOI   ScienceOn
8 A. Wang, T. Qiu, and L. Shao, "A Simple Method of Radial Distortion Correction with Centre of Distortion Estimation," Journal of Mathematical Imaging and Vision, vol. 35, no. 3, pp. 165-172, July 2009.   DOI   ScienceOn
9 G. Gilboa, N. Sochen, and Y.Y. Zeevi, "Regularized Shock Filters and Complex Diffusion", ECCV 2002, LNCS 2350, pp. 399-313, May 2002.
10 Y.S. Ho and Y.S. Kang, "Multi-view Depth Generation using Multi-Depth Camera System," Proc. of International Conference on 3D Systems and Application (3DSA), pp. 1-4, May 2010.