Browse > Article
http://dx.doi.org/10.15701/kcgs.2018.24.3.61

High-quality Texture Extraction for Point Clouds Reconstructed from RGB-D Images  

Seo, Woong (Department of Computer Science and Engineering, Sogang University)
Park, Sang Uk (Department of Computer Science and Engineering, Sogang University)
Ihm, Insung (Department of Computer Science and Engineering, Sogang University)
Publication Information
Journal of the Korea Computer Graphics Society / v.24, no.3, 2018 , pp. 61-71 More about this Journal
Abstract
When triangular meshes are generated from the point clouds in global space reconstructed through camera pose estimation against captured RGB-D streams, the quality of the resulting meshes improves as more triangles are hired. However, for 3D reconstructed models beyond some size threshold, they become to suffer from the ugly-looking artefacts due to the insufficient precision of RGB-D sensors as well as significant burdens in memory requirement and rendering cost. In this paper, for the generation of 3D models appropriate for real-time applications, we propose an effective technique that extracts high-quality textures for moderate-sized meshes from the captured colors associated with the reconstructed point sets. In particular, we show that via a simple method based on the mapping between the 3D global space resulting from the camera pose estimation and the 2D texture space, textures can be generated effectively for the 3D models reconstructed from captured RGB-D image streams.
Keywords
RGB-D image stream; camera pose estimation; 3D point set; triangular mesh; texture generation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 R. A Newcombe, S. lzadi, O. Hilliges, D. Molyneaux, D. Kim, A. J. Davison, P. Kohli, J. Shotton, S. Hodges, A. Fitzgibbon, "KinectFusion: Real-time dense surface mapping and tracking," Proc. the 2011 IEEE international Symposium on Mixed and Augmented Reality (JSMAR). pp. 127-136, October 2011.
2 H. Pfister, M. Zwicker, J. van Baar, M. Gross, "Surfels: Surface elements as rendering primitives," in ACM Transactions on Graphics (Proc. ACM SJGGRAPH 2000). pp. 335-342, 2000.
3 M. Kazhdan and H. Hoppe, "Screened Poisson surface reconstruction," ACM Transactions on Graphics (TOG), Vol. 32, No. 3, pp. 1-13, June 2013.
4 B. Levy, S. Petitjean, N. Ray, and J. Maillot. "Least squares conformal maps for automatic texture atlas generation." ACM Transactions on Graphics (Proc. ACM SIGGRAPH 2002). Vol. 21, No. 3, pp. 362-371, 2002.
5 M. Arikan, R. Preiner, C. Scheiblauer, S. Jeschke, and M. Wimmer, "Large-scale point-cloud visualization through localized textured surface reconstruction," IEEE Transactions on Visualization and Computer Graphics, Vol. 20, No. 9, pp. 1280-1292, 2014.   DOI
6 T. Whelan, M. Kaess, H. Johannsson, M. Fallon, J. Leonard, and J. McDonald, "Real-time large-scale desne RGB-D SLAM with volumetric fusion," The Intl. J. of Robotics Research, Vol. 34, No. 4-5, pp. 598-626, 2015.   DOI
7 L. Ma, T. Whelan, E. Bondarev, P. H. N. de With, and J. McDonald, "Planar simplification and texturing of dense point cloud maps," Proc. 2013 European Conf. on Mobile Robots, pp. 25-27, 2013.
8 S. Liu, W. Li, P. Ogunbona, and Y. Chow, "Creating simplified 3D Models with high quality textures," Proc. 2015 Intl. Conf. on Digital Image Computing; Techniques and Applications, 2015.
9 Q. Zhou and V. Koltun, "Color map optimization for 3D reconstruction with consumer depth cameras," ACM Transactions on Graphics, Vol. 33, Issue 4, Article No. 155, 2014.
10 A. Handa, T. Whelan, J. McDonald and A. J. Davison, "A Benchmark for RGB-D Visual Odometry, 3D Reconstruction and SLAM," Proc. IEEE Int. Conf. Robot. Autom., pp. 1524-1531, 2014.
11 T. Whelan, S. Leutenegger, R. F. Salas-Moreno, B. Glocker and A. J. Davison, "ElasticFusion: Dense SLAM Without A Pose Graph," Proc. robotics Science and systems (RSS), 2015 .
12 J. An, J. Lee, J. Jeong, and I. Ihm, "Tracking an RGB-D camera on mobile devices using an improved frame-to-frame pose estimation method," Proc. IEEE Winter Conf. on Applications of Computer Vision 2018, pp. 1142-1150, 2014.