Browse > Article
http://dx.doi.org/10.5909/JBE.2020.25.3.439

Real-time 3D Volumetric Model Generation using Multiview RGB-D Camera  

Kim, Kyung-Jin (Kwangwoon university Electronic Materials Engineering)
Park, Byung-Seo (Kwangwoon university Electronic Materials Engineering)
Kim, Dong-Wook (Kwangwoon university Electronic Materials Engineering)
Kwon, Soon-Chul (Kwangwoon university Graduate School of Smart Convergence)
Seo, Young-Ho (Kwangwoon university Electronic Materials Engineering)
Publication Information
Journal of Broadcast Engineering / v.25, no.3, 2020 , pp. 439-448 More about this Journal
Abstract
In this paper, we propose a modified optimization algorithm for point cloud matching of multi-view RGB-D cameras. In general, in the computer vision field, it is very important to accurately estimate the position of the camera. The 3D model generation methods proposed in the previous research require a large number of cameras or expensive 3D cameras. Also, the methods of obtaining the external parameters of the camera through the 2D image have a large error. In this paper, we propose a matching technique for generating a 3D point cloud and mesh model that can provide omnidirectional free viewpoint using 8 low-cost RGB-D cameras. We propose a method that uses a depth map-based function optimization method with RGB images and obtains coordinate transformation parameters that can generate a high-quality 3D model without obtaining initial parameters.
Keywords
Registration; RGB-D Camera; Point Cloud; 3D; Camera Pose Estimation;
Citations & Related Records
Times Cited By KSCI : 5  (Citation Analysis)
연도 인용수 순위
1 S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodeges, D. Freeman, A. Davison, A. Fitzgibbon, "KinectFusion: Real-Time Dynamic 3D Surface Reconstruction and Interaction Using a Moving Depth Camera" ISMAR, Vol. 11, No. 2011, pp. 127-136, October 2011.
2 S. Choi, S. Park, "Convenient View Calibration of Multiple RGB-D Cameras Using a Spherical Object." KIPS Transactions on Software and Data Engineering, Vol.3 No.8, pp.309-314, 2014.   DOI
3 C. Gregory, W. Sang, K. David, "ICP Registration Using Invariant Features.", IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, Vol. 24, No. 1, pp. 90-102, January 2002.   DOI
4 S. Gold, A. Rangarajan, C. Lu, S. Pappu, E. Mjolsness, "New algorithms for 2d and 3d point matching: Pose estimation and correspondence." In Pattern Recognition, Journal of KIISE, Vol. 31, pp. 1019-1031, August 1998.   DOI
5 S. Granger, X. Pennec. "Multi-scale em-icp: A fast and robust approach for surface registration." In ECCV, pp. 418-432, June 2002.
6 P. David, D. DeMenthon, R. Duraiswami, H. Samet. "Simultaneous pose and correspondence determination using line features." In CVPR, pp. 424-431, June 2003.
7 W. Zhao, D. Nister, S. Hus. "Alignment of continuous video onto 3d point clouds." PAMI, Vol. 27, pp.1305-1318, August 2005.
8 Li, Hongdong, R. Hartley. "The 3D-3D Registration Problem Revisited." 2007 IEEE 11th International Conference on Computer Vision, pp. 1-8, 2007
9 S. Sclaroff, A. Pentland. "Modal matching for correspondence and recognition." In PAMI, June 1995.
10 M. Leordeanu, M. Hebert. "A spectral technique for correspondence problems using pairwise constraints." In ICCV, Vol. 2, pp. 1482-1489, 2005
11 J. Lee, "Camera calibration and Compensation distortion", Korea robotics society review, Vol. 10 No, 1, pp. 23-29, February 2013
12 K.-J Kim, B.-S. Park, D.-W. Kim, Y.-H. Seo, "Point Cloud Registration Algorithm Based on RGB-D Camera for Shooting Volumetric Objects.", JBE Vol. 24, No. 5, pp. 765-774, September 2019.
13 B. Lin, M. Su, P. Cheng, P. Tseng, S. Chen " Temporal and Spatial Denoising of Depth Maps", Sensors 2015 Vol. 15, No. 8, pp. 18506-18525, August 2015.
14 J. Digne, C. Franchis, "The Bilateral Filter for Point Clouds", Image Processing on Line Vol. 2017, No. 7, pp.278-287, March 2018.
15 T. Fang, L. A. Piegl. "Delaunay triangulation in three dimensions." IEEE Computer Graphics and Applications, Vol. 15, No. 5, pp. 62-69, September 1995   DOI
16 J. Kim, S. Yoo, K. Min. "Microsoft Kinect-based Indoor Building Information Model Acquisition." Computational Structural Engineering Institute of Korea 31.4 (2018): 207-214.   DOI
17 S. Lee, "Convergence Rate of Optimization Algorithms for a Non-strictly Convex Function", Institute of Control Robotics and Systems, pp. 349-350, May 2019.
18 Z. Zhang, "A flexible new technique for camera calibration," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.22, No.11, pp.1330-1334, 2000.   DOI