Browse > Article
http://dx.doi.org/10.5370/JEET.2018.13.6.2530

Improved LiDAR-Camera Calibration Using Marker Detection Based on 3D Plane Extraction  

Yoo, Joong-Sun (Hancom Robotics Inc.)
Kim, Do-Hyeong (Dept. of Control and Robot Engineering, Chungbuk National University)
Kim, Gon-Woo (School of Electronics Engineering, Chungbuk National University)
Publication Information
Journal of Electrical Engineering and Technology / v.13, no.6, 2018 , pp. 2530-2544 More about this Journal
Abstract
In this paper, we propose an enhanced LiDAR-camera calibration method that extracts the marker plane from 3D point cloud information. In previous work, we estimated the straight line of each board to obtain the vertex. However, the errors in the point information in relation to the z axis were not considered. These errors are caused by the effects of user selection on the board border. Because of the nature of LiDAR, the point information is separated in the horizontal direction, causing the approximated model of the straight line to be erroneous. In the proposed work, we obtain each vertex by estimating a rectangle from a plane rather than obtaining a point from each straight line in order to obtain a vertex more precisely than the previous study. The advantage of using planes is that it is easier to select the area, and the most point information on the board is available. We demonstrated through experiments that the proposed method could be used to obtain more accurate results compared to the performance of the previous method.
Keywords
3D LiDAR; Extrinsic calibration; Marker detection; Point cloud; Plane fitting;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Shotton, Jamie, et al. "Real-time human pose recognition in parts from single depth images," Computer Vision and Pattern Recognition conference, Colorado, USA, June, 2011.
2 Andreasson, Henrik, and Achim J. Lilienthal. "6D scan registration using depth-interpolated local image features," Robotics and Autonomous Systems, vol. 58, no. 2, pp. 157-165, 2010.   DOI
3 Pandey, Gaurav, et al. "Extrinsic calibration of a 3d laser scanner and an omnidirectional camera," 7th IFAC symposium on intelligent autonomous vehicles, vol. 7, no. 1, 2010.
4 Zhang, Zhengyou. "Flexible camera calibration by viewing a plane from unknown orientations," in Proceedings of IEEE Computer Vision Conference, vol. 1, 1999.
5 Smisek, Jan, Michal Jancosek, and Tomas Pajdla. "3D with Kinect," In Consumer depth cameras for computer vision, pp. 3-25, Springer, London, 2013.
6 Zhu, Jiejie, et al. "Fusion of time-of-flight depth and stereo for high accuracy depth maps," Computer Vision and Pattern Recognition Conference, Alaska, USA, 2008.
7 Vasconcelos, Francisco, Joao P. Barreto, and Urbano Nunes. "A minimal solution for the extrinsic calibration of a camera and a laser-rangefinder," IEEE transactions on pattern analysis and machine intelligence, vol. 34, no. 11, pp. 2097-2107, 2012.   DOI
8 Jung, Jiyoung, et al. "A novel 2.5 D pattern for extrinsic calibration of tof and camera fusion system," Intelligent Robots and Systems, San Francisco, USA, 2011.
9 Sui, Jingfeng, and Shuo Wang. "Extrinsic calibration of camera and 3D laser sensor system," Chinese Control Conference, Dalian, China, 2017.
10 Xiao, Zhipeng, et al. "Accurate extrinsic calibration between monocular camera and sparse 3D Lidar points without markers," Intelligent Vehicles Symposium, IEEE, 2017.
11 Dhall, A., et al. "LiDAR-camera calibration using 3D-3D point correspondences," arXiv preprint arXiv: 1705.09785, 2017.
12 Kern, F. "Supplementing laserscanner geometric data with photogrammetric images for modeling," International Archives of Photogrammetry Remote Sensing and Spatial Information Sciences 34.5/ C7, pp. 454-461, 2002.
13 Gong, Xiaojin, Ying Lin, and Jilin Liu. "3D LIDARcamera extrinsic calibration using an arbitrary trihedron," Sensors, vol. 13, no. 2, pp. 1902-1918, 2013.   DOI
14 Velas, M., et al. "Calibration of rgb camera with velodyne lidar," International Conference on Computer Graphics, Visualization and Computer Vision, Plzen, Czech, 2014.
15 Yoo, J.S, Kim, G.W. "3D LiDAR-camera calibration using efficient marker detection based on plane surface extraction," Proc of 2017 ICROS (Institute of Control, Robotics and Systems) Daejeon, Korean, 2017.
16 [Online] Available: https://github.com/SmartRoboticSystems/aruco_mapping
17 Zhang, N. "Plane fitting on airborne laser scanning data using ransac," Lunds Tekniska Hogskola, pp. 17, 2011.
18 [Online] Available: http://pointclouds.org/documentation/tutorials/.
19 Atanacio-Jimenez, Gerardo, et al. "Lidar velodyne hdl-64e calibration using pattern planes," International Journal of Advanced Robotic Systems, vol. 8, no. 5, pp. 59, 2011.   DOI
20 Jarvis, R. A. "On the identification of the convex hull of a finite set of points in the plane," Inform Process Lett, vol. 2, no. 1, pp. 18-21, 1973.   DOI
21 Graham, R.L, Yao, F.F. "Finding the convex hull of a simple polygon," J Algorithm, vol. 4, no. 4, pp. 324-331, 1983.   DOI
22 [Online] Available: http://jeffe.cs.illinois.edu/teaching/373/notes/x05-convexhull.pdf
23 Kang, K.T. "Smart sensors and intelligent cars," Mech J (in Korean) vol. 54, no. 10, pp. 32-34, 2014.
24 Besl, Paul J., and Ramesh C. Jain. "Three-dimensional object recognition," ACM Computing Surveys (CSUR), vol. 17, no. 1, pp. 75-145, 1985.   DOI
25 Freeman, H, Shapira, R. "Determining the minimumarea encasing rectangle for an arbitrary closed curve," Communications of the ACM, vol. 18, no. 7, pp. 409-413, 1975.   DOI
26 Guindel, C., Beltran, J., Martin, D. and Garcia, F. "Automatic Extrinsic Calibration for Lidar-Stereo Vehicle Sensor Setups," Intelligent Transportation Systems, Yokohama, Japan, 2017.
27 Kang, J., Doh, N. L. "Full-DOF calibration of a rotating 2-D LIDAR with a simple plane measurement," IEEE T Robot, vol. 32, no. 5, pp. 1245-1263, 2016.   DOI
28 Brown, Matthew, and David G. Lowe. "Automatic panoramic image stitching using invariant features," International journal of computer vision, vol. 74, no. 1, pp. 59-73, 2007.   DOI
29 Szeliski, Richard, and Heung-Yeung Shum. "Creating full view panoramic image mosaics and environment maps," Proceedings of the 24th annual conference on Computer graphics and interactive techniques. ACM Press/Addison-Wesley Publishing Co., 1997.