Journal of Electrical Engineering and Technology

The Korean Institute of Electrical Engineers (대한전기학회)
권호 표지
DOI QR코드

DOI QR Code

Augmented Feature Point Initialization Method for Vision/Lidar Aided 6-DoF Bearing-Only Inertial SLAM

  • Yun, Sukchang (Dept. of Aerospace Information Engineering, Konkuk University) ;
  • Lee, Byoungjin (Dept. of Aerospace Information Engineering, Konkuk University) ;
  • Kim, Yeon-Jo (Dept. of Aerospace Information Engineering, Konkuk University) ;
  • Lee, Young Jae (Dept. of Aerospace Information Engineering, Konkuk University) ;
  • Sung, Sangkyung (Dept. of Aerospace Information Engineering, Konkuk University)
  • Received : 2015.09.10
  • Accepted : 2016.05.16
  • Published : 2016.11.01
Download PDF
⟨ Previous Next ⟩

Abstract

This study proposes a novel feature point initialization method in order to improve the accuracy of feature point positions by fusing a vision sensor and a lidar. The initialization is a process that determines three dimensional positions of feature points through two dimensional image data, which has a direct influence on performance of a 6-DoF bearing-only SLAM. Prior to the initialization, an extrinsic calibration method which estimates rotational and translational relationships between a vision sensor and lidar using multiple calibration tools was employed, then the feature point initialization method based on the estimated extrinsic calibration parameters was presented. In this process, in order to improve performance of the accuracy of the initialized feature points, an iterative automatic scaling parameter tuning technique was presented. The validity of the proposed feature point initialization method was verified in a 6-DoF bearing-only SLAM framework through an indoor and outdoor tests that compare estimation performance with the previous initialization method.

Keywords

References

  1. T. Bailey, "Constrained initialisation for bearing-only SLAM," in IEEE International Conference on Robotics and Automation, 2003, pp. 1966-1971.
  2. A. J. Davison, "Real-time simultaneous localisation and mapping with a single camera," in International Conference on Computer Vision., 2003, vol. 2, pp. 1403-1410.
  3. A. J. Davison, Y. G. Cid, and N. Kita, "REAL-TIME 3D SLAM WITH WIDE-ANGLE VISION," in IFAC/EURON Symposium on Intelligent Autonomous Vehicles, 2004.
  4. N. M. Kwok and G. Dissanayake, "An efficient multiple hypothesis filter for bearing-only SLAM," 2004 IEEE/RSJ Int. Conf. Intell. Robot. Syst. (IEEE Cat. No.04CH37566), pp. 736-742, 2004.
  5. C. Premebida, O. Ludwig, and U. Nunes, "LIDAR and Vision-Based Pedestrian Detection System," J. F. Robot., vol. 26, no. 9, pp. 696-711, 2009. https://doi.org/10.1002/rob.20312
  6. L. Huang and M. Barth, "Tightly-Coupled LIDAR and Computer Vision Integration for Vehicle Detection," in IEEE Intelligent Vehicles Symposium, 2009, pp. 604-609.
  7. P. Moghadam, W. S. Wijesoma, and D. J. Feng, "Improving Path Planning and Mapping Based on Stereo Vision and Lidar," in International Conference on Control, Automation, Robotics and Vision, 2008, no. December, pp. 384-389.
  8. "Kinect Specification." [Online]. Available: https://dev.windows.com/en-us/kinect/hardware.
  9. "DepthSense Camera Specification." [Online]. Available: http://www.softkinetic.com/Products/DepthSenseCameras.
  10. "Basler ToF Camera Specification." [Online]. Available: https://www.baslerweb.com/media/documents/BAS1409_ToF_EN_web.pdf.
  11. D. Wilson, "Time of Flight Cameras Take on Industrial Applications," Novus Light Technologies Today, 15-Jun-2015.
  12. G. Cui, J. Wang, and J. Li, "Robust multilane detection and tracking in urban scenarios based on LIDAR and mono-vision," IET Image Process., vol. 8, no. 5, pp. 269-279, 2014. https://doi.org/10.1049/iet-ipr.2013.0371
  13. Q. Li, L. Chen, M. Li, S. L. Shaw, and A. Nuchter, "A sensor-fusion drivable-region and lane-detection system for autonomous vehicle navigation in challenging road scenarios," IEEE Trans. Veh. Technol., vol. 63, no. 2, pp. 540-555, 2014. https://doi.org/10.1109/TVT.2013.2281199
  14. A. Cherubini, F. Spindler, and F. Chaumette, "Autonomous Visual Navigation and Laser-Based Moving Obstacle Avoidance," IEEE Trans. Intell. Transform. Syst., vol. 15, no. 5, pp. 2101-2110, 2014. https://doi.org/10.1109/TITS.2014.2308977
  15. T. Ju, W. Lu, K. Chen, and J. Guo, "Vision-Based Moving Objects Detection for Intelligent Automobiles and a Robustness Enhancing Method," in 2014 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW), 2014, vol. 1, pp. 75-76.
  16. Q. Zhang and R. Pless, "Extrinsic Calibration of a Camera and Laser Range Finder (improves camera calibration)," in IEEE/RJS International Conference on Intelligent Robot Systems, 2004, pp. 2301-2306.
  17. L. Huang and M. Barth, "A Novel Multi-Planar LIDAR and Computer Vision Calibration Procedure Using 2D Patterns for Automated Navigation," in IEEE Intelligent Vehicles Symposium, 2009, pp. 117-122.
  18. O. Naroditsky, A. P. Iv, and K. Daniilidis, "Automatic Alignment of a Camera with a Line Scan LIDAR System," in 2011 IEEE International Conference on Robotics and Automation, 2011, pp. 3429-3434.
  19. R. Unnikrishnan and M. Hebert, "Fast Extrinsic Calibration of a Laser Rangefinder to a Camera," in Tech. Report CMU-RI-TR-05-09, Rototics Institute, 2005.
  20. G. Pandey, J. R. Mcbride, S. Savarese, and R. M. Eustice, "Automatic Targetless Extrinsic Calibration of a 3D Lidar and Camera by Maximizing Mutual Information," in Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, 2012, pp. 2053-2059.
  21. P. Moghadam, M. Bosse, and R. Zlot, "Line-based extrinsic calibration of range and image sensors," in IEEE International Conference on Robotics and Automation, 2013, no. c, pp. 3685-3691.
  22. D. Scaramuzza, A. Harati, and R. Siegwart, "Extrinsic self calibration of a camera and a 3D laser range finder from natural scenes," in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2007, pp. 4164-4169.
  23. S. Hur, D. H. Shim, and J. Kim, "Integrated navigation system using camera and gimbaled laser scanner for indoor and outdoor autonomous flight of UAVs," 2013 IEEE/RSJ Int. Conf. Intell. Robot. Syst., pp. 3158-3163, Nov. 2013.
  24. J. J. More, "The Levenberg-Marquardt algorithm: Implementation and theory," in Proceedings of the Biennial Conference, 1977, pp. 105-116.
  25. H. Durrant-whyte and T. Bailey, "Simultaneous Localization and Mapping: Part I," IEEE Robot. Autom. Mag., vol. 13, no. 2, pp. 99-108, 2006.
  26. M. W. M. G. Dissanayake, P. Newman, S. Clark, H. F. Durrant-whyte, and M. Csorba, "A Solution to the Simultaneous Localization and Map Building (SLAM) Problem," IEEE Trans. Robot. Autom., vol. 17, no. 3, pp. 229-241, 2001. https://doi.org/10.1109/70.938381
  27. J. Kim and S. Sukkarieh, "Autonomous airborne navigation in unknown terrain environments," IEEE Trans. Aerosp. Electron. Syst., vol. 40, no. 3, pp. 1031-1045, 2004. https://doi.org/10.1109/TAES.2004.1337472
  28. D. Benson, "A Comparison of Two Approaches to Pure-Inertial and Doppler-Inertial Error Analysis," IEEE Trans. Aerosp. Electron. Syst., vol. AES-11, no. 4, pp. 447-455, Jul. 1975. https://doi.org/10.1109/TAES.1975.308106
  29. S. Yun, Y. J. Lee, C. J. Kim, and S. Sung, "Integrated Navigation Design Using a Gimbaled Vision/LiDAR System with an Approximate Ground Description Model," Int. J. Aeronaut. Sp. Sci., vol. 14, no. 4, pp. 369-378, Dec. 2013.
  30. C. Harris and M. Stephens, "A Combined Corner and Edge Detector," Procedings Alvey Vis. Conf. 1988, pp. 147-151, 1988.
  31. C. Tomasi and T. Kanade, "Detection and Tracking of Point Features," in Technical Report CMU-CS-91-132, Carnegie Mellon University, 1991, no. April.