Mathematical Modeling for the Physical Relationship between the Coordinate Systems of IMU/GPS and Camera

IMU/GPS와 카메라 좌표계간의 물리적 관계를 위한 수학적 모델링

  • Published : 2008.12.31

Abstract

When extracting geo-referenced 3D data from cameras mounted on Mobile Mapping Systems, one of important properties for accuracy of extracted data is the alignment of the relative translation(lever-arm) and rotation(bore-sight) between the coordinate systems of Inertial Measurement Unit(IMU)/Ground Positioning System(GPS) and cameras. Since the conventional method calculates absolute camera orientation using ground control points (GCP), the alignment is determined in one Coordinated System (GPS Coordinated System). It basically require GCP. We proposed a mathematical model for the alignment using the initially uncoupled data of cameras and IMU/GPS without GCPs.

모바일 매핑시스템 (Mobile Mapping Systems)에 장착된 카메라로부터, 3차원 데이터를 취득시, 취득된 3차원 데이터의 정밀도를 결정하는 중요한 요소 중 하나는 IMU/GPS와 카메라 좌표계간의 상대적인 위치(lever-arm)와 자세(bore-sight) 얼라인먼트이다. 기존 연구는 지상기준점(GPS)을 통하여 카메라의 절대표정을 계산하기 때문에, 하나의 좌표계 (GPS 좌표계) 상에서 이 얼라인먼트가 이루어진다. 이 방법은 GCP을 기본적으로 필요로 하는 단점이 있다. 본 논문에서는 GCP가 필요하지 않고, 연관성이 없는 카메라 데이터와 IMU/GPS 데이터를 통하여 이 두좌표계 간의 얼라인먼트를 계산하는 수학적 모델링을 제시한다.

Keywords

References

  1. 전재춘, 2008, 벡터내적 기반 카메라 자세 추정, 대한원격탐사학회지, 24(6). pp. 641-644 https://doi.org/10.7780/kjrs.2008.24.6.641
  2. 전재춘, S. Sastry, 2008. 벡터내적기반 카메라 외부파라메타, 응용: 절대표정, 제어로봇시스템학회지, 14(1), pp. 70-74
  3. 전재춘, S. Sastry , 2007. 벡터내적 기반 카메라 외부 파라메터응용: 카메라와 레이져스캐너간의 캘리브레이션, 대한원격탐사학회지, 23(6), pp. 553-558 https://doi.org/10.7780/kjrs.2007.23.6.553
  4. 전재춘, 서용철, 김형석 (2004), 동적계획법과 적응 비용 변환을 이용한 영상 모자이크의 seam-line 결정, 한국지리정보학회지, 7(2), pp. 16-28
  5. Bayoud, F. A (2005), Vision-Aided Inertial Navigation Using a Geomatics Approach, Proceedings of the ION GNSS 2005 Meeting, Long Beach, USA, pp. 13-16
  6. Brown, D.C. (1971), Lens Distortion for Close-Range Photogrammetry-, Photometric Engineering, Vol. 37, No. 8, pp. 855-866
  7. Chon, J, Fuse, T., Shimizu, E, and Shibasaki, R. (2007), 3D Image Mosaicking Using Multiple Projection Planes, IEEE Tr. on SMC-B, Vol. 37, No. 3, pp 1-12
  8. Edward M. Mikhail, James S. Bethel and J. Chris McGlone (2001), Introduction to modern photogrammetry, JOHNWILEY &SONS,INC., pp. 80-151
  9. El-Sheimy, N. and Schwarz, K. P. (1999), Navigating Urban Areas by VISAT - A Mobile Mapping System Integrating GPS/INS/Digital Cameras for GIS Application, Navigation, Vol. 45, No. 4, pp. 275-286
  10. Gennery, Donald B., (2006), Generalized Camera Calibration Including Fish-Eye Lenses, International Journal of Computer Vision, Vol. 68, No. 3, pp. 239-266 https://doi.org/10.1007/s11263-006-5168-1
  11. Han, J.H. and Park,J.S. (2000), Contour matching using epipolar geometry, IEEETr.onPAMI, Vol. 22, No. 4, pp. 358-370
  12. Heikkil, J. and Silven, O. (1997), A Four-step Camera Calibration Procedure with Implicit Image Correction, In Computer Vision and Pattern Recognition, pp. 1106-1113
  13. Mostafa, M.M.R. (2003), Design and Performance of the DSS, Proceedings, 49th Photogrammetric Week, Stuttgart, Germany, September 1-5, 2003
  14. Pollefeys, M., Koch, R., Vergauwen, M., and Gool, L. V. (2000), Automated reconstruction of 3D scenes from sequences of images, ISPRS Journal Of Photogrammetry And RemoteSensing, Vol. 55, No. 4, pp. 251-267 https://doi.org/10.1016/S0924-2716(00)00023-X
  15. Schwarz, K. P., Chapman, M. A., Cannon M.E and Gong, P. (1993). An Integrated INS/GPS Approach to the Georeferencing of Remotely Sensed Data, Photogrammetric Engineering &Remote Sensing, Vol. 59, No. 11, pp. 1667-1674
  16. Skaloud, J (1999), Problems in direct georeferencing by INS/GPS in the airborne environment、ISPRS Barcelona, pp. 25-26
  17. NASA (2008), Mars Mapping Technology Brings Main Street to Life, 50 Years of NASA-Derived Technologies(1958-2008), SPIN-OFF, pp. 141-142, http://www.sti.nasa.gov/tto/Spinoff2008/ct_9.html
  18. Tsai, R. Y. (1987), A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses, IEEE Journal of Robotics Automat., Vol. RA-3, No. 4. pp. 323-344
  19. Zhang,Z. (1999),Flexible Camera Calibration By Viewing a Plane From Unknown Orientations, In 7th IEEE International Conference on Computer Vision, pp. 666—673