Korean Journal of Remote Sensing (대한원격탐사학회지)

Korean Society of Remote Sensing (대한원격탐사학회)
권호 표지
DOI QR코드

DOI QR Code

Speeding up the KLT Tracker for Real-time Image Georeferencing using GPS/INS Data

  • Tanathong, Supannee (Laboratory for Sensor and Modeling, Department of Geoinformatics, The University of Seoul) ;
  • Lee, Im-Pyeong (Laboratory for Sensor and Modeling, Department of Geoinformatics, The University of Seoul)
  • Received : 2010.10.19
  • Accepted : 2010.12.20
  • Published : 2010.12.30
Download PDF
⟨ Previous Next ⟩

Abstract

A real-time image georeferencing system requires all inputs to be determined in real-time. The intrinsic camera parameters can be identified in advance from a camera calibration process while other control information can be derived instantaneously from real-time GPS/INS data. The bottleneck process is tie point acquisition since manual operations will be definitely obstacles for real-time system while the existing extraction methods are not fast enough. In this paper, we present a fast-and-automated image matching technique based on the KLT tracker to obtain a set of tie-points in real-time. The proposed work accelerates the KLT tracker by supplying the initial guessed tie-points computed using the GPS/INS data. Originally, the KLT only works effectively when the displacement between tie-points is small. To drive an automated solution, this paper suggests an appropriate number of depth levels for multi-resolution tracking under large displacement using the knowledge of uncertainties the GPS/INS data measurements. The experimental results show that our suggested depth levels is promising and the proposed work can obtain tie-points faster than the ordinary KLT by 13% with no less accuracy. This promising result suggests that our proposed algorithm can be effectively integrated into the real-time image georeferencing for further developing a real-time surveillance application.

Keywords

References

  1. Bouguet, J. Y., 2000. Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the Algorithm. Technical Report, Intel Corporation, Microsoft Research Labs.
  2. Bradski, G. and Kaehler, A., 2008. Learning OpenCV: Computer Vision with the OpenCV Library. O'Reilly, California, pp. 316-367.
  3. CBC News, 2010. The world's worst natural disasters. [online] http://www.cbc.ca/world/ story/2008/05/08/f-natural-disastershistory. html
  4. Choi, K. and Lee, I., 2009. A Sequential AT Algorithm based on Combined Adjustment. Korean Journal of Geomatics, 27(6): 669- 678.
  5. Ghilani, C. D. and Wolf, P. R., 2006. Adjustment Computations : Spatial Data Analysis. John Wiley & Sons, New Jersey, pp. 84-95.
  6. Gruen, A. W., 1985. Adaptive Least Squares Correlation: A Powerful Image Matching Technique. South Africa Journal of Photogrammetry, Remote Sensing and Cartography, pp. 175-187.
  7. Hong, J., Lee, I., Oh, T. and Choi, K., 2009. Data Fusion of LIDAR and Image Data for Generation of a High-quality Urban DSM. Proceedings of the 2009 Urban Remote Sensing Joint Event, Shanghai, May 2009.
  8. Hubner, T., and Pajarola, R., 2009, Real-time Feature Acquisition and Integration for Vision-based Mobile Robots. ISVC09, USA, pp. 189-200.
  9. Lucas, B. and Kanade, T., 1981. An Iterative Image Registration Technique with An Application to Stereo Vision. Proceedings of the International Joint Conference on Artificial Intelligence, pp. 674-679
  10. Lowe, D., 2004. Distinctive Image Features from Scale Invariant Keypoints. Int. Journal of Computer Vision, 60(2): 91-110. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  11. Mikhail, E. M., 1976. Observations and Least Squares. University Press of America, New York.
  12. Moallem, P., Faez, K., and Haddadnia, J., 2002. Fast Edge-based Stereo Matching Algorithms through Search Space Reduction. Proc. IEICE Transaction on Information and System, pp. 1850-1871.
  13. Nakaguro, Y., Dailey, M., and Makhanov, S., 2007. SLAM with KLT Point Features. Proc. International Workshop on Advanced Image Technology, Thailand, pp. 262-267.
  14. Rodriguez, J., Vos, F., Below, R., and Guha-Sapir, D., 2009. Annual Disaster Statistical Review 2008 - The Numbers and 23Trends, Centre for Research on the Epidemiology of Disasters (CRED). [online] http://www.cred. be/sites/default/files/ADSR_2008.pdf
  15. Schenk, T., 1999. Digital Photogrammetry. TerraScience, Ohio, pp. 225-255, 381-405.
  16. Shi, J. and Tomasi, C., 1994. Good Features to Track. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 593-600.
  17. USGS, 2010. Magnitude 7.0 - Haiti Region. [online] http://earthquake.usgs.gov/earthquakes/recent eqsww/Quakes/us2010rja6.php
  18. Wolf, P. R. and Dewitt B., 1999. Elements of Photogrammetry with Applications in GIS. McGraw-Hill, pp. 366-403.
  19. Zivkovic, Z., 2004. Improving The Selection of Feature Points for Tracking. Pattern Analysis and Applications, 7(2): 144-150. https://doi.org/10.1007/s10044-004-0210-9