Browse > Article
http://dx.doi.org/10.5139/JKSAS.2020.48.10.783

Vision-based Navigation using Semantically Segmented Aerial Images  

Hong, Kyungwoo (Korea Advanced Institute of Science and Technology)
Kim, Sungjoong (Korea Advanced Institute of Science and Technology)
Park, Junwoo (Korea Advanced Institute of Science and Technology)
Bang, Hyochoong (Korea Advanced Institute of Science and Technology)
Heo, Junhoe (Poongsan R&D Institute)
Kim, Jin-Won (Poongsan R&D Institute)
Pak, Chang-Ho (Poongsan R&D Institute)
Seo, Songwon (Poongsan R&D Institute)
Publication Information
Journal of the Korean Society for Aeronautical & Space Sciences / v.48, no.10, 2020 , pp. 783-789 More about this Journal
Abstract
This paper proposes a new method for vision-based navigation using semantically segmented aerial images. Vision-based navigation can reinforce the vulnerability of the GPS/INS integrated navigation system. However, due to the visual and temporal difference between the aerial image and the database image, the existing image matching algorithms have difficulties being applied to aerial navigation problems. For this reason, this paper proposes a suitable matching method for the flight composed of navigational feature extraction through semantic segmentation followed by template matching. The proposed method shows excellent performance in simulation and even flight situations.
Keywords
Vision-Based Navigation; Semantic Segmentation; Template Matching;
Citations & Related Records
Times Cited By KSCI : 5  (Citation Analysis)
연도 인용수 순위
1 Kim, J. M. and Leeghim, H., "INS/Multi-Vision Integrated Navigation System Based on Landmark," Journal of the Korean Society for Aeronautical and Space Sciences, Vol. 45, No. 8, July 2017, pp. 671-677.   DOI
2 Won, D. H., Chun, S. B., Sung, S. K., Cho, J. S. and Lee, Y. J., "Observability Analysis of a Vision-INS Integrated Navigation System Using Landmark," Journal of the Korean Society for Aeronautical and Space Sciences, Vol. 38, No. 3, March 2010, pp. 236-242.   DOI
3 Conte, G. and Doherty, P., "Vision-based unmanned aerial vehicle navigation using georeferenced information," EURASIP Journal on Advances in Signal Processing, 2009, 10.
4 Wu, A. D., "Vision-based navigation and mapping for flight in GPS-denied environments," PhD Thesis, Georgia Institute of Technology, 2010.
5 Dumble, S. J. and Gibbens, P. W., "Airborne vision-aided navigation using road intersection features," Journal of Intelligent and Robotic Systems, Vol. 78, No. 2, May. 2015, pp. 185-204.   DOI
6 Hong, K. W., Kim, S. J., Bang, H. C., Kim, J. W., Seo, I. W. and Pak, C. H., "Particle Filters using Gaussian Mixture Models for Vision-Based Navigation," Journal of the Korean Society for Aeronautical and Space Sciences, Vol. 47, No. 4, April 2019. pp. 274-282.   DOI
7 Lowe, D. G., "Distinctive image features from scale-invariant keypoints," International journal of computer vision, Vol. 60, No. 2, November 2004, pp. 91-110.   DOI
8 Bay, H., Ess, A., Tuytelaars, T. and Van Gool, L., "Speeded-up robust features (SURF)," Computer vision and image understanding, Vol. 110, No. 3, June 2008, pp. 346-359.   DOI
9 Calonder, M., Lepetit, V., Strecha, C. and Fua, P., "Brief: Binary robust independent elementary features," In European conference on computer vision, Springer, Berlin, Heidelberg, September 2010, pp. 778-792.
10 Karami, E., Prasad, S. and Shehata, M., "Image matching using SIFT, SURF, BRIEF and ORB: performance comparison for distorted images," arXiv preprint arXiv:1710.02726.
11 He, K., Gkioxari, G., Dollár, P. and Girshick, R., "Mask r-cnn," Proceedings of the IEEE international conference on computer vision 2017, pp. 2961-2969.
12 Noh, H. W., Hong, S. H. and Han, B. H., "Learning deconvolution network for semantic segmentation," Proceedings of the IEEE international conference on computer vision 2015, pp. 1520-1528.
13 Long, J., Shelhamer, E. and Darrell, T., "Fully convolutional networks for semantic segmentation," Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 3431-3440.
14 Chai, D., Newsam, S. and Huang, J., "Aerial image semantic segmentation using DCNN predicted distance maps," ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 161, March 2020, pp. 309-322.   DOI
15 Mahmood, A. and Khan, S., "Exploiting transitivity of correlation for fast template matching," IEEE Transactions on Image Processing, Vol. 19, No. 8, August 2010, pp. 2190-2200.   DOI
16 Montoya-Zegarra, J. A., Wegner, J. D. and Schindler, K., "Semantic segmentation of aerial images in urban areas with class-specific higherorder cliques," ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 2, 2015, pp. 127-133.   DOI
17 Hong, K. W., Kim, S. J. and Bang, H. C., "Vision-based Navigation using Gaussian Mixture Model of Terrain Features," AIAA Scitech 2020 Forum, Jan 2020, p. 1344.
18 Briechle, K. and Hanebeck, U. D., "Template matching using fast normalized cross correlation," Optical Pattern Recognition XII, International Society for Optics and Photonics, Vol. 4387, March 2001, pp. 95-102.
19 Uchida, A., Ito, Y. and Nakano, K., "Fast and accurate template matching using pixel rearrangement on the GPU," 2011 Second International Conference on Networking and Computing IEEE, December 2011, pp. 153-159
20 Pele, O. and Werman, M., "Accelerating pattern matching or how much can you slide?," Asian Conference on Computer Vision, November 2007, pp. 435-446.