Browse > Article
http://dx.doi.org/10.7780/kjrs.2019.35.6.1.6

Coarse to Fine Image Registration of Unmanned Aerial Vehicle Images over Agricultural Area using SURF and Mutual Information Methods  

Kim, Taeheon (Department of Geospatial Information, Kyungpook National University)
Lee, Kirim (School of Convergence & Fusion System, Kyungpook National University)
Lee, Won Hee (School of Convergence & Fusion System, Kyungpook National University)
Yeom, Junho (Department of Civil Engineering, Gyeongsang National University)
Jung, Sejung (Department of Geospatial Information, Kyungpook National University)
Han, Youkyung (School of Convergence & Fusion System, Kyungpook National University)
Publication Information
Korean Journal of Remote Sensing / v.35, no.6_1, 2019 , pp. 945-957 More about this Journal
Abstract
In this study, we propose a coarse to fine image registration method for eliminating geometric error between images over agricultural areas acquired using Unmanned Aerial Vehicle (UAV). First, images of agricultural area were acquired using UAV, and then orthophotos were generated. In order to reduce the probability of extracting outliers that cause errors during image registration, the region of interest is selected by using the metadata of the generated orthophotos to minimize the search area. The coarse image registration was performed based on the extracted tie-points using the Speeded-Up Robust Features (SURF) method to eliminate geometric error between orthophotos. Subsequently, the fine image registration was performed using tie-points extracted through the Mutual Information (MI) method, which can extract the tie-points effectively even if there is no outstanding spatial properties or structure in the image. To verify the effectiveness and superiority of the proposed method, a comparison analysis using 8 orthophotos was performed with the results of image registration using the SURF method and the MI method individually. As a result, we confirmed that the proposed method can effectively eliminated the geometric errors between the orthophotos.
Keywords
Unmanned Aerial Vehicle (UAV); Coarse to fine image registration; Speeded-Up Robust Features (SURF); Mutual Information (MI);
Citations & Related Records
Times Cited By KSCI : 6  (Citation Analysis)
연도 인용수 순위
1 Oh, J.H., Y.J. Jang, and N.C. Lee, 2018. Accuracy analysis of low-cost UAV photogrammetry for corridor mapping, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 36(6): 565-572 (in Korean with English abstract).   DOI
2 Tsai, C.H. and Y.C. Lin, 2017. An accelerated image matching technique for UAV orthoimage registration, ISPRS Journal of Photogrammetry and Remote Sensing, 128: 130-145.   DOI
3 Viola, P. and W.M. Wells, 1997. Alignment by maximization of mutual information. International Journal of Computer Vision, 24(2): 137-154.   DOI
4 Wei, Z., Y. Han, M. Li, K. Yang, Y. Yang, Y. Luo, and S.H. Ong, 2017. A small UAV based multi-temporal image registration for dynamic agricultural terrace monitoring, Remote Sensing, 9(9): 904.   DOI
5 Ye, C.S., 2018. Feature matching using variable circular template for multi-resolution image registration, Korean Journal of Remote Sensing, 34(6-3): 1351-1367 (in Korean with English abstract).   DOI
6 Zhuo, X., T. Koch, F. Kurz, F. Fraundorfer, and P. Reinartz, 2017. Automatic UAV image geo-registration by matching UAV images to georeferenced image data, Remote Sensing, 9(4): 376.   DOI
7 Zitova, B. and J. Flusser, 2003. Image registration methods: a survey, Image and Vision Computing, 21(11): 977-1000.   DOI
8 Aicardi, I., F. Nex, M. Gerke, and A. Lingua, 2016. An image-based approach for the co-registration of multi-temporal UAV image datasets, Remote Sensing, 8(9): 779.   DOI
9 Bay, H., A. Ess, T. Tuytelaars, and L. Van Gool, 2008. Speeded-up robust features (SURF), Computer Vision and Image Understanding, 10(3): 346-359.
10 Bentoutou, Y., N. Taleb, K. Kpalma, and J. Ronsin, 2005. An automatic image registration for applications in remote sensing, IEEE Transactions on Geoscience and Remote Sensing, 43(9): 2127-2137.   DOI
11 Choi, H.S. and E.M. Kim, 2017. Image registration of Drone Images through association analysis of linear features, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 35(6): 441-452 (in Korean with English abstract).   DOI
12 Han, Y., J. Choi, J. Jung, A. Chang, S. Oh, and J. Yeom, 2019. Automated coregistration of multisensor orthophotos generated from unmanned aerial vehicle platforms, Journal of Sensors, 1(91): 431-435.
13 Gong, M., S. Zhao, L. Jiao, D. Tian, and S. Wang, 2013. A novel coarse-to-fine scheme for automatic image registration based on SIFT and mutual information, IEEE Transactions on Geoscience and Remote Sensing, 52(7): 4328-4338.   DOI
14 Han, Y.K., 2017. Fine registration between very high resolution satellite images using registration noise distribution, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 35(3): 125-132 (in Korean with English abstract).   DOI
15 Han, Y.K. and J.H. Oh, 2018. RNCC-based Fine Co-registration of Multi-temporal RapidEye Satellite Imagery, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 36(6): 581-588 (in Korean with English abstract).   DOI
16 Hong, G. and Y. Zhang, 2007. Combination of feature-based and area-based image registration technique for high resolution remote sensing image, Proc. of 2007 IEEE International Geoscience and Remote Sensing Symposium, Barcelona, Spain, Jul. 23-27, pp. 377-380.
17 Huo, C., C. Pan, L. Huo, and Z. Zhou, 2011. Multilevel SIFT matching for large-size VHR image registration, IEEE Geoscience and Remote Sensing Letters, 9(2): 171-175.   DOI
18 Kim, A.L., J.H. Song, S.L. Kang, and W.K. Lee, 2014. Matching and geometric correction of multi-resolution satellite SAR images using SURF technique, Korean Journal of Remote Sensing, 30(4): 431-444 (in Korean with English abstract).   DOI
19 Lowe, D.G., 2004. Distinctive image features from scale-invariant keypoints, International Journal of Computer Vision, 60(2): 91-110.   DOI