Browse > Article
http://dx.doi.org/10.7780/kjrs.2022.38.5.1.13

Image Matching for Orthophotos by Using HRNet Model  

Seong, Seonkyeong (Department of Civil Engineering, Chungbuk National University)
Choi, Jaewan (Department of Civil Engineering, Chungbuk National University)
Publication Information
Korean Journal of Remote Sensing / v.38, no.5_1, 2022 , pp. 597-608 More about this Journal
Abstract
Remotely sensed data have been used in various fields, such as disasters, agriculture, urban planning, and the military. Recently, the demand for the multitemporal dataset with the high-spatial-resolution has increased. This manuscript proposed an automatic image matching algorithm using a deep learning technique to utilize a multitemporal remotely sensed dataset. The proposed deep learning model was based on High Resolution Net (HRNet), widely used in image segmentation. In this manuscript, denseblock was added to calculate the correlation map between images effectively and to increase learning efficiency. The training of the proposed model was performed using the multitemporal orthophotos of the National Geographic Information Institute (NGII). In order to evaluate the performance of image matching using a deep learning model, a comparative evaluation was performed. As a result of the experiment, the average horizontal error of the proposed algorithm based on 80% of the image matching rate was 3 pixels. At the same time, that of the Zero Normalized Cross-Correlation (ZNCC) was 25 pixels. In particular, it was confirmed that the proposed method is effective even in mountainous and farmland areas where the image changes according to vegetation growth. Therefore, it is expected that the proposed deep learning algorithm can perform relative image registration and image matching of a multitemporal remote sensed dataset.
Keywords
Deep learning; HRNet; Image matching; Multitemporal orthophotos;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 Huang, G., Z. Liu, L. Van Der Maaten, and K.Q. Weinberger, 2017. Densely connected convolutional networks, arXiv preprint arXiv:1608.06993. https://doi.org/10.48550/arXiv.1608.06993   DOI
2 Kuglin, C. and D. Hines, 1975. The phase correlation image alignment method, Proc. of IEEE 1975 International Conference on Cybernetics and Society, San Francisco, CA, Sep. 23-25, pp. 163-165.
3 Rocco, I., M. Cimpoi, R. Arandjelovic, A. Torii, T. Pajdla, and J. Sivic, 2020. NCNet: neighborhood consensus networks for estimating image correspondences, IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(2): 1020-1034. https://doi.org/10.1109/TPAMI.2020.3016711   DOI
4 Wang, J., K. Sun, T. Cheng, B. Jiang, C. Deng, Y. Zhao, D. Liu, Y. Mu, M. Tan, X. Wang, W. Liu, and B. Xiao, 2019. Deep high-resolution representation learning for visual recognition, arXiv preprint arXiv:198.07919. https://doi.org/10.48550/arXiv.1908.07919   DOI
5 Merkle, N., W. Luo, S. Auer, R. Muller, and R. Urtasun, 2017. Exploiting deep matching and SAR data for the geo-localization accuracy improvement of optical satellite images, Remote Sensing, 9(6):586. https://doi.org/10.3390/rs9060586   DOI
6 Chung. M and Y. Kim, 2020. Analysis on topographic normalization methods for 2019 Gangneung-East Sea wildfire area using PlanetScope imagery, Korean Journal of Remote Sensing, 36(2-1): 179-197 (in Korean with English abstract). https://doi.org/10.7780/kjrs.2020.36.2.1.7   DOI
7 Hughes, L., D. Marcos, S. Lobry, D. Tuia, and M. Schmitt, 2020. A deep learning framework for matching of SAR and optical imagery, ISPRS Journal of Photogrammetry and Remote Sensing, 169: 166-179. https://doi.org/10.1016/j.isprsjprs.2020.09.012   DOI
8 Li, L., L. Han, M. Ding, H. Cao, and H. Hu, 2021. A deep learning semantic template matching framework for remote sensing image registration, ISPRS Journal of Photogrammetry and Remote Sensing, 181: 205-217. https://doi.org/10.1016/j.isprsjprs.2021.09.012   DOI
9 Seong, S., J. Mo, S. Na, and J. Choi, 2021. Attention gated FC-DenseNet for extracting crop cultivation area by multispectral satellite imagery, Korean Journal of Remote Sensing, 37(5-1): 1061-1071 (in Korean with English abstract). https://doi.org/10.7780/kjrs.2021.37.5.1.18   DOI
10 Kim, E., B. Lee, and J. Lim, 2019. Forest damage detection using daily normal vegetation index based on time series LANDSAT images, Korean Journal of Remote Sensing, 35(6-2): 1133-1148 (in Korean with English abstract). https://doi.org/10.7780/kjrs.2019.35.6.2.9   DOI
11 Zitova, B and J. Flusser, 2003. Image registration methods: a survey, Image and Vision Computing, 21(11): 997-1000. https://doi.org/10.1016/S0262-8856(03)00137-9   DOI
12 Rocco, I., R. Arandjelovic, and J. Sivic, 2017. Convolutional neural network architecture for geometric matching, arXiv preprint arXiv:1703.05593. https://doi.org/10.48550/arXiv.1703.05593   DOI