Browse > Article
http://dx.doi.org/10.7780/kjrs.2020.36.4.5

Automatic Registration between EO and IR Images of KOMPSAT-3A Using Block-based Image Matching  

Kang, Hyungseok (The 3rd R&D Institute, Agency for Defense Development)
Publication Information
Korean Journal of Remote Sensing / v.36, no.4, 2020 , pp. 545-555 More about this Journal
Abstract
This paper focuses on automatic image registration between EO (Electro-Optical) and IR (InfraRed) satellite images with different spectral properties using block-based approach and simple preprocessing technique to enhance the performance of feature matching. If unpreprocessed EO and IR images from Kompsat-3A satellite were applied to local feature matching algorithms(Scale Invariant Feature Transform, Speed-Up Robust Feature, etc.), image registration algorithm generally failed because of few detected feature points or mismatched pairs despite of many detected feature points. In this paper, we proposed a new image registration method which improved the performance of feature matching with block-based registration process on 9-divided image and pre-processing technique based on adaptive histogram equalization. The proposed method showed better performance than without our proposed technique on visual inspection and I-RMSE. This study can be used for automatic image registration between various images acquired from different sensors.
Keywords
Image Registration; Electro-Optical Image; InfraRed Image; KOMPSAT-3A; Image Preprocessing; Block-based; Local Feature;
Citations & Related Records
Times Cited By KSCI : 7  (Citation Analysis)
연도 인용수 순위
1 Bay, H., A. Ess, T. Tuytelaars, and L. Van Gool, 2008. Speeded Up Robust Features (SURF), Computer Vision and Image Understanding, 110(3): 346-359.   DOI
2 Bentoutou, Y., N. Taleb, K. Kpalma, and J. Ronsin, 2005. An Automatic Image Registration for Applications in Remote Sensing, IEEE Transactions on Geoscience and Remote Sensing, 43(9): 2127-2137.   DOI
3 Bouchiha, R. and K. Besbes, 2013. Automatic Remotesensing Image Registration using SURF, International Journal of Computer Theory and Engineering, 5(1): 88-92.   DOI
4 Byun, Y., J. Choi, and Y. Han, 2013. An Area-Based Image Fusion Scheme for the Integration of SAR and Optical Satellite Imagery, IEEE Journal of Selected Topics in Applied Earth Observation and Remote Sensing, 6(5): 2212-2220.   DOI
5 Chen, H.M., M.K. Arora, and P.K. Varshney, 2003. Mutual information-based image registration for remote sensing data, International Journal of Remote Sensing, 24(18): 3701-3706.   DOI
6 Hong, G. and Y. Zhang, 2007. Combination of Featurebased and Area-based Image Registration Technique for High Resolution Remote Sensing Image, Proc. of IEEE International Geoscience and Remote Sensing Symposium, Barcelona, Spain, Jul. 23-27, pp. 377-380.
7 Irani, M. and P. Anandan, 1998. Robust Multi-Sensor Image Alignment, Proc. of the 6th IEEE International Conference on Computer Vision, Bombay, India, Jan. 4-7, pp. 959-966.
8 Ke, Y. and R. Sukthankar, 2004. PCA-SIFT: A more distinctive representation for local image descriptors, Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, D.C., USA, Jun. 29-Jul. 1, vol. 2, pp. 506-513.
9 Kim, D.S., 2017. Automatic Registration between Multiple IR Images Using Simple Pre-processing Method and Modified Local Features Extraction Algorithm, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 35(6): 485-494 (in Korean with English abstract).   DOI
10 Kim, D.S., Y.I. Kim, and Y.D. Eo, 2007. A Study on Automatic Co-registration and Band Selection of Hyperion Hyperspectral Images for Change Detection, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 25(5): 383-392 (in Korean with English abstract).
11 Kim, K.S., 2015. Survey on Registration Techniques of Visible and Infrared Images, IT CoNvergence PRActice (INPRA), 3(2): 25-35.
12 Lee, C. and J. Oh, 2020. Rigorous Co-Registration of KOMPSAT-3 Multispectral and Panchromatic Images for Pan-Sharpening Image Fusion, Sensors, 20(7): 2100.   DOI
13 Liu, F. and S. Seipel, 2015. Infrared-visible image registration for augmented reality-based thermographic building diagnostics, Visualization in Engineering, 3(16): 1-15.   DOI
14 Lee, K.J., K.Y. Oh, T.B. Chae, and W.J. Lee, 2019. Research Trend in KOMPSAT Series, Korean Journal of Remote Sensing, 35(6-4): 1313-1318 (in Korean with English abstract).   DOI
15 Leutenegger, S., M. Chli, and R. Siegwart, 2011. BRISK: Binary Robust Invariant Scalable Keypoints, Proc. of the IEEE International Conference on Computer Vision, Barcelona, Spain, Nov. 6-13, pp. 2548-2555.
16 Li, H. and Y.T. Zhou, 1995. Automatic EO/IR Sensor Image Registration, Proc. of the IEEE International Conference on Image Processing, Washington, D.C., USA, Oct. 23-26, vol. 3, pp. 240-243.
17 Lowe, D.G., 1999. Object Recognition from Local Scale-invariant Features, Proc. of the IEEE International Conference on Computer Vision, Corfu, Greece, Sep. 20-25, vol. 2, pp. 1150-1157.
18 Mistry, D. and A. Banerjee, 2017. Comparison of feature detection and matching approaches: SIFT and SURF, Global-Research and Development Journal for Engineering, 2(4): 7-13.
19 Morel, J.M. and G. Yu, 2009. ASIFT: A new framework for fully affine invariant image comparison, SIAM Journal on Imaging Sciences, 2(2): 438-469.   DOI
20 Oh, J.H. and C.N. Lee, 2019. Conjugate Point Extraction for High-Resolution Stereo Images Orientation, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 37(2): 55-62.   DOI
21 Oh, J. and H. Lee, 2011. A Performance Analysis of the SIFT Matching on Simulated Geospatial Image Differences, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 29(5): 449-457.   DOI
22 Wu, F., B. Wang, X. Yi, M. Li, J. Hao, H. Qin, and H. Zhou, 2015. Visible and Infrared Image Registration based on Visual Salient Features, Journal of Electronic Imaging, 24(5): 053027.   DOI
23 Pizer, S.M., E.P. Amburn, J.D. Austin, R. Cromartie, A. Geselowitz, T. Greer, and K. Zuideveld, 1987. Adaptive histogram equalization and its variations, Computer Vision, Graphics, and Image Processing, 39(3): 355-368.   DOI
24 Seo, D.K. and Y.D. Eo, 2019. Local-based Iterative Histogram Matching for Relative Radiometric Normalization, Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 37(5): 323-330.   DOI
25 Torr, P.H. and A. Zisserman, 2000. MLESAC: A new robust estimator with application to estimating image geometry, Computer Vision and Image Understanding, 78(1): 138-156.   DOI
26 Zheng, Q., 1993. A Computational Vision Approach to Image Registration, IEEE Transactions on Image Processing, 2(3): 311-326.   DOI
27 Zotiva, B. and J. Flusser, 2003. Image Registration Method: A Survey, Image and Vision Computing, 21(11): 977-1000.   DOI
28 Nag, S., 2017. Image Registration Techniques: A Survey, arXiv preprint arXiv:1712.07540.