Browse > Article
http://dx.doi.org/10.15701/kcgs.2019.25.3.21

Image Fusion Framework for Enhancing Spatial Resolution of Satellite Image using Structure-Texture Decomposition  

Yoo, Daehoon (Korea Aerospace Research Institute)
Publication Information
Journal of the Korea Computer Graphics Society / v.25, no.3, 2019 , pp. 21-29 More about this Journal
Abstract
This paper proposes a novel framework for image fusion of satellite imagery to enhance spatial resolution of the image via structure-texture decomposition. The resolution of the satellite imagery depends on the sensors, for example, panchromatic images have high spatial resolution but only a single gray band whereas multi-spectral images have low spatial resolution but multiple bands. To enhance the spatial resolution of low-resolution images, such as multi-spectral or infrared images, the proposed framework combines the structures from the low-resolution image and the textures from the high-resolution image. To improve the spatial quality of structural edges, the structure image from the low-resolution image is guided filtered with the structure image from the high-resolution image as the guidance image. The combination step is performed by pixel-wise addition of the filtered structure image and the texture image. Quantitative and qualitative evaluation demonstrate the proposed method preserves spectral and spatial fidelity of input images.
Keywords
Image fusion; structure-texture decomposition; pan-sharpening; satellite image;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Tu T., Su S., Shyu H. and Huang P. S., "A new look at HIS-like image fusion methods," Information Fusion, vol. 2, pp. 177-186, 2001.   DOI
2 Rahmani S., Strait M., Merkurjev D., Moeller M., and Wittman T., "An Adaptive IHS Pan-Sharpening Method," IEEE Geoscience and Remote Sensing Letter, Vol. 7, No. 4, 2010.
3 Chavez P. S., Jr. and Kwarteng A. W., "Extracting spectral contrast in Landsat thematic mapper image data using selective principal analysis," Photogramm. Eng. Remote Sens., vol. 58, no.5, pp.561-567, 1992
4 Laban C. A. and Brower B. V., Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening, US patenta 6,011,875, 2000.
5 Aiazzi B., Baronti S., and Selva M., "Improving component substitution pansharpening through multivariate regression of MS+Pan data," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 10, pp.3230-3239, 2007.   DOI
6 Li H., Manjunath M. S. and Mitra S. K., "Multisensor Image Fusion Using the Wavelet Trasform," Graphics Models and Image Processing, vol. 57, pp. 234-245, 1995.
7 M. N. Do and M. Vetterli, "The contourlet transform: An efficient directional multiresolution image representation," IEEE Trans. Image Process., vol. 14, no. 12, pp. 2091-2106, 2005.   DOI
8 F. Nencini, A. Garzelli, S. Baronti, and L. Alparone, "Remote sensing image fusion using the curvelet transform," Information fusion, Vol. 8, Issue 2, pp. 143-156, 2007   DOI
9 J. Yang, X. Fu, Y. Hu, Y. Huang, X. Ding, and J. Paisley, "PanNet: A Deep Network Architecture for Pan-Sahrpening," In Proc. ICCV 2017, pp. 5449-5457, 2017
10 Y. Wei, Yuan Q., Shen H., and Zhang L., "Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network," IEEE Geoscience and Remote Sensing Letters, Vol. 14, Issue 10, 2017
11 Tomasi C., Manduchi R., "Bilateral filtering for gray and color images," In Proc. ICCV 1998, pp. 839-846, 1998
12 He K., Sun J. and Tang X., "Guided Image Filtering," Transaction on Pattern Analysis and Machine Intelligence, No. 06, Vol. 35, pp. 1397-1709, 2013.   DOI
13 Cho H., Lee H., Kang H., and Lee S., "Bilateral Texture Filter," ACM Transaction on Graphics, Vol. 33, no. 4, 2014
14 Xu L., Yan Q., Xia Y. and Jia J., "Structure Extraction from Texture via Relative Total Variation," ACM Transaction on Graphics, Vol. 31, 2012.
15 Jeon J., Lee H., Kang H. and Lee S., "Scale-aware Structure-Preserving Texture Filtering," Computer Graphics Forum, Vol. 35, No. 7, 2016.
16 Lee H., Jeon J., Kim J. and Lee S., "Structure-Texture Decomposition of Images with Interval Gradient," Computer Graphics Forum, Vol. 36, 2017.
17 Wang Z., Bovik A. C., Sheikh H. R., and Simoncelli E. P., "Image quality assessment: from error visibility to structural similarity," IEEE Transactions on Image Processing, Vol. 13, Issue 4, pp. 600-612, 2004.   DOI
18 Wald L., Ranchin T., and Mangolini M., "Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images," Photogrammetric engineering and remote sensing, Vol. 63, pp. 691-699, 1997.