• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.29 no.6
• /
• pp.577-582
• /
• 2011

In remote sensing, spatial/spectral distortions are recognized as two of the main problems in the pansharpening algorithm. Most pansharpening methodologies show a tendency to distort spatial information from objects such as buildings and vehicles because there are local spatial dissimilarities among multispectral bands in Worldview-2 satellite imagery. In this paper, we propose a new pansharpening algorithm in order to minimize the effects of the local displacement of spatial information in the pansharpening process. In experiments using Worldview-2 images, our method provided better spectral and spatial quality than pre-existing pansharpening methods.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.34 no.4
• /
• pp.413-423
• /
• 2016

Worldview-3 satellite sensor provides panchromatic image with high-spatial resolution and 8-band multispectral images. Therefore, an image-sharpening technique, which sharpens the spatial resolution of multispectral images by using high-spatial resolution panchromatic images, is essential for various applications of Worldview-3 images based on image interpretation and processing. The existing pansharpening algorithms tend to tradeoff between spectral distortion and spatial enhancement. In this study, we applied six pansharpening algorithms to Worldview-3 satellite imagery and assessed the quality of pansharpened images qualitatively and quantitatively. We also analyzed the effects of time lag for each multispectral band during the pansharpening process. Quantitative assessment of pansharpened images was performed by comparing ERGAS (Erreur Relative Globale Adimensionnelle de Synthèse), SAM (Spectral Angle Mapper), Q-index and sCC (spatial Correlation Coefficient) based on real data set. In experiment, quantitative results obtained by MRA (Multi-Resolution Analysis)-based algorithm were better than those by the CS (Component Substitution)-based algorithm. Nevertheless, qualitative quality of spectral information was similar to each other. In addition, images obtained by the CS-based algorithm and by division of two multispectral sensors were shaper in terms of spatial quality than those obtained by the other pansharpening algorithm. Therefore, there is a need to determine a pansharpening method for Worldview-3 images for application to remote sensing data, such as spectral and spatial information-based applications.

• Proceedings of the KSRS Conference
• /
• 2008.10a
• /
• pp.18-21
• /
• 2008

Lee (2008) proposed the pansharpening method to reconstruct at the higher resolution the multispectral images which agree with the spectral values observed from the sensor of the lower resolution values. It outperformed over several current techniques for the statistical analysis with quantitative measures, and generated the imagery of good quality for visual interpretation. However, if a small object stretches over two adjacent pixels with different spectral characteristics at the lower resolution, the pixels of the object at the higher resolution may have different multispectral values according to their location even though they have a same intensity in the panchromatic image of higher resolution. To correct this problem, this study employed an iterative technique similar to the image restoration scheme of Point-Jacobian iterative MAP estimation. The effect of pansharpening on image segmentation/classification was assessed for various techniques. The method was applied to the IKONOS image acquired over the area around Anyang City of Korea.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.13 no.1
• /
• pp.327-346
• /
• 2019

The goal of hyperspectral pansharpening is to combine a hyperspectral image (HSI) with a panchromatic image (PANI) derived from the same scene to obtain a single fused image. In this paper, a new hyperspectral pansharpening approach using adaptive weighted regression and guided filter is proposed. First, the intensity information (INT) of the HSI is obtained by the adaptive weighted regression algorithm. Especially, the optimization formula is solved to obtain the closed solution to reduce the calculation amount. Then, the proposed method proposes a new way to obtain the sufficient spatial information from the PANI and INT by guided filtering. Finally, the fused HSI is obtained by adding the extracted spatial information to the interpolated HSI. Experimental results demonstrate that the proposed approach achieves better property in preserving the spectral information as well as enhancing the spatial detail compared with other excellent approaches in visual interpretation and objective fusion metrics.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.36 no.6
• /
• pp.555-563
• /
• 2018

Thermal infrared images have the characteristic of being able to detect objects that can not be seen with the naked eye and have the advantage of easily obtaining information of inaccessible areas. However, TIR (Thermal InfraRed) images have a relatively low spatial resolution. In this study, the applicability of the pansharpening algorithm used for satellite imagery on images acquired by the UAV (Unmanned Aerial Vehicle) was tested. RGB image have higher spatial resolution than TIR images. In this study, pansharpening algorithm was applied to TIR image to create the images which have similar spatial resolution as RGB images and have temperature information in it. Experimental results show that the pansharpening algorithm using the PC1 band and the average of RGB band shows better results for the quantitative evaluation than the other bands, and it has been confirmed that pansharpening results by ATWT (${\grave{A}}$ Trous Wavelet Transform) exhibit superior spectral resolution and spatial resolution than those by HPF (High-Pass Filter) and SFIM (Smoothing Filter-based Intensity Modulation) pansharpening algorithm.

• Korean Journal of Remote Sensing
• /
• v.24 no.5
• /
• pp.525-533
• /
• 2008

This study presents a pansharpening method, so called FitPAN, to synthesize multispectral images at a higher resolution by exploiting a high-resolution image acquired in panchromatic modality. FitPAN is a modified version of the quadratic programming approach proposed in (Lee, 2008), which is designed to generate synthesized multispectral images similar to the multispectral images that would have been observed by the corresponding sensor at the same high resolution. The proposed scheme aims at reconstructing the multispectral images at the higher resolution with as less spectral distortion as possible. This study also proposes a sharpening process to eliminate some distortions appeared in the fused image of the higher resolution. It employs the Point-Jacobian MAP iteration utilizing the contextual information of the original panchromatic image. In this study, the new method was applied to the IKONOS 1m panchromatic and 4m multispectral data, and the results were compared with them of several current approaches. Experimental results demonstrate that the proposed scheme can achieve significant improvement in both spectral and block distortion.

• Korean Journal of Remote Sensing
• /
• v.24 no.3
• /
• pp.257-266
• /
• 2008

This study presents an approach to synthesize multispectral images at a higher resolution by exploiting a high-resolution image acquired in panchromatic modality. The synthesized images should be similar to the multispectral images that would have been observed by the corresponding sensor at the same high resolution. The proposed scheme is designed to reconstruct the multispectral images at the higher resolution with as less color distortion as possible. It uses a regression model of the second order to fit panchromatic data to multispectral observations. Based on the regression model, the multispectral images at the higher spatial resolution of the panchromatic image are optimized by a quadratic programming. In this study, the new method was applied to the IKONOS 1m panchromatic and 4m multispectral data, and the results were compared with them of several current approaches. Experimental results demonstrate that the proposed scheme can achieve significant improvement over other methods.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.29 no.2
• /
• pp.175-181
• /
• 2011

In remote sensing, it has been a difficult task to obtain a multispectral image with high spatial resolution because of the technical limitation of satellite sensors. In order to solve these problems, various pansharpening algorithms have been tried and proposed. However, most pansharpened images created by various approaches tend to distort the spectral characteristics of the original multispectral image or decrease the visual sharpness of the panchromatic image. To minimize the spectral distortion of pansharpened image while preserving spatial information of the panchromatic image, a hybrid pansharpening algorithm based on the spatial correlation was proposed. In this paper, we analyzed the spatial and spectral distortion of the hybrid pansharpened images generated by the various spatial correlation methods. In the experiments, we proved that the method by using Laplacian filtering was more efficient than other high frequency extraction algorithms in the viewpoint of spectral distortion and spatial sharpness.

• Korean Journal of Remote Sensing
• /
• v.36 no.5_2
• /
• pp.961-973
• /
• 2020

In this manuscript, a new pansharpening model based on Convolutional Neural Network (CNN) was developed. Dilated convolution, which is one of the representative convolution technologies in CNN, was applied to the model by making it deep and complex to improve the performance of the deep learning architecture. Based on the dilated convolution, the residual network is used to enhance the efficiency of training process. In addition, we consider the spatial correlation coefficient in the loss function with traditional L1 norm. We experimented with Dilated Residual Networks (DRNet), which is applied to the structure using only a panchromatic (PAN) image and using both a PAN and multispectral (MS) image. In the experiments using KOMPSAT-3A, DRNet using both a PAN and MS image tended to overfit the spectral characteristics, and DRNet using only a PAN image showed a spatial resolution improvement over existing CNN-based models.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.36 no.5
• /
• pp.413-422
• /
• 2018

Many applications using satellite data from high-resolution multispectral sensors require an image fusion step, known as pansharpening, before processing and analyzing the multispectral images when spatial fidelity is crucial. Image fusion methods are to improve images with higher spatial and spectral resolutions by reducing spectral distortion, which occurs on image fusion processing. The image fusion methods can be classified into MRA (Multi-Resolution Analysis) and CSA (Component Substitution Analysis) approaches. To suggest the efficient image fusion method for Pleiades and KOMPSAT (Korea Multi-Purpose Satellite) 3 satellites, this study will evaluate image fusion methods for multispectral and panchromatic images. HPF (High-Pass Filtering), SFIM (Smoothing Filter-based Intensity Modulation), GS (Gram Schmidt), and GSA (Adoptive GS) were selected for MRA and CSA based image fusion methods and applied on multispectral and panchromatic images. Their performances were evaluated using visual and quality index analysis. HPF and SFIM fusion results presented low performance of spatial details. GS and GSA fusion results had enhanced spatial information closer to panchromatic images, but GS produced more spectral distortions on urban structures. This study presented that GSA was effective to improve spatial resolution of multispectral images from Pleiades 1A and KOMPSAT 3.