• Korean Journal of Remote Sensing
• /
• v.37 no.5_1
• /
• pp.999-1011
• /
• 2021

In spatio-temporal fusion aiming at predicting images with both high spatial and temporal resolutionsfrom multi-sensor images, the radiometric inconsistency between input multi-sensor images may affect prediction performance. This study investigates the effect of radiometric correction, which compensate different spectral responses of multi-sensor satellite images, on the spatio-temporal fusion results. The effect of relative radiometric correction of input images was quantitatively analyzed through the case studies using Sentinel-2, PlanetScope, and RapidEye images obtained from two croplands. Prediction performance was improved when radiometrically corrected multi-sensor images were used asinput. In particular, the improvement in prediction performance wassubstantial when the correlation between input images was relatively low. Prediction performance could be improved by transforming multi-sensor images with different spectral responses into images with similar spectral responses and high correlation. These results indicate that radiometric correction is required to improve prediction performance in spatio-temporal fusion of multi-sensor satellite images with low correlation.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.12 no.4
• /
• pp.524-531
• /
• 2009

In this paper, we propose an automatic image registration method for multi-sensor image fusion such as visible and infrared images. The registration is achieved by finding corresponding feature points in both input images. In general, the global statistical correlation is not guaranteed between multi-sensor images, which bring out difficulties on the image registration for multi-sensor images. To cope with this problem, mutual information is adopted to measure correspondence of features and to select faithful points. An update algorithm for projective transform is also proposed. Experimental results show that the proposed method provides robust and accurate registration results.

• Korean Journal of Remote Sensing
• /
• v.31 no.4
• /
• pp.321-330
• /
• 2015

Atmospheric correction is an essential part in time-series analysis on biophysical parameters of surface features. In this study, we tried to examine possible problems in atmospheric correction of multitemporal High Spatial Resolution (HSR) images obtained from two different sensor systems. Three KOMPSAT-2 and two IKONOS-2 multispectral images were used. Three atmospheric correction methods were applied to derive surface reflectance: (1) Radiative Transfer (RT) - based absolute atmospheric correction method, (2) the Dark Object Subtraction (DOS) method, and (3) the Cosine Of the Uun zeniTh angle (COST) method. Atmospheric correction results were evaluated by comparing spectral reflectance values extracted from invariant targets and vegetation cover types. In overall, multi-temporal reflectance from five images obtained from January to December did not show consistent pattern in invariant targets and did not follow a typical profile of vegetation growth in forests and rice field. The multi-temporal reflectance values were different by sensor type and atmospheric correction methods. The inconsistent atmospheric correction results from these multi-temporal HSR images may be explained by several factors including unstable radiometric calibration coefficients for each sensor and wide range of sun and sensor geometry with the off-nadir viewing HSR images.

• Korean Journal of Remote Sensing
• /
• v.20 no.4
• /
• pp.275-288
• /
• 2004

This paper presents a fuzzy relaxation labeling approach incorporated to the fuzzy logic fusion scheme for the classification of multi-sensor remote sensing images. The fuzzy logic fusion and iterative relaxation labeling techniques are adopted to effectively integrate multi-sensor remote sensing images and to incorporate spatial neighboring information into spectral information for contextual classification, respectively. Especially, the iterative relaxation labeling approach can provide additional information that depicts spatial distributions of pixels updated by spatial information. Experimental results for supervised land-cover classification using optical and multi-frequency/polarization images indicate that the use of multi-sensor images and spatial information can improve the classification accuracy.

• Korean Journal of Remote Sensing
• /
• v.38 no.5_1
• /
• pp.523-533
• /
• 2022

This paper presents a two-stage spatio-spectral fusion method (2SSFM) based on area-to-point regression kriging (ATPRK) to enhance spatial and spectral resolutions using multi-sensor satellite images with complementary spatial and spectral resolutions. 2SSFM combines ATPRK and random forest regression to predict spectral bands at high spatial resolution from multi-sensor satellite images. In the first stage, ATPRK-based spatial down scaling is performed to reduce the differences in spatial resolution between multi-sensor satellite images. In the second stage, regression modeling using random forest is then applied to quantify the relationship of spectral bands between multi-sensor satellite images. The prediction performance of 2SSFM was evaluated through a case study of the generation of red-edge and short-wave infrared bands. The red-edge and short-wave infrared bands of PlanetScope images were predicted from Sentinel-2 images using 2SSFM. From the case study, 2SSFM could generate red-edge and short-wave infrared bands with improved spatial resolution and similar spectral patterns to the actual spectral bands, which confirms the feasibility of 2SSFM for the generation of spectral bands not provided in high spatial resolution satellite images. Thus, 2SSFM can be applied to generate various spectral indices using the predicted spectral bands that are actually unavailable but effective for environmental monitoring.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.39 no.6
• /
• pp.533-540
• /
• 2021

High-resolution satellite images have high potential to acquire geospatial information over inaccessible areas such as Antarctica. Reference data are often required to increase the positional accuracy of the satellite data but the data are not available in many inland areas in Antarctica. Therefore this paper presents a multi-image RPCs (Rational Polynomial Coefficients) sensor modeling without any ground controls or reference data. Conjugate points between multi-images are extracted and used for the multi-image sensor modeling. The experiment was carried out for Kompsat-3A and showed that the significant accuracy increase was not observed but the approach has potential to suppress the maximum errors, especially the vertical errors.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2008.11a
• /
• pp.675-680
• /
• 2008

This paper proposes a way to measure the displacement of a multi-point by using a pattern recognition from video signal. Generally in measuring displacement, gab sensor, which is a displacement sensor, is used. However, it is difficult to measure displacement by using a common sensor in places where it is unsuitable to attach a sensor, such as high-temperature areas or radioactive places. In this kind of places, non-contact methods should be used to measure displacement and in this study, images of CCD camera were used. When displacement is measure by using camera images, it is possible to measure displacement with a non-contact method. It is simple to install and multi-point displacement measuring device so that it is advantageous to solve problems of spatial constraints.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.13 no.3
• /
• pp.445-452
• /
• 2010

Adequate segmentation of target objects from the background plays an important role for the performance of automatic target recognition(ATR) system. This paper presents a new segmentation algorithm using fuzzy thresholding to extract a target. The proposed algorithm consists of two steps. In the first step, the region of interest(ROI) including the target can be automatically selected by the proposed robust method based on the frame difference of each image sensor. In the second step, fuzzy thresholding with a proposed membership function is performed within the only ROI selected in the first step. The proposed membership function is based on the similarity of intensity and the adjacency of target area on each image. Experimental results applied to real CCD/IR images show a good performance and the proposed algorithm is expected to enhance the performance of ATR system using multi-sensors.

• Journal of Korea Multimedia Society
• /
• v.23 no.8
• /
• pp.1006-1018
• /
• 2020

Dataset is getting more import to develop a learning based algorithm. Quality of the algorithm definitely depends on dataset. So we introduce new dataset over 200 thousands images which are fully labeled multi modal sensor data. Proposed dataset was designed and constructed for researchers who want to develop detection, tracking, and action classification in outdoor environment for surveillance scenarios. The dataset includes various images and multi modal sensor data under different weather and lighting condition. Therefor, we hope it will be very helpful to develop more robust algorithm for systems equipped with difference kinds of sensors in outdoor application. Case studies with the proposed dataset are also discussed in this paper.

• Korean Journal of Remote Sensing
• /
• v.38 no.6_1
• /
• pp.1505-1514
• /
• 2022

Image matching is a crucial preprocessing step for effective utilization of multi-temporal and multi-sensor very high resolution (VHR) satellite images. Deep learning (DL) method which is attracting widespread interest has proven to be an efficient approach to measure the similarity between image pairs in quick and accurate manner by extracting complex and detailed features from satellite images. However, Image matching of VHR satellite images remains challenging due to limitations of DL models in which the results are depending on the quantity and quality of training dataset, as well as the difficulty of creating training dataset with VHR satellite images. Therefore, this study examines the feasibility of DL-based method in matching pair extraction which is the most time-consuming process during image registration. This paper also aims to analyze factors that affect the accuracy based on the configuration of training dataset, when developing training dataset from existing multi-sensor VHR image database with bias for DL-based image matching. For this purpose, the generated training dataset were composed of correct matching pairs and incorrect matching pairs by assigning true and false labels to image pairs extracted using a grid-based Scale Invariant Feature Transform (SIFT) algorithm for a total of 12 multi-temporal and multi-sensor VHR images. The Siamese convolutional neural network (SCNN), proposed for matching pair extraction on constructed training dataset, proceeds with model learning and measures similarities by passing two images in parallel to the two identical convolutional neural network structures. The results from this study confirm that data acquired from VHR satellite image database can be used as DL training dataset and indicate the potential to improve efficiency of the matching process by appropriate configuration of multi-sensor images. DL-based image matching techniques using multi-sensor VHR satellite images are expected to replace existing manual-based feature extraction methods based on its stable performance, thus further develop into an integrated DL-based image registration framework.