Browse > Article
http://dx.doi.org/10.7780/kjrs.2022.38.5.1.7

Spatio-spectral Fusion of Multi-sensor Satellite Images Based on Area-to-point Regression Kriging: An Experiment on the Generation of High Spatial Resolution Red-edge and Short-wave Infrared Bands  

Park, Soyeon (Department of Geoinformatic Engineering, Inha University)
Kang, Sol A (Department of Geoinformatic Engineering, Inha University)
Park, No-Wook (Department of Geoinformatic Engineering, Inha University)
Publication Information
Korean Journal of Remote Sensing / v.38, no.5_1, 2022 , pp. 523-533 More about this Journal
Abstract
This paper presents a two-stage spatio-spectral fusion method (2SSFM) based on area-to-point regression kriging (ATPRK) to enhance spatial and spectral resolutions using multi-sensor satellite images with complementary spatial and spectral resolutions. 2SSFM combines ATPRK and random forest regression to predict spectral bands at high spatial resolution from multi-sensor satellite images. In the first stage, ATPRK-based spatial down scaling is performed to reduce the differences in spatial resolution between multi-sensor satellite images. In the second stage, regression modeling using random forest is then applied to quantify the relationship of spectral bands between multi-sensor satellite images. The prediction performance of 2SSFM was evaluated through a case study of the generation of red-edge and short-wave infrared bands. The red-edge and short-wave infrared bands of PlanetScope images were predicted from Sentinel-2 images using 2SSFM. From the case study, 2SSFM could generate red-edge and short-wave infrared bands with improved spatial resolution and similar spectral patterns to the actual spectral bands, which confirms the feasibility of 2SSFM for the generation of spectral bands not provided in high spatial resolution satellite images. Thus, 2SSFM can be applied to generate various spectral indices using the predicted spectral bands that are actually unavailable but effective for environmental monitoring.
Keywords
Spatio-spectral fusion; Multi-sensor; Area-to-point regression kriging (ATPRK); Resolution;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Claverie, M., J. Ju, J.G. Masek, J.L. Dungan, E.F. Vermote, J.C. Roger, S.V. Skakun, and C. Justice, 2018. The harmonized Landsat and Sentinel-2 surface reflectance data set, Remote Sensing of Environment, 219: 145-161. https://doi.org/10.1016/j.rse.2018.09.002   DOI
2 Govender, M., K. Chetty, and H. Bulcock, 2007. A review of hyperspectral remote sensing and its application in vegetation and water resource studies, Water SA, 33(2): 145-151. https://doi.org/10.4314/wsa.v33i2.49049   DOI
3 Horler, D.N.H., M. Dockray, and J. Barber, 1983. The red edge of plant leaf reflectance, International Journal of Remote Sensing, 4(2): 273-288. https://doi.org/10.1080/01431168308948546   DOI
4 Jiang, X., S. Fang, X. Huang, Y. Liu, and L. Guo, 2021. Rice mapping and growth monitoring based on time series GF-6 images and red-edge bands, Remote Sensing, 13(4): 579. https://doi.org/10.3390/rs13040579   DOI
5 Kim, Y. and N.-W. Park, 2016. Spatial disaggregation of coarse scale satellite-based precipitation data using machine learning model and residual kriging, Journal of Climate Research, 11(2): 183-195 (in Korean with English abstract). http://dx.doi.org/10.14383/cri.2016.11.2.1   DOI
6 Kyriakidis, P.C., 2004. A geostatistical framework for area to point spatial interpolation, Geographical Analysis, 36(3): 259-289. https://doi.org/10.1111/j.1538-4632.2004.tb01135.x   DOI
7 Park, N.-W., 2013. Spatial downscaling of TRMM precipitation using geostatistics and fine scale environmental variables, Advances in Meteorology, Article ID 237126, 2013: 1-9. https://doi.org/10.1155/2013/237126   DOI
8 Lee, Z., K. Carder, R. Arnone, and M. He, 2007. Determination of primary spectral bands for remote sensing of aquatic environments, Sensors, 7(12): 3428-3441. https://doi.org/10.3390/s7123428   DOI
9 Li, Z., H.K. Zhang, D.P. Roy, L. Yan, and H. Huang, 2020. Sharpening the Sentinel-2 10 and 20 m bands to Planetscope-0 3 m resolution, Remote Sensing, 12(15): 2406. https://doi.org/10.3390/rs12152406   DOI
10 Lu, P., W. Shi, Q. Wang, Z. Li, Y. Qin, and X. Fan, 2021. Co-seismic landslide mapping using Sentinel-2 10-m fused NIR narrow, red-edge, and SWIR bands, Landslides, 18(6): 2017-2037. https://doi.org/10.1007/s10346-021-01636-2   DOI
11 Park, N.-W., Y. Kim, and G.-H. Kwak, 2019. An overview of theoretical and practical issues in spatial downscaling of coarse resolution satellite derived products, Korean Journal of Remote Sensing, 35(4): 589-607. https://doi.org/10.7780/kjrs.2019.35.4.8   DOI
12 Seong, N., M. Seo, K.-S. Lee, C. Lee, H. Kim, S. Choi, and K.-S. Han, 2015. A water stress evaluation over forest canopy using NDWI in Korean peninsula, Korean Journal of Remote Sensing, 31(2): 77-83 (in Korean with English abstract). https://doi.org/10.7780/kjrs.2015.31.2.3   DOI
13 Zhao, Y. and D. Liu, 2022. A robust and adaptive spatial-spectral fusion model for PlanetScope and Sentinel-2 imagery, GIScience & Remote Sensing, 59(1): 520-546. https://doi.org/10.1080/15481603.2022.2036054   DOI
14 Song, H., B. Huang, K. Zhang, and H. Zhang, 2014. Spatio-spectral fusion of satellite images based on dictionary-pair learning, Information Fusion, 18: 148-160. http://dx.doi.org/10.1016/j.inffus.2013.08.005   DOI
15 Wang, Z., A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli, 2004. Image quality assessment: from error visibility to structural similarity, IEEE Transactions on Image Processing, 13(4): 600-612. https://doi.org/10.1109/TIP.2003.819861   DOI
16 Wang, Q., W. Shi, P.M. Atkinson, and Y. Zhao, 2015. Downscaling MODIS images with area-to-point regression kriging, Remote Sensing of Environment, 166: 191-204. https://doi.org/10.1016/j.rse.2015.06.003   DOI
17 Jacques, D.C., L. Kergoat, P. Hiernaux, E. Mougin, and P. Defourny, 2014. Monitoring dry vegetation masses in semi-arid areas with MODIS SWIR bands, Remote Sensing of Environment, 153: 40-49. https://doi.org/10.1016/j.rse.2014.07.027   DOI
18 Zhou, J., Y. Qiu, J. Chen, and X. Chen, 2021. A geometric misregistration resistant data fusion approach for adding red-edge (RE) and short-wave infrared (SWIR) bands to high spatial resolution imagery, Science of Remote Sensing, 4: 100033. https://doi.org/10.1016/j.srs.2021.100033   DOI
19 Breiman, L., 2001. Random forests, Machine Learning, 45(1): 5-32. https://doi.org/10.1023/A:1010933404324   DOI
20 Du, Q., N.H. Younan, R. King, and V.P. Shah, 2007. On the performance evaluation of pan-sharpening techniques, IEEE Geoscience and Remote Sensing Letters, 4(4): 518-522. https://doi.org/10.1109/LGRS.2007.896328   DOI
21 Kim, Y. and N.-W. Park, 2017. Impact of trend estimates on predictive performance in model evaluation for spatial downscaling of satellite-based precipitation data, Korean Journal of Remote Sensing, 33(1): 25-35. https://doi.org/10.7780/kjrs.2017.33.1.3   DOI
22 Lee, H.S. and K.S. Lee, 2017. Effect of red-edge band to estimate leaf area index in close canopy forest, Korean Journal of Remote Sensing, 33(5-1): 571-585 (in Korean with English abstract). https://doi.org/10.7780/kjrs.2017.33.5.1.10   DOI
23 Wang, Q. and P.M. Atkinson, 2018. Spatio-temporal fusion for daily Sentinel-2 images, Remote Sensing of Environment, 204: 31-42. https://doi.org/10.1016/j.rse.2017.10.046   DOI
24 Mayer, B. and A. Kylling, 2005. The libRadtran software package for radiative transfer calculations - description and examples of use, Atmospheric Chemistry and Physics, 5(7): 1855-1877. https://doi.org/10.5194/acp-5-1855-2005   DOI
25 Planet, 2022. Planet imagery product specifications, https://assets.planet.com/docs/Planet_Combined_Imagery_Product_Specs_letter_screen.pdf, Accessed on Oct. 6, 2022.
26 Sun, Y., Q. Qin, H. Ren, T. Zhang, and S. Chen, 2019. Red-edge band vegetation indices for leaf area index estimation from Sentinel-2/MSI imagery, IEEE Transactions on Geoscience and Remote Sensing, 58(2): 826-840. https://doi.org/10.1109/TGRS.2019.2940826   DOI
27 Zhu, X.X. and R. Bamler, 2012. A sparse image fusion algorithm with application to pan-sharpening, IEEE Transactions on Geoscience and Remote Sensing, 51(5): 2827-2836. https://doi.org/10.1109/TGRS.2012.2213604   DOI
28 Choi, J.S., Y. Kim, and M. Kim, 2019. S3: A spectralspatial structure loss for pan-sharpening networks, IEEE Geoscience and Remote Sensing Letters, 17(5): 829-833. https://doi.org/10.1109/LGRS.2019.2934493   DOI