• Title/Summary/Keyword: Bias correction

Search Result 268, Processing Time 0.033 seconds

Analysis of bias correction performance of satellite-derived precipitation products by deep learning model

  • Le, Xuan-Hien;Nguyen, Giang V.;Jung, Sungho;Lee, Giha
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2022.05a
    • /
    • pp.148-148
    • /
    • 2022
  • Spatiotemporal precipitation data is one of the primary quantities in hydrological as well as climatological studies. Despite the fact that the estimation of these data has made considerable progress owing to advances in remote sensing, the discrepancy between satellite-derived precipitation product (SPP) data and observed data is still remarkable. This study aims to propose an effective deep learning model (DLM) for bias correction of SPPs. In which TRMM (The Tropical Rainfall Measuring Mission), CMORPH (CPC Morphing technique), and PERSIANN-CDR (Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks) are three SPPs with a spatial resolution of 0.25o exploited for bias correction, and APHRODITE (Asian Precipitation - Highly-Resolved Observational Data Integration Towards Evaluation) data is used as a benchmark to evaluate the effectiveness of DLM. We selected the Mekong River Basin as a case study area because it is one of the largest watersheds in the world and spans many countries. The adjusted dataset has demonstrated an impressive performance of DLM in bias correction of SPPs in terms of both spatial and temporal evaluation. The findings of this study indicate that DLM can generate reliable estimates for the gridded satellite-based precipitation bias correction.

  • PDF

Ricean Bias Correction in Linear Polarization Observation

  • Sohn, Bong-Won
    • Journal of Astronomy and Space Sciences
    • /
    • v.28 no.4
    • /
    • pp.267-271
    • /
    • 2011
  • I developed an enhanced correction method for Ricean bias which occurs in linear polarization measurement. Two known methods for Ricean bias correction are reviewed. In low signal-to-noise area, the method based on the mode of the equation gives better representation of the fractional polarization. But a caution should be given that the accurate estimation of noise level, i.e. ${\sigma}$ of the polarized flux, is important. The maximum likelihood method is better choice for high signal-to-noise area. I suggest a hybrid method which uses the mode of the equation at the low signal-to-noise area and takes the maximum likelihood method at the high signal-to-noise area. A modified correction coefficient for the mode solution is proposed. The impact on the depolarization measure analysis is discussed.

Pre-processing and Bias Correction for AMSU-A Radiance Data Based on Statistical Methods (통계적 방법에 근거한 AMSU-A 복사자료의 전처리 및 편향보정)

  • Lee, Sihye;Kim, Sangil;Chun, Hyoung-Wook;Kim, Ju-Hye;Kang, Jeon-Ho
    • Atmosphere
    • /
    • v.24 no.4
    • /
    • pp.491-502
    • /
    • 2014
  • As a part of the KIAPS (Korea Institute of Atmospheric Prediction Systems) Package for Observation Processing (KPOP), we have developed the modules for Advanced Microwave Sounding Unit-A (AMSU-A) pre-processing and its bias correction. The KPOP system calculates the airmass bias correction coefficients via the method of multiple linear regression in which the scan-corrected innovation and the thicknesses of 850~300, 200~50, 50~5, and 10~1 hPa are respectively used for dependent and independent variables. Among the four airmass predictors, the multicollinearity has been shown by the Variance Inflation Factor (VIF) that quantifies the severity of multicollinearity in a least square regression. To resolve the multicollinearity, we adopted simple linear regression and Principal Component Regression (PCR) to calculate the airmass bias correction coefficients and compared the results with those from the multiple linear regression. The analysis shows that the order of performances is multiple linear, principal component, and simple linear regressions. For bias correction for the AMSU-A channel 4 which is the most sensitive to the lower troposphere, the multiple linear regression with all four airmass predictors is superior to the simple linear regression with one airmass predictor of 850~300 hPa. The results of PCR with 95% accumulated variances accounted for eigenvalues showed the similar results of the multiple linear regression.

Application of Convolutional Neural Networks (CNN) for Bias Correction of Satellite Precipitation Products (SPPs) in the Amazon River Basin

  • Alena Gonzalez Bevacqua;Xuan-Hien Le;Giha Lee
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2023.05a
    • /
    • pp.159-159
    • /
    • 2023
  • The Amazon River basin is one of the largest basins in the world, and its ecosystem is vital for biodiversity, hydrology, and climate regulation. Thus, understanding the hydrometeorological process is essential to the maintenance of the Amazon River basin. However, it is still tricky to monitor the Amazon River basin because of its size and the low density of the monitoring gauge network. To solve those issues, remote sensing products have been largely used. Yet, those products have some limitations. Therefore, this study aims to do bias corrections to improve the accuracy of Satellite Precipitation Products (SPPs) in the Amazon River basin. We use 331 rainfall stations for the observed data and two daily satellite precipitation gridded datasets (CHIRPS, TRMM). Due to the limitation of the observed data, the period of analysis was set from 1st January 1990 to 31st December 2010. The observed data were interpolated to have the same resolution as the SPPs data using the IDW method. For bias correction, we use convolution neural networks (CNN) combined with an autoencoder architecture (ConvAE). To evaluate the bias correction performance, we used some statistical indicators such as NSE, RMSE, and MAD. Hence, those results can increase the quality of precipitation data in the Amazon River basin, improving its monitoring and management.

  • PDF

Development of bias correction scheme for high resolution precipitation forecast (고해상도 강수량 수치예보에 대한 편의 보정 기법 개발)

  • Uranchimeg, Sumiya;Kim, Ji-Sung;Kim, Kyu-Ho;Kwon, Hyun-Han
    • Journal of Korea Water Resources Association
    • /
    • v.51 no.7
    • /
    • pp.575-584
    • /
    • 2018
  • An increase in heavy rainfall and floods have been observed over South Korea due to recent abnormal weather. In this perspective, the high-resolution weather forecasts have been widely used to facilitate flood management. However, these models are known to be biased due to initial conditions and topographical conditions in the process of model building. Theretofore, a bias correction scheme is largely applied for the practical use of the prediction to flood management. This study introduces a new mean field bias correction (MFBC) approach for the high-resolution numerical rainfall products, which is based on a Bayesian Kriging model to combine an interpolation technique and MFBC approach for spatial representation of the error. The results showed that the proposed method can reliably estimate the bias correction factor over ungauged area with an improvement in the reduction of errors. Moreover, it can be seen that the bias corrected rainfall forecasts could be used up to 72 hours ahead with a relatively high accuracy.

Nonuniformity Correction Scheme Based on 3-dimensional Visualization of MRI Images (MRI 영상의 3차원 가시화를 통한 영상 불균일성 보정 기법)

  • Kim, Hyoung-Jin;Seo, Kwang-Deok
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.14 no.4
    • /
    • pp.948-958
    • /
    • 2010
  • Human body signals collected by the MRI system are very weak, such that they may be easily affected by either external noise or system instability while being imaged. Therefore, this paper analyzes the nonuniformity caused by a design of the RF receiving coil in a low-magnetic-field MRI system, and proposes an efficient method to improve the image uniformity. In this paper, a method for acquiring 3D bias volume data by using phantom data among various methods for correcting such nonuniformity in MRI image is proposed, such that it is possible to correct various-sized images. It is shown by simulations that images obtained by various imaging methods can be effectively corrected using single bias data.

Contrast-enhanced Bias-corrected Distance-regularized Level Set Method Applied to Hippocampus Segmentation

  • Selma, Tisa;Madusanka, Nuwan;Kim, Tae-Hyung;Kim, Young-Hoon;Mun, Chi-Woong;Choi, Heung-Kook
    • Journal of Korea Multimedia Society
    • /
    • v.19 no.8
    • /
    • pp.1236-1247
    • /
    • 2016
  • Recently, the level set has become a popular method in many research fields. The main reason is that it can be modified into many variants. One such case is our proposed method. We describe a contrast-enhancement method to segment the hippocampal region from the background. However, the hippocampus region has quite similar intensities to the neighboring pixel intensities. In addition, to handle the inhomogeneous intensities of the hippocampus, we used a bias correction before hippocampal segmentation. Thus, we developed a contrast-enhanced bias-corrected distance-regularized level set (CBDLS) to segment the hippocampus in magnetic resonance imaging (MRI). It shows better performance than the distance-regularized level set evolution (DLS) and bias-corrected distance-regularized level set (BDLS) methods in 33 MRI images of one normal patient. Segmentation after contrast enhancement and bias correction can be done more accurately than segmentation while not using a bias-correction method and without contrast enhancement.

Development of Pre-Processing and Bias Correction Modules for AMSU-A Satellite Data in the KIAPS Observation Processing System (KIAPS 관측자료 처리시스템에서의 AMSU-A 위성자료 초기 전처리와 편향보정 모듈 개발)

  • Lee, Sihye;Kim, Ju-Hye;Kang, Jeon-Ho;Chun, Hyoung-Wook
    • Atmosphere
    • /
    • v.23 no.4
    • /
    • pp.453-470
    • /
    • 2013
  • As a part of the KIAPS Observation Processing System (KOPS), we have developed the modules of satellite radiance data pre-processing and quality control, which include observation operators to interpolate model state variables into radiances in observation space. AMSU-A (Advanced Microwave Sounding Unit-A) level-1d radiance data have been extracted using the BUFR (Binary Universal Form for the Representation of meteorological data) decoder and a first guess has been calculated with RTTOV (Radiative Transfer for TIROS Operational Vertical Sounder) version 10.2. For initial quality checks, the pixels contaminated by large amounts of cloud liquid water, heavy precipitation, and sea ice have been removed. Channels for assimilation, rejection, or monitoring have been respectively selected for different surface types since the errors from the skin temperature are caused by inaccurate surface emissivity. Correcting the bias caused by errors in the instruments and radiative transfer model is crucial in radiance data pre-processing. We have developed bias correction modules in two steps based on 30-day innovation statistics (observed radiance minus background; O-B). The scan bias correction has been calculated individually for each channel, satellite, and scan position. Then a multiple linear regression of the scan-bias-corrected innovations with several predictors has been employed to correct the airmass bias.

Identifying the Actual Impact of Online Social Interactions on Demand

  • Dong Soo Kim
    • Asia Marketing Journal
    • /
    • v.26 no.1
    • /
    • pp.23-30
    • /
    • 2024
  • Firms often engage in manipulating online reviews as a promotional activity to influence consumers' evaluation on their products. With the prevalence of the promotional activities, consumers may notice and discount the reviews generated by the promotional activities. Discounting the firm-generating reviews may cause systematic measurement errors in the valence variable and lead to a negative bias when estimating the effect of consumers' organic reviews on demand. To correct the bias, this study proposes including product-specific bias-correction terms representing the proportion of extreme reviews in analysis. For illustration, the proposed method is applied to a demand model for data of movies released in South Korea. The results confirm a negative bias in the estimate of the valence sensitivity of demand. The negative bias potentially leads to an underestimation of the magnitude of the contagion effect through social interactions, a key component of evaluating the value of a satisfied consumer.

Bias Correction of RCP-based Future Extreme Precipitation using a Quantile Mapping Method ; for 20-Weather Stations of South Korea (분위사상법을 이용한 RCP 기반 미래 극한강수량 편의보정 ; 우리나라 20개 관측소를 대상으로)

  • Park, Jihoon;Kang, Moon Seong;Song, Inhong
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.54 no.6
    • /
    • pp.133-142
    • /
    • 2012
  • The objective of this study was to correct the bias of the Representative Concentration Pathways (RCP)-based future precipitation data using a quantile mapping method. This method was adopted to correct extreme values because it was designed to adjust simulated data using probability distribution function. The Generalized Extreme Value (GEV) distribution was used to fit distribution for precipitation data obtained from the Korea Meteorological Administration (KMA). The resolutions of precipitation data was 12.5 km in space and 3-hour in time. As the results of bias correction over the past 30 years (1976~2005), the annual precipitation was increased 16.3 % overall. And the results for 90 years (divided into 2011~2040, 2041~2070, 2071~2100) were that the future annual precipitation were increased 8.8 %, 9.6 %, 11.3 % respectively. It also had stronger correction effects on high value than low value. It was concluded that a quantile mapping appeared a good method of correcting extreme value.