• 제목/요약/키워드: Bias correction

검색결과 266건 처리시간 0.035초

Bias Correction of Satellite-Based Precipitation Using Convolutional Neural Network

  • Le, Xuan-Hien;Lee, Gi Ha
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2020년도 학술발표회
    • /
    • pp.120-120
    • /
    • 2020
  • Spatial precipitation data is one of the essential components in modeling hydrological problems. The estimation of these data has achieved significant achievements own to the recent advances in remote sensing technology. However, there are still gaps between the satellite-derived rainfall data and observed data due to the significant dependence of rainfall on spatial and temporal characteristics. An effective approach based on the Convolutional Neural Network (CNN) model to correct the satellite-derived rainfall data is proposed in this study. The Mekong River basin, one of the largest river system in the world, was selected as a case study. The two gridded precipitation data sets with a spatial resolution of 0.25 degrees used in the CNN model are APHRODITE (Asian Precipitation - Highly-Resolved Observational Data Integration Towards Evaluation) and PERSIANN-CDR (Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks). In particular, PERSIANN-CDR data is exploited as satellite-based precipitation data and APHRODITE data is considered as observed rainfall data. In addition to developing a CNN model to correct the satellite-based rain data, another statistical method based on standard deviations for precipitation bias correction was also mentioned in this study. Estimated results indicate that the CNN model illustrates better performance both in spatial and temporal correlation when compared to the standard deviation method. The finding of this study indicated that the CNN model could produce reliable estimates for the gridded precipitation bias correction problem.

  • PDF

전지구 계절예측시스템 GloSea5의 최적 편의보정기법 선정 (A selection of optimal method for bias-correction in Global Seasonal Forecast System version 5 (GloSea5))

  • 손찬영;송정현;김세진;조영현
    • 한국수자원학회논문집
    • /
    • 제50권8호
    • /
    • pp.551-562
    • /
    • 2017
  • 2014년부터 기상청에서 현업으로 활용하고 있는 전지구 계절예측시스템 GloSea5의 최대 6개월 예측 강수량을 수자원 및 여러 응용분야에 활용하기 위해서는 예측모델이 가지는 관측자료와의 정량적인 편의를 보정할 필요가 있다. 본 연구에서는 GloSea5의 예측 강수량에서 나타나는 편의를 보정하기 위해 확률분포형을 활용한 편의보정기법, 매개변수 및 비매개변수적 편의보정기법 등 총 11개의 기법을 활용하여 계절예측모델의 적용성을 평가하고 최적의 편의보정기법을 선정하고자 하였다. 과거재현기간에 대한 편의보정 결과, 비매개변수적 편의보정기법이 다른 기법에 비해 가장 관측자료와 유사하게 보정하는 것으로 분석되었으나 예측기간에 대해서는 상대적으로 많은 이상치를 발생시켰다. 이와는 대조적으로 매개변수적 편의보정기법은 과거재현기간 및 예측기간 모두 안정된 결과를 보여주고 있음을 확인할 수 있었다. 본 연구의 결과는 수자원운영 및 관리, 수력, 농업 등 계절예측모델을 활용한 여러 응용분야에 적용이 가능할 것으로 기대된다.

기후변화 시나리오 편의보정 기법에 따른 강우-유출 특성 분석 (Analysis of Rainfall-Runoff Characteristics on Bias Correction Method of Climate Change Scenarios)

  • 금동혁;박윤식;정영훈;신민환;류지철;박지형;양재의;임경재
    • 한국물환경학회지
    • /
    • 제31권3호
    • /
    • pp.241-252
    • /
    • 2015
  • Runoff behaviors by five bias correction methods were analyzed, which were Change Factor methods using past observed and estimated data by the estimation scenario with average annual calibration factor (CF_Y) or with average monthly calibration factor (CF_M), Quantile Mapping methods using past observed and estimated data considering cumulative distribution function for entire estimated data period (QM_E) or for dry and rainy season (QM_P), and Integrated method of CF_M+QM_E(CQ). The peak flow by CF_M and QM_P were twice as large as the measured peak flow, it was concluded that QM_P method has large uncertainty in monthly runoff estimation since the maximum precipitation by QM_P provided much difference to the other methods. The CQ method provided the precipitation amount, distribution, and frequency of the smallest differences to the observed data, compared to the other four methods. And the CQ method provided the rainfall-runoff behavior corresponding to the carbon dioxide emission scenario of SRES A1B. Climate change scenario with bias correction still contained uncertainty in accurate climate data generation. Therefore it is required to consider the trend of observed precipitation and the characteristics of bias correction methods so that the generated precipitation can be used properly in water resource management plan establishment.

모사된 화재의 열적환경에서 FDS를 이용한 온도 예측오차에 관한 수치해석 연구 (A Numerical Study on Temperature Prediction Bias using FDS in Simulated Thermal Environments of Fire)

  • 한호식;김봉준;황철홍
    • 한국안전학회지
    • /
    • 제32권2호
    • /
    • pp.14-20
    • /
    • 2017
  • A numerical study was conducted to identify the predictive performance for the bare-bead thermocouple (TC) using FDS (Fire Dynamics Simulator) in simulated thermal environments of fire. A relative prediction bias of TC temperature calculated from reverse-radiation correction by FDS was evaluated with the comparison of previous experimental data. As a result, it was identified that the TC temperatures predicted by FDS were lower than the temperatures measured by bare-bead TC for the ranges of heat flux and gas temperature considered. The relative prediction bias of TC temperature by FDS was gradually increased with the increase in radiative heat flux and also significantly increased with the decrease in the gas temperature. Quantitatively, at the gas temperature of $20^{\circ}C$, the TC temperature predicted by FDS had the relative bias of approximately -20% with the radiative heat flux of $20kW/m^2$ corresponding to thermal radiation level of the flashover. It is predicted from the present study that more accurate validation of fire modeling will be possible with the quantitative prediction bias occurred in the process of reverse-radiation correction of temperature predicted by FDS.

희귀 사건 로지스틱 회귀분석을 위한 편의 수정 방법 비교 연구 (Comparison of Bias Correction Methods for the Rare Event Logistic Regression)

  • 김형우;고태석;박노욱;이우주
    • 응용통계연구
    • /
    • 제27권2호
    • /
    • pp.277-290
    • /
    • 2014
  • 본 연구에서는 로지스틱 회귀 모형을 이용하여 보은 지방의 산사태 자료를 분석하였다. 5000 지역의 관측치 가운데 단 9개만이 산사태 발생 지역이므로 이 자료는 희귀 사건 자료로 간주될 수 있다. 로지스틱 회귀 분석 모형이 희귀사건 자료에 적용될 때 주요 이슈는 회귀 계수 추정치에 심각한 편의 문제가 생길 수 있다는 것이다. 기존에 두 가지의 편의 수정 방법이 제안되었는데, 본 논문에서는 시뮬레이션을 통해 정량적으로 비교 연구를 진행하였다. Firth(1993)의 방식이 다른 방법에 비해 우수한 성능을 보였으며, 이항 희귀 사건을 분석하는 데 있어서 매우 안정된 결과를 보여주었다.

A Study on Bias Effect on Model Selection Criteria in Graphical Lasso

  • Choi, Young-Geun;Jeong, Seyoung;Yu, Donghyeon
    • Quantitative Bio-Science
    • /
    • 제37권2호
    • /
    • pp.133-141
    • /
    • 2018
  • Graphical lasso is one of the most popular methods to estimate a sparse precision matrix, which is an inverse of a covariance matrix. The objective function of graphical lasso imposes an ${\ell}_1$-penalty on the (vectorized) precision matrix, where a tuning parameter controls the strength of the penalization. The selection of the tuning parameter is practically and theoretically important since the performance of the estimation depends on an appropriate choice of tuning parameter. While information criteria (e.g. AIC, BIC, or extended BIC) have been widely used, they require an asymptotically unbiased estimator to select optimal tuning parameter. Thus, the biasedness of the ${\ell}_1$-regularized estimate in the graphical lasso may lead to a suboptimal tuning. In this paper, we propose a two-staged bias-correction procedure for the graphical lasso, where the first stage runs the usual graphical lasso and the second stage reruns the procedure with an additional constraint that zero estimates at the first stage remain zero. Our simulation and real data example show that the proposed bias correction improved on both edge recovery and estimation error compared to the single-staged graphical lasso.

1D 측선에 의한 절리 자료에 대한 편향 보정 기법에 관한 연구 (A study of the Sampling Bias Correction on Joint Data from 1D Survey Line)

  • 엄정기
    • 터널과지하공간
    • /
    • 제13권5호
    • /
    • pp.344-352
    • /
    • 2003
  • 시추공 또는 선형조사선과 같은 1D측선에서 측정된 절리 자료의 샘플링 편향을 보정하는 절차를 기술하였다. ID 측선에서 절리가 관측될 수 있는 확률은 측선 방향에 대한 절리의 상대적인 방향 이외에도 절리 크기, 절리 모양 및 측선 길이 등의 복합적 요인에 의하여 결정될 수 있다. 본 연구에서는 절리의 모양을 원판형이라 가정하고 절리의 방향 및 크기에 의하여 나타날 수 있는 절리 자료의 방향 편향 효과를 동시에 보정할 수 있는 방법론을 제시하고, 현장적용을 통하여 방향 편향 보정이 절리군의 방향분포에 미치는 영향에 대하여 고찰하였다. 또한, 유한 길이의 측선으로부터 산정된 절리군의 간격분포는 샘플링 영역인 측선 길이에 따라 다르게 나타날 수 있으며, 이와 같은 간격 편향에 대한 보정절차를 기술하였다.

A Simple Bias-Correction Rule for the Apparent Prediction Error

  • Beong-Soo So
    • Communications for Statistical Applications and Methods
    • /
    • 제2권2호
    • /
    • pp.146-154
    • /
    • 1995
  • By using simple Taylor expansion, we derive an easy bias-correction rule for the apparent prodiction error of the predictor defined by the general M-estimators with respect to an arbitrary measure of prediction error. Our method has a considerable computational advantage over the previous methods based on the resampling thchnique such as Cross-validaton and Boothtrap. Connections with AIC, Cross-Validation and Boothtrap are discussed too.

  • PDF

PM2.5 예보를 위한 모델 성능평가와 편차보정 효과 분석 (Model Performance Evaluation and Bias Correction Effect Analysis for Forecasting PM2.5 Concentrations)

  • 김영성;최용주;김순태;배창한;박진수;신혜정
    • 한국대기환경학회지
    • /
    • 제33권1호
    • /
    • pp.11-18
    • /
    • 2017
  • The performance of a modeling system consisting of WRF model v3.3 and CMAQ model v4.7.1 for forecasting $PM_{2.5}$ concentrations were evaluated during the period May 2012 through December 2014. Twenty-four hour averages of $PM_{2.5}$ and its major components obtained through filter sampling at the Bulgwang intensive measurement station were used for comparison. The mean predicted $PM_{2.5}$ concentration over the entire period was 68% of the mean measured value. Predicted concentrations for major components were underestimated except for $NO_3{^-}$. The model performance for $PM_{2.5}$ generally tended to degrade with increasing the concentration level. However, the mean fractional bias (MFB) for high concentration above the $80^{th}$ percentile fell within the criteria, the level of accuracy acceptable for standard model applications. Among three bias correction methods, the ratio adjustment was generally most effective in improving the performance. Albeit for limited test conditions, this analysis demonstrated that the effects of bias correction were larger when using the data with a larger bias of predicted values from measurement values.

A copula based bias correction method of climate data

  • Gyamfi Kwame Adutwum;Eun-Sung Chung
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2023년도 학술발표회
    • /
    • pp.160-160
    • /
    • 2023
  • Generally, Global Climate Models (GCM) cannot be used directly due to their inherent error arising from over or under-estimation of climate variables compared to the observed data. Several bias correction methods have been devised to solve this problem. Most of the traditional bias correction methods are one dimensional as they bias correct the climate variables separately. One such method is the Quantile Mapping method which builds a transfer function based on the statistical differences between the GCM and observed variables. Laux et al. introduced a copula-based method that bias corrects simulated climate data by employing not one but two different climate variables simultaneously and essentially extends the traditional one dimensional method into two dimensions. but it has some limitations. This study uses objective functions to address specifically, the limitations of Laux's methods on the Quantile Mapping method. The objective functions used were the observed rank correlation function, the observed moment function and the observed likelihood function. To illustrate the performance of this method, it is applied to ten GCMs for 20 stations in South Korea. The marginal distributions used were the Weibull, Gamma, Lognormal, Logistic and the Gumbel distributions. The tested copula family include most Archimedean copula families. Five performance metrics are used to evaluate the efficiency of this method, the Mean Square Error, Root Mean Square Error, Kolmogorov-Smirnov test, Percent Bias, Nash-Sutcliffe Efficiency and the Kullback Leibler Divergence. The results showed a significant improvement of Laux's method especially when maximizing the observed rank correlation function and when maximizing a combination of the observed rank correlation and observed moments functions for all GCMs in the validation period.

  • PDF