• Title/Summary/Keyword: bias correction

Search Result 265, Processing Time 0.038 seconds

Uncertainty Analysis of Quantitative Radar Rainfall Estimation Using the Maximum Entropy (Maximum Entropy를 이용한 정량적 레이더 강우추정 불확실성 분석)

  • Lee, Jae-Kyoung
    • Atmosphere
    • /
    • v.25 no.3
    • /
    • pp.511-520
    • /
    • 2015
  • Existing studies on radar rainfall uncertainties were performed to reduce the uncertainty for each stage by using bias correction during the quantitative radar rainfall estimation process. However, the studies do not provide quantitative comparison with the uncertainties for all stages. Consequently, this study proposes a suitable approach that can quantify the uncertainties at each stage of the quantitative radar rainfall estimation process. First, the new approach can present initial and final uncertainties, increasing or decreasing the uncertainty, and the uncertainty percentage at each stage. Furthermore, Maximum Entropy (ME) was applied to quantify the uncertainty in the entire process. Second, for the uncertainty quantification of radar rainfall estimation at each stage, this study used two quality control algorithms, two rainfall estimation relations, and two bias correction techniques as post-processing and progressed through all stages of the radar rainfall estimation. For the proposed approach, the final uncertainty (ME = 3.81) from the ME of the bias correction stage was the smallest while the uncertainty of the rainfall estimation stage was higher because of the use of an unsuitable relation. Additionally, the ME of the quality control was at 4.28 (112.34%), while that of the rainfall estimation was at 4.53 (118.90%), and that of the bias correction at 3.81 (100%). However, this study also determined that selecting the appropriate method for each stage would gradually reduce the uncertainty at each stage. Finally, the uncertainty due to natural variability was 93.70% of the final uncertainty. Thus, the results indicate that this new approach can contribute significantly to the field of uncertainty estimation and help with estimating more accurate radar rainfall.

Scene-based Nonuniformity Correction for Neural Network Complemented by Reducing Lense Vignetting Effect and Adaptive Learning rate

  • No, Gun-hyo;Hong, Yong-hee;Park, Jin-ho;Jhee, Ho-jin
    • Journal of the Korea Society of Computer and Information
    • /
    • v.23 no.7
    • /
    • pp.81-90
    • /
    • 2018
  • In this paper, reducing lense Vignetting effect and adaptive learning rate method are proposed to complement Scribner's neural network for nuc algorithm which is the effective algorithm in statistic SBNUC algorithm. Proposed reducing vignetting effect method is updated weight and bias each differently using different cost function. Proposed adaptive learning rate for updating weight and bias is using sobel edge detection method, which has good result for boundary condition of image. The ordinary statistic SBNUC algorithm has problem to compensate lense vignetting effect, because statistic algorithm is updated weight and bias by using gradient descent method, so it should not be effective for global weight problem same like, lense vignetting effect. We employ the proposed methods to Scribner's neural network method(NNM) and Torres's reducing ghosting correction for neural network nuc algorithm(improved NNM), and apply it to real-infrared detector image stream. The result of proposed algorithm shows that it has 10dB higher PSNR and 1.5 times faster convergence speed then the improved NNM Algorithm.

An improvement of Simplified Atmospheric Correction : MODIS Visible Channel

  • Lee, Chang-Suk;Han, Kyung-Soo
    • Korean Journal of Remote Sensing
    • /
    • v.25 no.6
    • /
    • pp.487-499
    • /
    • 2009
  • Atmospheric correction of satellite measurements is a major step to estimate accurate surface reflectance of solar spectrum channels. In this study, Simplified Method for the Atmospheric Correction (SMAC) radiative transfer model used to retrieve surface reflectance from MODIS (MODerate resolution Imaging Spectrometer) top of atmosphere (TOA) reflectance. It is fast and simple atmospheric correction method, so it uses for work site operation in various satellite. This study attempts a test of accuracy of SMAC through a sensitivity test to detected error sources and to improve accuracy of surface reflectance using SMAC. The results of SMAC as compared with MODIS surface reflectance (MOD09) was represented that low accuracy ($R^2\;=\;0.6196$, Root Means Square Error (RMSE) = 0.00031, bias = - 0.0859). Thus sensitivity analysis of input parameters and coefficients was conducted to searching error sources. Among the input parameters, Aerosol Optical Depth (AOD) is the most influence input parameter. In order to modify AOD term in SMAC code, Stepwise multiple regression was performed with testing and remove variable in three stages with independent variables of AOD at 550nm, solar zenith angle, viewing zenith angle. Surface reflectance estimation by using Newly proposed AOD term in the study showed that improve accuracy ($R^2\;=\;0.827$, RMSE = 0.00672, bias = - 0.000762).

Studies on the Development of Novel 305 day Adjustment Factors for Production Traits in Dairy Cattle

  • Cho, K.H.;Na, S.H.;Cho, J.H.;Lee, J.H.;Lee, K.J.
    • Asian-Australasian Journal of Animal Sciences
    • /
    • v.17 no.12
    • /
    • pp.1689-1694
    • /
    • 2004
  • This study was conducted to develop a novel adjustment factors for 305 days using 138,103 lactation records and 1,770,764 daily records, which were based on environmental circumstances such as herd year, season, age at calving, dry period and lactating stages. The present study showed that the change of persistency of cows at the first parity from total lactacting characteristics was slowly processed, while it was rapidly changed in cows at the second parity stage. Particularly, there was an outstanding difference between the first and second parity cows. Milk yield and composition increased as the age at calving was increased. In addition, milk yield and composition were higher at the first parity on fall compared with others, and those were higher at the more than second parity on fall and winter compared with other parity stages and seasons. The cow of dry group was included into lactating records of more than second parity stage. The data indicated that optimal results arose from 45-70 days of dry period. Milk yield was decreased when dry period was longer or shorter than 45-70 days. The lactating days were divided into 17, 28 and 38 stages to compare the multiplicative correction factors. The factor was effective at 28 stages on the first parity. The total correlation coefficients were 0.93832, 0.95058 and 0.95076 at the present correction factor, 17 stage and 28 stage, respectively. At second parity, the factor was higher in dry group 1 and 3 at 17 stage, and it was higher in dry group 2 at 28 stage compared with others. Therefore, the present study showed that the percent squared bias (PSB), which was calculated from the novel correction factor, was better than previously used correction factors. Also, the present study indicated that the bias of the novel correction factor was improved, and this factor could be more accurate compared with others.

Development of daily spatio-temporal downscaling model with conditional Copula based bias-correction of GloSea5 monthly ensemble forecasts (조건부 Copula 함수 기반의 월단위 GloSea5 앙상블 예측정보 편의보정 기법과 연계한 일단위 시공간적 상세화 모델 개발)

  • Kim, Yong-Tak;Kim, Min Ji;Kwon, Hyun-Han
    • Journal of Korea Water Resources Association
    • /
    • v.54 no.12
    • /
    • pp.1317-1328
    • /
    • 2021
  • This study aims to provide a predictive model based on climate models for simulating continuous daily rainfall sequences by combining bias-correction and spatio-temporal downscaling approaches. For these purposes, this study proposes a combined modeling system by applying conditional Copula and Multisite Non-stationary Hidden Markov Model (MNHMM). The GloSea5 system releases the monthly rainfall prediction on the same day every week, however, there are noticeable differences in the updated prediction. It was confirmed that the monthly rainfall forecasts are effectively updated with the use of the Copula-based bias-correction approach. More specifically, the proposed bias-correction approach was validated for the period from 1991 to 2010 under the LOOCV scheme. Several rainfall statistics, such as rainfall amounts, consecutive rainfall frequency, consecutive zero rainfall frequency, and wet days, are well reproduced, which is expected to be highly effective as input data of the hydrological model. The difference in spatial coherence between the observed and simulated rainfall sequences over the entire weather stations was estimated in the range of -0.02~0.10, and the interdependence between rainfall stations in the watershed was effectively reproduced. Therefore, it is expected that the hydrological response of the watershed will be more realistically simulated when used as input data for the hydrological model.

Extension of shuster's algorithm for spin-axis attitude and sensor bias determination (위성 회전축 및 센서 바이어스 결정을 위한 확장 Shuster 알고리즘에 관한 연구)

  • 노태수
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1994.10a
    • /
    • pp.238-242
    • /
    • 1994
  • Shuster's algorithm for spin-axis determination is extended to include sensor bias and mounting angle as its solve-for parameters. The relation between direct and derived measurements bias is obtained by linearizing their kinematic equations. A one-step least-square estimation technique referred to as the 'closed form' solution is used, and the solution provides a more refined and decent initial guess for the subsequent filtering process contained within the differential correction module. The modified algorithm is applied for attitude determination of a GEO communication satellite in transfer orbit, and its results are presented.

  • PDF

Bias-correction of Dual Polarization Radar rainfall using Convolutional Autoencoder

  • Jung, Sungho;Le, Xuan Hien;Oh, Sungryul;Kim, Jeongyup;Lee, GiHa
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2020.06a
    • /
    • pp.166-166
    • /
    • 2020
  • Recently, As the frequency of localized heavy rains increases, the use of high-resolution radar data is increasing. The produced radar rainfall has still gaps of spatial and temporal compared to gauge observation rainfall, and in many studies, various statistical techniques are performed for correct rainfall. In this study, the precipitation correction of the S-band Dual Polarization radar in use in the flood forecast was performed using the ConvAE algorithm, one of the Convolutional Neural Network. The ConvAE model was trained based on radar data sets having a 10-min temporal resolution: radar rainfall data, gauge rainfall data for 790minutes(July 2017 in Cheongju flood event). As a result of the validation of corrected radar rainfall were reduced gaps compared to gauge rainfall and the spatial correction was also performed. Therefore, it is judged that the corrected radar rainfall using ConvAE will increase the reliability of the gridded rainfall data used in various physically-based distributed hydrodynamic models.

  • PDF

Generation of radar rainfall data for hydrological and meteorological application (I) : bias correction and estimation of error distribution (수문기상학적 활용을 위한 레이더 강우자료 생산(I) : 편의보정 및 오차분포 산정)

  • Kim, Tae-Jeong;Lee, Dong-Ryul;Jang, Sang-Min;Kwon, Hyun-Han
    • Journal of Korea Water Resources Association
    • /
    • v.50 no.1
    • /
    • pp.1-15
    • /
    • 2017
  • Information on radar rainfall with high spatio-temporal resolution over large areas has been used to mitigate climate-related disasters such as flash floods. On the other hand, a well-known problem associated with the radar rainfall using the Marshall-Palmer relationship is the underestimation. In this study, we develop a new bias correction scheme based on the quantile regression method. This study employed a bivariate copula function method for the joint simulation between radar and ground gauge rainfall data to better characterize the error distribution. The proposed quantile regression based bias corrected rainfall showed a good agreement with that of observed. Moreover, the results of our case studies suggest that the copula function approach was useful to functionalize the error distribution of radar rainfall in an effective way.

Database based Global Positioning System Correction (데이터베이스 기반 GPS 위치 보정 시스템)

  • Moon, Jun-Ho;Choi, Hyuk-Doo;Park, Nam-Hun;Kim, Chong-Hui;Park, Yong-Woon;Kim, Eun-Tai
    • The Journal of Korea Robotics Society
    • /
    • v.7 no.3
    • /
    • pp.205-215
    • /
    • 2012
  • A GPS sensor is widely used in many areas such as navigation, or air traffic control. Particularly, the car navigation system is equipped with GPS sensor for locational information. However, when a car goes through a tunnel, forest, or built-up area, GPS receiver cannot get the enough number of satellite signals. In these situations, a GPS receiver does not reliably work. A GPS error can be formulated by sum of bias error and sensor noise. The bias error is generated by the geometric arrangement of satellites and sensor noise error is generated by the corrupted signal noise of receiver. To enhance GPS sensor accuracy, these two kinds of errors have to be removed. In this research, we make the road database which includes Road Database File (RDF). RDF includes road information such as road connection, road condition, coordinates of roads, lanes, and stop lines. Among the information, we use the stop line coordinates as a feature point to correct the GPS bias error. If the relative distance and angle of a stop line from a car are detected and the detected stop line can be associated with one of the stop lines in the database, we can measure the bias error and correct the car's location. To remove the other GPS error, sensor noise, the Kalman filter algorithm is used. Additionally, using the RDF, we can get the information of the road where the car belongs. It can be used to help the GPS correction algorithm or to give useful information to users.

Satellite-based Rainfall for Water Resources Application

  • Supattra, Visessri;Piyatida, Ruangrassamee;Teerawat, Ramindra
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2017.05a
    • /
    • pp.188-188
    • /
    • 2017
  • Rainfall is an important input to hydrological models. The accuracy of hydrological studies for water resources and floods management depend primarily on the estimation of rainfall. Thailand is among the countries that have regularly affected by floods. Flood forecasting and warning are necessary to prevent or mitigate loss and damage. Merging near real time satellite-based precipitation estimation with relatively high spatial and temporal resolutions to ground gauged precipitation data could contribute to reducing uncertainty and increasing efficiency for flood forecasting application. This study tested the applicability of satellite-based rainfall for water resources management and flood forecasting. The objectives of the study are to assess uncertainty associated with satellite-based rainfall estimation, to perform bias correction for satellite-based rainfall products, and to evaluate the performance of the bias-corrected rainfall data for the prediction of flood events. This study was conducted using a case study of Thai catchments including the Chao Phraya, northeastern (Chi and Mun catchments), and the eastern catchments for the period of 2006-2015. Data used in the study included daily rainfall from ground gauges, telegauges, and near real time satellite-based rainfall products from TRMM, GSMaP and PERSIANN CCS. Uncertainty in satellite-based precipitation estimation was assessed using a set of indicators describing the capability to detect rainfall event and efficiency to capture rainfall pattern and amount. The results suggested that TRMM, GSMaP and PERSIANN CCS are potentially able to improve flood forecast especially after the process of bias correction. Recommendations for further study include extending the scope of the study from regional to national level, testing the model at finer spatial and temporal resolutions and assessing other bias correction methods.

  • PDF