• Title/Summary/Keyword: Bayesian modeling

Search Result 234, Processing Time 0.027 seconds

Improving streamflow and flood predictions through computational simulations, machine learning and uncertainty quantification

  • Venkatesh Merwade;Siddharth Saksena;Pin-ChingLi;TaoHuang
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2023.05a
    • /
    • pp.29-29
    • /
    • 2023
  • To mitigate the damaging impacts of floods, accurate prediction of runoff, streamflow and flood inundation is needed. Conventional approach of simulating hydrology and hydraulics using loosely coupled models cannot capture the complex dynamics of surface and sub-surface processes. Additionally, the scarcity of data in ungauged basins and quality of data in gauged basins add uncertainty to model predictions, which need to be quantified. In this presentation, first the role of integrated modeling on creating accurate flood simulations and inundation maps will be presented with specific focus on urban environments. Next, the use of machine learning in producing streamflow predictions will be presented with specific focus on incorporating covariate shift and the application of theory guided machine learning. Finally, a framework to quantify the uncertainty in flood models using Hierarchical Bayesian Modeling Averaging will be presented. Overall, this presentation will highlight that creating accurate information on flood magnitude and extent requires innovation and advancement in different aspects related to hydrologic predictions.

  • PDF

Joint analysis of binary and continuous data using skewed logit model in developmental toxicity studies (발달 독성학에서 비대칭 로짓 모형을 사용한 이진수 자료와 연속형 자료에 대한 결합분석)

  • Kim, Yeong-hwa;Hwang, Beom Seuk
    • The Korean Journal of Applied Statistics
    • /
    • v.33 no.2
    • /
    • pp.123-136
    • /
    • 2020
  • It is common to encounter correlated multiple outcomes measured on the same subject in various research fields. In developmental toxicity studies, presence of malformed pups and fetal weight are measured on the pregnant dams exposed to different levels of a toxic substance. Joint analysis of such two outcomes can result in more efficient inferences than separate models for each outcome. Most methods for joint modeling assume a normal distribution as random effects. However, in developmental toxicity studies, the response distributions may change irregularly in location and shape as the level of toxic substance changes, which may not be captured by a normal random effects model. Motivated by applications in developmental toxicity studies, we propose a Bayesian joint model for binary and continuous outcomes. In our model, we incorporate a skewed logit model for the binary outcome to allow the response distributions to have flexibly in both symmetric and asymmetric shapes on the toxic levels. We apply our proposed method to data from a developmental toxicity study of diethylhexyl phthalate.

An Effective Shadow Elimination Method Using Adaptive Parameters Update (적응적 매개변수 갱신을 통한 효과적인 그림자 제거 기법)

  • Kim, Byeoung-Su;Lee, Gwang-Gook;Yoon, Ja-Young;Kim, Jae-Jun;Kim, Whoi-Yul
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.45 no.3
    • /
    • pp.11-19
    • /
    • 2008
  • Background subtraction, which separates moving objects in video sequences, is an essential technology for object recognition and tracking. However, background subtraction methods are often confused by shadow regions and this misclassification of shadow regions disturbs further processes to perceive the shapes or exact positions of moving objects. This paper proposes a method for shadow elimination which is based on shadow modeling by color information and Bayesian classification framework. Also, because of dynamic update of modeling parametres, the proposed method is able to correspond adaptively to illumination changes. Experimental results proved that the proposed method can eliminate shadow regions effectively even for circumstances with varying lighting condition.

Climate Change Scenario Generation and Uncertainty Assessment: Multiple variables and potential hydrological impacts

  • Kwon, Hyun-Han;Park, Rae-Gun;Choi, Byung-Kyu;Park, Se-Hoon
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2010.05a
    • /
    • pp.268-272
    • /
    • 2010
  • The research presented here represents a collaborative effort with the SFWMD on developing scenarios for future climate for the SFWMD area. The project focuses on developing methodology for simulating precipitation representing both natural quasi-oscillatory modes of variability in these climate variables and also the secular trends projected by the IPCC scenarios that are publicly available. This study specifically provides the results for precipitation modeling. The starting point for the modeling was the work of Tebaldi et al that is considered one of the benchmarks for bias correction and model combination in this context. This model was extended in the framework of a Hierarchical Bayesian Model (HBM) to formally and simultaneously consider biases between the models and observations over the historical period and trends in the observations and models out to the end of the 21st century in line with the different ensemble model simulations from the IPCC scenarios. The low frequency variability is modeled using the previously developed Wavelet Autoregressive Model (WARM), with a correction to preserve the variance associated with the full series from the HBM projections. The assumption here is that there is no useful information in the IPCC models as to the change in the low frequency variability of the regional, seasonal precipitation. This assumption is based on a preliminary analysis of these models historical and future output. Thus, preserving the low frequency structure from the historical series into the future emerges as a pragmatic goal. We find that there are significant biases between the observations and the base case scenarios for precipitation. The biases vary across models, and are shrunk using posterior maximum likelihood to allow some models to depart from the central tendency while allowing others to cluster and reduce biases by averaging. The projected changes in the future precipitation are small compared to the bias between model base run and observations and also relative to the inter-annual and decadal variability in the precipitation.

  • PDF

Mapping Landslide Susceptibility Based on Spatial Prediction Modeling Approach and Quality Assessment (공간예측모형에 기반한 산사태 취약성 지도 작성과 품질 평가)

  • Al, Mamun;Park, Hyun-Su;JANG, Dong-Ho
    • Journal of The Geomorphological Association of Korea
    • /
    • v.26 no.3
    • /
    • pp.53-67
    • /
    • 2019
  • The purpose of this study is to identify the quality of landslide susceptibility in a landslide-prone area (Jinbu-myeon, Gangwon-do, South Korea) by spatial prediction modeling approach and compare the results obtained. For this goal, a landslide inventory map was prepared mainly based on past historical information and aerial photographs analysis (Daum Map, 2008), as well as some field observation. Altogether, 550 landslides were counted at the whole study area. Among them, 182 landslides are debris flow and each group of landslides was constructed in the inventory map separately. Then, the landslide inventory was randomly selected through Excel; 50% landslide was used for model analysis and the remaining 50% was used for validation purpose. Total 12 contributing factors, such as slope, aspect, curvature, topographic wetness index (TWI), elevation, forest type, forest timber diameter, forest crown density, geology, landuse, soil depth, and soil drainage were used in the analysis. Moreover, to find out the co-relation between landslide causative factors and incidents landslide, pixels were divided into several classes and frequency ratio for individual class was extracted. Eventually, six landslide susceptibility maps were constructed using the Bayesian Predictive Discriminant (BPD), Empirical Likelihood Ratio (ELR), and Linear Regression Method (LRM) models based on different category dada. Finally, in the cross validation process, landslide susceptibility map was plotted with a receiver operating characteristic (ROC) curve and calculated the area under the curve (AUC) and tried to extract success rate curve. The result showed that Bayesian, likelihood and linear models were of 85.52%, 85.23%, and 83.49% accuracy respectively for total data. Subsequently, in the category of debris flow landslide, results are little better compare with total data and its contained 86.33%, 85.53% and 84.17% accuracy. It means all three models were reasonable methods for landslide susceptibility analysis. The models have proved to produce reliable predictions for regional spatial planning or land-use planning.

Estimation of reflectivity-rainfall relationship parameters and uncertainty assessment for high resolution rainfall information (고해상도 강수정보 생산을 위한 레이더 반사도-강수량 관계식 매개변수 보정 및 불확실성 평가)

  • Kim, Tae-Jeong;Kim, Jang-Gyeong;Kim, Jin-Guk;Kwon, Hyun-Han
    • Journal of Korea Water Resources Association
    • /
    • v.54 no.5
    • /
    • pp.321-334
    • /
    • 2021
  • A fixed reflectivity-rainfall relationship approach, such as the Marshall-Palmer relationship, for an entire year and different seasons, can be problematic in cases where the relationship varies spatially and temporally throughout a region. From this perspective, this study explores the use of long-term radar reflectivity for South Korea to obtain a nationwide calibrated Z-R relationship and the associated uncertainties within a Bayesian inference framework. A calibrated spatially structured pattern in the parameters exists, particularly for the wet season and parameter for the dry season. A pronounced region of high values during the wet and dry seasons may be partially associated with storm movements in that season. Overall, the radar rainfall fields based on the proposed modeling procedure are similar to the observed rainfall fields. In contrast, the radar rainfall fields obtained from the existing Marshall-Palmer relationship show a systematic underestimation. In the event of high impact weather, it is expected that the value of national radar resources can be improved by establishing an active watershed-level hydrological analysis system.

Development of Snow Depth Frequency Analysis Model Based on A Generalized Mixture Distribution with Threshold (최심신적설량 빈도분석을 위한 임계값을 가지는 일반화된 혼합분포모형 개발)

  • Kim, Ho Jun;Kim, Jang-Gyeong;Kwon, Hyun-Han
    • Journal of Korean Society of Disaster and Security
    • /
    • v.13 no.4
    • /
    • pp.25-36
    • /
    • 2020
  • An increasing frequency and intensity of natural disasters have been observed due to climate change. To better prepare for these, the MOIS (ministry of the interior and safety) announced a comprehensive plan for minimizing damages associated with natural disasters, including drought and heavy snowfall. The spatial-temporal pattern of snowfall is greatly influenced by temperature and geographical features. Heavy snowfalls are often observed in Gangwon-do, surrounded by mountains, whereas less snowfall is dominant in the southern part of the country due to relatively high temperatures. Thus, snow depth data often contains zeros that can lead to difficulties in the selection of probability distribution and estimation of the parameters. A generalized mixture distribution approach to a maximum snow depth series over the southern part of Korea (i.e., Changwon, Tongyeoung, Jinju weather stations) are located is proposed to better estimate a threshold (𝛿) classifying discrete and continuous distribution parts. The model parameters, including the threshold in the mixture model, are effectively estimated within a Bayesian modeling framework, and the uncertainty associated with the parameters is also provided. Comparing to the Daegwallyeong weather station, It was found that the proposed model is more effective for the regions in which less snow depth is observed.

A Study on the War Simulation and Prediction Using Bayesian Inference (베이지안 추론을 이용한 전쟁 시뮬레이션과 예측 연구)

  • Lee, Seung-Lyong;Yoo, Byung Joo;Youn, Sangyoun;Bang, Sang-Ho;Jung, Jae-Woong
    • The Journal of the Korea Contents Association
    • /
    • v.21 no.11
    • /
    • pp.77-86
    • /
    • 2021
  • A method of constructing a war simulation based on Bayesian Inference was proposed as a method of constructing heterogeneous historical war data obtained with a time difference into a single model. A method of applying a linear regression model can be considered as a method of predicting future battles by analyzing historical war results. However it is not appropriate for two heterogeneous types of historical data that reflect changes in the battlefield environment due to different times to be suitable as a single linear regression model and violation of the model's assumptions. To resolve these problems a Bayesian inference method was proposed to obtain a post-distribution by assuming the data from the previous era as a non-informative prior distribution and to infer the final posterior distribution by using it as a prior distribution to analyze the data obtained from the next era. Another advantage of the Bayesian inference method is that the results sampled by the Markov Chain Monte Carlo method can be used to infer posterior distribution or posterior predictive distribution reflecting uncertainty. In this way, it has the advantage of not only being able to utilize a variety of information rather than analyzing it with a classical linear regression model, but also continuing to update the model by reflecting additional data obtained in the future.

Spatial Analysis for Mean Annual Precipitation Based On Neural Networks (신경망 기법을 이용한 연평균 강우량의 공간 해석)

  • Sin, Hyeon-Seok;Park, Mu-Jong
    • Journal of Korea Water Resources Association
    • /
    • v.32 no.1
    • /
    • pp.3-13
    • /
    • 1999
  • In this study, an alternative spatial analysis method against conventional methods such as Thiessen method, Inverse Distance method, and Kriging method, named Spatial-Analysis Neural-Network (SANN) is presented. It is based on neural network modeling and provides a nonparametric mean estimator and also estimators of high order statistics such as standard deviation and skewness. In addition, it provides a decision-making tool including an estimator of posterior probability that a spatial variable at a given point will belong to various classes representing the severity of the problem of interest and a Bayesian classifier to define the boundaries of subregions belonging to the classes. In this paper, the SANN is implemented to be used for analyzing a mean annual precipitation filed and classifying the field into dry, normal, and wet subregions. For an example, the whole area of South Korea with 39 precipitation sites is applied. Then, several useful results related with the spatial variability of mean annual precipitation on South Korea were obtained such as interpolated field, standard deviation field, and probability maps. In addition, the whole South Korea was classified with dry, normal, and wet regions.

  • PDF

A Study on the Modeling of PoF Estimation for Probabilistic Risk Assessment based on Bayesian Method (확률론적 위험도평가를 위한 베이지안 기반의 파손확률 추정 모델링 연구)

  • Kim, Keun Won;Shin, Dae Han;Choi, Joo-Ho;Shin, KiSu
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.41 no.8
    • /
    • pp.619-624
    • /
    • 2013
  • To predict the probabilistic service life, statistical factors should be included to consider the uncertainty of parameters. Generally the probabilistic analysis is one of the common methods to account the uncertainty of parameters on the structural failure. In order to apply probabilistic analysis on the deterministic life analysis, it would be necessary to introduce Probability of Failure(PoF) and conduct risk assessment. In this work, we have studied probabilistic risk assessment of aircraft structures by using PoF approach. To achieve this goal, the Bayesian method was utilized to model PoF estimation since this method is known as the proper method to express the uncertainty of parameters. A series of proof tests were also conducted in order to verify the result of PoF estimation. The results from this efforts showed that the PoF estimation model can calculate quantitatively the value of PoF. Furthermore effectiveness of risk assessment approach for the aircraft structures was also demonstrated.