• Title/Summary/Keyword: Bayesian probabilistic model

Search Result 125, Processing Time 0.034 seconds

Leave-one-out Bayesian model averaging for probabilistic ensemble forecasting

  • Kim, Yongdai;Kim, Woosung;Ohn, Ilsang;Kim, Young-Oh
    • Communications for Statistical Applications and Methods
    • /
    • v.24 no.1
    • /
    • pp.67-80
    • /
    • 2017
  • Over the last few decades, ensemble forecasts based on global climate models have become an important part of climate forecast due to the ability to reduce uncertainty in prediction. Moreover in ensemble forecast, assessing the prediction uncertainty is as important as estimating the optimal weights, and this is achieved through a probabilistic forecast which is based on the predictive distribution of future climate. The Bayesian model averaging has received much attention as a tool of probabilistic forecasting due to its simplicity and superior prediction. In this paper, we propose a new Bayesian model averaging method for probabilistic ensemble forecasting. The proposed method combines a deterministic ensemble forecast based on a multivariate regression approach with Bayesian model averaging. We demonstrate that the proposed method is better in prediction than the standard Bayesian model averaging approach by analyzing monthly average precipitations and temperatures for ten cities in Korea.

A Robust Bayesian Probabilistic Matrix Factorization Model for Collaborative Filtering Recommender Systems Based on User Anomaly Rating Behavior Detection

  • Yu, Hongtao;Sun, Lijun;Zhang, Fuzhi
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.9
    • /
    • pp.4684-4705
    • /
    • 2019
  • Collaborative filtering recommender systems are vulnerable to shilling attacks in which malicious users may inject biased profiles to promote or demote a particular item being recommended. To tackle this problem, many robust collaborative recommendation methods have been presented. Unfortunately, the robustness of most methods is improved at the expense of prediction accuracy. In this paper, we construct a robust Bayesian probabilistic matrix factorization model for collaborative filtering recommender systems by incorporating the detection of user anomaly rating behaviors. We first detect the anomaly rating behaviors of users by the modified K-means algorithm and target item identification method to generate an indicator matrix of attack users. Then we incorporate the indicator matrix of attack users to construct a robust Bayesian probabilistic matrix factorization model and based on which a robust collaborative recommendation algorithm is devised. The experimental results on the MovieLens and Netflix datasets show that our model can significantly improve the robustness and recommendation accuracy compared with three baseline methods.

Bayesian Model for Probabilistic Unsupervised Learning (확률적 자율 학습을 위한 베이지안 모델)

  • 최준혁;김중배;김대수;임기욱
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.11 no.9
    • /
    • pp.849-854
    • /
    • 2001
  • GTM(Generative Topographic Mapping) model is a probabilistic version of the SOM(Self Organizing Maps) which was proposed by T. Kohonen. The GTM is modelled by latent or hidden variables of probability distribution of data. It is a unique characteristic not implemented in SOM model, and, therefore, it is possible with GTM to analyze data accurately, thereby overcoming the limits of SOM. In the present investigation we proposed a BGTM(Bayesian GTM) combined with Bayesian learning and GTM model that has a small mis-classification ratio. By combining fast calculation ability and probabilistic distribution of data of GTM with correct reasoning based on Bayesian model, the BGTM model provided improved results, compared with existing models.

  • PDF

New stereo matching algorithm based on probabilistic diffusion (확률적 확산을 이용한 스테레오 정합 알고리듬)

  • 이상화;이충웅
    • Journal of the Korean Institute of Telematics and Electronics S
    • /
    • v.35S no.4
    • /
    • pp.105-117
    • /
    • 1998
  • In this paper, the general formula of disparity estimation based on Bayesian Maximum A Posteriori (MAP) algorithm is derived and implemented with simplified probabilistic models. The probabilistic models are independence and similarity among the neighboring disparities in the configuration.The formula is the generalized probabilistic diffusion equation based on Bayesian model, and can be implemented into the some different forms corresponding to the probabilistic models in the disparity neighborhood system or configuration. And, we proposed new probabilistic models in order to simplify the joint probability distribution of disparities in the configuration. According to the experimental results, the proposed algorithm outperformed the other ones, such as sum of swuared difference(SSD) based algorithm and Scharstein's method. We canconclude that the derived formular generalizes the probabilistic diffusion based on Bayesian MAP algorithm for disparity estimation, and the propsoed probabilistic models are reasonable and approximate the pure joint probability distribution very well with decreasing the computations to 0.01% of the generalized formula.

  • PDF

SHM-based probabilistic representation of wind properties: Bayesian inference and model optimization

  • Ye, X.W.;Yuan, L.;Xi, P.S.;Liu, H.
    • Smart Structures and Systems
    • /
    • v.21 no.5
    • /
    • pp.601-609
    • /
    • 2018
  • The estimated probabilistic model of wind data based on the conventional approach may have high discrepancy compared with the true distribution because of the uncertainty caused by the instrument error and limited monitoring data. A sequential quadratic programming (SQP) algorithm-based finite mixture modeling method has been developed in the companion paper and is conducted to formulate the joint probability density function (PDF) of wind speed and direction using the wind monitoring data of the investigated bridge. The established bivariate model of wind speed and direction only represents the features of available wind monitoring data. To characterize the stochastic properties of the wind parameters with the subsequent wind monitoring data, in this study, Bayesian inference approach considering the uncertainty is proposed to update the wind parameters in the bivariate probabilistic model. The slice sampling algorithm of Markov chain Monte Carlo (MCMC) method is applied to establish the multi-dimensional and complex posterior distribution which is analytically intractable. The numerical simulation examples for univariate and bivariate models are carried out to verify the effectiveness of the proposed method. In addition, the proposed Bayesian inference approach is used to update and optimize the parameters in the bivariate model using the wind monitoring data from the investigated bridge. The results indicate that the proposed Bayesian inference approach is feasible and can be employed to predict the bivariate distribution of wind speed and direction with limited monitoring data.

Probabilistic Approach for Predicting Degradation Characteristics of Corrosion Fatigue Crack (환경피로균열 열화특성 예측을 위한 확률론적 접근)

  • Lee, Taehyun;Yoon, Jae Young;Ryu, KyungHa;Park, Jong Won
    • Journal of Applied Reliability
    • /
    • v.18 no.3
    • /
    • pp.271-279
    • /
    • 2018
  • Purpose: Probabilistic safety analysis was performed to enhance the safety and reliability of nuclear power plants because traditional deterministic approach has limitations in predicting the risk of failure by crack growth. The study introduces a probabilistic approach to establish a basis for probabilistic safety assessment of passive components. Methods: For probabilistic modeling of fatigue crack growth rate (FCGR), various FCGR tests were performed either under constant load amplitude or constant ${\Delta}K$ conditions by using heat treated X-750 at low temperature with adequate cathodic polarization. Bayesian inference was employed to update uncertainties of the FCGR model using additional information obtained from constant ${\Delta}K$ tests. Results: Four steps of Bayesian parameter updating were performed using constant ${\Delta}K$ test results. The standard deviation of the final posterior distribution was decreased by a factor of 10 comparing with that of the prior distribution. Conclusion: The method for developing a probabilistic crack growth model has been designed and demonstrated, in the paper. Alloy X-750 has been used for corrosion fatigue crack growth experiments and modeling. The uncertainties of parameters in the FCGR model were successfully reduced using the Bayesian inference whenever the updating was performed.

Bayesian model updating for the corrosion fatigue crack growth rate of Ni-base alloy X-750

  • Yoon, Jae Young;Lee, Tae Hyun;Ryu, Kyung Ha;Kim, Yong Jin;Kim, Sung Hyun;Park, Jong Won
    • Nuclear Engineering and Technology
    • /
    • v.53 no.1
    • /
    • pp.304-313
    • /
    • 2021
  • Nickel base Alloy X-750, which is used as fastener parts in light-water reactor (LWR), has experienced many failures by environmentally assisted cracking (EAC). In order to improve the reliability of passive components for nuclear power plants (NPP's), it is necessary to study the failure mechanism and to predict crack growth behavior by developing a probabilistic failure model. In this study, The Bayesian inference was employed to reduce the uncertainties contained in EAC modeling parameters that have been established from experiments with Alloy X-750. Corrosion fatigue crack growth rate model (FCGR) was developed by fitting into Paris' Law of measured data from the several fatigue tests conducted either in constant load or constant ΔK mode. These parameters characterizing the corrosion fatigue crack growth behavior of X-750 were successfully updated to reduce the uncertainty in the model by using the Bayesian inference method. It is demonstrated that probabilistic failure models for passive components can be developed by updating a laboratory model with field-inspection data, when crack growth rates (CGRs) are low and multiple inspections can be made prior to the component failure.

Bayesian demand model based seismic vulnerability assessment of a concrete girder bridge

  • Bayat, M.;Kia, M.;Soltangharaei, V.;Ahmadi, H.R.;Ziehl, P.
    • Advances in concrete construction
    • /
    • v.9 no.4
    • /
    • pp.337-343
    • /
    • 2020
  • In the present study, by employing fragility analysis, the seismic vulnerability of a concrete girder bridge, one of the most common existing structural bridge systems, has been performed. To this end, drift demand model as a fundamental ingredient of any probabilistic decision-making analyses is initially developed in terms of the two most common intensity measures, i.e., PGA and Sa (T1). Developing a probabilistic demand model requires a reliable database that is established in this paper by performing incremental dynamic analysis (IDA) under a set of 20 ground motion records. Next, by employing Bayesian statistical inference drift demand models are developed based on pre-collapse data obtained from IDA. Then, the accuracy and reasonability of the developed models are investigated by plotting diagnosis graphs. This graphical analysis demonstrates probabilistic demand model developed in terms of PGA is more reliable. Afterward, fragility curves according to PGA based-demand model are developed.

PROBABILISTIC MEASUREMENT OF RISK ASSOCIATED WITH INITIAL COST ESTIMATES

  • Seokyon Hwang
    • International conference on construction engineering and project management
    • /
    • 2013.01a
    • /
    • pp.488-493
    • /
    • 2013
  • Accurate initial cost estimates are essential to effective management of construction projects where many decisions are made in the course of project management by referencing the estimates. In practice, the initial estimates are frequently derived from historical actual cost data, for which standard distribution-based techniques are widely applied in the construction industry to account for risk associated with the estimates. This approach assumes the same probability distribution of estimate errors for any selected estimates. This assumption, however, is not always satisfied. In order to account for the probabilistic nature of estimate errors, an alternative method for measuring the risk associated with a selected initial estimate is developed by applying the Bayesian probability approach. An application example include demonstrates how the method is implemented. A hypothesis test is conducted to reveal the robustness of the Bayesian probability model. The method is envisioned to effectively complement cost estimating methods that are currently in use by providing benefits as follows: (1) it effectively accounts for the probabilistic nature of errors in estimates; (2) it is easy to implement by using historical estimates and actual costs that are readily available in most construction companies; and (3) it minimizes subjective judgment by using quantitative data only.

  • PDF

A Probabilistic Tracking Mechanism for Luxury Purchase Implemented by Hidden Markov Model, Bayesian Inference, Customer Satisfaction and Net Promoter Score (고객만족, NPS, Bayesian Inference 및 Hidden Markov Model로 구현하는 명품구매에 관한 확률적 추적 메카니즘)

  • Hwang, Sun Ju;Rhee, Jung Soo
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.23 no.6
    • /
    • pp.79-94
    • /
    • 2018
  • The purpose of this study is to specify a probabilistic tracking mechanism for customer luxury purchase implemented by hidden Markov model, Bayesian inference, customer satisfaction and net promoter score. In this paper, we have designed a probabilistic model based on customer's actual data containing purchase or non-purchase states by tracking the SPC chain : customer satisfaction -> customer referral -> purchase/non-purchase. By applying hidden Markov model and Viterbi algorithm to marketing theory, we have developed the statistical model related to probability theories and have found the best purchase pattern scenario from customer's purchase records.