• Title/Summary/Keyword: ensemble prediction

Search Result 368, Processing Time 0.025 seconds

Development and Evaluation of the High Resolution Limited Area Ensemble Prediction System in the Korea Meteorological Administration (기상청 고해상도 국지 앙상블 예측 시스템 구축 및 성능 검증)

  • Kim, SeHyun;Kim, Hyun Mee;Kay, Jun Kyung;Lee, Seung-Woo
    • Atmosphere
    • /
    • v.25 no.1
    • /
    • pp.67-83
    • /
    • 2015
  • Predicting the location and intensity of precipitation still remains a main issue in numerical weather prediction (NWP). Resolution is a very important component of precipitation forecasts in NWP. Compared with a lower resolution model, a higher resolution model can predict small scale (i.e., storm scale) precipitation and depict convection structures more precisely. In addition, an ensemble technique can be used to improve the precipitation forecast because it can estimate uncertainties associated with forecasts. Therefore, NWP using both a higher resolution model and ensemble technique is expected to represent inherent uncertainties of convective scale motion better and lead to improved forecasts. In this study, the limited area ensemble prediction system for the convective-scale (i.e., high resolution) operational Unified Model (UM) in Korea Meteorological Administration (KMA) was developed and evaluated for the ensemble forecasts during August 2012. The model domain covers the limited area over the Korean Peninsula. The high resolution limited area ensemble prediction system developed showed good skill in predicting precipitation, wind, and temperature at the surface as well as meteorological variables at 500 and 850 hPa. To investigate which combination of horizontal resolution and ensemble member is most skillful, the system was run with three different horizontal resolutions (1.5, 2, and 3 km) and ensemble members (8, 12, and 16), and the forecasts from the experiments were evaluated. To assess the quantitative precipitation forecast (QPF) skill of the system, the precipitation forecasts for two heavy rainfall cases during the study period were analyzed using the Fractions Skill Score (FSS) and Probability Matching (PM) method. The PM method was effective in representing the intensity of precipitation and the FSS was effective in verifying the precipitation forecast for the high resolution limited area ensemble prediction system in KMA.

Improving Bagging Predictors

  • Kim, Hyun-Joong;Chung, Dong-Jun
    • Proceedings of the Korean Statistical Society Conference
    • /
    • 2005.11a
    • /
    • pp.141-146
    • /
    • 2005
  • Ensemble method has been known as one of the most powerful classification tools that can improve prediction accuracy. Ensemble method also has been understood as ‘perturb and combine’ strategy. Many studies have tried to develop ensemble methods by improving perturbation. In this paper, we propose two new ensemble methods that improve combining, based on the idea of pattern matching. In the experiment with simulation data and with real dataset, the proposed ensemble methods peformed better than bagging. The proposed ensemble methods give the most accurate prediction when the pruned tree was used as the base learner.

  • PDF

Development & Evaluation of Real-time Ensemble Drought Prediction System (실시간 앙상블 가뭄전망정보 생산 체계 구축 및 평가)

  • Bae, Deg-Hyo;Ahn, Joong-Bae;Kim, Hyun-Kyung;Kim, Heon-Ae;Son, Kyung-Hwan;Cho, Se-Ra;Jung, Ui-Seok
    • Atmosphere
    • /
    • v.23 no.1
    • /
    • pp.113-121
    • /
    • 2013
  • The objective of this study is to develop and evaluate the system to produce the real-time ensemble drought prediction data. Ensemble drought prediction consists of 3 processes (meteorological outlook using the multi-initial conditions, hydrological analysis and drought index calculation) therefore, more processing time and data is required than that of single member. For ensemble drought prediction, data process time is optimized and hardware of existing system is upgraded. Ensemble drought data is estimated for year 2012 and to evaluate the accuracy of drought prediction data by using ROC (Relative Operating Characteristics) analysis. We obtained 5 ensembles as optimal number and predicted drought condition for every tenth day i.e. 5th, 15th and 25th of each month. The drought indices used are SPI (Standard Precipitation Index), SRI (Standard Runoff Index), SSI (Standard Soil moisture Index). Drought conditions were determined based on results obtained for each ensemble member. Overall the results showed higher accuracy using ensemble members as compared to single. The ROC score of SRI and SSI showed significant improvement in drought period however SPI was higher in the demise period. The proposed ensemble drought prediction system can be contributed to drought forecasting techniques in Korea.

Leave-one-out Bayesian model averaging for probabilistic ensemble forecasting

  • Kim, Yongdai;Kim, Woosung;Ohn, Ilsang;Kim, Young-Oh
    • Communications for Statistical Applications and Methods
    • /
    • v.24 no.1
    • /
    • pp.67-80
    • /
    • 2017
  • Over the last few decades, ensemble forecasts based on global climate models have become an important part of climate forecast due to the ability to reduce uncertainty in prediction. Moreover in ensemble forecast, assessing the prediction uncertainty is as important as estimating the optimal weights, and this is achieved through a probabilistic forecast which is based on the predictive distribution of future climate. The Bayesian model averaging has received much attention as a tool of probabilistic forecasting due to its simplicity and superior prediction. In this paper, we propose a new Bayesian model averaging method for probabilistic ensemble forecasting. The proposed method combines a deterministic ensemble forecast based on a multivariate regression approach with Bayesian model averaging. We demonstrate that the proposed method is better in prediction than the standard Bayesian model averaging approach by analyzing monthly average precipitations and temperatures for ten cities in Korea.

A comparative assessment of bagging ensemble models for modeling concrete slump flow

  • Aydogmus, Hacer Yumurtaci;Erdal, Halil Ibrahim;Karakurt, Onur;Namli, Ersin;Turkan, Yusuf S.;Erdal, Hamit
    • Computers and Concrete
    • /
    • v.16 no.5
    • /
    • pp.741-757
    • /
    • 2015
  • In the last decade, several modeling approaches have been proposed and applied to estimate the high-performance concrete (HPC) slump flow. While HPC is a highly complex material, modeling its behavior is a very difficult issue. Thus, the selection and application of proper modeling methods remain therefore a crucial task. Like many other applications, HPC slump flow prediction suffers from noise which negatively affects the prediction accuracy and increases the variance. In the recent years, ensemble learning methods have introduced to optimize the prediction accuracy and reduce the prediction error. This study investigates the potential usage of bagging (Bag), which is among the most popular ensemble learning methods, in building ensemble models. Four well-known artificial intelligence models (i.e., classification and regression trees CART, support vector machines SVM, multilayer perceptron MLP and radial basis function neural networks RBF) are deployed as base learner. As a result of this study, bagging ensemble models (i.e., Bag-SVM, Bag-RT, Bag-MLP and Bag-RBF) are found superior to their base learners (i.e., SVM, CART, MLP and RBF) and bagging could noticeable optimize prediction accuracy and reduce the prediction error of proposed predictive models.

Uncertainty assessment of ensemble streamflow prediction method (앙상블 유량예측기법의 불확실성 평가)

  • Kim, Seon-Ho;Kang, Shin-Uk;Bae, Deg-Hyo
    • Journal of Korea Water Resources Association
    • /
    • v.51 no.6
    • /
    • pp.523-533
    • /
    • 2018
  • The objective of this study is to analyze uncertainties of ensemble-based streamflow prediction method for model parameters and input data. ESP (Ensemble Streamflow Prediction) and BAYES-ESP (Bayesian-ESP) based on ABCD rainfall-runoff model were selected as streamflow prediction method. GLUE (Generalized Likelihood Uncertainty Estimation) was applied for the analysis of parameter uncertainty. The analysis of input uncertainty was performed according to the duration of meteorological scenarios for ESP. The result showed that parameter uncertainty was much more significant than input uncertainty for the ensemble-based streamflow prediction. It also indicated that the duration of observed meteorological data was appropriate to using more than 20 years. And the BAYES-ESP was effective to reduce uncertainty of ESP method. It is concluded that this analysis is meaningful for elaborating characteristics of ESP method and error factors of ensemble-based streamflow prediction method.

Representation of Model Uncertainty in the Short-Range Ensemble Prediction for Typhoon Rusa (2002) (단기 앙상블 예보에서 모형의 불확실성 표현: 태풍 루사)

  • Kim, Sena;Lim, Gyu-Ho
    • Atmosphere
    • /
    • v.25 no.1
    • /
    • pp.1-18
    • /
    • 2015
  • The most objective way to overcome the limitation of numerical weather prediction model is to represent the uncertainty of prediction by introducing probabilistic forecast. The uncertainty of the numerical weather prediction system developed due to the parameterization of unresolved scale motions and the energy losses from the sub-scale physical processes. In this study, we focused on the growth of model errors. We performed ensemble forecast to represent model uncertainty. By employing the multi-physics scheme (PHYS) and the stochastic kinetic energy backscatter scheme (SKEBS) in simulating typhoon Rusa (2002), we assessed the performance level of the two schemes. The both schemes produced better results than the control run did in the ensemble mean forecast of the track. The results using PHYS improved by 28% and those based on SKEBS did by 7%. Both of the ensemble mean errors of the both schemes increased rapidly at the forecast time 84 hrs. The both ensemble spreads increased gradually during integration. The results based on SKEBS represented model errors very well during the forecast time of 96 hrs. After the period, it produced an under-dispersive pattern. The simulation based on PHYS overestimated the ensemble mean error during integration and represented the real situation well at the forecast time of 120 hrs. The displacement speed of the typhoon based on PHYS was closest to the best track, especially after landfall. In the sensitivity tests of the model uncertainty of SKEBS, ensemble mean forecast was sensitive to the physics parameterization. By adjusting the forcing parameter of SKEBS, the default experiment improved in the ensemble spread, ensemble mean errors, and moving speed.

Development of the Expert Seasonal Prediction System: an Application for the Seasonal Outlook in Korea

  • Kim, WonMoo;Yeo, Sae-Rim;Kim, Yoojin
    • Asia-Pacific Journal of Atmospheric Sciences
    • /
    • v.54 no.4
    • /
    • pp.563-573
    • /
    • 2018
  • An Expert Seasonal Prediction System for operational Seasonal Outlook (ESPreSSO) is developed based on the APEC Climate Center (APCC) Multi-Model Ensemble (MME) dynamical prediction and expert-guided statistical downscaling techniques. Dynamical models have improved to provide meaningful seasonal prediction, and their prediction skills are further improved by various ensemble and downscaling techniques. However, experienced scientists and forecasters make subjective correction for the operational seasonal outlook due to limited prediction skills and biases of dynamical models. Here, a hybrid seasonal prediction system that grafts experts' knowledge and understanding onto dynamical MME prediction is developed to guide operational seasonal outlook in Korea. The basis dynamical prediction is based on the APCC MME, which are statistically mapped onto the station-based observations by experienced experts. Their subjective selection undergoes objective screening and quality control to generate final seasonal outlook products after physical ensemble averaging. The prediction system is constructed based on 23-year training period of 1983-2005, and its performance and stability are assessed for the independent 11-year prediction period of 2006-2016. The results show that the ESPreSSO has reliable and stable prediction skill suitable for operational use.

Evaluation of PNU CGCM Ensemble Forecast System for Boreal Winter Temperature over South Korea (PNU CGCM 앙상블 예보 시스템의 겨울철 남한 기온 예측 성능 평가)

  • Ahn, Joong-Bae;Lee, Joonlee;Jo, Sera
    • Atmosphere
    • /
    • v.28 no.4
    • /
    • pp.509-520
    • /
    • 2018
  • The performance of the newly designed Pusan National University Coupled General Circulation Model (PNU CGCM) Ensemble Forecast System which produce 40 ensemble members for 12-month lead prediction is evaluated and analyzed in terms of boreal winter temperature over South Korea (S. Korea). The influence of ensemble size on prediction skill is examined with 40 ensemble members and the result shows that spreads of predictability are larger when the size of ensemble member is smaller. Moreover, it is suggested that more than 20 ensemble members are required for better prediction of statistically significant inter-annual variability of wintertime temperature over S. Korea. As for the ensemble average (ENS), it shows superior forecast skill compared to each ensemble member and has significant temporal correlation with Automated Surface Observing System (ASOS) temperature at 99% confidence level. In addition to forecast skill for inter-annual variability of wintertime temperature over S. Korea, winter climatology around East Asia and synoptic characteristics of warm (above normal) and cold (below normal) winters are reasonably captured by PNU CGCM. For the categorical forecast with $3{\times}3$ contingency table, the deterministic forecast generally shows better performance than probabilistic forecast except for warm winter (hit rate of probabilistic forecast: 71%). It is also found that, in case of concentrated distribution of 40 ensemble members to one category out of the three, the probabilistic forecast tends to have relatively high predictability. Meanwhile, in the case when the ensemble members distribute evenly throughout the categories, the predictability becomes lower in the probabilistic forecast.

Developing an Ensemble Classifier for Bankruptcy Prediction (부도 예측을 위한 앙상블 분류기 개발)

  • Min, Sung-Hwan
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.17 no.7
    • /
    • pp.139-148
    • /
    • 2012
  • An ensemble of classifiers is to employ a set of individually trained classifiers and combine their predictions. It has been found that in most cases the ensembles produce more accurate predictions than the base classifiers. Combining outputs from multiple classifiers, known as ensemble learning, is one of the standard and most important techniques for improving classification accuracy in machine learning. An ensemble of classifiers is efficient only if the individual classifiers make decisions as diverse as possible. Bagging is the most popular method of ensemble learning to generate a diverse set of classifiers. Diversity in bagging is obtained by using different training sets. The different training data subsets are randomly drawn with replacement from the entire training dataset. The random subspace method is an ensemble construction technique using different attribute subsets. In the random subspace, the training dataset is also modified as in bagging. However, this modification is performed in the feature space. Bagging and random subspace are quite well known and popular ensemble algorithms. However, few studies have dealt with the integration of bagging and random subspace using SVM Classifiers, though there is a great potential for useful applications in this area. The focus of this paper is to propose methods for improving SVM performance using hybrid ensemble strategy for bankruptcy prediction. This paper applies the proposed ensemble model to the bankruptcy prediction problem using a real data set from Korean companies.