• Title/Summary/Keyword: forecast performance

Search Result 511, Processing Time 0.023 seconds

The Performance Assessment of Special Observation Program (ProbeX-2009) and the Analysis on the Characteristics of Precipitation at the Ulleungdo (울릉도 특별관측 수행평가 및 강수특성 분석)

  • Kim, Ki-Hoon;Kim, Yeon-Hee;Kim, Do-Woo;Chang, Dong-Eon
    • Atmosphere
    • /
    • v.21 no.2
    • /
    • pp.185-196
    • /
    • 2011
  • The performance assessment in radiosonde observation on the special observation program (ProbeX-2009) is performed and the characteristics of precipitation using Auto Weather System (AWS) and radiosonde data in 2009 at the Ulleungdo are investigated. The launching time, observation time, and maximum altitude of radiosonde are satisfied with the regulation from Korea Meteorological Administration (KMA) and World Meteorological Organization (WMO) but the duration of observational time of radiosonde is much shorter than that of the ProbeX-2007 because the altitude of launching site is higher than others in 2007. From the analysis of trajectories of radiosonde, most radiosondes at the Ulleungdo tend to move into the east because the westerly prevail at the middle latitude. However, when the Okhotsk high is expanded to the Korean peninsula and the north-westerly winds strengthen over the East Sea as the subtropical high is retreated, radiosonde tends to move into the south-west and south-east, respectively. Maximum distance appears at the end of observation level before May but the level of maximum distance is changed into 100 hPa after June because the prevailing wind direction is reversed from westerly to easterly at the stratosphere during summer time. The condition of precipitation was more correlated with the dynamic instability except Changma season. Precipitation in 2009 at the Ulleungdo occurred under the marine climate so that total precipitation amounts and precipitation intensity were increased and intensified during nighttime. The local environment favorable for the precipitation during nighttime was while the wind speed at the surface and the inflow from the shoreline were strengthened. Precipitation events also affected by synoptic condition but the localized effect induced by topography was more strengthened at the northern part of Ulleungdo.

Validations of Typhoon Intensity Guidance Models in the Western North Pacific (북서태평양 태풍 강도 가이던스 모델 성능평가)

  • Oh, You-Jung;Moon, Il-Ju;Kim, Sung-Hun;Lee, Woojeong;Kang, KiRyong
    • Atmosphere
    • /
    • v.26 no.1
    • /
    • pp.1-18
    • /
    • 2016
  • Eleven Tropical Cyclone (TC) intensity guidance models in the western North Pacific have been validated over 2008~2014 based on various analysis methods according to the lead time of forecast, year, month, intensity, rapid intensity change, track, and geographical area with an additional focus on TCs that influenced the Korean peninsula. From the evaluation using mean absolute error and correlation coefficients for maximum wind speed forecasts up to 72 h, we found that the Hurricane Weather Research and Forecasting model (HWRF) outperforms all others overall although the Global Forecast System (GFS), the Typhoon Ensemble Prediction System of Japan Meteorological Agency (TEPS), and the Korean version of Weather and Weather Research and Forecasting model (KWRF) also shows a good performance in some lead times of forecast. In particular, HWRF shows the highest performance in predicting the intensity of strong TCs above Category 3, which may be attributed to its highest spatial resolution (~3 km). The Navy Operational Global Prediction Model (NOGAPS) and GFS were the most improved model during 2008~2014. For initial intensity error, two Japanese models, Japan Meteorological Agency Global Spectral Model (JGSM) and TEPS, had the smallest error. In track forecast, the European Centre for Medium-Range Weather Forecasts (ECMWF) and recent GFS model outperformed others. The present results has significant implications for providing basic information for operational forecasters as well as developing ensemble or consensus prediction systems.

A New Metric for Evaluation of Forecasting Methods : Weighted Absolute and Cumulative Forecast Error (수요 예측 평가를 위한 가중절대누적오차지표의 개발)

  • Choi, Dea-Il;Ok, Chang-Soo
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.38 no.3
    • /
    • pp.159-168
    • /
    • 2015
  • Aggregate Production Planning determines levels of production, human resources, inventory to maximize company's profits and fulfill customer's demands based on demand forecasts. Since performance of aggregate production planning heavily depends on accuracy of given forecasting demands, choosing an accurate forecasting method should be antecedent for achieving a good aggregate production planning. Generally, typical forecasting error metrics such as MSE (Mean Squared Error), MAD (Mean Absolute Deviation), MAPE (Mean Absolute Percentage Error), and CFE (Cumulated Forecast Error) are utilized to choose a proper forecasting method for an aggregate production planning. However, these metrics are designed only to measure a difference between real and forecast demands and they are not able to consider any results such as increasing cost or decreasing profit caused by forecasting error. Consequently, the traditional metrics fail to give enough explanation to select a good forecasting method in aggregate production planning. To overcome this limitation of typical metrics for forecasting method this study suggests a new metric, WACFE (Weighted Absolute and Cumulative Forecast Error), to evaluate forecasting methods. Basically, the WACFE is designed to consider not only forecasting errors but also costs which the errors might cause in for Aggregate Production Planning. The WACFE is a product sum of cumulative forecasting error and weight factors for backorder and inventory costs. We demonstrate the effectiveness of the proposed metric by conducting intensive experiments with demand data sets from M3-competition. Finally, we showed that the WACFE provides a higher correlation with the total cost than other metrics and, consequently, is a better performance in selection of forecasting methods for aggregate production planning.

Assessment of Performance on the Asian Dust Generation in Spring Using Hindcast Data in Asian Dust Seasonal Forecasting Model (황사장기예측자료를 이용한 봄철 황사 발생 예측 특성 분석)

  • Kang, Misun;Lee, Woojeong;Chang, Pil-Hun;Kim, Mi-Gyeong;Boo, Kyung-On
    • Atmosphere
    • /
    • v.32 no.2
    • /
    • pp.149-162
    • /
    • 2022
  • This study investigated the prediction skill of the Asian dust seasonal forecasting model (GloSea5-ADAM) on the Asian dust and meteorological variables related to the dust generation for the period of 1991~2016. Additionally, we evaluated the prediction skill of those variables depending on the combination of the initial dates in the sub-seasonal scale for the dust source region affecting South Korea. The Asian dust and meteorological variables (10 m wind speed, 1.5 m relative humidity, and 1.5 m air temperature) from GloSea5-ADAM were compared to that from Synoptic observation and European Centre for medium range weather forecasts reanalysis v5, respectively, based on Mean Bias Error (MBE), Root Mean Square Error (RMSE), and Anomaly Correlation Coefficient (ACC) as evaluation criteria. In general, the Asian dust and meteorological variables in the source region showed high ACC in the prediction scale within one month. For all variables, the use of the initial dates closest to the prediction month led to the best performances based on MBE, RMSE, and ACC, and the performances could be improved by adjusting the number of ensembles considering the combination of the initial date. ACC was as high as 0.4 in Spring when using the closest two initial dates. In particular, the GloSea5-ADAM shows the best performance of Asian dust generation with an ACC of 0.60 in the occurrence frequency of Asian dust in March when using the closest initial dates for initial conditions.

Comparative Analysis of Forecasting Accuracy and Model Performance for Development of Coastal Wave Forecasting System Based on Unstructured Grid (비정형격자 기반 국지연안 파랑예측시스템 구축을 위한 예측정확도 및 모델성능 비교분석)

  • Min, Roh;Sang Myeong, Oh;Pil-Hun, Chang;Hyun-Suk, Kang;Hyung Suk, Kim
    • Journal of Korean Society of Coastal and Ocean Engineers
    • /
    • v.34 no.6
    • /
    • pp.188-197
    • /
    • 2022
  • We develop a coastal wave forecasting system by using the unstructured grid based on sea wind data of Global Data Assimilation and Prediction System. The verification is performed to examine the performance and accuracy of the wave model. Since the conventional grid has limited wave forecasting on complex coastlines and bathymetry, the unstructured grid system is applied for precise numerical simulation, and applicability for operational support is evaluated. Both grid systems show similar prediction trends in offshore and coastal areas, and the difference in prediction errors according to the grid system is not large. In addition, the applicability of the operational wave forecasting system is confirmed by dramatically reducing the model execution time of the unstructured grid under the same conditions.

Comparison of forecasting performance of time series models for the wholesale price of dried red peppers: focused on ARX and EGARCH

  • Lee, Hyungyoug;Hong, Seungjee;Yeo, Minsu
    • Korean Journal of Agricultural Science
    • /
    • v.45 no.4
    • /
    • pp.859-870
    • /
    • 2018
  • Dried red peppers are a staple agricultural product used in Korean cuisine and as such, are an important aspect of agricultural producers' income. Correctly forecasting both their supply and demand situations and price is very important in terms of the producers' income and consumer price stability. The primary objective of this study was to compare the performance of time series forecasting models for dried red peppers in Korea. In this study, three models (an autoregressive model with exogenous variables [ARX], AR-exponential generalized autoregressive conditional heteroscedasticity [EGARCH], and ARX-EGARCH) are presented for forecasting the wholesale price of dried red peppers. As a result of the analysis, it was shown that the ARX model and ARX-EGARCH model, each of which adopt both the rolling window and the adding approach and use the agricultural cooperatives price as the exogenous variable, showed a better forecasting performance compared to the autoregressive model (AR)-EGARCH model. Based on the estimation methods and results, there was no significant difference in the accuracy of the estimation between the rolling window and adding approach. In the case of dried red peppers, there is limitation in building the price forecasting models with a market-structured approach. In this regard, estimating a forecasting model using only price data and identifying the forecast performance can be expected to complement the current pricing forecast model which relies on market shipments.

Evaluation of Travel Time Prediction Reliability on Highway Using DSRC Data (DSRC 기반 고속도로 통행 소요시간 예측정보 신뢰성 평가)

  • Han, Daechul;Kim, Joohyon;Kim, Seoungbum
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.17 no.4
    • /
    • pp.86-98
    • /
    • 2018
  • Since 2015, the Korea Expressway Corporation has provided predicted travel time information, which is reproduced from DSRC systems over the extended expressway network in Korea. When it is open for public information, it helps travelers decide optimal routes while minimizing traffic congestions and travel cost. Although, sutiable evaluations to investigate the reliability of travel time forecast information have not been conducted so far. First of all, this study seeks to find out a measure of effectiveness to evaluate the reliability of travel time forecast via various literatures. Secondly, using the performance measurement, this study evaluates concurrent travel time forecast information in highway quantitatively and examines the forecast error by exploratory data analysis. It appears that most of highway lines provided reliable forecast information. However, we found significant over/under-forecast on a few links within several long lines and it turns out that such minor errors reduce overall reliability in travel time forecast of the corresponding highway lines. This study would help to build a priority for quality control of the travel time forecast information system, and highlight the importance of performing periodic and sustainable management for travel time forecast information.

Improvement of PM10 Forecasting Performance using Membership Function and DNN (멤버십 함수와 DNN을 이용한 PM10 예보 성능의 향상)

  • Yu, Suk Hyun;Jeon, Young Tae;Kwon, Hee Yong
    • Journal of Korea Multimedia Society
    • /
    • v.22 no.9
    • /
    • pp.1069-1079
    • /
    • 2019
  • In this study, we developed a $PM_{10}$ forecasting model using DNN and Membership Function, and improved the forecasting performance. The model predicts the $PM_{10}$ concentrations of the next 3 days in the Seoul area by using the weather and air quality observation data and forecast data. The best model(RM14)'s accuracy (82%, 76%, 69%) and false alarm rate(FAR:14%,33%,44%) are good. Probability of detection (POD: 79%, 50%, 53%), however, are not good performance. These are due to the lack of training data for high concentration $PM_{10}$ compared to low concentration. In addition, the model dose not reflect seasonal factors closely related to the generation of high concentration $PM_{10}$. To improve this, we propose Julian date membership function as inputs of the $PM_{10}$ forecasting model. The function express a given date in 12 factors to reflect seasonal characteristics closely related to high concentration $PM_{10}$. As a result, the accuracy (79%, 70%, 66%) and FAR (24%, 48%, 46%) are slightly reduced in performance, but the POD (79%, 75%, 71%) are up to 25% improved compared with those of the RM14 model. Hence, this shows that the proposed Julian forecast model is effective for high concentration $PM_{10}$ forecasts.

Impact of Snow Depth Initialization on Seasonal Prediction of Surface Air Temperature over East Asia for Winter Season (겨울철 동아시아 지역 기온의 계절 예측에 눈깊이 초기화가 미치는 영향)

  • Woo, Sung-Ho;Jeong, Jee-Hoon;Kim, Baek-Min;Kim, Seong-Joong
    • Atmosphere
    • /
    • v.22 no.1
    • /
    • pp.117-128
    • /
    • 2012
  • Does snow depth initialization have a quantitative impact on sub-seasonal to seasonal prediction skill? To answer this question, a snow depth initialization technique for seasonal forecast system has been implemented and the impact of the initialization on the seasonal forecast of surface air temperature during the wintertime is examined. Since the snow depth observation can not be directly used in the model simulation due to the large systematic bias and much smaller model variability, an anomaly rescaling method to the snow depth initialization is applied. Snow depth in the model is initialized by adding a rescaled snow depth observation anomaly to the model snow depth climatology. A suite of seasonal forecast is performed for each year in recent 12 years (1999-2010) with and without the snow depth initialization to evaluate the performance of the developed technique. The results show that the seasonal forecast of surface air temperature over East Asian region sensitively depends on the initial snow depth anomaly over the region. However, the sensitivity shows large differences for different timing of the initialization and forecast lead time. Especially, the snow depth anomaly initialized in the late winter (Mar. 1) is the most effective in modulating the surface air temperature anomaly after one month. The real predictability gained by the snow depth initialization is also examined from the comparison with observation. The gain of the real predictability is generally small except for the forecasting experiment in the early winter (Nov. 1), which shows some skillful forecasts. Implications of these results and future directions for further development are discussed.

Dual Doppler Wind Retrieval Using a Three-dimensional Variational Method (3차원 변분법을 사용한 이중 도플러 바람장 분석)

  • Lee, SeonYong;Choi, Young-Jean;Chan, Dong-Eon
    • Atmosphere
    • /
    • v.17 no.1
    • /
    • pp.69-86
    • /
    • 2007
  • The characteristics of the dual-Doppler wind retrieval method based on a three dimensional variational (3DVAR) conception were investigated from the following four points of view; the sensitivity of the number of iteration, the effect of the weak constraint term, the effect of the smoothness term, and the sensitivity of the error mixing ratio of the radial velocities. In the experiment, the radial velocities relative to the Gosan and Jindo radar sites of the Korea Meteorological Administration (KMA) were calculated from the forecasting of the WRF (Weather Research and Forecast; Skamarock, 2004) model at 1330 UTC 30 June 2006, which is the one and half hour forecast from the initial time, 1200 UTC on that day. The results showed that the retrieval performance of the horizontal wind field was robust, but that of the vertical wind was sensitive to the external conditions, such as iteration number and the on/off of the weak constraint term. The sensitivity of error mixing ratio was so large that even the horizontal wind retrieval efficiency was reduced a lot. But the sensitivity of the smooth term was not so large. When we applied this method to the real mesoscale convective system (MCS) between the Gosan and Jindo radar pair at 1430 UTC 30 June 2006, the wind structure of the convective cells in the MCS was consistently retrieved relative to the reflectivity factor structure. By comparing the vertical wind structure of this case with that of 10 minutes after, 1440 UTC 30 June 2006, we got the physical consistency of our method.