• Title/Summary/Keyword: Mean Absolute Relative Error

Search Result 75, Processing Time 0.024 seconds

A Study on the Assessment of Right-tail Prediction Ability of Extreme Distributions using Simulation Experiment (모의 실험을 이용한 Right-tail quantiles의 극치 분포형 비교 평가에 관한 연구)

  • Jung, Jinseok;Kim, Taereem;Song, Hyun-Keun;Heo, Jun-Haeng
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2016.05a
    • /
    • pp.158-158
    • /
    • 2016
  • 본 연구에서는 극치 분포의 오른쪽 꼬리 부분 예측 시 안정적인 확률수문량 산정하는 확률분포형과 매개변수 추정 방법을 평가하기 위해 Monte Carlo 모의를 수행하였다. 수문자료의 빈도해석에 적합한 것으로 알려진 generalized extreme value (GEV), Gumbel (GUM), generalized logistic (GLO), gamma3 (GAM3), normal (NOR), log-normal3 (LN3) 총 6개의 확률분포형을 바탕으로 오른쪽 꼬리 부분의 확률수문량 추정 성능을 모의 실험을 통해 평가하고자 한다. 30년 이상 자료를 보유한 기상청 지점의 지속기간별 연최대값 자료를 분석한 결과를 바탕으로 모분포를 GEV분포로 선정하였으며 평균이 1.0, 표준편차 0.5, 왜곡도 계수는 0.5, 1.0, 2.0, 3.0, 4.0이 되도록 가정하였다. 또한 자료 길이에 따른 성능 평가를 위해 표본 크기 20, 50, 100, 150, 200개에 대해 분석을 수행하였다. 위와 같은 가정으로 총 25종류(왜곡도계수 5개 ${\times}$ 표본 크기 5개)의 발생된 모분포에 6가지의 확률분포형과 3가지의 매개변수 추정방법(모멘트법, 최우도법, 확률가중모멘트법)을 조합한 18가지의 모델을 비교 분석해보았다. 평가방법으로는 평균 제곱근 오차(Root Mean Square Error, RMSE), 편의(bias), 평균 상대오차(Mean Relative Difference, MRD), 평균 절대 상대오차(Mean Absolute Relative Difference, MARD)를 사용하여 적용 모델의 성능을 비교 분석하였다.

  • PDF

A comparison of neural networks to ols regression in process/quality control applications

  • Nam, Kyungdoo;Sanford, Clive C.;Jayakumar, Maliyakal D.
    • Korean Management Science Review
    • /
    • v.11 no.2
    • /
    • pp.133-146
    • /
    • 1994
  • This study compares the performance of neural networks and ordinary least squares regression with quality-control processes. We examine the applicability of neural networks because they do not require any assumptions regarding either the functional from of the underlying process or the distribution of errors. The coefficient of determination($R^2$), mean absolute deviation(MAD), and the mean squared error(MSE) metrics indicate that neural networks are a viable and can be a superior technique. We also demonstrate that an assessment of the magnitude of the neural notwork input layer cumulative weights can be used to determine the relative importance of predictor variables.

  • PDF

Evaluation of UM-LDAPS Prediction Model for Daily Ahead Forecast of Solar Power Generation (태양광 발전 예보를 위한 UM-LDAPS 예보 모형 성능평가)

  • Kim, Chang Ki;Kim, Hyun-Goo;Kang, Yong-Heack;Yun, Chang-Yeol
    • Journal of the Korean Solar Energy Society
    • /
    • v.39 no.2
    • /
    • pp.71-80
    • /
    • 2019
  • Daily ahead forecast is necessary for the electricity balance between load and supply due to the variability renewable energy. Numerical weather prediction is usually employed to produce the solar irradiance as well as electric power forecast for more than 12 hours forecast horizon. UM-LDAPS model is the numerical weather prediction operated by Korea Meteorological Administration and it generates the 36 hours forecast of hourly total irradiance 4 times a day. This study attempts to evaluate the model performance against the in situ measurements at 37 ground stations from January to May, 2013. Relative mean bias error, mean absolute error and root mean square error of hourly total irradiance are averaged over all ground stations as being 8.2%, 21.2% and 29.6%, respectively. The behavior of mean bias error appears to be different; positively largest in Chupoongnyeong station but negatively largest in Daegu station. The distinct contrast might be attributed to the limitation of microphysics parameterization for thick and thin clouds in the model.

Variation of Psychophysiological Characteristics Related with Human Errors during a Simple Pointing Task (단순 지적과업 중 인간과오 관련 심리생리학적 특성의 변화)

  • Lim, Hyeon-Kyo
    • Journal of the Korean Society of Safety
    • /
    • v.24 no.3
    • /
    • pp.71-78
    • /
    • 2009
  • During a learning process, a human being is assumed to experience knowledge-based behaviors, rule-based behaviors, and skill-based behaviors sequentially if Rasmussen was right. If any psycho-physiological symptom to those different levels can be obtained, it can be useful as a measure whether a human being is fully trained and has gotten a skill in his work. Therefore, this study aimed to draw relationships between human performance measures and psycho-physiological measures while committing a computer-simulated pointing task by utilizing the power spectrum technique of EEG data, especially with the ratio of relative beta-to-alpha band power. The result showed that, during correct responses, the ratio came to stabilize as all the performance data went stable. However, response time was not a simple linear function of task difficulty level only, but a joint function of task characteristics as well as behavior levels. Comparing relative band power ratios from errors and correct responses, activated states of one's brain could be explained, and characteristics of the task could understood. To tell that of pointing task, correlations around C3, C4, P3, P4 and 01, 02 area were significant and high in correct response cases whereas most correlation coefficients went down in error cases standing for imbalance of psycho-motor functions. Though task difficulty was the only one factor that could influence on relative band power ratio with statistical significance, it should be comprehended to mean a different way of expression indicating task characteristics since at least error-some situation could be explained with the help of relative band power ratio that absolute band power failed.

Evaluation of HSPF Model Applicability for Runoff Estimation of 3 Sub-watershed in Namgang Dam Watershed (남강댐 상류 3개 소유역의 유출량 추정을 위한 HSPF 모형의 적용성 평가)

  • Kim, So Rae;Kim, Sang Min
    • Journal of Korean Society on Water Environment
    • /
    • v.34 no.3
    • /
    • pp.328-338
    • /
    • 2018
  • The objective of this study was to evaluate the applicability of a HSPF (Hydrological Simulation Program-Fortran) model for runoff estimation in the Namgang dam watershed. Spatial data, such as watershed, stream, land use, and a digital elevation map, were used as input for the HSPF model, which was calibrated and validated using observed runoff data from 2004 to 2015 for three stations (Sancheong, Shinan, Changchon) in the study watershed. Parameters for runoff calibration were selected based on the user's manual and references, and parameter calibration was done by trial and error. The $R^2$ (determination coefficient), RMSE (root-mean-square error), NSE (Nash-Sutcliffe efficiency coefficient), and RMAE (relative mean absolute error) were used to evaluate the model's performance. Calibration and validation results showed that annual mean runoff was within a ${\pm}5%$ error in Sancheong and Shinan, whereas there was a14% error in Changchon. The model performance criteria for calibration and validation showed that $R^2$ ranged from 0.80 to 0.92, RMSE was 2.33 to 2.39 mm/day, NSE was 0.71 to 0.85, and RMAE was 0.37 to 0.57 mm/day for daily runoff. Visual inspection showed that the simulated daily flow, monthly flow, and flow exceedance graph agreed well with observations for the Sancheong and Shinan stations, whereas the simulated flow was higher than observed at the Changchon station.

Estimation of the Hapcheon Dam Inflow Using HSPF Model (HSPF 모형을 이용한 합천댐 유입량 추정)

  • Cho, Hyun Kyung;Kim, Sang Min
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.61 no.5
    • /
    • pp.69-77
    • /
    • 2019
  • The objective of this study was to calibrate and validate the HSPF (Hydrological Simulation Program-Fortran) model for estimating the runoff of the Hapcheon dam watershed. Spatial data, such as watershed, stream, land use, and a digital elevation map, were used as input data for the HSPF model. Observed runoff data from 2000 to 2016 in study watershed were used for calibration and validation. Hydrologic parameters for runoff calibration were selected based on the user's manual and references, and trial and error method was used for parameter calibration. The $R^2$, RMSE (root-mean-square error), RMAE (relative mean absolute error), and NSE (Nash-Sutcliffe efficiency coefficient) were used to evaluate the model's performance. Calibration and validation results showed that annual mean runoff was within ${\pm}4%$ error. The model performance criteria for calibration and validation showed that $R^2$ was in the rang of 0.78 to 0.83, RMSE was 2.55 to 2.76 mm/day, RMAE was 0.46 to 0.48 mm/day, and NSE was 0.81 to 0.82 for daily runoff. The amount of inflow to Hapcheon Dam was calculated from the calibrated HSPF model and the result was compared with observed inflow, which was -0.9% error. As a result of analyzing the relation between inflow and storage capacity, it was found that as the inflow increases, the storage increases, and when the inflow decreases, the storage also decreases. As a result of correlation between inflow and storage, $R^2$ of the measured inflow and storage was 0.67, and the simulated inflow and storage was 0.61.

Application of Simple Regression Models for Pollutants Load Estimation of Paddy to Yeongsan and Seomjin River Watersheds (영산강.섬진강 유역을 대상으로 한 논 오염부하 산정 단순회귀모형 적용)

  • Choi, Woo-Jung;Kwak, Jin-Hyeob;Jung, Jae-Woon;Yoon, Kwang-Sik;Chang, Nam-Ik;Huh, Yu-Jeong
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.49 no.1
    • /
    • pp.89-97
    • /
    • 2007
  • Simple regression models for pollutants load estimation of paddy developed by the Ministry of Environment in 1995 were tested with the data (T-N, T-P, $COD_{Mn}$, and SS) collected from Yeongsan and Seomjin river watersheds, and improvement measures were suggested. Overall, the simulated values showed a great difference from the measured values except for T-P according to the statistical analyses (RMSE, root mean square error; RMAE, root mean absolute error; RB, relative bias; EI, efficiency index). Such difference was assumed due to the fact that the models use only hydrologic factors (quantity factor) associated with precipitation and run-off as input parameters, but do not consider other factors which are likely to affect pollutant concentration (quality factor) including days after fertilization. In addition, in terms of accessibility of the models, some parameters in the models such as run-off depth and run-off amount which can not be obtained from the weather database but should be collected by on-site measurements need to be replaced with other variables.

Prediction of Storm Surge Height Using Synthesized Typhoons and Artificial Intelligence (합성태풍과 인공지능을 활용한 폭풍해일고 예측)

  • Eum, Ho-Sik;Park, Jong-Jib;Jeong, Kwang-Young;Park, Young-Min
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.26 no.7
    • /
    • pp.892-903
    • /
    • 2020
  • The rapid and accurate prediction of storm-surge height during typhoon attacks is essential in responding to coastal disasters. Most methods used for predicting typhoon data are based on numerical modeling, but numerical modeling takes significant computing resources and time. Recently, various studies on the expeditious production of predictive data based on artificial intelligence have been conducted, and in this study, artificial intelligence-based storm-surge height prediction was performed. Several learning data were needed for artificial intelligence training. Because the number of previous typhoons was limited, many synthesized typhoons were created using the tropical cyclone risk model, and the storm-surge height was also generated using the storm surge model. The comparison of the storm-surge height predicted using artificial intelligence with the actual typhoon, showed that the root-mean-square error was 0.09 ~ 0.30 m, the correlation coefficient was 0.65 ~ 0.94, and the absolute relative error of the maximum height was 1.0 ~ 52.5%. Although errors appeared to be somewhat large at certain typhoons and points, future studies are expected to improve accuracy through learning-data optimization.

Analysis of Regional-Scale Weather Model Applicabilities for the Enforcement of Flood Risk Reduction (홍수피해 감소를 위한 지역규모 기상모델의 적용성 분석)

  • Jung, Yong;Baek, JongJin;Choi, Minha
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.32 no.5B
    • /
    • pp.267-272
    • /
    • 2012
  • To reduce the flood risk caused by unexpected heavy rainfall, many prediction methods for flood have been developed. A major constituent of flood prediction is an accurate rainfall estimation which is an input of hydrologic models. In this study, a regional-scale weather model which can provide relatively longer lead time for flood mitigation compared to the Nowcasting based on radar system will be introduced and applied to the Chongmi river basin located in central part of South Korea. The duration of application of a regional weather model is from July 11 to July 23 in 2006. The estimated rainfall amounts were compared with observations from rain gauges (Sangkeuk, Samjook, and Sulsung). For this rainfall event at Chongmi river basin, Thomson and Kain-Frisch Schemes for microphysics and cumulus parameterization, respectively, were selected as optimal physical conditions to present rainfall fall amount in terms of Mean Absolute Relative Errors (MARE>0.45).

Evaluation of SWAT Model Applicability for Runoff Estimation in Nam River Dam Watershed (남강댐 상류 소유역의 유출량 추정을 위한 SWAT 모형의 적용성 평가)

  • Kim, Dong-Hyeon;Kim, Sang-Min
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.58 no.4
    • /
    • pp.9-19
    • /
    • 2016
  • The objective of this study was to evaluate the applicability of SWAT (Soil and Water Assessment Tool) model for runoff estimation in the Nam river dam watershed. Input data for the SWAT model were established using spatial data (land use, soil, digital elevation map) and weather data. The SWAT model was calibrated and validated using observed runoff data from 2003 to 2014 for three stations (Sancheong, Shinan, Changchon) within the study watershed. The $R^2$ (Determination Coefficient), RMSE (Root Mean Square Error), NSE (Nash-Sutcliffe efficiency coefficient), and RMAE (Relative Mean Absolute Error) were used to evaluate the model performance. Parameters for runoff calibration were selected based on user's manual and references and trial and error method was applied for parameter calibration. Calibration results showed that annual mean runoff were within ${\pm}5%$ error compared to observed. $R^2$ were ranged 0.64 ~ 0.75, RMSE were 2.51 ~ 4.97 mm/day, NSE were 0.48 ~ 0.65, and RMAE were 0.34 ~ 0.63 mm/day for daily runoff, respectively. The runoff comparison for three stations showed that annual runoff was higher in Changchon especially summer and winter seasons. The flow exceedance graph showed that Sancheong and Shinan stations were similar while Changchon was higher in entire fraction.