• Title/Summary/Keyword: MAE(mean absolute error)

Search Result 187, Processing Time 0.029 seconds

Novel integrative soft computing for daily pan evaporation modeling

  • Zhang, Yu;Liu, LiLi;Zhu, Yongjun;Wang, Peng;Foong, Loke Kok
    • Smart Structures and Systems
    • /
    • v.30 no.4
    • /
    • pp.421-432
    • /
    • 2022
  • Regarding the high significance of correct pan evaporation modeling, this study introduces two novel neuro-metaheuristic approaches to improve the accuracy of prediction for this parameter. Vortex search algorithms (VSA), sunflower optimization (SFO), and stochastic fractal search (SFS) are integrated with a multilayer perceptron neural network to create the VSA-MLPNN, SFO-MLPNN, and SFS-MLPNN hybrids. The climate data of Arcata-Eureka station (operated by the US environmental protection agency) belonging to the years 1986-1989 and the year 1990 are used for training and testing the models, respectively. Trying different configurations revealed that the best performance of the VSA, SFO, and SFS is obtained for the population size of 400, 300, and 100, respectively. The results were compared with a conventionally trained MLPNN to examine the effect of the metaheuristic algorithms. Overall, all four models presented a very reliable simulation. However, the SFS-MLPNN (mean absolute error, MAE = 0.0997 and Pearson correlation coefficient, RP = 0.9957) was the most accurate model, followed by the VSA-MLPNN (MAE = 0.1058 and RP = 0.9945), conventional MLPNN (MAE = 0.1062 and RP = 0.9944), and SFO-MLPNN (MAE = 0.1305 and RP = 0.9914). The findings indicated that employing the VSA and SFS results in improving the accuracy of the neural network in the prediction of pan evaporation. Hence, the suggested models are recommended for future practical applications.

Comparative analysis of wavelet transform and machine learning approaches for noise reduction in water level data (웨이블릿 변환과 기계 학습 접근법을 이용한 수위 데이터의 노이즈 제거 비교 분석)

  • Hwang, Yukwan;Lim, Kyoung Jae;Kim, Jonggun;Shin, Minhwan;Park, Youn Shik;Shin, Yongchul;Ji, Bongjun
    • Journal of Korea Water Resources Association
    • /
    • v.57 no.3
    • /
    • pp.209-223
    • /
    • 2024
  • In the context of the fourth industrial revolution, data-driven decision-making has increasingly become pivotal. However, the integrity of data analysis is compromised if data quality is not adequately ensured, potentially leading to biased interpretations. This is particularly critical for water level data, essential for water resource management, which often encounters quality issues such as missing values, spikes, and noise. This study addresses the challenge of noise-induced data quality deterioration, which complicates trend analysis and may produce anomalous outliers. To mitigate this issue, we propose a noise removal strategy employing Wavelet Transform, a technique renowned for its efficacy in signal processing and noise elimination. The advantage of Wavelet Transform lies in its operational efficiency - it reduces both time and costs as it obviates the need for acquiring the true values of collected data. This study conducted a comparative performance evaluation between our Wavelet Transform-based approach and the Denoising Autoencoder, a prominent machine learning method for noise reduction.. The findings demonstrate that the Coiflets wavelet function outperforms the Denoising Autoencoder across various metrics, including Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE), and Mean Squared Error (MSE). The superiority of the Coiflets function suggests that selecting an appropriate wavelet function tailored to the specific application environment can effectively address data quality issues caused by noise. This study underscores the potential of Wavelet Transform as a robust tool for enhancing the quality of water level data, thereby contributing to the reliability of water resource management decisions.

Machine Learning-based Quality Control and Error Correction Using Homogeneous Temporal Data Collected by IoT Sensors (IoT센서로 수집된 균질 시간 데이터를 이용한 기계학습 기반의 품질관리 및 데이터 보정)

  • Kim, Hye-Jin;Lee, Hyeon Soo;Choi, Byung Jin;Kim, Yong-Hyuk
    • Journal of the Korea Convergence Society
    • /
    • v.10 no.4
    • /
    • pp.17-23
    • /
    • 2019
  • In this paper, quality control (QC) is applied to each meteorological element of weather data collected from seven IoT sensors such as temperature. In addition, we propose a method for estimating the data regarded as error by means of machine learning. The collected meteorological data was linearly interpolated based on the basic QC results, and then machine learning-based QC was performed. Support vector regression, decision table, and multilayer perceptron were used as machine learning techniques. We confirmed that the mean absolute error (MAE) of the machine learning models through the basic QC is 21% lower than that of models without basic QC. In addition, when the support vector regression model was compared with other machine learning methods, it was found that the MAE is 24% lower than that of the multilayer neural network and 58% lower than that of the decision table on average.

CNN-based Image Rotation Correction Algorithm to Improve Image Recognition Rate (이미지 인식률 개선을 위한 CNN 기반 이미지 회전 보정 알고리즘)

  • Lee, Donggu;Sun, Young-Ghyu;Kim, Soo-Hyun;Sim, Issac;Lee, Kye-San;Song, Myoung-Nam;Kim, Jin-Young
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.20 no.1
    • /
    • pp.225-229
    • /
    • 2020
  • Recently, convolutional neural network (CNN) have been showed outstanding performance in the field of image recognition, image processing and computer vision, etc. In this paper, we propose a CNN-based image rotation correction algorithm as a solution to image rotation problem, which is one of the factors that reduce the recognition rate in image recognition system using CNN. In this paper, we trained our deep learning model with Leeds Sports Pose dataset to extract the information of the rotated angle, which is randomly set in specific range. The trained model is evaluated with mean absolute error (MAE) value over 100 test data images, and it is obtained 4.5951.

A study on short-term wind power forecasting using time series models (시계열 모형을 이용한 단기 풍력발전 예측 연구)

  • Park, Soo-Hyun;Kim, Sahm
    • The Korean Journal of Applied Statistics
    • /
    • v.29 no.7
    • /
    • pp.1373-1383
    • /
    • 2016
  • The wind energy industry and wind power generation have increased; consequently, the stable supply of the wind power has become an important issue. It is important to accurately predict the wind power with short-term basis in order to make a reliable planning for the power supply and demand of wind power. In this paper, we first analyzed the speed, power and the directions of the wind. The neural network and the time series models (ARMA, ARMAX, ARMA-GARCH, Holt Winters) for wind power generation forecasting were compared based on mean absolute error (MAE). For one to three hour-ahead forecast, ARMA-GARCH model was outperformed, and the neural network method showed a better performance in the six hour-ahead forecast.

A Study on Accuracy of Meteorological Information for Low Altitude Aerospace around the Airport on the West Coast (서해안 인접공항의 저고도 항공기상 정확도 연구)

  • Cho, Young-Jin;Yoo, Kwang Eui
    • Journal of the Korean Society for Aviation and Aeronautics
    • /
    • v.28 no.2
    • /
    • pp.53-62
    • /
    • 2020
  • This study is to evaluate the accuracy of the meteorological information provided for the aircraft operating at low altitude. At first, it is necessary to identify crucial elements of weather information closely related to flight safety during low altitude flights. The study conducted a survey of pilots of low altitude aircraft, divided into pre-flight and in-flight phases, and reached an opinion that wind direction, wind speed, cloud coverage and ceiling and visibility are important items. Related to these items, we compared and calculated the accuracy of TAFs and METARs from Taean Airfield, Seosan Airport and Gunsan Airport because of their high number of domestic low-altitude flights. Accuracy analysis evaluated the accuracy of two numerical variables, Mean Absolute Error(MAE) and Root Mean Square Error(RMSE), and the cloud coverage which is categorical variable was calculated and compared by accuracy. For numeric variables, one-way ANOVA, which is a parameter-test, was approached to identify differences between actual forecast values and observations based on absolute errors for each item derived from the results of MAE and RMSE accuracy analyses. To determine the satisfaction of both normality assumptions and equivalence variability assumptions, the Shapiro-Wilk test was performed to verify that they do not have a normality distribution for numerical variables, and for the non-parametric test, Kruscal-Wallis test was conducted to determine whether or not they are satisfied.

Prediction of Vertical Sea Water Temperature Profile in the East Sea Based on Machine Learning and XBT Data

  • Kim, Young-Joo;Lee, Soo-Jin;Kim, Young-Won
    • Journal of the Korea Society of Computer and Information
    • /
    • v.27 no.11
    • /
    • pp.47-55
    • /
    • 2022
  • Recently, researches on the prediction of sea water temperature using artificial intelligence models has been actively conducted in Korea. However, most researches in the sea around the Korean peninsula mainly focus on predicting sea surface temperatures. Unlike previous researches, this research predicted the vertical sea water temperature profile of the East Sea, which is very important in submarine operations and anti-submarine warfare, using XBT(eXpendable Bathythermograph) data and machine learning models(RandomForest, XGBoost, LightGBM). The model was trained using XBT data measured from sea surface to depth of 200m in a specific area of the East Sea, and the prediction accuracy was evaluated through MAE(Mean Absolute Error) and vertical sea water temperature profile graphs.

Optimal Operating Method of PV+ Storage System Using the Peak-Shaving in Micro-Grid System (Micro-Grid 시스템에서 Peak-Shaving을 이용한 PV+ 시스템의 최적 운영 방법)

  • Lee, Gi-hwan;Lee, Kang-won
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.43 no.2
    • /
    • pp.1-13
    • /
    • 2020
  • There are several methods of peak-shaving, which reduces grid power demand, electricity bought from electricity utility, through lowering "demand spike" during On-Peak period. An optimization method using linear programming is proposed, which can be used to perform peak-shaving of grid power demand for grid-connected PV+ system. Proposed peak shaving method is based on the forecast data for electricity load and photovoltaic power generation. Results from proposed method are compared with those from On-Off and Real Time methods which do not need forecast data. The results also compared to those from ideal case, an optimization method which use measured data for forecast data, that is, error-free forecast data. To see the effects of forecast error 36 error scenarios are developed, which consider error types of forecast, nMAE (normalizes Mean Absolute Error) for photovoltaic power forecast and MAPE (Mean Absolute Percentage Error) for load demand forecast. And the effects of forecast error are investigated including critical error scenarios which provide worse results compared to those of other scenarios. It is shown that proposed peak shaving method are much better than On-Off and Real Time methods under almost all the scenario of forecast error. And it is also shown that the results from our method are not so bad compared to the ideal case using error-free forecast.

Block-Matching Motion Estimation : Classification and Comparison (블록 정합 방법을 이용한 움직임 추정 : 분류 및 비교)

  • Cheoi, Kyung-Joo;Lee, Yill-Byung
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2000.10b
    • /
    • pp.931-934
    • /
    • 2000
  • 움직임 추정 및 보상을 위한 방법 중 가장 많이 사용하는 블록 정합 방법은 어떤 평가 함수와 탐색방법(Search Procedure)을 사용했느냐에 따라 그 성능이 달라지게 된다. 본 논문에서는 평가 함수로써 평균 제곱 오차(Mean Squared Error; MSE), 평균 절대값 오차(Mean Absolute Error; MAE), 화소 차분류(Pel Difference Classification: PDC)을, 탐색 방법으로써 전체 탐색 방법(Full Search Method : FSM), 3단계 탐색 방법(Three Step Search : TSS), 대각 탐색 방법(Cross Search Algorithm ;CSA)을 사용하여 이들의 성능을 각각 비교 분석하여 봄으로써 블록 정합 방법을 이용한 움직임 추정에 대한 전반적인 이해를 도모하고자 한다.

  • PDF

A Comparative Study on the Spatial Statistical Models for the Estimation of Population Distribution

  • Oh, Doo-Ri;Hwang, Chul Sue
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.33 no.3
    • /
    • pp.145-153
    • /
    • 2015
  • This study aims to accurately estimate population distribution more specifically than administrative unites using a RK (Regression-Kriging) model. The RK model is the areal interpolation technique that involves linear regression and the Kriging model. In order to estimate a population’s distribution using a sample region, four different models were used, namely; a regression model, RK model, OK (Ordinary Kriging) model and CK (Co-Kriging) model. The results were then compared with each other. Evaluation of the accuracy and validity of evaluation analysis results were the basis RMSE (Root Mean Square Error), MAE (Mean Absolute Error), G statistic and correlation coefficient (ρ). In the sample regions, every statistic value of the RK model showed better results than other models. The results of this comparative study will be useful to estimate a population distribution of the metropolitan areas with high population density