• 제목/요약/키워드: MLP Neural Network

검색결과 257건 처리시간 0.027초

The prediction of atmospheric concentrations of toluene using artificial neural network methods in Tehran

  • Asadollahfardi, Gholamreza;Aria, Shiva Homayoun;Mehdinejad, Mahdi
    • Advances in environmental research
    • /
    • 제4권4호
    • /
    • pp.219-231
    • /
    • 2015
  • In recent years, raising air pollutants has become as a big concern, especially in metropolitan cities such as Tehran. Therefore, forecasting the level of pollutants plays a significant role in air quality management. One of the forecasting tools that can be used is an artificial neural network which is able to model the complicated process of air pollution. In this study, we applied two different methods of artificial neural networks, the Multilayer Perceptron (MLP) and Radial Basis Function (RBF), to predict the hourly air concentrations of toluene in Tehran. Hourly temperature, wind speed, humidity and $NO_x$ were selected as inputs. Both methods had acceptable results; however, the RBF neural network produced better results. The coefficient of determination ($R^2$) between the observed and predicted data was 0.9642 and 0.99 for MLP and RBF neural networks, respectively. The results of the mean bias errors (MBE) were 0.00 and -0.014 for RBF and MLP, respectively which indicate the adequacy of the models. The index of agreement (IA) between the observed and predicted data was 0.999 and 0.994 in the RBF and the MLP, respectively which indicates the efficiency of the models. Finally, sensitivity analysis related to the MLP neural network determined that temperature was the most significant factor in air concentration of toluene in Tehran which may be due to the volatile nature of toluene.

회귀예측 신경모델과 카오스 신경회로망을 결합한 고립 숫자음 인식 (Isolated Digit Recognition Combined with Recurrent Neural Prediction Models and Chaotic Neural Networks)

  • 김석현;여지환
    • 한국지능시스템학회논문지
    • /
    • 제8권6호
    • /
    • pp.129-135
    • /
    • 1998
  • 본 논문은 서러 다른 접근방식을 사용하는 카오스 회귀 신경예측모델과 다층 신경회로망이 결합하여 고립음의 인식률을 높이고자 하였다. 전반적으로 다층신경회로망은 MLP와 결합한 인식률은 1.2%에서 2.5% 이상이 개선 되었다. 이는 서로 인식하는 방법이 다르기 때문에 서로 상호 보완되고, 카오스의 다이내믹 성질이 인식률을 개선시켰음을 실험으로 밝혔다. MLP와 결합한 인식률은 카오스 다층신경망일 때가 가장 좋았다. 그러나 학습시 알고리즘이 단순하고, 신뢰도 면에서는 오히려 카오스 단층 신경망이 인식률은 0.5%정도 떨어지지만 더욱 좋다고 생각된다. 주로 MLP는 숫자음 “일”과 “오”에서 우수한 성적을 나타내었고, 카오스 예측 신경망은 숫자음 “영”, “삼”, “칠”에서 우수하였다.

  • PDF

Predicting Atmospheric Concentrations of Benzene in the Southeast of Tehran using Artificial Neural Network

  • Asadollahfardi, Gholamreza;Mehdinejad, Mahdi;Mirmohammadi, Mohsen;Asadollahfardi, Rashin
    • Asian Journal of Atmospheric Environment
    • /
    • 제9권1호
    • /
    • pp.12-21
    • /
    • 2015
  • Air pollution is a challenging issue in some of the large cities in developing countries. In this regard, data interpretation is one of the most important parts of air quality management. Several methods exist to analyze air quality; among these, we applied the Multilayer Perceptron (MLP) and Radial Basis Function (RBF) methods to predict the hourly air concentration of benzene in 14 districts in the municipality of Tehran. Input data were hourly temperature, wind speed and relative humidity. Both methods determined reliable results. However, the RBF neural network performance was much closer to observed benzene data than the MLP neural network. The correlation determination resulted in 0.868 for MLP and 0.907 for RBF, while the Index of Agreement (IA) was 0.889 for MLP and 0.937 for RBF. The sensitivity analysis related to the MLP neural network indicated that the temperature had the greatest effect on prediction of benzene in comparison with the wind speed and humidity in the study area. The temperature was the most significant factor in benzene production because benzene is a volatile liquid.

Modelling of dissolved oxygen (DO) in a reservoir using artificial neural networks: Amir Kabir Reservoir, Iran

  • Asadollahfardi, Gholamreza;Aria, Shiva Homayoun;Abaei, Mehrdad
    • Advances in environmental research
    • /
    • 제5권3호
    • /
    • pp.153-167
    • /
    • 2016
  • We applied multilayer perceptron (MLP) and radial basis function (RBF) neural network in upstream and downstream water quality stations of the Karaj Reservoir in Iran. For both neural networks, inputs were pH, turbidity, temperature, chlorophyll-a, biochemical oxygen demand (BOD) and nitrate, and the output was dissolved oxygen (DO). We used an MLP neural network with two hidden layers, for upstream station 15 and 33 neurons in the first and second layers respectively, and for the downstream station, 16 and 21 neurons in the first and second hidden layer were used which had minimum amount of errors. For learning process 6-fold cross validation were applied to avoid over fitting. The best results acquired from RBF model, in which the mean bias error (MBE) and root mean squared error (RMSE) were 0.063 and 0.10 for the upstream station. The MBE and RSME were 0.0126 and 0.099 for the downstream station. The coefficient of determination ($R^2$) between the observed data and the predicted data for upstream and downstream stations in the MLP was 0.801 and 0.904, respectively, and in the RBF network were 0.962 and 0.97, respectively. The MLP neural network had acceptable results; however, the results of RBF network were more accurate. A sensitivity analysis for the MLP neural network indicated that temperature was the first parameter, pH the second and nitrate was the last factor affecting the prediction of DO concentrations. The results proved the workability and accuracy of the RBF model in the prediction of the DO.

지역 및 광역 리커런트 신경망을 이용한 비선형 적응예측 (Nonlinear Adaptive Prediction using Locally and Globally Recurrent Neural Networks)

  • 최한고
    • 대한전자공학회논문지SP
    • /
    • 제40권1호
    • /
    • pp.139-147
    • /
    • 2003
  • 동적 신경망은 신호예측과 같이 temporal 신호처리가 요구되는 여러 분야에 적용되어 왔다. 본 논문에서는 다층 리커런트 신경망(RNN)의 동특성을 향상시키기 위해 지역 궤환 신경망(LRNN)과 광역 궤환 신경망(CRNN)으로 구성된 합성 신경망을 제안하고, 적응필터로 제안된 신경망을 사용하여 비선형 적응예측을 다루고 있다. 합성 신경망은 LRNN으로 IIR-MLP와 CRNN으로 Elman RNN 신경망으로 구성되어 있다. 제안된 신경망은 비선형 신호예측을 통해 평가되었으며, 예측 성능의 상대적인 비교를 위해 Elman RNN과 IIR-MLP 신경망과 상호 비교하였다. 실험결과에 의하면 합성 신경망은 수렴속도과 정확도에서 더 우수한 성능을 보여줌으로써, 제안된 신경망이 기존의 다층 리커런트 신경망보다 비정적 신호에 대한 비선형 예측에 더 효과적인 예측모델임을 확인하였다.

Hybrid 리커런트 신경망을 이용한 시스템 식별 (System Identification Using Hybrid Recurrent Neural Networks)

  • 최한고;고일환;김종인
    • 융합신호처리학회논문지
    • /
    • 제6권1호
    • /
    • pp.45-52
    • /
    • 2005
  • 동적 신경망은 temporal 신호처리가 요구되는 여러 분야에 사용되어 왔다. 본 논문에서는 다층 리커런트 신경망(RNN)의 동특성을 더 향상시키기 위해 지역 궤환 신경망(LRNN)과 광역 궤환 신경망(GRNN)으로 구성된 합성 신경망을 사용하여 시스템 식별을 다루고 있다. 합성 신경망의 구조는 LRNN으로 IIR-MLP를, GRNN으로 Elman RNN을 결합하고 있다. 합성신경망은 선형과 비선형 시스템 식별을 통해 평가되었으며 상대적인 성능평가를 위해 Elman RNN과 IIR-MLP 신경망과 비교하고 있다. 시뮬레이션 결과에 의하면 합성 신경망은 학습속도와 정확도에서 더 우수하게 동작하였으며, 이러한 사실은 비선형 시스템 식별에 있어서 합성 신경망이 기존의 다층 리커런트 신경망보다 더 효과적인 신경망이 될 수 있음을 보여주었다.

  • PDF

The development of four efficient optimal neural network methods in forecasting shallow foundation's bearing capacity

  • Hossein Moayedi;Binh Nguyen Le
    • Computers and Concrete
    • /
    • 제34권2호
    • /
    • pp.151-168
    • /
    • 2024
  • This research aimed to appraise the effectiveness of four optimization approaches - cuckoo optimization algorithm (COA), multi-verse optimization (MVO), particle swarm optimization (PSO), and teaching-learning-based optimization (TLBO) - that were enhanced with an artificial neural network (ANN) in predicting the bearing capacity of shallow foundations located on cohesionless soils. The study utilized a database of 97 laboratory experiments, with 68 experiments for training data sets and 29 for testing data sets. The ANN algorithms were optimized by adjusting various variables, such as population size and number of neurons in each hidden layer, through trial-and-error techniques. Input parameters used for analysis included width, depth, geometry, unit weight, and angle of shearing resistance. After performing sensitivity analysis, it was determined that the optimized architecture for the ANN structure was 5×5×1. The study found that all four models demonstrated exceptional prediction performance: COA-MLP, MVO-MLP, PSO-MLP, and TLBO-MLP. It is worth noting that the MVO-MLP model exhibited superior accuracy in generating network outputs for predicting measured values compared to the other models. The training data sets showed R2 and RMSE values of (0.07184 and 0.9819), (0.04536 and 0.9928), (0.09194 and 0.9702), and (0.04714 and 0.9923) for COA-MLP, MVO-MLP, PSO-MLP, and TLBO-MLP methods respectively. Similarly, the testing data sets produced R2 and RMSE values of (0.08126 and 0.07218), (0.07218 and 0.9814), (0.10827 and 0.95764), and (0.09886 and 0.96481) for COA-MLP, MVO-MLP, PSO-MLP, and TLBO-MLP methods respectively.

MLP 신경망을 위한 시공간 병렬처리모델 (A Spatiotemporal Parallel Processing Model for the MLP Neural Network)

  • 김성완
    • 한국컴퓨터정보학회논문지
    • /
    • 제10권5호
    • /
    • pp.95-102
    • /
    • 2005
  • 본 논문에서는 MLP신경망의 패턴 학습과정을 위하여 시공간 병렬성을 고려한 병렬처리모델을 제시한다. 시간 병렬성을 위한 학습집합 분할과 공간 병렬성을 위한 네트워크 분할을 동시 적용하여 융통성있는 병렬처리모델을 설계하고자 하였다. 성능평가모델로부터 해석적으로 구한 결과, 대규모 과제라고 해도 패턴 크기와 패턴 갯수 중 어느 쪽이 지배적이냐에 따라 분할병렬처리 방법이 절충되어야 할 것으로 본다.

  • PDF

Predicting PM2.5 Concentrations Using Artificial Neural Networks and Markov Chain, a Case Study Karaj City

  • Asadollahfardi, Gholamreza;Zangooei, Hossein;Aria, Shiva Homayoun
    • Asian Journal of Atmospheric Environment
    • /
    • 제10권2호
    • /
    • pp.67-79
    • /
    • 2016
  • The forecasting of air pollution is an important and popular topic in environmental engineering. Due to health impacts caused by unacceptable particulate matter (PM) levels, it has become one of the greatest concerns in metropolitan cities like Karaj City in Iran. In this study, the concentration of $PM_{2.5}$ was predicted by applying a multilayer percepteron (MLP) neural network, a radial basis function (RBF) neural network and a Markov chain model. Two months of hourly data including temperature, NO, $NO_2$, $NO_x$, CO, $SO_2$ and $PM_{10}$ were used as inputs to the artificial neural networks. From 1,488 data, 1,300 of data was used to train the models and the rest of the data were applied to test the models. The results of using artificial neural networks indicated that the models performed well in predicting $PM_{2.5}$ concentrations. The application of a Markov chain described the probable occurrences of unhealthy hours. The MLP neural network with two hidden layers including 19 neurons in the first layer and 16 neurons in the second layer provided the best results. The coefficient of determination ($R^2$), Index of Agreement (IA) and Efficiency (E) between the observed and the predicted data using an MLP neural network were 0.92, 0.93 and 0.981, respectively. In the MLP neural network, the MBE was 0.0546 which indicates the adequacy of the model. In the RBF neural network, increasing the number of neurons to 1,488 caused the RMSE to decline from 7.88 to 0.00 and caused $R^2$ to reach 0.93. In the Markov chain model the absolute error was 0.014 which indicated an acceptable accuracy and precision. We concluded the probability of occurrence state duration and transition of $PM_{2.5}$ pollution is predictable using a Markov chain method.

LSTM - MLP 인공신경망 앙상블을 이용한 장기 강우유출모의 (Long-term runoff simulation using rainfall LSTM-MLP artificial neural network ensemble)

  • 안성욱;강동호;성장현;김병식
    • 한국수자원학회논문집
    • /
    • 제57권2호
    • /
    • pp.127-137
    • /
    • 2024
  • 수자원 관리를 위해 주로 사용되는 물리 모형은 입력자료의 구축과 구동이 어렵고 사용자의 주관적 견해가 개입될 수 있다. 최근 수자원 분야에서 이러한 문제점을 보완하기 위해 기계학습과 같은 자료기반 모델을 이용한 연구가 활발히 진행되고 있다. 본 연구에서는 관측자료만을 이용하여 강원도 삼척시 오십천 유역의 장기강우유출모의를 수행했다. 이를 위해 기상자료로 3개의 입력자료군(기상관측요소, 일 강수량 및 잠재증발산량, 일강수량 - 잠재증발산량)을 구성하고 LSTM (Long Short-term Memory)인공신경망 모델에 각각 학습시킨 결과를 비교 및 분석했다. 그 결과 기상관측요소만을 이용한 LSTM-Model 1의 성능이 가장 높았으며, 여기에 MLP 인공신경망을 더한 6개의 LSTM-MLP 앙상블 모델을 구축하여 오십천 유역의 장기유출을 모의했다. LSTM 모델과 LSTM-MLP 모형을 비교한 결과 두 모델 모두 대체적으로 비슷한 결과를 보였지만 LSTM 모델에 비해 LSTM-MLP의 MAE, MSE, RMSE가 감소했고 특히 저유량 부분이 개선되었다. LSTM-MLP의 결과에서 저유량 부분의 개선을 보임에 따라 향후 LSTM-MLP 모델 이외에 CNN등 다양한 앙상블 모형을 이용해 물리적 모델 구축 및 구동 시간이 오래 걸리는 대유역과 입력 자료가 부족한 미계측 유역의 유황곡선 작성 등에 활용성이 높을 것으로 판단된다.