• Title/Summary/Keyword: a neural network with two-hidden layer

Search Result 59, Processing Time 0.024 seconds

Estimating Evapotranspiration of Rice Crop Using Neural Networks -Application of Back-propagation and Counter-propagation Algorithm- (신경회로망을 이용한 수도 증발산량 예측 -백프로파게이션과 카운터프로파게이션 알고리즘의 적용-)

  • 이남호;정하우
    • Magazine of the Korean Society of Agricultural Engineers
    • /
    • v.36 no.2
    • /
    • pp.88-95
    • /
    • 1994
  • This paper is to evaluate the applicability of neural networks to the estimation of evapotranspiration. Two neural networks were developed to forecast daily evapotranspiration of the rice crop with back-propagation and counter-propagation algorithm. The neural network trained by back-propagation algorithm with delta learning rule is a three-layer network with input, hidden, and output layers. The other network with counter-propagation algorithm is a four-layer network with input, normalizing, competitive, and output layers. Training neural networks was conducted using daily actual evapotranspiration of rice crop and daily climatic data such as mean temperature, sunshine hours, solar radiation, relative humidity, and pan evaporation. During the training, neural network parameters were calibrated. The trained networks were applied to a set of field data not used in the training. The created response of the back-propagation network was in good agreement with desired values and showed better performances than the counter-propagation network did. Evaluating the neural network performance indicates that the back-propagation neural network may be applied to the estimation of evapotranspiration of the rice crop. This study does not provide with a conclusive statement as to the ability of a neural network to evapotranspiration estimating. More detailed study is required for better understanding and evaluating the behavior of neural networks.

  • PDF

Correlation of Liquid-Liquid Equilibrium of Four Binary Hydrocarbon-Water Systems, Using an Improved Artificial Neural Network Model

  • Lv, Hui-Chao;Shen, Yan-Hong
    • Journal of the Korean Chemical Society
    • /
    • v.57 no.3
    • /
    • pp.370-376
    • /
    • 2013
  • A back propagation artificial neural network model with one hidden layer is established to correlate the liquid-liquid equilibrium data of hydrocarbon-water systems. The model has four inputs and two outputs. The network is systematically trained with 48 data points in the range of 283.15 to 405.37K. Statistical analyses show that the optimised neural network model can yield excellent agreement with experimental data(the average absolute deviations equal to 0.037% and 0.0012% for the correlated mole fractions of hydrocarbon in two coexisting liquid phases respectively). The comparison in terms of average absolute deviation between the correlated mole fractions for each binary system and literature results indicates that the artificial neural network model gives far better results. This study also shows that artificial neural network model could be developed for the phase equilibria for a family of hydrocarbon-water binaries.

Searching a global optimum by stochastic perturbation in error back-propagation algorithm (오류 역전파 학습에서 확률적 가중치 교란에 의한 전역적 최적해의 탐색)

  • 김삼근;민창우;김명원
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.35C no.3
    • /
    • pp.79-89
    • /
    • 1998
  • The Error Back-Propagation(EBP) algorithm is widely applied to train a multi-layer perceptron, which is a neural network model frequently used to solve complex problems such as pattern recognition, adaptive control, and global optimization. However, the EBP is basically a gradient descent method, which may get stuck in a local minimum, leading to failure in finding the globally optimal solution. Moreover, a multi-layer perceptron suffers from locking a systematic determination of the network structure appropriate for a given problem. It is usually the case to determine the number of hidden nodes by trial and error. In this paper, we propose a new algorithm to efficiently train a multi-layer perceptron. OUr algorithm uses stochastic perturbation in the weight space to effectively escape from local minima in multi-layer perceptron learning. Stochastic perturbation probabilistically re-initializes weights associated with hidden nodes to escape a local minimum if the probabilistically re-initializes weights associated with hidden nodes to escape a local minimum if the EGP learning gets stuck to it. Addition of new hidden nodes also can be viewed asa special case of stochastic perturbation. Using stochastic perturbation we can solve the local minima problem and the network structure design in a unified way. The results of our experiments with several benchmark test problems including theparity problem, the two-spirals problem, andthe credit-screening data show that our algorithm is very efficient.

  • PDF

Application of artificial neural networks to the response prediction of geometrically nonlinear truss structures

  • Cheng, Jin;Cai, C.S.;Xiao, Ru-Cheng
    • Structural Engineering and Mechanics
    • /
    • v.26 no.3
    • /
    • pp.251-262
    • /
    • 2007
  • This paper examines the application of artificial neural networks (ANN) to the response prediction of geometrically nonlinear truss structures. Two types of analysis (deterministic and probabilistic analyses) are considered. A three-layer feed-forward backpropagation network with three input nodes, five hidden layer nodes and two output nodes is firstly developed for the deterministic response analysis. Then a back propagation training algorithm with Bayesian regularization is used to train the network. The trained network is then successfully combined with a direct Monte Carlo Simulation (MCS) to perform a probabilistic response analysis of geometrically nonlinear truss structures. Finally, the proposed ANN is applied to predict the response of a geometrically nonlinear truss structure. It is found that the proposed ANN is very efficient and reasonable in predicting the response of geometrically nonlinear truss structures.

Kriging Regressive Deep Belief WSN-Assisted IoT for Stable Routing and Energy Conserved Data Transmission

  • Muthulakshmi, L.;Banumathi, A.
    • International Journal of Computer Science & Network Security
    • /
    • v.22 no.7
    • /
    • pp.91-102
    • /
    • 2022
  • With the evolution of wireless sensor network (WSN) technology, the routing policy has foremost importance in the Internet of Things (IoT). A systematic routing policy is one of the primary mechanics to make certain the precise and robust transmission of wireless sensor networks in an energy-efficient manner. In an IoT environment, WSN is utilized for controlling services concerning data like, data gathering, sensing and transmission. With the advantages of IoT potentialities, the traditional routing in a WSN are augmented with decision-making in an energy efficient manner to concur finer optimization. In this paper, we study how to combine IoT-based deep learning classifier with routing called, Kriging Regressive Deep Belief Neural Learning (KR-DBNL) to propose an efficient data packet routing to cope with scalability issues and therefore ensure robust data packet transmission. The KR-DBNL method includes four layers, namely input layer, two hidden layers and one output layer for performing data transmission between source and destination sensor node. Initially, the KR-DBNL method acquires the patient data from different location. Followed by which, the input layer transmits sensor nodes to first hidden layer where analysis of energy consumption, bandwidth consumption and light intensity are made using kriging regression function to perform classification. According to classified results, sensor nodes are classified into higher performance and lower performance sensor nodes. The higher performance sensor nodes are then transmitted to second hidden layer. Here high performance sensor nodes neighbouring sensor with higher signal strength and frequency are selected and sent to the output layer where the actual data packet transmission is performed. Experimental evaluation is carried out on factors such as energy consumption, packet delivery ratio, packet loss rate and end-to-end delay with respect to number of patient data packets and sensor nodes.

Classification of ECG Arrhythmia Signals Using Back-Propagation Network (역전달 신경회로망을 이용한 심전도 파형의 부정맥 분류)

  • 권오철;최진영
    • Journal of Biomedical Engineering Research
    • /
    • v.10 no.3
    • /
    • pp.343-350
    • /
    • 1989
  • A new algorithm classifying ECG Arrhythmia signals using Back-propagation network is proposed. The base-line of ECG signal is detected by high pass filter and probability density function then input data are normalized for learning and classifying. In addition, ECG data are scanned to classify Arrhythmia signal which is hard to find R-wave. A two-layer perceptron with one hidden layer along with error back-propagation learning rule is utilized as an artificial neural network. The proposed algorithm shows outstanding performance under circumstances of amplitude variation, baseline wander and noise contamination.

  • PDF

Speech Recognition and Its Learning by Neural Networks (신경회로망을 이용한 음성인식과 그 학습)

  • 이권현
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.16 no.4
    • /
    • pp.350-357
    • /
    • 1991
  • A speech recognition system based on a neural network, which can be used for telephon number services was tested. Because in Korea two different cardinal number systems, a koreanic one and a sinokoreanic one, are in use, it is necessary that the used systems is able to recognize 22 discret words. The structure of the neural network used had two layers, also a structure with 3 layers, one hidden layreformed of each 11, 22 and 44 hidden units was tested. During the learning phase of the system the so called BP-algorithm (back propagation) was applied. The process of learning can e influenced by using a different learning factor and also by the method of learning(for instance random or cycle). The optimal rate of speaker independent recognition by using a 2 layer neural network was 96%. A drop of recognition was observed by overtraining. This phenomen appeared more clearly if a 3 layer neural network was used. These phenomens are described in this paper in more detail. Especially the influence of the construction of the neural network and the several states during the learning phase are examined.

  • PDF

A Development of System for Flood Runoff Forecasting using Neural Network Model (신경망 모형을 이용한 홍수유출 예측시스템의 재발)

  • Ahn, Sang-Jin;Jun, Kye-Won
    • Journal of Korea Water Resources Association
    • /
    • v.37 no.9
    • /
    • pp.771-780
    • /
    • 2004
  • The purpose of this study is to test a development of system for flood runoff forecasting using neural network model. As the forecasting models for flood runoff the neural network model was tested with the observed flood data at Gongju and Buyeo stations. The neural network model consists of input layer, hidden layer, and output layer. For the flood events tested rainfall and runoff data were the input to the input layer and the flood runoff data were used in the output layer. To make a choice the forecasting model which would make up of runoff forecasting system properly, real-time runoff of river when flood periods were forecasted by using neural network model and state-space model. A comparison of the results obtained by the two forecasting models indicated the superiority and reliability of the neural network model over the state-space model. The neural network model was modified to work in the Web and developed to be the basic model of the forecasting system for the flood runoff. The neural network model developed to be used in the Web was loaded into the server and was applied to the main stream of Geum river. For the main stage gauging stations mentioned above the applicability of the selected forecasting model, the Neural Network Model, was verified in the Web.

Prediction of Turbidity in Treated Water and the Estimation of the Optimum Feed Concentration of Coagulants in Rapid Mixing Process using an Artificial Neural Network Model (인공신경망 모형을 이용한 급속혼화공정에서 적정 응집제 주입농도 결정 및 응집처리후 탁도의 예측)

  • Jeong, Dong-Hwan;Park, Kyoohong
    • Journal of Korean Society on Water Environment
    • /
    • v.21 no.1
    • /
    • pp.21-28
    • /
    • 2005
  • The training and prediction modeling using an artificial neural network was implemented to predict the turbidity of treated water as well as to estimate the optimized feed concentration of polyaluminium chloride (PACl) in a water treatment plant. The parameters used in the input layers were pH, temperature, turbidity and alkalinity, while those in output layers were PACl and turbidity of treated water. Levenberg-Marquadt method of feedforward back-propagation perceptron in the neural network toolbox of MATLAB program was used in this study. Correlation coefficients of the training data with the measured data were 0.9997 for PACl and 0.6850 for turbidity and those of the testing data with measured data were 0.9140 for PACl and 0.3828 for turbidity, when four parameters at input layer, 12-12 nodes each at both the first and the second hidden layers, and two parameters(PACl and turbidity) at output layer were used. Although the predictability of PACl was improved, compared to that of the previous studies to use the only coagulant dose as output layer, turbidity in treated water could not be predicted well. Acquisition of more data through several years obtained with the advanced on-line measuring system could make the artificial neural network useful and practical in actual water treatment plants.

Development of Autonomous Algorithm Using an Online Feedback-Error Learning Based Neural Network for Nonholonomic Mobile Robots (온라인 피드백 에러 학습을 이용한 이동 로봇의 자율주행 알고리즘 개발)

  • Lee, Hyun-Dong;Myung, Byung-Soo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.21 no.5
    • /
    • pp.602-608
    • /
    • 2011
  • In this study, a method of designing a neurointerface using neural network (NN) is proposed for controlling nonholonomic mobile robots. According to the concept of virtual master-slave robots, in particular, a partially stable inverse dynamic model of the master robot is acquired online through the NN by applying a feedback-error learning method, in which the feedback controller is assumed to be based on a PD compensator for such a nonholonomic robot. The NN for the online feedback-error learning can composed that the input layer consists of six units for the inputs $x_i$, i=1~6, the hidden layer consists of two hidden units for hidden outputs $o_j$, j=1~2, and the output layer consists of two units for the outputs ${\tau}_k$, k=1~2. A tracking control problem is demonstrated by some simulations for a nonholonomic mobile robot with two-independent driving wheels. The initial q value was set to [0, 5, ${\pi}$].