• Title/Summary/Keyword: backpropagation algorithm

Search Result 350, Processing Time 0.025 seconds

Implementation of the Controller for intelligent Process System Using Neural Network (신경회로망을 이용한 지능형 가공 시스템 제어기 구현)

  • Son, Chang-U;kim, Gwan-Hyeong;Kim, Il;Tak, Han-Ho;Lee, Sang-Bae
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2000.11a
    • /
    • pp.376-379
    • /
    • 2000
  • In this paper, this system makes use of the analog infrered rays sensor and converts the feature of fish analog signal when sensor is operating with CPU(80C196KC). Then, After signal processing, this feature is classified a special feature and a outline of fish by using the neural network, one of the artificial intelligence scheme. This neural network classifies fish pattern of very simple and short calculation. This has linear activation function and the error backpropagation is used as a learning algorithm. And the neural network is learned in off-line process. Because an adaptation period of neural network is too long time when random initial weights are used, off-line learning is induced to decrease the progress time. We confirmed this method has better performance than somewhat outdated machines.

  • PDF

A Study on Loose Part Monitoring System in Nuclear Power Plant Based on Neural Network

  • Kim, Jung-Soo;Hwang, In-Koo;Kim, Jung-Tak;Moon, Byung-Soo;Lyou, Joon
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.2 no.2
    • /
    • pp.95-99
    • /
    • 2002
  • The Loose Part Monitoring System(LPMS) has been designed to detect. locate and evaluate detached or loosened parts and foreign objects in the reactor coolant system. In this paper, at first, we presents an application of the back propagation neural network. At the preprocessing step, the moving window average filter is adopted to reject the reject the low frequency background noise components. And then, extracting the acoustic signature such as Starting point of impact signal. Rising time. Half period. and Global time, they are used as the inputs to neural network . Secondly, we applied the neural network algorithm to LPMS in order to estimate the mass of loose parts. We trained the impact test data of YGN3 using the backpropagation method. The input parameter for training is Rising clime. Half Period amplitude. The result shored that the neural network would be applied to LPMS. Also, applying the neural network to thin practical false alarm data during startup and impact test signal at nuclear power plant, the false alarms are reduced effectively.

Computation of Noncentral F Probabilities using multilayer neural network (다층 신경 망을 이용한 비중심F분포 확률계산)

  • Gu, Sun-Hee
    • The KIPS Transactions:PartB
    • /
    • v.9B no.3
    • /
    • pp.271-276
    • /
    • 2002
  • The test statistic in ANOVA tests has a single or doubly noncentral F distribution and the noncentral F distribution is applied to the calculation of the power functions of tests of general linear hypotheses. Although various approximations of noncentral F distribution are suggested, they are troublesome to compute. In this paper, the calculation of noncentral F distribution is applied to the neural network theory, to solve the computation problem. The neural network consists of the multi-layer perceptron structure and learning process has the algorithm of the backpropagation. Using fables and figs, comparisons are made between the results obtained by neural network theory and the Patnaik's values. Regarding of accuracy and calculation, the results by neural network are efficient than the Patnaik's values.

A study on the control chart pattern for detecting shifts using neural network in start-up process (초기공정에서 공정변화에 대한 신경망을 이용한 관리도 형태 연구)

  • 이희춘
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.6 no.3
    • /
    • pp.65-70
    • /
    • 2001
  • This Paper Propose the control chart Pattern to provide a more comprehensive scheme for detecting process shifts using individual observations in start-up process. In this paper, which uses the backpropagation algorithm two samples are fed into the trained neural network to provide outputs ranging from 0 to 1. The main advantage of using neural networks approach with a control chart is that the neural network has almost no delay in detecting small shift. This paper illustrates how neural networks can provide a useful method for optimizing parameter(connection weights) that affect process control. Simulation results show that the performance of the proposed control chart using the neural network (NNCC) is quite promising.

  • PDF

A Study on Reliability Analysis According to the Number of Training Data and the Number of Training (훈련 데이터 개수와 훈련 횟수에 따른 과도학습과 신뢰도 분석에 대한 연구)

  • Kim, Sung Hyeock;Oh, Sang Jin;Yoon, Geun Young;Kim, Wan
    • Korean Journal of Artificial Intelligence
    • /
    • v.5 no.1
    • /
    • pp.29-37
    • /
    • 2017
  • The range of problems that can be handled by the activation of big data and the development of hardware has been rapidly expanded and machine learning such as deep learning has become a very versatile technology. In this paper, mnist data set is used as experimental data, and the Cross Entropy function is used as a loss model for evaluating the efficiency of machine learning, and the value of the loss function in the steepest descent method is We applied the Gradient Descent Optimize algorithm to minimize and updated weight and bias via backpropagation. In this way we analyze optimal reliability value corresponding to the number of exercises and optimal reliability value without overfitting. And comparing the overfitting time according to the number of data changes based on the number of training times, when the training frequency was 1110 times, we obtained the result of 92%, which is the optimal reliability value without overfitting.

Structural damage detection of steel bridge girder using artificial neural networks and finite element models

  • Hakim, S.J.S.;Razak, H. Abdul
    • Steel and Composite Structures
    • /
    • v.14 no.4
    • /
    • pp.367-377
    • /
    • 2013
  • Damage in structures often leads to failure. Thus it is very important to monitor structures for the occurrence of damage. When damage happens in a structure the consequence is a change in its modal parameters such as natural frequencies and mode shapes. Artificial Neural Networks (ANNs) are inspired by human biological neurons and have been applied for damage identification with varied success. Natural frequencies of a structure have a strong effect on damage and are applied as effective input parameters used to train the ANN in this study. The applicability of ANNs as a powerful tool for predicting the severity of damage in a model steel girder bridge is examined in this study. The data required for the ANNs which are in the form of natural frequencies were obtained from numerical modal analysis. By incorporating the training data, ANNs are capable of producing outputs in terms of damage severity using the first five natural frequencies. It has been demonstrated that an ANN trained only with natural frequency data can determine the severity of damage with a 6.8% error. The results shows that ANNs trained with numerically obtained samples have a strong potential for structural damage identification.

Deep learning-based sensor fault detection using S-Long Short Term Memory Networks

  • Li, Lili;Liu, Gang;Zhang, Liangliang;Li, Qing
    • Structural Monitoring and Maintenance
    • /
    • v.5 no.1
    • /
    • pp.51-65
    • /
    • 2018
  • A number of sensing techniques have been implemented for detecting defects in civil infrastructures instead of onsite human inspections in structural health monitoring. However, the issue of faults in sensors has not received much attention. This issue may lead to incorrect interpretation of data and false alarms. To overcome these challenges, this article presents a deep learning-based method with a new architecture of Stateful Long Short Term Memory Neural Networks (S-LSTM NN) for detecting sensor fault without going into details of the fault features. As LSTMs are capable of learning data features automatically, and the proposed method works without an accurate mathematical model. The detection of four types of sensor faults are studied in this paper. Non-stationary acceleration responses of a three-span continuous bridge when under operational conditions are studied. A deep network model is applied to the measured bridge data with estimation to detect the sensor fault. Another set of sensor output data is used to supervise the network parameters and backpropagation algorithm to fine tune the parameters to establish a deep self-coding network model. The response residuals between the true value and the predicted value of the deep S-LSTM network was statistically analyzed to determine the fault threshold of sensor. Experimental study with a cable-stayed bridge further indicated that the proposed method is robust in the detection of the sensor fault.

A piecewise affine approximation of sigmoid activation functions in multi-layered perceptrons and a comparison with a quantization scheme (다중계층 퍼셉트론 내 Sigmoid 활성함수의 구간 선형 근사와 양자화 근사와의 비교)

  • 윤병문;신요안
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.35C no.2
    • /
    • pp.56-64
    • /
    • 1998
  • Multi-layered perceptrons that are a nonlinear neural network model, have been widely used for various applications mainly thanks to good function approximation capability for nonlinear fuctions. However, for digital hardware implementation of the multi-layere perceptrons, the quantization scheme using "look-up tables (LUTs)" is commonly employed to handle nonlinear signmoid activation functions in the neworks, and thus requires large amount of storage to prevent unacceptable quantization errors. This paper is concerned with a new effective methodology for digital hardware implementation of multi-layered perceptrons, and proposes a "piecewise affine approximation" method in which input domain is divided into (small number of) sub-intervals and nonlinear sigmoid function is linearly approximated within each sub-interval. Using the proposed method, we develop an expression and an error backpropagation type learning algorithm for a multi-layered perceptron, and compare the performance with the quantization method through Monte Carlo simulations on XOR problems. Simulation results show that, in terms of learning convergece, the proposed method with a small number of sub-intervals significantly outperforms the quantization method with a very large storage requirement. We expect from these results that the proposed method can be utilized in digital system implementation to significantly reduce the storage requirement, quantization error, and learning time of the quantization method.quantization method.

  • PDF

Influence on overfitting and reliability due to change in training data

  • Kim, Sung-Hyeock;Oh, Sang-Jin;Yoon, Geun-Young;Jung, Yong-Gyu;Kang, Min-Soo
    • International Journal of Advanced Culture Technology
    • /
    • v.5 no.2
    • /
    • pp.82-89
    • /
    • 2017
  • The range of problems that can be handled by the activation of big data and the development of hardware has been rapidly expanded and machine learning such as deep learning has become a very versatile technology. In this paper, mnist data set is used as experimental data, and the Cross Entropy function is used as a loss model for evaluating the efficiency of machine learning, and the value of the loss function in the steepest descent method is We applied the GradientDescentOptimize algorithm to minimize and updated weight and bias via backpropagation. In this way we analyze optimal reliability value corresponding to the number of exercises and optimal reliability value without overfitting. And comparing the overfitting time according to the number of data changes based on the number of training times, when the training frequency was 1110 times, we obtained the result of 92%, which is the optimal reliability value without overfitting.

The Speed Control of an Induction Motor Based on Neural Networks (뉴럴 네트워크를 이용한 유도 전동기의 속도 제어)

  • Lee, Dong-Bin;Ryu, Chang-Wan;Hong, Dae-Seung;Ko, Jae-Ho;Yim, Wha-Yeong
    • Proceedings of the KIEE Conference
    • /
    • 1999.07b
    • /
    • pp.516-518
    • /
    • 1999
  • This paper presents an feed-forward neural network design instead PI controller for the speed control of an Induction Motor. The design employs the training strategy with Neural Network Controller(NNC) and Neural Network Emulator(NNE). Emulator identifies the motor by simulating the input and output map. In order to update the weights of the Controller. Emulator supplies the error path to the output stage of the controller using backpropagation algorithm. and then Controller produces an adequate output to the system due to neural networks learning capability. Therefore it becomes adjustable to the system with changing characteristics caused by a load. The speed control based on neural networks for induction motor is implemented by a vector controlled induction motor. The simulation results demonstrate that actual motor speed with neural network system well follows the reference speed minimizing the error and is available to implement on the vector control theory.

  • PDF