• Title/Summary/Keyword: backpropagation algorithm

Search Result 350, Processing Time 0.026 seconds

REVISING THE TRADITIONAL BACKPROPAGATION WITH THE METHOD OF VARIABLE METRIC(QUASI-NEWTON) AND APPROXIMATING A STEP SIZE

  • Choe, Sang-Woong;Lee, Jin-Choon
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1998.06a
    • /
    • pp.118-121
    • /
    • 1998
  • In this paper, we propose another paradigm(QNBP) to be capable of overcoming Limitations of the traditional backpropagation(SDBP). QNBPis based on the method of Quasi -Newton(variable metric) with the nomalized direction vectors and computes step size through the linear search. Simulation results showed that QNBP was definitely superior to both the stochasitc SDBP and the deterministic SDBP in terms of accuracy and rate of convergence and might sumount the problem of local minima. and there was no different between DFP+SR1 and BFGS+SR1 combined algrothms in QNBP.

  • PDF

Identification of the Chip Form Using Neural Network (신경망을 이용한 칩 형태의 인식)

  • 심재형;권혁준;백인환
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.15 no.12
    • /
    • pp.106-112
    • /
    • 1998
  • A major problem in automation of turning operations is the difficulty in obtaining a sufficient and reliable chip control. The chip should be detected in order to provide a optimum chip control for unmanned turning operation. Using the difference of energy radiated from the chip, chip Patterns are estimated using pyrometer. From the initial output from the pyrometer, chips are identified according to the backpropagation algorithm developed in the research. The learning system developed in this work can be applied in real-time control of turning process with minor modification in drive system.

  • PDF

The Prediction of 'Slice' Using Neural Network in Golf Swing (골프스윙시 인공지능 을 이용한 (Neural Network) 슬라이스 예측에 관한 연구)

  • 심태용;오승일;신성휴;이상식;문정환
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2004.10a
    • /
    • pp.1221-1224
    • /
    • 2004
  • In this study, we developed a method classifying slice shot during golf practice using backpropagation algorithm. The 144 data based on the backpropagation model(11 inputs, 2 outputs) was used as a learning set and the model was verified based on the extra 50 data in the process to predict a slice shot in golf swing. The results showed 100% separating rate of learning set and 91.5% separating rate of verified set. The developed method can be potentially beneficial for the predicting of slice shot in an indoor golf excercise setting without applying any additional equipment.

  • PDF

Input-Output Linearization of Nonlinear Systems via Dynamic Feedback (비선형 시스템의 동적 궤환 입출력 선형화)

  • Cho, Hyun-Seob
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.6 no.4
    • /
    • pp.238-242
    • /
    • 2013
  • We consider the problem of constructing observers for nonlinear systems with unknown inputs. Connectionist networks, also called neural networks, have been broadly applied to solve many different problems since McCulloch and Pitts had shown mathematically their information processing ability in 1943. In this thesis, we present a genetic neuro-control scheme for nonlinear systems. Our method is different from those using supervised learning algorithms, such as the backpropagation (BP) algorithm, that needs training information in each step. The contributions of this thesis are the new approach to constructing neural network architecture and its training.

A Producer's Allocation Policy Considering Buyers' Demands in the Supply Chain (공급사슬에서의 구매자의 수요를 고려한 생산자의 제품 할당 정책)

  • Eum, Seung Chul;Lee, Young Hae;Jung, Jung Woo
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.31 no.3
    • /
    • pp.210-218
    • /
    • 2005
  • In the current global business environment, it is very important how to allocate products from the producer to buyers (or distributors). Sometimes some buyers can order more than pertinent demand due to inappropriate forecasting customers' orders. This is the big obstacle to the efficient allocation of products. If the producer can become aware of buyers' pertinent demand, it is possible to realize the high-level order fulfillment through the effective allocation of products. In this study, a new allocation policy is proposed considering buyers' demands. The backpropagation algorithm, one of algorithms in neural network theory, is used to find pertinent demands from the distributors' orders. In the experiment, an allocation policy considering buyers' demands outperforms previous allocation policies.

An Emphirical Closed Loop Modeling of a Suspension System using a Neural Networks (신경회로망을 이용한 폐회로 현가장치의 시스템 모델링)

  • 김일영;정길도;노태수;홍동표
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 1996.11a
    • /
    • pp.384-388
    • /
    • 1996
  • The closed-loop system modeling of an Active/semiactive suspension system has been accomplished through an artificial neural Networks. The 7DOF full model as the system equation of motion has been derived and the output feedback linear quadratic regulator has been designed for the control purpose. For the neural networks training set of a sample data has been obtained through the computer simulation. A 7DOF full model with LQR controller simulated under the several road conditions such as sinusoidal bumps and the rectangular bumps. A general multilayer perceptron neural network is used for the dynamic modeling and the target outputs are feedback to the input layer. The Backpropagation method is used as the training algorithm. The modeling of system and the model validation have been shown through computer simulations.

  • PDF

The Real-time Printed Alphabets Recognition using Artificial Neural Networks (인공신경망을 이용한 실시간 영문인쇄체 인식)

  • 심성균;정원용
    • Proceedings of the Korea Institute of Convergence Signal Processing
    • /
    • 2001.06a
    • /
    • pp.149-152
    • /
    • 2001
  • The goals of this papper are not only to maximize of performance but also to reduce the response time for the real-time printed alphabets recognition system using the backpropagation algorithm in the artificial neural network. The Genesis board and MIL(Matrox Image Library) package were used to real-time acquisition, processing and display of images. Through this experiment proved the possibility of real-time recognition processing by comparing response times of the system and proposing the method to reduce of order of the output vectors.

  • PDF

A Study on Methodology of Soil Resistivity Estimation Using the BP (역전과 알고리즘(BP)을 이용한 대지저항률 추청 방법에 관한 연구)

  • Ryu, Bo-Hyeok;Wi, Won-Seok;Kim, Jeong-Hun
    • The Transactions of the Korean Institute of Electrical Engineers A
    • /
    • v.51 no.2
    • /
    • pp.76-82
    • /
    • 2002
  • This paper presents the method of sail-resistivity estimation using the backpropagation(BP) neural network. Existing estimation programs are expensive, and their estimation methods need complex techniques and take much time. Also, those programs have not become well spreaded in Korea yet. Soil resistivity estimation method using BP algorithm has studied for the reason mentioned above. This paper suggests the method which differs from expensive program or graphic technology requiring many input stages, complicated calculation and professional knowledge. The equivalent earth resistivity can be presented immediately after inputting apparent resistivity through the personal computer with a simplified Program without many Processing stages. This program has the advantages of reasonable accuracy, rapid processing time and confident of anti users.

A Study on the Neuro-Fuzzy Control for an Inverted Pendulum System (도립진자 시스템의 뉴로-퍼지 제어에 관한 연구)

  • 소명옥;류길수
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.20 no.4
    • /
    • pp.11-19
    • /
    • 1996
  • Recently, fuzzy and neural network techniques have been successfully applied to control of complex and ill-defined system in a wide variety of areas, such as robot, water purification, automatic train operation system and automatic container crane operation system, etc. In this paper, we present a neuro-fuzzy controller which unifies both fuzzy logic and multi-layered feedforward neural networks. Fuzzy logic provides a means for converting linguistic control knowledge into control actions. On the other hand, feedforward neural networks provide salient features, such as learning and parallelism. In the proposed neuro-fuzzy controller, the parameters of membership functions in the antecedent part of fuzzy inference rules are identified by using the error backpropagation algorithm as a learning rule, while the coefficients of the linear combination of input variables in the consequent part are determined by using the least square estimation method. Finally, the effectiveness of the proposed controller is verified through computer simulation of an inverted pendulum system.

  • PDF

Heart Attack Prediction using Neural Network and Different Online Learning Methods

  • Antar, Rayana Khaled;ALotaibi, Shouq Talal;AlGhamdi, Manal
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.6
    • /
    • pp.77-88
    • /
    • 2021
  • Heart Failure represents a critical pathological case that is challenging to predict and discover at an early age, with a notable increase in morbidity and mortality. Machine Learning and Neural Network techniques play a crucial role in predicting heart attacks, diseases and more. These techniques give valuable perspectives for clinicians who may then adjust their diagnosis for each individual patient. This paper evaluated neural network models for heart attacks predictions. Several online learning methods were investigated to automatically and accurately predict heart attacks. The UCI dataset was used in this work to train and evaluate First Order and Second Order Online Learning methods; namely Backpropagation, Delta bar Delta, Levenberg Marquardt and QuickProp learning methods. An optimizer technique was also used to minimize the random noise in the database. A regularization concept was employed to further improve the generalization of the model. Results show that a three layers' NN model with a Backpropagation algorithm and Nadam optimizer achieved a promising accuracy for the heart attach prediction tasks.