• Title/Summary/Keyword: Backpropagation neural network(BP)

Search Result 47, Processing Time 0.034 seconds

Uncertainty-Compensating Neural Network Control for Nonlinear Systems (비선형 시스템의 불확실성을 보상하는 신경회로망 제어)

  • Cho, Hyun-Seob;Oh, Myoung-Kwan
    • Proceedings of the KAIS Fall Conference
    • /
    • 2008.05a
    • /
    • pp.152-156
    • /
    • 2008
  • We consider the problem of constructing observers for nonlinear systems with unknown inputs. Connectionist networks, also called neural networks, have been broadly applied to solve many different problems since McCulloch and Pitts had shown mathematically their information processing ability in 1943. In this thesis, we present a genetic neuro-control scheme for nonlinear systems. Our method is different from those using supervised learning algorithms, such as the backpropagation (BP) algorithm, that needs training information in each step. The contributions of this thesis are the new approach to constructing neural network architecture and its training.

  • PDF

Principal Feature Extraction on Image Data Using Neural Networks of Learning Algorithm Based on Steepest Descent and Dynamic tunneling (기울기하강과 동적터널링에 기반을 둔 학습알고리즘의 신경망을 이용한 영상데이터의 주요특징추출)

  • Jo, Yong-Hyeon
    • The Transactions of the Korea Information Processing Society
    • /
    • v.6 no.5
    • /
    • pp.1393-1402
    • /
    • 1999
  • This paper proposes an efficient principal feature extraction of the image data using neural networks of a new learning algorithm. The proposed learning algorithm is a backpropagation(BP) algorithm based on the steepest descent and dynamic tunneling. The BP algorithm based on the steepest descent is applied for high-speed optimization, and the BP algorithm based on the dynamic tunneling is also applied for global optimization. Converging to the local minimum by the BP algorithm of steepest descent, the new initial weights for escaping the local minimum is estimated by the BP algorithm of dynamic tunneling. The proposed algorithm has been applied to the 3 image data of 12${\times}$12pixels and the Lenna image of 128${\times}$128 pixels respectively. The simulation results shows that the proposed algorithm has better performances of the convergence and the feature extraction, in comparison with those using the Sanger method and the Foldiak method for single-layer neural networks and the BP algorithm for multilayer neural network.

  • PDF

Text-Independent Speaker Identification System Based On Vowel And Incremental Learning Neural Networks

  • Heo, Kwang-Seung;Lee, Dong-Wook;Sim, Kwee-Bo
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.1042-1045
    • /
    • 2003
  • In this paper, we propose the speaker identification system that uses vowel that has speaker's characteristic. System is divided to speech feature extraction part and speaker identification part. Speech feature extraction part extracts speaker's feature. Voiced speech has the characteristic that divides speakers. For vowel extraction, formants are used in voiced speech through frequency analysis. Vowel-a that different formants is extracted in text. Pitch, formant, intensity, log area ratio, LP coefficients, cepstral coefficients are used by method to draw characteristic. The cpestral coefficients that show the best performance in speaker identification among several methods are used. Speaker identification part distinguishes speaker using Neural Network. 12 order cepstral coefficients are used learning input data. Neural Network's structure is MLP and learning algorithm is BP (Backpropagation). Hidden nodes and output nodes are incremented. The nodes in the incremental learning neural network are interconnected via weighted links and each node in a layer is generally connected to each node in the succeeding layer leaving the output node to provide output for the network. Though the vowel extract and incremental learning, the proposed system uses low learning data and reduces learning time and improves identification rate.

  • PDF

Dynamic Neural Units and Genetic Algorithms With Applications to the Control of Unknown Nonlinear Systems (Dynamic Neural Unit와 GA를 이용한 비선형 동적 시스템 제어)

  • Cho, Hyeon-Seob;Roh, Yong-Gi;Jang, Sung-Whan
    • Proceedings of the KAIS Fall Conference
    • /
    • 2006.05a
    • /
    • pp.311-315
    • /
    • 2006
  • "Dynamic Neural Unit"(DNU) based upon the topology of a reverberating circuit in a neuronal pool of the central nervous system. In this thesis, we present a genetic DNU-control scheme for unknown nonlinear systems. Our methodis different from those using supervised learning algorithms, such as the backpropagation (BP) algorithm, that needs training information in each step. The contributions of this thesis are the new approach to constructing neural network architecture and its trainin

  • PDF

Self-Learning Control of Cooperative Motion for Humanoid Robots

  • Hwang, Yoon-Kwon;Choi, Kook-Jin;Hong, Dae-Sun
    • International Journal of Control, Automation, and Systems
    • /
    • v.4 no.6
    • /
    • pp.725-735
    • /
    • 2006
  • This paper deals with the problem of self-learning cooperative motion control for the pushing task of a humanoid robot in the sagittal plane. A model with 27 linked rigid bodies is developed to simulate the system dynamics. A simple genetic algorithm(SGA) is used to find the cooperative motion, which is to minimize the total energy consumption for the entire humanoid robot body. And the multi-layer neural network based on backpropagation(BP) is also constructed and applied to generalize parameters, which are obtained from the optimization procedure by SGA, in order to control the system.

Prediction of concrete strength in presence of furnace slag and fly ash using Hybrid ANN-GA (Artificial Neural Network-Genetic Algorithm)

  • Shariati, Mahdi;Mafipour, Mohammad Saeed;Mehrabi, Peyman;Ahmadi, Masoud;Wakil, Karzan;Trung, Nguyen Thoi;Toghroli, Ali
    • Smart Structures and Systems
    • /
    • v.25 no.2
    • /
    • pp.183-195
    • /
    • 2020
  • Mineral admixtures have been widely used to produce concrete. Pozzolans have been utilized as partially replacement for Portland cement or blended cement in concrete based on the materials' properties and the concrete's desired effects. Several environmental problems associated with producing cement have led to partial replacement of cement with other pozzolans. Furnace slag and fly ash are two of the pozzolans which can be appropriately used as partial replacements for cement in concrete. However, replacing cement with these materials results in significant changes in the mechanical properties of concrete, more specifically, compressive strength. This paper aims to intelligently predict the compressive strength of concretes incorporating furnace slag and fly ash as partial replacements for cement. For this purpose, a database containing 1030 data sets with nine inputs (concrete mix design and age of concrete) and one output (the compressive strength) was collected. Instead of absolute values of inputs, their proportions were used. A hybrid artificial neural network-genetic algorithm (ANN-GA) was employed as a novel approach to conducting the study. The performance of the ANN-GA model is evaluated by another artificial neural network (ANN), which was developed and tuned via a conventional backpropagation (BP) algorithm. Results showed that not only an ANN-GA model can be developed and appropriately used for the compressive strength prediction of concrete but also it can lead to superior results in comparison with an ANN-BP model.

Dynamic Neural Units and Genetic Algorithms With Applications to the Control of Unknown Nonlinear Systems (동적 신경망과 Geneo-tic Algorithms를 적용한 비선형 시스템의 제어)

  • Cho, Hyun-Seob;Min, Jin-Kyoung;Roh, Yong-Gi;Jung, Byung-Jo;Jang, Sung-Whan
    • Proceedings of the KIEE Conference
    • /
    • 2006.07d
    • /
    • pp.1943-1944
    • /
    • 2006
  • "Dynamic Neural Unit"(DNU) based upon the topology of a reverberating circuit in a neuronal pool of the central nervous system. In this thesis, we present a genetic DNU-control scheme for unknown nonlinear systems. Our methodis different from those using supervised learning algorithms, such as the backpropagation (BP) algorithm, that needs training information in each step. The contributions of this thesis are the new approach to constructing neural network architecture and its trainin

  • PDF

Dynamic Neural Units and Genetic Algorithms With Applications to the Optimal Control of Nonlinear Systems (신경망과 유전 알고리즘을 사용한 비선형 시스템의 최적 제어)

  • Cho Hyeon-Seob;Min Jin-Kyoung;Lee Hyung-Chung
    • Proceedings of the KAIS Fall Conference
    • /
    • 2004.06a
    • /
    • pp.217-220
    • /
    • 2004
  • 'Dynamic Neural Unit'(DNU) based upon the topology of a reverberating circuit in a neuronal pool of the central nervous system. In this thesis, we present a genetic DNU-control scheme for unknown nonlinear systems. Our methodis different from those using supervised loaming algorithms, such as the backpropagation (BP) algorithm, that needs training information In each step. The contributions of this thesis are the new approach to constructing neural network architecture and its trainin.

  • PDF

FIGURE ALPHABET HYPOTHESIS INSPIRED NEURAL NETWORK RECOGNITION MODEL

  • Ohira, Ryoji;Saiki, Kenji;Nagao, Tomoharu
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2009.01a
    • /
    • pp.547-550
    • /
    • 2009
  • The object recognition mechanism of human being is not well understood yet. On research of animal experiment using an ape, however, neurons that respond to simple shape (e.g. circle, triangle, square and so on) were found. And Hypothesis has been set up as human being may recognize object as combination of such simple shapes. That mechanism is called Figure Alphabet Hypothesis, and those simple shapes are called Figure Alphabet. As one way to research object recognition algorithm, we focused attention to this Figure Alphabet Hypothesis. Getting idea from it, we proposed the feature extraction algorithm for object recognition. In this paper, we described recognition of binarized images of multifont alphabet characters by the recognition model which combined three-layered neural network in the feature extraction algorithm. First of all, we calculated the difference between the learning image data set and the template by the feature extraction algorithm. The computed finite difference is a feature quantity of the feature extraction algorithm. We had it input the feature quantity to the neural network model and learn by backpropagation (BP method). We had the recognition model recognize the unknown image data set and found the correct answer rate. To estimate the performance of the contriving recognition model, we had the unknown image data set recognized by a conventional neural network. As a result, the contriving recognition model showed a higher correct answer rate than a conventional neural network model. Therefore the validity of the contriving recognition model could be proved. We'll plan the research a recognition of natural image by the contriving recognition model in the future.

  • PDF

Neuro-Control of Nonlinear Systems Using Genetic Algorithms (Genetic Algorithms를 이용한 비선형 시스템의 신경망 제어)

  • Cho, Hyeon-Seob;Min, Jin-Kyoung;Ryu, In-Ho
    • Proceedings of the KAIS Fall Conference
    • /
    • 2006.05a
    • /
    • pp.316-319
    • /
    • 2006
  • Connectionist networks, also called neural networks, have been broadly applied to solve many different problems since McCulloch and Pitts had shown mathematically their information processing ability in 1943. In this thesis, we present a genetic neuro-control scheme for nonlinear systems. Our method is different from those using supervised learning algorithms, such as the backpropagation (BP) algorithm, that needs training information in each step. The contributions of this thesis are the new approach to constructing neural network architecture and its training.

  • PDF