• Title/Summary/Keyword: feed forward neural network

Search Result 172, Processing Time 0.032 seconds

A Gait Phase Classifier using a Recurrent Neural Network (순환 신경망을 이용한 보행단계 분류기)

  • Heo, Won ho;Kim, Euntai;Park, Hyun Sub;Jung, Jun-Young
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.21 no.6
    • /
    • pp.518-523
    • /
    • 2015
  • This paper proposes a gait phase classifier using a Recurrent Neural Network (RNN). Walking is a type of dynamic system, and as such it seems that the classifier made by using a general feed forward neural network structure is not appropriate. It is known that an RNN is suitable to model a dynamic system. Because the proposed RNN is simple, we use a back propagation algorithm to train the weights of the network. The input data of the RNN is the lower body's joint angles and angular velocities which are acquired by using the lower limb exoskeleton robot, ROBIN-H1. The classifier categorizes a gait cycle as two phases, swing and stance. In the experiment for performance verification, we compared the proposed method and general feed forward neural network based method and showed that the proposed method is superior.

Classification System of EEG Signals During Mental Tasks

  • Seo Hee Don;Kim Min Soo;Eoh Soo Hae;Huang Xiyue;Rajanna K.
    • Proceedings of the IEEK Conference
    • /
    • 2004.08c
    • /
    • pp.671-674
    • /
    • 2004
  • We propose accurate classification method of EEG signals during mental tasks. In the experimental task, the tasks of subjects show 3 major measurements; there are mathematical tasks, color decision tasks, and Chinese phrase tasks. The classifier implemented for this work is a feed-forward neural network that trained with the error back-propagation algorithm. The new BCI system is proposed by using neural network. In this system, tr e architecture of the neural network is composed of three layers with a feed-forward network, which implements the error back propagation-learning algorithm. By applying this algorithm to 4 subjects, we achieved $95{\%}$ classification rates. The results for BCI mathematical task experiments show performance better than those of the Chinese phrase tasks. The selection time of each task depends on the mental task of subjects. We expect that the proposed detection method can be a basic technology for brain-computer interface by combining with left/right hand movement or yes/no discrimination methods.

  • PDF

Comparison of Objective Functions for Feed-forward Neural Network Classifiers Using Receiver Operating Characteristics Graph

  • Oh, Sang-Hoon;Wakuya, Hiroshi
    • International Journal of Contents
    • /
    • v.10 no.1
    • /
    • pp.23-28
    • /
    • 2014
  • When developing a classifier using various objective functions, it is important to compare the performances of the classifiers. Although there are statistical analyses of objective functions for classifiers, simulation results can provide us with direct comparison results and in this case, a comparison criterion is considerably critical. A Receiver Operating Characteristics (ROC) graph is a simulation technique for comparing classifiers and selecting a better one based on a performance. In this paper, we adopt the ROC graph to compare classifiers trained by mean-squared error, cross-entropy error, classification figure of merit, and the n-th order extension of cross-entropy error functions. After the training of feed-forward neural networks using the CEDAR database, the ROC graphs are plotted to help us identify which objective function is better.

Contour Plots of Objective Functions for Feed-Forward Neural Networks

  • Oh, Sang-Hoon
    • International Journal of Contents
    • /
    • v.8 no.4
    • /
    • pp.30-35
    • /
    • 2012
  • Error surfaces provide us with very important information for training of feed-forward neural networks (FNNs). In this paper, we draw the contour plots of various error or objective functions for training of FNNs. Firstly, when applying FNNs to classifications, the weakness of mean-squared error is explained with the viewpoint of error contour plot. And the classification figure of merit, mean log-square error, cross-entropy error, and n-th order extension of cross-entropy error objective functions are considered for the contour plots. Also, the recently proposed target node method is explained with the viewpoint of contour plot. Based on the contour plots, we can explain characteristics of various error or objective functions when training of FNNs proceeds.

A study on the adaptive control used in a system with variable load (가변부하시스템에서의 적응제어에 관한 연구)

  • 강대규;전내석;이성근;김윤식;안병원;박영산
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.5 no.6
    • /
    • pp.1122-1127
    • /
    • 2001
  • This paper proposed a speed adaptive control system with load torque observer and feed-forward compensation using neural network for air compressor system driven an induction motor. The motor receive impact load change under the influence of piston movement of up and down, and so it difficult to obtain good speed control characteristics. With real-time adjusting control gain estimated in neural network, control characteristics of motor is improved. The validity of the proposed system is confirmed through the theoretical analysis and computer simulation.

  • PDF

A study on the adaptive control used in a system with variable load (가변부하시스템에서의 적응제어에 관한 연구)

  • 강대규;전내석;이성근;김윤식;안병원;박영산
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2001.10a
    • /
    • pp.397-400
    • /
    • 2001
  • This paper proposed a speed adaptive control system with load torque observer and feed-forward compensation using neural network for air compressor system driven an induction motor. The motor receive impact load change under the influence of piston movement of up and down, and so it difficult to obtain good speed control characteristics. With real-time adjusting control gain estimated in neural network, control characteristics of motor is improved. The validity of the proposed system is confirmed through the theoretical analysis and computer simulation.

  • PDF

A Comparison Study of MIMO Water Wall Model with Linear, MFNN and ESN Models

  • Moon, Un-Chul;Lim, Jaewoo;Lee, Kwang Y.
    • Journal of Electrical Engineering and Technology
    • /
    • v.11 no.2
    • /
    • pp.265-273
    • /
    • 2016
  • A water wall system is one of the most important components of a boiler in a thermal power plant, and it is a nonlinear Multi-Input and Multi-Output (MIMO) system, with 6 inputs and 3 outputs. Three models are developed and comp for the controller design, including a linear model, a multilayer feed-forward neural network (MFNN) model and an Echo State Network (ESN) model. First, the linear model is developed by linearizing a given nonlinear model and is analyzed as a function of the operating point. Second, the MFNN and the ESN are developed by using training data from the nonlinear model. The three models are validated using Matlab with nonlinear input-output data that was not used during training.

The Structure of Boundary Decision Using the Back Propagation Algorithms (역전파 알고리즘을 이용한 경계결정의 구성에 관한 연구)

  • Lee, Ji-Young
    • The Journal of Information Technology
    • /
    • v.8 no.1
    • /
    • pp.51-56
    • /
    • 2005
  • The Back propagation algorithm is a very effective supervised training method for multi-layer feed forward neural networks. This paper studies the decision boundary formation based on the Back propagation algorithm. The discriminating powers of several neural network topology are also investigated against five manually created data sets. It is found that neural networks with multiple hidden layer perform better than single hidden layer.

  • PDF

The nonlinear function approximation based on the neural network application

  • Sugisaka, Masanori;Itou, Minoru
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.462-462
    • /
    • 2000
  • In this paper, genetic algorithm (GA) is the technique to search for the optimal structures (i,e., the kind of neural network, the number of hidden neuron, ..) of the neural networks which are used approximating a given nonlinear function, In this paper, we used multi layer feed-forward neural network. The decision method of synapse weights of each neuron in each generation used back-propagation method. In this study, we simulated nonlinear function approximation in the temperature control system.

  • PDF

Structure Optimization of Neural Networks using Rough Set Theory (러프셋 이론을 이용한 신경망의 구조 최적화)

  • 정영준;이동욱;심귀보
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1998.03a
    • /
    • pp.49-52
    • /
    • 1998
  • Neural Network has good performance in pattern classification, control and many other fields by learning ability. However, there is effective rule or systematic approach to determine optimal structure. In this paper, we propose a new method to find optimal structure of feed-forward multi-layer neural network as a kind of pruning method. That eliminating redundant elements of neural network. To find redundant elements we analysis error and weight changing with Rough Set Theory, in condition of executing back-propagation leaning algorithm.

  • PDF