• Title/Summary/Keyword: multi multi-layer neural networks

Search Result 223, Processing Time 0.036 seconds

Advanced Self-Organizing Neural Networks Based on Competitive Fuzzy Polynomial Neurons (경쟁적 퍼지다항식 뉴런에 기초한 고급 자기구성 뉴럴네트워크)

  • 박호성;박건준;이동윤;오성권
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.53 no.3
    • /
    • pp.135-144
    • /
    • 2004
  • In this paper, we propose competitive fuzzy polynomial neurons-based advanced Self-Organizing Neural Networks(SONN) architecture for optimal model identification and discuss a comprehensive design methodology supporting its development. The proposed SONN dwells on the ideas of fuzzy rule-based computing and neural networks. And it consists of layers with activation nodes based on fuzzy inference rules and regression polynomial. Each activation node is presented as Fuzzy Polynomial Neuron(FPN) which includes either the simplified or regression polynomial fuzzy inference rules. As the form of the conclusion part of the rules, especially the regression polynomial uses several types of high-order polynomials such as linear, quadratic, and modified quadratic. As the premise part of the rules, both triangular and Gaussian-like membership (unction are studied and the number of the premise input variables used in the rules depends on that of the inputs of its node in each layer. We introduce two kinds of SONN architectures, that is, the basic and modified one with both the generic and the advanced type. Here the basic and modified architecture depend on the number of input variables and the order of polynomial in each layer. The number of the layers and the nodes in each layer of the SONN are not predetermined, unlike in the case of the popular multi-layer perceptron structure, but these are generated in a dynamic way. The superiority and effectiveness of the Proposed SONN architecture is demonstrated through two representative numerical examples.

Evolutionally optimized Fuzzy Polynomial Neural Networks Based on Fuzzy Relation and Genetic Algorithms: Analysis and Design (퍼지관계와 유전자 알고리즘에 기반한 진화론적 최적 퍼지다항식 뉴럴네트워크: 해석과 설계)

  • Park, Byoung-Jun;Lee, Dong-Yoon;Oh, Sung-Kwun
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.15 no.2
    • /
    • pp.236-244
    • /
    • 2005
  • In this study, we introduce a new topology of Fuzzy Polynomial Neural Networks(FPNN) that is based on fuzzy relation and evolutionally optimized Multi-Layer Perceptron, discuss a comprehensive design methodology and carry out a series of numeric experiments. The construction of the evolutionally optimized FPNN(EFPNN) exploits fundamental technologies of Computational Intelligence. The architecture of the resulting EFPNN results from a synergistic usage of the genetic optimization-driven hybrid system generated by combining rule-based Fuzzy Neural Networks(FNN) with polynomial neural networks(PNN). FNN contributes to the formation of the premise part of the overall rule-based structure of the EFPNN. The consequence part of the EFPNN is designed using PNN. As the consequence part of the EFPNN, the development of the genetically optimized PNN(gPNN) dwells on two general optimization mechanism: the structural optimization is realized via GAs whereas in case of the parametric optimization we proceed with a standard least square method-based learning. To evaluate the performance of the EFPNN, the models are experimented with the use of several representative numerical examples. A comparative analysis shows that the proposed EFPNN are models with higher accuracy as well as more superb predictive capability than other intelligent models presented previously.

The Capacity of Core-Net : Multi-Level 2-Layer Neural Networks (2층 다단 신경망회로 코어넷의 처리용량에 관한 연구)

  • Park, Jong-Jun
    • The Transactions of the Korea Information Processing Society
    • /
    • v.6 no.8
    • /
    • pp.2098-2115
    • /
    • 1999
  • One of the unsolved problems in Neural Networks is the interpretation of hidden layers. This paper defines the Core-Net which has an input(p levels) and an output(q levels) with 2-layers as a basic circuit of neural network. In have suggested an equation, {{{{ {a}_{p,q} = {{q}^{2}} over {2}p(p-1)- { q} over {2 } (3 { p}^{2 } -7p+2)+ { p}^{2 }-3p+2}}}}, whichs ws the capacity of the Core-Net and have proved it by using the mathematical induction. It has been also shown that some of the problems with hidden layers can be solved by using the Core-Net and using simulation of an example.

  • PDF

A Study on the Number Recognition using Cellular Neural Network (Cellular Neural Network을 이용한 숫자인식에 관한 연구)

  • 전흥우;김명관;정금섭
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.6 no.6
    • /
    • pp.819-826
    • /
    • 2002
  • Cellular neural networks(CNN) are neural networks that have locally connected characteristics and real-time image processing. Locally connected characteristics are suitable for VLSI implementation. It also has applications in such areas as image processing and pattern recognition. In this thesis cellular neural networks are used for feature detection in number recognition at the stage of re-processing. The four or six directional shadow detectors are used in numbers recognition. At the stage of classification, this result of feature detection was simulated by using a multi-layer back Propagation neural network. The experiments indicate that the CNN feature detectors capture good features for number recognition tasks.

Emotion Recognition and Expression System of User using Multi-Modal Sensor Fusion Algorithm (다중 센서 융합 알고리즘을 이용한 사용자의 감정 인식 및 표현 시스템)

  • Yeom, Hong-Gi;Joo, Jong-Tae;Sim, Kwee-Bo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.18 no.1
    • /
    • pp.20-26
    • /
    • 2008
  • As they have more and more intelligence robots or computers these days, so the interaction between intelligence robot(computer) - human is getting more and more important also the emotion recognition and expression are indispensable for interaction between intelligence robot(computer) - human. In this paper, firstly we extract emotional features at speech signal and facial image. Secondly we apply both BL(Bayesian Learning) and PCA(Principal Component Analysis), lastly we classify five emotions patterns(normal, happy, anger, surprise and sad) also, we experiment with decision fusion and feature fusion to enhance emotion recognition rate. The decision fusion method experiment on emotion recognition that result values of each recognition system apply Fuzzy membership function and the feature fusion method selects superior features through SFS(Sequential Forward Selection) method and superior features are applied to Neural Networks based on MLP(Multi Layer Perceptron) for classifying five emotions patterns. and recognized result apply to 2D facial shape for express emotion.

A Study on Multi-layer Fuzzy Inference System based on a Modified GMDH Algorithm (수정된 GMDH 알고리즘 기반 다층 퍼지 추론 시스템에 관한 연구)

  • Park, Byoung-Jun;Park, Chun-Seong;Oh, Sung-Kwun
    • Proceedings of the KIEE Conference
    • /
    • 1998.11b
    • /
    • pp.675-677
    • /
    • 1998
  • In this paper, we propose the fuzzy inference algorithm with multi-layer structure. MFIS(Multi-layer Fuzzy Inference System) uses PNN(Polynomial Neural networks) structure and the fuzzy inference method. The PNN is the extended structure of the GMDH(Group Method of Data Hendling), and uses several types of polynomials such as linear, quadratic and cubic, as well as the biquadratic polynomial used in the GMDH. In the fuzzy inference method, the simplified and regression polynomial inference methods are used. Here, the regression polynomial inference is based on consequence of fuzzy rules with the polynomial equations such as linear, quadratic and cubic equation. Each node of the MFIS is defined as fuzzy rules and its structure is a kind of neuro-fuzzy structure. We use the training and testing data set to obtain a balance between the approximation and the generalization of process model. Several numerical examples are used to evaluate the performance of the our proposed model.

  • PDF

Neural Network Active Control of Structures with Earthquake Excitation

  • Cho Hyun Cheol;Fadali M. Sami;Saiidi M. Saiid;Lee Kwon Soon
    • International Journal of Control, Automation, and Systems
    • /
    • v.3 no.2
    • /
    • pp.202-210
    • /
    • 2005
  • This paper presents a new neural network control for nonlinear bridge systems with earthquake excitation. We design multi-layer neural network controllers with a single hidden layer. The selection of an optimal number of neurons in the hidden layer is an important design step for control performance. To select an optimal number of hidden neurons, we progressively add one hidden neuron and observe the change in a performance measure given by the weighted sum of the system error and the control force. The number of hidden neurons which minimizes the performance measure is selected for implementation. A neural network was trained for mitigating vibrations of bridge systems caused by El Centro earthquake. We applied the proposed control approach to a single-degree-of-freedom (SDOF) and a two-degree-of-freedom (TDOF) bridge system. We assessed the robustness of the control system using randomly generated earthquake excitations which were not used in training the neural network. Our results show that the neural network controller drastically mitigates the effect of the disturbance.

Non linear vibrations of stepped beam systems using artificial neural networks

  • Bagdatli, S.M.;Ozkaya, E.;Ozyigit, H.A.;Tekin, A.
    • Structural Engineering and Mechanics
    • /
    • v.33 no.1
    • /
    • pp.15-30
    • /
    • 2009
  • In this study, the nonlinear vibrations of stepped beams having different boundary conditions were investigated. The equations of motions were obtained by using Hamilton's principle and made non dimensional. The stretching effect induced non-linear terms to the equations. Natural frequencies are calculated for different boundary conditions, stepped ratios and stepped locations by Newton-Raphson Method. The corresponding nonlinear correction coefficients are also calculated for the fundamental mode. At the second part, an alternative method is produced for the analysis. The calculated natural frequencies and nonlinear corrections are used for training an artificial neural network (ANN) program which has a multi-layer, feed-forward, back-propagation algorithm. The results of the algorithm produce errors less than 2.5% for linear case and 10.12% for nonlinear case. The errors are much lower for most cases except clamped-clamped end condition. By employing the ANN algorithm, the natural frequencies and nonlinear corrections are easily calculated by little errors, and the computational time is drastically reduced compared with the conventional numerical techniques.

Neural network analysis of water pollution for a main river, Tamagawa, in Tokyo metropolis

  • Yuan, Yan;Kambe, Junko;Aoyama, T.;Nagashima, U.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2004.08a
    • /
    • pp.1078-1083
    • /
    • 2004
  • We proposed a method to compensate incomplete observations and made a study of environmental problem, water quality of Tama-River in Tokyo.The method is based on interpolations of the multi-layer neural networks. We call the approach as CQSAR method .which can compensate the defect data.The water quality data include defects which will give wrong effect to other normal data. The CQSAR method suppresses the wrong effect .Thus, we believe that the proposed CQSAR method has practical usability for environment examinations.

  • PDF

Detection of Abnormal Signals in Gas Pipes Using Neural Networks

  • Min, Hwang-Ki;Park, Cheol-Hoon
    • Proceedings of the IEEK Conference
    • /
    • 2008.06a
    • /
    • pp.669-670
    • /
    • 2008
  • In this paper, we present a real-time system to detect abnormal events on gas pipes, based on the signals which are observed through the audio sensors attached on them. First, features are extracted from these signals so that they are robust to noise and invariant to the distance between a sensor and a spot at which an abnormal event like an attack on the gas pipes occurs. Then, a classifier is constructed to detect abnormal events using neural networks. It is a combination of two neural network models, a Gaussian mixture model and a multi-layer perceptron, for the reduction of miss and false alarms. The former works for miss alarm prevention and the latter for false alarm prevention. The experimental result with real data from the actual gas system shows that the proposed system is effective in detecting the dangerous events in real-time with an accuracy of 92.9%.

  • PDF