• Title/Summary/Keyword: multi multi-layer neural networks

Search Result 225, Processing Time 0.028 seconds

Precision indices of neural networks for medicines: structure-activity correlation relationships

  • Zhu, Hanxi;Aoyama, Tomoo;Yoshihara, Ikuo;Lee, Seung-Woo;Kim, Wook-Hyun
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.481-481
    • /
    • 2000
  • We investigated the structure-activity relationships on use of multi-layer neural networks. The relationships are techniques required in developments of medicines. Since many kinds of observations might be adopted on the techniques, we discussed some points between the observations and the properties of multi-layer neural networks. In the structure-activity relationships, an important property is not that standard deviations are nearly equal to zero for observed physiological activity, but prediction ability for unknown medicines. Since we adopted non-linear approximation, the function to represent the activity can be defined by observations; therefore, we believe that the standard deviations have not significance. The function was examined by "leave-one-out" method, which was originally introduced for the multi-regression analysis. In the linear approximation, the examination is significance, however, we believe that the method is inappropriate in case of nonlinear fitting as neural networks; therefore, we derived a new index fer the relationships from the differential of information propagation in the neural network. By using the index, we discussed physiological activity of an anti-cancer medicine, Mitomycine derivatives. The neuro-computing suggests that there is no direction to extend the anti-cancer activity of Mitomycine, which is close to the trend of anticancer developing.

  • PDF

Design of Multi-layer Fuzzy Neural Networks (다층 퍼지뉴럴 네트워크의 설계)

  • Park, Byoung-Jun;Park, Keon-Jun;Oh, Sung-Kwun
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2004.04a
    • /
    • pp.307-310
    • /
    • 2004
  • In this study, a new architecture and comprehensive design methodology of genetically optimized Multi-layer Fuzzy Neural Networks (gMFNN) are introduced and a series of numeric experiments are carried out. The gMFNN architecture results from a synergistic usage of the hybrid system generated by combining Fuzzy Neural Networks (FNN) with Polynomial Neural Networks (PNN), FNN contributes to the formation of the premise part of the overall network structure of the gMFNN. The consequence part of the gMFNN is designed using PNN.

  • PDF

The Structure of Boundary Decision Using the Back Propagation Algorithms (역전파 알고리즘을 이용한 경계결정의 구성에 관한 연구)

  • Lee, Ji-Young
    • The Journal of Information Technology
    • /
    • v.8 no.1
    • /
    • pp.51-56
    • /
    • 2005
  • The Back propagation algorithm is a very effective supervised training method for multi-layer feed forward neural networks. This paper studies the decision boundary formation based on the Back propagation algorithm. The discriminating powers of several neural network topology are also investigated against five manually created data sets. It is found that neural networks with multiple hidden layer perform better than single hidden layer.

  • PDF

Design of SVM-Based Polynomial Neural Networks Classifier Using Particle Swarm Optimization (입자군집 최적화를 이용한 SVM 기반 다항식 뉴럴 네트워크 분류기 설계)

  • Roh, Seok-Beom;Oh, Sung-Kwun
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.67 no.8
    • /
    • pp.1071-1079
    • /
    • 2018
  • In this study, the design methodology as well as network architecture of Support Vector Machine based Polynomial Neural Network, which is a kind of the dynamically generated neural networks, is introduced. The Support Vector Machine based polynomial neural networks is given as a novel network architecture redesigned with the aid of polynomial neural networks and Support Vector Machine. The generic polynomial neural networks, whose nodes are made of polynomials, are dynamically generated in each layer-wise. The individual nodes of the support vector machine based polynomial neural networks is constructed as a support vector machine, and the nodes as well as layers of the support vector machine based polynomial neural networks are dynamically generated as like the generation process of the generic polynomial neural networks. Support vector machine is well known as a sort of robust pattern classifiers. In addition, in order to enhance the structural flexibility as well as the classification performance of the proposed classifier, multi-objective particle swarm optimization is used. In other words, the optimization algorithm leads to sequentially successive generation of each layer of support vector based polynomial neural networks. The bench mark data sets are used to demonstrate the pattern classification performance of the proposed classifiers through the comparison of the generalization ability of the proposed classifier with some already studied classifiers.

Water Quality Forecasting of Chungju Lake Using Artificial Neural Network Algorithm (인공신경망 이론을 이용한 충주호의 수질예측)

  • 정효준;이소진;이홍근
    • Journal of Environmental Science International
    • /
    • v.11 no.3
    • /
    • pp.201-207
    • /
    • 2002
  • This study was carried out to evaluate the artificial neural network algorithm for water quality forecasting in Chungju lake, north Chungcheong province. Multi-layer perceptron(MLP) was used to train artificial neural networks. MLP was composed of one input layer, two hidden layers and one output layer. Transfer functions of the hidden layer were sigmoid and linear function. The number of node in the hidden layer was decided by trial and error method. It showed that appropriate node number in the hidden layer is 10 for pH training, 15 for DO and BOD, respectively. Reliability index was used to verify for the forecasting power. Considering some outlying data, artificial neural network fitted well between actual water quality data and computed data by artificial neural networks.

Boundary estimation in electrical impedance tomography with multi-layer neural networks.

  • Kim, J.H.;Jeon, H.J.;Choi, B.Y.;Kim, M.C.;Kim, S.;Kim, K.Y.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.553-558
    • /
    • 2003
  • The boundary estimation problem is used to estimate the shape of organic depend on the phase of the cardiac cycle or interested in the detection of the location and size of anomalies with resistivity values different from the background tissues such as nuclear reactor. And we can use the method to solve the optimal solution such as modified Newton raphson, kalman filter, extended kalman filter, etc. But, this method consumes much time and is sensitive to the initial value and noise in the estimation of the unknown shape. In the paper, we propose that multi-layer neural networks estimate the boundary of the unknown object using Fourier coefficient. This method can be used at the real time estimation and have strong characteristics at the noise and initial value. It uses voltage change; difference the homogeneous voltage to the non-homogeneous voltage, and change of Fourier coefficient change to train multi-layer neural network. After train, we can have real time estimation using this method.

  • PDF

A self-organizing algorithm for multi-layer neural networks (다층 신경회로망을 위한 자기 구성 알고리즘)

  • 이종석;김재영;정승범;박철훈
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.41 no.3
    • /
    • pp.55-65
    • /
    • 2004
  • When a neural network is used to solve a given problem it is necessary to match the complexity of the network to that of the problem because the complexity of the network significantly affects its learning capability and generalization performance. Thus, it is desirable to have an algorithm that can find appropriate network structures in a self-organizing way. This paper proposes algorithms which automatically organize feed forward multi-layer neural networks with sigmoid hidden neurons for given problems. Using both constructive procedures and pruning procedures, the proposed algorithms try to find the near optimal network, which is compact and shows good generalization performance. The performances of the proposed algorithms are tested on four function regression problems. The results demonstrate that our algorithms successfully generate near-optimal networks in comparison with the previous method and the neural networks of fixed topology.

The Study of the Financial Index Prediction Using the Equalized Multi-layer Arithmetic Neural Network (균등다층연산 신경망을 이용한 금융지표지수 예측에 관한 연구)

  • 김성곤;김환용
    • Journal of the Korea Society of Computer and Information
    • /
    • v.8 no.3
    • /
    • pp.113-123
    • /
    • 2003
  • Many researches on the application of neural networks for making financial index prediction have proven their advantages over statistical and other methods. In this paper, a neural network model is proposed for the Buying, Holding or Selling timing prediction in stocks by the price index of stocks by inputting the closing price and volume of dealing in stocks and the technical indexes(MACD, Psychological Line). This model has an equalized multi-layer arithmetic function as well as the time series prediction function of backpropagation neural network algorithm. In the case that the numbers of learning data are unbalanced among the three categories (Buying, Holding or Selling), the neural network with conventional method has the problem that it tries to improve only the prediction accuracy of the most dominant category. Therefore, this paper, after describing the structure, working and learning algorithm of the neural network, shows the equalized multi-layer arithmetic method controlling the numbers of learning data by using information about the importance of each category for improving prediction accuracy of other category. Experimental results show that the financial index prediction using the equalized multi-layer arithmetic neural network has much higher correctness rate than the other conventional models.

  • PDF

An Action Decision and Execution Method of Robotic Soccer System based on Neural Networks (신경회로망을 이용한 로봇축구 시스템의 행동결정 및 행동실행 방법)

  • Lee, Kyoung-Tae;Kim, Hak-Il;Kim, Choon-Woo
    • Proceedings of the KIEE Conference
    • /
    • 1998.11b
    • /
    • pp.543-545
    • /
    • 1998
  • Robotic soccer is multi-agent system playing soccer game under given rule. This system consists of three mobile robots, vision sensor, action decision module, action execution module and communication module. This paper presents new action decision method using multi-layer neural networks.

  • PDF

Evaluation of existing bridges using neural networks

  • Molina, Augusto V.;Chou, Karen C.
    • Structural Engineering and Mechanics
    • /
    • v.13 no.2
    • /
    • pp.187-209
    • /
    • 2002
  • The infrastructure system in the United States has been aging faster than the resource available to restore them. Therefore decision for allocating the resources is based in part on the condition of the structural system. This paper proposes to use neural network to predict the overall rating of the structural system because of the successful applications of neural network to other fields which require a "symptom-diagnostic" type relationship. The goal of this paper is to illustrate the potential of using neural network in civil engineering applications and, particularly, in bridge evaluations. Data collected by the Tennessee Department of Transportation were used as "test bed" for the study. Multi-layer feed forward networks were developed using the Levenberg-Marquardt training algorithm. All the neural networks consisted of at least one hidden layer of neurons. Hyperbolic tangent transfer functions were used in the first hidden layer and log-sigmoid transfer functions were used in the subsequent hidden and output layers. The best performing neural network consisted of three hidden layers. This network contained three neurons in the first hidden layer, two neurons in the second hidden layer and one neuron in the third hidden layer. The neural network performed well based on a target error of 10%. The results of this study indicate that the potential for using neural networks for the evaluation of infrastructure systems is very good.