• Title/Summary/Keyword: multi multi-layer neural networks

Search Result 223, Processing Time 0.037 seconds

Nondestructive crack detection in metal structures using impedance responses and artificial neural networks

  • Ho, Duc-Duy;Luu, Tran-Huu-Tin;Pham, Minh-Nhan
    • Structural Monitoring and Maintenance
    • /
    • v.9 no.3
    • /
    • pp.221-235
    • /
    • 2022
  • Among nondestructive damage detection methods, impedance-based methods have been recognized as an effective technique for damage identification in many kinds of structures. This paper proposes a method to detect cracks in metal structures by combining electro-mechanical impedance (EMI) responses and artificial neural networks (ANN). Firstly, the theories of EMI responses and impedance-based damage detection methods are described. Secondly, the reliability of numerical simulations for impedance responses is demonstrated by comparing to pre-published results for an aluminum beam. Thirdly, the proposed method is used to detect cracks in the beam. The RMSD (root mean square deviation) index is used to alarm the occurrence of the cracks, and the multi-layer perceptron (MLP) ANN is employed to identify the location and size of the cracks. The selection of the effective frequency range is also investigated. The analysis results reveal that the proposed method accurately detects the cracks' occurrence, location, and size in metal structures.

Regression Neural Networks for Improving the Learning Performance of Single Feature Split Regression Trees (단일특징 분할 회귀트리의 학습성능 개선을 위한 회귀신경망)

  • Lim, Sook;Kim, Sung-Chun
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.33B no.1
    • /
    • pp.187-194
    • /
    • 1996
  • In this paper, we propose regression neural networks based on regression trees. We map regression trees into three layered feedforward networks. We put multi feature split functions in the first layer so that the networks have a better chance to get optimal partitions of input space. We suggest two supervised learning algorithms for the network training and test both in single feature split and multifeature split functions. In experiments, the proposed regression neural networks is proved to have the better learning performance than those of the single feature split regression trees and the single feature split regression networks. Furthermore, we shows that the proposed learning schemes have an effect to prune an over-grown tree without degrading the learning performance.

  • PDF

Deep Neural Network Model For Short-term Electric Peak Load Forecasting (단기 전력 부하 첨두치 예측을 위한 심층 신경회로망 모델)

  • Hwang, Heesoo
    • Journal of the Korea Convergence Society
    • /
    • v.9 no.5
    • /
    • pp.1-6
    • /
    • 2018
  • In smart grid an accurate load forecasting is crucial in planning resources, which aids in improving its operation efficiency and reducing the dynamic uncertainties of energy systems. Research in this area has included the use of shallow neural networks and other machine learning techniques to solve this problem. Recent researches in the field of computer vision and speech recognition, have shown great promise for Deep Neural Networks (DNN). To improve the performance of daily electric peak load forecasting the paper presents a new deep neural network model which has the architecture of two multi-layer neural networks being serially connected. The proposed network model is progressively pre-learned layer by layer ahead of learning the whole network. For both one day and two day ahead peak load forecasting the proposed models are trained and tested using four years of hourly load data obtained from the Korea Power Exchange (KPX).

Modelling the wide temperature range of steam table using the neural networks (신경회로망을 사용한 넓은 온도 범위의 증기표 모델링)

  • Lee, Tae-Hwan
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.10 no.11
    • /
    • pp.2008-2013
    • /
    • 2006
  • In numerical analysis on evaluating the thermal performance of the thermal equipment, numerical values of thermodynamic properties such as temperature, pressure, specific volume, enthalpy and entropy are required. But the steam table itself cannot be used without modelling. In this study applicability of neural networks in modelling the wide temperature range of wet saturated vapor region was examined. the multi-layer neural network consists of a input layer with 1 node, two hidden layers with 10 and 20 nodes respectively and a output layer with 6 nodes. Quadratic and cubic spline interpoations methods were also applied for comparison. Neural network model revealed similar percentage error to spline interpolation. From these results, it is confirmed that the neural networks could be powerful method in modelling the wide range of the steam table.

Classification of the Types of Defects in Steam Generator Tubes using the Quasi-Newton Method

  • Lee, Joon-Pyo;Jo, Nam-H.;Roh, Young-Su
    • Journal of Electrical Engineering and Technology
    • /
    • v.5 no.4
    • /
    • pp.666-671
    • /
    • 2010
  • Multi-layer perceptron neural networks have been constructed to classify four types of defects in steam generator tubes. Three features are extracted from the signals of the eddy current testing method. These include maximum impedance, phase angle at the point of maximum impedance, and an angle between the point of maximum impedance and the point of half the maximum impedance. Two hundred sets of these features are used for training and assessing the networks. Two approaches are involved to train the networks and to classify the defect type. One is the conjugate gradient method and the other is the Broydon-Fletcher-Goldfarb-Shanno method which is recognized as the most popular algorithm of quasi-Newton methods. It is found from the computation results that the training time of the Broydon-Fletcher-Goldfarb-Shanno method is much faster than that of the conjugate gradient method in most cases. On the other hand, no significant difference of the classification performance between the two methods is observed.

Predicting concrete properties using neural networks (NN) with principal component analysis (PCA) technique

  • Boukhatem, B.;Kenai, S.;Hamou, A.T.;Ziou, Dj.;Ghrici, M.
    • Computers and Concrete
    • /
    • v.10 no.6
    • /
    • pp.557-573
    • /
    • 2012
  • This paper discusses the combined application of two different techniques, Neural Networks (NN) and Principal Component Analysis (PCA), for improved prediction of concrete properties. The combination of these approaches allowed the development of six neural networks models for predicting slump and compressive strength of concrete with mineral additives such as blast furnace slag, fly ash and silica fume. The Back-Propagation Multi-Layer Perceptron (BPMLP) with Bayesian regularization was used in all these models. They are produced to implement the complex nonlinear relationship between the inputs and the output of the network. They are also established through the incorporation of a huge experimental database on concrete organized in the form Mix-Property. Thus, the data comprising the concrete mixtures are much correlated to each others. The PCA is proposed for the compression and the elimination of the correlation between these data. After applying the PCA, the uncorrelated data were used to train the six models. The predictive results of these models were compared with the actual experimental trials. The results showed that the elimination of the correlation between the input parameters using PCA improved the predictive generalisation performance models with smaller architectures and dimensionality reduction. This study showed also that using the developed models for numerical investigations on the parameters affecting the properties of concrete is promising.

Inverse optimization problem solver on use of multi-layer neural networks

  • Wang, Qianyi;Aoyama, Tomoo;Nagashima, Umpei;Kang, Eui-Sung
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.88.5-88
    • /
    • 2001
  • We propose a neural network solver for an inverse problem. The problem is that input data with complete teaching include defects and predict the defect value. The solver is constructed of a three layer neural network whose learning method is combined from BP and reconstruction learning. The input data for the defects are unknown; therefore, the circulation of an arithmetic progression replaces them; rightly, the learning procedure is not converged for the circulation data vut for the normal data. The learning is quitted after such a learning status id kept. Then, we search a minimum of the differences between teaching data and output of the circulation. Then, we search a minimum of the ...

  • PDF

The Parallel ANN(Artificial Neural Network) Simulator using Mobile Agent (이동 에이전트를 이용한 병렬 인공신경망 시뮬레이터)

  • Cho, Yong-Man;Kang, Tae-Won
    • The KIPS Transactions:PartB
    • /
    • v.13B no.6 s.109
    • /
    • pp.615-624
    • /
    • 2006
  • The objective of this paper is to implement parallel multi-layer ANN(Artificial Neural Network) simulator based on the mobile agent system which is executed in parallel in the virtual parallel distributed computing environment. The Multi-Layer Neural Network is classified by training session, training data layer, node, md weight in the parallelization-level. In this study, We have developed and evaluated the simulator with which it is feasible to parallel the ANN in the training session and training data parallelization because these have relatively few network traffic. In this results, we have verified that the performance of parallelization is high about 3.3 times in the training session and training data. The great significance of this paper is that the performance of ANN's execution on virtual parallel computer is similar to that of ANN's execution on existing super-computer. Therefore, we think that the virtual parallel computer can be considerably helpful in developing the neural network because it decreases the training time which needs extra-time.

The Design of Pattern Classification based on Fuzzy Combined Polynomial Neural Network (퍼지 결합 다항식 뉴럴 네트워크 기반 패턴 분류기 설계)

  • Rho, Seok-Beom;Jang, Kyung-Won;Ahn, Tae-Chon
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.63 no.4
    • /
    • pp.534-540
    • /
    • 2014
  • In this paper, we propose a fuzzy combined Polynomial Neural Network(PNN) for pattern classification. The fuzzy combined PNN comes from the generic TSK fuzzy model with several linear polynomial as the consequent part and is the expanded version of the fuzzy model. The proposed pattern classifier has the polynomial neural networks as the consequent part, instead of the general linear polynomial. PNNs are implemented by stacking the simple polynomials dynamically. To implement one layer of PNNs, the various types of simple polynomials are used so that PNNs have flexibility and versatility. Although the structural complexity of the implemented PNNs is high, the PNNs become a high order-multi input polynomial finally. To estimate the coefficients of a polynomial neuron, The weighted linear discriminant analysis. The output of fuzzy rule system with PNNs as the consequent part is the linear combination of the output of several PNNs. To evaluate the classification ability of the proposed pattern classifier, we make some experiments with several machine learning data sets.

A new Design of Granular-oriented Self-organizing Polynomial Neural Networks (입자화 중심 자기구성 다항식 신경 회로망의 새로운 설계)

  • Oh, Sung-Kwun;Park, Ho-Sung
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.61 no.2
    • /
    • pp.312-320
    • /
    • 2012
  • In this study, we introduce a new design methodology of a granular-oriented self-organizing polynomial neural networks (GoSOPNNs) that is based on multi-layer perceptron with Context-based Polynomial Neurons (CPNs) or Polynomial Neurons (PNs). In contrast to the typical architectures encountered in polynomial neural networks (PNN), our main objective is to develop a methodological design strategy of GoSOPNNs as follows : (a) The 1st layer of the proposed network consists of Context-based Polynomial Neuron (CPN). In here, CPN is fully reflective of the structure encountered in numeric data which are granulated with the aid of Context-based Fuzzy C-Means (C-FCM) clustering method. The context-based clustering supporting the design of information granules is completed in the space of the input data while the build of the clusters is guided by a collection of some predefined fuzzy sets (so-called contexts) defined in the output space. (b) The proposed design procedure being applied at each layer of GoSOPNN leads to the selection of preferred nodes of the network (CPNs or PNs) whose local characteristics (such as the number of contexts, the number of clusters, a collection of the specific subset of input variables, and the order of the polynomial) can be easily adjusted. These options contribute to the flexibility as well as simplicity and compactness of the resulting architecture of the network. For the evaluation of performance of the proposed GoSOPNN network, we describe a detailed characteristic of the proposed model using a well-known learning machine data(Automobile Miles Per Gallon Data, Boston Housing Data, Medical Image System Data).