• Title/Summary/Keyword: multilayer NN

Search Result 16, Processing Time 0.025 seconds

Multilayer Neural Network Using Delta Rule: Recognitron III (텔타규칙을 이용한 다단계 신경회로망 컴퓨터:Recognitron III)

  • 김춘석;박충규;이기한;황희영
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.40 no.2
    • /
    • pp.224-233
    • /
    • 1991
  • The multilayer expanson of single layer NN (Neural Network) was needed to solve the linear seperability problem as shown by the classic example using the XOR function. The EBP (Error Back Propagation ) learning rule is often used in multilayer Neural Networks, but it is not without its faults: 1)D.Rimmelhart expanded the Delta Rule but there is a problem in obtaining Ca from the linear combination of the Weight matrix N between the hidden layer and the output layer and H, wich is the result of another linear combination between the input pattern and the Weight matrix M between the input layer and the hidden layer. 2) Even if using the difference between Ca and Da to adjust the values of the Weight matrix N between the hidden layer and the output layer may be valid is correct, but using the same value to adjust the Weight matrixd M between the input layer and the hidden layer is wrong. Recognitron III was proposed to solve these faults. According to simulation results, since Recognitron III does not learn the three layer NN itself, but divides it into several single layer NNs and learns these with learning patterns, the learning time is 32.5 to 72.2 time faster than EBP NN one. The number of patterns learned in a EBP NN with n input and output cells and n+1 hidden cells are 2**n, but n in Recognitron III of the same size. [5] In the case of pattern generalization, however, EBP NN is less than Recognitron III.

  • PDF

A Fault Diagnosis Based on Multilayer/ART2 Neural Networks (다층/ART2 신경회로망을 이용한 고장진단)

  • Lee, In-Soo;Yu, Du-Hyoung
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.14 no.7
    • /
    • pp.830-837
    • /
    • 2004
  • Neural networks-based fault diagnosis algorithm to detect and isolate faults in the nonlinear systems is proposed. In the proposed method, the fault is detected when the errors between the system output and the multilayer neural network-based nominal model output cross a Predetermined threshold. Once a fault in the system is detected, the system outputs are transferred to the fault classifier by nultilayer/ART2 NN (adaptive resonance theory 2 neural network) for fault isolation. From the computer simulation results, it is verified that the proposed fault diagonal method can be performed successfully to detect and isolate faults in a nonlinear system.

Neural network based model for seismic assessment of existing RC buildings

  • Caglar, Naci;Garip, Zehra Sule
    • Computers and Concrete
    • /
    • v.12 no.2
    • /
    • pp.229-241
    • /
    • 2013
  • The objective of this study is to reveal the sufficiency of neural networks (NN) as a securer, quicker, more robust and reliable method to be used in seismic assessment of existing reinforced concrete buildings. The NN based approach is applied as an alternative method to determine the seismic performance of each existing RC buildings, in terms of damage level. In the application of the NN, a multilayer perceptron (MLP) with a back-propagation (BP) algorithm is employed using a scaled conjugate gradient. NN based model wasd eveloped, trained and tested through a based MATLAB program. The database of this model was developed by using a statistical procedure called P25 method. The NN based model was also proved by verification set constituting of real existing RC buildings exposed to 2003 Bingol earthquake. It is demonstrated that the NN based approach is highly successful and can be used as an alternative method to determine the seismic performance of each existing RC buildings.

Decomposition Analysis of Time Series Using Neural Networks (신경망을 이용한 시계열의 분해분석)

  • Jhee, Won-Chul
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.25 no.1
    • /
    • pp.111-124
    • /
    • 1999
  • This evapaper is toluate the forecasting performance of three neural network(NN) approaches against ARIMA model using the famous time series analysis competition data. The first NN approach is to analyze the second Makridakis (M2) Competition Data using Multilayer Perceptron (MLP) that has been the most popular NN model in time series analysis. Since it is recently known that MLP suffers from bias/variance dilemma, two approaches are suggested in this study. The second approach adopts Cascade Correlation Network (CCN) that was suggested by Fahlman & Lebiere as an alternative to MLP. In the third approach, a time series is separated into two series using Noise Filtering Network (NFN) that utilizes autoassociative memory function of neural network. The forecasts in the decomposition analysis are the sum of two prediction values obtained from modeling each decomposed series, respectively. Among the three NN approaches, Decomposition Analysis shows the best forecasting performance on the M2 Competition Data, and is expected to be a promising tool in analyzing socio-economic time series data because it reduces the effect of noise or outliers that is an impediment to modeling the time series generating process.

  • PDF

A Study on artifact extraction in magnetocardiography using multilayer neural network and principal component analysis (신경망과 주성분 분석을 이용한 심자도 신호에서 Artifact 추출)

  • Lee D. H.;Kim T. Y.;Lee D. J.
    • 한국컴퓨터산업교육학회:학술대회논문집
    • /
    • 2003.11a
    • /
    • pp.59-64
    • /
    • 2003
  • Principal component analysis(PCA) and neural network(NN) are used in reducing external noise in magnetocadiography. The PCA technique turns out to be very effective in reducing pulse noise in some SQUID channels and the NN find noise component automatically. Some experimental results obtained from 61 channel MCG system are shown.

  • PDF

Comparison of Different Schemes for Speed Sensorless Control of Induction Motor Drives by Neural Network (유도전동기의 속도 센서리스 제어를 위한 신경회로망 알고리즘의 추정 특성 비교)

  • 이경훈;국윤상;김윤호;최원범
    • Proceedings of the KIPE Conference
    • /
    • 1999.07a
    • /
    • pp.526-530
    • /
    • 1999
  • This paper presents a newly developed speed sensorless drive using Neural Network algorithm. Neural Network algorithm can be divided into three categories. In the first one, a Back Propagation-based NN algorithm is well-known to gradient descent method. In the second scheme, a Extended Kalman Filter-based NN algorithm has just the time varying learning rate. In the last scheme, a Recursive Least Square-based NN algorithm is faster and more stable than the classical back-propagation algorithm for training multilayer perceptrons. The number of iterations required to converge and the mean-squared error between the desired and actual outputs is compared with respect to each method. The theoretical analysis and experimental results are discussed.

  • PDF

Implementation of Stable Adaptive Neural Networks for Feedback Linearization (피이드백 선형화를 위한 안정한 적응 신경회로망 구현)

  • Kim, Dong-Hun;Yang, Hai-Won
    • Proceedings of the KIEE Conference
    • /
    • 1996.11a
    • /
    • pp.58-61
    • /
    • 1996
  • For a class of single-input single-output continuous-time nonlinear systems, a multilayer neural network-based controller that feedback-linearizes the system is presented. Control action is used to achieve tracking performance for a state-feedback linearizable but unknown nonlinear system. The multilayer neural network(NN) is used to approximate nonlinear continuous function to any desired degree of accuracy. The weight-update rule of multilayer neural network is derived to satisfy Lyapunov stability. It is shown that all the signals in the closed-loop system are uniformly bounded. Initialization of the network weights is straightforward.

  • PDF

Prediction of California bearing ratio (CBR) for coarse- and fine-grained soils using the GMDH-model

  • Mintae Kim;Seyma Ordu;Ozkan Arslan;Junyoung Ko
    • Geomechanics and Engineering
    • /
    • v.33 no.2
    • /
    • pp.183-194
    • /
    • 2023
  • This study presents the prediction of the California bearing ratio (CBR) of coarse- and fine-grained soils using artificial intelligence technology. The group method of data handling (GMDH) algorithm, an artificial neural network-based model, was used in the prediction of the CBR values. In the design of the prediction models, various combinations of independent input variables for both coarse- and fine-grained soils have been used. The results obtained from the designed GMDH-type neural networks (GMDH-type NN) were compared with other regression models, such as linear, support vector, and multilayer perception regression methods. The performance of models was evaluated with a regression coefficient (R2), root-mean-square error (RMSE), and mean absolute error (MAE). The results showed that GMDH-type NN algorithm had higher performance than other regression methods in the prediction of CBR value for coarse- and fine-grained soils. The GMDH model had an R2 of 0.938, RMSE of 1.87, and MAE of 1.48 for the input variables {G, S, and MDD} in coarse-grained soils. For fine-grained soils, it had an R2 of 0.829, RMSE of 3.02, and MAE of 2.40, when using the input variables {LL, PI, MDD, and OMC}. The performance evaluations revealed that the GMDH-type NN models were effective in predicting CBR values of both coarse- and fine-grained soils.

Automatic Identification of Database Workloads by using SVM Workload Classifier (SVM 워크로드 분류기를 통한 자동화된 데이터베이스 워크로드 식별)

  • Kim, So-Yeon;Roh, Hong-Chan;Park, Sang-Hyun
    • The Journal of the Korea Contents Association
    • /
    • v.10 no.4
    • /
    • pp.84-90
    • /
    • 2010
  • DBMS is used for a range of applications from data warehousing through on-line transaction processing. As a result of this demand, DBMS has continued to grow in terms of its size. This growth invokes the most important issue of manually tuning the performance of DBMS. The DBMS tuning should be adaptive to the type of the workload put upon it. But, identifying workloads in mixed database applications might be quite difficult. Therefore, a method is necessary for identifying workloads in the mixed database environment. In this paper, we propose a SVM workload classifier to automatically identify a DBMS workload. Database workloads are collected in TPC-C and TPC-W benchmark while changing the resource parameters. Parameters for SVM workload classifier, C and kernel parameter, were chosen experimentally. The experiments revealed that the accuracy of the proposed SVM workload classifier is about 9% higher than that of Decision tree, Naive Bayes, Multilayer perceptron and K-NN classifier.

A comparison of activity recognition using a triaxial accelerometer sensor (3축 가속도 센서를 이용한 행동 인식 비교)

  • Wang, ChangWon;Ho, JongGab;Na, YeJi;Jung, HwaYung;Nam, YunYoung;Min, Se Dong
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2015.10a
    • /
    • pp.1361-1364
    • /
    • 2015
  • 본 연구에서는 노인들이 일상에서 많이 행동하는 7가지 유형의 행동의 특징을 추출하고, 총 7가지 분류 알고리즘에 적용하여 가장 인식률이 높은 알고리즘을 도출하고자 하였다. 행동패턴은 정상보행, 절름발이, 지팡이, 느린 보행, 허리가 굽은 상태에서 보행, 스스로 휠체어 끌 때 그리고 누군가가 휠체어를 끌어줄 때 총 7가지로 구성하였다. 행동패턴의 특징은 3축 가속도 센서의 값, 평균, 표준편차, 수직 및 수평축의 데이터를 사용하였다. 분류 알고리즘은 Naive Bayes, Bayes Net, k-NN, SVM, Decision Tree, Multilayer perception, Logistic regression을 사용하였다. 연구결과 k-NN 알고리즘의 인식률이 98.7%로 다른 분류알고리즘에 비해 인식률이 높게 나타났다.