• Title/Summary/Keyword: Levenberg-Marquardt Back-Propagation

Search Result 20, Processing Time 0.032 seconds

Evaluation for Applications of the Levenberg-Marquardt Algorithm in Geotechnical Engineering (Levenberg-Marquardt 알고리즘의 지반공학 적용성 평가)

  • Kim, Youngsu;Kim, Daeman
    • Journal of the Korean GEO-environmental Society
    • /
    • v.10 no.5
    • /
    • pp.49-57
    • /
    • 2009
  • In this study, one of the complicated geotechnical problem, compression index was predicted by a artificial neural network method of Levenberg-Marquardt (LM) algorithm. Predicted values were compared and evaluated by the results of the Back Propagation (BP) method, which is used extensively in geotechnical engineering. Also two different results were compared with experimental values estimated by verified experimental methods in order to evaluate the accuracy of each method. The results from experimental method generally showed higher error than the results of both artificial neural network method. The predicted compression index by LM algorithm showed better comprehensive results than BP algorithm in terms of convergence, but accuracy was similar each other.

  • PDF

Iris Recognition using Multi-Resolution Frequency Analysis and Levenberg-Marquardt Back-Propagation

  • Jeong Yu-Jeong;Choi Gwang-Mi
    • Journal of information and communication convergence engineering
    • /
    • v.2 no.3
    • /
    • pp.177-181
    • /
    • 2004
  • In this paper, we suggest an Iris recognition system with an excellent recognition rate and confidence as an alternative biometric recognition technique that solves the limit in an existing individual discrimination. For its implementation, we extracted coefficients feature values with the wavelet transformation mainly used in the signal processing, and we used neural network to see a recognition rate. However, Scale Conjugate Gradient of nonlinear optimum method mainly used in neural network is not suitable to solve the optimum problem for its slow velocity of convergence. So we intended to enhance the recognition rate by using Levenberg-Marquardt Back-propagation which supplements existing Scale Conjugate Gradient for an implementation of the iris recognition system. We improved convergence velocity, efficiency, and stability by changing properly the size according to both convergence rate of solution and variation rate of variable vector with the implementation of an applied algorithm.

Iris Recognition System using Multi-Resolution Frequency Analysis and Back-Propagation (다해상도 주파수 분할과 Back-Propagation을 이용한 홍채인식)

  • Park, Kyoung-Woo
    • Journal of Integrative Natural Science
    • /
    • v.1 no.3
    • /
    • pp.221-229
    • /
    • 2008
  • 본 논문에서는 기존의 개인 식별 방법의 한계를 해결하는 대안으로 떠오르고 있는 생체인식 기술 중 인식률이 뛰어나고 신뢰성 있는 홍채인식 시스템을 구현하고자 한다. 구현을 위하여 신호처리 분야에서 주로 사용되는 wavelet변환으로 계수 특징 값 추출을 하였으며, 인식률을 알아보기 위하여 신경망 기법을 이용하고자 한다. 그러나 신경망 기법에서 주로 사용되는 비선형 최적화기법인 Scale Conjugate Gradient는 최적화 문제점을 해결하기에는 수렴속도가 느리기 때문에 적합하지 않다. 따라서 본 논문에서는 기존 Scale Conjugate Gradient를 보완한 Levenberg-Marquardt Back-Propagation을 홍채인식에 적용하여 구현함으로써 인식율을 높이고자 한다. 적용한 알고리즘 구현으로 해의 수렴정도, 변수 벡터의 변화정도에 따라 크기를 적절히 변화시킴으로써 수렴속도를 개선하고, 효율성과 안정성을 동시에 얻을 수 있었다.

  • PDF

Water Quality Forecasting at Gongju station in Geum River using Neural Network Model (신경망 모형을 적용한 금강 공주지점의 수질예측)

  • An, Sang-Jin;Yeon, In-Seong;Han, Yang-Su;Lee, Jae-Gyeong
    • Journal of Korea Water Resources Association
    • /
    • v.34 no.6
    • /
    • pp.701-711
    • /
    • 2001
  • Forecasting of water quality variation is not an easy process due to the complicated nature of various water quality factors and their interrelationships. The objective of this study is to test the applicability of neural network models to the forecasting of the water quality at Gongju station in Geum River. This is done by forecasting monthly water qualities such as DO, BOD, and TN, and comparing with those obtained by ARIMA model. The neural network models of this study use BP(Back Propagation) algorithm for training. In order to improve the performance of the training, the models are tested in three different styles ; MANN model which uses the Moment-Adaptive learning rate method, LMNN model which uses the Levenberg-Marquardt method, and MNN model which separates the hidden layers for judgement factors from the hidden layers for water quality data. the results show that the forecasted water qualities are reasonably close to the observed data. And the MNN model shows the best results among the three models tested

  • PDF

Gabor-Features Based Wavelet Decomposition Method for Face Detection (얼굴 검출을 위한 Gabor 특징 기반의 웨이블릿 분해 방법)

  • Lee, Jung-Moon;Choi, Chan-Sok
    • Journal of Industrial Technology
    • /
    • v.28 no.B
    • /
    • pp.143-148
    • /
    • 2008
  • A real-time face detection is to find human faces robustly under the cluttered background free from the effect of occlusion by other objects or various lightening conditions. We propose a face detection system for real-time applications using wavelet decomposition method based on Gabor features. Firstly, skin candidate regions are extracted from the given image by skin color filtering and projection method. Then Gabor-feature based template matching is performed to choose face cadidate from the skin candidate regions. The chosen face candidate region is transformed into 2-level wavelet decomposition images, from which feature vectors are extracted for classification. Based on the extracted feature vectors, the face candidate region is finally classified into either face or nonface class by the Levenberg-Marguardt back-propagation neural network.

  • PDF

LM-BP algorithm application for odour classification and concentration prediction using MOS sensor array (MOS 센서어레이를 이용한 냄새 분류 및 농도추정을 위한 LM-BP 알고리즘 응용)

  • 최찬석;변형기;김정도
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.210-210
    • /
    • 2000
  • In this paper, we have investigated the properties of multi-layer perceptron (MLP) for odour patterns classification and concentration estimation simultaneously. When the MLP may be has a fast convergence speed with small error and excellent mapping ability for classification, it can be possible to use for classification and concentration prediction of volatile chemicals simultaneously. However, the conventional MLP, which is back-Propagation of error based on the steepest descent method, was difficult to use for odour classification and concentration estimation simultaneously, because it is slow to converge and may fall into the local minimum. We adapted the Levenberg-Marquardt(LM) algorithm [4,5] having advantages both the steepest descent method and Gauss-Newton method instead of the conventional steepest descent method for the simultaneous classification and concentration estimation of odours. And, We designed the artificial odour sensing system(Electronic Nose) and applied LM-BP algorithm for classification and concentration prediction of VOC gases.

  • PDF

Intracranial Hemorrhagic Lesion Feature Extraction System Of Using Wavelet Transform and LMBP (웨이블렛 변환과 LMBP를 이용한 대뇌출혈성 병변 인식 시스템)

  • 정유정;정채영
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2002.10d
    • /
    • pp.625-627
    • /
    • 2002
  • 본 논문에서는 의료영상 인식 기술 중 인식률이 뛰어나고 신뢰성 있는 대뇌출혈성 병변인식 시스템을 구현하기 위하여 신호처리 분야에서 주로 사용되는 Wavelet 변환과 신경망 기법을 이용하고자 한다. 그러나 신경망 기법에서 주로 사용되는 비선형 최적화기법인 Gradient descent BP는 최적화 문제점을 해결하기에는 수렴속도가 느리기 때문에 적합하지 않다. 따라서 본 논문에서는 기존 Gradient descent BP를 보완한 Levenberg-Marquardt Back-Propagation을 대뇌출혈성 병변인식에 적용하여 구현함으로써 총 50개의 패턴 중 45개의 영상이 인식에 성공하였고 전체 평균 인식률은 각각 90%와 87%의 인식률을 보였다.

  • PDF

Forecasting of Runoff Hydrograph Using Neural Network Algorithms (신경망 알고리즘을 적용한 유출수문곡선의 예측)

  • An, Sang-Jin;Jeon, Gye-Won;Kim, Gwang-Il
    • Journal of Korea Water Resources Association
    • /
    • v.33 no.4
    • /
    • pp.505-515
    • /
    • 2000
  • THe purpose of this study is to forecast of runoff hydrographs according to rainfall event in a stream. The neural network theory as a hydrologic blackbox model is used to solve hydrological problems. The Back-Propagation(BP) algorithm by the Levenberg-Marquardt(LM) techniques and Radial Basis Function(RBF) network in Neural Network(NN) models are used. Runoff hydrograph is forecasted in Bocheongstream basin which is a IHP the representative basin. The possibility of a simulation for runoff hydrographs about unlearned stations is considered. The results show that NN models are performed to effective learning for rainfall-runoff process of hydrologic system which involves a complexity and nonliner relationships. The RBF networks consist of 2 learning steps. The first step is an unsupervised learning in hidden layer and the next step is a supervised learning in output layer. Therefore, the RBF networks could provide rather time saved in the learning step than the BP algorithm. The peak discharge both BP algorithm and RBF network model in the estimation of an unlearned are a is trended to observed values.

  • PDF

LATERAL CONTROL OF AUTONOMOUS VEHICLE USING SEVENBERG-MARQUARDT NEURAL NETWORK ALGORITHM

  • Kim, Y.-B.;Lee, K.-B.;Kim, Y.-J.;Ahn, O.-S.
    • International Journal of Automotive Technology
    • /
    • v.3 no.2
    • /
    • pp.71-78
    • /
    • 2002
  • A new control method far vision-based autonomous vehicle is proposed to determine navigation direction by analyzing lane information from a camera and to navigate a vehicle. In this paper, characteristic featured data points are extracted from lane images using a lane recognition algorithm. Then the vehicle is controlled using new Levenberg-Marquardt neural network algorithm. To verify the usefulness of the algorithm, another algorithm, which utilizes the geometric relation of a camera and vehicle, is introduced. The second one involves transformation from an image coordinate to a vehicle coordinate, then steering is determined from Ackermann angle. The steering scheme using Ackermann angle is heavily depends on the correct geometric data of a vehicle and a camera. Meanwhile, the proposed neural network algorithm does not need geometric relations and it depends on the driving style of human driver. The proposed method is superior than other referenced neural network algorithms such as conjugate gradient method or gradient decent one in autonomous lateral control .

Prediction of compressive strength of bacteria incorporated geopolymer concrete by using ANN and MARS

  • X., John Britto;Muthuraj, M.P.
    • Structural Engineering and Mechanics
    • /
    • v.70 no.6
    • /
    • pp.671-681
    • /
    • 2019
  • This paper examines the applicability of artificial neural network (ANN) and multivariate adaptive regression splines (MARS) to predict the compressive strength of bacteria incorporated geopolymer concrete (GPC). The mix is composed of new bacterial strain, manufactured sand, ground granulated blast furnace slag, silica fume, metakaolin and fly ash. The concentration of sodium hydroxide (NaOH) is maintained at 8 Molar, sodium silicate ($Na_2SiO_3$) to NaOH weight ratio is 2.33 and the alkaline liquid to binder ratio of 0.35 and ambient curing temperature ($28^{\circ}C$) is maintained for all the mixtures. In ANN, back-propagation training technique was employed for updating the weights of each layer based on the error in the network output. Levenberg-Marquardt algorithm was used for feed-forward back-propagation. MARS model was developed by establishing a relationship between a set of predictors and dependent variables. MARS is based on a divide and conquers strategy partitioning the training data sets into separate regions; each gets its own regression line. Six models based on ANN and MARS were developed to predict the compressive strength of bacteria incorporated GPC for 1, 3, 7, 28, 56 and 90 days. About 70% of the total 84 data sets obtained from experiments were used for development of the models and remaining 30% data was utilized for testing. From the study, it is observed that the predicted values from the models are found to be in good agreement with the corresponding experimental values and the developed models are robust and reliable.