• Title/Summary/Keyword: LM (Levenberg-Marquardt) algorithm

Search Result 21, Processing Time 0.029 seconds

Evaluation for Applications of the Levenberg-Marquardt Algorithm in Geotechnical Engineering (Levenberg-Marquardt 알고리즘의 지반공학 적용성 평가)

  • Kim, Youngsu;Kim, Daeman
    • Journal of the Korean GEO-environmental Society
    • /
    • v.10 no.5
    • /
    • pp.49-57
    • /
    • 2009
  • In this study, one of the complicated geotechnical problem, compression index was predicted by a artificial neural network method of Levenberg-Marquardt (LM) algorithm. Predicted values were compared and evaluated by the results of the Back Propagation (BP) method, which is used extensively in geotechnical engineering. Also two different results were compared with experimental values estimated by verified experimental methods in order to evaluate the accuracy of each method. The results from experimental method generally showed higher error than the results of both artificial neural network method. The predicted compression index by LM algorithm showed better comprehensive results than BP algorithm in terms of convergence, but accuracy was similar each other.

  • PDF

Adaptive Marquardt Algorithm based on Mobile environment (모바일 환경에 적합한 적응형 마쿼트 알고리즘 제시)

  • Lee, Jongsu;Hwang, Eunhan;Song, Sangseob
    • Smart Media Journal
    • /
    • v.3 no.2
    • /
    • pp.9-13
    • /
    • 2014
  • The Levenberg-Marquardt (LM) algorithm is the most widely used fitting algorithm. It outperforms simple gradient descent and other conjugate gradient methods in a wide variety of problems. Based on the work of paper[1], we propose a modified Levenberg-Marquardt algorithm for better performance of mobile system. The LM parameter at the $k_{th}$ iteration is chosen ${\mu}=A{\bullet}{\parallel}f(x){\parallel}{\bullet}I$ where f is the residual function, and J is the Jacobi of f. In this paper, we show this method is more efficient than traditional method under the situation that the system iteration is limited.

A Data Fitting Technique for Rational Function Models Using the LM Optimization Algorithm (LM 최적화 알고리즘을 이용한 유리함수 모델의 데이터 피팅)

  • Park, Jae-Han;Bae, Ji-Hun;Baeg, Moon-Hong
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.17 no.8
    • /
    • pp.768-776
    • /
    • 2011
  • This paper considers a data fitting problem for rational function models using the LM (Levenberg-Marquardt) optimization method. Rational function models have various merits on representing a wide range of shapes and modeling complicated structures by polynomials of low degrees in both the numerator and denominator. However, rational functions are nonlinear in the parameter vector, thereby requiring nonlinear optimization methods to solve the fitting problem. In this paper, we propose a data fitting method for rational function models based on the LM algorithm which is renowned as an effective nonlinear optimization technique. Simulations show that the fitting results are robust against the measurement noises and uncertainties. The effectiveness of the proposed method is further demonstrated by the real application to a 3D depth camera calibration problem.

LM-BP algorithm application for odour classification and concentration prediction using MOS sensor array (MOS 센서어레이를 이용한 냄새 분류 및 농도추정을 위한 LM-BP 알고리즘 응용)

  • 최찬석;변형기;김정도
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.210-210
    • /
    • 2000
  • In this paper, we have investigated the properties of multi-layer perceptron (MLP) for odour patterns classification and concentration estimation simultaneously. When the MLP may be has a fast convergence speed with small error and excellent mapping ability for classification, it can be possible to use for classification and concentration prediction of volatile chemicals simultaneously. However, the conventional MLP, which is back-Propagation of error based on the steepest descent method, was difficult to use for odour classification and concentration estimation simultaneously, because it is slow to converge and may fall into the local minimum. We adapted the Levenberg-Marquardt(LM) algorithm [4,5] having advantages both the steepest descent method and Gauss-Newton method instead of the conventional steepest descent method for the simultaneous classification and concentration estimation of odours. And, We designed the artificial odour sensing system(Electronic Nose) and applied LM-BP algorithm for classification and concentration prediction of VOC gases.

  • PDF

FPGA Implementation of Levenverg-Marquardt Algorithm (LM(Levenberg-Marquardt) 알고리즘의 FPGA 구현)

  • Lee, Myung-Jin;Jung, Yong-Jin
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.51 no.11
    • /
    • pp.73-82
    • /
    • 2014
  • The LM algorithm is used in solving the least square problem in a non linear system, and is used in various fields. However, in cases the applied field's target functionis complicated and high-dimensional, it takes a lot of time solving the inner matrix and vector operations. In such cases, the LM algorithm is unsuitable in embedded environment and requires a hardware accelerator. In this paper, we implemented the LM algorithm in hardware. In the implementation, we used pipeline stages to divide the target function operation, and reduced the period of data input of the matrix and vector operations in order to accelerate the speed. To measure the performance of the implemented hardware, we applied the refining fundamental matrix(RFM), which is a part of 3D reconstruction application. As a result, the implemented system showed similar performance compared to software, and the execution speed increased in a product of 74.3.

Hybrid evolutionary identification of output-error state-space models

  • Dertimanis, Vasilis K.;Chatzi, Eleni N.;Spiridonakos, Minas D.
    • Structural Monitoring and Maintenance
    • /
    • v.1 no.4
    • /
    • pp.427-449
    • /
    • 2014
  • A hybrid optimization method for the identification of state-space models is presented in this study. Hybridization is succeeded by combining the advantages of deterministic and stochastic algorithms in a superior scheme that promises faster convergence rate and reliability in the search for the global optimum. The proposed hybrid algorithm is developed by replacing the original stochastic mutation operator of Evolution Strategies (ES) by the Levenberg-Marquardt (LM) quasi-Newton algorithm. This substitution results in a scheme where the entire population cloud is involved in the search for the global optimum, while single individuals are involved in the local search, undertaken by the LM method. The novel hybrid identification framework is assessed through the Monte Carlo analysis of a simulated system and an experimental case study on a shear frame structure. Comparisons to subspace identification, as well as to conventional, self-adaptive ES provide significant indication of superior performance.

Estimation of Camera Motion Parameter using Invariant Feature Models (불변 특징모델을 이용한 카메라 동작인수 측정)

  • Cha, Jeong-Hee;Lee, Keun-Soo
    • Journal of the Korea Society of Computer and Information
    • /
    • v.10 no.4 s.36
    • /
    • pp.191-201
    • /
    • 2005
  • In this paper, we propose a method to calculate camera motion parameter, which is based on efficient invariant features irrelevant to the camera veiwpoint. As feature information in previous research is variant to camera viewpoint. information content is increased, therefore, extraction of accurate features is difficult. LM(Levenberg-Marquardt) method for camera extrinsic parameter converges on the goat value exactly, but it has also drawback to take long time because of minimization process by small step size. Therefore, in this paper, we propose the extracting method of invariant features to camera viewpoint and two-stage calculation method of camera motion parameter which enhances accuracy and convergent degree by using camera motion parameter by 2D homography to the initial value of LM method. The proposed method are composed of features extraction stage, matching stage and calculation stage of motion parameter. In the experiments, we compare and analyse the proposed method with existing methods by using various indoor images to demonstrate the superiority of the proposed algorithm.

  • PDF

ANN Synthesis Models Trained with Modified GA-LM Algorithm for ACPWs with Conductor Backing and Substrate Overlaying

  • Wang, Zhongbao;Fang, Shaojun;Fu, Shiqiang
    • ETRI Journal
    • /
    • v.34 no.5
    • /
    • pp.696-705
    • /
    • 2012
  • Accurate synthesis models based on artificial neural networks (ANNs) are proposed to directly obtain the physical dimensions of an asymmetric coplanar waveguide with conductor backing and substrate overlaying (ACPWCBSO). First, the ACPWCBSO is analyzed with the conformal mapping technique (CMT) to obtain the training data. Then, a modified genetic-algorithm-Levenberg-Marquardt (GA-LM) algorithm is adopted to train ANNs. In the algorithm, the maximal relative error (MRE) is used as the fitness function of the chromosomes to guarantee that the MRE is small, while the mean square error is used as the error function in LM training to ensure that the average relative error is small. The MRE of ANNs trained with the modified GA-LM algorithm is less than 8.1%, which is smaller than those trained with the existing GA-LM algorithm and the LM algorithm (greater than 15%). Lastly, the ANN synthesis models are validated by the CMT analysis, electromagnetic simulation, and measurements.

An Improved EEG Signal Classification Using Neural Network with the Consequence of ICA and STFT

  • Sivasankari, K.;Thanushkodi, K.
    • Journal of Electrical Engineering and Technology
    • /
    • v.9 no.3
    • /
    • pp.1060-1071
    • /
    • 2014
  • Signals of the Electroencephalogram (EEG) can reflect the electrical background activity of the brain generated by the cerebral cortex nerve cells. This has been the mostly utilized signal, which helps in effective analysis of brain functions by supervised learning methods. In this paper, an approach for improving the accuracy of EEG signal classification is presented to detect epileptic seizures. Moreover, Independent Component Analysis (ICA) is incorporated as a preprocessing step and Short Time Fourier Transform (STFT) is used for denoising the signal adequately. Feature extraction of EEG signals is accomplished on the basis of three parameters namely, Standard Deviation, Correlation Dimension and Lyapunov Exponents. The Artificial Neural Network (ANN) is trained by incorporating Levenberg-Marquardt(LM) training algorithm into the backpropagation algorithm that results in high classification accuracy. Experimental results reveal that the methodology will improve the clinical service of the EEG recording and also provide better decision making in epileptic seizure detection than the existing techniques. The proposed EEG signal classification using feed forward Backpropagation Neural Network performs better than to the EEG signal classification using Adaptive Neuro Fuzzy Inference System (ANFIS) classifier in terms of accuracy, sensitivity, and specificity.

Optimal Design of Friction Dampers based on the Story Shear Force Distribution of a Building Structure (경주지역에서 발생한 3개 지진의 지진원 및 지진파전파 매질특성에 관한 연구)

  • Jung, Je-Won;Kim, Jun-Kyoung
    • Journal of the Earthquake Engineering Society of Korea
    • /
    • v.10 no.1 s.47
    • /
    • pp.33-39
    • /
    • 2006
  • Parameters including the seismic sources and the elastic wave propagation characteristics were analysed using the observed ground motions from 3 Kyoungju region earthquakes. The Levenberg-Marquardt algorithm was applied to invert all the variables non-linearly and simultaneously with S wave energy In frequency domain. Average stress drop of 3 events and local attenuation parameter ${\kappa}$ were estimated to about 48-bar and 0.0312 respectively. Regional attenuation parameter, Qo and ${\eta}$, were also estimated to be about 417 and 0.83. ${\kappa}$ values are much higher than that of EUS, even though smaller than that of WUS. All these values resultant from this study show that there are differences in some parameters of other studios due to differences in the governing equation. of acceleration motions