• Title/Summary/Keyword: Levenberg-Marquardt 알고리즘

Search Result 44, Processing Time 0.029 seconds

LM-BP algorithm application for odour classification and concentration prediction using MOS sensor array (MOS 센서어레이를 이용한 냄새 분류 및 농도추정을 위한 LM-BP 알고리즘 응용)

  • 최찬석;변형기;김정도
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.210-210
    • /
    • 2000
  • In this paper, we have investigated the properties of multi-layer perceptron (MLP) for odour patterns classification and concentration estimation simultaneously. When the MLP may be has a fast convergence speed with small error and excellent mapping ability for classification, it can be possible to use for classification and concentration prediction of volatile chemicals simultaneously. However, the conventional MLP, which is back-Propagation of error based on the steepest descent method, was difficult to use for odour classification and concentration estimation simultaneously, because it is slow to converge and may fall into the local minimum. We adapted the Levenberg-Marquardt(LM) algorithm [4,5] having advantages both the steepest descent method and Gauss-Newton method instead of the conventional steepest descent method for the simultaneous classification and concentration estimation of odours. And, We designed the artificial odour sensing system(Electronic Nose) and applied LM-BP algorithm for classification and concentration prediction of VOC gases.

  • PDF

FPGA Implementation of Levenverg-Marquardt Algorithm (LM(Levenberg-Marquardt) 알고리즘의 FPGA 구현)

  • Lee, Myung-Jin;Jung, Yong-Jin
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.51 no.11
    • /
    • pp.73-82
    • /
    • 2014
  • The LM algorithm is used in solving the least square problem in a non linear system, and is used in various fields. However, in cases the applied field's target functionis complicated and high-dimensional, it takes a lot of time solving the inner matrix and vector operations. In such cases, the LM algorithm is unsuitable in embedded environment and requires a hardware accelerator. In this paper, we implemented the LM algorithm in hardware. In the implementation, we used pipeline stages to divide the target function operation, and reduced the period of data input of the matrix and vector operations in order to accelerate the speed. To measure the performance of the implemented hardware, we applied the refining fundamental matrix(RFM), which is a part of 3D reconstruction application. As a result, the implemented system showed similar performance compared to software, and the execution speed increased in a product of 74.3.

신경망기법을 이용한 위성영상(ETM+)에서 산불피해지역 추출

  • 임정호;원강연;사공호상
    • Proceedings of the KSRS Conference
    • /
    • 2001.03a
    • /
    • pp.70-70
    • /
    • 2001
  • 인공위성영상(ETM+)을 이용하여 산불피해지역을 추출하기 위해 신경망기법을 응용하였다. 적용된 신경망은 3개의 층으로 구성된 전향신경망이며 Levenberg-Marquardt 역전파 훈련 알고리즘을 사용하였다. 산불피해지역은 심, 중, 경 세 가지로 나누었으며, 그외 피해없는 산림지역과 기타(나지, 도시 등)지역으로 분류하였다.

  • PDF

Water Quality Forecasting at Gongju station in Geum River using Neural Network Model (신경망 모형을 적용한 금강 공주지점의 수질예측)

  • An, Sang-Jin;Yeon, In-Seong;Han, Yang-Su;Lee, Jae-Gyeong
    • Journal of Korea Water Resources Association
    • /
    • v.34 no.6
    • /
    • pp.701-711
    • /
    • 2001
  • Forecasting of water quality variation is not an easy process due to the complicated nature of various water quality factors and their interrelationships. The objective of this study is to test the applicability of neural network models to the forecasting of the water quality at Gongju station in Geum River. This is done by forecasting monthly water qualities such as DO, BOD, and TN, and comparing with those obtained by ARIMA model. The neural network models of this study use BP(Back Propagation) algorithm for training. In order to improve the performance of the training, the models are tested in three different styles ; MANN model which uses the Moment-Adaptive learning rate method, LMNN model which uses the Levenberg-Marquardt method, and MNN model which separates the hidden layers for judgement factors from the hidden layers for water quality data. the results show that the forecasted water qualities are reasonably close to the observed data. And the MNN model shows the best results among the three models tested

  • PDF

Real-Time Image Mosaic Using DirectX (DirectX를 이용한 실시간 영상 모자익)

  • Chong, Min-Yeong;Choi, Seung-Hyun;Bae, Ki-Tae;Lee, Chil-Woo
    • The KIPS Transactions:PartB
    • /
    • v.10B no.7
    • /
    • pp.803-810
    • /
    • 2003
  • In this paper, we describe a fast image mosaic method for constructing a large-scale image with video image captured from cameras that are arranged in radial shape. In the first step, we adopt the phase correlation algorithm to estimate the horizontal and vertical displacement between two adjacent images. Secondly, we calculate the accurate transform matrix among those cameras with Levenberg-Marquardt method. In the last step, those images are stitched into one large scale image in real-time by applying the transform matrix to the texture mapping function of DirectX. The feature of the method is that we do not need to use special hardware devices or write machine-level programs for Implementing a real-time mosaic system since we use conventional graphic APIs (Application Programming Interfaces), DirectX for image synthesis process.

Estimation of Camera Motion Parameter using Invariant Feature Models (불변 특징모델을 이용한 카메라 동작인수 측정)

  • Cha, Jeong-Hee;Lee, Keun-Soo
    • Journal of the Korea Society of Computer and Information
    • /
    • v.10 no.4 s.36
    • /
    • pp.191-201
    • /
    • 2005
  • In this paper, we propose a method to calculate camera motion parameter, which is based on efficient invariant features irrelevant to the camera veiwpoint. As feature information in previous research is variant to camera viewpoint. information content is increased, therefore, extraction of accurate features is difficult. LM(Levenberg-Marquardt) method for camera extrinsic parameter converges on the goat value exactly, but it has also drawback to take long time because of minimization process by small step size. Therefore, in this paper, we propose the extracting method of invariant features to camera viewpoint and two-stage calculation method of camera motion parameter which enhances accuracy and convergent degree by using camera motion parameter by 2D homography to the initial value of LM method. The proposed method are composed of features extraction stage, matching stage and calculation stage of motion parameter. In the experiments, we compare and analyse the proposed method with existing methods by using various indoor images to demonstrate the superiority of the proposed algorithm.

  • PDF

Study of Neural Network Training Algorithm Comparison and Prediction of Unsteady Aerodynamic Forces of 2D Airfoil (신경망 학습알고리즘의 비교와 2차원 익형의 비정상 공력하중 예측기법에 관한 연구)

  • Kang, Seung-On;Jun, Sang-Ook;Park, Kyung-Hyun;Jeon, Yong-Hee;Lee, Dong-Ho
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.37 no.5
    • /
    • pp.425-432
    • /
    • 2009
  • In this study, the ability of neural network in modeling and predicting of the unsteady aerodynamic force coefficients of 2D airfoil with the data obtained from Euler CFD code has been confirmed. Neural network models are constructed based on supervised training process using Levenberg-Marquardt algorithm, combining this into genetic algorithm, hybrid genetic algorithm and the efficiency of the two cases are analyzed and compared. It is shown that hybrid-genetic algorithm is more efficient for neural network of complex system and the predicted properties of the unsteady aerodynamic force coefficients of 2D airfoil by the neural network models are confirmed to be similar to that of the numerical results and verified as suitable representing reduced models.

Flood Inflow Forecasting on Multipurpose Reservoir by Neural Network (신경망리론에 의한 다목적 저수지의 홍수유입량 예측)

  • Sim, Sun-Bo;Kim, Man-Sik
    • Journal of Korea Water Resources Association
    • /
    • v.31 no.1
    • /
    • pp.45-57
    • /
    • 1998
  • The purpose of this paper is to develop a neural network model in order to forecast flood inflow into the reservoir that has the nature of uncertainty and nonlinearity. The model has the features of multi-layered structure and parallel multi-connections. To develop the model. backpropagation learning algorithm was used with the Momentum and Levenberg-Marquardt techniques. The former technique uses gradient descent method and the later uses gradient descent and Gauss-Newton method respectively to solve the problems of local minima and for the speed of convergency. Used data for learning are continuous fixed real values of input as well as output to emulate the real physical aspects. after learning process. a reservoir inflows forecasting model at flood period was constructed. The data for learning were used to calibrate the developed model and the results were very satisfactory. applicability of the model to the Chungju Mlultipurpose Reservoir proved the availability of the developed model.

  • PDF

Algorithm Study for Diagnosis the Breast Cancer Using LMA and FDTD (LMA와 FDTD를 이용한 유방암 진단용 알고리즘 연구)

  • Seo, Min-Gyeong;Kim, Tae-Hong;Mun, Ji-Yeon;Jeon, Soon-Ik;Pack, Jeong-Ki
    • The Journal of Korean Institute of Electromagnetic Engineering and Science
    • /
    • v.22 no.12
    • /
    • pp.1124-1131
    • /
    • 2011
  • In this paper, image reconstruction algorithm for breast cancer detection using MT(Microwave Tomography) was investigated. The breast cancer detection system under development uses 16 transmit/receive antennas. The signal waveform was a sinusoidal wave at 900 MHz. To solve the 2D inverse scattering problem, we used the 2D FDTD (Finite Difference Time Domain) method for forward calculation and LMA(Levenberg-Marquardt Algorithm) for optimization. The result of the image reconstruction using the numerical phantom by MRI(Magnetic Resonance Imaging) obtained from real patient of breast cancer showed that we can detect the position of the tumor accurately.

Design of E-Tongue System using Neural Network (신경회로망을 이용한 휴대용 전자 혀 시스템의 설계)

  • Jung, Young-Chang;Kim, Dong-Jin;Kim, Jeong-Do;Jung, Woo-Suk
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.6 no.2
    • /
    • pp.149-158
    • /
    • 2005
  • In this paper, we have designed and implemented a portable e-tongue (electronic tongue) system using MACS (multi array chemical sensor) and PDA. The system embedded in PDA has merits such as comfortable user interface and data transfer by internet from on-site to remote computer. MACS was made up 7 electrodes (${NH_4}^+$, $Na^+$, $Cl^-$, ${NO_3}^-$, $K^+$, $Ca^{2+}$, $Na^+$, pH) and a reference electrode. For learning the system, we adapted the Levenberg-Marquardt algorithm based on the back-propagation, which could iteratively learned the pre-determined standard patterns, in e-tongue system. Conclusionally, the relationship between the standard patterns and unknown pattern can be easily analyzed. The e-tongue was applied to whiskeys and cognac (one high level whisky, one low level whiskey, two cognac) and 2 sample whiskeys for each standard patterns and unknown patterns. The relationship between the standard patterns and unknown patterns can be easily analyzed.

  • PDF