Browse > Article
http://dx.doi.org/10.5573/ieie.2014.51.11.073

FPGA Implementation of Levenverg-Marquardt Algorithm  

Lee, Myung-Jin (Department of electronics and communication engineering, Kwangwoon University)
Jung, Yong-Jin (Department of electronics and communication engineering, Kwangwoon University)
Publication Information
Journal of the Institute of Electronics and Information Engineers / v.51, no.11, 2014 , pp. 73-82 More about this Journal
Abstract
The LM algorithm is used in solving the least square problem in a non linear system, and is used in various fields. However, in cases the applied field's target functionis complicated and high-dimensional, it takes a lot of time solving the inner matrix and vector operations. In such cases, the LM algorithm is unsuitable in embedded environment and requires a hardware accelerator. In this paper, we implemented the LM algorithm in hardware. In the implementation, we used pipeline stages to divide the target function operation, and reduced the period of data input of the matrix and vector operations in order to accelerate the speed. To measure the performance of the implemented hardware, we applied the refining fundamental matrix(RFM), which is a part of 3D reconstruction application. As a result, the implemented system showed similar performance compared to software, and the execution speed increased in a product of 74.3.
Keywords
Levenberg-Marquardt; FPGA; Hardware; 3D reconstruction; Fundamental matrix;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Marquardt, "An Algorithm for Least-Squares Estimation of Nonlinear Parameters", Journal of the society for Industrial and Applied Mathematics, Vol. 11, No. 2(Jun.,1963), 431-441.   DOI   ScienceOn
2 Golub, G. "Numerical methods for solving linear least squares problems." Numerische Mathematik 7.3 (1965): 206-216.   DOI
3 Gratton, Serge, Amos S. Lawless, and Nancy K. Nichols. "Approximate Gauss-Newton methods for nonlinear least squares problems." SIAM Journal on Optimization 18.1 (2007): 106-132.   DOI   ScienceOn
4 Levenberg, Kenneth. "A method for the solution of certain problems in least squares." Quarterly of applied mathematics 2 (1944): 164-168.
5 Powell, Michael JD. "A hybrid method for nonlinear equations." Numerical methods for nonlinear algebraic equations 7 (1970): 87-114.
6 R. Hartley and A. Zisserman, "Multiple View Geometry in Computer Vision", Cambridge University Press, 2000.
7 David C. Lay, "Linear Algebra and Its Applications, Third Edition", Pearson, 14-25.
8 Madsen, Kaj, Hans Bruun Nielsen, and Ole Tingleff. Methods for non-linear least squares problems. 1999.
9 Lowe, David G. "Object recognition from local scale-invariant features." Computer vision, 1999. The proceedings of the seventh IEEE international conference on. Vol. 2. Ieee, 1999.
10 Mount, David M. ANN programming manual. Technical report, Dept. of Computer Science, U. of Maryland, 1998.
11 Golub, Gene H., and Christian Reinsch. "Singular value decomposition and least squares solutions." Numerische Mathematik 14.5 (1970): 403-420.   DOI
12 ImpulseC, Impulse CoDeveloperTM [Online]. Available: http://www.impulseaccelerated.com
13 ARM, "Cortex-A9 Floating-Point Unit (FPU) Technical Reference Manual(ARM DDI 0408), Revision :r2p2", : 44.
14 Xilinx, "floating_point_ds335.pdf",(March, 2011): 5.
15 Blasco, Jose M., et al. "Maximum Likelihood Estimation and Non-Linear Least Squares Fitting Implementation in FPGA Devices for High Resolution Hodoscopy." (2013): 1-7.