• Title/Summary/Keyword: conjugate gradient algorithm

Search Result 100, Processing Time 0.022 seconds

An Acoustic Noise Cancellation Using Subband Block Conjugate Gradient Algorithm (부밴드 블록 공액 경사 알고리듬을 이용한 음향잡음 제거)

  • 김대성;배현덕
    • The Journal of the Acoustical Society of Korea
    • /
    • v.20 no.3
    • /
    • pp.8-14
    • /
    • 2001
  • In this paper, we present a new cost function for subband block adaptive algorithm and block conjugate gradient algorithm for noise cancellation of acoustic signal. For the cost function, we process the subband signals with data blocks for each subbands and recombine it a whole data block. After these process, the cost function has a quadratic form in adaptive filter coefficients, it guarantees the convergence of the suggested block conjugate gradient algorithm. And the block conjugate gradient algorithm which minimizes the suggested cost function has better performance than the case of full-band block conjugate gradient algorithm, the computer simulation results of noise cancellation show the efficiency of the suggested algorithm.

  • PDF

Compression of Image Data Using Neural Networks based on Conjugate Gradient Algorithm and Dynamic Tunneling System

  • Cho, Yong-Hyun;Kim, Weon-Ook;Bang, Man-Sik;Kim, Young-il
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1998.06a
    • /
    • pp.740-749
    • /
    • 1998
  • This paper proposes compression of image data using neural networks based on conjugate gradient method and dynamic tunneling system. The conjugate gradient method is applied for high speed optimization .The dynamic tunneling algorithms, which is the deterministic method with tunneling phenomenon, is applied for global optimization. Converging to the local minima by using the conjugate gradient method, the new initial point for escaping the local minima is estimated by dynamic tunneling system. The proposed method has been applied the image data compression of 12 ${\times}$12 pixels. The simulation results shows the proposed networks has better learning performance , in comparison with that using the conventional BP as learning algorithm.

AN AFFINE SCALING INTERIOR ALGORITHM VIA CONJUGATE GRADIENT AND LANCZOS METHODS FOR BOUND-CONSTRAINED NONLINEAR OPTIMIZATION

  • Jia, Chunxia;Zhu, Detong
    • Journal of applied mathematics & informatics
    • /
    • v.29 no.1_2
    • /
    • pp.173-190
    • /
    • 2011
  • In this paper, we construct a new approach of affine scaling interior algorithm using the affine scaling conjugate gradient and Lanczos methods for bound constrained nonlinear optimization. We get the iterative direction by solving quadratic model via affine scaling conjugate gradient and Lanczos methods. By using the line search backtracking technique, we will find an acceptable trial step length along this direction which makes the iterate point strictly feasible and the objective function nonmonotonically decreasing. Global convergence and local superlinear convergence rate of the proposed algorithm are established under some reasonable conditions. Finally, we present some numerical results to illustrate the effectiveness of the proposed algorithm.

A Development of a Path-Based Traffic Assignment Algorithm using Conjugate Gradient Method (Conjugate Gradient 법을 이용한 경로기반 통행배정 알고리즘의 구축)

  • 강승모;권용석;박창호
    • Journal of Korean Society of Transportation
    • /
    • v.18 no.5
    • /
    • pp.99-107
    • /
    • 2000
  • Path-based assignment(PBA) is valuable to dynamic traffic control and routing in integrated ITS framework. As one of widely studied PBA a1gorithms, Gradient Projection(GP) a1gorithm typically fields rapid convergence to a neighborhood of an optimal solution. But once it comes near a solution, it tends to slow down. To overcome this problem, we develop more efficient path-based assignment algorithm by combining Conjugate Gradient method with GP algorithm. It determines more accurate moving direction near a solution in order to gain a significant advantage in speed of convergence. Also this algorithm is applied to the Sioux-Falls network and verified its efficiency. Then we demonstrate that this type of method is very useful in improving speed of convergence in the case of user equilibrium problem.

  • PDF

Conjugate finite-step length method for efficient and robust structural reliability analysis

  • Keshtegar, Behrooz
    • Structural Engineering and Mechanics
    • /
    • v.65 no.4
    • /
    • pp.415-422
    • /
    • 2018
  • The Conjugate Finite-Step Length" (CFSL) algorithm is proposed to improve the efficiency and robustness of first order reliability method (FORM) for reliability analysis of highly nonlinear problems. The conjugate FORM-based CFSL is formulated using the adaptive conjugate search direction based on the finite-step size with simple adjusting condition, gradient vector of performance function and previous iterative results including the conjugate gradient vector and converged point. The efficiency and robustness of the CFSL algorithm are compared through several nonlinear mathematical and structural/mechanical examples with the HL-RF and "Finite-Step-Length" (FSL) algorithms. Numerical results illustrated that the CFSL algorithm performs better than the HL-RF for both robust and efficient results while the CFLS is as robust as the FSL for structural reliability analysis but is more efficient.

A NEW CONJUGATE GRADIENT MINIMIZATION METHOD BASED ON EXTENDED QUADRATIC FUNCTIONS

  • Moghrabi, Issam.A.R.
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • v.8 no.2
    • /
    • pp.7-13
    • /
    • 2004
  • A Conjugate Gradient (CG) algorithm for unconstrained minimization is proposed which is invariant to a nonlinear scaling of a strictly convex quadratic function and which generates mutually conjugate directions for extended quadratic functions. It is derived for inexact line searches and is designed for the minimization of general nonlinear functions. It compares favorably in numerical tests with the original Dixon algorithm on which the new algorithm is based.

  • PDF

CONVERGENCE PROPERTIES OF A CORRELATIVE POLAK-RIBIERE CONJUGATE GRADIENT METHOD

  • Hu Guofang;Qu Biao
    • Journal of applied mathematics & informatics
    • /
    • v.22 no.1_2
    • /
    • pp.461-466
    • /
    • 2006
  • In this paper, an algorithm with a new Armijo-type line search is proposed that ensure global convergence of a correlative Polak-Ribiere conjugate method for the unconstrained minimization of non-convex differentiable function.

Improving the Training Performance of Neural Networks by using Hybrid Algorithm (하이브리드 알고리즘을 이용한 신경망의 학습성능 개선)

  • Kim, Weon-Ook;Cho, Yong-Hyun;Kim, Young-Il;Kang, In-Ku
    • The Transactions of the Korea Information Processing Society
    • /
    • v.4 no.11
    • /
    • pp.2769-2779
    • /
    • 1997
  • This Paper Proposes an efficient method for improving the training performance of the neural networks using a hybrid of conjugate gradient backpropagation algorithm and dynamic tunneling backpropagation algorithm The conjugate gradient backpropagation algorithm, which is the fast gradient algorithm, is applied for high speed optimization. The dynamic tunneling backpropagation algorithm, which is the deterministic method with tunneling phenomenon, is applied for global optimization. Conversing to the local minima by using the conjugate gradient backpropagation algorithm, the new initial point for escaping the local minima is estimated by dynamic tunneling backpropagation algorithm. The proposed method has been applied to the parity check and the pattern classification. The simulation results show that the performance of proposed method is superior to those of gradient descent backpropagtion algorithm and a hybrid of gradient descent and dynamic tunneling backpropagation algorithm, and the new algorithm converges more often to the global minima than gradient descent backpropagation algorithm.

  • PDF

Comparison of Regularization Techniques For an Inverse Radiation Boundary Analysis (역복사경계해석을 위한 다양한 조정기법 비교)

  • Kim, Ki-Wan;Baek, Seung-Wook
    • Proceedings of the KSME Conference
    • /
    • 2004.11a
    • /
    • pp.1288-1293
    • /
    • 2004
  • Inverse radiation problems are solved for estimating the boundary conditions such as temperature distribution and wall emissivity in axisymmetric absorbing, emitting and scattering medium, given the measured incident radiative heat fluxes. Various regularization methods, such as hybrid genetic algorithm, conjugate-gradient method and Newton method, were adopted to solve the inverse problem, while discussing their features in terms of estimation accuracy and computational efficiency. Additionally, we propose a new combined approach of adopting the genetic algorithm as an initial value selector, whereas using the conjugate-gradient method and Newton method to reduce their dependence on the initial value.

  • PDF