• Title/Summary/Keyword: gradient methods

Search Result 1,171, Processing Time 0.031 seconds

STOCHASTIC GRADIENT METHODS FOR L2-WASSERSTEIN LEAST SQUARES PROBLEM OF GAUSSIAN MEASURES

  • YUN, SANGWOON;SUN, XIANG;CHOI, JUNG-IL
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • v.25 no.4
    • /
    • pp.162-172
    • /
    • 2021
  • This paper proposes stochastic methods to find an approximate solution for the L2-Wasserstein least squares problem of Gaussian measures. The variable for the problem is in a set of positive definite matrices. The first proposed stochastic method is a type of classical stochastic gradient methods combined with projection and the second one is a type of variance reduced methods with projection. Their global convergence are analyzed by using the framework of proximal stochastic gradient methods. The convergence of the classical stochastic gradient method combined with projection is established by using diminishing learning rate rule in which the learning rate decreases as the epoch increases but that of the variance reduced method with projection can be established by using constant learning rate. The numerical results show that the present algorithms with a proper learning rate outperforms a gradient projection method.

Interior Point Methods for Network Problems (An Efficient Conjugate Gradient Method for Interior Point Methods) (네트워크 문제에서 내부점 방법의 활용 (내부점 선형계획법에서 효율적인 공액경사법))

  • 설동렬
    • Journal of the military operations research society of Korea
    • /
    • v.24 no.1
    • /
    • pp.146-156
    • /
    • 1998
  • Cholesky factorization is known to be inefficient to problems with dense column and network problems in interior point methods. We use the conjugate gradient method and preconditioners to improve the convergence rate of the conjugate gradient method. Several preconditioners were applied to LPABO 5.1 and the results were compared with those of CPLEX 3.0. The conjugate gradient method shows to be more efficient than Cholesky factorization to problems with dense columns and network problems. The incomplete Cholesky factorization preconditioner shows to be the most efficient among the preconditioners.

  • PDF

Comparison with two Gradient Methods through the application to the Vector Linear Predictor (두가지 gradient 방법의 벡터 선형 예측기에 대한 적용 비교)

  • Shin, Kwang-Kyun;Yang, Seung-In
    • Proceedings of the KIEE Conference
    • /
    • 1987.07b
    • /
    • pp.1595-1597
    • /
    • 1987
  • Two gradient methods, steepest descent method and conjugate gradient descent method, are compar ed through application to vector linear predictors. It is found that the convergence rate of the conju-gate gradient descent method is much faster than that of the steepest descent method.

  • PDF

Comparison of Ionospheric Spatial Gradient Estimation Methods using GNSS (GNSS를 이용한 전리층 기울기 추정 방법 비교)

  • Jeong, Myeong-Sook;Kim, Jeong-Rae
    • Journal of the Korean Society for Aviation and Aeronautics
    • /
    • v.15 no.2
    • /
    • pp.18-24
    • /
    • 2007
  • The high ionospheric spatial gradient during ionospheric storm is the most concern when applying GNSS(Global Navigation Satellite System) augmentation systems for aircraft precision approach. Since the ionospheric gradient level depends on geographical location as well as the storm, understanding the ionospheric gradient statistics over a specific regional area is necessary for operating the augmentation systems. This paper compares three ionosphere gradient computation methods, direct differentiation between two receivers' ionospheric delay signal for a common satellite, derivation from a grid ionosphere map, and derivation from a plate ionosphere map. The plate map method provides a good indication on the gradient variation behavior over a regional area with limited number of GNSS receivers. The residual analysis for the ionosphere storm detection is discussed as well.

  • PDF

GRADIENT PROJECTION METHODS FOR THE n-COUPLING PROBLEM

  • Kum, Sangho;Yun, Sangwoon
    • Journal of the Korean Mathematical Society
    • /
    • v.56 no.4
    • /
    • pp.1001-1016
    • /
    • 2019
  • We are concerned with optimization methods for the $L^2$-Wasserstein least squares problem of Gaussian measures (alternatively the n-coupling problem). Based on its equivalent form on the convex cone of positive definite matrices of fixed size and the strict convexity of the variance function, we are able to present an implementable (accelerated) gradient method for finding the unique minimizer. Its global convergence rate analysis is provided according to the derived upper bound of Lipschitz constants of the gradient function.

An edge detection method for gray scale images based on their fuzzy system representation (디지털 영상의 퍼지시스템 표현을 이용한 Edge 검출방법)

  • 문병수;이현철;김장열
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.11 no.6
    • /
    • pp.454-458
    • /
    • 2001
  • Based on a fuzzy system representation of gray scale images, we derive and edge detection algorithm whose convolution kernel is different from the known kernels such as those of Robert's Prewitt's or Sobel's gradient. Our fuzzy system representation is an exact representation of the bicubic spline function which represents the gray scale image approximately. Hence the fuzzy system is a continuous function and it provides a natural way to define the gradient and the Laplacian operator. We show that the gradient at grid points can be evaluated by taking the convolution of the image with a 3$\times$3 kernel. We also that our gradient coupled with the approximate value of the continuous function generates an edge detection method which creates edge images clearer than those by other methods. A few examples of applying our methods are included.

  • PDF

LEAST-SQUARE SWITCHING PROCESS FOR ACCURATE AND EFFICIENT GRADIENT ESTIMATION ON UNSTRUCTURED GRID

  • SEO, SEUNGPYO;LEE, CHANGSOO;KIM, EUNSA;YUNE, KYEOL;KIM, CHONGAM
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • v.24 no.1
    • /
    • pp.1-22
    • /
    • 2020
  • An accurate and efficient gradient estimation method on unstructured grid is presented by proposing a switching process between two Least-Square methods. Diverse test cases show that the gradient estimation by Least-Square methods exhibit better characteristics compared to Green-Gauss approach. Based on the investigation, switching between the two Least-Square methods, whose merit complements each other, is pursued. The condition number of the Least-Square matrix is adopted as the switching criterion, because it shows clear correlation with the gradient error, and it can be easily calculated from the geometric information of the grid. To illustrate switching process on general grid, condition number is analyzed using stencil vectors and trigonometric relations. Then, the threshold of switching criterion is established. Finally, the capability of Switching Weighted Least-Square method is demonstrated through various two- and three-dimensional applications.

An Application of the Clustering Threshold Gradient Descent Regularization Method for Selecting Genes in Predicting the Survival Time of Lung Carcinomas

  • Lee, Seung-Yeoun;Kim, Young-Chul
    • Genomics & Informatics
    • /
    • v.5 no.3
    • /
    • pp.95-101
    • /
    • 2007
  • In this paper, we consider the variable selection methods in the Cox model when a large number of gene expression levels are involved with survival time. Deciding which genes are associated with survival time has been a challenging problem because of the large number of genes and relatively small sample size (n<

AN AFFINE SCALING INTERIOR ALGORITHM VIA CONJUGATE GRADIENT AND LANCZOS METHODS FOR BOUND-CONSTRAINED NONLINEAR OPTIMIZATION

  • Jia, Chunxia;Zhu, Detong
    • Journal of applied mathematics & informatics
    • /
    • v.29 no.1_2
    • /
    • pp.173-190
    • /
    • 2011
  • In this paper, we construct a new approach of affine scaling interior algorithm using the affine scaling conjugate gradient and Lanczos methods for bound constrained nonlinear optimization. We get the iterative direction by solving quadratic model via affine scaling conjugate gradient and Lanczos methods. By using the line search backtracking technique, we will find an acceptable trial step length along this direction which makes the iterate point strictly feasible and the objective function nonmonotonically decreasing. Global convergence and local superlinear convergence rate of the proposed algorithm are established under some reasonable conditions. Finally, we present some numerical results to illustrate the effectiveness of the proposed algorithm.

An Edge Detection Method for Gray Scale Images Based on their Fuzzy System Representation

  • Moon, Byung-Soo;Lee, Hyun-Chul;Kim, Jang-Yeol
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2001.12a
    • /
    • pp.283-286
    • /
    • 2001
  • Based on a fuzzy system representation of gray scale images, we derive an edge detection algorithm whose convolution kernel is different from the known kernels such as those of Roberts', Prewitt's or Sobel's gradient. Our fuzzy system representation is an exact representation of the bicubic spline function which represents the gray scale image approximately. Hence the fuzzy system is a continuous function and it provides a natural way to define the gradient and the Laplacian operator. We show that the gradient at grid points can be evaluated by taking the convolution of the image with a 3 3 kernel. We also show that our gradient coupled with the approximate value of the continuous function generates an edge detection method which creates edge images clearer than those by other methods. A few examples of applying our methods are included.

  • PDF