• Title/Summary/Keyword: least squares

Search Result 2,607, Processing Time 0.026 seconds

SVC with Modified Hinge Loss Function

  • Lee, Sang-Bock
    • Journal of the Korean Data and Information Science Society
    • /
    • v.17 no.3
    • /
    • pp.905-912
    • /
    • 2006
  • Support vector classification(SVC) provides more complete description of the linear and nonlinear relationships between input vectors and classifiers. In this paper we propose to solve the optimization problem of SVC with a modified hinge loss function, which enables to use an iterative reweighted least squares(IRWLS) procedure. We also introduce the approximate cross validation function to select the hyperparameters which affect the performance of SVC. Experimental results are then presented which illustrate the performance of the proposed procedure for classification.

  • PDF

L$_\infty$-estimation based Algorithm for the Least Median of Squares Estimator

  • Bu Young Kim
    • Communications for Statistical Applications and Methods
    • /
    • v.3 no.2
    • /
    • pp.299-307
    • /
    • 1996
  • This article is concerned with the algorithms for the least median of squares estimator. An algorithm based on the $L{\infty}$ .inf.-estimation procedure is proposed in an attempt to improve the optimality of the estimate. And it is shown that the proposed algorithm yields more optimal estimate than the traditional resampling algorithms. The proposed algorithm employs a linear scaling transformation at each iteration of the$L{\infty}$-algorithm to deal with its computational inefficiency problem.

  • PDF

TOTAL LEAST SQUARES FITTING WITH QUADRICS

  • Spath, Helmuth
    • The Pure and Applied Mathematics
    • /
    • v.11 no.2
    • /
    • pp.103-115
    • /
    • 2004
  • A computational algorithm is developed for fitting given data in the plane or in 3-space by implicitly defined quadrics. Implicity implies that the type of the quadric is part of the model and need not be known in advance. Starting with some estimate for the coefficients of the quadric the method will alternatively determine the shortest distances from the given points onto the quadric and adapt the coefficients such as to reduce the sum of those squared distances. Numerical examples are given.

  • PDF

A Statistical Estimation of The Universal Constants Using A Simulation Predictor

  • Park, Jeong-Soo-
    • Proceedings of the Korea Society for Simulation Conference
    • /
    • 1992.10a
    • /
    • pp.6-6
    • /
    • 1992
  • This work deals with nonlinear least squares method for estimating unknown universial constants C in a computer simulation code real experimental data(or database) and computer simulation data. The best linear unbiased predictor based on a spatial statistical model is fitted from the computer simulation data. Then nonlinear least squares estimation method is applied to the real data using the fitted prediction model(or simulation predictor) as if it were the true simulation model. An application to the computational nuclear fusion device is presented.

  • PDF

GRADIENT PROJECTION METHODS FOR THE n-COUPLING PROBLEM

  • Kum, Sangho;Yun, Sangwoon
    • Journal of the Korean Mathematical Society
    • /
    • v.56 no.4
    • /
    • pp.1001-1016
    • /
    • 2019
  • We are concerned with optimization methods for the $L^2$-Wasserstein least squares problem of Gaussian measures (alternatively the n-coupling problem). Based on its equivalent form on the convex cone of positive definite matrices of fixed size and the strict convexity of the variance function, we are able to present an implementable (accelerated) gradient method for finding the unique minimizer. Its global convergence rate analysis is provided according to the derived upper bound of Lipschitz constants of the gradient function.

Algorithms for bivariate time series modeling in small size computers (2변수 시계열 모델 산출을 위한 소형컴퓨터용 알고리즘)

  • 김광준;문인혁;박병호
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1986.10a
    • /
    • pp.108-112
    • /
    • 1986
  • Several algorithms for bivariate time series modeling are reviewed : linear least square, nonlinear least squares, generalized least square, and multi-stage least square methods. Estimation results of simulated data by the above methods are discussed.

  • PDF

Mixed-effects model by projections (사영에 의한 혼합효과모형)

  • Choi, Jaesung
    • The Korean Journal of Applied Statistics
    • /
    • v.29 no.7
    • /
    • pp.1155-1163
    • /
    • 2016
  • This paper deals with an estimation procedure of variance components in a mixed effects model by projections. Projections are used to obtain sums of squares instead of using reductions in sums of squares due to fitting both the assumed model and sub-models in the fitting constants method. A projection matrix can be obtained for the residual model at each step by a stepwise procedure to test the hypotheses. A weighted least squares method is used for the estimation of fixed effects. Satterthwaite's approximation is done for the confidence intervals for variance components.

On Parameter Estimation of Growth Curves for Technological Forecasting by Using Non-linear Least Squares

  • Ko, Young-Hyun;Hong, Seung-Pyo;Jun, Chi-Hyuck
    • Management Science and Financial Engineering
    • /
    • v.14 no.2
    • /
    • pp.89-104
    • /
    • 2008
  • Growth curves including Bass, Logistic and Gompertz functions are widely used in forecasting the market demand. Nonlinear least square method is often adopted for estimating the model parameters but it is difficult to set up the starting value for each parameter. If a wrong starting point is selected, the result may lead to erroneous forecasts. This paper proposes a method of selecting starting values for model parameters in estimating some growth curves by nonlinear least square method through grid search and transformation into linear regression model. Resealing the market data using the national economic index makes it possible to figure out the range of parameters and to utilize the grid search method. Application to some real data is also included, where the performance of our method is demonstrated.

An Estimation of Parameters in Weibull Distribution Using Least Squares Method under Random Censoring Model (임의 중단모형에서 최소제곱법을 이용한 와이블분포의 모수 추정)

  • Lee, Woo-Dong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.7 no.2
    • /
    • pp.263-272
    • /
    • 1996
  • In this parer, under random censorship model, an estimation of scale and shape parameters in Weibull lifetime model is considered. Based on nonparametric estimator of survival function, the least square method is proposed. The proposed estimation method is simple and the performance of the proposed estimator is as efficient as maximum likelihood estimators. An example is presented, using field winding data. Simulation studies are performed to compare the performaces of the proposed estimator and maximum likelihood estimator.

  • PDF