• Title/Summary/Keyword: Least squares method

Search Result 1,469, Processing Time 0.026 seconds

STOCHASTIC GRADIENT METHODS FOR L2-WASSERSTEIN LEAST SQUARES PROBLEM OF GAUSSIAN MEASURES

  • YUN, SANGWOON;SUN, XIANG;CHOI, JUNG-IL
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • v.25 no.4
    • /
    • pp.162-172
    • /
    • 2021
  • This paper proposes stochastic methods to find an approximate solution for the L2-Wasserstein least squares problem of Gaussian measures. The variable for the problem is in a set of positive definite matrices. The first proposed stochastic method is a type of classical stochastic gradient methods combined with projection and the second one is a type of variance reduced methods with projection. Their global convergence are analyzed by using the framework of proximal stochastic gradient methods. The convergence of the classical stochastic gradient method combined with projection is established by using diminishing learning rate rule in which the learning rate decreases as the epoch increases but that of the variance reduced method with projection can be established by using constant learning rate. The numerical results show that the present algorithms with a proper learning rate outperforms a gradient projection method.

Weighted Least Absolute Error Estimation of Regression Parameters

  • Song, Moon-Sup
    • Journal of the Korean Statistical Society
    • /
    • v.8 no.1
    • /
    • pp.23-36
    • /
    • 1979
  • In the multiple linear regression model a class of weighted least absolute error estimaters, which minimize the sum of weighted absolute residuals, is proposed. It is shown that the weighted least absolute error estimators with Wilcoxon scores are equivalent to the Koul's Wilcoxon type estimator. Therefore, the asymptotic efficiency of the proposed estimator with Wilcoxon scores relative to the least squares estimator is the same as the Pitman efficiency of the Wilcoxon test relative to the Student's t-test. To find the estimates the iterative weighted least squares method suggested by Schlossmacher is applicable.

  • PDF

Simultaneous Kinetic Spectrophotometric Determination of Sulfite and Sulfide Using Partial Least Squares (PLS) Regression

  • Afkhami, Abbas;Sarlak, Nahid;Zarei, Ali Reza;Madrakian, Tayyebeh
    • Bulletin of the Korean Chemical Society
    • /
    • v.27 no.6
    • /
    • pp.863-868
    • /
    • 2006
  • The partial least squares (PLS-1) calibration model based on spectrophotometric measurement, for the simultaneous determination of sulfite and sulfide is described. This method is based on the difference between the rate of the reaction of sulfide and sulfite with Malachite Green in pH 7.0 buffer solution and at 25 ${^{\circ}C}$. The absorption kinetic profiles of the solutions were monitored by measuring the decrease in the absorbance of Malachite Green at 617 nm in the time range 10-180 s after initiation of the reactions with 2 s intervals. The experimental calibration matrix for partial least squares (PLS-1) calibration was designed with 24 samples. The cross-validation method was used for selecting the number of factors. The results showed that simultaneous determination could be performed in the range 0.030-1.5 and 0.030-1.2 $\mu$g m$L ^{-1}$ for sulfite and sulfide, respectively. The proposed method was successfully applied to simultaneous determination of sulfite and sulfide in water samples and whole human blood.

Modified partial least squares method implementing mixed-effect model

  • Kyunga Kim;Shin-Jae Lee;Soo-Heang Eo;HyungJun Cho;Jae Won Lee
    • Communications for Statistical Applications and Methods
    • /
    • v.30 no.1
    • /
    • pp.65-73
    • /
    • 2023
  • Contemporary biomedical data often involve an ill-posed problem owing to small sample size and large number of multi-collinear variables. Partial least squares (PLS) method could be a plausible alternative to an ill-conditioned ordinary least squares. However, in the case of a PLS model that includes a random-effect, how to deal with a random-effect or mixed effects remains a widely open question worth further investigation. In the present study, we propose a modified multivariate PLS method implementing mixed-effect model (PLSM). The advantage of PLSM is its versatility in handling serial longitudinal data or its ability for taking a randomeffect into account. We conduct simulations to investigate statistical properties of PLSM, and showcase its real clinical application to predict treatment outcome of esthetic surgical procedures of human faces. The proposed PLSM seemed to be particularly beneficial 1) when random-effect is conspicuous; 2) the number of predictors is relatively large compared to the sample size; 3) the multicollinearity is weak or moderate; and/or 4) the random error is considerable.

Visualization of Vector Fields from Density Data Using Moving Least Squares Based on Monte Carlo Method (몬테카를로 방법 기반의 이동최소제곱을 이용한 밀도 데이터의 벡터장 시각화)

  • Jong-Hyun Kim
    • Journal of the Korea Computer Graphics Society
    • /
    • v.30 no.2
    • /
    • pp.1-9
    • /
    • 2024
  • In this paper, we propose a new method to visualize different vector field patterns from density data. We use moving least squares (MLS), which is used in physics-based simulations and geometric processing. However, typical MLS does not take into account the nature of density, as it is interpolated to a higher order through vector-based constraints. In this paper, we design an algorithm that incorporates Monte Carlo-based weights into the MLS to efficiently account for the density characteristics implicit in the input data, allowing the algorithm to represent different forms of white noise. As a result, we experimentally demonstrate detailed vector fields that are difficult to represent using existing techniques such as naive MLS and divergence-constrained MLS.

Estimation of viscous and Coulomb damping from free-vibration data by a least-squares curve-fitting analysis

  • Slemp, Wesley C.H.;Hallauer, William L. Jr.;Kapania, Rakesh K.
    • Smart Structures and Systems
    • /
    • v.4 no.3
    • /
    • pp.279-290
    • /
    • 2008
  • The modeling and parameter estimation of a damped one-degree-of-freedom mass-spring system is examined. This paper presents a method for estimating the system parameters (damping coefficients and natural frequency) from measured free-vibration motion of a system that is modeled to include both subcritical viscous damping and kinetic Coulomb friction. The method applies a commercially available least-squares curve-fitting software function to fit the known solution of the equations of motion to the measured response. The method was tested through numerical simulation, and it was applied to experimental data collected from a laboratory mass-spring apparatus. The mass of this apparatus translates on linear bearings, which are the primary source of light inherent damping. Results indicate that the curve-fitting method is effective and accurate for both perfect and noisy measurements from a lightly damped mass-spring system.

Localization of an Underwater Robot Using Acoustic Signal (음향 신호를 이용한 수중로봇의 위치추정)

  • Kim, Tae Gyun;Ko, Nak Yong
    • The Journal of Korea Robotics Society
    • /
    • v.7 no.4
    • /
    • pp.231-242
    • /
    • 2012
  • This paper proposes particle filter(PF) method using acoustic signal for localization of an underwater robot. The method uses time of arrival(TOA) or time difference of arrival(TDOA) of acoustic signals from beacons whose locations are known. An experiment in towing tank uses TOA information. Simulation uses TDOA information and it reveals dependency of the localization performance on the uncertainty of robot motion and senor data. Also, comparison of the PF method with the least squares method of spherical interpolation(SI) and spherical intersection(SX) is provided. Since PF uses TOA or TDOA which comes from measurement of external information as well as internal motion information, its estimation is more accurate and robust to the sensor and motion uncertainty than the least squares methods.

Conservative Quadratic RSM combined with Incomplete Small Composite Design and Conservative Least Squares Fitting

  • Kim, Min-Soo;Heo, Seung-Jin
    • Journal of Mechanical Science and Technology
    • /
    • v.17 no.5
    • /
    • pp.698-707
    • /
    • 2003
  • A new quadratic response surface modeling method is presented. In this method, the incomplete small composite design (ISCD) is newly proposed to .educe the number of experimental runs than that of the SCD. Unlike the SCD, the proposed ISCD always gives a unique design assessed on the number of factors, although it may induce the rank-deficiency in the normal equation. Thus, the singular value decomposition (SVD) is employed to solve the normal equation. Then, the duality theory is used to newly develop the conservative least squares fitting (CONFIT) method. This can directly control the ever- or the under-estimation behavior of the approximate functions. Finally, the performance of CONFIT is numerically shown by comparing its'conservativeness with that of conventional fitting method. Also, optimizing one practical design problem numerically shows the effectiveness of the sequential approximate optimization (SAO) combined with the proposed ISCD and CONFIT.

WorldView-2 pan-sharpening by minimization of spectral distortion with least squares

  • Choi, Myung-Jin
    • Korean Journal of Remote Sensing
    • /
    • v.27 no.3
    • /
    • pp.353-357
    • /
    • 2011
  • Although the intensity-hue-saturation (IHS) method for pan-sharpening has a spectral distortion problem, it is a popular method in the remote sensing community and has been used as a standard procedure in many commercial packages due to its fast computing and easy implementation. Recently, IHS-like approaches have tried to overcome the spectral distortion problem inherited from the IHS method itself and yielded a good result. In this paper, a similar IHS-like method with least squares for WorldView-2 pan-sharpening is presented. In particular, unlike the previous methods with three or four-band multispectral images for pan-sharpening, six bands of WorldView-2 multispectral image located within the range of panchromatic spectral radiance responses are considered in order to reduce the spectral distortion during the merging process. As a result, the new approach provides a satisfactory result, both visually and quantitatively. Furthermore, this shows great value in spectral fidelity of WorldView-2 eight-band multispectral imagery.

Application of GPS Surveying for Extracting Highway's Horizontal Alignment

  • Seo, Jeong-Hoon;Roh, Tae-Ho;Lee, Jong-Chool
    • Korean Journal of Geomatics
    • /
    • v.2 no.1
    • /
    • pp.1-6
    • /
    • 2002
  • Korea is a small country with relatively large mountainous areas and has many difficulties from planning to completing one road. Maintaining a completed road presents even more difficulties. presently, in estimating design elements, the result varies according to the engineer and there are many cases that question the reliability of the results. Therefore, in this study, the alignment of highway was sampled using by the centerline path, the design elements of horizontal alignment were reduced by applying the Least Squares Method, and the accuracy was analyzed. By this method, IP, IA, R, $\Delta$R and A-parameter were also determined. By observing relatively long straight sections, the approximate values could be estimated, and particularly, the considerably accurate value of A-parameter was determined. This study, using the Least Squares Method, aims to contribute to the development of the alignment examination in frequent traffic accident regions.

  • PDF