• Title/Summary/Keyword: least squares problem

Search Result 347, Processing Time 0.029 seconds

Multivariate Procedure for Variable Selection and Classification of High Dimensional Heterogeneous Data

  • Mehmood, Tahir;Rasheed, Zahid
    • Communications for Statistical Applications and Methods
    • /
    • v.22 no.6
    • /
    • pp.575-587
    • /
    • 2015
  • The development in data collection techniques results in high dimensional data sets, where discrimination is an important and commonly encountered problem that are crucial to resolve when high dimensional data is heterogeneous (non-common variance covariance structure for classes). An example of this is to classify microbial habitat preferences based on codon/bi-codon usage. Habitat preference is important to study for evolutionary genetic relationships and may help industry produce specific enzymes. Most classification procedures assume homogeneity (common variance covariance structure for all classes), which is not guaranteed in most high dimensional data sets. We have introduced regularized elimination in partial least square coupled with QDA (rePLS-QDA) for the parsimonious variable selection and classification of high dimensional heterogeneous data sets based on recently introduced regularized elimination for variable selection in partial least square (rePLS) and heterogeneous classification procedure quadratic discriminant analysis (QDA). A comparison of proposed and existing methods is conducted over the simulated data set; in addition, the proposed procedure is implemented to classify microbial habitat preferences by their codon/bi-codon usage. Five bacterial habitats (Aquatic, Host Associated, Multiple, Specialized and Terrestrial) are modeled. The classification accuracy of each habitat is satisfactory and ranges from 89.1% to 100% on test data. Interesting codon/bi-codons usage, their mutual interactions influential for respective habitat preference are identified. The proposed method also produced results that concurred with known biological characteristics that will help researchers better understand divergence of species.

NUMERICAL STUDY ON TWO-DIMENSIONAL INCOMPRESSIBLE VISCOUS FLOW BASED ON GRIDLESS METHOD (2차원 비압축성 점성유동에 관한 무격자법 기반의 수치해석)

  • Jeong, S.M.;Park, J.C.;Heo, J.K.
    • 한국전산유체공학회:학술대회논문집
    • /
    • 2009.04a
    • /
    • pp.239-244
    • /
    • 2009
  • The gridless (or meshfree) methods, such as MPS, SPH, FPM an so forth, are feasible and robust for the problems with moving boundary and/or complicated boundary shapes, because these methods do not need to generate a grid system. In this study, a gridless solver, which is based on the combination of moving least square interpolations on a cloud of points with point collocation for evaluating the derivatives of governing equations, is presented for two-dimensional unsteady incompressible Navier-Stokes problem in the low Reynolds number. A MAC-type algorithm was adopted and the Poission equation for the pressure was solved by successively in the moving least square sense. Some weighing functions were tested in order to investigate the up-winding effect for the convection term. Some typical problems were solved by the presented solver for the validation and the results obtained were compared with analytic solutions and the numerical results by conventional CFD methods, such as FVM.

  • PDF

An Improved Reliability-Based Design Optimization using Moving Least Squares Approximation (이동최소자승근사법을 이용한 개선된 신뢰도 기반 최적설계)

  • Kang, Soo-Chang;Koh, Hyun-Moo
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.29 no.1A
    • /
    • pp.45-52
    • /
    • 2009
  • In conventional structural design, deterministic optimization which satisfies codified constraints is performed to ensure safety and maximize economical efficiency. However, uncertainties are inevitable due to the stochastic nature of structural materials and applied loads. Thus, deterministic optimization without considering these uncertainties could lead to unreliable design. Recently, there has been much research in reliability-based design optimization (RBDO) taking into consideration both the reliability and optimization. RBDO involves the evaluation of probabilistic constraint that can be estimated using the RIA (Reliability Index Approach) and the PMA(Performance Measure Approach). It is generally known that PMA is more stable and efficient than RIA. Despite the significant advancement in PMA, RBDO still requires large computation time for large-scale applications. In this paper, A new reliability-based design optimization (RBDO) method is presented to achieve the more stable and efficient algorithm. The idea of the new method is to integrate a response surface method (RSM) with PMA. For the approximation of a limit state equation, the moving least squares (MLS) method is used. Through a mathematical example and ten-bar truss problem, the proposed method shows better convergence and efficiency than other approaches.

Interpolation method of head-related transfer function based on the least squares method and an acoustic modeling with a small number of measurement points (최소자승법과 음향학적 모델링 기반의 적은 개수의 측정점에 대한 머리전달함수 보간 기법)

  • Lee, Seokjin
    • The Journal of the Acoustical Society of Korea
    • /
    • v.36 no.5
    • /
    • pp.338-344
    • /
    • 2017
  • In this paper, an interpolation method of HRTF (Head-Related Transfer Function) is proposed for small-sized measurement data set, especially. The proposed algorithm is based on acoustic modeling of HRTFs, and the algorithm tries to interpolate the HRTFs via estimation the model coefficients. However, the estimation of the model coefficients is hard if there is lack of measurement points, so the algorithm solves the problem by a data augmentation using the VBAP (Vector Based Amplitude Panning). Therefore, the proposed algorithm consists of two steps, which are data augmentation step based on VBAP and model coefficients estimation step by least squares method. The proposed algorithm was evaluated by a simulation with a measured data from CIPIC (Center for Image Processing and Integrated Computing) HRTF database, and the simulation results show that the proposed algorithm reduces mean-squared error by 1.5 dB ~ 4 dB than the conventional algorithms.

A Comparative Study of Approximation Techniques on Design Optimization of a FPSO Riser Support Structure (FPSO Riser 지지구조의 설계최적화에 대한 근사화 기법의 비교 연구)

  • Shim, Chun-Sik;Song, Chang-Yong
    • Journal of the Computational Structural Engineering Institute of Korea
    • /
    • v.24 no.5
    • /
    • pp.543-551
    • /
    • 2011
  • The paper deals with the comparative study of design optimization based on various approximation techniques in strength design of riser support structure installed on floating production storage and offloading unit(FPSO) using offshore operation loading conditions. The design optimization problem is formulated such that structural member sizing variables are determined by minimizing the weight of riser support structure subject to the constraints of structural strength in terms of loading conditions. The approximation techniques used in the comparative study are response surface method based sequential approximate optimization(RBSAO), Kriging based sequential approximate optimization(KBSAO), and the enhanced moving least squares method(MLSM) based approximate optimization such as CF(constraint feasible)-MLSM and Post-MLSM. Commercial process integration and design optimization(PIDO) tools are employed for the applications of RBSAO and KBSAO. The enhanced MLSM based approximate optimization techniques are newly developed to ensure the constraint feasibility. In the context of numerical performances such as design solution and computational cost, the solution results from approximate techniques based design optimization are compared to actual non-approximate design optimization.

On B-spline Approximation for Representing Scattered Multivariate Data (비정렬 다변수 데이터의 B-스플라인 근사화 기법)

  • Park, Sang-Kun
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.35 no.8
    • /
    • pp.921-931
    • /
    • 2011
  • This paper presents a data-fitting technique in which a B-spline hypervolume is used to approximate a given data set of scattered data samples. We describe the implementation of the data structure of a B-spline hypervolume, and we measure its memory size to show that the representation is compact. The proposed technique includes two algorithms. One is for the determination of the knot vectors of a B-spline hypervolume. The other is for the control points, which are determined by solving a linear least-squares minimization problem where the solution is independent of the data-set complexity. The proposed approach is demonstrated with various data-set configurations to reveal its performance in terms of approximation accuracy, memory use, and running time. In addition, we compare our approach with existing methods and present unconstrained optimization examples to show the potential for various applications.

A Parameter Estimation Method using Nonlinear Least Squares (비선형 최소제곱법을 이용한 모수추정 방법론)

  • Oh, Suna;Song, Jongwoo
    • The Korean Journal of Applied Statistics
    • /
    • v.26 no.3
    • /
    • pp.431-440
    • /
    • 2013
  • We consider the problem of estimating the parameters of heavy tailed distributions. In general, maximum likelihood estimation(MLE) is the most preferred method of parameter estimation because it has good properties such as asymptotic consistency, normality and efficiency. However, MLE is not always the best solution because MLE is unstable or does not exist in some cases. This paper proposes another parameter estimation method, non-linear least squares(NLS) and compares its performance to MLE. The NLS estimator is achieved by minimizing sum of squared difference between empirical cumulative distribution function(CDF) and a theoretical distribution function. In this article, we compare the NLS method to MLE using simulated data from heavy tailed distributions. The NLS method is shown to perform better than MLE in Burr distribution when the sample size is small; in addition, it performs well in a Frechet distribution.

A Study on Employee's Compliance Behavior towards Information Security Policy : A Modified Triandis Model (조직 구성원의 정보보안정책 준수행동에 대한 연구 : 수정된 Triandis 모델의 적용)

  • Kim, Dae-Jin;Hwang, In-Ho;Kim, Jin-Soo
    • Journal of Digital Convergence
    • /
    • v.14 no.4
    • /
    • pp.209-220
    • /
    • 2016
  • Although organizations are providing information security policy, education and support to guide their employees in security policy compliance, accidents by non-compliance is still a never ending problem to organizations. This study investigates the factors that influence employees' information security policy compliance behavior using elements of Triandis model. We analyzed the relationships among Triandis model's factors using PLS(Partial Least Squares). The result of the hypothesis tests shows that organization can induce individual's information security policy compliance intention and behavior by information security policy and facilitating conditions that support it, and proves the importance of members' expected value, habit and affect about information security compliance. This study is significant in a way that it applies Triandis model in the field of information security, and presents direction for members' information security behavior, and will be able to provide measures to establish organization's information security policy and increase members' compliance behavior.

Analysis for Torsion of Hollow Beam by Least Squares and Boundary Elements Method (최소자승법 및 경계요소에 의한 중공단면 보의 비틀림 해석)

  • Kim, Chi-Kyung;Bae, Joon-Tai
    • Journal of the Computational Structural Engineering Institute of Korea
    • /
    • v.25 no.2
    • /
    • pp.175-182
    • /
    • 2012
  • In this paper we are concerned with the performance of structural stability of torsion in square cross section of a beam with holes. The critical load is defined as the smallest load at which the equilibrium of the structure fails to be stable as the load is slowly increased from zero. The beams subjected to torsion are frequently encountered in general structures and these forces influence to the stability of structure. The boundary element method is found to be very efficient and accurate for the analysis of torsion problems including complex boundary conditions with respect to its simplicity and generality. In this paper, it is required to derive the boundary element formulation for torsion problem and integrate directly on the discrete boundary. To investigate the validity of the developed computer program, three distinctly solid cross-sections which are elliptical, rectangular and triangular one are analyzed, and comparisons are made with analytical approaches where these can also be used.

Comparative Study of Approximate Optimization Techniques in CAE-Based Structural Design (구조 최적설계를 위한 다양한 근사 최적화기법의 적용 및 비교에 관한 연구)

  • Song, Chang-Yong;Lee, Jong-Soo
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.34 no.11
    • /
    • pp.1603-1611
    • /
    • 2010
  • The comparative study of regression-model-based approximate optimization techniques used in the strength design of an automotive knuckle component that will be under bump and brake loading conditions is carried out. The design problem is formulated such that the cross-sectional sizing variables are determined by minimizing the weight of the knuckle component that is subjected to stresses, deformations, and vibration frequency constraints. The techniques used in the comparative study are sequential approximate optimization (SAO), sequential two-point diagonal quadratic approximate optimization (STDQAO), and approximate optimization based on enhanced moving least squares method (MLSM), such as CF (constraint feasible)-MLSM and Post-MLSM. Commercial process integration and design optimization (PIDO) tools are utilized for the application of SAO and STDQAO. The enhanced MLSM-based approximate optimization techniques are newly developed to ensure constraint feasibility. The results of the approximate optimization techniques are compared with those of actual non-approximate optimization to evaluate their numerical performances.