• Title/Summary/Keyword: Partial least squares (PLS)

Search Result 383, Processing Time 0.776 seconds

Modified partial least squares method implementing mixed-effect model

  • Kyunga Kim;Shin-Jae Lee;Soo-Heang Eo;HyungJun Cho;Jae Won Lee
    • Communications for Statistical Applications and Methods
    • /
    • v.30 no.1
    • /
    • pp.65-73
    • /
    • 2023
  • Contemporary biomedical data often involve an ill-posed problem owing to small sample size and large number of multi-collinear variables. Partial least squares (PLS) method could be a plausible alternative to an ill-conditioned ordinary least squares. However, in the case of a PLS model that includes a random-effect, how to deal with a random-effect or mixed effects remains a widely open question worth further investigation. In the present study, we propose a modified multivariate PLS method implementing mixed-effect model (PLSM). The advantage of PLSM is its versatility in handling serial longitudinal data or its ability for taking a randomeffect into account. We conduct simulations to investigate statistical properties of PLSM, and showcase its real clinical application to predict treatment outcome of esthetic surgical procedures of human faces. The proposed PLSM seemed to be particularly beneficial 1) when random-effect is conspicuous; 2) the number of predictors is relatively large compared to the sample size; 3) the multicollinearity is weak or moderate; and/or 4) the random error is considerable.

Block-wise Adaptive Predictive PLS using Block-wise Data Extraction (데이터 추출 과정을 적용한 Block-wise Adaptive Predictive PLS)

  • Kim Sung-Young;Chung Chang-Bock;Choi Soo-Hyoung;Lee Bom-Sock
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.12 no.7
    • /
    • pp.706-712
    • /
    • 2006
  • Recursive Partial Least Squares(RPLS) method has been used for processing the on-line available multivariate chemical process data and modeling adaptive prediction model for process changes. However, RPLS method is unstable in PLS model updating because RPLS method updates PLS model by merging past PLS model and new data. In this study, Adaptive Predictive Partial Least Squres(APPLS) method is suggested for more sensitive adaptation to process changes. By expanding APPLS method, block-wise Adaptive Predictive Partial Least Squares(block-wise APPLS) method is suggested for a lager scale data of chemical processes. APPLS method has been applied to predict the reactor properties and the product quality of a direct esterification reactor for polyethylene terephthalate(PTT), and block-wise APPLS method has been applied to predict the cetane number using NIR Diesel Spectra data. APPLS and block-wise APPLS methods show better prediction and updating performance than RPLS method.

Partial Least Squares-discriminant Analysis for the Prediction of Hemodynamic Changes Using Near Infrared Spectroscopy

  • Seo, Youngwook;Lee, Seungduk;Koh, Dalkwon;Kim, Beop-Min
    • Journal of the Optical Society of Korea
    • /
    • v.16 no.1
    • /
    • pp.57-62
    • /
    • 2012
  • Using continuous wave near-infrared spectroscopy, we measured time-resolved concentration changes of oxy-hemoglobin and deoxy-hemoglobin from the primary motor cortex following finger tapping tasks. These data were processed using partial least squares-discriminant analysis (PLS-DA) to develop a prediction model for a brain-computer interface. The tasks were composed of a series of finger tapping for 15 sec and relaxation for 45 sec. The location of the motor cortex was confirmed by the anti-phasic behavior of the oxy- and deoxy-hemoglobin changes. The results were compared with those obtained using the hidden Markov model (HMM) which has been known to produce the best prediction model. Our data imply that PLS-DA makes better judgments in determining the onset of the events than HMM.

Pathway and Network Analysis in Glioma with the Partial Least Squares Method

  • Gu, Wen-Tao;Gu, Shi-Xin;Shou, Jia-Jun
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.15 no.7
    • /
    • pp.3145-3149
    • /
    • 2014
  • Gene expression profiling facilitates the understanding of biological characteristics of gliomas. Previous studies mainly used regression/variance analysis without considering various background biological and environmental factors. The aim of this study was to investigate gene expression differences between grade III and IV gliomas through partial least squares (PLS) based analysis. The expression data set was from the Gene Expression Omnibus database. PLS based analysis was performed with the R statistical software. A total of 1,378 differentially expressed genes were identified. Survival analysis identified four pathways, including Prion diseases, colorectal cancer, CAMs, and PI3K-Akt signaling, which may be related with the prognosis of the patients. Network analysis identified two hub genes, ELAVL1 and FN1, which have been reported to be related with glioma previously. Our results provide new understanding of glioma pathogenesis and prognosis with the hope to offer theoretical support for future therapeutic studies.

Shrinkage Structure of Ridge Partial Least Squares Regression

  • Kim, Jong-Duk
    • Journal of the Korean Data and Information Science Society
    • /
    • v.18 no.2
    • /
    • pp.327-344
    • /
    • 2007
  • Ridge partial least squares regression (RPLS) is a regression method which can be obtained by combining ridge regression and partial least squares regression and is intended to provide better predictive ability and less sensitive to overfitting. In this paper, explicit expressions for the shrinkage factor of RPLS are developed. The structure of the shrinkage factor is explored and compared with those of other biased regression methods, such as ridge regression, principal component regression, ridge principal component regression, and partial least squares regression using a near infrared data set.

  • PDF

Face recognition by PLS

  • Baek, Jang-Sun
    • Proceedings of the Korean Statistical Society Conference
    • /
    • 2003.10a
    • /
    • pp.69-72
    • /
    • 2003
  • The paper considers partial least squares (PLS) as a new dimension reduction technique for the feature vector to overcome the small sample size problem in face recognition. Principal component analysis (PCA), a conventional dimension reduction method, selects the components with maximum variability, irrespective of the class information. So PCA does not necessarily extract features that are important for the discrimination of classes. PLS, on the other hand, constructs the components so that the correlation between the class variable and themselves is maximized. Therefore PLS components are more predictive than PCA components in classification. The experimental results on Manchester and ORL databases show that PLS is to be preferred over PCA when classification is the goal and dimension reduction is needed.

  • PDF

Non-linear Data Classification Using Partial Least Square and Residual Compensator (부분 최소 자승법과 잔차 보상기를 이용한 비선형 데이터 분류)

  • 김경훈;김태영;최원호
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.10 no.2
    • /
    • pp.185-191
    • /
    • 2004
  • Partial least squares(PLS) is one of multiplicate statistical process methods and has been developed in various algorithms with the characteristics of principal component analysis, dimensionality reduction, and analysis of the relationship between input variables and output variables. But it has been limited somewhat by their dependency on linear mathematics. The algorithm is proposed to classify for the non-linear data using PLS and the residual compensator(RC) based on radial basis function network (RBFN). It compensates for the error of the non-linear data using the RC based on RBFN. The experimental result is given to verify its efficiency compared with those of previous works.

AI Technology Analysis using Partial Least Square Regression

  • Choi, JunHyeog;Jun, Sunghae
    • Journal of the Korea Society of Computer and Information
    • /
    • v.25 no.3
    • /
    • pp.109-115
    • /
    • 2020
  • In this paper, we propose an artificial intelligence(AI) technology analysis using partial least square(PLS) regression model. AI technology is now affecting most areas of our society. So, it is necessary to understand this technology. To analyze the AI technology, we collect the patent documents related to AI from the patent databases in the world. We extract AI technology keywords from the patent documents by text mining techniques. In addition, we analyze the AI keyword data by PLS regression model. This regression model is based on the technique of partial least squares used in the advanced analyses such as bioinformatics, social science, and engineering. To show the performance of our proposed method, we make experiments using AI patent documents, and we illustrate how our research can be applied to real problems. This paper is applicable not only to AI technology but also to other technological fields. This also contributes to understanding other various technologies by PLS regression analysis.

A Hybrid Fault Diagnosis Method based on SDG and PLS;Tennessee Eastman Challenge Process

  • Lee, Gi-Baek
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2004.08a
    • /
    • pp.110-115
    • /
    • 2004
  • The hybrid fault diagnosis method based on a combination of the signed digraph (SDG) and the partial least-squares (PLS) has the advantage of improving the diagnosis resolution, accuracy and reliability, compared to those of previous qualitative methods, and of enhancing the ability to diagnose multiple fault. In this study, the method is applied for the multiple fault diagnosis of the Tennessee Eastman challenge process, which is a realistic industrial process for evaluating process contol and monitoring methods. The process is decomposed using the local qualitative relationships of each measured variable. Dynamic PLS (DPLS) model is built to estimate each measured variable, which is then compared with the estimated value in order to diagnose the fault. Through case studies of 15 single faults and 44 double faults, the proposed method demonstrated a good diagnosis capability compared with previous statistical methods.

  • PDF

Gene Selection and Classification by Partial Least Squares and Principal component analysis (부분최소자승법과 주성분분석을 이용한 유전자 선택과 분류)

  • Park, Hoseok;Kim, Hey-Jin;Park, Seugj in;Bang, Sung-Yang
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2001.10a
    • /
    • pp.598-600
    • /
    • 2001
  • DNA chip technology enables us to monitor thousands of gene expressions per sample simultaneously. Typically, DNA microarray data has at least several thousands of variables (genes) wish relatively smal1 number of samples. Thus feature (gene) selection by dimensionality reduction is necessary for efficient data analysis. In this paper we employ the partial least squares (PLS) method for gene selection and the principal component analysis (PCA) method for classification. The useful behavior of the PLS is verified by computer simulations.

  • PDF