• Title/Summary/Keyword: principal response reduction

Search Result 22, Processing Time 0.022 seconds

MBRDR: R-package for response dimension reduction in multivariate regression

  • Heesung Ahn;Jae Keun Yoo
    • Communications for Statistical Applications and Methods
    • /
    • v.31 no.2
    • /
    • pp.179-189
    • /
    • 2024
  • In multivariate regression with a high-dimensional response Y ∈ ℝr and a relatively low-dimensional predictor X ∈ ℝp (where r ≥ 2), the statistical analysis of such data presents significant challenges due to the exponential increase in the number of parameters as the dimension of the response grows. Most existing dimension reduction techniques primarily focus on reducing the dimension of the predictors (X), not the dimension of the response variable (Y). Yoo and Cook (2008) introduced a response dimension reduction method that preserves information about the conditional mean E(Y | X). Building upon this foundational work, Yoo (2018) proposed two semi-parametric methods, principal response reduction (PRR) and principal fitted response reduction (PFRR), then expanded these methods to unstructured principal fitted response reduction (UPFRR) (Yoo, 2019). This paper reviews these four response dimension reduction methodologies mentioned above. In addition, it introduces the implementation of the mbrdr package in R. The mbrdr is a unique tool in the R community, as it is specifically designed for response dimension reduction, setting it apart from existing dimension reduction packages that focus solely on predictors.

Principal selected response reduction in multivariate regression (다변량회귀에서 주선택 반응변수 차원축소)

  • Yoo, Jae Keun
    • The Korean Journal of Applied Statistics
    • /
    • v.34 no.4
    • /
    • pp.659-669
    • /
    • 2021
  • Multivariate regression often appears in longitudinal or functional data analysis. Since multivariate regression involves multi-dimensional response variables, it is more strongly affected by the so-called curse of dimension that univariate regression. To overcome this issue, Yoo (2018) and Yoo (2019a) proposed three model-based response dimension reduction methodologies. According to various numerical studies in Yoo (2019a), the default method suggested in Yoo (2019a) is least sensitive to the simulated models, but it is not the best one. To release this issue, the paper proposes an selection algorithm by comparing the other two methods with the default one. This approach is called principal selected response reduction. Various simulation studies show that the proposed method provides more accurate estimation results than the default one by Yoo (2019a), and it confirms practical and empirical usefulness of the propose method over the default one by Yoo (2019a).

Multivariate Decision Tree for High -dimensional Response Vector with Its Application

  • Lee, Seong-Keon
    • Communications for Statistical Applications and Methods
    • /
    • v.11 no.3
    • /
    • pp.539-551
    • /
    • 2004
  • Multiple responses are often observed in many application fields, such as customer's time-of-day pattern for using internet. Some decision trees for multiple responses have been constructed by many researchers. However, if the response is a high-dimensional vector that can be thought of as a discretized function, then fitting a multivariate decision tree may be unsuccessful. Yu and Lambert (1999) suggested spline tree and principal component tree to analyze high dimensional response vector by using dimension reduction techniques. In this paper, we shall propose factor tree which would be more interpretable and competitive. Furthermore, using Korean internet company data, we will analyze time-of-day patterns for internet user.

A novel hybrid testing approach for piping systems of industrial plants

  • Bursi, Oreste S.;Abbiati, Giuseppe;Reza, Md S.
    • Smart Structures and Systems
    • /
    • v.14 no.6
    • /
    • pp.1005-1030
    • /
    • 2014
  • The need for assessing dynamic response of typical industrial piping systems subjected to seismic loading motivated the authors to apply model reduction techniques to experimental dynamic substructuring. Initially, a better insight into the dynamic response of the emulated system was provided by means of the principal component analysis. The clear understanding of reduction basis requirements paved the way for the implementation of a number of model reduction techniques aimed at extending the applicability range of the hybrid testing technique beyond its traditional scope. Therefore, several hybrid simulations were performed on a typical full-scale industrial piping system endowed with a number of critical components, like elbows, Tee joints and bolted flange joints, ranging from operational to collapse limit states. Then, the favourable performance of the L-Stable Real-Time compatible time integrator and an effective delay compensation method were also checked throughout the testing campaign. Finally, several aspects of the piping performance were commented and conclusions drawn.

Design of Robust Reduced-Order Model Predictive Control using Singular Value Decomposition of Pulse Response Circulant Matrix (펄스응답 순환행렬의 특이치 분해를 이용한 강인한 차수감소 모델예측제어기의 설계)

  • 김상훈;문혜진;이광순
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.4 no.4
    • /
    • pp.413-419
    • /
    • 1998
  • A novel order-reduction technique for model predictive control(MPC) is proposed based on the singular value decomposition(SVD) of a pulse response circulant matrix(PRCM) of a concerned system. It is first investigated that the PRCM (in the limit) contains a complete information of the frequency response of a system and its SVD decomposes the information into the respective principal directions at each frequency. This enables us to isolate the significant modes of the system and to devise the proposed order-reduction technique. Though the primary purpose of the proposed technique is to diminish the required computation in MPC, the clear frequency decomposition of the SVD of the PRCM also enables us to improve the robustness through selective excitation of frequency modes. Performance of the proposed technique is illustrated through two numerical examples.

  • PDF

Bayesian inference of the cumulative logistic principal component regression models

  • Kyung, Minjung
    • Communications for Statistical Applications and Methods
    • /
    • v.29 no.2
    • /
    • pp.203-223
    • /
    • 2022
  • We propose a Bayesian approach to cumulative logistic regression model for the ordinal response based on the orthogonal principal components via singular value decomposition considering the multicollinearity among predictors. The advantage of the suggested method is considering dimension reduction and parameter estimation simultaneously. To evaluate the performance of the proposed model we conduct a simulation study with considering a high-dimensional and highly correlated explanatory matrix. Also, we fit the suggested method to a real data concerning sprout- and scab-damaged kernels of wheat and compare it to EM based proportional-odds logistic regression model. Compared to EM based methods, we argue that the proposed model works better for the highly correlated high-dimensional data with providing parameter estimates and provides good predictions.

PRINCIPAL COMPONENTS BASED SUPPORT VECTOR REGRESSION MODEL FOR ON-LINE INSTRUMENT CALIBRATION MONITORING IN NPPS

  • Seo, In-Yong;Ha, Bok-Nam;Lee, Sung-Woo;Shin, Chang-Hoon;Kim, Seong-Jun
    • Nuclear Engineering and Technology
    • /
    • v.42 no.2
    • /
    • pp.219-230
    • /
    • 2010
  • In nuclear power plants (NPPs), periodic sensor calibrations are required to assure that sensors are operating correctly. By checking the sensor's operating status at every fuel outage, faulty sensors may remain undetected for periods of up to 24 months. Moreover, typically, only a few faulty sensors are found to be calibrated. For the safe operation of NPP and the reduction of unnecessary calibration, on-line instrument calibration monitoring is needed. In this study, principal component-based auto-associative support vector regression (PCSVR) using response surface methodology (RSM) is proposed for the sensor signal validation of NPPs. This paper describes the design of a PCSVR-based sensor validation system for a power generation system. RSM is employed to determine the optimal values of SVR hyperparameters and is compared to the genetic algorithm (GA). The proposed PCSVR model is confirmed with the actual plant data of Kori Nuclear Power Plant Unit 3 and is compared with the Auto-Associative support vector regression (AASVR) and the auto-associative neural network (AANN) model. The auto-sensitivity of AASVR is improved by around six times by using a PCA, resulting in good detection of sensor drift. Compared to AANN, accuracy and cross-sensitivity are better while the auto-sensitivity is almost the same. Meanwhile, the proposed RSM for the optimization of the PCSVR algorithm performs even better in terms of accuracy, auto-sensitivity, and averaged maximum error, except in averaged RMS error, and this method is much more time efficient compared to the conventional GA method.

Implementation of unsupervised clustering methods for measurement gases using artificial olfactory sensing system (인공 후각 센싱 시스템을 이용한 측정 가스의 Unsupervised clustering 방법의 구현)

  • 최지혁;함유경;최찬석;김정도;변형기
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.405-405
    • /
    • 2000
  • We designed the artificial olfactory sensing system (Electronic Nose) using MOS type sensor array fur recognizing and analyzing odour. The response of individual sensors of sensor array, each processing a slightly different response towards the sample volatiles, can provide enough information to discriminate between sample odours. In this paper, we applied clustering algorithm for dimension reduction, such as linear projection mapping (PCA method), nonlinear mapping (Sammon mapping method) and the combination of PCA and Sammon mapping having a better discriminating ability. The odours used are VOC (Volatile chemical compound) and Toxic gases.

  • PDF

Robust Facial Expression Recognition Based on Local Directional Pattern

  • Jabid, Taskeed;Kabir, Md. Hasanul;Chae, Oksam
    • ETRI Journal
    • /
    • v.32 no.5
    • /
    • pp.784-794
    • /
    • 2010
  • Automatic facial expression recognition has many potential applications in different areas of human computer interaction. However, they are not yet fully realized due to the lack of an effective facial feature descriptor. In this paper, we present a new appearance-based feature descriptor, the local directional pattern (LDP), to represent facial geometry and analyze its performance in expression recognition. An LDP feature is obtained by computing the edge response values in 8 directions at each pixel and encoding them into an 8 bit binary number using the relative strength of these edge responses. The LDP descriptor, a distribution of LDP codes within an image or image patch, is used to describe each expression image. The effectiveness of dimensionality reduction techniques, such as principal component analysis and AdaBoost, is also analyzed in terms of computational cost saving and classification accuracy. Two well-known machine learning methods, template matching and support vector machine, are used for classification using the Cohn-Kanade and Japanese female facial expression databases. Better classification accuracy shows the superiority of LDP descriptor against other appearance-based feature descriptors.

Development and Assessment for Resilient Modulus Prediction Model of Railway Trackbeds Based on Modulus Reduction Curve (탄성계수 감소곡선에 근거한 철도노반의 회복탄성계수 모델 개발 및 평가)

  • Park, Chul-Soo;Hwang, Seon-Keun;Choi, Chan-Yong;Mok, Young-Jin
    • Proceedings of the KSR Conference
    • /
    • 2008.11b
    • /
    • pp.805-814
    • /
    • 2008
  • This study focused on the resilient modulus prediction model, which is the functions of mean effective principal stress and axial strain, for three types of railroad trackbed materials such as crushed stone, weathered soil, and crushed-rock soil mixture. The model is composed with the maximum Young's modulus and nonlinear values for higher strain in parallel with dynamic shear modulus. The maximum values is modeled by model parameters, $A_E$ and the power of mean effective principal stress, $n_E$. The nonlinear portion is represented by modified hyperbolic model, with the model parameters of reference strain, ${\varepsilon}_r$ and curvature coefficient, a. To assess the performance of the prediction models proposed herein, the elastic response of a test trackbed near PyeongTaek, Korea was evaluated using a 3-D nonlinear elastic computer program (GEOTRACK) and compared with measured elastic vertical displacement during the passages of freight and passenger trains. The material types of sub-ballasts are crushed stone and weathered granite soil, respectively. The calculated vertical displacements within the sub-ballasts are within the order of 0.6mm, and agree well with measured values with the reasonable margin. The prediction models are thus concluded to work properly in the preliminary investigation.

  • PDF