• Title/Summary/Keyword: optimal dimension reduction

Search Result 35, Processing Time 0.02 seconds

Intensive numerical studies of optimal sufficient dimension reduction with singularity

  • Yoo, Jae Keun;Gwak, Da-Hae;Kim, Min-Sun
    • Communications for Statistical Applications and Methods
    • /
    • v.24 no.3
    • /
    • pp.303-315
    • /
    • 2017
  • Yoo (2015, Statistics and Probability Letters, 99, 109-113) derives theoretical results in an optimal sufficient dimension reduction with singular inner-product matrix. The results are promising, but Yoo (2015) only presents one simulation study. So, an evaluation of its practical usefulness is necessary based on numerical studies. This paper studies the asymptotic behaviors of Yoo (2015) through various simulation models and presents a real data example that focuses on ordinary least squares. Intensive numerical studies show that the $x^2$ test by Yoo (2015) outperforms the existing optimal sufficient dimension reduction method. The basis estimation by the former can be theoretically sub-optimal; however, there are no notable differences from that by the latter. This investigation confirms the practical usefulness of Yoo (2015).

Effect of Dimension in Optimal Dimension Reduction Estimation for Conditional Mean Multivariate Regression (다변량회귀 조건부 평균모형에 대한 최적 차원축소 방법에서 차원수가 결과에 미치는 영향)

  • Seo, Eun-Kyoung;Park, Chong-Sun
    • Communications for Statistical Applications and Methods
    • /
    • v.19 no.1
    • /
    • pp.107-115
    • /
    • 2012
  • Yoo and Cook (2007) developed an optimal sufficient dimension reduction methodology for the conditional mean in multivariate regression and it is known that their method is asymptotically optimal and its test statistic has a chi-squared distribution asymptotically under the null hypothesis. To check the effect of dimension used in estimation on regression coefficients and the explanatory power of the conditional mean model in multivariate regression, we applied their method to several simulated data sets with various dimensions. A small simulation study showed that it is quite helpful to search for an appropriate dimension for a given data set if we use the asymptotic test for the dimension as well as results from the estimation with several dimensions simultaneously.

Integrated Partial Sufficient Dimension Reduction with Heavily Unbalanced Categorical Predictors

  • Yoo, Jae-Keun
    • The Korean Journal of Applied Statistics
    • /
    • v.23 no.5
    • /
    • pp.977-985
    • /
    • 2010
  • In this paper, we propose an approach to conduct partial sufficient dimension reduction with heavily unbalanced categorical predictors. For this, we consider integrated categorical predictors and investigate certain conditions that the integrated categorical predictor is fully informative to partial sufficient dimension reduction. For illustration, the proposed approach is implemented on optimal partial sliced inverse regression in simulation and data analysis.

A Classification Method Using Data Reduction

  • Uhm, Daiho;Jun, Sung-Hae;Lee, Seung-Joo
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.12 no.1
    • /
    • pp.1-5
    • /
    • 2012
  • Data reduction has been used widely in data mining for convenient analysis. Principal component analysis (PCA) and factor analysis (FA) methods are popular techniques. The PCA and FA reduce the number of variables to avoid the curse of dimensionality. The curse of dimensionality is to increase the computing time exponentially in proportion to the number of variables. So, many methods have been published for dimension reduction. Also, data augmentation is another approach to analyze data efficiently. Support vector machine (SVM) algorithm is a representative technique for dimension augmentation. The SVM maps original data to a feature space with high dimension to get the optimal decision plane. Both data reduction and augmentation have been used to solve diverse problems in data analysis. In this paper, we compare the strengths and weaknesses of dimension reduction and augmentation for classification and propose a classification method using data reduction for classification. We will carry out experiments for comparative studies to verify the performance of this research.

An Ensemble Classifier using Two Dimensional LDA

  • Park, Cheong-Hee
    • Journal of Korea Multimedia Society
    • /
    • v.13 no.6
    • /
    • pp.817-824
    • /
    • 2010
  • Linear Discriminant Analysis (LDA) has been successfully applied for dimension reduction in face recognition. However, LDA requires the transformation of a face image to a one-dimensional vector and this process can cause the correlation information among neighboring pixels to be disregarded. On the other hand, 2D-LDA uses 2D images directly without a transformation process and it has been shown to be superior to the traditional LDA. Nevertheless, there are some problems in 2D-LDA. First, it is difficult to determine the optimal number of feature vectors in a reduced dimensional space. Second, the size of rectangular windows used in 2D-LDA makes strong impacts on classification accuracies but there is no reliable way to determine an optimal window size. In this paper, we propose a new algorithm to overcome those problems in 2D-LDA. We adopt an ensemble approach which combines several classifiers obtained by utilizing various window sizes. And a practical method to determine the number of feature vectors is also presented. Experimental results demonstrate that the proposed method can overcome the difficulties with choosing an optimal window size and the number of feature vectors.

Optimal Design of Straight Noise Barriers Using Genetic Algorithm (유전자 알고리즘을 이용한 직선 방음벽의 최적 설계)

  • 하지형;최태묵;조대승
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2001.11a
    • /
    • pp.127-132
    • /
    • 2001
  • A successful design approach for noise barriers should be multidisciplinary because noise reduction goals influence both acoustical and non-acoustical considerations, such as maintenance, safety, physical construction, cost, and visual impact. These various barrier design options are closely related with barrier dimensions. In this study, we have proposed an optimal design method of straight noise barriers using genetic algorithm, providing a barrier having the smallest dimension and achieving the specified noise reduction at a receiver region exposed to the industry and traffic noise, to help a successful barrier design.

  • PDF

Optimal Design of Noise Barriers Using Simulated Annealing Algorithm (Simulated Annealing 알고리즘을 이용한 방음벽의 최적 설계)

  • 김병희;김진형;최태묵;박일권;조대승
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.13 no.8
    • /
    • pp.619-625
    • /
    • 2003
  • A successful design approach for noise barriers should be multidisciplinary because noise reduction goals influence both acoustical and non-acoustical considerations, such as maintenance, safety, physical construction, cost, and visual impact. These various barrier design options are closely related with barrier dimensions. In this study, we have proposed an optimal design method of noise barriers using simulated annealing algorithm, providing a harrier having the smallest dimension and achieving the specified noise reduction at a receiver region exposed to the noise due to Industry and infrastructure, to help a successful barrier design.

Optimal Design of Noise Barrier Using Simulated Annealing Algorithm (Simulated Annealing 알고리즘을 이용한 방음벽의 최적 설계)

  • 김병희;김진형;조대승;박일권
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2003.05a
    • /
    • pp.1020-1025
    • /
    • 2003
  • A successful design approach for noise barriers should be multidisciplinary because noise reduction goals influence both acoustical and non-acoustical considerations, such as maintenance, safety, physical construction, cost and visual impact These various barrier design options are closely related with barrier dimensions. In this study, we have proposed an optimal design method of noise barriers using simulated annealing algorithm, providing a barrier having the smallest dimension and achieving the specified noise reduction at a receiver region exposed to the industry and infrastructures, to help a successful barrier design.

  • PDF

A Study on Robust Design Optimization of Layered Plates Bonding Process Considering Uncertainties (불확정성을 고려한 적층판 결합공정의 강건최적설계)

  • Lee, Woo-Hyuk;Park, Jung-Jin;Choi, Joo-Ho;Lee, Soo-Yong
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.31 no.1 s.256
    • /
    • pp.113-120
    • /
    • 2007
  • Design optimization of layered plates bonding process is conducted by considering uncertainties in a manufacturing process, in order to reduce the crack failure arising due to the residual stress at the surface of the adherent which is caused by different thermal expansion coefficients. Robust optimization is peformed to minimize the mean as well as its variance of the residual stress, while constraining the distortion as well as the instantaneous maximum stress under the allowable reliability limits. In this optimization, the dimension reduction (DR) method is employed to quantify the reliability such as mean and variance of the layered plate bonding. It is expected that the DR method benefits the optimization from the perspectives of efficiency, accuracy, and simplicity. The obtained robust optimal solution is verified by the Monte Carlo simulation.

Feature Extraction by Optimizing the Cepstral Resolution of Frequency Sub-bands (주파수 부대역의 켑스트럼 해상도 최적화에 의한 특징추출)

  • 지상문;조훈영;오영환
    • The Journal of the Acoustical Society of Korea
    • /
    • v.22 no.1
    • /
    • pp.35-41
    • /
    • 2003
  • Feature vectors for conventional speech recognition are usually extracted in full frequency band. Therefore, each sub-band contributes equally to final speech recognition results. In this paper, feature Teeters are extracted indepedently in each sub-band. The cepstral resolution of each sub-band feature is controlled for the optimal speech recognition. For this purpose, different dimension of each sub-band ceptral vectors are extracted based on the multi-band approach, which extracts feature vector independently for each sub-band. Speech recognition rates and clustering quality are suggested as the criteria for finding the optimal combination of sub-band Teeter dimension. In the connected digit recognition experiments using TIDIGITS database, the proposed method gave string accuracy of 99.125%, 99.775% percent correct, and 99.705% percent accuracy, which is 38%, 32% and 37% error rate reduction relative to baseline full-band feature vector, respectively.