• Title/Summary/Keyword: Kernel method

Search Result 985, Processing Time 0.023 seconds

An improved kernel principal component analysis based on sparse representation for face recognition

  • Huang, Wei;Wang, Xiaohui;Zhu, Yinghui;Zheng, Gengzhong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.10 no.6
    • /
    • pp.2709-2729
    • /
    • 2016
  • Representation based classification, kernel method and sparse representation have received much attention in the field of face recognition. In this paper, we proposed an improved kernel principal component analysis method based on sparse representation to improve the accuracy and robustness for face recognition. First, the distances between the test sample and all training samples in kernel space are estimated based on collaborative representation. Second, S training samples with the smallest distances are selected, and Kernel Principal Component Analysis (KPCA) is used to extract the features that are exploited for classification. The proposed method implements the sparse representation under ℓ2 regularization and performs feature extraction twice to improve the robustness. Also, we investigate the relationship between the accuracy and the sparseness coefficient, the relationship between the accuracy and the dimensionality respectively. The comparative experiments are conducted on the ORL, the GT and the UMIST face database. The experimental results show that the proposed method is more effective and robust than several state-of-the-art methods including Sparse Representation based Classification (SRC), Collaborative Representation based Classification (CRC), KCRC and Two Phase Test samples Sparse Representation (TPTSR).

Choice of the Kernel Function in Smoothing Moment Restrictions for Dependent Processes

  • Lee, Jin
    • Communications for Statistical Applications and Methods
    • /
    • v.16 no.1
    • /
    • pp.137-141
    • /
    • 2009
  • We study on selecting the kernel weighting function in smoothing moment conditions for dependent processes. For hypothesis testing in Generalized Method of Moments or Generalized Empirical Likelihood context, we find that smoothing moment conditions by Bartlett kernel delivers smallest size distortions based on empirical Edgeworth expansions of the long-run variance estimator.

Design method of interpolation kernel using piecewise $\textit{n}$ th polynomials

  • Honma, Akihiro;Aikawa, Naoyuki
    • Proceedings of the IEEK Conference
    • /
    • 2002.07a
    • /
    • pp.694-697
    • /
    • 2002
  • Sampling rate conversion widely used in subband coding, A/D and D/A transitions etc. is an important techniques. Nyquist filters and the filter banks have been used far the sampling converter. However, they need many memories and, whenever the sampling rate is changed it is necessary to redesign filters. Then we propose design method of the new interpolation kernel. Design method of the new interpolation kernel is approximated each piecewise of lowpass filter by n th polynomials. The proposed kernel is not redesigned, whenever the sampling rate is changed. The proposed kernel is a continuous function, the sampling rate of the rational number can be converted.

  • PDF

A note on SVM estimators in RKHS for the deconvolution problem

  • Lee, Sungho
    • Communications for Statistical Applications and Methods
    • /
    • v.23 no.1
    • /
    • pp.71-83
    • /
    • 2016
  • In this paper we discuss a deconvolution density estimator obtained using the support vector machines (SVM) and Tikhonov's regularization method solving ill-posed problems in reproducing kernel Hilbert space (RKHS). A remarkable property of SVM is that the SVM leads to sparse solutions, but the support vector deconvolution density estimator does not preserve sparsity as well as we expected. Thus, in section 3, we propose another support vector deconvolution estimator (method II) which leads to a very sparse solution. The performance of the deconvolution density estimators based on the support vector method is compared with the classical kernel deconvolution density estimator for important cases of Gaussian and Laplacian measurement error by means of a simulation study. In the case of Gaussian error, the proposed support vector deconvolution estimator shows the same performance as the classical kernel deconvolution density estimator.

AN ELIGIBLE KERNEL BASED PRIMAL-DUAL INTERIOR-POINT METHOD FOR LINEAR OPTIMIZATION

  • Cho, Gyeong-Mi
    • Honam Mathematical Journal
    • /
    • v.35 no.2
    • /
    • pp.235-249
    • /
    • 2013
  • It is well known that each kernel function defines primal-dual interior-point method (IPM). Most of polynomial-time interior-point algorithms for linear optimization (LO) are based on the logarithmic kernel function ([9]). In this paper we define new eligible kernel function and propose a new search direction and proximity function based on this function for LO problems. We show that the new algorithm has $\mathcal{O}(({\log}\;p)^{\frac{5}{2}}\sqrt{n}{\log}\;n\;{\log}\frac{n}{\epsilon})$ and $\mathcal{O}(q^{\frac{3}{2}}({\log}\;p)^3\sqrt{n}{\log}\;\frac{n}{\epsilon})$ iteration complexity for large- and small-update methods, respectively. These are currently the best known complexity results for such methods.

Integrating Spatial Proximity with Manifold Learning for Hyperspectral Data

  • Kim, Won-Kook;Crawford, Melba M.;Lee, Sang-Hoon
    • Korean Journal of Remote Sensing
    • /
    • v.26 no.6
    • /
    • pp.693-703
    • /
    • 2010
  • High spectral resolution of hyperspectral data enables analysis of complex natural phenomena that is reflected on the data nonlinearly. Although many manifold learning methods have been developed for such problems, most methods do not consider the spatial correlation between samples that is inherent and useful in remote sensing data. We propose a manifold learning method which directly combines the spatial proximity and the spectral similarity through kernel PCA framework. A gain factor caused by spatial proximity is first modelled with a heat kernel, and is added to the original similarity computed from the spectral values of a pair of samples. Parameters are tuned with intelligent grid search (IGS) method for the derived manifold coordinates to achieve optimal classification accuracies. Of particular interest is its performance with small training size, because labelled samples are usually scarce due to its high acquisition cost. The proposed spatial kernel PCA (KPCA) is compared with PCA in terms of classification accuracy with the nearest-neighbourhood classification method.

Improving effective Learning Performance of Kernel method (커널 메소드의 효과적인 학습 성능 향상)

  • 김은미;김수희;정태웅;이배호
    • Proceedings of the IEEK Conference
    • /
    • 2002.06c
    • /
    • pp.9-12
    • /
    • 2002
  • This paper proposes a dynamic moment algorithm to control oscillaion before the convergence of the KR(Kernel Relaxation). The proposed dynamic moment algorithm can be controlled to convergence speed and performance according to the change of the dynamic moment by teaming training. we used SONAR data that is a neural network classifier standard evaluation data in order to do impartial performance evaluation. The proposed algorithm has been applied to the KP (kernel perceptron), KPM(kernel perceptron with margin) and KLMS(kernel lms) as the kernel method presented recently. The simulation results of proposed algorithm have better the convergence performance than those using none and static moment.

  • PDF

On Improving Resolution of Time-Frequency Representation of Speech Signals Based on Frequency Modulation Type Kernel (FM변조된 형태의 Kernel을 사용한 음성신호의 시간-주파수 표현 해상도 향상에 관한 연구)

  • Lee, He-Young;Choi, Seung-Ho
    • Speech Sciences
    • /
    • v.12 no.4
    • /
    • pp.17-29
    • /
    • 2005
  • Time-frequency representation reveals some useful information about instantaneous frequency, instantaneous bandwidth and boundary of each AM-FM component of a speech signal. In many cases, the instantaneous frequency of each component is not constant. The variability of instantaneous frequency causes degradation of resolution in time-frequency representation. This paper presents a method of adaptively adjusting the transform kernel for preventing degradation of resolution due to time-varying instantaneous frequency. The transform kernel is the form of frequency modulated function. The modulation function in the transform kernel is determined by the estimate of instantaneous frequency which is approximated by first order polynomial at each time instance. Also, the window function is modulated by the estimated instantaneous. frequency for mitigation of fringing. effect. In the proposed method, not only the transform kernel but also the shape and the length of. the window function are adaptively adjusted by the instantaneous frequency of a speech signal.

  • PDF

Kirchhoff Plate Analysis by Using Hermite Reproducing Kernel Particle Method (HRKPM을 이용한 키르히호프 판의 해석)

  • 석병호;송태한
    • Transactions of the Korean Society of Machine Tool Engineers
    • /
    • v.12 no.5
    • /
    • pp.67-72
    • /
    • 2003
  • For the analysis of Kirchhoff plate bending problems, a new meshless method is implemented. For the satisfaction of the $C^1$ continuity condition in which the first derivative is treated an another primary variable, Hermite interpolation is enforced on standard reproducing kernel particle method. In order to impose essential boundary conditions on solving $C^1$ continuity problems, shape function modifications are adopted. Through numerical tests, the characteristics and accuracy of the HRKPM are investigated and compared with the finite element analysis. By this implementatioa it is shown that high accuracy is achieved by using HRKPM for solving Kirchhoff plate bending problems.

Analysis of Kernel Hardness of Korean Wheat Cultivars

  • Hong, Byung-Hee;Park, Chul-Soo
    • KOREAN JOURNAL OF CROP SCIENCE
    • /
    • v.44 no.1
    • /
    • pp.78-85
    • /
    • 1999
  • To investigate kernel hardness, a compression test which is widely used to measure the hardness of individual kernels as a physical testing method was made simultaneously with the measurement of friabilin (15KDa) which is strongly associated with kernel hardness and was recently developed as a biochemical marker for evaluating kernel hardness in 79 Korean wheat varieties and experimental lines. With the scattered diagram based on the principal component analysis from the parameters of the compression test, 79 Korean wheat varieties were classified into three groups based on the principal component analysis. Since conventional methods required large amount of flour samples for analysis of friabilin due to the relatively small amount of friabilin in wheat kernels, those methods had limitations for quality prediction in wheat breeding programs. An extraction of friabilin from the starch of a single kernel through cesium chloride gradient centrifugation was successful in this experiment. Among 79 Korean wheat varieties and experimental lines 50 lines (63.3%) exhibited a friabilin band and 29 lines (36.7%) did not show a friabilin band. In this study, lines that contained high maximum force and the lower ratio of minimum force to maximum force showed the absence of the friabilin band. Identification of friabilin, which is the product of a major gene, could be applied in the screening procedures of kernel hardness. The single kernel analysis system for friabilin was found to be an easy, simple and effective screening method for early generation materials in a wheat breeding program for quality improvement.

  • PDF