• Communications for Statistical Applications and Methods
• /
• v.23 no.1
• /
• pp.71-83
• /
• 2016

In this paper we discuss a deconvolution density estimator obtained using the support vector machines (SVM) and Tikhonov's regularization method solving ill-posed problems in reproducing kernel Hilbert space (RKHS). A remarkable property of SVM is that the SVM leads to sparse solutions, but the support vector deconvolution density estimator does not preserve sparsity as well as we expected. Thus, in section 3, we propose another support vector deconvolution estimator (method II) which leads to a very sparse solution. The performance of the deconvolution density estimators based on the support vector method is compared with the classical kernel deconvolution density estimator for important cases of Gaussian and Laplacian measurement error by means of a simulation study. In the case of Gaussian error, the proposed support vector deconvolution estimator shows the same performance as the classical kernel deconvolution density estimator.

• Communications for Statistical Applications and Methods
• /
• v.21 no.4
• /
• pp.317-325
• /
• 2014

Consider a nonlinear transform ${\Phi}(x)$ of x in $\mathbb{R}^p$ to Hilbert space H and assume that the dot product between ${\Phi}(x)$ and ${\Phi}(x^{\prime})$ in H is given by < ${\Phi}(x)$, ${\Phi}(x^{\prime})$ >= K(x, x'). The aim of this paper is to propose a mathematical technique to take screen shots of the multivariate dataset mapped to Hilbert space H, particularly suited to Gaussian kernel $K({\cdot},{\cdot})$, which is defined by $K(x,x^{\prime})={\exp}(-{\sigma}{\parallel}x-x^{\prime}{\parallel}^2)$, ${\sigma}$ > 0. Several numerical examples are given.

• 제어로봇시스템학회:학술대회논문집
• /
• 2005.06a
• /
• pp.408-413
• /
• 2005

A new methodology for discrete non-Gaussian probability density estimation is investigated in this paper based on a dynamic Bayesian network (DBN) and kernel functions. The estimator consists of a DBN in which the transition distribution is represented with kernel functions. The estimator parameters are determined through a recursive learning algorithm according to the maximum likelihood (ML) scheme. A discrete-type Poisson distribution is generated in a simulation experiment to evaluate the proposed method. In addition, an unknown probability density generated by nonlinear transformation of a Poisson random variable is simulated. Computer simulations numerically demonstrate that the method successfully estimates the unknown probability distribution function (PDF).

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.9 no.6
• /
• pp.2302-2316
• /
• 2015

We propose an efficient method of extracting targets within a region of interest in non-homogeneous infrared images by using a principal component analysis (PCA) plane and adaptive Gaussian kernel. Existing approaches for extracting targets have been limited to using only the intensity values of the pixels in a target region. However, it is difficult to extract the target regions effectively because the intensity values of the target region are mixed with the background intensity values. To overcome this problem, we propose a novel PCA based approach consisting of three steps. In the first step, we apply a PCA technique minimizing the total least-square errors of an IR image. In the second step, we generate a binary image that consists of pixels with higher values than the plane, and then calculate the second derivative of the sum of the square errors (SDSSE). In the final step, an iteration is performed until the convergence criteria is met, including the SDSSE, angle and labeling value. Therefore, a Gaussian kernel is weighted in addition to the PCA plane with the non-removed data from the previous step. Experimental results show that the proposed method achieves better segmentation performance than the existing method.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.2 no.3
• /
• pp.39-52
• /
• 2009

Scale Invariant Feature Transform (SIFT) is an effective algorithm in object recognition, panorama stitching, and image matching, however, due to its complexity, real time processing is difficult to achieve with software approaches. This paper proposes using a reconfigurable hardware processor with integer half kernel. The integer half kernel Gaussian reduces the Gaussian pyramid complexity in about half [] and the reconfigurable processor carries out a parallel implementation of a full search Fast SIFT algorithm. We use a low memory, fine grain single instruction stream multiple data stream (SIMD) pixel processor that is currently being developed. This implementation fully exposes the available parallelism of the SIFT algorithm process and exploits the processing and I/O capabilities of the processor which results in a system that can perform real time image and video compression. We apply this novel implementation to images and measure the effectiveness. Experimental simulation results indicate that the proposed implementation is capable of real time applications.

• Journal of the Korean Statistical Society
• /
• v.25 no.2
• /
• pp.265-276
• /
• 1996

The nonparametric deconvolution problems are studied to recover an unknown density when the data are contaminated with Gaussian error. We propose the estimator which is a linear combination of kernel type estimates of derivertives of the observed density function. We show that this estimator is consistent and also consider the properties of estimator at small sample by simulation.

• Communications for Statistical Applications and Methods
• /
• v.19 no.4
• /
• pp.517-526
• /
• 2012

In this paper a support vector method is proposed for use when the sample observations are contaminated by a normally distributed measurement error. The performance of deconvolution density estimators based on the support vector method is explored and compared with kernel density estimators by means of a simulation study. An interesting result was that for the estimation of kurtotic density, the support vector deconvolution estimator with a Gaussian kernel showed a better performance than the classical deconvolution kernel estimator.

• MALSORI
• /
• no.66
• /
• pp.105-116
• /
• 2008

In this research, we propose a speaker identification system using a kernel method which is expected to model the non-linearity of speech features well. We have been using principal component analysis (PCA) successfully, and extended to kernel PCA, which is used for many pattern recognition tasks such as face recognition. However, we cannot use kernel PCA for speaker identification directly because the storage required for the kernel matrix grows quadratically, and the computational cost grows linearly (computing eigenvector of $l{\times}l$ matrix) with the number of training vectors I. Therefore, we use greedy kernel PCA which can approximate kernel PCA with small representation error. In the experiments, we compare the accuracy of the greedy kernel PCA with the baseline Gaussian mixture models using MFCCs and PCA. As the results with limited enrollment data show, the greedy kernel PCA outperforms conventional methods.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2011.05a
• /
• pp.808-810
• /
• 2011

The background estimation algorithms had a significant impact on the performance of image processing and recognition. In this paper, background estimation algorithms were analysis of complexity and performance as preprocessing of image recognition. It was evaluated the performance of Gaussian Running Average, Mixture of Gaussian, and KDE algorithm. The simulation results show that KDE algorithm outperforms compared to the other algorithms.

• Journal of Korean Society of Coastal and Ocean Engineers
• /
• v.28 no.3
• /
• pp.171-176
• /
• 2016

The distribution shapes of air and water temperatures are basic and essential information, which determine the frequency patterns of their occurrence. It is also very useful to understand the changes in long-term air and water temperatures with respect to climate change. The typical distribution shapes of air and water temperatures cannot be well fitted using widely used/accepted normal distributions because their shapes show multimodal distributions. In this study, Gaussian mixture distributions and kernel distributions are suggested as the more suitable models to fit their distribution shapes. Based on the results, the tail shape exhibits different patterns. The tail is long in higher temperature regions of water temperature distribution and in lower temperature regions of air temperature distribution. These types of shape comparisons can be useful to identify the patterns of long-term air and water temperature changes and the relationship between air and water temperatures. It is nearly impossible to identify change patterns using only mean-temperatures and normal distributions.