Browse > Article
http://dx.doi.org/10.29220/CSAM.2019.26.6.635

A model-free soft classification with a functional predictor  

Lee, Eugene (Department of Statistics, Korea University)
Shin, Seung Jun (Department of Statistics, Korea University)
Publication Information
Communications for Statistical Applications and Methods / v.26, no.6, 2019 , pp. 635-644 More about this Journal
Abstract
Class probability is a fundamental target in classification that contains complete classification information. In this article, we propose a class probability estimation method when the predictor is functional. Motivated by Wang et al. (Biometrika, 95, 149-167, 2007), our estimator is obtained by training a sequence of functional weighted support vector machines (FWSVM) with different weights, which can be justified by the Fisher consistency of the hinge loss. The proposed method can be extended to multiclass classification via pairwise coupling proposed by Wu et al. (Journal of Machine Learning Research, 5, 975-1005, 2004). The use of FWSVM makes our method model-free as well as computationally efficient due to the piecewise linearity of the FWSVM solutions as functions of the weight. Numerical investigation to both synthetic and real data show the advantageous performance of the proposed method.
Keywords
functional data; Fisher consistency; support vector machines; probability estimation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Kimeldorf G and Wahba G (1971). Some results on Tchebycheffian spline functions, Journal of Mathematical Analysis and Applications, 33, 82-95.   DOI
2 Park C, Koo JY, Kim S, Sohn I, and Lee JW (2008). Classification of gene functions using support vector machine for time-course gene expression data, Computational Statistics & Data Analysis, 52, 2578-2587.   DOI
3 Rossi F and Villa N (2006). Support vector machine for functional data classification, Neurocomputing, 69, 730-742.   DOI
4 Shin SJ, Wu Y, and Zhang HH (2014). Two-dimensional solution surface for weighted support vector machines, Journal of Computational and Graphical Statistics, 23, 383-402.   DOI
5 Vapnik VN (1995). The Nature of Statistical Learning Theory, Springer-Verlag, Berlin, Heidelberg.
6 Wahba G (1990). Spline Models for Observational Data, Society for Industrial and Applied Mathematics, Philadelphia.
7 Wahba G (2002). Soft and hard classification by reproducing kernel Hilbert space methods, Proceedings of the National Academy of Sciences, 99, 16524-16530.   DOI
8 Wang J, Shen X, and Liu Y (2007). Probability estimation for large-margin classifiers, Biometrika, 95, 149-167.   DOI
9 Wu TF, Lin CJ, and Weng RC (2004). Probability estimates for multi-class classification by pairwise coupling, Journal of Machine Learning Research, 5, 975-1005.
10 James GM (2002). Generalized linear models with functional predictors, Journal of the Royal Statistical Society: Series B (Statistical Methodology), 64, 411-432.   DOI