Browse > Article
http://dx.doi.org/10.4218/etrij.10.0109.0425

Modified Fixed-Threshold SMO for 1-Slack Structural SVMs  

Lee, Chang-Ki (Software Research Laboratory, ETRI)
Jang, Myung-Gil (Software Research Laboratory, ETRI)
Publication Information
ETRI Journal / v.32, no.1, 2010 , pp. 120-128 More about this Journal
Abstract
In this paper, we describe a modified fixed-threshold sequential minimal optimization (FSMO) for 1-slack structural support vector machine (SVM) problems. Because the modified FSMO uses the fact that the formulation of 1-slack structural SVMs has no bias, it breaks down the quadratic programming (QP) problems of 1-slack structural SVMs into a series of smallest QP problems, each involving only one variable. For various test sets, the modified FSMO is as accurate as existing structural SVM implementations (n-slack and 1-slack SVM-struct) but is faster on large data sets.
Keywords
1-slack structural SVM; fixed-threshold sequential minimal optimization; modified FSMO;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
Times Cited By Web Of Science : 3  (Related Records In Web of Science)
Times Cited By SCOPUS : 6
연도 인용수 순위
1 S. Keerthi et al. "A Sequential Dual Method for Large Scale Multi-Class Linear SVMs," Proc. KDD, 2008, pp. 408-416.
2 Y. LeCun et al., "Gradient-Based Learning Applied to Document Recognition," Proceedings of the IEEE, vol. 86, no. 11, Nov. 1988, pp. 2278-2324.
3 M. Collins et al., "Exponentiated Gradient Algorithms for Conditional Random Fields and Max-Margin Markov Networks," JMLR, vol. 9, 2008, pp. 1775-1822.
4 N.D. Ratliff, J.A. Bagnell, and M.A. Zinkevich, "(Online) Subgradient Methods for Structured Prediction," Proc. AISTATS, 2007.
5 S. Shalev-Shwartz, Y. Singer, and N. Srebro, "Pegasos: Primal Estimated Subgradient Solver for SVM," Proc. ICML, 2007, pp. 807-814.
6 C. Lee and M. Jang, "Fast Training of Structured SVM Using Fixed-Threshold Sequential Minimal Optimization," ETRI J., vol. 31, no. 2, 2009, pp. 121-128.   DOI   ScienceOn
7 C.H. Teo et al., "A Scalable Modular Convex Solver for Regularized Risk Minimization," Proc. KDD, 2007, pp. 727-736.
8 T. Joachims, T. Finley, and C.N. Yu, "Cutting-Plane Training of Structural SVMs," MLJ, vol. 77, no. 1, 2009, pp. 27-59.   DOI   ScienceOn
9 B. Taskar, C. Guestrin, and D. Koller, "Max Margin Markov Networks," NIPS, vol. 16, 2004.
10 I. Tsochantaridis et al., "Support Vector Machine Learning for Interdependent and Structured Output Spaces," Proc. ICML, 2004, pp. 104.
11 B. Taskar et al., "Max-Margin Parsing," Proc. EMNLP, 2004.
12 K. Lang. "Newsweeder: Learning to Filter Netnews," Proc. ICML, 1995.
13 E.F.T.K. Sang and S. Buchholz. "Introduction to the CoNLL-2000 Shared Task: Chunking," Proc. CoNLL-2000 and LLL-2000, 2000, pp. 127-132.
14 D. Lee, H. Rim, and D. Yook, "Automatic Word Spacing Using Probabilistic Models Based on Character n-Grams," IEEE Intelligent Systems, vol. 22, no. 1, 2007, pp. 28-35.   DOI
15 T. Joachims, "Training Linear SVMs in Linear Time," Proc. KDD, 2006, pp. 217-226.
16 R. Fan, P. Chen, and C. Lin, "Working Set Selection Using Second Order Information for Training Support Vector Machines," JMLR, vol. 6, 2005, pp. 1889-1918.
17 C.N. Yu et al., "Support Vector Training of Protein Alignment Models," Proc. RECOMB, 2007, pp. 253-267.
18 Y. Yue et al., "A Support Vector Method for Optimization Average Precision," Proc. SIGIR, 2007, pp. 271-278.
19 J. Platt, "Sequential Minimal Optimization: A Fast Algorithm for Training Support Vector Machines," Microsoft Research Technical Report MSR-TR-98-14, 1998.
20 T. Joachims, "A Statistical Learning Model of Text Classification with Support Vector Machines," Proc. SIGIR, 2001, pp. 128-136.
21 C. Lin, "Asymptotic Convergence of an SMO Algorithm Without Any Assumptions," IEEE Trans. Neural Networks, vol. 13, no. 1, 2002, pp. 248-250.   DOI   ScienceOn
22 S. Keerthi and E. Gilbert, "Convergence of a Generalized SMO Algorithm for SVM Classifier Design," Machine Learning, vol. 46, no. 1-3, 2002, pp. 351-360.   DOI
23 V. Franc and S. Sonnenburg, "Optimized Cutting Plane Algorithm for Support Vector Machines," Proc. ICML, vol. 307, 2008, pp. 320-327.
24 H. Kim and W. Kim, "Eye Detection in Facial Images Using Zernike Moments with SVM," ETRI J., vol. 30, no. 2, 2008, pp. 335-337.   DOI   ScienceOn