International Journal of Fuzzy Logic and Intelligent Systems

Korean Institute of Intelligent Systems (한국지능시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Modified Version of SVM for Text Categorization

  • Jo, Tae-Ho (School of Computer and Information Engineering Inha University)
  • Published : 2008.03.01
Download PDF
⟨ Previous Next ⟩

Abstract

This research proposes a new strategy where documents are encoded into string vectors for text categorization and modified versions of SVM to be adaptable to string vectors. Traditionally, when the traditional version of SVM is used for pattern classification, raw data should be encoded into numerical vectors. This encoding may be difficult, depending on a given application area of pattern classification. For example, in text categorization, encoding full texts given as raw data into numerical vectors leads to two main problems: huge dimensionality and sparse distribution. In this research, we encode full texts into string vectors, and apply the modified version of SVM adaptable to string vectors for text categorization.

Keywords

References

  1. Androutsopoulos, K. Koutsias, K. V. Chandrinos, and C. D. Spyropoulos, "An Experimental Comparison of Naïve Bayes and Keyword-based Anti-spam Filtering with personal email message", The Proceedings of 23rd ACM SIGIR, pp160-167, 2000
  2. M. Hearst, "Support Vector Machines", IEEE Intelligent Systems, Vol 13, No 4, pp18-28, 1998
  3. P. Jackson, and I. Mouliner, Natural Language Processing for Online Applications: Text Retrieval, Extraction and Categorization, John Benjamins Publishing Company, 2002
  4. T. Joachims, "Text Categorization with Support Vector Machines: Learning with many Relevant Features", The Proceedings of 10th European Conference on Machine Learning, pp143-151, 1998
  5. H. Lodhi, C. Saunders, J. Shawe-Taylor, N. Cristianini, and C. Watkins, Text Classification with String Kernels, Journal of Machine Learning Research, Vol 2, No 2, pp419-444, 2002 https://doi.org/10.1162/153244302760200687
  6. B. Massand, G. Linoff, and D. Waltz, "Classifying News Stories using Memory based Reasoning", The Proceedings of 15th ACM International Conference on Research and Development in Information Retrieval, 1992, pp59-65, 1992
  7. Mitchell, T. M., Machine Learning, McGraw-Hill, 1997
  8. D. Mladenic, and M. Grobelink, "Feature Selection for unbalanced class distribution and Naïve Bayes", The Proceedings of International Conference on Machine Learning, pp256-267, 1999
  9. M. E. Ruiz, and P. Srinivasan, "Hierarchical Text Categorization Using Neural Networks", Information Retrieval, Vol 5, No 1, 2002, pp87-118, 2002 https://doi.org/10.1023/A:1012782908347
  10. F. Sebastiani, "Machine Learning in Automated Text Categorization", ACM Computing Survey, Vol 34, No 1, pp1-47, 2002 https://doi.org/10.1145/505282.505283
  11. E. D. Wiener, "A Neural Network Approach to Topic Spotting in Text", The Thesis of Master of University of Colorado, 1995
  12. Y. Yang, "An evaluation of statistical approaches to text categorization", Information Retrieval, Vol 1, No 1-2, pp67-88, 1999

Cited by

  1. Pattern Recognition of Ship Navigational Data Using Support Vector Machine vol.15, pp.4, 2015, https://doi.org/10.5391/IJFIS.2015.15.4.268