Browse > Article
http://dx.doi.org/10.5626/JOK.2015.42.2.227

Learning Multiple Instance Support Vector Machine through Positive Data Distribution  

Hwang, Joong-Won (Kyungpook National Univ.)
Park, Seong-Bae (Kyungpook National Univ.)
Lee, Sang-Jo (Kyungpook National Univ.)
Publication Information
Journal of KIISE / v.42, no.2, 2015 , pp. 227-234 More about this Journal
Abstract
This paper proposes a modified MI-SVM algorithm by considering data distribution. The previous MI-SVM algorithm seeks the margin by considering the "most positive" instance in a positive bag. Positive instances included in positive bags are located in a similar area in a feature space. In order to reflect this characteristic of positive instances, the proposed method selects the "most positive" instance by calculating the distance between each instance in the bag and a pivot point that is the intersection point of all positive instances. This paper suggests two ways to select the "most positive" pivot point in the training data. First, the algorithm seeks the "most positive" pivot point along the current predicted parameter, and then selects the nearest instance in the bag as a representative from the pivot point. Second, the algorithm finds the "most positive" pivot point by using a Diverse Density framework. Our experiments on 12 benchmark multi-instance data sets show that the proposed method results in higher performance than the previous MI-SVM algorithm.
Keywords
multi-instance learning; MI-SVM; support vector machine; data distribution;
Citations & Related Records
연도 인용수 순위
  • Reference
1 T. G. Dietterich, R. H. Lathrop, and T. Lozano-Perez, "Solving the multiple instance problem with axis-parallel rectangles," Artificial Intelligence, Vol. 89, pp. 31-71, 1997.   DOI
2 P. M. Long and L. Tan, "PAC learning axis aligned rectangles with respect to product distributions from multiple-instance examples," Proc. of Conference on Computational Learning Theory, 1996.
3 O. Maron and A. L. Ratan, "Multiple-instance learning for natural scene classification," Proc. of the Fifteenth International Conference on Machine Learning, pp. 341-349. 1998.
4 O. Maron and T. Lozano-Perez, "A framework for multiple-instance learning," Advances in Neural Information Processing Systems, pp. 570-576, 1997.
5 Y. Chen and J. Wang, "Image Categorization by Learning and Reasoning with Regions," Journal of Machine Learning Research, Vol. 5, pp. 913-939, 2004.
6 D. Gray and R. Soumya, "A theoretical and empirical analysis of support vector machine methods for multiple-instance classification," Machine Learning, pp. 1-24, 2013.
7 S. Andrews, I. Tsochantaridis, and T. Hofmann, "Support vector machines for multiple-instance learning," In Advances in Neural Information, Processing Systems, Vol. 15, pp. 561-568, 2003.
8 Q. Zhang, S. A. Goldman and W. Yu and J. Fritts, "Content-Based Image Retrieval Using Multiple-Instance Learning," Proc. of 19th International Conference of Machine Learning, pp. 682-689, 2002.
9 C. Yang and T. Lozano-Perez, "Image Database Retrieval with Multiple-Instance Learning Techniques," Proc. of IEEE International Conference of Data Engineering, pp. 233-243, 2000.
10 Z. H. Zhou and M. L. Zhang, "Ensembles of Multi- Instance Learners," Lecture Notes in Artificial Intelligence, Vol. 2837, pp. 492-502, 2003.
11 Q. Zhang and S. A. Goldman, "EM-DD: An Improved Multiple-Instance Learning Technique," Advances in Neural Information Processing Systems, pp. 1073-1080, 2002.
12 B. Scholkopf and A. Smola, "Learning with Kernels, Support Vector Machines," Regularization, Optimization and Beyond, MIT Press, 2002.
13 Y. Chen, J. Bi and J.Z. Wang, "MILES: Multiple Instance Learning via Embedded Instance Selection," IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 28, No. 12, pp. 1931-1947, 2006.   DOI