Browse > Article
http://dx.doi.org/10.5391/IJFIS.2015.15.4.217

Multiple Instance Mamdani Fuzzy Inference  

Khalifa, Amine B. (CECS Department, University of Louisville)
Frigui, Hichem (CECS Department, University of Louisville)
Publication Information
International Journal of Fuzzy Logic and Intelligent Systems / v.15, no.4, 2015 , pp. 217-231 More about this Journal
Abstract
A novel fuzzy learning framework that employs fuzzy inference to solve the problem of Multiple Instance Learning (MIL) is presented. The framework introduces a new class of fuzzy inference systems called Multiple Instance Mamdani Fuzzy Inference Systems (MI-Mamdani). In multiple instance problems, the training data is ambiguously labeled. Instances are grouped into bags, labels of bags are known but not those of individual instances. MIL deals with learning a classifier at the bag level. Over the years, many solutions to this problem have been proposed. However, no MIL formulation employing fuzzy inference exists in the literature. Fuzzy logic is powerful at modeling knowledge uncertainty and measurements imprecision. It is one of the best frameworks to model vagueness. However, in addition to uncertainty and imprecision, there is a third vagueness concept that fuzzy logic does not address quiet well, yet. This vagueness concept is due to the ambiguity that arises when the data have multiple forms of expression, this is the case for multiple instance problems. In this paper, we introduce multiple instance fuzzy logic that enables fuzzy reasoning with bags of instances. Accordingly, a MI-Mamdani that extends the standard Mamdani inference system to compute with multiple instances is introduced. The proposed framework is tested and validated using a synthetic dataset suitable for MIL problems. Additionally, we apply the proposed multiple instance inference to fuse the output of multiple discrimination algorithms for the purpose of landmine detection using Ground Penetrating Radar.
Keywords
Fuzzy inference; Mamdani FIS; Multiple Instance Learning; Algorithm fusion;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 L. A. Zadeh, A Theory of Approximate Reasoning (AR). Berkeley, CA: Electronics Research Laboratory, College of Engineering, University of California, 1977.
2 O. Cordon, "A historical review of evolutionary learning methods for Mamdani-type fuzzy rule-based systems: designing interpretable genetic fuzzy systems," International Journal of Approximate Reasoning, vol. 52, no. 6, pp. 894-913, 2011. http://dx.doi.org/10.1016/j.ijar.2011.03.004   DOI
3 L. A. Zadeh, "Outline of a new approach to the analysis of complex systems and decision processes," IEEE Transactions on Systems, Man and Cybernetics, vol. 3, no. 1, pp. 28-44, 1973. http://dx.doi.org/10.1109/tsmc.1973.5408575
4 E. H. Mamdani, "Application of fuzzy algorithms for control of simple dynamic plant," Proceedings of the Institution of Electrical Engineers, vol. 121, no. 12, pp. 1585-1588, 1974. http://dx.doi.org/10.1049/piee.1974.0328
5 R. Jager, H. Verbruggen, and P. M. Bruijin, "Fuzzy inference in rule-based control systems," in Proceedings of 1st International Conference on Intelligent Systems Engineering, Edinburgh, Scotland, 1992, pp. 232-237.
6 C. C. Lee, "Fuzzy logic in control systems: fuzzy logic controller. II," IEEE Transactions on Systems, Man and Cybernetics, vol. 20, no. 2, pp. 419-435, 1990. http://dx.doi.org/10.1109/21.52552   DOI
7 J. Casillas, Interpretability Issues in Fuzzy Modeling. Berlin: Springer-Verlag, 2003.
8 C. Y. Chiu, H. C. Lin, and S. N. Yang, "A fuzzy logic CBIR system," in Proceedings of the 12th IEEE International Conference on Fuzzy Systems, St. Louis, MO, 2003, pp. 1171-1176. http://dx.doi.org/10.1109/fuzz.2003.1206597
9 A. A. Othman, H. R. Tizhoosh, and F. Khalvati, "EFIS: evolving fuzzy image segmentation," IEEE Transactions on Fuzzy Systems, vol. 22, no. 1, pp. 72-82, 2014. http://dx.doi.org/10.1109/tfuzz.2013.2246761   DOI
10 D. Y. Kim and H. M. Chung, "Image recognition by learning multi-valued logic neural network," International Journal of Fuzzy Logic and Intelligent Systems, vol. 2, no. 3, pp. 215-220, 2002. http://dx.doi.org/10.5391/ijfis.2002.2.3.215   DOI
11 H. K. Kwan and L. Y. Cai, "Supervised fuzzy inference network for invariant pattern recognition," in Proceedings of the 43rd IEEE Midwest Symposium on Circuits and Systems, Lansing, MI, 2000, pp. 850-854. http://dx.doi.org/10.1109/mwscas.2000.952888   DOI
12 J. S. Kim, "Prediction of user's preference by using fuzzy rule & RDB inference: a cosmetic brand selection," International Journal of Fuzzy Logic and Intelligent Systems, vol. 5, no. 4, pp. 353-359, 2005. http://dx.doi.org/10.5391/ijfis.2005.5.4.353   DOI
13 A. Khalifa and H. Frigui, "Fusion of multiple algorithms for detecting buried objects using fuzzy inference," Proceedings of SPIE, vol. 9072, 2014. http://dx.doi.org/10.1117/12.2051217   DOI
14 "Flickr," 2014; Available http://www.flickr.com/
15 M. Y. Chen and D. Linkens, "Rule-base self-generation and simplification for data-driven fuzzy models," in Proceedings of the 10th IEEE International Conference on Fuzzy Systems, Melbourne, Australia, 2001, pp. 424-427. http://dx.doi.org/10.1109/fuzz.2001.1007339   DOI
16 D. Z. Saletic, "On data-driven procedure for determining the number of rules in a Takagi-36 fuzzy model," in Proceedings of the International Conference on Computer as a Tool (EUROCON2005), Belgrade, Serbia 2005, pp. 1132-1135. http://dx.doi.org/10.1109/eurcon.2005.1630151   DOI
17 P. Zikopoulos, D. DeRoos, K. Parasuraman, T. Deutsch, J. Giles, and D. Corrigan, Harness the Power of Big Data: The IBM Big Data Platform. New York, NY: McGraw-Hill, 2012.
18 "Craigslist," 2014; Available http://www.craigslist.org
19 A. Sorokin and D. Forsyth, "Utility data annotation with Amazon Mechanical Turk," in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Anchorage, AK, 2008, pp. 1-8. http://dx.doi.org/10.1109/cvprw.2008.4562953   DOI
20 A. Torralba, B. C. Russell, and J. Yuen, "Labelme: online image annotation and applications," Proceedings of the IEEE, vol. 98, no. 8, pp. 1467-1484, 2010. http://dx.doi.org/10.1109/jproc.2010.2050290   DOI
21 I. J. Goodfellow, Y. Bulatov, J. Ibarz, S. Arnoud, and V. Shet, "Multi-digit number recognition from street view imagery using deep convolutional neural networks," in Proceedings of 2nd International Conference on Learning Representations (ICLR2014), Banff, Canada, 2014, pp. 1-13.
22 O. Maron, "Learning from ambiguity," Ph.D. dissertation, Massachusetts Institute of Technology, Cambridge, MA, 1998.
23 A. Karem and H. Frigui, "A multiple instance learning approach for landmine detection using ground penetrating radar," in Proceedings of 2011 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Vancouver, Canada, 2011, pp. 878-881. http://dx.doi.org/10.1109/igarss.2011.6049271   DOI
24 T. G. Dietterich, R. H. Lathrop, and T. Lozano-Perez, "Solving the multiple instance problem with axis-parallel rectangles," Artificial Intelligence, vol. 89, no. 1-2, pp. 31-71, 1997. http://dx.doi.org/10.1016/s0004-3702(96)00034-3   DOI
25 C. Zhang, X. Chen, and W. B. Chen, "An online multiple instance learning system for semantic image retrieval," in Proceedings of 9th IEEE International Symposium on Multimedia Workshops (ISMW'07), Taichung, Taiwan, 2007, pp. 83-84. http://dx.doi.org/10.1109/ism.workshops.2007.23   DOI
26 O. Maron and T. Lozano-Perez, "A framework for multiple-instance learning," in Proceedings of the 1997 Conference on Advances in Neural Information Processing Systems (NIPS'97), Cambridge, MA, 1998, pp. 570-576.
27 R. Rahmani and S. A. Goldman, "MISSL: Multipleinstance semi-supervised learning," in Proceedings of the 23rd International Conference on Machine Learning (ICML'06), Pittsburgh, PA, 2006, pp. 705-712. http://dx.doi.org/10.1145/1143844.1143933   DOI
28 S. Ray and M. Craven, "Supervised versus multiple instance learning: an empirical comparison," in Proceedings of the 22nd International Conference on Machine Learning (ICML'05), Bonn, Germany, 2005, pp. 697-704. http://dx.doi.org/10.1145/1102351.1102439   DOI
29 Y. Chen, J. Bi, and J. Z.Wang, "MILES: multiple-instance learning via embedded instance selection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 1931-1947, 2006. http://dx.doi.org/10.1109/tpami.2006.248   DOI
30 C. Yang, M. Dong, and F. Fotouhi, "Region based image annotation through multiple-instance learning," in Proceedings of the 13th Annual ACM International Conference on Multimedia, Singapore, 2005, pp. 435-438. http://dx.doi.org/10.1145/1101149.1101245
31 B. Babenko, M. H. Yang, and S. Belongie, "Robust object tracking with online multiple instance learning," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 8, pp. 1619-1632, 2011. http: //dx.doi.org/10.1109/tpami.2010.226   DOI
32 P. L. Lanzi, W. Stolzmann, and S. W. Wilson, Learning Classifier Systems: From Foundations to Applications (LNCS vol.1813). Berlin: Springer, 2000.
33 L. A. Zadeh, "Fuzzy sets," Information and Control, vol. 8, no. 3, pp. 338-353, 1965. http://dx.doi.org/10.1016/S0019-9958(65)90241-X   DOI
34 E. H. Mamdani and S. Assilian, "An experiment in linguistic synthesis with a fuzzy logic controller," International Journal of Human-Computer Studies, vol. 51, no. 2, pp. 135-147, 1999. http://dx.doi.org/10.1006/ijhc.1973.0303   DOI
35 E. H. Mamdani, "Application of fuzzy logic to approximate reasoning using linguistic synthesis," IEEE Transactions on Computers, vol. 26, no. 12, pp. 1182-1191, 1977. http://dx.doi.org/10.1109/tc.1977.1674779
36 T. Takagi and M. Sugeno, "Fuzzy identification of systems and its applications to modeling and control," IEEE Transactions on Systems, Man and Cybernetics, vol. 15, no. 1, pp. 116-132, 1985. http://dx.doi.org/10.1109/tsmc.1985.6313399   DOI
37 R. R. Yager, "On the theory of bags," International Journal of General Systems, vol. 13, no. 1, pp. 23-37, 1986. http://dx.doi.org/10.1080/03081078608934952   DOI
38 K. T. Atanassov, "Intuitionistic fuzzy sets," Fuzzy Sets and Systems, vol. 20, no. 1, pp. 87-96, 1986. http://dx.doi.org/10.1016/s0165-0114(86)80034-3   DOI
39 D. Ramot, R. Milo, M. Friedman, and A. Kandel, "Complex fuzzy sets," IEEE Transactions on Fuzzy Systems, vol. 10, no. 2, pp. 171-186, 2002. http://dx.doi.org/10.1109/91.995119   DOI
40 V. Torra, "Hesitant fuzzy sets," International Journal of Intelligent Systems, vol. 25, no. 6, pp. 529-539, 2010. http://dx.doi.org/10.1002/int.20418   DOI
41 G. Cheng and J. Yang, "Complex fuzzy reasoning schemes," in Proceedings of 2010 3rd International Conference on Information and Computing (ICIC), Wuxi, China, 2010, pp. 29-32. http://dx.doi.org/10.1109/icic.2010.190   DOI
42 V. G. Kaburlasos and A. Kehagias, "Fuzzy inference system (FIS) extensions based on the lattice theory," IEEE Transactions on Fuzzy Systems, vol. 2, no. 3, pp. 531-546, 2013. http://dx.doi.org/10.1109/TFUZZ.2013.2263807   DOI
43 A. Mahnot and M. Popescu, "Fumil-fuzzy multiple instance learning for early illness recognition in older adults," in Proceedings of 2012 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), Brisbane, Australia, 2012, pp. 1-5. http://dx.doi.org/10.1109/fuzz-ieee.2012.6251358   DOI
44 J. Casasnovas and G. Mayor, "Discrete t-norms and operations on extended multisets," Fuzzy Sets and Systems, vol. 159, no. 10, pp. 1165-1177, 2008. http://dx.doi.org/10.1016/j.fss.2007.12.005   DOI
45 D. E. Tamir and A. Kandel, "Axiomatic theory of complex fuzzy logic and complex fuzzy classes," International Journal of Computers, Communications & Control, vol. 6, no. 3, pp. 562-576, 2011. http://dx.doi.org/10.15837/ijccc.2011.3.2135   DOI
46 J. S. R. Jang, C. T. Sun, and E. Mizutani, Neuro-fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Upper Saddle River, NJ: Prentice Hall, 1997.
47 A. Karem and H. Frigui, "Fuzzy clustering algorithm of multiple instance data," in Proceedings of 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), Istanbul, Turkey, 2015, pp. 1-7. http://dx.doi.org/10.1109/FUZZ-IEEE.2015.7338084   DOI
48 D. Dubois and H. M. Prade, Fuzzy Sets and Systems: Theory and Applications. New York, NY: Academic Press, 1980.
49 M. Xia and Z. Xu, "Hesitant fuzzy information aggregation in decision making," International Journal of Approximate Reasoning, vol. 52, no. 3, pp. 395-407, 2011. http://dx.doi.org/10.1016/j.ijar.2010.09.002   DOI
50 L. A. Zadeh, "Is there a need for fuzzy logic?," Information Sciences, vol. 178, no. 13, pp. 2751-2779, 2008. http://dx.doi.org/10.1016/j.ins.2008.02.012   DOI
51 J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms. New York, NY: Plenum Press, 1981.
52 H. Frigui and P. Gader, "Detection and discrimination of land mines in ground-penetrating radar based on edge histogram descriptors and a possibilistic k-nearest neighbor classifier," IEEE Transactions on Fuzzy Systems, vol. 17, no. 1, pp. 185-199, 2009. http://dx.doi.org/10.1109/tfuzz.2008.2005249   DOI