Journal of KIISE:Software and Applications (한국정보과학회논문지:소프트웨어및응용)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

A Weighted Fuzzy Min-Max Neural Network for Pattern Classification

패턴 분류 문제에서 가중치를 고려한 퍼지 최대-최소 신경망

  • 김호준 (한동대학교 전산전자공학부) ;
  • 박현정 (삼성전자 프린팅사업부)
  • Published : 2006.08.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this study, a weighted fuzzy min-max (WFMM) neural network model for pattern classification is proposed. The model has a modified structure of FMM neural network in which the weight concept is added to represent the frequency factor of feature values in a learning data set. First we present in this paper a new activation function of the network which is defined as a hyperbox membership function. Then we introduce a new learning algorithm for the model that consists of three kinds of processes: hyperbox creation/expansion, hyperbox overlap test, and hyperbox contraction. A weight adaptation rule considering the frequency factors is defined for the learning process. Finally we describe a feature analysis technique using the proposed model. Four kinds of relevance factors among feature values, feature types, hyperboxes and patterns classes are proposed to analyze relative importance of each feature in a given problem. Two types of practical applications, Fisher's Iris data and Cleveland medical data, have been used for the experiments. Through the experimental results, the effectiveness of the proposed method is discussed.

본 연구에서는 패턴 분류문제를 위하여 가중치 개념을 갖는 퍼지 최대 최소 신경망 모델을 제안한다. 제안된 모델은 기존의 FMM 신경망 모델에 대하여 학습데이타에 포함되는 특징값의 빈도요소를 효과적으로 반영할 수 있도록 수정한 구조를 갖는다. 본 논문에서는 제안된 모델에 대하여 하이퍼박스 소속함수로 정의되는 새로운 활성화 특성과 학습알고리즘을 정의한다. 학습알고리즘은 하이퍼박스 생성 및 확장, 중첩 테스트, 하이퍼박스 축소의 3 단계 과정으로 이루어지며, 각 과정에서 특정값의 빈도요소를 고려하여 가중치값을 갱신하는 규칙이 새롭게 정의된다. 본 연구에서는 또한 제안된 모텔의 응용으로서 특정분석 기법을 제안한다. 이를 위하여 특정값, 특정유형, 하이퍼박스, 패턴클래스 상호간 연관도 요소를 4 가지 유형의 척도로 정의하여, 주어진 패턴분류 문제에서 각 특정의 상대적 중요도를 평가할 수 있도록 한다. 아이리스 데이타와 클리블랜드 의료데이타에 대한 분류문제에 적용한 실험결과를 통하여 제안된 방법의 타당성을 고찰하였다.

Keywords

References

  1. P. K. Simpson, 'Fuzzy Min-Max neural networks Part 1:classification, IEEE Transaction on Neural Networks,' Vol.3, No.5, pp.776-786, 1992 https://doi.org/10.1109/72.159066
  2. Jayanta Basak, Rajat K. De, Sankar K. Pal, 'Unsupervised feature selection using a neurofFuzzy approach,' Pattern Recognition Letters, Vol.19, No.1, pp.997-1006, 1998 https://doi.org/10.1016/S0167-8655(98)00083-X
  3. S. Mitra, R. K. De, and S. K. Pal, 'Knowledgebased fuzzy MLP for classification and rule generation,' IEEE Transactions on Neural Networks, Vol.18, No.6, pp.1338-1350, 1997 https://doi.org/10.1109/72.641457
  4. B. Gabrys, A. Bargiela, 'General Fuzzy Min-Max neural network for clustering and classification,' IEEE Transaction on Neural Networks, Vo.11 , No.3, pp.769-783, 2000 https://doi.org/10.1109/72.846747
  5. P. K. Simpson, 'Fuzzy Min-Max neural networks Part 2:clustering,' IEEE Transaction on Fuzzy Systems, Vol.1, No.1, pp.32-45, 1993 https://doi.org/10.1109/TFUZZ.1993.390282
  6. C. Z. Ye, J. Yang, D. Geng, Y. Zhou, N. Y. Chen, 'Fuzzy rules to predict degree of malignancy in brain glioma,' Medical and Biological Engineering and Computing, Vol.40, No.1, pp.145-152, 2002 https://doi.org/10.1007/BF02348118
  7. Raphael Feraud, Fabrice Clerot, 'A methodology to explain neural network classification,' Neural Networks, Vol.15, No.1, pp.237-246, 2002 https://doi.org/10.1016/S0893-6080(01)00127-7
  8. Kumar S. Ray and Jayati Ghoshal, 'Neuro fuzzy approach to pattern recognition,' Neural Networks, Vol.10, No.1, pp.161-182, 1997 https://doi.org/10.1016/S0893-6080(96)00056-1
  9. Mahn M. Lee, Kuo H. Chen, I. F. Jiang, 'A neural network classifier with disjunctive fuzzy information,' Neural Networks, Vol. 11 , No.1, pp.1113-1125, 1998 https://doi.org/10.1016/S0893-6080(98)00058-6
  10. Hung P. Chiu, Din C. Tseng, 'Invariant handwritten Chinese character recognition using Fuzzy Min-Max neural networks,' Pattern Recognition Letters, Vol.18. No.1, pp.481-491, 1997 https://doi.org/10.1016/S0167-8655(97)00029-9
  11. Jayanta Basak, Rajat K. De, Sankar K. Pal, 'Unsupervised Feature Selection using a Neuro-Fuzzy Approach,' Pattern Recognition Letters, Vol.19, pp.997-1006, 1998 https://doi.org/10.1016/S0167-8655(98)00083-X
  12. Jean M. Steppe, Kenneth W. Bauer, Jr. 'Improved feature screening in feedforward neural networks,' Neurocomputing , Vol.13, pp.47-58, 1996 https://doi.org/10.1016/0925-2312(95)00100-X
  13. C. L. Blake, and C. J. Merz, 'UCI Repository of machine learning databases [http://www.ics.uci.edu/-mlearn/MLRepository.html],' Irvine, CA: University of California, Department of Information and Computer Science, 1998