Browse > Article

Neural and MTS Algorithms for Feature Selection  

Su, Chao-Ton (Department of Industrial Engineering and Management National Chiao Tung University)
Li, Te-Sheng (Department of Industrial Engineering and Management Minghsin Institute of Technology)
Publication Information
International Journal of Quality Innovation / v.3, no.2, 2002 , pp. 113-131 More about this Journal
Abstract
The relationships among multi-dimensional data (such as medical examination data) with ambiguity and variation are difficult to explore. The traditional approach to building a data classification system requires the formulation of rules by which the input data can be analyzed. The formulation of such rules is very difficult with large sets of input data. This paper first describes two classification approaches using back-propagation (BP) neural network and Mahalanobis distance (MD) classifier, and then proposes two classification approaches for multi-dimensional feature selection. The first one proposed is a feature selection procedure from the trained back-propagation (BP) neural network. The basic idea of this procedure is to compare the multiplication weights between input and hidden layer and hidden and output layer. In order to simplify the structure, only the multiplication weights of large absolute values are used. The second approach is Mahalanobis-Taguchi system (MTS) originally suggested by Dr. Taguchi. The MTS performs Taguchi's fractional factorial design based on the Mahalanobis distance as a performance metric. We combine the automatic thresholding with MD: it can deal with a reduced model, which is the focus of this paper In this work, two case studies will be used as examples to compare and discuss the complete and reduced models employing BP neural network and MD classifier. The implementation results show that proposed approaches are effective and powerful for the classification.
Keywords
Feature selection; Artificial neural networks; Backpropagation; Mahalanobis distance; Automatic thresholding; Mahalanobis-Taguchi system.;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Guo, R. and Pandit, S. M., 1998.Automatic threshold selection based on histogram lodes and a discriminant criterion. Machine vision and applications 10, 331-338   DOI   ScienceOn
2 Shah, N. K. and Gemperline, P. J., 1990. Combination of the Mahalanobis distance and residual variance pattern recognition techniques for classification of Near-Infrared reflectance spectra. Analytic Chemistry 62, 465-470   DOI
3 Tsukimoto, H., 2000. Extraction Rules from Trained Neural Networks. IEEE Transactions on Neural Networks 11, 377-389   DOI   ScienceOn
4 Younis, K. S., Rogers, T. K. and DeSimio, M. P., 1996. Vector quantization based on dynamic adjustment of Mahalanobis distance. Aerospace and Electronics Conference Proceedings of IEEE of 1996 1.2, 858-862
5 Andrews, R. and Diederich, J., 1996.Rules and Networks. Proceedings of Rule Extraction Trained Artificial Neural Networks Workshop, AISB
6 Otsu, N., 1979. A threshold selection method from gray level histograms. IEEE Transaction on Systems Man and Cybernetics. SMC 9, 62-66
7 Brown, C. W. and Lo, S. C., 1998.Chemical information based on neural network processing of Near IR Spectra.Analytic Chemistry 70, 2983-2990   DOI   ScienceOn
8 Sette, S., Boullart, L., Langenhove, L. V. and Kiekens, P., 1997. Optimizing the fiber-to-yarn production process with a combined neural network/genetic algorithm approach. Textile Research Journal 67, 84-92   ScienceOn
9 Andrews, R., Diederich, J. and Tickle, A B., 1995. Survey and critque of techniques for extracting rules from trained artificial neural networks. Knowledge-Based System 8, 373-389   DOI   ScienceOn
10 Kato, N., Suzuki, M., Omachi, S., Aso, H. and Nemoto, Y., 1999. A handwritten character recognition system using directional element feature and asymmetric Mahalanobis distance. IEEE Transaction on Pattem Analysis and Machine Intelligence. 21, 258-263   DOI   ScienceOn
11 Pfurtscheller, G., Kalcher, J. and Nerper, C., 1996. Online EEG classification during externally paced hand movements using a neural network-based classifier. Electroncephalogr. Clinical Neruophsiology 99, 416-425   DOI   ScienceOn
12 Antony, J., 2000. Multi response optimization in industrial experiments using Taguchi's quality loss function and principal component analysis. Quality Reliability Engineering. International 16, 3-8   DOI   ScienceOn
13 Taguchi, Genichi, 1998. Mathematics for Quality Engineering. Journal of Quality Engineering Forum 6, 5-10
14 Sarle, W. S., 2000. How to measure importance of inputs?. SAS Institute Inc., Cary, NC, USA. ftp://ftp.sas.com./put/neural/importance.html.
15 Kwak, N. K. and Lee, C., 1997. A neural network application to classification of health status of HIV/AIDS patients.Journal of Medical System 21. 87-97   DOI   ScienceOn
16 Sutter, J. M. and Jurs, P. C., 1997 Neural network classification and quantification of organic vapors based on fluorescence data from a fiber optic sensor array. Analytic Chemistry 69, 856-862   DOI   ScienceOn
17 Giacinto, G., Roli, F. and Bruzzone, L., 2000. Combination of neural and statistical algorithms for supervised classification of remote-sensing images. Pattern recognition letters 21, 385-397   DOI   ScienceOn