• Proceedings of the IEEK Conference
• /
• 1998.10a
• /
• pp.1273-1276
• /
• 1998

The HMM-Net is an architecture for a neural network that implements a hidden Markov model (HMM). The architecture is developed for the purpose of combining the discriminant power of neural networks with the time-domain modeling capability of HMMs. Criteria used for learning HMM-Net classifiers are maximum likelihood (ML), maximum mutual information (MMI), and minimization of mean squared error(MMSE). In this paper we propose an efficient learning method of HMM-Net classifiers using hybrid criteria, ML/MMSE and MMI/MMSE, and report the results of an experimental study comparing the performance of HMM-Net classifiers trained by the gradient descent algorithm with the above criteria. Experimental results for the isolated numeric digits from /0/ to /9/ show that the performance of the proposed method is better than the others in the respects of learning and recognition rates.

• Proceedings of the KSRS Conference
• /
• 2002.10a
• /
• pp.709-714
• /
• 2002

This paper discussed and analyzed results of different classification algorithms for land use classification in arid and semiarid areas using CBERS-1 image, which in case of our study is Shihezi Municipality, Xinjiang Province. Three types of classifiers are included in our experiment, including the Maximum Likelihood classifier, BP neural network classifier and Fuzzy-ARTMAP neural network classifier. The classification results showed that the classification accuracy of Fuzzy-ARTMAP was the best among three classifiers, increased by 10.69% and 6.84% than Maximum likelihood and BP neural network, respectively. Meanwhile, the result also confirmed the practicability of CBERS-1 image in land use survey.

• The KIPS Transactions:PartD
• /
• v.9D no.5
• /
• pp.939-944
• /
• 2002

In this paper, we propose and apply new classification method to the remotely sensed image acquired from airborne multi-spectral scanner. This is a neuro-fuzzy image classifier derived from the generic model of a 3-layer fuzzy perceptron. We implement a classification software system with the proposed method for land cover image classification. Comparisons with the proposed and maximum-likelihood classifiers are also presented. The results show that the neuro-fuzzy classification method classifies more accurately than the maximum likelihood method. In comparing the maximum-likelihood classification map with the neuro-fuzzy classification map, it is apparent that there is more different as amount as 7.96% in the overall accuracy. Most of the differences are in the "Building" and "Pine tree", for which the neuro-fuzzy classifier was considerably more accurate. However, the "Bare soil" is classified more correctly with the maximum-likelihood classifier rather than the neuro-fuzzy classifier.

• Journal of the Korean Institute of Telematics and Electronics C
• /
• v.34C no.9
• /
• pp.61-67
• /
• 1997

The HMM-Net is an architecture for a neural network that implements a hidden markov model(HMM). The architecture is developed for the purpose of combining the classification power of neural networks with the time-domain modeling capability of HMMs. Criteria which are used for learning HMM_Net classifiers are maximum likelihood(ML), maximum mutual information (MMI), and minimization of mean squared error(MMSE). In this classifiers trained by the gradient descent algorithm with the above criteria. Experimental results for the isolated numbers from /young/to/koo/ show that in the binary inputs the performance of MMSE is better than the others, while in the fuzzy inputs the performance of MMI is better than the others.

• Proceedings of the IEEK Conference
• /
• 1998.06a
• /
• pp.933-935
• /
• 1998

The HMM-Net is an architecture for a neural network that implements a hidden markov model (HMM). The architecture is developed for the purpose of combining the discriminant power of neural networks with the time-domain modeling capability of HMMs. Criteria used for learning HMM-Net classifiers are maximum likelihood(ML) and minimization of mean squared error(MMSE). In this paper we propose an efficient learning method of HMM_Net classifiers using a ML-MMSE hybrid criterion and report the results of an experimental study comparing the performance of HMM_Net classifiers trained by the gradient descent algorithm with the above criteria. Experimental results for the isolated numeric digits from /0/ to /9/ show that the performance of the proposed method is better than the others in the repects of learning and recognition rates.

• Proceedings of the KSRS Conference
• /
• 2007.10a
• /
• pp.6-10
• /
• 2007

Classification of hyperspectral images is challenging. A very high dimensional input space requires an exponentially large amount of data to adequately and reliably represent the classes in that space. In other words in order to obtain statistically reliable classification results, the number of necessary training samples increases exponentially as the number of spectral bands increases. However, in many situations, acquisition of the large number of training samples for these high-dimensional datasets may not be so easy. This problem can be overcome by using multiple classifiers. In this paper we compared the effectiveness of two approaches for creating multiple classifiers, feature selection and feature extraction. The methods are based on generating multiple feature subsets by running feature selection or feature extraction algorithm several times, each time for discrimination of one of the classes from the rest. A maximum likelihood classifier is applied on each of the obtained feature subsets and finally a combination scheme was used to combine the outputs of individual classifiers. Experimental results show the effectiveness of feature extraction algorithm for generating multiple classifiers.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.31B no.12
• /
• pp.108-115
• /
• 1994

Most pattern classifiers have been designed based on the ML (Maximum Likelihood) training algorithm which is simple and relatively powerful. The ML training is an efficient algorithm to individually estimate the model parameters of each class under the assumption that all class models in a classifier are statistically independent. That assumption, however, is not valid in many real situations, which degrades the performance of the classifier. In this paper, we propose a minimum-error-rate training algorithm based on the MAP (Maximum a Posteriori) approach. The algorithm regards the normalized outputs of the classifier as estimates of the a posteriori probability, and tries to maximize those estimates. According to Bayes decision theory, the proposed algorithm satisfies the condition of minimum-error-rate classificatin. We apply this algorithm to NPM (Neural Prediction Model) for speech recognition, and derive new disrminative training algorithms. Experimental results on ten Korean digits recognition have shown the reduction of 37.5% of the number of recognition errors.

• Proceedings of the KSRS Conference
• /
• 1998.09a
• /
• pp.122-127
• /
• 1998

This paper presents the neuro-fuzzy classifier derived from the generic model of a 3-layer fuzzy perceptron and developed the classification software based on the neuro-fuzzl model. Also, a comparison of the neuro-fuzzy and maximum-likelihood classifiers is presented in this paper. The Airborne Multispectral Scanner(AMS) imagery of Tae-Duk Science Complex Town were used for this comparison. The neuro-fuzzy classifier was more considerably accurate in the mixed composition area like "bare soil" , "dried grass" and "coniferous tree", however, the "cement road" and "asphalt road" classified more correctly with the maximum-likelihood classifier than the neuro-fuzzy classifier. Thus, the neuro-fuzzy model can be used to classify the mixed composition area like the natural environment of korea peninsula. From this research we conclude that the neuro-fuzzy classifier was superior in suppression of mixed pixel classification errors, and more robust to training site heterogeneity and the use of class labels for land use that are mixtures of land cover signatures.

• Korean Journal of Remote Sensing
• /
• v.28 no.5
• /
• pp.489-499
• /
• 2012

In this paper, a classifier ensemble framework for remote sensing data classification is presented that combines classification results generated from both different training sets and different classifiers. A core part of the presented framework is to increase a diversity between classification results by using both different training sets and classifiers to improve classification accuracy. First, different training sets that have different sampling densities are generated and used as inputs for supervised classification using different classifiers that show different discrimination capabilities. Then several preliminary classification results are combined via a majority voting scheme to generate a final classification result. A case study of land-cover classification using multi-temporal ENVISAT ASAR data sets is carried out to illustrate the potential of the presented classification framework. In the case study, nine classification results were combined that were generated by using three different training sets and three different classifiers including maximum likelihood classifier, multi-layer perceptron classifier, and support vector machine. The case study results showed that complementary information on the discrimination of land-cover classes of interest would be extracted within the proposed framework and the best classification accuracy was obtained. When comparing different combinations, to combine any classification results where the diversity of the classifiers is not great didn't show an improvement of classification accuracy. Thus, it is recommended to ensure the greater diversity between classifiers in the design of multiple classifier systems.

• Journal of the Korean Society for Nondestructive Testing
• /
• v.10 no.2
• /
• pp.23-31
• /
• 1990

Acoustic Emission(AE) signals obtained during fracture toughness test and fatigue test for nuclear pressure vessel material(SA 508 cl.3) and artificial AE signals from pencil break and ultrasonic pulser were classified using pattern recognition methods. Three different classifiers ; namely Minimum Distance Classifier, Linear Discriminant Classifier and Maximum Likelihood Classifier were used for pattern recognition. In this study, the performance of each classifier was compared. The discrimination of AE signals from cracking and crack surface rubbing was possible and the analysis for crack propagation was applicable by pattern recognition methods.