• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.42 no.4 s.304
• /
• pp.43-50
• /
• 2005

This paper proposes a new pattern recognition system combining the new adaptive feature weighting based on the genetic algorithm and the modified KNN(K Nearest-Neighbor) rules. The new feature weighting proposed herein avoids the overfitting and finds the Proper feature weighting value by determining the middle value of weights using GA. New GA operators are introduced to obtain the high performance of the system. Moreover, a class dependent feature weighting strategy is employed. Whilst the classical methods use the same feature space for all classes, the Proposed method uses a different feature space for each class. The KNN rule is modified to estimate the class of test pattern using adaptive feature space. Experiments were performed with the unconstrained handwritten numeral database of Concordia University in Canada to show the performance of the proposed method.

• Proceedings of the Korean Information Science Society Conference
• /
• 2002.04b
• /
• pp.661-663
• /
• 2002

필기체 숫자 인식을 위한 새로운 특징 추출방범을 숫자의 기하학적인 구조들을 이용하여 연구 제안하였다. 일반적으로 쓰이고 있는 특징점들의 몇가지 부류를 결정하여 추줄하였고, 분절 화소들을 이용한 특징 추출기는 사소한 부분들을 명확한 특징으로 탐지하여 추줄하게 된다. 신경망은 새로운 접근 가능성을 탐지하는 실험 인식기로 사용하였고, 이러한 방법들을 이용하여, 일반적인 특징점 추줄방법과 본 연구에서 제안하는 특징점 추출방법을 결합하게 되면 필기체 문자의 인식률이 단순히 일반적인 특징만을 활용하여 얻는 인식률 보다 훨씬 향상됨을 보여주었다.

• Proceedings of the Korea Multimedia Society Conference
• /
• 2003.05b
• /
• pp.762-765
• /
• 2003

본 논문에서 제안하는 분절된 화소들의 특징추출 방법은 이진화 영상에서 수직/수평 화소들의 분절점을 탐색하여 추출하는 특징 탐색기이다. 숫자의 구조적인 면을 고려하여 사소한 부분들도 명확한 특징으로 탐지하여 추출하였고, 이러한 방법은 일반적으로 사용하여지는 특징추출방법 몇가지를 선택하여 이용하였고, 제안하는 방법과 결합하여 필기체 숫자를 인식하였다. 인식기를 구현하기 위하여 3개층 구조를 갖는 클러스터 MLP 신경망을 사용하였다 실험 결과 단순히 일반적인 특징만을 활용하여 얻는 인식률 보다 훨씬 향상됨을 보여주었다.

• Proceedings of the Korean Information Science Society Conference
• /
• 2000.10b
• /
• pp.344-346
• /
• 2000

임의 길이 숫자열을 인식하기 위해서는 우선 숫자열 영상을 인식기가 다룰 수 있는 형태로 변환해야 한다. 만일, 사용하는 인식기가 낱자 단위 인식기라면 낱자 단위로 분할하여야 하는데, 두자 이상의 숫자들이 접촉한 경우 정확한 분할이 어렵다. 이 논문은 이러한 문제를 해결하기 위하여 접촉 숫자쌍을 분할하지 않고 통째로 인식하는 방법을 사용한다. 필기 숫자열을 인식하기 위해 제안한 방법은 두 개의 인식기를 이용한다. 숫자열에서 분할된 패턴이 낱자인 경우 낱자 인시기가, 접촉 숫자쌍일 경우 접촉 숫자쌍 인식기가 인식한다. NIST 데이터베이스에 대한 실험 결과 2~10개의 숫자를 포함한 숫자열에 대하여 83.76%의 숫자열 인식률을 보여 접촉 숫자열 패턴을 낱자 단위로 분할하지 않고도 효과적으로 인식할 수 있음을 확인할 수 있었다.

• Journal of KIISE:Software and Applications
• /
• v.34 no.9
• /
• pp.857-868
• /
• 2007

The good classifier ensemble should have a high complementarity among classifiers in order to produce a high recognition rate and its size is small in order to be efficient. This paper proposes a classifier ensemble selection algorithm with coarse-to-fine stages. for the algorithm to be successful, the original classifier pool should be sufficiently diverse. This paper produces a large classifier pool by combining several different classification algorithms and lots of feature subsets. The aim of the coarse selection is to reduce the size of classifier pool with little sacrifice of recognition performance. The fine selection finds near-optimal ensemble using genetic algorithms. A hybrid genetic algorithm with improved searching capability is also proposed. The experimentation uses the worldwide handwritten numeral databases. The results showed that the proposed algorithm is superior to the conventional ones.

• Journal of the Institute of Convergence Signal Processing
• /
• v.2 no.1
• /
• pp.44-52
• /
• 2001

This paper describes an off-line method for recognizing totally unconstrained handwritten digits using modified chaotic neural networks(MCNN). The chaotic neural networks(CNN) is modified to be a useful network for solving complex pattern problems by enforcing dynamic characteristics and learning process. Since the MCNN has the characteristics of highly nonlinear dynamics in structure and neuron itself, it can be an appropriate network for the robust classification of complex handwritten digits. Digit identification starts with extraction of features from the raw digit images and then recognizes digits using the MCNN based classifier. The performance of the MCNN classifier is evaluated on the numeral database of Concordia University, Montreal, Canada. For the relative comparison of recognition performance, the MCNN classifier is compared with the recurrent neural networks(RNN) classifier. Experimental results show that the classification rate is 98.0%. It indicates that the MCNN classifier outperforms the RNN classifier as well as other classifiers that have been reported on the same database.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.33B no.2
• /
• pp.159-167
• /
• 1996

In this paper, a new competitive learning algorithm called dynamic competitive learning (DCL) is presented. DCL is a supervised learning mehtod that dynamically generates output neuraons and nitializes weight vectors from training patterns. It introduces a new parameter called LOG (limit of garde) to decide whether or not an output neuron is created. In other words, if there exist some neurons in the province of LOG that classify the input vector correctly, then DCL adjusts the weight vector for the neuraon which has the minimum grade. Otherwise, it produces a new output neuron using the given input vector. It is largely learning is not limited only to the winner and the output neurons are dynamically generated int he trining process. In addition, the proposed algorithm has a small number of parameters. Which are easy to be determined and applied to the real problems. Experimental results for patterns recognition of remote sensing data and handwritten numeral data indicate the superiority of dCL in comparison to the conventional competitive learning methods.

• Journal of Electrical Engineering and information Science
• /
• v.1 no.1
• /
• pp.108-117
• /
• 1996

In this paper, we propose a new type of recurrent neural network architecture in which each output unit is connected with itself and fully-connected with other output units and all hidden units. The proposed recurrent network differs from Jordan's and Elman's recurrent networks in view of functions and architectures because it was originally extended from the multilayer feedforward neural network for improving the discrimination and generalization power. We also prove the convergence property of learning algorithm of the proposed recurrent neural network and analyze the performance of the proposed recurrent neural network by performing recognition experiments with the totally unconstrained handwritten numeral database of Concordia University of Canada. Experimental results confirmed that the proposed recurrent neural network improves the discrimination and generalization power in recognizing spatial patterns.

• The Transactions of the Korea Information Processing Society
• /
• v.2 no.6
• /
• pp.995-1001
• /
• 1995

The structure of a typical pattern recognition consists a pre-processing, a feature extraction(algorithm) and classification or recognition. In classification, when widely varying patterns exist in same category, we need the clustering which organize the similar patterns. Clustering algorithm is two approaches. Firs, statistical approaches which are k-means, ISODATA algorithm. Second, neural network approach which is T. Kohonen's LVQ(Learning Vector Quantization). Nikhil R. Palet al proposed the GLVQ(Generalized LVQ, 1993). This paper suggest the efficient feature extraction methods of handwritten numerals in GLVQ clustering network. We use the handwritten numeral data from 21's authors(ie, 200 patterns) and compare the proportion of misclassified patterns for each feature extraction methods. As results, when we use the projection combination method, the classification ratio is 98.5%.

• Journal of KIISE:Software and Applications
• /
• v.26 no.1
• /
• pp.93-93
• /
• 1999

Researches on digit recognition have been conducted actively for a long time because the classes to recognize are much fewer than other character sets and because it is very likely thatthe digit recognition can be applied to many problems in real world, The recent studies on designingrecognition system with high performance are in progress with two different aspects. One is toconstruct a recognizer using several features at the same time, and the other is to use severalrecognizers. In this paper, we propose a multistage combination method to recognize the unconstrainedhandwritten numerals. The method is a two-stage combination method which uses multiplecombination methods at the same time unlike the existing methods with only one combination method.The recognizers are first combined by several combination methods of different classes simultaneously,and then the results of them are combined by another combination method to generate a final result.Five recognizers and eight combination methods are used in the proposed system. The experimentalresults showed that the recognition rates on CENPARMI and CEDAR data were 97.75% and 98.6%,respectively and the recognition performance could be improved as the process passed through stages,We could get the best performance by combining the combination methods of different classes, whichmeans there are a complementary relation among them, The proposed method can be considered asan extended version of the existing combination methods.