Browse > Article

Effect of Training Sequence Control in On-line Learning for Multilayer Perceptron  

Lee, Jae-Young (경북대학교 컴퓨터과학과)
Kim, Hwang-Soo (경북대학교 컴퓨터학부)
Publication Information
Journal of KIISE:Software and Applications / v.37, no.7, 2010 , pp. 491-502 More about this Journal
Abstract
When human beings acquire and develop knowledge through education, their prior knowledge influences the next learning process. As this is a fact that should be considered in machine learning, we need to examine the effects of controlling the order of training sequence on machine learning. In this research, the role of the supervisor is extended to control the order of training samples, in addition to just instructing the target values for classification problems. The supervisor sequences the training examples categorized by SOM to the learning model which in this case is MLP. The proposed method is distinguished in that it selects the most instructive example from categories formed by SOM to assist the learning progress, while others use SOM only as a preprocessing method for training samples. The result shows that the method is effective in terms of the number of samples used and time taken in training.
Keywords
Training Sequence; MLP; SOM; Categorization; Supervisor; Classification;
Citations & Related Records
연도 인용수 순위
  • Reference
1 MacKay, David, Information Theory, Inference and Learning Algorithms, Cambridge University Press. 2003.
2 Bernard, I., "Multilayer perceptron and uppercase handwritten characters recognition," Proc. of the Second International Conference on Document Analysis and Recognition, pp.935-938, Oct. 1993.
3 Markovic, M.Z., Milosavljevic, M.M., Samcovic, A.B., "A performance analysis of the multilayer perceptron in limited training data set conditions," Proc. 13th International Conference on Digital Signal Processing, vol.2, pp.719-722, Jul. 1997.
4 Corinna Cortes, Vladimir Vapnik, "Support-Vector Networks," Machine Leaming, vol.20, pp.273-297, 1995.
5 Xiaoguang Lu, Yunhong Wang, Jain, A.K., "Combining classifiers for face recognition," Proc. of International Conference on Multimedia and Expo, vol.3, pp.III-13-16, Jul. 2003.
6 Rui Xu; Wunsch, D., "Survey of clustering algorithms," IEEE Transactions on Neural Networks, vol.16, no.3, pp.645-678, May. 2005.   DOI   ScienceOn
7 Kohonen, T., "The self-organizing map," Proc. of the IEEE, vol.78, no.9, pp.1464-1480, Sept. 1990.   DOI   ScienceOn
8 Najet Arous, Noureddine Ellouze, "Cooperative supervised and unsupervised learning algorithm for phoneme recognition in continuous speech and speaker-independent context," Neurocomputing, vol.51, pp.225-235, Apr. 2003.   DOI   ScienceOn
9 Hsieh, K.-R., Chen, W.-T., "A neural network model which combines unsupervised and supervised learning," IEEE Transactions on Neural Networks, vol.4, no.2, pp.357-360, Mar. 1993.   DOI   ScienceOn
10 Mingkun Li, Ishwar K.Sethi, "Confidence-Based Active Learning," IEEE Transaction on Pattern Analysis and Machine Intelligence, vol.28, no.8, pp.1251-1261, Aug. 2006.   DOI
11 Burr Settles, "Active Learning Literature Survey," Computer Sciences Technical Report 1648, University of Wisconsin-Madison. 2009.
12 Olsson, Fredrik, "A literature survey of active machine learning in the context of natural language processing," SICS Technical Report T2009:06. Swedish Institute of Computer Science, Kista, Sweden. 2009.
13 UCI Machine Learning Repository, http://archive.ics.uci.edu/ml/
14 Simon Haykin, Neural Networks:A Comprehensive Foundation, 2nd Ed., Prentice Hall, 1999.