Browse > Article

A Efficient Rule Extraction Method Using Hidden Unit Clarification in Trained Neural Network  

Lee, Hurn-joo (고려대학교 정보대학 컴퓨터학과)
Kim, Hyeoncheol (고려대학교 정보대학 컴퓨터학과)
Publication Information
The Journal of Korean Association of Computer Education / v.21, no.1, 2018 , pp. 51-58 More about this Journal
Abstract
Recently artificial neural networks have shown excellent performance in various fields. However, there is a problem that it is difficult for a person to understand what is the knowledge that artificial neural network trained. One of the methods to solve these problems is an algorithm for extracting rules from trained neural network. In this paper, we extracted rules from artificial neural networks using ordered-attribute search(OAS) algorithm, which is one of the methods of extracting rules, and analyzed result to improve extracted rules. As a result, we have found that the distribution of output values of the hidden layer unit affects the accuracy of rules extracted by using OAS algorithm, and it is suggested that efficient rules can be extracted by binarizing hidden layer output values using hidden unit clarification.
Keywords
Artificial Neural Network; Rule Extraction; Hidden Unit Clarification;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Ishikawa, M. (1996). Structural Learning with Forgetting. Neural Networks, vol.9, no.3, 509-521.   DOI
2 L. M. Fu. (1993). Knowledge-based connectionism for revising domain theories. IEEE Transactions on Systems, Man, and Cybernetics 23(1), 173-182.   DOI
3 S. Thrun. (1995). Extracting rules from artificial neural networks with distributed representations. Advances in neural information processing systems, 505-512.
4 I. A. a. J. G. Taha. (1999). Symbolic interpretation of artificial neural network. IEEE Transactions on knowledge and data engineering, 11(3), 448-463.   DOI
5 G. P. C. A. a. F. S. G. Schmitz. (1999). ANN-DT: an algorithm for extraction of decision trees from artificial neural networks. IEEE Transactions on Neural Networks, 10(6), 1392-1401.   DOI
6 G. G. a. j. W. S. Towell. (1993) Extracting refined rules from knowledge-based neural networks. Machine learning, 13(1), 71-101.   DOI
7 R. Setiono, W. K. Leow (2000). FERNN: An algorithm for fast extraction. Applied Intelligence, 12(1-2), 15-25.   DOI
8 T. Hailesilassie. (2016). Rule extraction algorithm for deep neural networks: A review. International Journal of Computer Science and Information Security, 14, 7, p. 376.
9 Andrews, R. Diederich, J. & Tickle, A. B. (1995). Survey and critique of techniques for extracting rules from trained artificial neural networks. Knowledge-Based System, 8(6), 373-389.   DOI
10 L. M. Fu. (1994). Rule Generation from Neural Networks. Systems, Man and Cybernetics, 24(8), 1114-1124.   DOI
11 L. M. Fu. (1991). Rule Learning by Searching on Adapted Nets. AAAI, 590-595.
12 Kim H. (2000). Computationally Efficient Heuristics for If-Then Rule Extraction from Feed-Forward Neural Networks. Lecture Notes in Computer Science, vol 1967, Springer, Berlin, Heidelberg.