한국정보과학회논문지:소프트웨어및응용 (Journal of KIISE:Software and Applications)

한국정보과학회 (Korean Institute of Information Scientists and Engineers)
권호 표지

은닉지식 추출을 이용한 신경망회로망 정제

Neural Network Refinement using Hidden Knowledge Extraction

  • 발행 : 2000.11.01
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

신경회로망 구조의 정제(精製)는 회로망의 일반화능력이나 효율성의 관점에서 중요한 문제이다. 본 논문에서는 feed-forward neural networks로부터 은닉지식을 추출하는 방법을 사용하여 네트워크 재구성을 통한 정제방법을 제안한다. 먼저, 효율적인 if-then rule 추출방법을 제시하고 그 추출된 룰들을 사용하여 룰기반 네트워크로 변환하는 과정을 보여준다. 생성된 룰기반 네트워크 fully connected network에 비하여 상당히 축소된 연결 복잡도를 가지게 되며 일반적으로 더 우수한 일반화능력을 가지게 된다. 본 연구는 도메인 지식이 없이 데이타만 사용하여 어떻게 정제된 룰기반 신경망회로를 생성하고 있는가를 보여준다. 도메인 데이타들에 대한 실험결과도 제시하였다.

키워드

참고문헌

  1. Mozer, M. and Smolensky, P., 'Skeletonization: A Technique for Trimming the Fat from a Network via Relevance Assessment, Advances in Neural Information Processing System 1, (editor: Touretzky, D.S.) 1989
  2. Krogh, A. and Hertz, J.A, A Simple Weight Decay Can Improve Generalization, Advances in Neural Information Processing Systems, Vol. 4, pp950-957, 1992
  3. Kruschke, J.K., and Movellan, J.R., Benefits of Gain: Speeded Learning and Minimal Hidden Layers in Backpropagation Networks, IEEE Transactions on. Systems, Man and Cybernetics, 21(1), January, 1991 https://doi.org/10.1109/21.101159
  4. Fu, LiMin and Kim, Hyeoncheol, Abstraction and Representation of Hidden Knowledge in an Adapted Neural Network, Technical Report, CISE, University of Florida, October 1994
  5. Kim, Hyeoncheol and Fu, LiMin, Generalization and Fault Tolerance in Rule-based Neural Network, In Proceedings of IEEE International Conference on Neural Networks, volume 5. pp. 1550-1555, 1994 https://doi.org/10.1109/ICNN.1994.374386
  6. Opitz, D.W., and Shavlik, J.W., Using Genetic Search to Refine Knowledge-Based Neural Networks, Machine Learning: Proceedings of the 11th International Conference, 1994
  7. Towell, G.G. Shavlik, J.W. and Noordewier, M.O., Refinement of Approximate Domain Theories by Knowledge-based Neural Networks, Proceedings AAAI-90, pp861-866, 1990
  8. Fu, LiMin, Knowledge-based connectionism for revising domain theories. IEEE Transactions on Systems, Man, and Cybernetics, 23(1), pp. 173-182. 1993 https://doi.org/10.1109/21.214775
  9. Fu, LiMin, Neural Networks in Computer Intelligence. chapter 14, McGraw Hill, Inc., New York 1994
  10. Towell, G.G and Shavlik, J,W., Knowledge-Based Artificial Neural Networks, Artificial Intelligence, vol. 70, pp119-165. 1994 https://doi.org/10.1016/0004-3702(94)90105-8
  11. Fu, LiMin, Rule generation from neural networks. IEEE Transactions on Systems, Man, and Cybernetics, 24(8), pp. 1114- 1124. 1994 https://doi.org/10.1109/21.299696
  12. Gallant, S.I. Connectionist Expert Systems. Communications of the ACM, 31(2), pp. 152-169. 1988 https://doi.org/10.1145/42372.42377
  13. Setino, Rudy and Liu, Huan, Understanding neural networks via rule extraction. In Proceedings of the 14th International Joint Conference on Artificial Intelligence, vol.1, pp. 480-485, 1995
  14. Setino, Rudy and Liu, Huan, Symbolic Representation of Neural Networks, Computer, pp. 71-77, 1996 https://doi.org/10.1109/2.485895
  15. Taha, I.A. and Ghosh, J., Symbolic Interpretation of Artificial Neural Networks, IEEE Transactions on Knowledge and Data Engineering, vol. 11, no. 3. 1999 https://doi.org/10.1109/69.774103