• 한국CDE학회논문집
• /
• 제14권6호
• /
• pp.382-389
• /
• 2009

Recently, knowledge management has been required in companies as a tool of competitiveness. Companies have constructed Enterprise Resource Planning(ERP) system in order to manage huge knowledge. But, it is not easy to formalize knowledge in organization. We focused on data mining system by genetic programming(GP). Data mining system by genetic programming can be useful tools to derive and extract the necessary information and knowledge from the huge accumulated data. However when we don't have enough amounts of data to perform the learning process of genetic programming, we have to reduce input parameter(s) or increase number of learning or training data. In this study, an enhanced data mining method combining Genetic Programming with Self organizing map, that reduces the number of input parameters, is suggested. Experiment results through a prototype implementation are also discussed.

• 한국지능시스템학회:학술대회논문집
• /
• 한국퍼지및지능시스템학회 2000년도 춘계학술대회 학술발표 논문집
• /
• pp.114-117
• /
• 2000

In this paper, Fuzzy Self-organizing Neural Networks(FSONN) based on Fuzzy Neural Networks(FNN) is proposed to overcome some problems, such as the conflict between ovefitting and good generation, and low reliability. The proposed FSONN consists of FNN and SONN. Here, FNN is used as the premise part of FSONN and SONN is the consequnt part of FSONN. The FUN plays the preceding role of FSONN. For the fuzzy reasoning and learning method in FNN, Simplified fuzzy reasoning and backpropagation learning rule are utilized. The number of layers and the number of nodes in each layers of SONN that is based on the GMDH method are not predetermined, unlike in the case of the popular multi layer perceptron structure and can be generated. Also the partial descriptions of nodes can use various forms such as linear, modified quadratic, cubic, high-order polynomial and so on. In this paper, the optimal design procedure of the proposed FSONN is shown in each step and performance index related to approximation and generalization capabilities of model is evaluated and also discussed.

• ETRI Journal
• /
• 제44권3호
• /
• pp.438-449
• /
• 2022

This study proposes a dependency grammar-based self-attention multilayered bidirectional long short-term memory (DG-M-Bi-LSTM) model for subject-predicate-object (SPO) tuple recognition from natural language (NL) sentences. To add recent knowledge to the knowledge base autonomously, it is essential to extract knowledge from numerous NL data. Therefore, this study proposes a high-accuracy SPO tuple recognition model that requires a small amount of learning data to extract knowledge from NL sentences. The accuracy of SPO tuple recognition using DG-M-Bi-LSTM is compared with that using NL-based self-attention multilayered bidirectional LSTM, DG-based bidirectional encoder representations from transformers (BERT), and NL-based BERT to evaluate its effectiveness. The DG-M-Bi-LSTM model achieves the best results in terms of recognition accuracy for extracting SPO tuples from NL sentences even if it has fewer deep neural network (DNN) parameters than BERT. In particular, its accuracy is better than that of BERT when the learning data are limited. Additionally, its pretrained DNN parameters can be applied to other domains because it learns the structural relations in NL sentences.

• 전기학회논문지
• /
• 제61권2호
• /
• pp.312-320
• /
• 2012

In this study, we introduce a new design methodology of a granular-oriented self-organizing polynomial neural networks (GoSOPNNs) that is based on multi-layer perceptron with Context-based Polynomial Neurons (CPNs) or Polynomial Neurons (PNs). In contrast to the typical architectures encountered in polynomial neural networks (PNN), our main objective is to develop a methodological design strategy of GoSOPNNs as follows : (a) The 1st layer of the proposed network consists of Context-based Polynomial Neuron (CPN). In here, CPN is fully reflective of the structure encountered in numeric data which are granulated with the aid of Context-based Fuzzy C-Means (C-FCM) clustering method. The context-based clustering supporting the design of information granules is completed in the space of the input data while the build of the clusters is guided by a collection of some predefined fuzzy sets (so-called contexts) defined in the output space. (b) The proposed design procedure being applied at each layer of GoSOPNN leads to the selection of preferred nodes of the network (CPNs or PNs) whose local characteristics (such as the number of contexts, the number of clusters, a collection of the specific subset of input variables, and the order of the polynomial) can be easily adjusted. These options contribute to the flexibility as well as simplicity and compactness of the resulting architecture of the network. For the evaluation of performance of the proposed GoSOPNN network, we describe a detailed characteristic of the proposed model using a well-known learning machine data(Automobile Miles Per Gallon Data, Boston Housing Data, Medical Image System Data).

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 2006년도 제37회 하계학술대회 논문집 D
• /
• pp.1868-1870
• /
• 2006

Neural network is used in many fields of control systems, but input-output patterns of a control system are not easy to be obtained and by using as single feedback neural network controller. And also it is difficult to get a satisfied performance when the changes of rapid load and disturbance are applied. To resolve those problems, this paper proposes a new algorithm which is the neural network controller. The new algorithm uses the neural network instead of activation function to control object at the output node. Therefore, control object is composed of neural network controller unifying activation function, and it supplies the error back propagation path to calculate the error at the output node. As a result, the input-output pattern problem of the controller which is resigned by the simple structure of neural network is solved, and real-time learning can be possible in general back propagation algorithm. Application of the new algorithm of neural network controller gives excellent performance for initial and tracking response and it shows the robust performance for rapid load change and disturbance. The proposed control algorithm is implemented on a high speed DSP, TMS320C32, for the speed of 3-phase induction motor. Enhanced performance is shown in the test of the speed control.

• 한국음향학회지
• /
• 제14권1호
• /
• pp.13-21
• /
• 1995

본 논문에서는 신경망 학습에 의한 영상분류 알고리즘을 개선하였으며, 이것은 입력패턴 생성부와 분류을 위한 역전파 알고리즘에 의한 광역신경망으로 구성된다. 입력패턴을 위한 특징값으로는 자기조직화 형상지도 학습에 의해 얻은 코드북 데이타를 특징벡터로 이용한다. 이것은 입력벡터로서 원영상에 충실하면서 입력 뉴런수를 감소시킨다. 분류기에 사용된 광역망 알고리즘은 가중치와 유니트 오프셋 제어가 가능하도록 역전파 알고리즘에 제어부와 어드레스 메모리부를 삽입하였다. 실험결과 이들 분류기는 학습시 국소최소점에 빠지지 않게 되며, 대규모 신경망을 구현하고자 할 때 망구조를 간단히 할 수 있다. 또한 이것은 동작속도를 크게 개선할 수 있다.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2003년도 ICCAS
• /
• pp.1315-1318
• /
• 2003

In this paper, a neural network based approach using a self-organizing feature map is proposed for the segmentation of X ray images. A number of algorithms based on such approaches as histogram analysis, region growing, edge detection and pixel classification have been proposed for segmentation of general images. However, few approaches have been applied to X ray image segmentation because of blur of the X ray image and vagueness of its edge, which are inherent properties of X ray images. To this end, we develop a new model based on the neural network to detect objects in a given X ray image. The new model utilizes Mumford-Shah functional incorporating with a modified adaptive SOFM. Although Mumford-Shah model is an active contour model not based on the gradient of the image for finding edges in image, it has some limitation to accurately represent object images. To avoid this criticism, we utilize an adaptive self organizing feature map developed earlier by the authors.[1] It's learning rule is derived from Mumford-Shah energy function and the boundary of blurred and vague X ray image. The evolution of the neural network is shown to well segment and represent. To demonstrate the performance of the proposed method, segmentation of an industrial part is solved and the experimental results are discussed in detail.

• 한국정보통신학회:학술대회논문집
• /
• 한국해양정보통신학회 2002년도 춘계종합학술대회
• /
• pp.322-325
• /
• 2002

본 논문에서는 클러스터 해석으로 알려진 고전적인 패턴인식 알고리즘인 KCN(Kohonen Clustering Network)의 문제점을 개선하기 위한 방식을 제안하였다. 제안한 방식은 퍼지시스템을 이용하여 학습하는 동안 자동적으로 이웃 반경의 크기와 학습율을 조절한다. 퍼지 시스템의 입력은 입력 데이터와 연결강도와의 거리와 거리의 변화율을 사용하였으며, 출력은 이웃 반경의 크기와 학습율을 사용하였다. 퍼지 시스템의 제어 규칙은 기존의 코호넨 클러스터링 네트워크를 이용한 시뮬레이션에 의하여 정하였다. 제안한 방식의 유용성을 입증하기 위해 Anderson의 IRIS 데이터를 이용하여, 기존의 코호넨 클러스터링 네트웍을 시뮬레이션한 결과 제안한 방식의 성능의 우수함을 확인하였다.

• 전자공학회논문지B
• /
• 제28B권9호
• /
• pp.739-746
• /
• 1991

This paper develops a modified multilayer perceptron architecture which speeds up learning as well as the net's mapping accuracy. In Phase I, a cluster partitioning algorithm like the Kohonen's self-organizing feature map or the leader clustering algorithm is used as the front end that determines the cluster to which the input data belongs. In Phase II, this cluster selects a subset of the hidden layer nodes that combines the input and outputs nodes into a subnet of the full scale backpropagation network. The proposed net has been applied to two mapping problems, one rather smooth and the other highly nonlinear. Namely, the inverse kinematic problem for a 3-link robot manipulator and the 5-bit parity mapping have been chosen as examples. The results demonstrate the proposed net's superior accuracy and convergence properties over the original backpropagation network or its existing improvement techniques.

• 한국정보과학회논문지:소프트웨어및응용
• /
• 제33권4호
• /
• pp.440-448
• /
• 2006

자기 조직화 신경망 (SOM: Self-Organizing Map)은 자율 학습 신경망으로 사전 지식이 존재하지 않는 자료에 존재하는 구조적 관계성을 보전하는데 이용된다. 자기 조직화 신경망은 벡터 양자화, 조합 최적화, 패턴 인식과 같은 복잡한 문제 해결을 위한 연구에 많이 이용되어 왔다. 이 논문에서는 좀더 효율적인 유전 알고리즘을 얻기 위한 스키마 변환 도구로서 자기 조직화 신경망을 이용하는 새로운 사용법에 대해서 제안한다. 즉, 각 자식해는 탐색 공간에서 좀더 바람직한 모양을 가지는 동질의 인공 신경망으로 변환된다. 이 변환으로 인해 강한 상위(epistasis)를 가지는 유전자들은 염색체 상에서 서로 인접하게 되는 것이다. 실험 결과는 기존 결과에 비해서 주목할만한 성능 개선이 있음을 보여준다.