• 전자공학회논문지B
• /
• 제31B권8호
• /
• pp.211-218
• /
• 1994

In this paper we develope a hybrid learning rule to improve the robustness of multi-layer Perceptions. In most neural networks the activation of a neuron is deternined by a nonlinear transformation of the weighted sum of inputs to the neurons. Investigating the behaviour of activations of hidden layer neurons a new learning algorithm is developed for improved robustness for multi-layer Perceptrons. Unlike other methods which reduce the network complexity by putting restrictions on synaptic weights our method based on error-backpropagation increases the complexity of the underlying proplem by imposing it saturation requirement on hidden layer neurons. We also found that the additional gradient-descent term for the requirement corresponds to the Hebbian rule and our algorithm incorporates the Hebbian learning rule into the error back-propagation rule. Computer simulation demonstrates fast learning convergence as well as improved robustness for classification and hetero-association of patterns.

• 한국통신학회논문지
• /
• 제16권2호
• /
• pp.128-136
• /
• 1991

A neural network of multi layer perception type, learned by error back propagation learning rule, is generally used for the verification or clustering of similar type of patterns. When learning is completed, the network has a constant value of output depending on a pattern. This paper shows that the intensity of neuron's out put can be controlled by a function which intensifies the excitatory interconnection coefficients or the inhibitory one between neurons in output layer and those in hidden layer. In this paper the value of factor in the function to control the output is derived from the know values of the neural network after learning is completed And also this paper show that the amount of an increased neuron's output in output layer by arbitary value of the factor is derived. For the applications increased recognition performance of a pattern than has distortion is introduced and the output of partially damaged neurons are first managed and this paper shows that the reduced recognition performance can be recovered.

• 한국IT서비스학회지
• /
• 제16권4호
• /
• pp.149-160
• /
• 2017

Sentiment analysis is the process of determining whether a piece of document, text or conversation is positive, negative, neural or other emotion. Sentiment analysis has been applied for several real-world applications, such as chatbot. In the last five years, the practical use of the chatbot has been prevailing in many field of industry. In the chatbot applications, to recognize the user emotion, sentiment analysis must be performed in advance in order to understand the intent of speakers. The specific emotion is more than describing positive or negative sentences. In light of this context, we propose deep learning models for conducting multi-class sentiment analysis for identifying speaker's emotion which is categorized to be joy, fear, guilt, sad, shame, disgust, and anger. Thus, we develop convolutional neural network (CNN), long short term memory (LSTM), and multi-layer neural network models, as deep neural networks models, for detecting emotion in a sentence. In addition, word embedding process was also applied in our research. In our experiments, we have found that long short term memory (LSTM) model performs best compared to convolutional neural networks and multi-layer neural networks. Moreover, we also show the practical applicability of the deep learning models to the sentiment analysis for chatbot.

• International Journal of Advanced Culture Technology
• /
• 제6권3호
• /
• pp.142-150
• /
• 2018

This paper describes the algorithm that lowers the dimension, maintains the object recognition and significantly reduces the eigenspace configuration time by combining the edge orientation histogram and principle component analysis. By using the detected object region as a recognition input image, in this paper the object recognition method combined with principle component analysis and the multi-layer network which is one of the intelligent classification was suggested and its performance was evaluated. As a pre-processing algorithm of input object image, this method computes the eigenspace through principle component analysis and expresses the training images with it as a fundamental vector. Each image takes the set of weights for the fundamental vector as a feature vector and it reduces the dimension of image at the same time, and then the object recognition is performed by inputting the multi-layer neural network.

• 대한산업공학회지
• /
• 제24권1호
• /
• pp.23-35
• /
• 1998

This article presents a network flow analysis to form flexible machine cells with minimum intercellular part moves and a neural network model to form part families. The operational sequences and production quantity of the part, and the number of cells and the cell size are taken into considerations for a 0-1 quadratic programming formulation and a network flow based solution procedure is developed. After designing the machine cells, a neural network approach for the integration of part families and the automatic assignment of new parts to the existing cells is proposed. A multi-layer backpropagation network with one hidden layer is used. Experimental results with varying number of neurons in hidden layer to evaluate the role of hidden neurons in the network learning performance are also presented. The comprehensive methodology developed in this article is appropriate for solving large-scale industrial applications without building the knowledge-based expert rule for the cellular manufacturing environment.

• 조명전기설비학회논문지
• /
• 제21권6호
• /
• pp.94-101
• /
• 2007

하드 디스크(Hard Disk) 결함의 표준 패턴 클래스는 6가지로 분류되며, 이는 하드 디스크 생산 공정의 불량 처리 과정에서 중요한 역할을 수행한다. 본 논문에서는 다층 퍼셉트론(Multi-Layer Perceptron)을 이용한 하드 디스크 결함 분포의 패턴 인식 기법을 제시한다. 결함 분포로부터 5가지의 특징들을 추출하고, 이를 이용하여 퍼셉트론의 입력을 구성하였으며, 미리 분류된 표준 패턴 클래스를 이용하여 퍼셉트론의 출력을 구성하였다. 구성된 입출력 데이터들은 오차 역전파(Error Back-Propagation) 알고리듬을 통하여 다층 퍼셉트론의 학습에 사용되었다. 테스트 결과 제시된 신경망은 하드 디스크의 패턴 분류에 만족할 만한 성능을 나타내었다.

• 한국공작기계학회논문집
• /
• 제15권5호
• /
• pp.114-122
• /
• 2006

This paper presents a new control scheme that combines a sliding mode control and a neural network. In the proposed sliding mode control, a continuous control is employed removing the switching phenomena and the equivalent control within the boundary layer is estimated through on-line teaming of the neural network. The performances of the proposed control are compared with off-line neural network and on-line neural sliding mode control by computer simulation. The simulation results show that the proposed control reduces high frequency chattering and tracking error in example of the two link manipulator.

• International Journal of Control, Automation, and Systems
• /
• 제3권2호
• /
• pp.202-210
• /
• 2005

This paper presents a new neural network control for nonlinear bridge systems with earthquake excitation. We design multi-layer neural network controllers with a single hidden layer. The selection of an optimal number of neurons in the hidden layer is an important design step for control performance. To select an optimal number of hidden neurons, we progressively add one hidden neuron and observe the change in a performance measure given by the weighted sum of the system error and the control force. The number of hidden neurons which minimizes the performance measure is selected for implementation. A neural network was trained for mitigating vibrations of bridge systems caused by El Centro earthquake. We applied the proposed control approach to a single-degree-of-freedom (SDOF) and a two-degree-of-freedom (TDOF) bridge system. We assessed the robustness of the control system using randomly generated earthquake excitations which were not used in training the neural network. Our results show that the neural network controller drastically mitigates the effect of the disturbance.

• 전기전자학회논문지
• /
• 제25권4호
• /
• pp.650-663
• /
• 2021

Subsurface topology estimation is an important factor in the geophysical survey. Electrical impedance tomography is one of the popular methods used for subsurface imaging. The EIT inverse problem is highly nonlinear and ill-posed; therefore, reconstructed conductivity distribution suffers from low spatial resolution. The subsurface region can be approximated as piece-wise separate regions with constant conductivity in each region; therefore, the conductivity estimation problem is transformed to estimate the shape and location of the layer boundary interface. Each layer interface boundary is treated as an open boundary that is described using front points. The subsurface domain contains multi-layers with very complex configurations, and, in such situations, conventional methods such as the modified Newton Raphson method fail to provide the desired solution. Therefore, in this work, we have implemented a 7-layer artificial neural network (ANN) as an inverse problem algorithm to estimate the front points that describe the multi-layer interface boundaries. An ANN model consisting of input, output, and five fully connected hidden layers are trained for interlayer boundary reconstruction using training data that consists of pairs of voltage measurements of the subsurface domain with three-layer configuration and the corresponding front points of interface boundaries. The results from the proposed ANN model are compared with the gravitational search algorithm (GSA) for interlayer boundary estimation, and the results show that ANN is successful in estimating the layer boundaries with good accuracy.

• 전자공학회논문지B
• /
• 제28B권12호
• /
• pp.27-37
• /
• 1991

In this paper, the novel PLD (Preceding Layer Driven) MLP (Multi Layer Perceptron) neural network model and its learning algorithm is described. This learning algorithm is different from the conventional. This integer weights and hard limit function are used for synaptic weight values and activation function, respectively. The entire learning process is performed by layer-by-layer method. the number of layers can be varied with difficulty of training data. Since the synaptic weight values are integers, the synapse circuit can be easily implemented with CMOS. PLD MLP neural network was applied to English Characters, arbitrary waveform generation and spiral problem.