• 정보처리학회논문지:소프트웨어 및 데이터공학
• /
• 제6권4호
• /
• pp.203-210
• /
• 2017

본 논문에서는 이미지 캡션 생성과 모델 전이에 효과적인 심층 신경망 모델을 제시한다. 본 모델은 멀티 모달 순환 신경망 모델의 하나로서, 이미지로부터 시각 정보를 추출하는 컨볼루션 신경망 층, 각 단어를 저차원의 특징으로 변환하는 임베딩 층, 캡션 문장 구조를 학습하는 순환 신경망 층, 시각 정보와 언어 정보를 결합하는 멀티 모달 층 등 총 5 개의 계층들로 구성된다. 특히 본 모델에서는 시퀀스 패턴 학습과 모델 전이에 우수한 LSTM 유닛을 이용하여 순환 신경망 층을 구성하며, 캡션 문장 생성을 위한 매 순환 단계마다 이미지의 시각 정보를 이용할 수 있도록 컨볼루션 신경망 층의 출력을 순환 신경망 층의 초기 상태뿐만 아니라 멀티 모달 층의 입력에도 연결하는 구조를 가진다. Flickr8k, Flickr30k, MSCOCO 등의 공개 데이터 집합들을 이용한 다양한 비교 실험들을 통해, 캡션의 정확도와 모델 전이의 효과 면에서 본 논문에서 제시한 멀티 모달 순환 신경망 모델의 높은 성능을 확인할 수 있었다.

• 전자공학회논문지B
• /
• 제31B권7호
• /
• pp.179-189
• /
• 1994

A two-phase neural network finds exact feasible solutions for a constrained optimization programming problem. The time-varying programming neural network is a modified steepest-gradient algorithm which solves time-varying optimization problems. In this paper, we propose a time-varying two-phase optimization neural network which incorporates the merits of the two-phase neural network and the time-varying neural network. The proposed algorithm is applied to system identification and function approximation using a multi-layer perceptron. Particularly training of a multi-layer perceptrion is regarded as a time-varying optimization problem. Our algorithm can also be applied to the case where the weights are constrained. Simulation results prove the proposed algorithm is efficient for solving various optimization problems.

• 정보학연구
• /
• 제8권1호
• /
• pp.51-56
• /
• 2005

The Back propagation algorithm is a very effective supervised training method for multi-layer feed forward neural networks. This paper studies the decision boundary formation based on the Back propagation algorithm. The discriminating powers of several neural network topology are also investigated against five manually created data sets. It is found that neural networks with multiple hidden layer perform better than single hidden layer.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2001년도 ICCAS
• /
• pp.88.4-88
• /
• 2001

In this paper, we propose a solver for differential equations, using a multi-layer neural network. The multi-layer neural network is a transformer function originally where the function is differential and the explicit representation has been developed. The learning determines the response of neural networks; however, the response is not equal to the output values. The differential relations are also the response. The differential conditions can be also set as teaching data; therefore, there is a possibility to reach a new solver for the differential equations. Since it is unknown how to define the input data for the neural network solver during long terms, we could not derive the expressions. Recently, the analogue type neural network is known and it transforms any vector to another The "any" must be...

• Structural Engineering and Mechanics
• /
• 제13권2호
• /
• pp.187-209
• /
• 2002

The infrastructure system in the United States has been aging faster than the resource available to restore them. Therefore decision for allocating the resources is based in part on the condition of the structural system. This paper proposes to use neural network to predict the overall rating of the structural system because of the successful applications of neural network to other fields which require a "symptom-diagnostic" type relationship. The goal of this paper is to illustrate the potential of using neural network in civil engineering applications and, particularly, in bridge evaluations. Data collected by the Tennessee Department of Transportation were used as "test bed" for the study. Multi-layer feed forward networks were developed using the Levenberg-Marquardt training algorithm. All the neural networks consisted of at least one hidden layer of neurons. Hyperbolic tangent transfer functions were used in the first hidden layer and log-sigmoid transfer functions were used in the subsequent hidden and output layers. The best performing neural network consisted of three hidden layers. This network contained three neurons in the first hidden layer, two neurons in the second hidden layer and one neuron in the third hidden layer. The neural network performed well based on a target error of 10%. The results of this study indicate that the potential for using neural networks for the evaluation of infrastructure systems is very good.

• 전자공학회논문지B
• /
• 제31B권9호
• /
• pp.159-165
• /
• 1994

In this paper, we propose a multi-layer associative neural network structure suitable for hardware implementaion with the function of performance refinement and improved robutst capability. Unlike other methods which reduce network complexity by putting restrictions on synaptic weithts, we are imposing a requirement of hidden layer neurons for the function. The proposed network has synaptic weights obtainted by Hebbian rule between adjacent layer's memory patterns such as Kosko's BAM. This network can be extended to arbitary multi-layer network trainable with Genetic algorithm for getting hidden layer memory patterns starting with initial random binary patterns. Learning is done to minimize newly defined network error. The newly defined error is composed of the errors at input, hidden, and output layers. After learning, we have bidirectional recall process for performance improvement of the network with one-shot recall. Experimental results carried out on pattern recognition problems demonstrate its performace according to the parameter which represets relative significance of the hidden layer error over the sum of input and output layer errors, show that the proposed model has much better performance than that of Kosko's bidirectional associative memory (BAM), and show the performance increment due to the bidirectionality in recall process.

• 전기학회논문지
• /
• 제67권11호
• /
• pp.1506-1511
• /
• 2018

This study presents a human sensibility evaluation method using neural network and multiple-template method on electroencephalogram(EEG). We used a multi-layer perceptron type neural network as the sensibility classifier using EEG signal. For our research objective, 10-channel EEG signals are collected from the healthy subjects. After the necessary preprocessing is performed on the acquired signals, the various EEG parameters are estimated and their discriminating performance is evaluated in terms of pattern classification capability. In our study, Linear Prediction(LP) coefficients are utilized as the feature parameters extracting the characteristics of EEG signal, and a multi-layer neural network is used for indicating the degree of human sensibility. Also, the estimation for human comfortableness is performed by varying temperature and humidity environment factors and our results showed that the proposed scheme achieved good performances for evaluation of human sensibility.

• 한국컴퓨터정보학회논문지
• /
• 제4권1호
• /
• pp.62-67
• /
• 1999

신경회로망은 입력층. 출력층, 하나 이상의 은닉층으로 구성된 네드워크이다. 학습능력과 근사화 능력으로 말미암아 신경회로망은 패턴인식 및 시스템제어분야에서 많이 사용되고 있다. Elman 신경회로망은 J. Elman에 의해 제안되었으며, recurrent network의 형태로 구성되어 있다. Elman 신경회로망은 기존의 신경회로망에 context층을 새로 추가하여, 은닉층의 출력을 context층의 입력으로 피드백 하는 구조로 되어 있다. 본 논문에서는 Elman 신경회로망을 변형한 형태로, 은닉층 뿐 만 아니라 출력층의 출력도 context층으로 피드백 하는 새로운 형태의 Elman 신경회로망을 제안한다. 제안한 방식의 유용성을 확인하기 위해 X-Y cartesian에 적용하여 시뮬레이션한 결과는 기존의 신경회로망 및 Elman 신경회로망 보다 우수한 방식임을 보여 주고 있다.

• 한국환경과학회지
• /
• 제11권3호
• /
• pp.201-207
• /
• 2002

This study was carried out to evaluate the artificial neural network algorithm for water quality forecasting in Chungju lake, north Chungcheong province. Multi-layer perceptron(MLP) was used to train artificial neural networks. MLP was composed of one input layer, two hidden layers and one output layer. Transfer functions of the hidden layer were sigmoid and linear function. The number of node in the hidden layer was decided by trial and error method. It showed that appropriate node number in the hidden layer is 10 for pH training, 15 for DO and BOD, respectively. Reliability index was used to verify for the forecasting power. Considering some outlying data, artificial neural network fitted well between actual water quality data and computed data by artificial neural networks.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2002년도 ICCAS
• /
• pp.89.4-89
• /
• 2002

$\textbullet$ Field Programmable Gate Array $\textbullet$ flexible hardware $\textbullet$ neural network $\textbullet$ determinism learning $\textbullet$ multi-valued logic $\textbullet$ disjunctive normal form $\textbullet$ multi-dimensional exclusive OR