• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 1990년도 한국자동제어학술회의논문집(국내학술편); KOEX, Seoul; 26-27 Oct. 1990
• /
• pp.234-239
• /
• 1990

A neural controller for process control was proposed that combines a simple feedback controller with a neural network. This control was applied to distillation control. The feedback error learning technique was used for on-line learning. Important characteristics on neural controller were analyzed. The proposed neural controller can cope well with strong interactions, significant time delays, sudden changes in process dynamics without any prior knowledge of the process. It was shown that the neural controller has good features such as fault tolerance, interpolation effect and random learning capability

• Journal of Multimedia Information System
• /
• 제9권1호
• /
• pp.21-32
• /
• 2022

Early-stage diagnosis of Alzheimer's Disease (AD) from Cognitively Normal (CN) patients is crucial because treatment at an early stage of AD can prevent further progress in the AD's severity in the future. Recently, computer-aided diagnosis using magnetic resonance image (MRI) has shown better performance in the classification of AD. However, these methods use a traditional machine learning algorithm that requires supervision and uses a combination of many complicated processes. In recent research, the performance of deep neural networks has outperformed the traditional machine learning algorithms. The ability to learn from the data and extract features on its own makes the neural networks less prone to errors. In this paper, a dense neural network is designed for binary classification of Alzheimer's disease. To create a classifier with better results, we studied result of different activation functions in the prediction. We obtained results from 5-folds validations with combinations of different activation functions and compared with each other, and the one with the best validation score is used to classify the test data. In this experiment, features used to train the model are obtained from the ADNI database after processing them using FreeSurfer software. For 5-folds validation, two groups: AD and CN are classified. The proposed DNN obtained better accuracy than the traditional machine learning algorithms and the compared previous studies for AD vs. CN, AD vs. Mild Cognitive Impairment (MCI), and MCI vs. CN classifications, respectively. This neural network is robust and better.

• 대한전기학회논문지:전력기술부문A
• /
• 제48권10호
• /
• pp.1231-1238
• /
• 1999

This paper presents an approach for the optimal heating load Identification using Diagonal Recurrent Neural Networks(DRNN). In this paper, the DRNN captures the dynamic nature of a system and since it is not fully connected, training is much faster than a fully connected recurrent neural network. The architecture of DRNN is a modified model of the fully connected recurrent neural network with one hidden layer. The hidden layer is comprised of self-recurrent neurons, each feeding its output only into itself. In this study, A dynamic backpropagation (DBP) with delta-bar-delta learning method is used to train an optimal heating load identifier. Delta-bar-delta learning method is an empirical method to adapt the learning rate gradually during the training period in order to improve accuracy in a short time. The simulation results based on experimental data show that the proposed model is superior to the other methods in most cases, in regard of not only learning speed but also identification accuracy.

• 산업기술연구
• /
• 제20권B호
• /
• pp.201-206
• /
• 2000

A priori information of object is needed to control in some well known control methods. But we can't always know a priori information of object in real world. In this paper, the inverted pendulum is simulated as a control task with the goal of learning to balance the pendulum with no a priori information using neural network controller. In contrast to other applications of neural networks to the inverted pendulum task, the performance feedback is unavailable on each training step, appearing only as a failure signal when the pendulum falls or reaches the bound of track. To solve this task, the delayed performance evaluation and the learning of nonlinear of nonlinear functions must be dealt. Reinforcement learning method is used for those issues.

• 한국컴퓨터정보학회논문지
• /
• 제23권7호
• /
• pp.81-90
• /
• 2018

In this paper, reducing lense Vignetting effect and adaptive learning rate method are proposed to complement Scribner's neural network for nuc algorithm which is the effective algorithm in statistic SBNUC algorithm. Proposed reducing vignetting effect method is updated weight and bias each differently using different cost function. Proposed adaptive learning rate for updating weight and bias is using sobel edge detection method, which has good result for boundary condition of image. The ordinary statistic SBNUC algorithm has problem to compensate lense vignetting effect, because statistic algorithm is updated weight and bias by using gradient descent method, so it should not be effective for global weight problem same like, lense vignetting effect. We employ the proposed methods to Scribner's neural network method(NNM) and Torres's reducing ghosting correction for neural network nuc algorithm(improved NNM), and apply it to real-infrared detector image stream. The result of proposed algorithm shows that it has 10dB higher PSNR and 1.5 times faster convergence speed then the improved NNM Algorithm.

• 한국컴퓨터정보학회논문지
• /
• 제8권3호
• /
• pp.113-123
• /
• 2003

본 논문에서는 주식의 종가, 거래량 기술적 지표인 MACD(Moving Average Convergence Divergence) 값과 투자 심리선값을 입력 패턴으로 사용하여 개별 금융지표지수에 대한 매도, 중립 및 매수 시점 예측을 수행하는 신경망 모델이 제안된다. 이 모델은 역전파 알고리즘을 이용한 시계열 예측 기능과 균등다층연산 기능을 갖는다. 학습 데이터의 수가 각 범주들(매도, 중립, 매수)에 균일하게 분포되어 있지 않을 경우 기존의 신경망은 가장 우세한 범주의 예측 정확성만을 향상시키는 문제점을 가지고 있다. 따라서, 본 논문에서는 신경망의 구조, 동작, 학습 알고리즘에 대해 표현한 후 다른 범주의 예측 정확성도 향상시키기 위해 각 범주의 중요성을 이용하여 학습 데이터의 수를 조절하는 균등다층연산 방법을 제안한다. 실험 결과, 균등다층연산 신경망을 이용한 금융지표지수 예측 방법이 기존의 신경망을 이용한 금융지표지수 예측 방법 보다 각 범주에 대해 높은 정확성 비율을 보임을 확인할 수 있었다.

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 2005년도 제36회 하계학술대회 논문집 D
• /
• pp.2681-2683
• /
• 2005

In this paper, we present the structure of fuzzy neural network(FNN) based on wavelet function, and apply this network structure to the identification of nonlinear systems. For adjusting the shape of membership function and the connection weights, the parameter learning method based on the gradient descent scheme is adopted. And an approach that uses adaptive learning rates is driven via a Lyapunov stability analysis to guarantee the fast convergence. Finally, to verify the efficiency of our network structure. we compare the Identification performance of proposed wavelet based fuzzy neural network(WFNN) with those of the FNN, the wavelet fuzzy model(WFM) and the wavelet neural network(WNN) through the computer simulation.

• Journal of Information Processing Systems
• /
• 제18권1호
• /
• pp.12-25
• /
• 2022

In recent years, deep convolutional neural networks have made significant progress in the research of single image super-resolution. However, it is difficult to be applied in practical computing terminals or embedded devices due to a large number of parameters and computational effort. To balance these problems, we propose CSRNet, a lightweight neural network based on channel split residual learning structure, to reconstruct highresolution images from low-resolution images. Lightweight refers to designing a neural network with fewer parameters and a simplified structure for lower memory consumption and faster inference speed. At the same time, it is ensured that the performance of recovering high-resolution images is not degraded. In CSRNet, we reduce the parameters and computation by channel split residual learning. Simultaneously, we propose a double-upsampling network structure to improve the performance of the lightweight super-resolution network and make it easy to train. Finally, we propose a new evaluation metric for the lightweight approaches named 100_FPS. Experiments show that our proposed CSRNet not only speeds up the inference of the neural network and reduces memory consumption, but also performs well on single image super-resolution.

• 실천공학교육논문지
• /
• 제14권3호
• /
• pp.491-498
• /
• 2022

본 논문에서는 비전공자들을 위한 교양과정으로, 기초 순환신경망 과목 커리큘럼을 설계하는데 필수적으로 요구되는 순환신경망 SW 실습 사례를 개발하였다. 개발된 SW 실습 사례는 순환신경망의 동작원리를 이해시키는 데 초점을 두고, 시각화된 전체 동작 과정을 확인할 수 있도록 스프레드시트를 사용하였다. 개발된 순환신경망 실습 사례는 지도학습 방식의 텍스트완성 훈련데이터 생성, 입력층, 은닉층, 상태층(컨텍스트 노드) 그리고 출력층을 차례대로 구현하고, 텍스트 데이터에 대해 순환신경망의 성능을 테스트하는 것으로 구성되었다. 본 논문에서 개발한 순환신경망 실습사례는 다양한 문자 수를 갖는 단어를 자동 완성한다. 제안한 순환신경망 실습사례를 활용하여, 한글 또는 영어 단어를 구성하는 최대 문자 수를 다양하게 확장하여 자동 완성하는 인공지능 SW 실습 사례를 만들 수 있다. 따라서, 본 순환신경망 기초 실습 사례의 활용도가 높다고 할 수 있다.

• International journal of advanced smart convergence
• /
• 제12권2호
• /
• pp.56-66
• /
• 2023

The goal of deep learning is to extract complex features from multidimensional data use the features to create models that connect input and output. Deep learning is a process of learning nonlinear features and functions from complex data, and the user data that is employed to train deep learning models has become the focus of privacy concerns. Companies that collect user's sensitive personal information, such as users' images and voices, own this data for indefinite period of times. Users cannot delete their personal information, and they cannot limit the purposes for which the data is used. The study has designed a deep learning method that employs privacy protection technology that uses distributed collaborative learning so that multiple participants can use neural network models collaboratively without sharing the input datasets. To prevent direct leaks of personal information, participants are not shown the training datasets during the model training process, unlike traditional deep learning so that the personal information in the data can be protected. The study used a method that can selectively share subsets via an optimization algorithm that is based on modified distributed stochastic gradient descent, and the result showed that it was possible to learn with improved learning accuracy while protecting personal information.