• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2000년도 ITC-CSCC -2
• /
• pp.1041-1044
• /
• 2000

The enhancement to the back-propagation algorithm presented in this paper has resulted from the need to extract sparsely connected networks from networks employing product terms. The enhancement works in conjunction with the back-propagation weight update process, so that the actions of weight zeroing and weight stimulation enhance each other. It is shown that the error measure, can also be interpreted as rate of weight change (as opposed to ${\Delta}W_{ij}$), and consequently used to determine when weights have reached a stable state. Weights judged to be stable are then compared to a zero weight threshold. Should they fall below this threshold, then the weight in question is zeroed. Simulation of such a system is shown to return improved learning rates and reduce network connection requirements, with respect to the optimal network solution, trained using the normal back-propagation algorithm for Multi-Layer Perceptron (MLP), Higher Order Neural Network (HONN) and Sigma-Pi networks.

• 대한전자공학회논문지SP
• /
• 제44권1호
• /
• pp.40-48
• /
• 2007

이 논문은 다중 스케일 베이지안 관점에서 다층 퍼셉트론과 마코프 랜덤 필드를 사용한 새로운 결 분할 방법을 제안한다. 다층 퍼셉트론의 출력은 사후 확률을 모델링하므로 본 논문에서는 다중 스케일 웨이블릿 계수들을 다층 퍼셉트론의 입력으로 사용한다. 다층 퍼셉트론으로부터 구한 사후 확률과 MAP (maximum a posterior) 분류를 이용하여 각 스케일에서 결 분류를 수행한다. 또한 가장 섬세한 스케일에서 더 개선된 분할 결과를 얻기 위하여 모든 스케일에서 MAP 분류 결과들을 거친 스케일에서 섬세한 스케일까지 차례로 융합한다. 이런 과정은 한 스케일에서의 분류 정보와 그 인접한 보다 거친 스케일에서 얻어지는 문맥과 관련한 연역적 정보를 이용하여 MAP 분류를 행함으로써 이루어진다. 이 융합 과정에서, MRF (Markov random fields) 사전 모델이 평탄화 제한자로서 동작하고, 깁스 샘플러 (Gibbs sampler)는 MAP 분류기로서 동작한다. 제안한 분할 방법은 HMT (Hidden Markov Trees) 모델과 HMTseg 알고리즘을 이용한 결 분할 방법보다 더 좋은 성능을 보인다.

• International Journal of Control, Automation, and Systems
• /
• 제2권4호
• /
• pp.423-434
• /
• 2004

In this paper, we introduce a new topology of Self-Organizing Polynomial Neural Networks (SOPNN) based on genetically optimized Multi-Layer Perceptron (MLP) and discuss its comprehensive design methodology involving mechanisms of genetic optimization. Let us recall that the design of the 'conventional' SOPNN uses the extended Group Method of Data Handling (GMDH) technique to exploit polynomials as well as to consider a fixed number of input nodes at polynomial neurons (or nodes) located in each layer. However, this design process does not guarantee that the conventional SOPNN generated through learning results in optimal network architecture. The design procedure applied in the construction of each layer of the SOPNN deals with its structural optimization involving the selection of preferred nodes (or PNs) with specific local characteristics (such as the number of input variables, the order of the polynomials, and input variables) and addresses specific aspects of parametric optimization. An aggregate performance index with a weighting factor is proposed in order to achieve a sound balance between the approximation and generalization (predictive) abilities of the model. To evaluate the performance of the GA-based SOPNN, the model is experimented using pH neutralization process data as well as sewage treatment process data. A comparative analysis indicates that the proposed SOPNN is the model having higher accuracy as well as more superb predictive capability than other intelligent models presented previously.reviously.

• 한국인터넷방송통신학회논문지
• /
• 제22권6호
• /
• pp.173-178
• /
• 2022

최근, 소셜 네트워크 서비스에서 딥러닝을 활용한 추천시스템이 활발하게 연구되고 있다. 하지만 딥러닝을 이용한 추천시스템의 경우 콜드스타트 문제와 복잡한 연산으로 인해 늘어난 학습시간이 단점으로 존재한다. 본 논문에서는 사용자의 메타데이터를 활용하여 사용자 맞춤형 운동 루틴 추천 알고리즘을 제안한다. 본 논문에서 제안하는 알고리즘은 메타데이터(사용자의 키, 몸무게, 성, 등)를 입력받아 설계된 모델에 적용한다. 본 논문에서 제안한 운동 추천시스템 모델은 matrix factorization 알고리즘과 multi-layer perceptron을 활용한 neural collaborative filtering(NCF) 알고리즘을 기반으로 설계된다. 제안된 모델은 사용자 메타데이터와 운동 정보를 입력받아 학습을 진행한다. 학습이 완료된 모델은 특정 운동이 입력되면 사용자에게 추천도를 제공한다. 실험 결과에서 제안하는 운동 추천시스템 모델이 기존 NCF 모델보다 10% 추천 성능 향상과 50% 학습 시간 단축을 보였다.

• 대한조선학회논문집
• /
• 제52권1호
• /
• pp.88-95
• /
• 2015

For the frequency-domain spectral fatigue analysis, the probability density function of stress range needs to be estimated based on the stress spectrum only, which is a frequency domain representation of the response. The probability distribution of the stress range of the narrow-band spectrum is known to follow the Rayleigh distribution, however the PDF of wide-band spectrum is difficult to define with clarity due to the complicated fluctuation pattern of spectrum. In this paper, efforts have been made to figure out the links between the probability density function of stress range to the structural response of wide-band Gaussian random process. An artificial neural network scheme, known as one of the most powerful system identification methods, was used to identify the multivariate functional relationship between the idealized wide-band spectrums and resulting probability density functions. To achieve this, the spectrums were idealized as a superposition of two triangles with arbitrary location, height and width, targeting to comprise wide-band spectrum, and the probability density functions were represented by the linear combination of equally spaced Gaussian basis functions. To train the network under supervision, varieties of different wide-band spectrums were assumed and the converged probability density function of the stress range was derived using the rainflow counting method and all these data sets were fed into the three layer perceptron model. This nonlinear least square problem was solved using Levenberg-Marquardt algorithm with regularization term included. It was proven that the network trained using the given data set could reproduce the probability density function of arbitrary wide-band spectrum of two triangles with great success.

• 한국데이타베이스학회:학술대회논문집
• /
• 한국데이타베이스학회 1999년도 춘계공동학술대회: 지식경영과 지식공학
• /
• pp.261-270
• /
• 1999

Sintering transforms powdered ore into lumped ore so that the latter can be used in a blast furnace. The powdered ore combined with coke and other materials is loaded into a container and moved along by a pallet while the ignited coke bums. The speed by which the pallet moves determines how much sintering takes place. Since the process is complicated and lacks an accurate mathematical model, human operators manually control the speed by monitoring various factors in the plant. In this paper, we propose a neural network-based pallet speed controller which copies human operator knowledge. Actual process data were collected from a sintering plant fer eight months and preprocessed to remove noisy and inconsistent data. A multilayer perceptron was trained using a back-propagation learning algorithm. In on-line testing at the sinter plant, the proposed model reliably controlled pallet speed during normal operation without the help of human operators. Moreover, the duality and productivity was as good as with human operators.

• 한국지능정보시스템학회:학술대회논문집
• /
• 한국지능정보시스템학회 1999년도 춘계공동학술대회-지식경영과 지식공학
• /
• pp.261-270
• /
• 1999

Sintering transforms powdered ore into lumped ore so that the latter can be used in a blast furnace. The powdered or combined with coke and other materials is loaded into a container and moved along by a pallet while the ignited coke burns. The speed by which the pallet moves determines how much sintering takes place. Since the process is complicated and lacks an accurate mathematical model, human operators manually control the speed by monitoring various factors in the plant. In this paper, we propose a neural network-based pallet speed controller which copies human operator knowledge. Actual process data were collected from a sintering plant for eight months and preprocessed to remove noisy and inconsistent data. A multilayer perceptron was trained using a back-propagation learning algorithm. In on-line testing at the sinter plant, the proposed model reliably controlled pallet speed during normal operation without the help of human operators. Moreover, the quality and productivity was as good as with human operators.

• 한국통신학회논문지
• /
• 제16권1호
• /
• pp.13-22
• /
• 1991

본 논문에서는 단층 구조 퍼셉트론 신경 회로망 모델을 사용하여 입력 데이타에서 발생한 2비트의 에러를 검증 및 수정하는 회로를 설계하였다. 순회 해밍 부호를 응용하여 6비트의 데이타 비트와 8비트의 체크 비트를 갖는(14, 6) 블럭 부호를 사용하였다. 모든 회로들은 이중 배선 CMOS 2$\mu$m 설계 규칙에 따라 설계되었다. 회로를 시뮬레이션한 결과. 2비트 에러 검증 및 수정 회로는 최대 67MHz의 입력주파수에서 동작함을 확인하였다.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2001년도 ICCAS
• /
• pp.172.6-172
• /
• 2001

In recent years, many attempts have been made to predict the behavior of bonds, currencies, stock, or other economic markets. Most previous experiments used multilayer perceptrons(MLP) for stock market forecasting, The Kospi 200 Index is modeled using different neural networks and fuzzy system predictions. In this paper, a multilayer perceptron architecture, a dynamic polynomial neural network(DPNN) and a fuzzy system are used to predict the Kospi 200 index. The results of prediction is compared with the root mean squared error(RMSE) and the scatter plot. The results show that the fuzzy system is performing slightly better than DPNN and MLP. We can develop the desired fuzzy system by learning methods ...

• Journal of Electrical Engineering and Technology
• /
• 제5권4호
• /
• pp.666-671
• /
• 2010

Multi-layer perceptron neural networks have been constructed to classify four types of defects in steam generator tubes. Three features are extracted from the signals of the eddy current testing method. These include maximum impedance, phase angle at the point of maximum impedance, and an angle between the point of maximum impedance and the point of half the maximum impedance. Two hundred sets of these features are used for training and assessing the networks. Two approaches are involved to train the networks and to classify the defect type. One is the conjugate gradient method and the other is the Broydon-Fletcher-Goldfarb-Shanno method which is recognized as the most popular algorithm of quasi-Newton methods. It is found from the computation results that the training time of the Broydon-Fletcher-Goldfarb-Shanno method is much faster than that of the conjugate gradient method in most cases. On the other hand, no significant difference of the classification performance between the two methods is observed.