• Proceedings of the Korea Water Resources Association Conference
• /
• 2022.05a
• /
• pp.186-186
• /
• 2022

강수 및 침투 등으로 발생하는 지하수위의 변동을 예측하는 것은 지하수 자원의 활용 및 관리에 필수적이다. 지하수위의 변동은 지하수 자원의 활용 및 관리뿐만이 아닌 홍수 발생과 지반의 응력상태 등에 직접적인 영향을 미치기 때문에 정확한 예측이 필요하다. 본 연구는 인공신경망 중 다층퍼셉트론(Multi Layer Perceptron, MLP)을 이용한 지하수위 예측성능 향상을 위해 MLP의 구조 중 Optimizer를 개량하였다. MLP는 입력자료와 출력자료간 최적의 상관관계(가중치 및 편향)를 찾는 Optimizer와 출력되는 값을 결정하는 활성화 함수의 연산을 반복하여 학습한다. 특히 Optimizer는 신경망의 출력값과 관측값의 오차가 최소가 되는 상관관계를 찾는 연산자로써 MLP의 학습 및 예측성능에 직접적인 영향을 미친다. 기존의 Optimizer는 경사하강법(Gradient Descent, GD)을 기반으로 하는 Optimizer를 사용했다. 하지만 기존의 Optimizer는 미분을 이용하여 상관관계를 찾기 때문에 지역탐색 위주로 진행되며 기존에 생성된 상관관계를 저장하는 구조가 없어 지역 최적해로 수렴할 가능성이 있다는 단점이 있다. 본 연구에서는 기존 Optimizer의 단점을 개선하기 위해 지역탐색과 전역탐색을 동시에 고려할 수 있으며 기존의 해를 저장하는 구조가 있는 메타휴리스틱 최적화 알고리즘을 이용하였다. 메타휴리스틱 최적화 알고리즘 중 구조가 간단한 화음탐색법(Harmony Search, HS)과 GD의 결합모형(HS-GD)을 MLP의 Optimizer로 사용하여 기존 Optimizer의 단점을 개선하였다. HS-GD를 이용한 MLP의 성능검토를 위해 이천시 지하수위 예측을 실시하였으며 예측 결과를 기존의 Optimizer를 이용한 MLP 및 HS를 이용한 MLP의 예측결과와 비교하였다.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.16 no.3
• /
• pp.372-377
• /
• 2006

In this paper, we propose sensibility recognition model that recognize user's sensibility using brain waves. Method to acquire quantitative data of brain waves including priority living body data or sensitivity data to recognize user's sensitivity need and pattern recognition techniques to examine closely present user's sensitivity state through next acquired brain waves becomes problem that is important. In this paper, we used pattern recognition techniques to use Multi Layer Perceptron (MLP) that is pattern recognition techniques that recognize user's sensibility state through brain waves. We measures several subject's emotion brain waves in specification space for an experiment of sensibility recognition model's which propose in this paper and we made a emotion DB by the meaning data that made of concentration or stability by the brain waves measured. The model recognizes new user's sensibility by the user's brain waves after study by sensibility recognition model which propose in this paper to emotion DB. Finally, we estimates the performance of sensibility recognition model which used brain waves as that measure the change of recognition rate by the number of subjects and a number of hidden nodes.

• International Journal of Contents
• /
• v.9 no.4
• /
• pp.11-15
• /
• 2013

"Protein Folding Problem" is considered to be one of the "Great Challenges of Computer Science" and prediction of disordered protein is an important part of the protein folding problem. Machine learning models can predict the disordered structure of protein based on its characteristic of "learning from examples". Among many machine learning models, we investigate the possibility of multilayer perceptron (MLP) as the predictor of protein disorder. The investigation includes a single hidden layer MLP, multi hidden layer MLP and the hierarchical structure of MLP. Also, the target node cost function which deals with imbalanced data is used as training criteria of MLPs. Based on the investigation results, we insist that MLP should have deep architectures for performance improvement of protein disorder prediction.

• Journal of Korea Multimedia Society
• /
• v.23 no.9
• /
• pp.1155-1163
• /
• 2020

Deep learning approach is emerging as a new way to improve the accuracy of tree species identification using bark image. However, the approach has not been studied enough because it is confronted with the problem of acquiring a large volume of bark image dataset. This study solved this problem by utilizing a pretrained off-the-shelf DCNN model. It compares the discrimination power of bark features extracted by each DCNN model. Then it extracts the features by using a selected DCNN model and feeds them to a multi-layer perceptron (MLP). We found out that the ResNet50 model is effective in extracting bark features and the MLP could be trained well with the features reduced by the principal component analysis. The proposed approach gives accuracy of 99.1% and 98.4% for BarkTex and Trunk12 datasets respectively.

• 제어로봇시스템학회:학술대회논문집
• /
• 1990.10b
• /
• pp.1377-1382
• /
• 1990

In Multi-Layer Perceptron (MLP) which realizes continuous mappings, the output errors is directly affected by the weight errors which may be caused by the limited precision of digital or analog hardware in implementations. So, it is important to study the sensitivity due to the perturbation of connection weights between neurons. In this paper, we derive a sensitivity function to the statistical weight perturbations in MLP with differentiable activation functions. This sensitivity function can be regarded as an ensemble average of deterministic sensitivity measures due to the perturbations of weights. Hence, this sensitivity function can be used as the criteria for selecting weights with the minimum sensitivity among possible sets of connection weights in MLP. For the verification of the validity of the proposed sensitivity function, computer simulations have been performed and through the simulations we find good agreement between the theoretical and simulation results.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.32B no.8
• /
• pp.1110-1118
• /
• 1995

Over the past few years, a wide variety of techniques have been developed which make a reliable recognition of speech signal. Multi-layer perceptron(MLP) which has excellent pattern recognition properties is one of the most versatile networks in the area of speech recognition. This paper describes an automatic speech recognition system which use both MLP and lexicon. In this system., the recognition is performed by a network search algorithm which matches words in lexicon to MLP output scores. We also suggest a recognition algorithm which incorperat durational information of each phone, whose performance is comparable to that of conventional continuous HMM(CHMM). Performance of the system is evaluated on the database of 26 vocabulary size from 9 speakers. The experimental results show that the proposed algorithm achieves error rate of 7.3% which is 5.3% lower rate than 12.6% of CHMM.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2022.11a
• /
• pp.746-748
• /
• 2022

투자 분배 시스템은 지속성, 수익성, 변동성, 하방경직성 등 각각의 지표를 찾아내는 데이터 분석을 조합한 시스템으로 MLP 신경망을 통한 시황을 예측으로 투자 경험이 부족한 일반 사용자에게 안정적인 투자 분배 전략을 제공한다. 투자분배 시스템 구현을 위하여 추가적으로 금융시장에 대한 회귀분석, 켈리 공식과 같은 도구를 활용하였다.

• Nuclear Engineering and Technology
• /
• v.52 no.10
• /
• pp.2250-2261
• /
• 2020

Accurate localization of radioactive materials is crucial in homeland security and radiological emergencies. Coded-aperture gamma camera is an interesting solution for such applications and can be developed into portable real-time imaging devices. However, traditional reconstruction methods cannot effectively deal with signal-independent noise, thereby hindering low-noise real-time imaging. In this study, a novel reconstruction method with excellent noise-suppression capability based on a multi-layer perceptron (MLP) is proposed. A coded-aperture gamma camera based on pixel detector and coded-aperture mask was constructed, and the process of radioactive source imaging was simulated. Results showed that the MLP method performs better in noise suppression than the traditional correlation analysis method. When the Co-57 source with an activity of 1 MBq was at 289 different positions within the field of view which correspond to 289 different pixels in the reconstructed image, the average contrast-to-noise ratio (CNR) obtained by the MLP method was 21.82, whereas that obtained by the correlation analysis method was 5.85. The variance in CNR of the MLP method is larger than that of correlation analysis, which means the MLP method has some instability in certain conditions.

• Journal of KIISE:Software and Applications
• /
• v.29 no.3
• /
• pp.180-191
• /
• 2002

We present a new text localization method in images using a multi-layer perceptron(MLP) and a multiple continuously adaptive mean shift (MultiCAMShift) algorithm. An automatically constructed MLP-based texture classifier generates a text probability image for various types of images without an explicit feature extraction. The MultiCAMShift algorithm, which operates on the text probability Image produced by an MLP, can place bounding boxes efficiently without analyzing the texture properties of an entire image.

• Journal of Korea Water Resources Association
• /
• v.56 no.1
• /
• pp.63-74
• /
• 2023

High-reliability prediction of dam inflow is necessary for efficient dam operation. Recently, studies were conducted to predict the inflow of dams using Multi Layer Perceptron (MLP). Existing studies used the Gradient Descent (GD)-based optimizer as the optimizer among MLP operators to find the optimal correlation between data. However, the GD-based optimizers have disadvantages in that the prediction performance is deteriorated due to the possibility of convergence to the local optimal value and the absence of storage space. This study improved the shortcomings of the GD-based optimizer by developing Adaptive moments combined with Improved Harmony Search (AdamIHS), which combines Adaptive moments among GD-based optimizers and Improved Harmony Search (IHS). In order to evaluate the learning and prediction performance of MLP using AdamIHS, Daecheong Dam inflow was learned and predicted and compared with the learning and prediction performance of MLP using GD-based optimizer. Comparing the learning results, the Mean Squared Error (MSE) of MLP, which is 5 hidden layers using AdamIHS, was the lowest at 11,577. Comparing the prediction results, the average MSE of MLP, which is one hidden layer using AdamIHS, was the lowest at 413,262. Using AdamIHS developed in this study, it will be possible to show improved prediction performance in various fields.