• The Journal of the Acoustical Society of Korea
• /
• v.21 no.5
• /
• pp.430-437
• /
• 2002

Having a variety of good characteristics against other pattern recognition techniques, the multilayer perceptron (MLP) has been widely used in speech recognition and speaker recognition. But, it is known that the error backpropagation (EBP) algorithm that MLP uses in learning has the defect that requires restricts long learning time, and it restricts severely the applications like speaker recognition and speaker adaptation requiring real time processing. Because the learning data for pattern recognition contain high redundancy, in order to increase the learning speed it is very effective to use the online-based learning methods, which update the weight vector of the MLP by the pattern. A typical online EBP algorithm applies the fixed learning rate for each update of the weight vector. Though a large amount of speedup with the online EBP can be obtained by choosing the appropriate fixed rate, firing the rate leads to the problem that the algorithm cannot respond effectively to different learning phases as the phases change and the number of patterns contributing to learning decreases. To solve this problem, this paper proposes a Changing rate and Omitting patterns in Instant Learning (COIL) method to apply the variable rate and the only patterns necessary to the learning phase when the phases come to change. In this paper, experimentations are conducted for speaker verification and speech recognition, and results are presented to verify the performance of the COIL.

• Journal of KIISE:Computing Practices and Letters
• /
• v.8 no.3
• /
• pp.344-355
• /
• 2002

Having a variety of good characteristics against other pattern recognition techniques, Multilayer Perceptron (MLP) has been used in wide applications. But, it is known that Error Backpropagation (EBP) algorithm which MLP uses in learning has a defect that requires relatively long leaning time. Because learning data in pattern recognition contain abundant redundancies, in order to increase learning speed it is very effective to use online-based teaming methods, which update parameters of MLP pattern by pattern. Typical online EBP algorithm applies fixed learning rate for each update of parameters. Though a large amount of speedup with online EBP can be obtained by choosing an appropriate fixed rate, fixing the rate leads to the problem that the algorithm cannot respond effectively to different leaning phases as the phases change and the learning pattern areas vary. To solve this problem, this paper defines learning as three phases and proposes a Instant Learning by Varying Rate and Skipping (ILVRS) method to reflect only necessary patterns when learning phases change. The basic concept of ILVRS is as follows. To discriminate and use necessary patterns which change as learning proceeds, (1) ILVRS uses a variable learning rate which is an error calculated from each pattern and is suppressed within a proper range, and (2) ILVRS bypasses unnecessary patterns in loaming phases. In this paper, an experimentation is conducted for speaker verification as an application of pattern recognition, and the results are presented to verify the performance of ILVRS.

• Smart Structures and Systems
• /
• v.32 no.1
• /
• pp.37-47
• /
• 2023

Indirect determination of pan evaporation (PE) has been highly regarded, due to the advantages of intelligent models employed for this objective. This work pursues improving the reliability of a popular intelligent model, namely multi-layer perceptron (MLP) through surmounting its computational knots. Available climatic data of Fresno weather station (California, USA) is used for this study. In the first step, testing several most common trainers of the MLP revealed the superiority of the Levenberg-Marquardt (LM) algorithm. It, therefore, is considered as the classical training approach. Next, the optimum configurations of two metaheuristic algorithms, namely cuttlefish optimization algorithm (CFOA) and teaching-learning-based optimization (TLBO) are incorporated to optimally train the MLP. In these two models, the LM is replaced with metaheuristic strategies. Overall, the results demonstrated the high competency of the MLP (correlations above 0.997) in the presence of all three strategies. It was also observed that the TLBO enhances the learning and prediction accuracy of the classical MLP (by nearly 7.7% and 9.2%, respectively), while the CFOA performed weaker than LM. Moreover, a comparison between the efficiency of the used metaheuristic optimizers showed that the TLBO is a more time-effective technique for predicting the PE. Hence, it can serve as a promising approach for indirect PE analysis.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2017.01a
• /
• pp.19-20
• /
• 2017

인공지능이 사회적으로 대두되면서 많은 양의 관련 연구가 시작되고 있다. 본 논문에서는 다층 퍼셉트론 신경망에서 역전파 학습의 진행 과정을 시각화 하는 것을 목표로 하고 있다. 다층 퍼셉트론 신경망은 학습의 진행 과정과 그 방식은 잘 알려져 있으나 각 신경의 값이 어떻게 변화되어 가는 지는 눈에 보이지 않는다. 이러한 과정에 대해 시각화를 통해 값이 변하는 과정을 눈으로 쉽게 관찰할 수 있도록 하는 것이 이 논문의 목표이다. 본 연구결과는 향후 다층 퍼셉트론 신경망을 기반으로 하는 다른 모델의 시각화에 대한 기초자료로 활용될 수 있을 것이다.

• Proceedings of the Korean Society of Machine Tool Engineers Conference
• /
• 2004.10a
• /
• pp.345-351
• /
• 2004

This Paper describes a nonlinear adaptive noise filter using neural network for digital controller system. Back-Propagation Learning Algorithm based MLP (Multi Layer Perceptron)is used an adaptive filters. In this paper. it assume that the noise of primary input in the adaptive noise canceller is not the same characteristic as that of the reference input. Experimental reaults show that the neural network base noise canceller outperforms the linear noise canceller. Especially to make noise cancel close to realtime, Primary input is divided by unit and each divided part is processed for very short time than all the processed data are unified to whole data.

• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.29 no.5
• /
• pp.997-1006
• /
• 2019

To overcome the difficulties and inefficiencies of the existing power analysis attack, we try to extract the secret key embedded in a cryptographic device using attack model based on MLP(Multi-Layer Perceptron) method. The target of our proposed power analysis attack is the AES-128 encryption module implemented on an 8-bit processor XMEGA128. We use the divide-and-conquer method in bytes to recover the whole 16 bytes secret key. As a result, the MLP-based power analysis attack can extract the secret key with the accuracy of 89.51%. Additionally, this MLP model has the 94.51% accuracy when the pre-processing method on power traces is applied. Compared to the machine leaning-based model SVM(Support Vector Machine), we show that the MLP can be a outstanding method in power analysis attacks due to excellent ability for feature extraction.

• 제어로봇시스템학회:학술대회논문집
• /
• 1993.10a
• /
• pp.842-846
• /
• 1993

Because of complexity, neural network is difficult to learn. So if internal representation[1] can be performed successfully, it is possible to use perceptron learning rule. As a result, learning is easier. Therefore the method of internal representations applied to the "XOR" problem, and the "spirals" problem. And then using the above results, the structure of neural network for computing is embodied.mputing is embodied.

• 제어로봇시스템학회:학술대회논문집
• /
• 1995.10a
• /
• pp.364-367
• /
• 1995

In this paper, a design method of learning flight control system via input matching is proposed. The proposed learning control system is a simple structure which has an artificial neural network and feedback mechanism, and it is a useful method to control nonlinear systems.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.28B no.10
• /
• pp.783-789
• /
• 1991

A learing method for the recognition of printed Chinese character by using the input driven multi-layer perceptron model was proposed and the circuit representing the learning result was designed. In learning the extracted features from Chinese characters are used as inputs and the synapse's weight is integer value. So it is possible to implement the learning result with CMOS circuit.

• Computers and Concrete
• /
• v.16 no.5
• /
• pp.741-757
• /
• 2015

In the last decade, several modeling approaches have been proposed and applied to estimate the high-performance concrete (HPC) slump flow. While HPC is a highly complex material, modeling its behavior is a very difficult issue. Thus, the selection and application of proper modeling methods remain therefore a crucial task. Like many other applications, HPC slump flow prediction suffers from noise which negatively affects the prediction accuracy and increases the variance. In the recent years, ensemble learning methods have introduced to optimize the prediction accuracy and reduce the prediction error. This study investigates the potential usage of bagging (Bag), which is among the most popular ensemble learning methods, in building ensemble models. Four well-known artificial intelligence models (i.e., classification and regression trees CART, support vector machines SVM, multilayer perceptron MLP and radial basis function neural networks RBF) are deployed as base learner. As a result of this study, bagging ensemble models (i.e., Bag-SVM, Bag-RT, Bag-MLP and Bag-RBF) are found superior to their base learners (i.e., SVM, CART, MLP and RBF) and bagging could noticeable optimize prediction accuracy and reduce the prediction error of proposed predictive models.