• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.156-161
• /
• 2003

It is an interest problem to predict substance distributions in three-dimensional space. Recently, a research field as Geostatistics is advanced. It is a kind of inter- or extrapolation mathematically. Some useful means for the inter- and extrapolation are known, in which slide window method with neural networks is hopeful one. We propose multi-dimensional extrapolation using multi-layer neural networks and the slide-window method. The multi-dimensional extrapolation is not similar to one-dimension. It has plural algorithms. We researched line predictors and local-plain predictors I two-dimensional space. The both predictors are equivalent; however, in multi-dimensional extrapolation, it is very important to find the direction of predictions. Especially, since the slide window method requires information to predict the future in sampling data, if they are not ordered appropriately in the direction, the predictor cannot operate. We tested the extrapolation for typical two-dimensional functions, and found an excellent character of slide-window method based on local-plain. By using the method, we can extrapolate the function until twice-outer regions of the definitions.

• Journal of the Korean Society of Clothing and Textiles
• /
• v.26 no.1
• /
• pp.152-159
• /
• 2002

Neural networks are used to predict the sense of touch of polyurethane coated fabrics. In this study, we used the multi layer perceptron (MLP) neural networks in Neural Connection. The learning algorithm for neural networks is back-propagation algorithm. We used 29 polyurethane coated fabrics to train the neural networks and 4 samples to test the neural networks. Input variables are 17 mechanical properties measured with KES-FB system, and output variable is the sense of touch of polyurethane coated fabrics. The influence of MLF function, the number of hidden layers, and the number of hidden nodes on the prediction accuracy is investigated. The results were as follows: MLP function, the number of hidden layer and the number of hidden nodes have some influence on the prediction accuracy. In this work, tangent function, the architecture of the double hidden layers and the 24-12-hidden nodes has the best prediction accuracy with the lowest RMS error. Using the neural networks to predict the sense of touch of polyurethane coated fabrics has hotter prediction accuracy than regression approach used in our previous study.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.14 no.5
• /
• pp.660-665
• /
• 2004

In this study, a new architecture and comprehensive design methodology of genetically optimized Multi-layer Fuzzy Neural Networks (gMFNN) are introduced and a series of numeric experiments are carried out. The gMFNN architecture results from a synergistic usage of the hybrid system generated by combining Fuzzy Neural Networks (FNN) with Polynomial Neural Networks (PNN). FNN contributes to the formation of the premise part of the overall network structure of the gMFNN. The consequence part of the gMFNN is designed using PNN. The optimization of the FNN is realized with the aid of a standard back-propagation learning algorithm and genetic optimization. The development of the PNN dwells on the extended Group Method of Data Handling (GMDH) method and Genetic Algorithms (GAs). To evaluate the performance of the gMFNN, the models are experimented with the use of a numerical example.

• Journal of Information Technology Services
• /
• v.16 no.4
• /
• pp.149-160
• /
• 2017

Sentiment analysis is the process of determining whether a piece of document, text or conversation is positive, negative, neural or other emotion. Sentiment analysis has been applied for several real-world applications, such as chatbot. In the last five years, the practical use of the chatbot has been prevailing in many field of industry. In the chatbot applications, to recognize the user emotion, sentiment analysis must be performed in advance in order to understand the intent of speakers. The specific emotion is more than describing positive or negative sentences. In light of this context, we propose deep learning models for conducting multi-class sentiment analysis for identifying speaker's emotion which is categorized to be joy, fear, guilt, sad, shame, disgust, and anger. Thus, we develop convolutional neural network (CNN), long short term memory (LSTM), and multi-layer neural network models, as deep neural networks models, for detecting emotion in a sentence. In addition, word embedding process was also applied in our research. In our experiments, we have found that long short term memory (LSTM) model performs best compared to convolutional neural networks and multi-layer neural networks. Moreover, we also show the practical applicability of the deep learning models to the sentiment analysis for chatbot.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.58 no.4
• /
• pp.832-839
• /
• 2009

In this paper, we introduce an design of fuzzy relation-based fuzzy neural networks with multi-output. Fuzzy relation-based fuzzy neural networks comprise the network structure generated by dividing the entire input space. The premise part of the fuzzy rules of the network reflects the relation of the division space for the entire input space and the consequent part of the fuzzy rules expresses three types of polynomial functions such as constant, linear, and modified quadratic. For the multi-output structure the neurons in the output layer were connected with connection weights. The learning of fuzzy neural networks is realized by adjusting connections of the neurons both in the consequent part of the fuzzy rules and in the output layer, and it follows a back-propagation algorithm. In addition, in order to optimize the network, the parameters of the network such as apexes of membership functions, learning rate and momentum coefficient are automatically optimized by using real-coded genetic algorithm. Two examples are included to evaluate the performance of the proposed network.

• Journal of Advanced Marine Engineering and Technology
• /
• v.21 no.1
• /
• pp.66-70
• /
• 1997

In this paper a new learning algorithm for curvature smoothing and improved generalization for multi-layer neural networks is proposed. To enhance the generalization ability a constraint term of hidden neuron activations is added to the conventional output error, which gives the curvature smoothing characteristics to multi-layer neural networks. When the total cost consisted of the output error and hidden error is minimized by gradient-descent methods, the additional descent term gives not only the Hebbian learning but also the synaptic weight decay. Therefore it incorporates error back-propagation, Hebbian, and weight decay, and additional computational requirements to the standard error back-propagation is negligible. From the computer simulation of the time series prediction with Santafe competition data it is shown that the proposed learning algorithm gives much better generalization performance.

• Proceedings of the KIEE Conference
• /
• 2003.11b
• /
• pp.263-266
• /
• 2003

In this paper, we have proposed a realization method of tactile sense of virtual objects using multi-layer Neural Networks(NN). Inputs of the NN are position data of non-rigid objects and outputs of the NN are forces at that time and point. First, the position and forte data are measured from non-rigid objects (a sponge and a balloon) using two PHANToMS, one as a master and the other as a slave manipulator, then the data are used to train a multi-layer Neural Networks whose inputs and outputs are designed to represent tactile information. The trained Neural Networks is used to regenerate the tactile sense on the virtual objects graphically made by a computer, and one can feel a quite similar sense of touch by using the system while touching the virtual objects.

• Proceedings of the KIEE Conference
• /
• 2005.10b
• /
• pp.155-157
• /
• 2005

We propose a new category of hybrid multi-layer neural networks with hetero nodes such as Fuzzy Set based Polynomial Neurons (FSPNs) and Polynomial Neurons (PNs). These networks are based on a genetically optimized multi-layer perceptron. We develop a comprehensive design methodology involving mechanisms of genetic optimization and genetic algorithms, in particular. The augmented genetically optimized HFPNN (namely gHFPNN) results in a structurally optimized structure and comes with a higher level of flexibility in comparison to the one we encounter in the conventional HFPNN. The GA-based design procedure being applied at each layer of HFPNN leads to the selection of preferred nodes (FPNs or PNs) available within the HFPNN. In the sequel, two general optimization mechanisms are explored. First, the structural optimization is realized via GAs whereas the ensuing detailed parametric optimization is carried out in the setting of a standard least square method-based learning. The performance of the gHFPNNs quantified through experimentation where we use a number of modeling benchmarks-synthetic and experimental data already experimented with in fuzzy or neurofuzzy modeling.

• Journal of Information Processing Systems
• /
• v.14 no.1
• /
• pp.176-190
• /
• 2018

This paper presents a novel convolutional neural network based multi-feature fusion learning method for non-rigid 3D model retrieval, which can investigate the useful discriminative information of the heat kernel signature (HKS) descriptor and the wave kernel signature (WKS) descriptor. At first, we compute the 2D shape distributions of the two kinds of descriptors to represent the 3D model and use them as the input to the networks. Then we construct two convolutional neural networks for the HKS distribution and the WKS distribution separately, and use the multi-feature fusion layer to connect them. The fusion layer not only can exploit more discriminative characteristics of the two descriptors, but also can complement the correlated information between the two kinds of descriptors. Furthermore, to further improve the performance of the description ability, the cross-connected layer is built to combine the low-level features with high-level features. Extensive experiments have validated the effectiveness of the designed multi-feature fusion learning method.

• 제어로봇시스템학회:학술대회논문집
• /
• 2004.08a
• /
• pp.40-45
• /
• 2004

This work presents a boundary estimation approach in electrical impedance imaging for binary-mixture fields based on a parallel structured multi-layer neural network. The interfacial boundaries are expressed with the truncated Fourier series and the unknown Fourier coefficients are estimated with the parallel structure of multi-layer neural network. Results from numerical experiments shows that the proposed approach is insensitive to the measurement noise and has a strong possibility in the visualization of binary mixtures for a real time monitoring.