• Journal of KIISE:Software and Applications
• /
• v.29 no.1_2
• /
• pp.1-9
• /
• 2002

Evolutionary artificial neural networks (EANNs) are towards the near optimal ANN using the global search of evolutionary instead of trial-and-error process. However, many real-world problems are too hard to be solved by only one ANN. Recently there has been plenty of interest on combining ANNs in the last generation to improve the performance and reliability. This paper proposes a new approach of constructing multiple ANNs which complement each other by speciation. Also, we develop a multiple ANN to combine the results in abstract, rank, and measurement levels. The experimental results on Australian credit approval data from UCI benchmark data set have shown that combining of the speciated EANNs have better recognition ability than EANNs which are not speciated, and the average error rate of 0.105 proves the superiority of the proposed EANNs.

• Proceedings of the Korean Society for Bioinformatics Conference
• /
• 2004.11a
• /
• pp.150-157
• /
• 2004

microRNA (miRNA)는 21-25 nucleotide (nt)의 single-stranded RNA 분자로서 mRNA의 3' untranslated region (3' UTR)에 상보적으로 결합하여 유전자 발현을 제어하는 새로운 조절물질이다. 지금까지 실험을 통해 수백 개의 miRNA가 알려져 있으나, miRNA에 의해 조절되는 target 유전자는 실험상의 어려움으로 아직까지 거의 알려지지 않았다. miRNA는 서열의 길이가 짧고 target과 느슨한 상보적 결합을 하기 때문에 기존의 서열 비교 방법으로 miRNA의 target을 찾는 것은 쉬운 일이 아니다. 본 논문은 신경망을 이용하여 Caenorhabditis elegans mRNA의 3' UTR에서 miRNA가 결합하는 영역을 예측하였다. 신경망은 복잡한 비선형 데이터를 잘 분리해내고 불완전하고 잡음이 많은 입력에 강하기 때문에 miRNA target 예측에 적합하다. miRNA와 mRNA의 결합 영역을 다양하게 분석하였고 민감도 0.59, 특수도 0.99의 성능을 갖는 신경망을 구현하였다. 신경망 입력 값을 달리하여 각각의 특성이 결과에 미치는 영향을 분석하였고 기존 예측 방법에 의한 결과와 비교하여 성능을 평가하였다.

• Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
• /
• 2007.11a
• /
• pp.462-463
• /
• 2007

신경망을 이용하여 반구형 유도결합형 플라즈마 장비에 대한 전자밀도의 예측모델을 개발하였다. 신경망으로는 Radial Basis function Network를 이용하였고, 신경망의 예측성능은 유전자 알고리즘을 이용하여 최적화하였다. 체계적인 모델링을 위해 $2^4$ 전 인자 (Full Factorial) 실험계획법을 이용하였다. 개발된 모델을 이용하여 공정변수에 따른 전자밀도의 영향을 고찰하였다. 전자밀도는 팁 위치(즉 챔버 높이)에 가장 많은 영향을 받았으며, 소스전력과 압력의 변화에 따른 전자밀도의 변화는 작았다. 팁 위치는 소스전력 변화에 영향을 받지 않았지만, 압력변화는 팁 위치에 따라 복잡하게 전자밀도에 영향을 미쳤다.

• KIPS Transactions on Software and Data Engineering
• /
• v.11 no.9
• /
• pp.371-380
• /
• 2022

Convolutional neural networks are widely used to manipulate data arranged in a grid, such as images. A general convolutional neural network consists of a convolutional layers and a fully connected layers, and each layer contains a nonlinear activation functions. This paper proposes a combined parametric activation function to improve the performance of convolutional neural networks. The combined parametric activation function is created by adding the parametric activation functions to which parameters that convert the scale and location of the activation function are applied. Various nonlinear intervals can be created according to parameters that convert multiple scales and locations, and parameters can be learned in the direction of minimizing the loss function calculated by the given input data. As a result of testing the performance of the convolutional neural network using the combined parametric activation function on the MNIST, Fashion MNIST, CIFAR10 and CIFAR100 classification problems, it was confirmed that it had better performance than other activation functions.

• Journal of KIISE:Software and Applications
• /
• v.29 no.3
• /
• pp.192-201
• /
• 2002

Automated text classification is considered as an important method to manage and process a huge amount of documents in digital forms that are widespread and continuously increasing. Recently, text classification has been addressed with machine learning technologies such as k-nearest neighbor, decision tree, support vector machine and neural networks. However, only few investigations in text classification are studied on real problems but on well-organized text corpus, and do not show their usefulness. This paper proposes and analyzes text classification methods for a real application, email document classification task. First, we propose a combining method of multiple neural networks that improves the performance through the combinations with maximum and neural networks. Second, we present another strategy of combining multiple machine learning classifiers. Voting, Borda count and neural networks improve the overall classification performance. Experimental results show the usefulness of the proposed methods for a real application domain, yielding more than 90% precision rates.

• The KIPS Transactions:PartB
• /
• v.12B no.3 s.99
• /
• pp.343-348
• /
• 2005

The goal of this paper is to study the joint effect of factors of neural network teaming procedure. There are many factors, which may affect the generalization ability and teaming speed of neural networks, such as the initial values of weights, the learning rates, and the regularization coefficients. We will apply a constructive training algerian for neural network, then patterns are trained incrementally by considering them one by one. First, we will investigate the effect of these factors on generalization performance and learning speed. Based on these factors' effect, we will propose a joint method that simultaneously considers these three factors, and dynamically hue the learning rate and regularization coefficient. Then we will present the results of some experimental comparison among these kinds of methods in several simulated nonlinear data. Finally, we will draw conclusions and make plan for future work.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2005.05a
• /
• pp.477-480
• /
• 2005

본 논문에서는 신경망과 유전자 알고리즘의 장점을 결합하고, 개선된 유전자 알고리즘 기반의 역전파 신경망 알고리즘을 이용한 신경망 학습 효과를 살펴 본다. 유전자 알고리즘을 이용한 신경망 학습은 비선형 함수를 이용하여 발생시킨 모의 자료를 통하여 수행하고 학습 수렴의 정도와 학습 속도 등을 비교할 수 있는 모의실험 결과를 일반 신경망 학습 결과와 함께 제시한다. 모의실험의 결과로서 유전자 알고리즘을 적용한 신경망 제어기가 일반 신경망 학습 결과보다 수렴 정확도 및 학습 속도에서 더 좋은 결과를 나타내 주고 있다.

• The Korean Journal of Applied Statistics
• /
• v.37 no.3
• /
• pp.297-309
• /
• 2024

This paper evaluates the performance of the neural network autoregressive model combined with an exponential smoothing model, called the NNARX+ETS model. The combined model utilizes the components of ETS as exogenous variables for NNARX, to forecast time series data using artificial neural networks. The main idea is to enhance the performance of NNAR using only lags of the original time series data, by combining traditional time series analysis methods with the neural networks through NNARX. We employ two real data for performance evaluation and compare the NNARX+ETS with NNAR and traditional time series analysis methods such as ETS and ARIMA (autoregressive integrated moving average) models.

• KIISE Transactions on Computing Practices
• /
• v.23 no.12
• /
• pp.698-702
• /
• 2017

Since the introduction of Deep Neural Networks to the Natural Language Processing field, two major approaches have been considered for modeling text. One method involved learning embeddings, i.e. the distributed representations containing abstract semantics of words or sentences, with the textual context. The other strategy consisted of composing the embeddings trained by the above to get embeddings of longer texts. However, most studies of the composition methods just adopt word embeddings without consideration of the optimal embedding unit and the optimal method of composition. In this paper, we conducted experiments to analyze the optimal embedding unit and the optimal composition method for modeling longer texts, such as documents. In addition, we suggest a new discourse-based composition to overcome the limitation of the sequential composition method on composing sentence embeddings.

• Proceedings of the Acoustical Society of Korea Conference
• /
• spring
• /
• pp.27-30
• /
• 2000

본 논문은 HMM(Hidden Markov Model)을 이용하여 인식을 수행할 경우의 오류를 최소화 할 수 있는 후 처리 과정으로 신경망을 결합시켜 HMM 단독으로 사용하였을 때 보다 높은 인식률을 얻을 수 있는 HMM과 신경망의 하이브리드시스템을 제안한다. HMM을 이용하여 학습한 후 학습에 참여하지 않은 데이터를 인식하였을 때 오인식 데이터를 정인식으로 인식하도록 HMM의 출력으로 얻은 각 출력확률을 후 처리에 사용될 MLP(Multilayer Perceptrons)의 학습용으로 사용하여 MLP를 학습하여 HMM과 MLP을 결합한 하이브리드 모델을 만든다. 이와 같은 HMM과 신경망을 결합한 하이브리드 모델을 사용하여 단독 숫자음과 4연 숫자음 데이터에서 실험한 결과 HMM 단독으로 사용하였을 때 보다 각각 약 $4.5\%$, $1.3\%$의 인식률 향상이 있었다. 기존의 하이브리드 시스템이 갖는 많은 학습시간이 소요되는 문제점과 실시간 음성인식시스템을 구현할 때의 학습데이터의 부족으로 인한 인식률 저하를 해결할 수 있는 방법임을 확인할 수 있었다.