• Journal of Information Processing Systems
• /
• 제10권3호
• /
• pp.443-458
• /
• 2014

An extreme learning machine (ELM) is a recently proposed learning algorithm for a single-layer feed forward neural network. In this paper we studied the ensemble of ELM by using a bagging algorithm for facial expression recognition (FER). Facial expression analysis is widely used in the behavior interpretation of emotions, for cognitive science, and social interactions. This paper presents a method for FER based on the histogram of orientation gradient (HOG) features using an ELM ensemble. First, the HOG features were extracted from the face image by dividing it into a number of small cells. A bagging algorithm was then used to construct many different bags of training data and each of them was trained by using separate ELMs. To recognize the expression of the input face image, HOG features were fed to each trained ELM and the results were combined by using a majority voting scheme. The ELM ensemble using bagging improves the generalized capability of the network significantly. The two available datasets (JAFFE and CK+) of facial expressions were used to evaluate the performance of the proposed classification system. Even the performance of individual ELM was smaller and the ELM ensemble using a bagging algorithm improved the recognition performance significantly.

• 한국콘텐츠학회논문지
• /
• 제7권1호
• /
• pp.58-64
• /
• 2007

패턴 인식 분야에는 지수적 탐색 공간을 가진 최적화 문제가 많이 있다. 이를 해결하기 위해 부 최적해를 구하는 순차 탐색 알고리즘이 사용되어 왔고, 이들 알고리즘은 국부 최적점에 빠지는 문제점을 안고 있다. 최근 이를 극복하기 위해 유전 알고리즘을 사용하는 사례가 많아졌다. 이 논문은 특징 선택, 분류기 앙상블 선택, 신경망 가지치기, 군집화 문제의 지수적 탐색 공간 특성을 설명하고 이를 해결하기 위한 유전 알고리즘을 살펴본다. 또한 향후 연구로서 가치가 높은 주제들에 대해 소개한다.

• International Journal of Advanced Culture Technology
• /
• 제9권4호
• /
• pp.268-273
• /
• 2021

In this paper, we propose a sentiment analysis model that improves performance on small-scale data. A sentiment analysis model for small-scale data is proposed and verified through experiments. To this end, we propose Bagging-Bi-GRU, which combines Bi-GRU, which learns GRU, which is a variant of LSTM (Long Short-Term Memory) with excellent performance on sequential data, in both directions and the bagging technique, which is one of the ensembles learning methods. In order to verify the performance of the proposed model, it is applied to small-scale data and large-scale data. And by comparing and analyzing it with the existing machine learning algorithm, Bi-GRU, it shows that the performance of the proposed model is improved not only for small data but also for large data.

• Journal of the Korean Wood Science and Technology
• /
• 제47권3호
• /
• pp.265-276
• /
• 2019

In our previous study, the LeNet3 model successfully classified images from the transverse surfaces of five Korean softwood species (cedar, cypress, Korean pine, Korean red pine, and larch). However, a practical limitation exists in our system stemming from the nature of the training images obtained from the transverse plane of the wood species. In real-world applications, it is necessary to utilize images from the longitudinal surfaces of lumber. Thus, we improved our model by training it with images from the longitudinal and transverse surfaces of lumber. Because the longitudinal surface has complex but less distinguishable features than the transverse surface, the classification performance of the LeNet3 model decreases when we include images from the longitudinal surfaces of the five Korean softwood species. To remedy this situation, we adopt ensemble methods that can enhance the classification performance. Herein, we investigated the use of ensemble models from the LeNet and MiniVGGNet models to automatically classify the transverse and longitudinal surfaces of the five Korean softwoods. Experimentally, the best classification performance was achieved via an ensemble model comprising the LeNet2, LeNet3, and MiniVGGNet4 models trained using input images of $128{\times}128{\times}3pixels$ via the averaging method. The ensemble model showed an F1 score greater than 0.98. The classification performance for the longitudinal surfaces of Korean pine and Korean red pine was significantly improved by the ensemble model compared to individual convolutional neural network models such as LeNet3.

• 통합자연과학논문집
• /
• 제14권4호
• /
• pp.183-188
• /
• 2021

Collaborative filtering is one of the commonly used methods in the web recommendation system. Numerous researches on the collaborative filtering proposed the numbers of measures for enhancing the accuracy. This study suggests the movie recommendation system applied with Word2Vec and ensemble convolutional neural networks. First, user sentences and movie sentences are made from the user, movie, and rating information. Then, the user sentences and movie sentences are input into Word2Vec to figure out the user vector and movie vector. The user vector is input on the user convolutional model while the movie vector is input on the movie convolutional model. These user and movie convolutional models are connected to the fully-connected neural network model. Ultimately, the output layer of the fully-connected neural network model outputs the forecasts for user, movie, and rating. The test result showed that the system proposed in this study showed higher accuracy than the conventional cooperative filtering system and Word2Vec and deep neural network-based system suggested in the similar researches. The Word2Vec and deep neural network-based recommendation system is expected to help in enhancing the satisfaction while considering about the characteristics of users.

• 대한전기학회논문지
• /
• 제43권6호
• /
• pp.1027-1035
• /
• 1994

This paper aims to make an artificial arm control strategy. For this, we propose a new feature extraction method and design artificial neural network for the functional classification of myoelectric signal(MES). We first transform the two channel myoelectric signals (MES) for biceps and triceps into frequency domain using fast Fourier transform (FFT). And features were obtained by comparing the magnitudes of ensemble spectrum data and used as inputs to the three-layer neural network for the learning. By changing the number of units in hidden layer of neural network we observed the improvement of classification performance. To observe the effeciency of the proposed scheme we performed experiments for classification of six arm functions to the three subjects. And we obtained on average 94[%] the ratio of classification.

• International Journal of Computer Science & Network Security
• /
• 제23권9호
• /
• pp.186-191
• /
• 2023

Neural Networks are widely used for huge variety of tasks solution. Machine Learning methods are used also for signal and time series analysis, including electrocardiograms. Contemporary wearable devices, both medical and non-medical type like smart watch, allow to gather the data in real time uninterruptedly. This allows us to transfer these data for analysis or make an analysis on the device, and thus provide preliminary diagnosis, or at least fix some serious deviations. Different methods are being used for this kind of analysis, ranging from medical-oriented using distinctive features of the signal to machine learning and deep learning approaches. Here we will demonstrate a neural network-based approach to this task by building an ensemble of 1D CNN classifiers and a final classifier of selection using logistic regression, random forest or support vector machine, and make the conclusions of the comparison with other approaches.

• 한국습지학회지
• /
• 제21권spc호
• /
• pp.61-68
• /
• 2019

최근 장기적인 기후 변동성을 고려하기 위하여 대기-해양 순환 패턴을 수치화한 기상인자가 수문 변수 예측에 널리 사용되고 있다. 또한 정확하고 안정적인 예측을 위해 인공신경망 기반의 예측 모형이 꾸준히 발전하고 있다. 기상인자를 활용하여 기후 변동성을 고려한 수문량 예측은 수자원 및 환경 보존의 장기적인 관리에 효율적으로 활용될 수 있으므로 수문 변수에 유의한 인자의 파악과 이를 활용한 예측 모형의 적용은 꾸준한 도전이 될 것이다. 본 연구에서는 우리나라 한강 유역 댐 유입량에 통계적으로 유의한 상관성이 있는 대표 기상인자를 선정하고, 이를 인공신경망 앙상블 모형에 적용하여 댐 유입량 예측을 수행하였다. 이를 위해 앙상블 경험적 모드분해법을 활용하여 댐 유입량과 기상인자간의 통계적 상관성을 확인하였으며, 기존 단일 인공신경망 모형의 한계를 보완한 인공신경망 앙상블 모형을 구축하였다. 예측 수행 결과, 5개 댐 상관계수 평균이 훈련 기간에서 0.88, 검증 기간에서 0.68의 예측력을 보이는 것을 확인하였으며, 본 연구에서의 절차를 토대로 우리나라의 다양한 수문 변수와 기후 변동성간의 관계를 활용한 다양한 적용 사례가 나오길 기대한다.

• 한국컴퓨터정보학회논문지
• /
• 제22권11호
• /
• pp.111-116
• /
• 2017

This paper proposes a data mining approach to predicting stock price direction. Stock market fluctuates due to many factors. Therefore, predicting stock price direction has become an important issue in the field of stock market analysis. However, in literature, there are few studies applying data mining approaches to predicting the stock price direction. To contribute to literature, this paper proposes comparing single classifiers and ensemble classifiers. Single classifiers include logistic regression, decision tree, neural network, and support vector machine. Ensemble classifiers we consider are adaboost, random forest, bagging, stacking, and vote. For the sake of experiments, we garnered dataset from Korea Stock Exchange (KRX) ranging from 2008 to 2015. Data mining experiments using WEKA revealed that random forest, one of ensemble classifiers, shows best results in terms of metrics such as AUC (area under the ROC curve) and accuracy.

• 전자공학회논문지C
• /
• 제34C권1호
• /
• pp.28-41
• /
• 1997

This paper describes a parallel implementation of a neurla network ensemble developed for object recognition on the connection machine CM-2. The implementation ensures that multiple networks are implemented simultaneously starting from different initial weights and all training samples are applied to each network by one sample per a copy of each network. When compared with a sequential implementation, this accelerates the computation speed by O(N.m.n) where N, m, and n are the network, respectively. The speedup in the computation time and the convergence characteristics of sthe modified backpropagation learning precedure were evaluated by two-dimensional object recognition problem.