• Title/Summary/Keyword: Extreme Machine Learning (ELM)

Search Result 66, Processing Time 0.029 seconds

Stepwise Constructive Method for Neural Networks Using a Flexible Incremental Algorithm (Flexible Incremental 알고리즘을 이용한 신경망의 단계적 구축 방법)

  • Park, Jin-Il;Jung, Ji-Suk;Cho, Young-Im;Chun, Myung-Geun
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.19 no.4
    • /
    • pp.574-579
    • /
    • 2009
  • There have been much difficulties to construct an optimized neural network in complex nonlinear regression problems such as selecting the networks structure and avoiding overtraining problem generated by noise. In this paper, we propose a stepwise constructive method for neural networks using a flexible incremental algorithm. When the hidden nodes are added, the flexible incremental algorithm adaptively controls the number of hidden nodes by a validation dataset for minimizing the prediction residual error. Here, the ELM (Extreme Learning Machine) was used for fast training. The proposed neural network can be an universal approximator without user intervene in the training process, but also it has faster training and smaller number of hidden nodes. From the experimental results with various benchmark datasets, the proposed method shows better performance for real-world regression problems than previous methods.

SUNSPOT AREA PREDICTION BASED ON COMPLEMENTARY ENSEMBLE EMPIRICAL MODE DECOMPOSITION AND EXTREME LEARNING MACHINE

  • Peng, Lingling
    • Journal of The Korean Astronomical Society
    • /
    • v.53 no.6
    • /
    • pp.139-147
    • /
    • 2020
  • The sunspot area is a critical physical quantity for assessing the solar activity level; forecasts of the sunspot area are of great importance for studies of the solar activity and space weather. We developed an innovative hybrid model prediction method by integrating the complementary ensemble empirical mode decomposition (CEEMD) and extreme learning machine (ELM). The time series is first decomposed into intrinsic mode functions (IMFs) with different frequencies by CEEMD; these IMFs can be divided into three groups, a high-frequency group, a low-frequency group, and a trend group. The ELM forecasting models are established to forecast the three groups separately. The final forecast results are obtained by summing up the forecast values of each group. The proposed hybrid model is applied to the smoothed monthly mean sunspot area archived at NASA's Marshall Space Flight Center (MSFC). We find a mean absolute percentage error (MAPE) and a root mean square error (RMSE) of 1.80% and 9.75, respectively, which indicates that: (1) for the CEEMD-ELM model, the predicted sunspot area is in good agreement with the observed one; (2) the proposed model outperforms previous approaches in terms of prediction accuracy and operational efficiency.

Extreme Learning Machine based Fuzzy Pattern Classifier for Face Recognition (얼굴인식을 위한 ELM 기반 퍼지 패턴분류기)

  • Oh, Sung-Kwun;Roh, Seok-Beom
    • Proceedings of the KIEE Conference
    • /
    • 2015.07a
    • /
    • pp.1369-1370
    • /
    • 2015
  • 본 논문에서는 얼굴 인식을 위하여 인공 신경망의 일종인 Extreme Learning Machine의 학습 알고리즘을 기반으로 하여 지능형 알고리즘인 퍼지 집합 이론을 이용하여 주변 노이즈에 매우 강한 특성을 보이며 학습 속도가 매우 빠른 새로운 패턴 분류기를 제안한다. 제안된 퍼지 패턴 분류기는 기존 신경회로망의 학습 속도에 비해 매우 빠른 학습 속도를 보이며, 패턴 분류기의 일반화 성능이 우수하다고 알려진 Extreme Learning Machine의 특성을 퍼지 집합 이론과 결합하여 퍼지 패턴 분류기의 일반화 성능을 개선하였다. 제안된 퍼지 패턴 분류기는 얼굴 인식 데이터를 이용하여 성능을 평가 하였다.

  • PDF

Steel-UHPC composite dowels' pull-out performance studies using machine learning algorithms

  • Zhihua Xiong;Zhuoxi Liang;Xuyao Liu;Markus Feldmann;Jiawen Li
    • Steel and Composite Structures
    • /
    • v.48 no.5
    • /
    • pp.531-545
    • /
    • 2023
  • Composite dowels are implemented as a powerful alternative to headed studs for the efficient combination of Ultra High-Performance Concrete (UHPC) with high-strength steel in novel composite structures. They are required to provide sufficient shear resistance and ensure the transmission of tensile forces in the composite connection in order to prevent lifting of the concrete slab. In this paper, the load bearing capacity of puzzle-shaped and clothoidal-shaped dowels encased in UHPC specimen were investigated based on validated experimental test data. Considering the influence of the embedment depth and the spacing width of shear dowels, the characteristics of UHPC square plate on the load bearing capacity of composite structure, 240 numeric models have been constructed and analyzed. Three artificial intelligence approaches have been implemented to learn the discipline from collected experimental data and then make prediction, which includes Artificial Neural Network-Particle Swarm Optimization (ANN-PSO), Adaptive Neuro-Fuzzy Inference System (ANFIS) and an Extreme Learning Machine (ELM). Among the factors, the embedment depth of composite dowel is proved to be the most influential parameter on the load bearing capacity. Furthermore, the results of the prediction models reveal that ELM is capable to achieve more accurate prediction.

Development of ELM based Load Modeling Method for Residential Loads (ELM을 이용한 주거용 부하의 부하모델링 기법 개발)

  • Jung, Young-Taek;Ji, Pyeong-Shik
    • The Transactions of the Korean Institute of Electrical Engineers P
    • /
    • v.61 no.1
    • /
    • pp.29-34
    • /
    • 2012
  • Due to the increasing of nonlinear loads such as converters and inverters connected to the electric power distribution system, and extensive application of harmonic generation sources with power electronic devices, disturbance of the electric power system and its influences on industries have been continuously increasing. Thus, it is difficult to construct accurate load model for active and reactive power in environments with harmonics. In this research, we develop a load modeling method based on Extreme Learning Machine(ELM) with fast learning procedure for residential loads. Using data sets acquired from various residential loads, the proposed method has been intensively tested. As the experimental results, we confirm that the proposed method makes it possible to effective estimate active and reactive powers than conventional methods.

Development of Daily Peak Power Demand Forecasting Algorithm using ELM (ELM을 이용한 일별 최대 전력 수요 예측 알고리즘 개발)

  • Ji, Pyeong-Shik;Kim, Sang-Kyu;Lim, Jae-Yoon
    • The Transactions of the Korean Institute of Electrical Engineers P
    • /
    • v.62 no.4
    • /
    • pp.169-174
    • /
    • 2013
  • Due to the increase of power consumption, it is difficult to construct an accurate prediction model for daily peak power demand. It is very important work to know power demand in next day to manage and control power system. In this research, we develop a daily peak power demand prediction method based on Extreme Learning Machine(ELM) with fast learning procedure. Using data sets between 2006 and 2010 in Korea, the proposed method has been intensively tested. As the prediction results, we confirm that the proposed method makes it possible to effective estimate daily peak power demand than conventional methods.

An ADHD Diagnostic Approach Based on Binary-Coded Genetic Algorithm and Extreme Learning Machine

  • Sachnev, Vasily;Suresh, Sundaram
    • Journal of Computing Science and Engineering
    • /
    • v.10 no.4
    • /
    • pp.111-117
    • /
    • 2016
  • An accurate approach for diagnosis of attention deficit hyperactivity disorder (ADHD) is presented in this paper. The presented technique efficiently classifies three subtypes of ADHD (ADHD-C, ADHD-H, ADHD-I) and typically developing control (TDC) by using only structural magnetic resonance imaging (MRI). The research examines structural MRI of the hippocampus from the ADHD-200 database. Each available MRI has been processed by a region-of-interest (ROI) to build a set of features for further analysis. The presented ADHD diagnostic approach unifies feature selection and classification techniques. The feature selection technique based on the proposed binary-coded genetic algorithm searches for an optimal subset of features extracted from the hippocampus. The classification technique uses a chosen optimal subset of features for accurate classification of three subtypes of ADHD and TDC. In this study, the famous Extreme Learning Machine is used as a classification technique. Experimental results clearly indicate that the presented BCGA-ELM (binary-coded genetic algorithm coupled with Extreme Learning Machine) efficiently classifies TDC and three subtypes of ADHD and outperforms existing techniques.

Development of Daily PV Power Forecasting Models using ELM (ELM을 이용한 일별 태양광발전량 예측모델 개발)

  • Lee, Chang-Sung;Ji, Pyeong-Shik
    • The Transactions of the Korean Institute of Electrical Engineers P
    • /
    • v.64 no.3
    • /
    • pp.164-168
    • /
    • 2015
  • Due to the uncertainty of weather, it is difficult to construct an accurate forecasting model for daily PV power generation. It is very important work to know PV power in next day to manage power system. In this paper, correlation analysis between weather and power generation was carried out and daily PV power forecasting models based on Extreme Learning Machine(ELM) was presented. Performance of district ELM model was compared with single ELM model. The proposed method has been tested using actual data set measured in 2014.

Development of Induction Motor Diagnosis Method by Variance Based Feature Selection and PCA-ELM (분산정보를 이용한 특징 선택과 PCA-ELM 기반의 유도전동기 고장진단 기법 개발)

  • Lee, Dae-Jong;Chun, Myung-Geun
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.24 no.8
    • /
    • pp.55-61
    • /
    • 2010
  • In this paper, we proposed selective extraction method of frequency information and PCA-ELM based diagnosis system for three-phase induction motors. As the first step for diagnosis procedure, DFT is performed to transform the acquired current signal into frequency domain. And then, frequency components are selected according to discriminate order calculated by variance As the next step, feature extraction is performed by principal component analysis (PCA). Finally, we used the classifier based on Extreme Learning Machine (ELM) with fast learning procedure. To show the effectiveness, the proposed diagnostic system has been intensively tested with the various data acquired under different electrical and mechanical faults with varying load.

Multi-gene genetic programming for the prediction of the compressive strength of concrete mixtures

  • Ghahremani, Behzad;Rizzo, Piervincenzo
    • Computers and Concrete
    • /
    • v.30 no.3
    • /
    • pp.225-236
    • /
    • 2022
  • In this article, Multi-Gene Genetic Programming (MGGP) is proposed for the estimation of the compressive strength of concrete. MGGP is known to be a powerful algorithm able to find a relationship between certain input space features and a desired output vector. With respect to most conventional machine learning algorithms, which are often used as "black boxes" that do not provide a mathematical formulation of the output-input relationship, MGGP is able to identify a closed-form formula for the input-output relationship. In the study presented in this article, MGPP was used to predict the compressive strength of plain concrete, concrete with fly ash, and concrete with furnace slag. A formula was extracted for each mixture and the performance and the accuracy of the predictions were compared to the results of Artificial Neural Network (ANN) and Extreme Learning Machine (ELM) algorithms, which are conventional and well-established machine learning techniques. The results of the study showed that MGGP can achieve a desirable performance, as the coefficients of determination for plain concrete, concrete with ash, and concrete with slag from the testing phase were equal to 0.928, 0.906, 0.890, respectively. In addition, it was found that MGGP outperforms ELM in all cases and its' accuracy is slightly less than ANN's accuracy. However, MGGP models are practical and easy-to-use since they extract closed-form formulas that may be implemented and used for the prediction of compressive strength.