International Journal of Fuzzy Logic and Intelligent Systems

  • 제16권2호
  • /
  • Pages.125-130
  • /
  • 2016
  • /
  • 1598-2645(pISSN)
  • /
  • 2093-744X(eISSN)
한국지능시스템학회 (Korean Institute of Intelligent Systems)
권호 표지
DOI QR코드

DOI QR Code

Pseudoinverse Matrix Decomposition Based Incremental Extreme Learning Machine with Growth of Hidden Nodes

  • 투고 : 2016.06.10
  • 심사 : 2016.06.16
  • 발행 : 2016.06.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

The proposal of this study is a fast version of the conventional extreme learning machine (ELM), called pseudoinverse matrix decomposition based incremental ELM (PDI-ELM). One of the main problems in ELM is to determine the number of hidden nodes. In this study, the number of hidden nodes is automatically determined. The proposed model is an incremental version of ELM which adds neurons with the goal of minimization the error of the ELM network. To speed up the model the information of pseudoinverse from previous step is taken into account in the current iteration. To show the ability of the PDI-ELM, it is applied to few benchmark classification datasets in the University of California Irvine (UCI) repository. Compared to ELM learner and two other versions of incremental ELM, the proposed PDI-ELM is faster.

키워드

참고문헌

  1. N. Y. Liang, G. B. Huang, P. Saratchandran, and N. Sundararajan, "A fast and accurate online sequential learning algorithm for feedforward networks," IEEE Transactions on Neural Networks, vol. 17, no. 6, pp. 1411-1423, 2006. http://dx.doi.org/10.1109/TNN.2006.880583
  2. G. B. Huang, H. Zhou, X. Ding, and R. Zhang, "Extreme learning machine for regression and multiclass classification," IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), vol. 42, no. 2, pp. 513-529, 2012. http://dx.doi.org/10.1109/TSMCB.2011.2168604
  3. Z. Bai, G. B. Huang, D. Wang, H. Wang, and M. B. Westover, "Sparse extreme learning machine for classification," IEEE Transactions on Cybernetics, vol. 44, no. 10, pp. 1858-1870, 2014. http://dx.doi.org/10.1109/TCYB.2014.2298235
  4. J. Luo, C. M. Vong, and P. K. Wong, "Sparse Bayesian extreme learning machine for multi-classification," IEEE Transactions on Neural Networks and Learning Systems, vol. 25, no. 4, pp. 836-843, 2014. http://dx.doi.org/10.1109/TNNLS.2013.2281839
  5. W. Zong, G. B. Huang, and Y. Chen, "Weighted extreme learning machine for imbalance learning," Neurocomputing, vol. 101, pp. 229-242, 2013. http://dx.doi.org/10.1016/j.neucom.2012.08.010
  6. G. B. Huang, Q. Y. Zhu, and C. K. Siew, "Extreme learning machine: a new learning scheme of feedforward neural networks," in Proceedings of IEEE International Joint Conference on Neural Networks, Budapest, Hungary, 2004, pp. 985-990. http://dx.doi.org/10.1109/IJCNN.2004.1380068
  7. Y. Miche, A. Sorjamaa, P. Bas, O. Simula, C. Jutten, and A. Lendasse, "OP-ELM: optimally pruned extreme learning machine," IEEE Transactions on Neural Networks, vol. 21, no. 1, pp. 158-162, 2010. http://dx.doi.org/10.1109/TNN.2009.2036259
  8. X. Bi, X. Zhao, G. Wang, P. Zhang, and C. Wang, "Distributed extreme learning machine with kernels based on MapReduce," Neurocomputing, vol. 149, pp. 456-463, 2015. http://dx.doi.org/10.1016/j.neucom.2014.01.070
  9. G. Huang, S. Song, J. N. D. Gupta, and C. Wu, "Semisupervised and unsupervised extreme learning machines," IEEE Transactions on Cybernetics, vol. 44, no. 12, pp. 2405-2417, 2014. http://dx.doi.org/10.1109/TCYB.2014.2307349
  10. G. B. Huang, L. Chen, and C. K. Siew, "Universal approximation using incremental constructive feedforward networks with random hidden nodes," IEEE Transactions on Neural Networks, vol. 17, no. 4, pp. 879-892, 2006. http://dx.doi.org/10.1109/TNN.2006.875977
  11. G. B. Huang, Q. Y. Zhu, and C. K. Siew, "Extreme learning machine: theory and applications," Neurocomputing, vol. 70, no. 1-3, pp. 489-501, 2006. http://dx.doi.org/10.1016/j.neucom.2005.12.126
  12. G. Feng, G. B. Huang, Q. Lin, and R. Gay, "Error minimized extreme learning machine with growth of hidden nodes and incremental learning," IEEE Transactions on Neural Networks, vol. 20, no. 8, pp. 1352-1357, 2009. http://dx.doi.org/10.1109/TNN.2009.2024147
  13. Y. Ye and Y. Qin, "QR factorization based incremental extreme learning machine with growth of hidden nodes," Pattern Recognition Letters, vol. 65, pp. 177-183, 2015. http://dx.doi.org/10.1016/j.patrec.2015.07.031
  14. T. N. E. Greville, "Some applications of the pseudoinverse of a matrix," SIAM Review, vol. 2, no. 1, pp. 15-22, 1960. http://dx.doi.org/10.1137/1002004