[KSCI] Korea Science Citation Index Service

http://dx.doi.org/10.17703/IJACT.2019.7.4.56

Analysis of Open-Source Hyperparameter Optimization Software Trends

Lee, Yo-Seob (School of ICT Convergence, Pyeongtaek University)
Moon, Phil-Joo (Dept. of Information & Communication, Pyeongtaek University)

Publication Information

International Journal of Advanced Culture Technology / v.7, no.4, 2019 , pp. 56-62 More about this Journal

Abstract

Recently, research using artificial neural networks has further expanded the field of neural network optimization and automatic structuring from improving inference accuracy. The performance of the machine learning algorithm depends on how the hyperparameters are configured. Open-source hyperparameter optimization software can be an important step forward in improving the performance of machine learning algorithms. In this paper, we review open-source hyperparameter optimization softwares.

Keywords

Hyperparameter Optimization; Machine Learning; Deep Learning; AutoML;

Citations & Related Records

Reference

1	Yonghyuk Moon, Ikhee Shin, Yongju Shin, Okgi Min, "Recent Research & Development Trends in Automated Machine Learning," Electronics and Telecommunications Trends, Vol. 34 No. 4, pp. 32-42, Aug 1, 2019. https://dx.doi.org/10.22648/ETRI.2019.J.340404
2	F. Hutter et al. (eds.), "Automated Machine Learning", The Springer Series on Challenges in Machine Learning, 2019, https://doi.org/10.1007/978-3-030-05318-5_1
3	Hyperparameter Optimization, https://en.wikipedia.org/wiki/Hyperparameter_optimization.
4	Claesen, Marc, and Bart De Moor. "Hyperparameter Search in Machine Learning", https://arxiv.org/abs/1502.02127
5	Hyperparameter, https://en.wikipedia.org/wiki/Hyperparameter_(machine_learning).
6	Scikit-learn, https://en.wikipedia.org/wiki/Scikit-learn.
7	Scikit-learn, https://scikit-learn.org/.
8	Tune, https://ray.readthedocs.io/en/latest/tune.html.
9	Hyperopt, https://github.com/hyperopt/hyperopt.
10	Auto-sklearn, https://github.com/automl/auto-sklearn.
11	BOCS, https://github.com/baptistar/BOCS.
12	DEAP, https://github.com/DEAP/deap.
13	scikit-optimize, https://github.com/scikit-optimize/scikit-optimize.
14	FAR-HO, https://github.com/lucfra/FAR-HO.
15	XGBoost, https://github.com/dmlc/xgboost.
16	DEvol, https://github.com/joeddav/devol.
17	mlrMBO, https://github.com/mlr-org/mlrMBO.