Browse > Article
http://dx.doi.org/10.12989/cac.2015.16.5.741

A comparative assessment of bagging ensemble models for modeling concrete slump flow  

Aydogmus, Hacer Yumurtaci (Department of Industrial Engineering, Alanya Alaaddin Keykubat University)
Erdal, Halil Ibrahim (Turkish Cooperation and Coordination Agency (TIKA))
Karakurt, Onur (Department of Civil Engineering, Gazi University)
Namli, Ersin (Department of Industrial Engineering, Istanbul University Engineering Faculty)
Turkan, Yusuf S. (Department of Industrial Engineering, Istanbul University Engineering Faculty)
Erdal, Hamit (Institude of Social Sciences, Ataturk University)
Publication Information
Computers and Concrete / v.16, no.5, 2015 , pp. 741-757 More about this Journal
Abstract
In the last decade, several modeling approaches have been proposed and applied to estimate the high-performance concrete (HPC) slump flow. While HPC is a highly complex material, modeling its behavior is a very difficult issue. Thus, the selection and application of proper modeling methods remain therefore a crucial task. Like many other applications, HPC slump flow prediction suffers from noise which negatively affects the prediction accuracy and increases the variance. In the recent years, ensemble learning methods have introduced to optimize the prediction accuracy and reduce the prediction error. This study investigates the potential usage of bagging (Bag), which is among the most popular ensemble learning methods, in building ensemble models. Four well-known artificial intelligence models (i.e., classification and regression trees CART, support vector machines SVM, multilayer perceptron MLP and radial basis function neural networks RBF) are deployed as base learner. As a result of this study, bagging ensemble models (i.e., Bag-SVM, Bag-RT, Bag-MLP and Bag-RBF) are found superior to their base learners (i.e., SVM, CART, MLP and RBF) and bagging could noticeable optimize prediction accuracy and reduce the prediction error of proposed predictive models.
Keywords
bagging (bootstrap aggregating); classification and regression trees; ensemble learning; multilayer perceptron; support vector machines;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Aertsen, W., Kint, V., Orshoven, J., Ozkan, K. and Muys, B. (2010), "Comparison and ranking of different modelling techniques for prediction of site index in Mediterranean mountain forests", Ecol. Model., 221, 1119-1130.   DOI
2 Abellan, J. and Masegosa, A.R. (2012), "Bagging schemes on the presence of class noise in classification", Exp. Syst. Appl., 39(8), 6827-6837.   DOI
3 Anderson, D. and McNeill, G. (1992), Artificial neural networks technology. Rome Laboratory, A DACS State of the Art Report, ELIN: A011, New York.
4 Basak, D., Pal, S. and Patranabis, D.C. (2007), "Support vector regression", Neu. Information Pro. Lett. Rev., 11(10), 203-224.
5 Borra, S. and Di Ciaccio, A. (2010), "Measuring the prediction error. A comparison of cross-validation, bootstrap and covariance penalty methods", Comput. Stat. Data An., 54(12), 2976-2989.   DOI
6 Breiman, L., Friedman, J.H., Olshen, R.A. and Stone, C.J. (1984), Classification and regression trees, Wadsworth, Int. Group, Belmont, California.
7 Breiman, L. (1996), "Bagging predictors", Mach. Learn., 24(2), 123-140.   DOI
8 Breiman, L. (1999), Using adaptive bagging to debias regressions., Technical Report No. 547 of University of CA, Berkeley.
9 Buhlmann, P. and Yu, B. (2002), "Analyzing bagging", Statist., 30(4), 927-961.   DOI
10 Chou, J.S. and Tsai, C.F. (2012), "Concrete compressive strength analysis using a combined classification and regression technique", Automat. Constr., 24, 52-60.   DOI
11 Chou, J.S. and Pham, A.D. (2013), "Enhanced artificial intelligence for ensemble approach to predicting high performance concrete compressive strength", Constr. Build. Mater., 49, 554-563.   DOI
12 Coppin, B. (2004), Artificial intelligence illuminated., Jones and Bartlett Publishers; Massachusetts.
13 Cortes, C. and Vapnik, V. (1995), "Support vector networks", Mach. Learn., 20, 273-297.
14 Erdal, H.I., Karakurt, O. and Namli, E. (2013), "High performance concrete compressive strength forecasting using ensemble models based on discrete wavelet transform", Eng. Appl. Artif. Intel., 26(4), 1246-1254.   DOI
15 Erdal, H.I. (2013), "Two-level and hybrid ensembles of decision trees for high performance concrete compressive strength prediction", Eng. Appl. Artif. Intel., 26(7), 1689-1697.   DOI
16 Erdal, H.I. and Karakurt, O. (2013), "Advancing monthly streamflowprediction accuracy of CART models using ensemble learning paradigms", J. Hydrol., 477, 119-128.   DOI
17 Ferraris, C.F. (1999), "Measurement of the rheological properties of high performance concrete: state of the art report", J. Res. Natl. Inst. Stan., 104(5), 461-478.   DOI
18 Ferraris, C.F., Brower, L., Ozyildirim, C. and Daczko, J. (2000), "Workability of self-compacting concrete", Int'l symposium on high performance concrete proceedings, Natl. Inst. Stan, Florida.
19 Gambhir, M.L. (2004), Concrete Technology, Tata McGraw-Hill Publishing Company Limited.
20 Hancock, T., Put, R., Coomans, D., Vanderheyden, Y. and Everingham,Y. (2005), "A performance comparison of modern statistical techniques for molecular descriptor selection and retention prediction in chromatographic QSRR studies", Chem. Intel. Lab.Syst., 76 (2), 185-196.   DOI
21 Haykin, S. (1999), Neural Networks: A comprehensive foundation, 2nd Editions Pearson Education, 9th Indian reprint 2005, India.
22 Heshmati, A.A.R., Salehzade, H., Alavi, A.H., Gandomi, A.H. and Abadi, M.M. (2008), "A multi expression programming application to high performance concrete", World Appl. Sci. J., 5(2), 215-223.
23 Jia, J., Xiao, X., Liu, B. and Jiao, L. (2011), "Bagging-based spectral clustering ensemble selection", Pattern Recogn. Lett., 32(10),1456-1467.   DOI
24 Karakurt, O., Erdal, H.I., Namli, E., Yumurtaci Aydogmus, H. and Turkan, Y.S. (2013), "Comparing ensembles of decision trees and neural networks for one-day-ahead streamflow prediction", Sci. Res. J. (SCIRJ), I(IV).
25 Kewalramani, M.A. and Gupta, R. (2006), "Concrete compressive strength prediction using ultrasonic pulse velocity through artificial neural networks", Automat. Constr., 15(3), 374-379.   DOI
26 Minqiang, Li., Tian, Jin. and Fuzan, Chen. (2008), "Improving multiclass pattern recognition with a co-evolutionary RBFNN", Pattern Recogn. Lett., 29(4), 392-406.   DOI
27 Li, Y. (2006), "Predicting materials properties and behavior using classification and regression trees", Mater. Sci. Eng. A, 433, 261-268.   DOI
28 Nanthagopalan, P. and Santhanam, M. (2011), "Fresh and hardened properties of self-compacting concrete produced with manufactured sand", Cement Concrete Comp., 33(3), 353-358.   DOI
29 Orr, M.J.L. (1996), Introduction to radial basis function networks: centre for cognitive science, University of Edinburgh.
30 Osman, I.H. and Laporte, G. (1996), "Metaheuristics: a bibliography", Ann. Oper. Res., 63, 513-623.
31 Pino-Mejias, R., Jimenez-Gamero, M.D., Cubiles-de-la-Vega, M.D. and Pascual-Acosta, A. (2008), "Reduced bootstrap aggregating of learning algorithms", Pattern Recogn. Lett., 29, 265-271.   DOI
32 Refaeilzadeh, P., Tang, L. and Liu, H. (2009), Cross-validation, Encyclopedia of database systems. Springer.
33 Rodriguez, J.D., Perez, A. and Lozano, J.A. (2010), "Sensitivity analysis of k-fold cross validation in prediction error estimation", Pattern Anal. Mach. Intel., IEEE Tran., 32(3), 569-575.   DOI
34 Thomas, P. and Thomas, A. (2011), "Multilayer perceptron for simulation models reduction: application to a sawmill workshop", Eng. Appl. Artif. Intel., 24, 646-657.   DOI
35 Topcu, I.B. and Saridemir, M. (2008), "Prediction of compressive strength of concrete containing fly ash using artificial neural networks and fuzzy logic", Comput. Mater. Sci., 41(3), 305-311.   DOI
36 Tregger, N., Gregori, A., Ferrara, L. and Shah, S. (2012), "Correlating dynamic segregation of self-consolidating concrete to the slump-flow test", Constr. Build. Mater., 28, 499-505.   DOI
37 Vapnik, V.N. (2000), The Nature of Statistical Learning Theory, 2nd Editions, Springer-verlag New York Inc.
38 Wang, G., Hao, J., Mab. J. and Jiang, H. (2011), "A comparative assessment of ensemble learning for credit scoring", Exp. Syst. Appl., 38, 223-230.   DOI
39 Wang, G., Ma, J., Huang, L. and Xu, K. (2012), "Two credit scoring models based on dual strategy ensemble trees", Knowl. Based Syst., 26, 61-68.   DOI
40 Yeh, I.C. (2007), "Modeling slump flow of concrete using second-order regressions and artificial neural networks", Cement Concrete Comp., 29, 474-480.   DOI
41 Yen, T., Tang, C.W., Chang, C.S. and Chen, K.H. (1999), "Flow behaviour of high strength high-performance concrete", Cement Concrete Comp., 21, 413-424.   DOI
42 Vapnik, V., Golowich, S.E. and Smola, A. (1996), "Support vector method for function approximation, regression estimation, and signal processing", Adv. Neu. Inform. Pr. Syst. 9.