Browse > Article
http://dx.doi.org/10.5351/CKSS.2002.9.3.809

A Study on Unbiased Methods in Constructing Classification Trees  

Lee, Yoon-Mo (Systembusiness Co., Ltd.)
Song, Moon Sup (Department of Statistics, Seoul National University)
Publication Information
Communications for Statistical Applications and Methods / v.9, no.3, 2002 , pp. 809-824 More about this Journal
Abstract
we propose two methods which separate the variable selection step and the split-point selection step. We call these two algorithms as CHITES method and F&CHITES method. They adapted some of the best characteristics of CART, CHAID, and QUEST. In the first step the variable, which is most significant to predict the target class values, is selected. In the second step, the exhaustive search method is applied to find the splitting point based on the selected variable in the first step. We compared the proposed methods, CART, and QUEST in terms of variable selection bias and power, error rates, and training times. The proposed methods are not only unbiased in the null case, but also powerful for selecting correct variables in non-null cases.
Keywords
variable selection bias; variable selection power; exhaustive search method;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Tree-structrued classification via generalized discriminant analysis /
[ Loh, W.Y.;Vanichsetakul, N. ] / Journal of the American Statistical Association   DOI   ScienceOn
2 /
[ Blake, C.L.;Merz, C.J. ] / UCI repository of machine learning databases
3 Split selection methods for classification trees /
[ Loh, W.Y.;Shih, Y.S. ] / Statistica Sinica
4 /
[ Quinlan, J.R. ] / C4.5 : Programs for Machine Learning
5 A Study on Bias Problems in Constructing Classification Trees /
[ Lee, Y.M. ] / Ph.D. Thesis
6 Classification trees with unbiased multiway splits /
[ Kim, H.;loh, W.Y. ] / Journal of the American statistical Association   DOI   ScienceOn
7 An Exploratory technique for investigating large quantities of categorical data /
[ Kass, G.V. ] / Applied Statistics   DOI   ScienceOn
8 A comparable study on variable selection methods in data mining software packages /
[ Song, m.S.;Yoon, Y.J. ] / Proceeding of the Tenth Japan and Korea Joint Conference of Statistics
9 /
[ Breiman, L.;Fredman, J.H.;Olshen. R.A.;Stone, C.J. ] / Classification and Regression Trees