• Title/Summary/Keyword: regression trees

Search Result 245, Processing Time 0.026 seconds

A Study for Improving the Performance of Data Mining Using Ensemble Techniques (앙상블기법을 이용한 다양한 데이터마이닝 성능향상 연구)

  • Jung, Yon-Hae;Eo, Soo-Heang;Moon, Ho-Seok;Cho, Hyung-Jun
    • Communications for Statistical Applications and Methods
    • /
    • v.17 no.4
    • /
    • pp.561-574
    • /
    • 2010
  • We studied the performance of 8 data mining algorithms including decision trees, logistic regression, LDA, QDA, Neral network, and SVM and their combinations of 2 ensemble techniques, bagging and boosting. In this study, we utilized 13 data sets with binary responses. Sensitivity, Specificity and missclassificate error were used as criteria for comparison.

회귀나무에서 변수선택 편의에 관한 연구

  • Kim, Min-Ho;Kim, Jin-Heum
    • Proceedings of the Korean Statistical Society Conference
    • /
    • 2003.10a
    • /
    • pp.263-268
    • /
    • 2003
  • Breiman, Friedman, Olshen and Stone(1984)의 전체탐색법에 의한 회귀나무는 상대적으로 많은 분리가 가능한 변수로 분리기준이 정해지는 편의 현상을 갖고 있다. 본 연구에서는 이런 문제점을 해결할 수 있는 알고리즘을 제안하여 변수선택편의가 없는 회귀나무를 만들고자 한다. 제안하는 알고리즘은 노드의 분리변수를 선택하는 단계와 그 선택된 변수에 의해 이진분리를 위한 분리점을 찾는 단계로 구성되어 있다. 예측변수 중에서 목표변수와 가장 밀접하게 연관된 예측변수는 예측변수의 자료의 종류에 따라 스피어만의 순위상관계수에 의한 검정 혹은 크루스칼-왈리스의 통계량에 의한 검정을 수행하여 가장 통계적으로 유의한 변수로 선택하였고, 선택된 변수에만 Breiman et al.(1984)의 전체선택법을 적용하여 분리점을 결정하였다. 모의실험을 통해 변수선택편의, 변수선택력 , 그리고 평균제곱오차 측면에서 Breiman et al. (1984)의 CART(Classification and Regression Trees)와 제안한 알고리즘을 서로 비교하였다. 또한, 두 알고리즘을 실제 자료에 적용하여 효율을 서로 비교하였다.

  • PDF

The Construction Methodology of a Rule-based Expert System using CART-based Decision Tree Method (CART 알고리즘 기반의 의사결정트리 기법을 이용한 규칙기반 전문가 시스템 구축 방법론)

  • Ko, Yun-Seok
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.6 no.6
    • /
    • pp.849-854
    • /
    • 2011
  • To minimize the spreading effect from the events of the system, a rule-based expert system is very effective. However, because the events of the large-scale system are diverse and the load condition is very variable, it is very difficult to construct the rule-based expert system. To solve this problem, this paper studies a methodology which constructs a rule-based expert system by applying a CART(Classification and Regression Trees) algorithm based decision tree determination method to event case examples.

Performance Comparison of Decision Trees of J48 and Reduced-Error Pruning

  • Jin, Hoon;Jung, Yong Gyu
    • International journal of advanced smart convergence
    • /
    • v.5 no.1
    • /
    • pp.30-33
    • /
    • 2016
  • With the advent of big data, data mining is more increasingly utilized in various decision-making fields by extracting hidden and meaningful information from large amounts of data. Even as exponential increase of the request of unrevealing the hidden meaning behind data, it becomes more and more important to decide to select which data mining algorithm and how to use it. There are several mainly used data mining algorithms in biology and clinics highlighted; Logistic regression, Neural networks, Supportvector machine, and variety of statistical techniques. In this paper it is attempted to compare the classification performance of an exemplary algorithm J48 and REPTree of ML algorithms. It is confirmed that more accurate classification algorithm is provided by the performance comparison results. More accurate prediction is possible with the algorithm for the goal of experiment. Based on this, it is expected to be relatively difficult visually detailed classification and distinction.

A Unit Selection Methods using Variable Break in a Japanese TTS (일본어 TTS의 가변 Break를 이용한 합성단위 선택 방법)

  • Na, Deok-Su;Bae, Myung-Jin
    • Proceedings of the IEEK Conference
    • /
    • 2008.06a
    • /
    • pp.983-984
    • /
    • 2008
  • This paper proposes a variable break that can offset prediction error as well as a pre-selection methods, based on the variable break, for enhanced unit selection. In Japanese, a sentence consists of several APs (Accentual phrases) and MPs (Major phrases), and the breaks between these phrases must predicted to realize text-to-speech systems. An MP also consists of several APs and plays a decisive role in making synthetic speech natural and understandable because short pauses appear at its boundary. The variable break is defined as a break that is able to change easily from an AP to an MP boundary, or from an MP to an AP boundary. Using CART (Classification and Regression Trees), the variable break is modeled stochastically, and then we pre-select candidate units in the unit-selection process. As the experimental results show, it was possible to complement a break prediction error and improve the naturalness of synthetic speech.

  • PDF

Evaluation of Ultrasound for Prediction of Carcass Meat Yield and Meat Quality in Korean Native Cattle (Hanwoo)

  • Song, Y.H.;Kim, S.J.;Lee, S.K.
    • Asian-Australasian Journal of Animal Sciences
    • /
    • v.15 no.4
    • /
    • pp.591-595
    • /
    • 2002
  • Three hundred thirty five progeny testing steers of Korean beef cattle were evaluated ultrasonically for back fat thickness (BFT), longissimus muscle area (LMA) and intramuscular fat (IF) before slaughter. Class measurements associated with the Korean yield grade and quality grade were also obtained. Residual standard deviation between ultrasonic estimates and carcass measurements of BFT, LMA were 1.49 mm and $0.96cm^2$. The linear correlation coefficients (p<0.01) between ultrasonic estimates and carcass measurements of BFT, LMA and IF were 0.75, 0.57 and 0.67, respectively. Results for improving predictions of yield grade by four methods-the Korean yield grade index equation, fat depth alone, regression and decision tree methods were 75.4%, 79.6%, 64.3% and 81.4%, respectively. We conclude that the decision tree method can easily predict yield grade and is also useful for increasing prediction accuracy rate.

The Within-tree Variation in Wood Density and Mechanical Properties and Their Relationship in Juniperus polycarpos

  • Kiaei, Majid;Bakhshi, Reza;Saffari, Mohsen;Golkari, Sadegh
    • Journal of Forest and Environmental Science
    • /
    • v.31 no.4
    • /
    • pp.267-271
    • /
    • 2015
  • The variations of wood density and mechanical properties of Juniperus polycarpos trees were studied in a natural forest in Iran. Sample disks were taken from each tree to examine wood density and mechanical properties (MOE and MOR) from pith to bark at breast height, 50%, and 75% of total tree height. The analysis of variance (ANOVA) indicated that radial position and height significantly affected all wood properties. The wood density, MOE and MOR were decreased along horizontal position from the pith to the bark and vertical direction from base upwards. Regression analysis showed that modulus of elasticity (MOE) and modulus of rupture (MOR) had a positive correlation with wood density.

Soil Environment's Impact on the Growth of Pinus thunbergii by Season in Urban Forests (도시림의 계절별 토양환경이 곰솔의 생육에 미치는 영향)

  • Kim, Seok-Kyu
    • Journal of Environmental Impact Assessment
    • /
    • v.20 no.4
    • /
    • pp.455-464
    • /
    • 2011
  • The purpose of this study is to clarify correlations between soil environments and the growth of trees in forests and thereon analyze effects of seasonal changes in such environments on such growth. To determine seasonal factors of soil affecting the Tree Vitality of Pinus thunbergii, first of all, the study designated the Tree Vitality as a dependent variable and soil hardness, moisture, pH, K, Na, Mg and Ca as independent variables. Then the study performed Pearson's coefficient analysis. To clarify what soil factors influence the seasonal growth of Pinus thunbergii multiple regression analysis is carried out, and findings are as follow; the growth of Pinus thunbergii was basically influenced by pH, followed by soil hardness in spring, K, followed by moisture in summer, and by soil hardness in winter. However, no soil factors affected the vitality at the significance level of 5% for t.

Crown Competition on the Relation of Crown Width to Diameter at Breast Height of Trees (樹木의 胸高直經과 樹冠너비와의 關係로 본 樹冠競爭)

  • Park, Bong Kyu;Ok-Kyung Kim
    • The Korean Journal of Ecology
    • /
    • v.8 no.4
    • /
    • pp.197-200
    • /
    • 1985
  • The relations of crown width and DBH for Pinus densiflora, Pinus rigida, Pinus koraiensis, and Ginkgo biloba were accomplished to estimate the level of crown competition. Measurements of the relations revealed that crown width and DBH were highly correlated for the same species. Also it seems that these relations are independent of age and site quality. The results of regression analysis were as follow: P. densiflora, Y=0.3477X+0.3828 r=0.95 p. rigida, Y=0.3537X+0.1645 r=0.95 P. koraiensis, Y=0.2895X+0.6310 r=0.92 G. biloba, Y=0.4360X+0.0995 r=0.90 The significant differences between G. biloba and pine species seems due to their structural differences of crown formation according to tree species. As results of computing Maximum Crown Area and Crown Competition Factor as indices of crown competition, they indicated that P. densiflora would grow better under the natural conditions.

  • PDF

Ensemble Methods Applied to Classification Problem

  • Kim, ByungJoo
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.11 no.1
    • /
    • pp.47-53
    • /
    • 2019
  • The idea of ensemble learning is to train multiple models, each with the objective to predict or classify a set of results. Most of the errors from a model's learning are from three main factors: variance, noise, and bias. By using ensemble methods, we're able to increase the stability of the final model and reduce the errors mentioned previously. By combining many models, we're able to reduce the variance, even when they are individually not great. In this paper we propose an ensemble model and applied it to classification problem. In iris, Pima indian diabeit and semiconductor fault detection problem, proposed model classifies well compared to traditional single classifier that is logistic regression, SVM and random forest.