• Title/Summary/Keyword: Decision Tree analysis

Search Result 725, Processing Time 0.03 seconds

Classification and Analysis of Data Mining Algorithms (데이터마이닝 알고리즘의 분류 및 분석)

  • Lee, Jung-Won;Kim, Ho-Sook;Choi, Ji-Young;Kim, Hyon-Hee;Yong, Hwan-Seung;Lee, Sang-Ho;Park, Seung-Soo
    • Journal of KIISE:Databases
    • /
    • v.28 no.3
    • /
    • pp.279-300
    • /
    • 2001
  • Data mining plays an important role in knowledge discovery process and usually various existing algorithms are selected for the specific purpose of the mining. Currently, data mining techniques are actively to the statistics, business, electronic commerce, biology, and medical area and currently numerous algorithms are being researched and developed for these applications. However, in a long run, only a few algorithms, which are well-suited to specific applications with excellent performance in large database, will survive. So it is reasonable to focus our effort on those selected algorithms in the future. This paper classifies about 30 existing algorithms into 7 categories - association rule, clustering, neural network, decision tree, genetic algorithm, memory-based reasoning, and bayesian network. First of all, this work analyzes systematic hierarchy and characteristics of algorithms and we present 14 criteria for classifying the algorithms and the results based on this criteria. Finally, we propose the best algorithms among some comparable algorithms with different features and performances. The result of this paper can be used as a guideline for data mining researches as well as field applications of data mining.

  • PDF

Classification of Soil Creep Hazard Class Using Machine Learning (기계학습기법을 이용한 땅밀림 위험등급 분류)

  • Lee, Gi Ha;Le, Xuan-Hien;Yeon, Min Ho;Seo, Jun Pyo;Lee, Chang Woo
    • Journal of Korean Society of Disaster and Security
    • /
    • v.14 no.3
    • /
    • pp.17-27
    • /
    • 2021
  • In this study, classification models were built using machine learning techniques that can classify the soil creep risk into three classes from A to C (A: risk, B: moderate, C: good). A total of six machine learning techniques were used: K-Nearest Neighbor, Support Vector Machine, Logistic Regression, Decision Tree, Random Forest, and Extreme Gradient Boosting and then their classification accuracy was analyzed using the nationwide soil creep field survey data in 2019 and 2020. As a result of classification accuracy analysis, all six methods showed excellent accuracy of 0.9 or more. The methods where numerical data were applied for data training showed better performance than the methods based on character data of field survey evaluation table. Moreover, the methods learned with the data group (R1~R4) reflecting the expert opinion had higher accuracy than the field survey evaluation score data group (C1~C4). The machine learning can be used as a tool for prediction of soil creep if high-quality data are continuously secured and updated in the future.

Stock Price Direction Prediction Using Convolutional Neural Network: Emphasis on Correlation Feature Selection (합성곱 신경망을 이용한 주가방향 예측: 상관관계 속성선택 방법을 중심으로)

  • Kyun Sun Eo;Kun Chang Lee
    • Information Systems Review
    • /
    • v.22 no.4
    • /
    • pp.21-39
    • /
    • 2020
  • Recently, deep learning has shown high performance in various applications such as pattern analysis and image classification. Especially known as a difficult task in the field of machine learning research, stock market forecasting is an area where the effectiveness of deep learning techniques is being verified by many researchers. This study proposed a deep learning Convolutional Neural Network (CNN) model to predict the direction of stock prices. We then used the feature selection method to improve the performance of the model. We compared the performance of machine learning classifiers against CNN. The classifiers used in this study are as follows: Logistic Regression, Decision Tree, Neural Network, Support Vector Machine, Adaboost, Bagging, and Random Forest. The results of this study confirmed that the CNN showed higher performancecompared with other classifiers in the case of feature selection. The results show that the CNN model effectively predicted the stock price direction by analyzing the embedded values of the financial data

Development and Validation of MRI-Based Radiomics Models for Diagnosing Juvenile Myoclonic Epilepsy

  • Kyung Min Kim;Heewon Hwang;Beomseok Sohn;Kisung Park;Kyunghwa Han;Sung Soo Ahn;Wonwoo Lee;Min Kyung Chu;Kyoung Heo;Seung-Koo Lee
    • Korean Journal of Radiology
    • /
    • v.23 no.12
    • /
    • pp.1281-1289
    • /
    • 2022
  • Objective: Radiomic modeling using multiple regions of interest in MRI of the brain to diagnose juvenile myoclonic epilepsy (JME) has not yet been investigated. This study aimed to develop and validate radiomics prediction models to distinguish patients with JME from healthy controls (HCs), and to evaluate the feasibility of a radiomics approach using MRI for diagnosing JME. Materials and Methods: A total of 97 JME patients (25.6 ± 8.5 years; female, 45.5%) and 32 HCs (28.9 ± 11.4 years; female, 50.0%) were randomly split (7:3 ratio) into a training (n = 90) and a test set (n = 39) group. Radiomic features were extracted from 22 regions of interest in the brain using the T1-weighted MRI based on clinical evidence. Predictive models were trained using seven modeling methods, including a light gradient boosting machine, support vector classifier, random forest, logistic regression, extreme gradient boosting, gradient boosting machine, and decision tree, with radiomics features in the training set. The performance of the models was validated and compared to the test set. The model with the highest area under the receiver operating curve (AUROC) was chosen, and important features in the model were identified. Results: The seven tested radiomics models, including light gradient boosting machine, support vector classifier, random forest, logistic regression, extreme gradient boosting, gradient boosting machine, and decision tree, showed AUROC values of 0.817, 0.807, 0.783, 0.779, 0.767, 0.762, and 0.672, respectively. The light gradient boosting machine with the highest AUROC, albeit without statistically significant differences from the other models in pairwise comparisons, had accuracy, precision, recall, and F1 scores of 0.795, 0.818, 0.931, and 0.871, respectively. Radiomic features, including the putamen and ventral diencephalon, were ranked as the most important for suggesting JME. Conclusion: Radiomic models using MRI were able to differentiate JME from HCs.

Effective Studying Methods during a School Vacation: A Data Mining Approach (데이타 마이닝을 사용한 방학 중 학습방법과 학업성취도의 관계 분석)

  • Kim, Hea-Suk;Moon, Yang-Sae;Kim, Jin-Ho;Loh, Woong-Kee
    • Journal of KIISE:Software and Applications
    • /
    • v.34 no.1
    • /
    • pp.40-51
    • /
    • 2007
  • To improve academic achievement, the most students not only participate in regular classes but also take various extra programs such as private lessons, private institutes, and educational TV programs. In this paper, we propose a data mining approach to identify which studying methods or usual life patterns during a school vacation affect changes in the academic achievement. First, we derive various studying methods and life patterns that are thought to be affecting changes in the academic achievement during a school vacation. Second, we propose the method of transforming and analyzing data to apply them to decision trees and association rules, which are representative data mining techniques. Third, we construct decision trees and find association rules from the real survey data of middle school students. We have discovered four representative results from the decision trees. First, for students in the higher rank, there is a tendency that private institutes give a positive effect on the academic achievement. Second, for the most students, the Internet teaming sites nay give a negative effect on the achievement. Third, private lessons that have thought to be making a large impact to the achievement, however, do not make a positive effect on the achievement. Fourth, taking several studying methods in parallel nay give a negative effect on the achievement. In association rules, however, we cannot find any meaningful relationships between academic achievement and usual life patterns during a school vacation. We believe that our approach will be very helpful for teachers and parents to give a good direction both in preparing a studying plan and in selecting studying methods during a school vacation.

A study on the characteristics of cyanobacteria in the mainstream of Nakdong river using decision trees (의사결정나무를 이용한 낙동강 본류 구간의 남조류 발생특성 연구)

  • Jung, Woo Suk;Jo, Bu Geon;Kim, Young Do;Kim, Sung Eun
    • Journal of Wetlands Research
    • /
    • v.21 no.4
    • /
    • pp.312-320
    • /
    • 2019
  • The occurrence of cyanobacteria causes problems such as oxygen depletion and increase of organic matter in the water body due to mass prosperity and death. Each year, Algae bloom warning System is issued due to the effects of summer heat and drought. It is necessary to quantitatively characterize the occurrence of cyanobacteria for proactive green algae management in the main Nakdong river. In this study, we analyzed the major influencing factors on cyanobacteria bloom using visualization and correlation analysis. A decision tree, a machine learning method, was used to quantitatively analyze the conditions of cyanobacteria according to the influence factors. In all the weirs, meteorological factors, temperature and SPI drought index, were significantly correlated with cyanobacterial cell number. Increasing the number of days of heat wave and drought block the mixing of water in the water body and the stratification phenomenon to promote the development of cyanobacteria. In the long term, it is necessary to proactively manage cyanobacteria considering the meteorological impacts.

A Comparative Analysis of Ensemble Learning-Based Classification Models for Explainable Term Deposit Subscription Forecasting (설명 가능한 정기예금 가입 여부 예측을 위한 앙상블 학습 기반 분류 모델들의 비교 분석)

  • Shin, Zian;Moon, Jihoon;Rho, Seungmin
    • The Journal of Society for e-Business Studies
    • /
    • v.26 no.3
    • /
    • pp.97-117
    • /
    • 2021
  • Predicting term deposit subscriptions is one of representative financial marketing in banks, and banks can build a prediction model using various customer information. In order to improve the classification accuracy for term deposit subscriptions, many studies have been conducted based on machine learning techniques. However, even if these models can achieve satisfactory performance, utilizing them is not an easy task in the industry when their decision-making process is not adequately explained. To address this issue, this paper proposes an explainable scheme for term deposit subscription forecasting. For this, we first construct several classification models using decision tree-based ensemble learning methods, which yield excellent performance in tabular data, such as random forest, gradient boosting machine (GBM), extreme gradient boosting (XGB), and light gradient boosting machine (LightGBM). We then analyze their classification performance in depth through 10-fold cross-validation. After that, we provide the rationale for interpreting the influence of customer information and the decision-making process by applying Shapley additive explanation (SHAP), an explainable artificial intelligence technique, to the best classification model. To verify the practicality and validity of our scheme, experiments were conducted with the bank marketing dataset provided by Kaggle; we applied the SHAP to the GBM and LightGBM models, respectively, according to different dataset configurations and then performed their analysis and visualization for explainable term deposit subscriptions.

A CRM Study on the Using of Data Mining - Focusing on the "A" Fashion Company - (데이타마이닝을 이용(利用)한 CRM 사례연구(事例硏究) - A 패션기업(企業)을 중심(中心)으로 -)

  • Lee, Yu-Soon
    • Journal of Fashion Business
    • /
    • v.6 no.5
    • /
    • pp.136-150
    • /
    • 2002
  • In this study, we proposed a method to be standing customers as the supporting system for the improvement of fashion garment industry which was the marginal growth getting into full maturity of market. As for the customer creation method of Fashion garment company is developing a marketing program to be standing customer as customer scoring to estimate a existing customer‘s buying power, and figure out minimum fixed sales of company to use a future purchasing predict. This study was a result of data from total sixty thousands data to be created for the 11 months from september. 2000 to July. 2001. The data is part of which the company leading the Korean fashion garment industry has a lot of a customer purchasing history data. But this study used only 48,845 refined purchased data to discriminate from sixty thousands data and 21,496 customer case with the exception of overlapping purchased data among of those. The software used to handle sixty thousands data was SAS e-miner. As the analysis process is put in to operation the analysis of the purchasing customer’s profile firstly, and the second come into basket analysis to consider the buying associations for Association goods, the third estimate the customer grade of Customer loyalty by 3 ways of logit regression analysis, decision tree, Artificial Neural Network. The result suggested a method to be estimate the customer loyalty as 3 independent variables, 2 coefficients. The 3 independent variables are total purchasing amount, purchasing items per one purchase, payment amount by one purchasing item. The 2 coefficients are royal and normal for customer segmentation. The result was that this model use a logit regression analysis was valid as the method to be estimate the customer loyalty.

A Systematic Review of Economic Analysis on Idiopathic Short Stature (특발성 저신장의 경제성 평가 연구 경향 분석: 체계적 문헌고찰)

  • Lee, Boram;Kwon, Chan-Young;Jang, Soobin
    • The Journal of Pediatrics of Korean Medicine
    • /
    • v.35 no.2
    • /
    • pp.1-10
    • /
    • 2021
  • Objectives We aimed to examine health-related economic analysis of available interventions on idiopathic short stature (ISS). Methods Eight studies were reviewed from English, Korean, and Chinese databases which were published up to December 24, 2020. Effectiveness, utility, and cost data were extracted from the studies and descriptive analysis of the individual studies was conducted Results Five studies were chosen. In the two economic evaluation studies, the incremental cost-effectiveness ratio (ICER) of growth hormone (GH) treatment was presented by performing cost-effectiveness analysis based on the deterministic decision tree approach for the GH and untreated group. Final adult height and direct medical costs were analyzed as effectiveness and cost outcomes. In 1 review article, an ICER of GH was presented based on systematic review on the effects of the GH treatment. In the two clinical trials, the effectiveness and cost of the 12 months Oriental medicine combination treatment were presented in comparison with the GH treatment alone. There were no literatures that provided utility data of available intervention on ISS. Conclusions The results of this study will be used as basic data for the economic analysis of Oriental medicine treatment on ISS in the future.

Exploring On-line Consumption Tendency of Sports 4.0 Market Consumer: Focused on Sports Goods Consumption by Generation of Working Age Population (스포츠 4.0 시장 소비자의 온라인 소비성향 탐색: 생산 가능인구의 세대별 스포츠 용품 소비를 중심으로)

  • Jin-Ho Shin
    • Journal of the Korean Applied Science and Technology
    • /
    • v.40 no.1
    • /
    • pp.24-34
    • /
    • 2023
  • This study sought to explore the online consumption propensity of sports goods by generation of the productive population and to provide basic data to predict the future consumption market by segmenting online consumers in the sports 4.0 market. Therefore, this survey was conducted on those who consumed sports goods among the generation-specific groups (Generation Y and above, Z) of the productive population, and a total of 478 people's data were applied to the final analysis. Data processing was conducted with SPSS statistics (ver.21.0), frequency analysis, exploratory factor analysis, correlation analysis of re-examination reliability, reliability analysis, and decision tree analysis. According to the online consumption propensity of sports goods by generation of the productive population, there is a high probability of being classified as Generation Z group if the factors of leisure, joy, and environment are high. In addition, the classification accuracy of such a model was 69.7%.