• Journal of the Korea Society for Simulation
• /
• v.32 no.4
• /
• pp.19-26
• /
• 2023

The increase in the dropout rate of college students nationwide has a serious negative impact on universities and society as well as individual students. In order to proactive identify students at risk of dropout, this study built a decision tree, random forest, logistic regression, and deep learning-based dropout prediction model using academic data that can be easily obtained from each university's academic management system. Their performances were subsequently analyzed and compared. The analysis revealed that while the logistic regression-based prediction model exhibited the highest recall rate, its f-1 value and ROC-AUC (Receiver Operating Characteristic - Area Under the Curve) value were comparatively lower. On the other hand, the random forest-based prediction model demonstrated superior performance across all other metrics except recall value. In addition, in order to assess model performance over distinct prediction periods, we divided these periods into short-term (within one semester), medium-term (within two semesters), and long-term (within three semesters). The results underscored that the long-term prediction yielded the highest predictive efficacy. Through this study, each university is expected to be able to identify students who are expected to be dropped out early, reduce the dropout rate through intensive management, and further contribute to the stabilization of university finances.

• Advanced Industrial SCIence
• /
• v.3 no.2
• /
• pp.8-16
• /
• 2024

This paper shows the system of drug classification, the goal of this is to foretell the apt drug for the patients based on their demographic and physiological traits. The dataset consists of various attributes like Age, Sex, BP (Blood Pressure), Cholesterol Level, and Na_to_K (Sodium to Potassium ratio), with the objective to determine the kind of drug being given. The models used in this paper are K-Nearest Neighbors (KNN), Logistic Regression and Random Forest. Further to fine-tune hyper parameters using 5-fold cross-validation, GridSearchCV was used and each model was trained and tested on the dataset. To assess the performance of each model both with and without hyper parameter tuning evaluation metrics like accuracy, confusion matrices, and classification reports were used and the accuracy of the models without GridSearchCV was 0.7, 0.875, 0.975 and with GridSearchCV was 0.75, 1.0, 0.975. According to GridSearchCV Logistic Regression is the most suitable model for drug classification among the three-model used followed by the K-Nearest Neighbors. Also, Na_to_K is an essential feature in predicting the outcome.

• Information Systems Review
• /
• v.22 no.4
• /
• pp.21-39
• /
• 2020

Recently, deep learning has shown high performance in various applications such as pattern analysis and image classification. Especially known as a difficult task in the field of machine learning research, stock market forecasting is an area where the effectiveness of deep learning techniques is being verified by many researchers. This study proposed a deep learning Convolutional Neural Network (CNN) model to predict the direction of stock prices. We then used the feature selection method to improve the performance of the model. We compared the performance of machine learning classifiers against CNN. The classifiers used in this study are as follows: Logistic Regression, Decision Tree, Neural Network, Support Vector Machine, Adaboost, Bagging, and Random Forest. The results of this study confirmed that the CNN showed higher performancecompared with other classifiers in the case of feature selection. The results show that the CNN model effectively predicted the stock price direction by analyzing the embedded values of the financial data

• Korean Journal of Radiology
• /
• v.23 no.12
• /
• pp.1281-1289
• /
• 2022

Objective: Radiomic modeling using multiple regions of interest in MRI of the brain to diagnose juvenile myoclonic epilepsy (JME) has not yet been investigated. This study aimed to develop and validate radiomics prediction models to distinguish patients with JME from healthy controls (HCs), and to evaluate the feasibility of a radiomics approach using MRI for diagnosing JME. Materials and Methods: A total of 97 JME patients (25.6 ± 8.5 years; female, 45.5%) and 32 HCs (28.9 ± 11.4 years; female, 50.0%) were randomly split (7:3 ratio) into a training (n = 90) and a test set (n = 39) group. Radiomic features were extracted from 22 regions of interest in the brain using the T1-weighted MRI based on clinical evidence. Predictive models were trained using seven modeling methods, including a light gradient boosting machine, support vector classifier, random forest, logistic regression, extreme gradient boosting, gradient boosting machine, and decision tree, with radiomics features in the training set. The performance of the models was validated and compared to the test set. The model with the highest area under the receiver operating curve (AUROC) was chosen, and important features in the model were identified. Results: The seven tested radiomics models, including light gradient boosting machine, support vector classifier, random forest, logistic regression, extreme gradient boosting, gradient boosting machine, and decision tree, showed AUROC values of 0.817, 0.807, 0.783, 0.779, 0.767, 0.762, and 0.672, respectively. The light gradient boosting machine with the highest AUROC, albeit without statistically significant differences from the other models in pairwise comparisons, had accuracy, precision, recall, and F1 scores of 0.795, 0.818, 0.931, and 0.871, respectively. Radiomic features, including the putamen and ventral diencephalon, were ranked as the most important for suggesting JME. Conclusion: Radiomic models using MRI were able to differentiate JME from HCs.

• Journal of Trauma and Injury
• /
• v.37 no.3
• /
• pp.201-208
• /
• 2024

Purpose: The number of elderly patients with trauma is increasing; therefore, precise models are necessary to estimate the mortality risk of elderly patients with trauma for informed clinical decision-making. This study aimed to develop machine learning based predictive models that predict 30-day mortality in severely injured elderly patients with trauma and to compare the predictive performance of various machine learning models. Methods: This study targeted patients aged ≥65 years with an Injury Severity Score of ≥15 who visited the regional trauma center at Chungbuk National University Hospital between 2016 and 2022. Four machine learning models-logistic regression, decision tree, random forest, and eXtreme Gradient Boosting (XGBoost)-were developed to predict 30-day mortality. The models' performance was compared using metrics such as area under the receiver operating characteristic curve (AUC), accuracy, precision, recall, specificity, F1 score, as well as Shapley Additive Explanations (SHAP) values and learning curves. Results: The performance evaluation of the machine learning models for predicting mortality in severely injured elderly patients with trauma showed AUC values for logistic regression, decision tree, random forest, and XGBoost of 0.938, 0.863, 0.919, and 0.934, respectively. Among the four models, XGBoost demonstrated superior accuracy, precision, recall, specificity, and F1 score of 0.91, 0.72, 0.86, 0.92, and 0.78, respectively. Analysis of important features of XGBoost using SHAP revealed associations such as a high Glasgow Coma Scale negatively impacting mortality probability, while higher counts of transfused red blood cells were positively correlated with mortality probability. The learning curves indicated increased generalization and robustness as training examples increased. Conclusions: We showed that machine learning models, especially XGBoost, can be used to predict 30-day mortality in severely injured elderly patients with trauma. Prognostic tools utilizing these models are helpful for physicians to evaluate the risk of mortality in elderly patients with severe trauma.

• Journal of the Korean Geosynthetics Society
• /
• v.23 no.3
• /
• pp.15-22
• /
• 2024

Predicting ground settlement during the improvement of soft ground and the construction of a structure is an crucial factor. Numerous studies have been conducted, and many prediction equations have been proposed to estimate settlement. Settlement can be calculated using the compression index of clay. In this study, data on water content, void ratio, liquid limit, plastic limit, and compression index from the Busan New Port area were collected to construct a dataset. Correlation analysis was conducted among the collected data. Machine learning algorithms, including Random Forest, Neural Network, Linear Regression, Ada Boost, and Gradient Boosting, were applied using the Orange mining program to propose compression index prediction models. The models' results were evaluated by comparing RMSE and MAPE values, which indicate error rates, and R² values, which signify the models' significance. As a result, water content showed the highest correlation, while the plastic limit showed a somewhat lower correlation than other characteristics. Among the compared models, the AdaBoost model demonstrated the best performance. As a result of comparing each model, the AdaBoost model had the lowest error rate and a large coefficient of determination.

• Journal of the Korean Society of Environmental Restoration Technology
• /
• v.6 no.3
• /
• pp.46-55
• /
• 2003

This study aims to evaluate the Ulsan city residents' perception and satisfaction with open spaces and cityscape after consideration in the side of getting primary data for the city open spaces policy and Green Plan for Ulsan city. In this study, low data was gathered by questionnaires survey with stratified random sampling method. Questionnaires were designed by several sets of variables such as behavioral patterns, satisfactions for open spaces and user's demographic variables. Data were analyzed by descriptive statistics, cross-tabulation and regression analysis. The main results of this study can be summarized as follows : 1. In overage the residents were slightly satisfied with park open spaces. There were good and poor park open spaces. in the perceptions of citizens as follows : 'nearby mountain and open spaces', 'rail side green area' were high satisfactory, and 'riverside', 'green qualities' were low in satisfaction. 2. In overage the residents were slightly satisfied with cityscape. There were good and poor cityscape in the perceptions of citizens as follows : 'nearby forest in and open spaces', 'night scape of an urban center' were high satisfactory, and 'streetscape', 'appearances of high-rise buildings' were low in satisfaction. 3. As a results of regression analysis predictable variables for satisfaction with Park and Open spaces were : 'open spaces by the public', 'open spaces by neighbor', 'grande open spaces', 'open spaces of residence'. 4. As a results of regression analysis predictable variables for satisfaction with cityscape were : 'Central Business District(C.B.D) and nearby mountain and open spaces', 'residence and streetscape', 'riverside and park green open spaces'.

• Journal of Environmental Impact Assessment
• /
• v.30 no.5
• /
• pp.271-296
• /
• 2021

Since the thermal stratification in a reservoir inhibits the vertical mixing of the upper and lower layers and causes the formation of a hypoxia layer and the enhancement of nutrients release from the sediment, changes in the stratification structure of the reservoir according to future climate change are very important in terms of water quality and aquatic ecology management. This study was aimed to develop a data-driven inflow water temperature prediction model for Daecheong Reservoir (DR), and to predict future inflow water temperature and the stratification structure of DR considering future climate scenarios of Representative Concentration Pathways (RCP). The random forest (RF)regression model (NSE 0.97, RMSE 1.86℃, MAPE 9.45%) developed to predict the inflow temperature of DR adequately reproduced the statistics and variability of the observed water temperature. Future meteorological data for each RCP scenario predicted by the regional climate model (HadGEM3-RA) was input into RF model to predict the inflow water temperature, and a three-dimensional hydrodynamic model (AEM3D) was used to predict the change in the future (2018~2037, 2038~2057, 2058~2077, 2078~2097) stratification structure of DR due to climate change. As a result, the rates of increase in air temperature and inflow water temperature was 0.14~0.48℃/10year and 0.21~0.41℃/10year,respectively. As a result of seasonal analysis, in all scenarios except spring and winter in the RCP 2.6, the increase in inflow water temperature was statistically significant, and the increase rate was higher as the carbon reduction effort was weaker. The increase rate of the surface water temperature of the reservoir was in the range of 0.04~0.38℃/10year, and the stratification period was gradually increased in all scenarios. In particular, when the RCP 8.5 scenario is applied, the number of stratification days is expected to increase by about 24 days. These results were consistent with the results of previous studies that climate change strengthens the stratification intensity of lakes and reservoirs and prolonged the stratification period, and suggested that prolonged water temperature stratification could cause changes in the aquatic ecosystem, such as spatial expansion of the low-oxygen layer, an increase in sediment nutrient release, and changed in the dominant species of algae in the water body.

• Korean Journal of Remote Sensing
• /
• v.38 no.5_1
• /
• pp.627-646
• /
• 2022

Recently, the seriousness of climate change-related problems caused by global warming is growing, and the average temperature is also rising. As a result, it is affecting the environment in which various temperature-sensitive creatures and creatures live, and changes in the ecosystem are also being detected. Seasons are one of the important factors influencing the types, distribution, and growth characteristics of creatures living in the area. Among the most popular and easily recognized plant seasonal phenomena among the indicators of the climate change impact evaluation, the blooming day of flower and the peak day of autumn leaves were modeled. The types of plants used in the modeling were forsythia and cherry trees, which can be seen as representative plants of spring, and maple and ginkgo, which can be seen as representative plants of autumn. Weather data used to perform modeling were temperature, precipitation, and solar radiation observed through the ASOS Observatory of the Korea Meteorological Administration. As satellite data, MODIS NDVI was used for modeling, and it has a correlation coefficient of about -0.2 for the flowering date and 0.3 for the autumn leaves peak date. As the model used, the model was established using multiple regression models, which are linear models, and Random Forest, which are nonlinear models. In addition, the predicted values estimated by each model were expressed as isopleth maps using spatial interpolation techniques to express the trend of plant seasonal changes from 2003 to 2020. It is believed that using NDVI with high spatio-temporal resolution in the future will increase the accuracy of plant phenology modeling.

• The Korean Journal of Applied Statistics
• /
• v.30 no.1
• /
• pp.25-39
• /
• 2017

Over 5 million people participate in cycle racing betting and its revenue is more than 2 trillion won. This study predicts the ranking of cycle racing using various statistical analyses and identifies important variables which have influence on ranking. We propose competitive ranking prediction models using various classification and regression methods. Our model can predict rankings with low misclassification rates most of the time. We found that the ranking increases as the grade of a racer decreases and as overall scores increase. Inversely, we can observe that the ranking decreases when the grade of a racer increases, race number four is given, and the ranking of the last race of a racer decreases. We also found that prediction accuracy can be improved when we use centered data per race instead of raw data. However, the real profit from the future data was not high when we applied our prediction model because our model can predict only low-return events well.