• Title/Summary/Keyword: Model Ensemble

Search Result 638, Processing Time 0.027 seconds

A Study on the Development of University Students Dropout Prediction Model Using Ensemble Technique (앙상블 기법을 활용한 대학생 중도탈락 예측 모형 개발)

  • Park, Sangsung
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.17 no.1
    • /
    • pp.109-115
    • /
    • 2021
  • The number of freshmen at universities is decreasing due to the recent decline in the school-age population, and the survival of many universities is threatened. To overcome this situation, universities are seeking ways to use big data within the school to improve the quality of education. A study on the prediction of dropout students is a representative case of using big data in universities. The dropout prediction can prepare a systematic management plan by identifying students who will drop out of school due to reasons such as dropout or expulsion. In the case of actual on-campus data, a large number of missing values are included because it is collected and managed by various departments. For this reason, it is necessary to construct a model by effectively reflecting the missing values. In this study, we propose a university student dropout prediction model based on eXtreme Gradient Boost that can be applied to data with many missing values and shows high performance. In order to examine the practical applicability of the proposed model, an experiment was performed using data from C University in Chungbuk. As a result of the experiment, the prediction performance of the proposed model was found to be excellent. The management strategy of dropout students can be established through the prediction results of the model proposed in this paper.

Defect Severity-based Ensemble Model using FCM (FCM을 적용한 결함심각도 기반 앙상블 모델)

  • Lee, Na-Young;Kwon, Ki-Tae
    • KIISE Transactions on Computing Practices
    • /
    • v.22 no.12
    • /
    • pp.681-686
    • /
    • 2016
  • Software defect prediction is an important factor in efficient project management and success. The severity of the defect usually determines the degree to which the project is affected. However, existing studies focus only on the presence or absence of a defect and not the severity of defect. In this study, we proposed an ensemble model using FCM based on defect severity. The severity of the defect of NASA data set's PC4 was reclassified. To select the input column that affected the severity of the defect, we extracted the important defect factor of the data set using Random Forest (RF). We evaluated the performance of the model by changing the parameters in the 10-fold cross-validation. The evaluation results were as follows. First, defect severities were reclassified from 58, 40, 80 to 30, 20, 128. Second, BRANCH_COUNT was an important input column for the degree of severity in terms of accuracy and node impurities. Third, smaller tree number led to more variables for good performance.

Improvement of the Ensemble Streamflow Prediction System Using Optimal Linear Correction (최적선형보정을 이용한 앙상블 유량예측 시스템의 개선)

  • Jeong, Dae-Il;Lee, Jae-Kyoung;Kim, Young-Oh
    • Journal of Korea Water Resources Association
    • /
    • v.38 no.6 s.155
    • /
    • pp.471-483
    • /
    • 2005
  • A monthly Ensemble Streamflow Prediction (ESP) system was developed by applying a daily rainfall-runoff model known as the Streamflow Synthesis and Reservoir Regulation (SSARR) model to the Han, Nakdong, and Seomjin River basins in Korea. This study first assesses the accuracy of the averaged monthly runoffs simulated by SSARR for the 3 basins and proposes some improvements. The study found that the SSARR modeling of the Han and Nakdong River basins tended to significantly underestimate the actual runoff levels and the modeling of the Seomjin River basinshowed a large error variance. However, by implementing optimal linear correction (OLC), the accuracy of the SSARR model was considerably improved in predicting averaged monthly runoffs of the Han and Nakdong River basins. This improvement was not seen in the modeling of the Seomjin River basin. In addition, the ESP system was applied to forecast probabilistic runoff forecasts one month in advance for the 3 river basins from 1998 to 2003. Considerably improvement was also achieved with OLC in probabilistic forecasting accuracy for the Han and Nakdong River basins, but not in that of the Seomjin River basin.

A Study on the Accuracy Improvement of Movie Recommender System Using Word2Vec and Ensemble Convolutional Neural Networks (Word2Vec과 앙상블 합성곱 신경망을 활용한 영화추천 시스템의 정확도 개선에 관한 연구)

  • Kang, Boo-Sik
    • Journal of Digital Convergence
    • /
    • v.17 no.1
    • /
    • pp.123-130
    • /
    • 2019
  • One of the most commonly used methods of web recommendation techniques is collaborative filtering. Many studies on collaborative filtering have suggested ways to improve accuracy. This study proposes a method of movie recommendation using Word2Vec and an ensemble convolutional neural networks. First, in the user, movie, and rating information, construct the user sentences and movie sentences. It inputs user sentences and movie sentences into Word2Vec to obtain user vectors and movie vectors. User vectors are entered into user convolution model and movie vectors are input to movie convolution model. The user and the movie convolution models are linked to a fully connected neural network model. Finally, the output layer of the fully connected neural network outputs forecasts of user movie ratings. Experimentation results showed that the accuracy of the technique proposed in this study accuracy of conventional collaborative filtering techniques was improved compared to those of conventional collaborative filtering technique and the technique using Word2Vec and deep neural networks proposed in a similar study.

Diabetes prediction mechanism using machine learning model based on patient IQR outlier and correlation coefficient (환자 IQR 이상치와 상관계수 기반의 머신러닝 모델을 이용한 당뇨병 예측 메커니즘)

  • Jung, Juho;Lee, Naeun;Kim, Sumin;Seo, Gaeun;Oh, Hayoung
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.10
    • /
    • pp.1296-1301
    • /
    • 2021
  • With the recent increase in diabetes incidence worldwide, research has been conducted to predict diabetes through various machine learning and deep learning technologies. In this work, we present a model for predicting diabetes using machine learning techniques with German Frankfurt Hospital data. We apply outlier handling using Interquartile Range (IQR) techniques and Pearson correlation and compare model-specific diabetes prediction performance with Decision Tree, Random Forest, Knn (k-nearest neighbor), SVM (support vector machine), Bayesian Network, ensemble techniques XGBoost, Voting, and Stacking. As a result of the study, the XGBoost technique showed the best performance with 97% accuracy on top of the various scenarios. Therefore, this study is meaningful in that the model can be used to accurately predict and prevent diabetes prevalent in modern society.

Estimation of optimal runoff hydrograph using radar rainfall ensemble and blending technique of rainfall-runoff models (레이더 강우 앙상블과 유출 블랜딩 기법을 이용한 최적 유출 수문곡선 산정)

  • Lee, Myungjin;Kang, Narae;Kim, Jongsung;Kim, Hung Soo
    • Journal of Korea Water Resources Association
    • /
    • v.51 no.3
    • /
    • pp.221-233
    • /
    • 2018
  • Recently, the flood damage by the localized heavy rainfall and typhoon have been frequently occurred due to the climate change. Accurate rainfall forecasting and flood runoff estimates are needed to reduce such damages. However, the uncertainties are involved in guage rainfall, radar rainfall, and the estimated runoff hydrograph from rainfall-runoff models. Therefore, the purpose of this study is to identify the uncertainty of rainfall by generating a probabilistic radar rainfall ensemble and confirm the uncertainties of hydrological models through the analysis of the simulated runoffs from the models. The blending technique is used to estimate a single integrated or an optimal runoff hydrograph by the simulated runoffs from multi rainfall-runoff models. The radar ensemble is underestimated due to the influence of rainfall intensity and topography and the uncertainty of the rainfall ensemble is large. From the study, it will be helpful to estimate and predict the accurate runoff to prepare for the disaster caused by heavy rainfall.

Molecular Dynamics Simulation Studies of Benzene, Toluene, and p-Xylene in NpT Ensemble: Thermodynamic, Structural, and Dynamic Properties

  • Kim, Ja-Hun;Lee, Song-Hi
    • Bulletin of the Korean Chemical Society
    • /
    • v.23 no.3
    • /
    • pp.447-453
    • /
    • 2002
  • In this paper we have presented the results of thermodynamic, structural, and dynamic properties of model systems for liquid benzene, toluene and p-xylene in an isobaric-isothermal (NpT) ensemble at 283.15, 303.15, 323.15, and 343.15 K using molecular dynamics (MD) simulation. This work is initiated to compensate for our previous canonical (NVT) ensemble MD simulations [Bull. Kor. Chem. Soc. 2001, 23, 441] for the same systems in which the calculated pressures were too low. The calculated pressures in the NpT ensemble MD simulations are close to 1 atm and the volume of each system increases with increasing temperature. The first and second peaks in the center of mass g(r) diminish gradually and the minima increase as usual for the three liquids as the temperature increases. The three peaks of the site-site gC-C(r) at 283.15 K support the perpendicular structure of nearest neighbors in liquid benzene. Two self-diffusion coefficients of liquid benzene via the Einstein equation and via the Green-Kubo relation are in excellent agreement with the experimental measures. The self-diffusion coefficients of liquid toluene and p-xylene are in accord with the trend that the self-diffusion coefficient decreases with increasing number of methyl group. The friction constants calculated from the force auto-correlation (FAC) function with the assumption that the fast random force correlation ends at time which the FAC has the first negative value give a correct qualitative trends: decrease with increase of temperature and increase with the number of methyl group. The friction constants calculated from the FAC's are always less than those obtained from the friction-diffusion relation which reflects that the random FAC decays slower than the total FAC as described by Kubo [Rep. Prog. Phys. 1966, 29, 255].

Path Loss Prediction Using an Ensemble Learning Approach

  • Beom Kwon;Eonsu Noh
    • Journal of the Korea Society of Computer and Information
    • /
    • v.29 no.2
    • /
    • pp.1-12
    • /
    • 2024
  • Predicting path loss is one of the important factors for wireless network design, such as selecting the installation location of base stations in cellular networks. In the past, path loss values were measured through numerous field tests to determine the optimal installation location of the base station, which has the disadvantage of taking a lot of time to measure. To solve this problem, in this study, we propose a path loss prediction method based on machine learning (ML). In particular, an ensemble learning approach is applied to improve the path loss prediction performance. Bootstrap dataset was utilized to obtain models with different hyperparameter configurations, and the final model was built by ensembling these models. We evaluated and compared the performance of the proposed ensemble-based path loss prediction method with various ML-based methods using publicly available path loss datasets. The experimental results show that the proposed method outperforms the existing methods and can predict the path loss values accurately.

Vacant Technology Forecasting using Ensemble Model (앙상블모형을 이용한 공백기술예측)

  • Jun, Sung-Hae
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.21 no.3
    • /
    • pp.341-346
    • /
    • 2011
  • A vacant technology forecasting is an important issue in management of technology. The forecast of vacant technology leads to the growth of nation and company. So, we need the results of technology developments until now to predict the vacant technology. Patent is an objective thing of the results in research and development of technology. We study a predictive method for forecasting the vacant technology quantitatively using patent data in this paper. We propose an ensemble model that is to vote some clustering criteria because we can't guarantee a model is optimal. Therefore, an objective and accurate forecasting model of vacant technology is researched in our paper. This model combines statistical analysis methods with machine learning algorithms. To verify our performance evaluation objectively, we make experiments using patent documents of diverse technology fields.

Improvement of Vocal Detection Accuracy Using Convolutional Neural Networks

  • You, Shingchern D.;Liu, Chien-Hung;Lin, Jia-Wei
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.2
    • /
    • pp.729-748
    • /
    • 2021
  • Vocal detection is one of the fundamental steps in musical information retrieval. Typically, the detection process consists of feature extraction and classification steps. Recently, neural networks are shown to outperform traditional classifiers. In this paper, we report our study on how to improve detection accuracy further by carefully choosing the parameters of the deep network model. Through experiments, we conclude that a feature-classifier model is still better than an end-to-end model. The recommended model uses a spectrogram as the input plane and the classifier is an 18-layer convolutional neural network (CNN). With this arrangement, when compared with existing literature, the proposed model improves the accuracy from 91.8% to 94.1% in Jamendo dataset. As the dataset has an accuracy of more than 90%, the improvement of 2.3% is difficult and valuable. If even higher accuracy is required, the ensemble learning may be used. The recommend setting is a majority vote with seven proposed models. Doing so, the accuracy increases by about 1.1% in Jamendo dataset.