• Title/Summary/Keyword: prediction score

Search Result 507, Processing Time 0.027 seconds

Analysis of Online Behavior and Prediction of Learning Performance in Blended Learning Environments

  • JO, Il-Hyun;PARK, Yeonjeong;KIM, Jeonghyun;SONG, Jongwoo
    • Educational Technology International
    • /
    • v.15 no.2
    • /
    • pp.71-88
    • /
    • 2014
  • A variety of studies to predict students' performance have been conducted since educational data such as web-log files traced from Learning Management System (LMS) are increasingly used to analyze students' learning behaviors. However, it is still challenging to predict students' learning achievement in blended learning environment where online and offline learning are combined. In higher education, diverse cases of blended learning can be formed from simple use of LMS for administrative purposes to full usages of functions in LMS for online distance learning class. As a result, a generalized model to predict students' academic success does not fulfill diverse cases of blended learning. This study compares two blended learning classes with each prediction model. The first blended class which involves online discussion-based learning revealed a linear regression model, which explained 70% of the variance in total score through six variables including total log-in time, log-in frequencies, log-in regularities, visits on boards, visits on repositories, and the number of postings. However, the second case, a lecture-based class providing regular basis online lecture notes in Moodle show weaker results from the same linear regression model mainly due to non-linearity of variables. To investigate the non-linear relations between online activities and total score, RF (Random Forest) was utilized. The results indicate that there are different set of important variables for the two distinctive types of blended learning cases. Results suggest that the prediction models and data-mining technique should be based on the considerations of diverse pedagogical characteristics of blended learning classes.

Hyperparameter Tuning Based Machine Learning classifier for Breast Cancer Prediction

  • Md. Mijanur Rahman;Asikur Rahman Raju;Sumiea Akter Pinky;Swarnali Akter
    • International Journal of Computer Science & Network Security
    • /
    • v.24 no.2
    • /
    • pp.196-202
    • /
    • 2024
  • Currently, the second most devastating form of cancer in people, particularly in women, is Breast Cancer (BC). In the healthcare industry, Machine Learning (ML) is commonly employed in fatal disease prediction. Due to breast cancer's favorable prognosis at an early stage, a model is created to utilize the Dataset on Wisconsin Diagnostic Breast Cancer (WDBC). Conversely, this model's overarching axiom is to compare the effectiveness of five well-known ML classifiers, including Logistic Regression (LR), Decision Tree (DT), Random Forest (RF), K-Nearest Neighbor (KNN), and Naive Bayes (NB) with the conventional method. To counterbalance the effect with conventional methods, the overarching tactic we utilized was hyperparameter tuning utilizing the grid search method, which improved accuracy, secondary precision, third recall, and finally the F1 score. In this study hyperparameter tuning model, the rate of accuracy increased from 94.15% to 98.83% whereas the accuracy of the conventional method increased from 93.56% to 97.08%. According to this investigation, KNN outperformed all other classifiers in terms of accuracy, achieving a score of 98.83%. In conclusion, our study shows that KNN works well with the hyper-tuning method. These analyses show that this study prediction approach is useful in prognosticating women with breast cancer with a viable performance and more accurate findings when compared to the conventional approach.

A Grey Wolf Optimized- Stacked Ensemble Approach for Nitrate Contamination Prediction in Cauvery Delta

  • Kalaivanan K;Vellingiri J
    • Economic and Environmental Geology
    • /
    • v.57 no.3
    • /
    • pp.329-342
    • /
    • 2024
  • The exponential increase in nitrate pollution of river water poses an immediate threat to public health and the environment. This contamination is primarily due to various human activities, which include the overuse of nitrogenous fertilizers in agriculture and the discharge of nitrate-rich industrial effluents into rivers. As a result, the accurate prediction and identification of contaminated areas has become a crucial and challenging task for researchers. To solve these problems, this work leads to the prediction of nitrate contamination using machine learning approaches. This paper presents a novel approach known as Grey Wolf Optimizer (GWO) based on the Stacked Ensemble approach for predicting nitrate pollution in the Cauvery Delta region of Tamilnadu, India. The proposed method is evaluated using a Cauvery River dataset from the Tamilnadu Pollution Control Board. The proposed method shows excellent performance, achieving an accuracy of 93.31%, a precision of 93%, a sensitivity of 97.53%, a specificity of 94.28%, an F1-score of 95.23%, and an ROC score of 95%. These impressive results underline the demonstration of the proposed method in accurately predicting nitrate pollution in river water and ultimately help to make informed decisions to tackle these critical environmental problems.

Pure additive contribution of genetic variants to a risk prediction model using propensity score matching: application to type 2 diabetes

  • Park, Chanwoo;Jiang, Nan;Park, Taesung
    • Genomics & Informatics
    • /
    • v.17 no.4
    • /
    • pp.47.1-47.12
    • /
    • 2019
  • The achievements of genome-wide association studies have suggested ways to predict diseases, such as type 2 diabetes (T2D), using single-nucleotide polymorphisms (SNPs). Most T2D risk prediction models have used SNPs in combination with demographic variables. However, it is difficult to evaluate the pure additive contribution of genetic variants to classically used demographic models. Since prediction models include some heritable traits, such as body mass index, the contribution of SNPs using unmatched case-control samples may be underestimated. In this article, we propose a method that uses propensity score matching to avoid underestimation by matching case and control samples, thereby determining the pure additive contribution of SNPs. To illustrate the proposed propensity score matching method, we used SNP data from the Korea Association Resources project and reported SNPs from the genome-wide association study catalog. We selected various SNP sets via stepwise logistic regression (SLR), least absolute shrinkage and selection operator (LASSO), and the elastic-net (EN) algorithm. Using these SNP sets, we made predictions using SLR, LASSO, and EN as logistic regression modeling techniques. The accuracy of the predictions was compared in terms of area under the receiver operating characteristic curve (AUC). The contribution of SNPs to T2D was evaluated by the difference in the AUC between models using only demographic variables and models that included the SNPs. The largest difference among our models showed that the AUC of the model using genetic variants with demographic variables could be 0.107 higher than that of the corresponding model using only demographic variables.

LSTM-based Deep Learning for Time Series Forecasting: The Case of Corporate Credit Score Prediction (시계열 예측을 위한 LSTM 기반 딥러닝: 기업 신용평점 예측 사례)

  • Lee, Hyun-Sang;Oh, Sehwan
    • The Journal of Information Systems
    • /
    • v.29 no.1
    • /
    • pp.241-265
    • /
    • 2020
  • Purpose Various machine learning techniques are used to implement for predicting corporate credit. However, previous research doesn't utilize time series input features and has a limited prediction timing. Furthermore, in the case of corporate bond credit rating forecast, corporate sample is limited because only large companies are selected for corporate bond credit rating. To address limitations of prior research, this study attempts to implement a predictive model with more sample companies, which can adjust the forecasting point at the present time by using the credit score information and corporate information in time series. Design/methodology/approach To implement this forecasting model, this study uses the sample of 2,191 companies with KIS credit scores for 18 years from 2000 to 2017. For improving the performance of the predictive model, various financial and non-financial features are applied as input variables in a time series through a sliding window technique. In addition, this research also tests various machine learning techniques that were traditionally used to increase the validity of analysis results, and the deep learning technique that is being actively researched of late. Findings RNN-based stateful LSTM model shows good performance in credit rating prediction. By extending the forecasting time point, we find how the performance of the predictive model changes over time and evaluate the feature groups in the short and long terms. In comparison with other studies, the results of 5 classification prediction through label reclassification show good performance relatively. In addition, about 90% accuracy is found in the bad credit forecasts.

Seasonal Prediction of Tropical Cyclone Frequency in the Western North Pacific using GDAPS Ensemble Prediction System (GDAPS 앙상블 예보 시스템을 이용한 북서태평양에서의 태풍 발생 계절 예측)

  • Kim, Ji-Sun;Kwon, H. Joe
    • Atmosphere
    • /
    • v.17 no.3
    • /
    • pp.269-279
    • /
    • 2007
  • This study investigates the possibility of seasonal prediction for tropical cyclone activity in the western North Pacific by using a dynamical modeling approach. We use data from the SMIP/HFP (Seasonal Prediction Model Inter-comparison Project/Historical Forecast Project) experiment with the Korea Meteorological Administration's GDAPS (Global Data Assimilation and Prediction System) T106 model, focusing our analysis on model-generated tropical cyclones. It is found that the prediction depends primarily on the tropical cyclone (TC) detecting criteria. Additionally, a scaling factor and a different weighting to each ensemble member are found to be essential for the best predictions of summertime TC activity. This approach indeed shows a certain skill not only in the category forecast but in the standard verifications such as Brier score and relative operating characteristics (ROC).

Prediction of Transition Temperature and Magnetocaloric Effects in Bulk Metallic Glasses with Ensemble Models (앙상블 기계학습 모델을 이용한 비정질 소재의 자기냉각 효과 및 전이온도 예측)

  • Chunghee Nam
    • Korean Journal of Materials Research
    • /
    • v.34 no.7
    • /
    • pp.363-369
    • /
    • 2024
  • In this study, the magnetocaloric effect and transition temperature of bulk metallic glass, an amorphous material, were predicted through machine learning based on the composition features. From the Python module 'Matminer', 174 compositional features were obtained, and prediction performance was compared while reducing the composition features to prevent overfitting. After optimization using RandomForest, an ensemble model, changes in prediction performance were analyzed according to the number of compositional features. The R2 score was used as a performance metric in the regression prediction, and the best prediction performance was found using only 90 features predicting transition temperature, and 20 features predicting magnetocaloric effects. The most important feature when predicting magnetocaloric effects was the 'Fe' compositional ratio. The feature importance method provided by 'scikit-learn' was applied to sort compositional features. The feature importance method was found to be appropriate by comparing the prediction performance of the Fe-contained dataset with the full dataset.

Data-driven Modeling for Valve Size and Type Prediction Using Machine Learning (머신 러닝을 이용한 밸브 사이즈 및 종류 예측 모델 개발)

  • Chanho Kim;Minshick Choi;Chonghyo Joo;A-Reum Lee;Yun Gun;Sungho Cho;Junghwan Kim
    • Korean Chemical Engineering Research
    • /
    • v.62 no.3
    • /
    • pp.214-224
    • /
    • 2024
  • Valves play an essential role in a chemical plant such as regulating fluid flow and pressure. Therefore, optimal selection of the valve size and type is essential task. Valve size and type have been selected based on theoretical formulas about calculating valve sizing coefficient (Cv). However, this approach has limitations such as requiring expert knowledge and consuming substantial time and costs. Herein, this study developed a model for predicting valve sizes and types using machine learning. We developed models using four algorithms: ANN, Random Forest, XGBoost, and Catboost and model performances were evaluated using NRMSE & R2 score for size prediction and F1 score for type prediction. Additionally, a case study was conducted to explore the impact of phases on valve selection, using four datasets: total fluids, liquids, gases, and steam. As a result of the study, for valve size prediction, total fluid, liquid, and gas dataset demonstrated the best performance with Catboost (Based on R2, total: 0.99216, liquid: 0.98602, gas: 0.99300. Based on NRMSE, total: 0.04072, liquid: 0.04886, gas: 0.03619) and steam dataset showed the best performance with RandomForest (R2: 0.99028, NRMSE: 0.03493). For valve type prediction, Catboost outperformed all datasets with the highest F1 scores (total: 0.95766, liquids: 0.96264, gases: 0.95770, steam: 1.0000). In Engineering Procurement Construction industry, the proposed fluid-specific machine learning-based model is expected to guide the selection of suitable valves based on given process conditions and facilitate faster decision-making.

Development and Evaluation of the High Resolution Limited Area Ensemble Prediction System in the Korea Meteorological Administration (기상청 고해상도 국지 앙상블 예측 시스템 구축 및 성능 검증)

  • Kim, SeHyun;Kim, Hyun Mee;Kay, Jun Kyung;Lee, Seung-Woo
    • Atmosphere
    • /
    • v.25 no.1
    • /
    • pp.67-83
    • /
    • 2015
  • Predicting the location and intensity of precipitation still remains a main issue in numerical weather prediction (NWP). Resolution is a very important component of precipitation forecasts in NWP. Compared with a lower resolution model, a higher resolution model can predict small scale (i.e., storm scale) precipitation and depict convection structures more precisely. In addition, an ensemble technique can be used to improve the precipitation forecast because it can estimate uncertainties associated with forecasts. Therefore, NWP using both a higher resolution model and ensemble technique is expected to represent inherent uncertainties of convective scale motion better and lead to improved forecasts. In this study, the limited area ensemble prediction system for the convective-scale (i.e., high resolution) operational Unified Model (UM) in Korea Meteorological Administration (KMA) was developed and evaluated for the ensemble forecasts during August 2012. The model domain covers the limited area over the Korean Peninsula. The high resolution limited area ensemble prediction system developed showed good skill in predicting precipitation, wind, and temperature at the surface as well as meteorological variables at 500 and 850 hPa. To investigate which combination of horizontal resolution and ensemble member is most skillful, the system was run with three different horizontal resolutions (1.5, 2, and 3 km) and ensemble members (8, 12, and 16), and the forecasts from the experiments were evaluated. To assess the quantitative precipitation forecast (QPF) skill of the system, the precipitation forecasts for two heavy rainfall cases during the study period were analyzed using the Fractions Skill Score (FSS) and Probability Matching (PM) method. The PM method was effective in representing the intensity of precipitation and the FSS was effective in verifying the precipitation forecast for the high resolution limited area ensemble prediction system in KMA.

Development and evaluation of dam inflow prediction method based on Bayesian method (베이지안 기법 기반의 댐 예측유입량 산정기법 개발 및 평가)

  • Kim, Seon-Ho;So, Jae-Min;Kang, Shin-Uk;Bae, Deg-Hyo
    • Journal of Korea Water Resources Association
    • /
    • v.50 no.7
    • /
    • pp.489-502
    • /
    • 2017
  • The objective of this study is to propose and evaluate the BAYES-ESP, which is a dam inflow prediction method based on Ensemble Streamflow Prediction method (ESP) and Bayesian theory. ABCD rainfall-runoff model was used to predict monthly dam inflow. Monthly meteorological data collected from KMA, MOLIT and K-water and dam inflow data collected from K-water were used for the model calibration and verification. To estimate the performance of ABCD model, ESP and BAYES-ESP method, time series analysis and skill score (SS) during 1986~2015 were used. In time series analysis monthly ESP dam inflow prediction values were nearly similar for every years, particularly less accurate in wet and dry years. The proposed BAYES-ESP improved the performance of ESP, especially in wet year. The SS was used for quantitative analysis of monthly mean of observed dam inflows, predicted values from ESP and BAYES-ESP. The results indicated that the SS values of ESP were relatively high in January, February and March but negative values in the other months. It also showed that the BAYES-ESP improved ESP when the values from ESP and observation have a relatively apparent linear relationship. We concluded that the existing ESP method has a limitation to predict dam inflow in Korea due to the seasonality of precipitation pattern and the proposed BAYES-ESP is meaningful for improving dam inflow prediction accuracy of ESP.