• Communications for Statistical Applications and Methods
• /
• v.28 no.2
• /
• pp.189-204
• /
• 2021

In a regression analysis, a single best model is usually selected among several candidate models. However, it is often useful to combine several candidate models to achieve better performance, especially, in the prediction viewpoint. Model combining methods such as stacking and Bayesian model averaging (BMA) have been suggested from the perspective of averaging candidate models. When the candidate models include a true model, it is expected that BMA generally gives better performance than stacking. On the other hand, when candidate models do not include the true model, it is known that stacking outperforms BMA. Since stacking and BMA approaches have different properties, it is difficult to determine which method is more appropriate under other situations. In particular, it is not easy to find research papers that compare stacking and BMA when regression model assumptions are violated. Therefore, in the paper, we compare the performance among model averaging methods as well as a single best model in the linear regression analysis when standard linear regression assumptions are violated. Simulations were conducted to compare model averaging methods with the linear regression when data include outliers and data do not include them. We also compared them when data include errors from a non-normal distribution. The model averaging methods were applied to the water pollution data, which have a strong multicollinearity among variables. Simulation studies showed that the stacking method tends to give better performance than BMA or standard linear regression analysis (including the stepwise selection method) in the sense of risks (see (3.1)) or prediction error (see (3.2)) when typical linear regression assumptions are violated.

• The Transactions of the Korean Institute of Electrical Engineers P
• /
• v.67 no.4
• /
• pp.183-190
• /
• 2018

Predicting accurate electricity prices is an important task in the electricity trading market. To address the electricity price forecasting problem, various approaches have been proposed so far and it is known that linear regression-based approaches are the best. However, the use of such linear regression-based methods is limited due to low accuracy and performance. In traditional linear regression methods, it is not practical to find a nonlinear regression model that explains the training data well. If the training data is complex (i.e., small-sized individual data and large-sized features), it is difficult to find the polynomial function with n terms as the model that fits to the training data. On the other hand, as a linear regression model approximating a nonlinear regression model is used, the accuracy of the model drops considerably because it does not accurately reflect the characteristics of the training data. To cope with this problem, we propose a new electricity price forecasting method that divides the entire dataset to multiple split datasets and find the best linear regression models, each of which is the optimal model in each dataset. Meanwhile, to improve the performance of the proposed method, we modify the proposed localized linear regression method in the map and reduce way that is a framework for parallel processing data stored in a Hadoop distributed file system. Our experimental results show that the proposed model outperforms the existing linear regression model. Specifically, the accuracy of the proposed method is improved by 45% and the performance is faster 5 times than the existing linear regression-based model.

• Communications for Statistical Applications and Methods
• /
• v.5 no.1
• /
• pp.19-24
• /
• 1998

When multicollinearity appears in linear regression model, we can use ridge regression for stabilizing the regression coefficient estimates. We propose the screen diagram as a graphical method for detecting multicollinearity and estimating ridge constant in linear regression model.

• The Korean Journal of Applied Statistics
• /
• v.10 no.2
• /
• pp.403-411
• /
• 1997

Fuzzy linear regression model introduced by Tanaka et al. 91982) has been proposed and developed as alternative to statistical linear regression when our understanding of a phenomenon is imprecise or vague. In this paper we review fuzzy linear regression model and its parameter estimation and examine its strengths and weaknesses through case study. In addition another fuzzy linear model is introduced and applied to an economic study.

• Communications of the Korean Mathematical Society
• /
• v.33 no.3
• /
• pp.973-983
• /
• 2018

Fuzzy linear regression model has been widely studied with many successful applications but there have been only a few studies on the fuzzy regression model with monotonic response function as a generalization of the linear response function. In this paper, we propose the fuzzy regression model with the monotonic response function and the algorithm to construct the proposed model by using ${\alpha}-level$ set of fuzzy number and the resolution identity theorem. To estimate parameters of the proposed model, the least squares (LS) method and the least absolute deviation (LAD) method have been used in this paper. In addition, to evaluate the performance of the proposed model, two performance measures of goodness of fit are introduced. The numerical examples indicate that the fuzzy regression model with the monotonic response function is preferable to the fuzzy linear regression model when the fuzzy data represent the non-linear pattern.

• Communications for Statistical Applications and Methods
• /
• v.8 no.2
• /
• pp.319-325
• /
• 2001

In this note, we propose a simple fuzzy linear regression model for fuzzy input-output data based on Tanaka's approach. Then an LP-based method to derived the satisfying solution of the decision making is developed.

• Journal of Information Processing Systems
• /
• v.18 no.2
• /
• pp.268-281
• /
• 2022

The development of information technology is bringing many changes to everyday life, and machine learning can be used as a technique to solve a wide range of real-world problems. Analysis and utilization of data are essential processes in applying machine learning to real-world problems. As a method of processing data in machine learning, we propose an approach based on applying multiple linear regression models by interlacing data to the task of classifying similar software. Linear regression is widely used in estimation problems to model the relationship between input and output data. In our approach, multiple linear regression models are generated by training on interlaced feature data. A combination of these multiple models is then used as the prediction model for classifying similar software. Experiments are performed to evaluate the proposed approach as compared to conventional linear regression, and the experimental results show that the proposed method classifies similar software more accurately than the conventional model. We anticipate the proposed approach to be applied to various kinds of classification problems to improve the accuracy of conventional linear regression.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.16 no.4
• /
• pp.499-505
• /
• 2006

Regularlization approach to regression can be easily found in Statistics and Information Science literature. The technique of regularlization was introduced as a way of controlling the smoothness properties of regression function. In this paper, we have presented a new method to evaluate linear and non-linear fuzzy regression model based on Tanaka's model using the idea of regularlization technique. Especially this method is a very attractive approach to model non -linear fuzzy data.

• International Journal of Advanced Culture Technology
• /
• v.11 no.3
• /
• pp.310-314
• /
• 2023

The purpose of this study is to predict the remaining capacity of lithium-ion batteries and evaluate their performance using five artificial intelligence models, including linear regression analysis, decision tree, random forest, neural network, and ensemble model. We is in the study, measured Excel data from the CS2 lithium-ion battery was used, and the prediction accuracy of the model was measured using evaluation indicators such as mean square error, mean absolute error, coefficient of determination, and root mean square error. As a result of this study, the Root Mean Square Error(RMSE) of the linear regression model was 0.045, the decision tree model was 0.038, the random forest model was 0.034, the neural network model was 0.032, and the ensemble model was 0.030. The ensemble model had the best prediction performance, with the neural network model taking second place. The decision tree model and random forest model also performed quite well, and the linear regression model showed poor prediction performance compared to other models. Therefore, through this study, ensemble models and neural network models are most suitable for predicting the remaining capacity of lithium-ion batteries, and decision tree and random forest models also showed good performance. Linear regression models showed relatively poor predictive performance. Therefore, it was concluded that it is appropriate to prioritize ensemble models and neural network models in order to improve the efficiency of battery management and energy systems.

• Corrosion Science and Technology
• /
• v.19 no.6
• /
• pp.302-309
• /
• 2020

This study aimed to predict the pitting corrosion characteristics of AL-6XN super-austenitic steel using multiple linear regression. The variables used in the model are degree of sensitization, temperature, and pH. Experiments were designed and cyclic polarization curve tests were conducted accordingly. The data obtained from the cyclic polarization curve tests were used as training data for the multiple linear regression model. The significance of each factor in the response (critical pitting potential, repassivation potential) was analyzed. The multiple linear regression model was validated using experimental conditions that were not included in the training data. As a result, the degree of sensitization showed a greater effect than the other variables. Multiple linear regression showed poor performance for prediction of repassivation potential. On the other hand, the model showed a considerable degree of predictive performance for critical pitting potential. The coefficient of determination (R2) was 0.7745. The possibility for pitting potential prediction was confirmed using multiple linear regression.