• Title/Summary/Keyword: Model stacking

Search Result 228, Processing Time 0.04 seconds

Robustness of model averaging methods for the violation of standard linear regression assumptions

  • Lee, Yongsu;Song, Juwon
    • Communications for Statistical Applications and Methods
    • /
    • v.28 no.2
    • /
    • pp.189-204
    • /
    • 2021
  • In a regression analysis, a single best model is usually selected among several candidate models. However, it is often useful to combine several candidate models to achieve better performance, especially, in the prediction viewpoint. Model combining methods such as stacking and Bayesian model averaging (BMA) have been suggested from the perspective of averaging candidate models. When the candidate models include a true model, it is expected that BMA generally gives better performance than stacking. On the other hand, when candidate models do not include the true model, it is known that stacking outperforms BMA. Since stacking and BMA approaches have different properties, it is difficult to determine which method is more appropriate under other situations. In particular, it is not easy to find research papers that compare stacking and BMA when regression model assumptions are violated. Therefore, in the paper, we compare the performance among model averaging methods as well as a single best model in the linear regression analysis when standard linear regression assumptions are violated. Simulations were conducted to compare model averaging methods with the linear regression when data include outliers and data do not include them. We also compared them when data include errors from a non-normal distribution. The model averaging methods were applied to the water pollution data, which have a strong multicollinearity among variables. Simulation studies showed that the stacking method tends to give better performance than BMA or standard linear regression analysis (including the stepwise selection method) in the sense of risks (see (3.1)) or prediction error (see (3.2)) when typical linear regression assumptions are violated.

Development of an Application Model of Simple NIOSH Lifting Equation to Multi-stacking Complex Lifting Tasks (다단적재 복합들기 작업에 대한 NIOSH 단순들기 수식의 적용 모형 개발)

  • Park, Jae-Hee
    • Journal of the Korean Society of Safety
    • /
    • v.24 no.2
    • /
    • pp.76-82
    • /
    • 2009
  • The NIOSH lifting equation has been used as a dominant tool in evaluating the hazard levels of lifting tasks. Although it provides two different ways for each simple and complex lifting task, the NIOSH simple lifting equation is almost used for not only simple tasks but also complex tasks. However, most of lifting tasks in industries are in the form of complex lifting. Therefore some errors occur inevitably in the evaluation of complex lifting tasks. Among complex lifting tasks, a multi-stacking task is the most popular in lifting tasks. To compensate the error in the evaluation of multi-stacking tasks by using the NIOSH simple lifting equation, a set of calculations for finding LIs(Lifting Indices) was performed for the systematically varying multi-stacking tasks. Then a regression model which finds the equivalent height in simple lifting task for multi-stacking task was established. By using this model, multi-stacking tasks can be evaluated with less error. To validate this model, some real multi-stacking tasks were evaluated as examples.

A New Ensemble Machine Learning Technique with Multiple Stacking (다중 스태킹을 가진 새로운 앙상블 학습 기법)

  • Lee, Su-eun;Kim, Han-joon
    • The Journal of Society for e-Business Studies
    • /
    • v.25 no.3
    • /
    • pp.1-13
    • /
    • 2020
  • Machine learning refers to a model generation technique that can solve specific problems from the generalization process for given data. In order to generate a high performance model, high quality training data and learning algorithms for generalization process should be prepared. As one way of improving the performance of model to be learned, the Ensemble technique generates multiple models rather than a single model, which includes bagging, boosting, and stacking learning techniques. This paper proposes a new Ensemble technique with multiple stacking that outperforms the conventional stacking technique. The learning structure of multiple stacking ensemble technique is similar to the structure of deep learning, in which each layer is composed of a combination of stacking models, and the number of layers get increased so as to minimize the misclassification rate of each layer. Through experiments using four types of datasets, we have showed that the proposed method outperforms the exiting ones.

A Model Stacking Algorithm for Indoor Positioning System using WiFi Fingerprinting

  • JinQuan Wang;YiJun Wang;GuangWen Liu;GuiFen Chen
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.4
    • /
    • pp.1200-1215
    • /
    • 2023
  • With the development of IoT and artificial intelligence, location-based services are getting more and more attention. For solving the current problem that indoor positioning error is large and generalization is poor, this paper proposes a Model Stacking Algorithm for Indoor Positioning System using WiFi fingerprinting. Firstly, we adopt a model stacking method based on Bayesian optimization to predict the location of indoor targets to improve indoor localization accuracy and model generalization. Secondly, Taking the predicted position based on model stacking as the observation value of particle filter, collaborative particle filter localization based on model stacking algorithm is realized. The experimental results show that the algorithm can control the position error within 2m, which is superior to KNN, GBDT, Xgboost, LightGBM, RF. The location accuracy of the fusion particle filter algorithm is improved by 31%, and the predicted trajectory is close to the real trajectory. The algorithm can also adapt to the application scenarios with fewer wireless access points.

Stacking Durability Analysis of Fruit , Packaging Boxes by Creep (크리이프에 의한 과실 포장입자의 층적 내구성 분석)

  • 박종민;권순홍;권순구;김만수
    • Journal of Biosystems Engineering
    • /
    • v.21 no.2
    • /
    • pp.191-197
    • /
    • 1996
  • Allowable stacking duration of the corrugated fiberboard boxes being widely used for packaging fruits and vegetables was analyzed by the creep behavior and the cumulative load correction factor for the boxes. The stacking boxes were assumed to be stored at a nearly constant temperature and relative humidity condition. When the stacking duration was short period, the stacking height determined by two methods showed a little difference between them, but almost no difference was shown as the stacking duration was longer. Allowable stacking duration was rapidly decreased with the increase of static load applied on the stacking boxes, and allowable stacking duration of Box A was estimated the longer than that of Box B. A model of allowable stacking duration for the corrugated fiberboard box was developed as a function of the stacking load and the ambient relative humidity.

  • PDF

Automatic Fruit Grading Using Stacking Ensemble Model Based on Visual and Physical Features (시각적 특징과 물리적 특징에 기반한 스태킹 앙상블 모델을 이용한 과일의 자동 선별)

  • Kim, Min-Ki
    • Journal of Korea Multimedia Society
    • /
    • v.25 no.10
    • /
    • pp.1386-1394
    • /
    • 2022
  • As consumption of high-quality fruits increases and sales and packaging units become smaller, the demand for automatic fruit grading systems is increasing. Compared to other crops, the quality of fruit is determined by visual characteristics such as shape, color, and scratches, rather than just physical size and weight. Accordingly, this study presents a CNN model that can effectively extract and classify the visual features of fruits and a perceptron that classifies fruits using physical features, and proposes a stacking ensemble model that can effectively combine the classification results of these two neural networks. The experiments with AI Hub public data show that the stacking ensemble model is effective for grading fruits. However, the ensemble model does not always improve the performance of classifying all the fruit grading. So, it is necessary to adapt the model according to the kind of fruit.

Structural Studies upon the Interactive Effects between Organic Dyestuffs and Polyelectrolytes (I). The Stacking Effect of Methylene Blue and Acridine Orange (유기색소분자와 전해질고분자 사이의 상호작용 효과에 관한 구조론적 연구 (I). Methylene Blue 및 Acridine Orange의 Stacking 효과)

  • Chong Hoe Park;Dae Hyun Shin;Sock Sung Yun;Moo Soon Park;Hong Lee
    • Journal of the Korean Chemical Society
    • /
    • v.30 no.3
    • /
    • pp.289-295
    • /
    • 1986
  • Spectroscopic studies have been carried out on the metachromatic behavior of methylene blue(MB) and acridine orange(AO) in the presence of polyvinylsulfate(PVS) and polystyrenesulfonate(PSS) The characteristic changes of meta-band with the change of P/D value are discussed in terms of stacking theory. It has been found that the stacking effect in the PVS-dye system is stronger than that in the PSS-dye system and that MB shows stronger stacking effect than AO. A stacking model and dimension of bound dyes on the surface of polymer chain is proposed on the basis of the previously suggested model of dimer found in the aqueous solution of planar aromatic dyes. The proposed model is found to be reasonable in accordance with the experimental results obtained by various workers.

  • PDF

Structural Studies upon the Interactive Effects between Organic Dyestuffs and Polyelectrolytes (Ⅱ). The Interaction of Methylene Blue and Acridine Orange with Chondroitin Sulfate (유기색소분자와 고분자전해질 사이의 상호작용 효과에 관한 구조론적 연구 (II). Methylene Blue 및 Acridine Orange의 Chondroitin Sulfate와의 상호작용)

  • Chong Hoe Park;Moo Soon Park;Hong Lee
    • Journal of the Korean Chemical Society
    • /
    • v.31 no.4
    • /
    • pp.295-300
    • /
    • 1987
  • Spectroscopic studies have been carried out on the metachromatic behavior of methylene blue(MB) and acridine orange(AO) in the presence of chondroitin sulfate A(CSA) and chondroitin sulfate C(CSC). The characteristic changes of the meta-band with the changes of P/D value are discussed in terms of the stacking theory. Quantitative studies on the stacking effect are made to calculate the number of bound molecules of dye per unit molecule of the polyanion. The result shows that MB has stronger stacking effect than AO. A stacking model and the dimension of the bound dyes on the surface of the polyanion are proposed, on the basis of the dimer model of planar aromatic dyes and the most stable conformation of the CSA chain. The model is found to be reasonable in accordance with the experimental results.

  • PDF

Resistance to Air Flow through Fruits and Vegetables in Bulk (산물퇴적 청과물의 송풍저항 특성)

  • 윤홍선;조영길;박판규;박경규
    • Journal of Biosystems Engineering
    • /
    • v.20 no.4
    • /
    • pp.333-342
    • /
    • 1995
  • The resistance to air flow through fruits and vegetables in bulk was an important consideration in the design of the pressure cooling system. The amount of resistance to air flow through produce in bulk normally depended upon air flow rate, stacking depth, porosity, stacking patterns and shape and site of product. But, there was not enough information relating the effects of those factors on air flow resistance. The objectives of this study were to investigate the effect of stacking depth, stacking patterns, porosity and airflow rate on airflow resistance and to develop a statistical model to predict static pressure drop across the produce bed as a function of air flow rate, stacking depth, bed porosity, and product size. Mandarins and tomatoes were used in the experiment. The airflow rate were in the range of 0.1~1.0 ㎥/s.$m^2$, the porosity were in the range of 0.25~0.45, the depth were in the range of 0.3~0.9m and the equivalent diameters were 5.3cm and 6.3cm for mandarins, and 6.5cm and 8.5cm for tomatoes. Three methods of stacking arrangement were used i.e. cubic, square staggered, and staggered stacking arrangement. The results were summarized as follows. 1. The pressure drops across produce bed increased in proportion to stacking depth and superficial air velocity and decreased in proportion to porosity. 2. The increasing rates of pressure drop according to stacking patterns with the increase of superficial air velocity were different one another. The staggered stacking arrangement produced the highest increasing rate and the cubic stacking arrangement produced the lowest increasing rate. But it could be assumed that the stacking patterns had not influenced greatly on pressure drops if it was of equal porosity. 3. The statistical models to predict the pressure drop across produce bed as a function of superficial air velocity, stacking depth, porosity, and product diameter were developed from these experiments.

  • PDF