• Title/Summary/Keyword: Robust Statistics

Search Result 397, Processing Time 0.019 seconds

Analysis of quantitative high throughput screening data using a robust method for nonlinear mixed effects models

  • Park, Chorong;Lee, Jongga;Lim, Changwon
    • Communications for Statistical Applications and Methods
    • /
    • v.27 no.6
    • /
    • pp.701-714
    • /
    • 2020
  • Quantitative high throughput screening (qHTS) assays are used to assess toxicity for many chemicals in a short period by collectively analyzing them at several concentrations. Data are routinely analyzed using nonlinear regression models; however, we propose a new method to analyze qHTS data using a nonlinear mixed effects model. qHTS data are generated by repeating the same experiment several times for each chemical; therefor, they can be viewed as if they are repeated measures data and hence analyzed using a nonlinear mixed effects model which accounts for both intra- and inter-individual variabilities. Furthermore, we apply a one-step approach incorporating robust estimation methods to estimate fixed effect parameters and the variance-covariance structure since outliers or influential observations are not uncommon in qHTS data. The toxicity of chemicals from a qHTS assay is classified based on the significance of a parameter related to the efficacy of the chemicals using the proposed method. We evaluate the performance of the proposed method in terms of power and false discovery rate using simulation studies comparing with one existing method. The proposed method is illustrated using a dataset obtained from the National Toxicology Program.

A Robust Design Using Approximation Model and Probability of Success (근사모델 및 성공확률을 이용한 강건설계)

  • Song, Byoung-Cheol;Lee, Kwon-Hee
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.7 no.3
    • /
    • pp.3-11
    • /
    • 2008
  • Robust design pioneered by Dr. G. Taguchi has been applied to versatile engineering problems for improving quality. Since 1980s, the Taguchi method has been introduced to numerical optimization, complementing the deficiencies of deterministic optimization, which is often called the robust optimization. In this study, the robust optimization strategy is proposed by considering the robustness of objective and constraint functions. The statistics of responses in the functions are surrogated by kriging models. In addition, objective and/or constraint function is represented by the probability of success, thus facilitating robust optimization. The mathematical problem and the two-bar design problem are investigated to show the validity of the proposed method.

  • PDF

A Robust Principal Component Neural Network

  • Changha Hwang;Park, Hyejung;A, Eunyoung-N
    • Communications for Statistical Applications and Methods
    • /
    • v.8 no.3
    • /
    • pp.625-632
    • /
    • 2001
  • Principal component analysis(PCA) is a multivariate technique falling under the general title of factor analysis. The purpose of PCA is to Identify the dependence structure behind a multivariate stochastic observation In order to obtain a compact description of it. In engineering field PCA is utilized mainly (or data compression and restoration. In this paper we propose a new robust Hebbian algorithm for robust PCA. This algorithm is based on a hyperbolic tangent function due to Hampel ef al.(1989) which is known to be robust in Statistics. We do two experiments to investigate the performance of the new robust Hebbian learning algorithm for robust PCA.

  • PDF

Robust Bayes and Empirical Bayes Analysis in Finite Population Sampling

  • Dal Ho Kim
    • Communications for Statistical Applications and Methods
    • /
    • v.2 no.2
    • /
    • pp.63-73
    • /
    • 1995
  • We consider some robust Bayes estimators using ML-II priors as well as certain empirical Bayes estimators in estimating the finite population mean. The proposed estimators are compared with the sample mean and subjective Bayes estimators in terms of "posterior robustness" and "procedure robustness".re robustness".uot;.

  • PDF

A Robust Approach of Regression-Based Statistical Matching for Continuous Data

  • Sohn, Soon-Cheol;Jhun, Myoung-Shic
    • The Korean Journal of Applied Statistics
    • /
    • v.25 no.2
    • /
    • pp.331-339
    • /
    • 2012
  • Statistical matching is a methodology used to merge microdata from two (or more) files into a single matched file, the variants of which have been extensively studied. Among existing studies, we focused on Moriarity and Scheuren's (2001) method, which is a representative method of statistical matching for continuous data. We examined this method and proposed a revision to it by using a robust approach in the regression step of the procedure. We evaluated the efficiency of our revised method through simulation studies using both simulated and real data, which showed that the proposed method has distinct advantages over existing alternatives.

A Study on High Breakdown Discriminant Analysis : A Monte Carlo Simulation

  • Moon Sup;Young Joo;Youngjo
    • Communications for Statistical Applications and Methods
    • /
    • v.7 no.1
    • /
    • pp.225-232
    • /
    • 2000
  • The linear and quadratic discrimination functions based on normal theory are widely used to classify an observation to one of predefined groups. But the discriminant functions are sensitive to outliers. A high breakdown procedure to estimate location and scatter of multivariate data is the minimum volume ellipsoid or MVE estimator To obtain high breakdown classifiers outliers in multivariate data are detected by using the robust Mahalanobis distance based on MVE estimators and the weighted estimators are inserted in the functions for classification. A samll-sample MOnte Carlo study shows that the high breakdown robust procedures perform better than the classical classifiers.

  • PDF

Statistical analysis of the employment future for Korea

  • Lee, SangHyuk;Park, Sang-Gue;Lee, Chan Kyu;Lim, Yaeji
    • Communications for Statistical Applications and Methods
    • /
    • v.27 no.4
    • /
    • pp.459-468
    • /
    • 2020
  • We examine the rate of substitution of jobs by artificial intelligence using a score called the "weighted ability rate of substitution (WARS)." WARS is a indicator that represents each job's potential for substitution by automation and digitalization. Since the conventional WARS is sensitive to the particular responses from the employees, we consider a robust version of the indicator. In this paper, we propose the individualized WARS, which is a modification of the conventional WARS, and compute robust averages and confidence intervals for inference. In addition, we use the clustering method to statistically classify jobs according to the proposed individualized WARS. The proposed method is applied to Korean job data, and proposed WARS are computed for five future years. Also, we observe that 747 jobs are well-clustered according to the substitution levels.

Minimum Distance Estimation Based On The Kernels For U-Statistics

  • Park, Hyo-Il
    • Journal of the Korean Statistical Society
    • /
    • v.27 no.1
    • /
    • pp.113-132
    • /
    • 1998
  • In this paper, we consider a minimum distance (M.D.) estimation based on kernels for U-statistics. We use Cramer-von Mises type distance function which measures the discrepancy between U-empirical distribution function(d.f.) and modeled d.f. of kernel. In the distance function, we allow various integrating measures, which can be finite, $\sigma$-finite or discrete. Then we derive the asymptotic normality and study the qualitative robustness of M. D. estimates.

  • PDF

Fast robust variable selection using VIF regression in large datasets (대형 데이터에서 VIF회귀를 이용한 신속 강건 변수선택법)

  • Seo, Han Son
    • The Korean Journal of Applied Statistics
    • /
    • v.31 no.4
    • /
    • pp.463-473
    • /
    • 2018
  • Variable selection algorithms for linear regression models of large data are considered. Many algorithms are proposed focusing on the speed and the robustness of algorithms. Among them variance inflation factor (VIF) regression is fast and accurate due to the use of a streamwise regression approach. But a VIF regression is susceptible to outliers because it estimates a model by a least-square method. A robust criterion using a weighted estimator has been proposed for the robustness of algorithm; in addition, a robust VIF regression has also been proposed for the same purpose. In this article a fast and robust variable selection method is suggested via a VIF regression with detecting and removing potential outliers. A simulation study and an analysis of a dataset are conducted to compare the suggested method with other methods.

A Comparative Study on Optimization Procedures to Robust Design (로버스트설계에서 최적화방안에 대한 비교 연구)

  • Kwon, Yong-Man;Mun, In-Suk
    • Journal of the Korean Data and Information Science Society
    • /
    • v.11 no.1
    • /
    • pp.65-72
    • /
    • 2000
  • Robust design is an approach to reducing performance variation of quality characteristic values in quality engineering. Taguchi parameter design has a great deal of advantages but it also has some disadvantages. The various research efforts aimed at developing alternative methods. In the Taguchi parameter design, the product-array approach using orthogonal arrays is mainly used. However, it often requires an excessive number of experiments. An alternative approach, which is called the combined-array approach, was suggested by Welch et. al. (1990) and studied by others. In this paper we make a comparative study on optimization procedures to robust design in the two different experimental design(product array, combined array) approaches the Mough the Monte Carlo simulation.

  • PDF