• Title/Summary/Keyword: Permutation Test

Search Result 88, Processing Time 0.022 seconds

A Note on Bootstrapping in Sufficient Dimension Reduction

  • Yoo, Jae Keun;Jeong, Sun
    • Communications for Statistical Applications and Methods
    • /
    • v.22 no.3
    • /
    • pp.285-294
    • /
    • 2015
  • A permutation test is the popular and attractive alternative to derive asymptotic distributions of dimension test statistics in sufficient dimension reduction methodologies; however, recent studies show that a bootstrapping technique also can be used. We consider two types of bootstrapping dimension determination, which are partial and whole bootstrapping procedures. Numerical studies compare the permutation test and the two bootstrapping procedures; subsequently, real data application is presented. Considering two additional bootstrapping procedures to the existing permutation test, one has more supporting evidence for the dimension estimation of the central subspace that allow it to be determined more convincingly.

A study on alternatives to the permutation test in gene-set analysis (유전자집합분석에서 순열검정의 대안)

  • Lee, Sunho
    • The Korean Journal of Applied Statistics
    • /
    • v.31 no.2
    • /
    • pp.241-251
    • /
    • 2018
  • The analysis of gene sets in microarray has advantages in interpreting biological functions and increasing statistical powers. Many statistical methods have been proposed for detecting significant gene sets that show relations between genes and phenotypes, but there is no consensus about which is the best to perform gene sets analysis and permutation based tests are considered as standard tools. When many gene sets are tested simultaneously, a large number of random permutations are needed for multiple testing with a high computational cost. In this paper, several parametric approximations are considered as alternatives of the permutation distribution and the moment based gene set test has shown the best performance for providing p-values of the permutation test closely and quickly on a general framework.

Permutation Analysis of Split-Half Reliability Coefficient

  • Um, Yonghwan
    • Journal of the Korea Society of Computer and Information
    • /
    • v.22 no.7
    • /
    • pp.133-139
    • /
    • 2017
  • In this paper, we describe a permutation procedure in which we compute a resampling probability value and empirical quantile limits for Split-Half measure of internal reliability. We use the Split-Half reliability coefficient given by two simple methods, the Spearman-Brown formula and the two-part coefficient alpha. The use of a permutation test for Split-Half reliability coefficient is highlighted as a valuable tool when the sample sizes are small and necessary assumptions cannot be met. The permutation tests for Split-Half reliability coefficient are illustrated with an example analysis of two survey data with a sample size of 15 and 35, respectively, and a hypothetical data with a sample size of 5.

Permutation Test for the Equality of Several Independent Cronbach's Alpha Coefficients

  • Um, Yonghwan
    • Journal of the Korea Society of Computer and Information
    • /
    • v.24 no.6
    • /
    • pp.159-164
    • /
    • 2019
  • The statistical inference of Cronbach's alpha measure of internal reliability is known to be inaccurate when sample size is small and the assumption of normality is violated. In this paper, we describe the permutation method in which we compute resampling p-values for testing the difference between two or more independent Cronbach's alpha coefficients. When the over-all permutation test is significant, we also make pairwise post-hoc comparisons using permutaion method. The permutation tests for the equality of two independent Cronbach's alpha coefficients and three independent Cronbach's alpha coefficients are illustrated with an example analysis of survey data.

Testing the Equality of Two Linear Regression Models : Comparison between Chow Test and a Permutation Test

  • Um, Yonghwan
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.8
    • /
    • pp.157-164
    • /
    • 2021
  • Regression analysis is a well-known statistical technique useful to explain the relationship between response variable and predictor variables. In particular, Researchers are interested in comparing the regression coefficients(intercepts and slopes) of the models in two independent populations. The Chow test, proposed by Gregory Chow, is one of the most commonly used methods for comparing regression models and for testing the presence of a structural break in linear models. In this study, we propose the use of permutation method and compare it with Chow test analysis for testing the equality of two independent linear regression models. Then simulation study is conducted to examine the powers of permutation test and Chow test.

Outlier Impact on the Power of Significance Test for Cronbach Alpha Reliability Coefficient

  • Yonghwan Um
    • Journal of the Korea Society of Computer and Information
    • /
    • v.28 no.5
    • /
    • pp.179-187
    • /
    • 2023
  • In this paper, we studied the impact of outliers on the power of the significance tests for Cronbach alpha reliability coefficient. Four variables were varied: sample size, the number of items, the number of outliers and population Cronbach Alpha levels. We simulated data using multivariate normal distribution and used outliers sampled from uniform distribution. To test the significance of Cronbach Alpha Reliability, parametric approach(F statistic) and permutation method were used. Consequently, we observed that the powers of permutation test are equal to or greater than those of F test under all conditions, and also both F test and permutation test lose the power as the number of outliers increases, and that these effects of outliers on the power are enhanced for increasing population alpha levels.

Tests to Detect Changes in Micro-Flora Composition;

  • Kim, Donguk;Yang, Mark C.K.
    • Communications for Statistical Applications and Methods
    • /
    • v.10 no.1
    • /
    • pp.211-224
    • /
    • 2003
  • Good's lambda test, a permutation test used to detect the changes of microorganism composition under two pathological conditions, has been quite popular for studying the micro-flora responsible for periodontal disease. A vast number of different micro-flora in the mouth renders the traditional chi-square test inapplicable. The main purpose of this paper is to evaluate the power of this test so that the sample size can be determined at the design stage. The robustness of this test and its comparison to two other intuitive tests are also presented. It is found that a permutation test based on likelihood ratio is more powerful than the lambda test in our simulated cases.

Permutation-Based Test with Small Samples for Detecting Differentially Expressed Genes (극소수 샘플에서 유의발현 유전자 탐색에 사용되는 순열에 근거한 검정법)

  • Lee, Ju-Hyoung;Song, Hae-Hiang
    • The Korean Journal of Applied Statistics
    • /
    • v.22 no.5
    • /
    • pp.1059-1072
    • /
    • 2009
  • In the analysis of microarray data with a small number of arrays, the most important task is the detection of differentially expressed genes by a significance test. For this purpose, one needs to construct a null distribution based on a large number of genes and one of the best way for constructing the null distribution for a small number of arrays is by means of permutation methods. In this paper we propose simple test statistics and permutation methods that are appropriate in constructing the null distribution. In a simulation study, we compare the null distributions generated by the proposed test statistics and permutation methods with the previous ones. With an example microarray data, differentially expressed genes are determined by applying these methods.

Nonparametric test on dimensionality of explantory variables (설명변수 차원 축소에 관한 비모수적 검정)

  • 서한손
    • The Korean Journal of Applied Statistics
    • /
    • v.8 no.2
    • /
    • pp.65-75
    • /
    • 1995
  • For the determination of dimension of e.d.r. space, both of Sliced Inverse Regression (SIR) and Principal Hessian Directions (PHD) proposed asymptotic test. But the asymptotic test requires the normality and large samples of explanatory variables. Cook and Weisberg(1991) suggested permutation tests instead. In this study permutation tests are actually made, and the power of them is compared with asymptotic test in the case of SIR and PHD.

  • PDF

Nonparametric Test for Multivariate Location Translation Alternatives

  • Na, Jong-Hwa
    • Communications for Statistical Applications and Methods
    • /
    • v.7 no.3
    • /
    • pp.799-809
    • /
    • 2000
  • In this paper we propose a nonparametric one sided test for location parameters in p-variate(p$\geq$2) location translation model. The exact null distributions of test statistics are calculated by permutation principle in the case of relatively small sample sizes and the asymptotic distributions are also considered. The powers of various tests are compared through computer simulation and thep-values with real data are also suggested through example.

  • PDF