• Title/Summary/Keyword: nonparametric statistical method

Search Result 190, Processing Time 0.022 seconds

An Assessment of Statistical Validity of Articles Published in the Journal of Korean Acupuncture & Moxibusition Society - from 1984 to 2002 - (대한침구학회지 논문의 통계적 오류에 관한 연구)

  • Lee, Seung-deok
    • Journal of Acupuncture Research
    • /
    • v.21 no.1
    • /
    • pp.176-188
    • /
    • 2004
  • This study was carried out to investigate statistical validity of medical articles that used various statistical techniques such as t-test, analysis of variance, correlation analysis, regression analysis and chi-square test. For study 429 original articles using those statistical methods were selected from Journal of Korean Acupuncture & Moxibusition Society published from 1984 to 2002. 429 original articles were reviewed to analyzed the statistical procedures. Results are summarized as follows : 1. In this study 93 articles(21.68%) of 429 ones didn't report statement of statistical method in detail. 2. 53 articles(12.53%) didn't report p-value in correctly, and 245 articles(57.11 %) used mean${\pm}$standard error (Mean${\pm}$SEM.) and 109 articles used mean${\pm}$standard deviation(Mean${\pm}$SD.). All of 23 articles using nonparametric statistical techniques made an error to central tendency or dispersion. 3. 175 articles(59.93%) and 14 articles(4.79%) of 292 ones made an error to description of equal variances and normal distribution. 4. 99 articles(50%) of 185 ones misused t-test and 4 articles of 5 ones misused chi-square test. 5. 28 articles(73.68%) of 38 ones using discrete variable misused parametric technique such as t-test or ANOVA. 2 articles and 1 article of 125 ones choosing paired samples misused independent t-test and Mann-Whitney U test. 6. 20 articles using analysis of variance didn't use multiple comparison.

  • PDF

A pooled Bayes test of independence using restricted pooling model for contingency tables from small areas

  • Jo, Aejeong;Kim, Dal Ho
    • Communications for Statistical Applications and Methods
    • /
    • v.29 no.5
    • /
    • pp.547-559
    • /
    • 2022
  • For a chi-squared test, which is a statistical method used to test the independence of a contingency table of two factors, the expected frequency of each cell must be greater than 5. The percentage of cells with an expected frequency below 5 must be less than 20% of all cells. However, there are many cases in which the regional expected frequency is below 5 in general small area studies. Even in large-scale surveys, it is difficult to forecast the expected frequency to be greater than 5 when there is small area estimation with subgroup analysis. Another statistical method to test independence is to use the Bayes factor, but since there is a high ratio of data dependency due to the nature of the Bayesian approach, the low expected frequency tends to decrease the precision of the test results. To overcome these limitations, we will borrow information from areas with similar characteristics and pool the data statistically to propose a pooled Bayes test of independence in target areas. Jo et al. (2021) suggested hierarchical Bayesian pooling models for small area estimation of categorical data, and we will introduce the pooled Bayes factors calculated by expanding their restricted pooling model. We applied the pooled Bayes factors using bone mineral density and body mass index data from the Third National Health and Nutrition Examination Survey conducted in the United States and compared them with chi-squared tests often used in tests of independence.

Statistical analysis of effects of test conditions on compressive strength of cement solidified radioactive waste

  • Hyeongjin Byeon;Jaeyeong Park
    • Nuclear Engineering and Technology
    • /
    • v.55 no.3
    • /
    • pp.876-883
    • /
    • 2023
  • Radioactive waste should be solidified before being disposed of in the repository to eliminate liquidity or dispersibility. Cement is a widely used solidifying media for radioactive waste, and cement solidified waste should satisfy the minimum compressive strength of the waste acceptance criteria of a radioactive repository. Although the compressive strength of waste should be measured by the test method provided by the waste acceptance criteria, the method differs depending on the operating repository of different countries. Considering the measured compressive strength changes depending on test conditions, the effect of test conditions should be analyzed to avoid overestimation or underestimation of the compressive strength during disposal. We selected test conditions such as the height-to-diameter ratio, loading rate, and porosity as the main factors affecting the compressive strength of cement solidified radioactive waste. Owing to the large variance in measured compressive strength, the effects of the test conditions were analyzed via statistical analyses using parametric and nonparametric methods. The results showed that the test condition of the lower loading rate, with a height-to-diameter ratio of two, reflected the actual cement content well, while the porosity showed no correlation. The compressive strength assessment method that reflects the large variance of strengths was suggested.

Image noise reduction algorithms using nonparametric method (비모수 방법을 사용한 영상 잡음 제거 알고리즘)

  • Woo, Ho-young;Kim, Yeong-hwa
    • The Korean Journal of Applied Statistics
    • /
    • v.32 no.5
    • /
    • pp.721-740
    • /
    • 2019
  • Noise reduction is an important field in image processing and requires a statistical approach. However, it is difficult to assume a specific distribution of noise, and a spatial filter that reflects regional characteristics is a small sample and cannot be accessed in a parametric manner. The first order image differential and the second order image differential show a clear difference according to the noise level included in the image and can be more clearly understood using the canyon edge detector. The Fligner-Killeen test was performed and the bootstrap method was used to statistically check the noise level. The estimated noise level was set between 0 and 1 using the cumulative distribution function of the beta distribution. In this paper, we propose a nonparametric noise reduction algorithm that accounts for the noise level included in the image.

Bearing fault detection through multiscale wavelet scalogram-based SPC

  • Jung, Uk;Koh, Bong-Hwan
    • Smart Structures and Systems
    • /
    • v.14 no.3
    • /
    • pp.377-395
    • /
    • 2014
  • Vibration-based fault detection and condition monitoring of rotating machinery, using statistical process control (SPC) combined with statistical pattern recognition methodology, has been widely investigated by many researchers. In particular, the discrete wavelet transform (DWT) is considered as a powerful tool for feature extraction in detecting fault on rotating machinery. Although DWT significantly reduces the dimensionality of the data, the number of retained wavelet features can still be significantly large. Then, the use of standard multivariate SPC techniques is not advised, because the sample covariance matrix is likely to be singular, so that the common multivariate statistics cannot be calculated. Even though many feature-based SPC methods have been introduced to tackle this deficiency, most methods require a parametric distributional assumption that restricts their feasibility to specific problems of process control, and thus limit their application. This study proposes a nonparametric multivariate control chart method, based on multiscale wavelet scalogram (MWS) features, that overcomes the limitation posed by the parametric assumption in existing SPC methods. The presented approach takes advantage of multi-resolution analysis using DWT, and obtains MWS features with significantly low dimensionality. We calculate Hotelling's $T^2$-type monitoring statistic using MWS, which has enough damage-discrimination ability. A bootstrap approach is used to determine the upper control limit of the monitoring statistic, without any distributional assumption. Numerical simulations demonstrate the performance of the proposed control charting method, under various damage-level scenarios for a bearing system.

Wage Determinants Analysis by Quantile Regression Tree

  • Chang, Young-Jae
    • Communications for Statistical Applications and Methods
    • /
    • v.19 no.2
    • /
    • pp.293-301
    • /
    • 2012
  • Quantile regression proposed by Koenker and Bassett (1978) is a statistical technique that estimates conditional quantiles. The advantage of using quantile regression is the robustness in response to large outliers compared to ordinary least squares(OLS) regression. A regression tree approach has been applied to OLS problems to fit flexible models. Loh (2002) proposed the GUIDE algorithm that has a negligible selection bias and relatively low computational cost. Quantile regression can be regarded as an analogue of OLS, therefore it can also be applied to GUIDE regression tree method. Chaudhuri and Loh (2002) proposed a nonparametric quantile regression method that blends key features of piecewise polynomial quantile regression and tree-structured regression based on adaptive recursive partitioning. Lee and Lee (2006) investigated wage determinants in the Korean labor market using the Korean Labor and Income Panel Study(KLIPS). Following Lee and Lee, we fit three kinds of quantile regression tree models to KLIPS data with respect to the quantiles, 0.05, 0.2, 0.5, 0.8, and 0.95. Among the three models, multiple linear piecewise quantile regression model forms the shortest tree structure, while the piecewise constant quantile regression model has a deeper tree structure with more terminal nodes in general. Age, gender, marriage status, and education seem to be the determinants of the wage level throughout the quantiles; in addition, education experience appears as the important determinant of the wage level in the highly paid group.

Logistic Regression Method in Interval-Censored Data

  • Yun, Eun-Young;Kim, Jin-Mi;Ki, Choong-Rak
    • The Korean Journal of Applied Statistics
    • /
    • v.24 no.5
    • /
    • pp.871-881
    • /
    • 2011
  • In this paper we propose a logistic regression method to estimate the survival function and the median survival time in interval-censored data. The proposed method is motivated by the data augmentation technique with no sacrifice in augmenting data. In addition, we develop a cross validation criterion to determine the size of data augmentation. We compare the proposed estimator with other existing methods such as the parametric method, the single point imputation method, and the nonparametric maximum likelihood estimator through extensive numerical studies to show that the proposed estimator performs better than others in the sense of the mean squared error. An illustrative example based on a real data set is given.

Local Linear Logistic Classification of Microarray Data Using Orthogonal Components (직교요인을 이용한 국소선형 로지스틱 마이크로어레이 자료의 판별분석)

  • Baek, Jang-Sun;Son, Young-Sook
    • The Korean Journal of Applied Statistics
    • /
    • v.19 no.3
    • /
    • pp.587-598
    • /
    • 2006
  • The number of variables exceeds the number of samples in microarray data. We propose a nonparametric local linear logistic classification procedure using orthogonal components for classifying high-dimensional microarray data. The proposed method is based on the local likelihood and can be applied to multi-class classification. We applied the local linear logistic classification method using PCA, PLS, and factor analysis components as new features to Leukemia data and colon data, and compare the performance of the proposed method with the conventional statistical classification procedures. The proposed method outperforms the conventional ones for each component, and PLS has shown best performance when it is embedded in the proposed method among the three orthogonal components.

On Practical Efficiency of Locally Parametric Nonparametric Density Estimation Based on Local Likelihood Function

  • Kang, Kee-Hoon;Han, Jung-Hoon
    • Communications for Statistical Applications and Methods
    • /
    • v.10 no.2
    • /
    • pp.607-617
    • /
    • 2003
  • This paper offers a practical comparison of efficiency between local likelihood approach and conventional kernel approach in density estimation. The local likelihood estimation procedure maximizes a kernel smoothed log-likelihood function with respect to a polynomial approximation of the log likelihood function. We use two types of data driven bandwidths for each method and compare the mean integrated squares for several densities. Numerical results reveal that local log-linear approach with simple plug-in bandwidth shows better performance comparing to the standard kernel approach in heavy tailed distribution. For normal mixture density cases, standard kernel estimator with the bandwidth in Sheather and Jones(1991) dominates the others in moderately large sample size.

On Adaptation to Sparse Design in Bivariate Local Linear Regression

  • Hall, Peter;Seifert, Burkhardt;Turlach, Berwin A.
    • Journal of the Korean Statistical Society
    • /
    • v.30 no.2
    • /
    • pp.231-246
    • /
    • 2001
  • Local linear smoothing enjoys several excellent theoretical and numerical properties, an in a range of applications is the method most frequently chosen for fitting curves to noisy data. Nevertheless, it suffers numerical problems in places where the distribution of design points(often called predictors, or explanatory variables) is spares. In the case of univariate design, several remedies have been proposed for overcoming this problem, of which one involves adding additional ″pseudo″ design points in places where the orignal design points were too widely separated. This approach is particularly well suited to treating sparse bivariate design problem, and in fact attractive, elegant geometric analogues of unvariate imputation and interpolation rules are appropriate for that case. In the present paper we introduce and develop pseudo dta rules for bivariate design, and apply them to real data.

  • PDF