• Title/Summary/Keyword: Variance Reduction

Search Result 322, Processing Time 0.028 seconds

Statistical algorithm and application for the noise variance estimation (영상 잡음의 분산 추정에 관한 통계적 알고리즘 및 응용)

  • Kim, Yeong-Hwa;Nam, Ji-Ho
    • Journal of the Korean Data and Information Science Society
    • /
    • v.20 no.5
    • /
    • pp.869-878
    • /
    • 2009
  • Image restoration techniques such as noise reduction and contrast enhancement have been researched for enhancing a contaminated image by the noise. An image degraded by additive random noise can be enhanced by noise reduction. Sigma filtering is one of the most widely used method to reduce the noise. In this paper, we propose a new sigma filter algorithm based on noise variance estimation which effectively enhances the degraded image by noise. Specifically, the Bartlett test is used to measure the degree of noise with respect to the degree of image feature. Simulation results are also given to show the performance of the proposed algorithm.

  • PDF

Determination of Incentive Level of Direct Load Control using Probabilistic Technique with Variance Reduction Technique (확률적 기법을 통한 직접부하제어의 제어지원금 산정)

  • Jeong Yun-Won;Park Jong-Bae;Shin Joong-Rin
    • Journal of Energy Engineering
    • /
    • v.14 no.1
    • /
    • pp.46-53
    • /
    • 2005
  • This paper presents a new approach for determining an accurate incentive levels of Direct Load Control (DLC) program using probabilistic techniques. The economic analysis of DLC resources needs to identify the hourly-by-hourly expected energy-not-served resulting from the random outage characteristics of generators as well as to reflect the availability and duration of DLC resources, which results the computational explosion. Therefore, the conventional methods are based on the scenario approaches to reduce the computation time as well as to avoid the complexity of economic studies. In this paper, we have developed a new technique based on the sequential Monte Carlo simulation to evaluate the required expected load control amount in each hour and to decide the incentive level satisfying the economic constraints. In addition, we have applied the variance reduction technique to enhance the efficiency of the simulation. To show the efficiency and effectiveness of the suggested method, the numerical studies have been performed for the modified IEEE 24-bus reliability test system.

Application of Variance Reduction Techniques for the Improvement of Monte Carlo Dose Calculation Efficiency (분산 감소 기법에 의한 몬테칼로 선량 계산 효율 평가)

  • Park, Chang-Hyun;Park, Sung-Yong;Park, Dal
    • Progress in Medical Physics
    • /
    • v.14 no.4
    • /
    • pp.240-248
    • /
    • 2003
  • The Monte Carlo calculation is the most accurate means of predicting radiation dose, but its accuracy is accompanied by an increase in the amount of time required to produce a statistically meaningful dose distribution. In this study, the effects on calculation time by introducing variance reduction techniques and increasing computing power, respectively, in the Monte Carlo dose calculation for a 6 MV photon beam from the Varian 600 C/D were estimated when maintaining accuracy of the Monte Carlo calculation results. The EGSnrc­based BEAMnrc code was used to simulate the beam and the EGSnrc­based DOSXYZnrc code to calculate dose distributions. Variance reduction techniques in the codes were used to describe reduced­physics, and a computer cluster consisting of ten PCs was built to execute parallel computing. As a result, time was more reduced by the use of variance reduction techniques than that by the increase of computing power. Because the use of the Monte Carlo dose calculation in clinical practice is yet limited by reducing the computational time only through improvements in computing power, introduction of reduced­physics into the Monte Carlo calculation is inevitable at this point. Therefore, a more active investigation of existing or new reduced­physics approaches is required.

  • PDF

Tutorial: Methodologies for sufficient dimension reduction in regression

  • Yoo, Jae Keun
    • Communications for Statistical Applications and Methods
    • /
    • v.23 no.2
    • /
    • pp.105-117
    • /
    • 2016
  • In the paper, as a sequence of the first tutorial, we discuss sufficient dimension reduction methodologies used to estimate central subspace (sliced inverse regression, sliced average variance estimation), central mean subspace (ordinary least square, principal Hessian direction, iterative Hessian transformation), and central $k^{th}$-moment subspace (covariance method). Large-sample tests to determine the structural dimensions of the three target subspaces are well derived in most of the methodologies; however, a permutation test (which does not require large-sample distributions) is introduced. The test can be applied to the methodologies discussed in the paper. Theoretical relationships among the sufficient dimension reduction methodologies are also investigated and real data analysis is presented for illustration purposes. A seeded dimension reduction approach is then introduced for the methodologies to apply to large p small n regressions.

A Study on the Effects of Wage Standardization Strategy by the Trade Unions (임금표준화전략의 효과에 관한 연구)

  • 남상섭
    • The Journal of Information Technology
    • /
    • v.3 no.2
    • /
    • pp.23-37
    • /
    • 2000
  • This study examines the effect of trade union on the structure of wage determining and the variance of wage in manufacturing and non-manufacturing, 1993, in Korea It finds that the wage determining mechanism is significantly different between union and nonunion establishments, and that the wage inequality is too significantly lower among workers in establishments that are unionized than among those that are not. However, it is not clear whether the union wage policies designed to standardize rates have the effects of reduction in wage variance. that is mostly because of smaller variance within unionized workers having the same wage determining characteristics.

  • PDF

A Study on the Strategies of Hedging System Trading Using Single-Stock Futures (개별주식선물을 이용한 시스템트레이딩 헤징전략의 성과분석)

  • Kim, Sun Woong;Choi, Heung Sik;Kim, Nam-Hyun
    • Korean Management Science Review
    • /
    • v.31 no.1
    • /
    • pp.49-61
    • /
    • 2014
  • We investigate the hedging effectiveness of incorporating single-stock futures into the corresponding stocks. Investing in only stocks frequently causes too much risk when market volatility suddenly rises. We found that single-stock futures help reduce the variance and risk levels of the corresponding stocks invested. We use daily prices of Korean stocks and their corresponding futures for the time period from December 2009 to August 2013 to test the hedging effect. We also use system trading technique that uses automatic trading program which also has several simulation functions. Moving average strategy, Stochastic's strategy, Larry William's %R strategy have been considered for hedging strategy of the futures. Hedging effectiveness of each strategy was analyzed by percent reduction in the variance between the hedged and the unhedged variance. The results clearly showed that examined hedging strategies reduce price volatility risk compared to unhedged portfolio.

Gaussian Variance Filtering for Automatic Inspection of Gas Pipelines using Magnetic Flux Leakage Signal (가스 배관 자동 검사를 위한 자기 누설 신호의 가우시안 분산 필터링)

  • Han, Byung-Gil;Lee, Min-Ho;Cho, Sung-Ho;Rho, Young-Woo;Choi, Doo-Hyun
    • Proceedings of the IEEK Conference
    • /
    • 2006.06a
    • /
    • pp.361-362
    • /
    • 2006
  • Magnetic Flux Leakage (MFL) inspection is a general non-destructive testing (NDT) method to detect the corrosion of natural gas pipelines. Currently, it is subjectively analyzed by trained analysts. In spite of investing much time and human resources, the inspection results may be different according to the analysts' expertise. So, many gas suppliers are keenly interested in the automation of the interpretation process. This paper presents a Gaussian variance filtering method of MFL signals, which is taken from MFL pigging of underground pipelines. In the proposed algorithm the original MFL signals are filtered by multiple Gaussians with different variance. Experimental results show that this approach does not need to align bias and to use explicit noise reduction algorithm.

  • PDF

STOCHASTIC GRADIENT METHODS FOR L2-WASSERSTEIN LEAST SQUARES PROBLEM OF GAUSSIAN MEASURES

  • YUN, SANGWOON;SUN, XIANG;CHOI, JUNG-IL
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • v.25 no.4
    • /
    • pp.162-172
    • /
    • 2021
  • This paper proposes stochastic methods to find an approximate solution for the L2-Wasserstein least squares problem of Gaussian measures. The variable for the problem is in a set of positive definite matrices. The first proposed stochastic method is a type of classical stochastic gradient methods combined with projection and the second one is a type of variance reduced methods with projection. Their global convergence are analyzed by using the framework of proximal stochastic gradient methods. The convergence of the classical stochastic gradient method combined with projection is established by using diminishing learning rate rule in which the learning rate decreases as the epoch increases but that of the variance reduced method with projection can be established by using constant learning rate. The numerical results show that the present algorithms with a proper learning rate outperforms a gradient projection method.

Noise reduction by sigma filter applying orientations of feature in image (영상에 포함된 특징의 방향성을 적용한 시그마 필터의 잡음제거)

  • Kim, Yeong-Hwa;Park, Youngho
    • Journal of the Korean Data and Information Science Society
    • /
    • v.24 no.6
    • /
    • pp.1127-1139
    • /
    • 2013
  • In the realization of obtained image by various visual equipments, the addition of noise to the original image is a common phenomenon and the occurrence of the noise is practically impossible to prevent completely. Thus, the noise detection and reduction is an important foundational purpose. In this study, we detect the orientation about feature of images and estimate the level of noise variance based on the measurement of the relative proportion of the noise. Also, we apply the estimated level of noise to the sigma filter on noise reduction algorithm. And using the orientation about feature of images by weighted value, we propose the effective algorithm to eliminate noise. As a result, the proposed statistical noise reduction methodology provides significantly improved results over the usual sigma filtering and regardless of the estimated level of the noise variance.

Adaptive Noise Reduction Algorithm for an Image Based on a Bayesian Method

  • Kim, Yeong-Hwa;Nam, Ji-Ho
    • Communications for Statistical Applications and Methods
    • /
    • v.19 no.4
    • /
    • pp.619-628
    • /
    • 2012
  • Noise reduction is an important issue in the field of image processing because image noise lowers the quality of the original pure image. The basic difficulty is that the noise and the signal are not easily distinguished. Simple smoothing is the most basic and important procedure to effectively remove the noise; however, the weakness is that the feature area is simultaneously blurred. In this research, we use ways to measure the degree of noise with respect to the degree of image features and propose a Bayesian noise reduction method based on MAP (maximum a posteriori). Simulation results show that the proposed adaptive noise reduction algorithm using Bayesian MAP provides good performance regardless of the level of noise variance.