• 방송공학회논문지
• /
• 제26권7호
• /
• pp.862-867
• /
• 2021

Although Deep Neural Networks (DNNs) have shown remarkable performance in various artificial intelligence fields, it is well known that DNNs are vulnerable to adversarial attacks. Since adversarial attacks are implemented by adding perturbations onto benign examples, increasing the sparsity of DNNs minimizes the propagation of errors to high-level layers. In this paper, unlike the traditional pruning scheme removing low magnitude weights, we eliminate high magnitude weights that are usually considered high absolute values, named 'reverse pruning' to ensure robustness. By conducting both theoretical and experimental analyses, we observe that reverse pruning ensures the robustness of DNNs. Experimental results show that our reverse pruning outperforms previous work with 29.01% in Top-1 accuracy on perturbed CIFAR-10. However, reverse pruning does not guarantee benign samples. To relax this problem, we further conducted experiments by adding a regularization term for the high magnitude weights. With adding the regularization term, we also applied conventional pruning to ensure the robustness of DNNs.

• Journal of the Korean Statistical Society
• /
• 제24권2호
• /
• pp.349-360
• /
• 1995

This paper deals with the robustness properties of the minimum disparity estimation in linear regression models. The estimators defined as statistical quantities whcih minimize the blended weight Hellinger distance between a weighted kernel density estimator of the residuals and a smoothed model density of the residuals. It is shown that if the weights of the density estimator are appropriately chosen, the estimates of the regression parameters are robust.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2003년도 하계종합학술대회 논문집 V
• /
• pp.2569-2572
• /
• 2003

In this paper, we Proposed the inverted pendulum control method using single neuron neural network that have weights as PID parameters. The proposed method has three inputs(proportion, integration, differentiation term of the error), and uses weights as P, I, D parameters. In order to verify the effectiveness of the proposed method, we experimented on the rotary inverted pendulum with load effect disturbance. The results showed the effectiveness and robustness of the proposed pendulum controller.

• 한국전기전자재료학회:학술대회논문집
• /
• 한국전기전자재료학회 2002년도 춘계합동학술대회 논문집
• /
• pp.121-126
• /
• 2002

We proposed the design of SVC adaptive fuzzy logic controller(AFLC) using Tabu search and neural network. We tuned the gains of input-output variables of fuzzy logic controller(FLC) and weights of neural network using Tabu search. Neural network was used for adaptively tuning the output gain of FLC. The weights of neural network was learned from the back propagation algorithm in real-time. To evaluate the usefulness of AFLC, we applied the proposed method to single-machine infinite system. AFLC showed the better control performance than PD controller and GAFLC[8] for. three-phase fault in nominal load which had used when tuning AFLC. To show the robustness of AFLC, we applied the proposed method to disturbances such as three-phase fault in heavy and light load. AFLC showed the better robustness than PD controller and GAFLC[8].

• Communications for Statistical Applications and Methods
• /
• 제7권2호
• /
• pp.574-574
• /
• 2000

Consider the problem of estimating regression function from a set of data which is contaminated by a long-tailed error distribution. The linear smoother is a kind of a local weighted average of response, so it is not robust against outliers. The kernel M-smoother and the lowess attain robustness against outliers by down-weighting outliers. However, the kernel M-smoother and the lowess requires the iteration for computing the robustness weights, and as Wang and Scott(1994) pointed out, the requirement of iteration is not a desirable property. In this article, we propose the robust nonparametic regression method which does not require the iteration. Robustness can be achieved not only by down-weighting outliers but also by transforming outliers. The rank transformation is a simple procedure where the data are replaced by their corresponding ranks. Iman and Conover(1979) showed the fact that the rank transformation is a robust and powerful procedure in the linear regression. In this paper, we show that we can also use the rank transformation to nonparametric regression to achieve the robustness.

• Communications for Statistical Applications and Methods
• /
• 제7권2호
• /
• pp.575-583
• /
• 2000

Consider the problem of estimating regression function from a set of data which is contaminated by a long-tailed error distribution. The linear smoother is a kind of a local weighted average of response, so it is not robust against outliers. The kernel M-smoother and the lowess attain robustness against outliers by down-weighting outliers. However, the kernel M-smoother and the lowess requires the iteration for computing the robustness weights, and as Wang and Scott(1994) pointed out, the requirement of iteration is not a desirable property. In this article, we propose the robust nonparametic regression method which does not require the iteration. Robustness can be achieved not only by down-weighting outliers but also by transforming outliers. The rank transformation is a simple procedure where the data are replaced by their corresponding ranks. Iman and Conover(1979) showed the fact that the rank transformation is a robust and powerful procedure in the linear regression. In this paper, we show that we can also use the rank transformation to nonparametric regression to achieve the robustness.

• Communications for Statistical Applications and Methods
• /
• 제11권1호
• /
• pp.153-160
• /
• 2004

In recent years, the size of data set which we usually handle is enormous, so a lot of outliers could be included in data set. Therefore the robust procedures that automatically handle outliers become very importance issue. We consider the robust estimation problem of location parameter in the univariate case. In this paper, we propose a new method for defining robustness weights for the weighted mean based on the median distance of observations and compare its performance with several existing robust estimators by a simulation study. It turns out that the proposed method is very competitive.

• 전자공학회논문지B
• /
• 제31B권8호
• /
• pp.211-218
• /
• 1994

In this paper we develope a hybrid learning rule to improve the robustness of multi-layer Perceptions. In most neural networks the activation of a neuron is deternined by a nonlinear transformation of the weighted sum of inputs to the neurons. Investigating the behaviour of activations of hidden layer neurons a new learning algorithm is developed for improved robustness for multi-layer Perceptrons. Unlike other methods which reduce the network complexity by putting restrictions on synaptic weights our method based on error-backpropagation increases the complexity of the underlying proplem by imposing it saturation requirement on hidden layer neurons. We also found that the additional gradient-descent term for the requirement corresponds to the Hebbian rule and our algorithm incorporates the Hebbian learning rule into the error back-propagation rule. Computer simulation demonstrates fast learning convergence as well as improved robustness for classification and hetero-association of patterns.

• 대한전기학회논문지:전력기술부문A
• /
• 제51권4호
• /
• pp.188-195
• /
• 2002

We proposed the design of SVC adaptive fuzzy logic controller(AFLC) using Tabu search and neural network. We tuned the gains of input-output variables of fuzzy logic controller(FLC) and weights of neural network using Tabu search. Neural network was used for adaptively tuning the output gain of FLC. The weights of neural network was learned from the back propagation algorithm in real-time. To evaluate the usefulness of AFLC, we applied the proposed method to single-machine infinite system. AFLC showed the better control performance than PD controller and GAFLS[10] for three-phase fault in nominal load which had used when tuning AFLC. To show the robustness of AFLC, we applied the proposed method to disturbances such as three-phase fault in heavy and light load. AFLC showed the better robustness than PD controller and GAFLC[10].

• 한국정보통신학회논문지
• /
• 제11권7호
• /
• pp.1254-1259
• /
• 2007

웨이브릿 변환 영상에서 저주파수 대역에 워터마크를 삽입하는 방법은 공격에 견고하지만 비가시성이 저하된다. 그리고 고주파수 대역에 워터마크를 삽입하는 방법은 비가시성이 좋지만 공격에 취약하다. 본 논문에서는 부대역의 특성과 인지가중치를 이용하여 삽입강도를 적응적으로 조절함으로써 워터마크의 비가시성과 견고성을 향상 시키는 방법을 제안한다. 실험 결과, 제안한 방법은 비가시성에서 $1.7dB{\sim}2.6dB$ 향상되고, 유사도 측정에서 $0.2{\sim}12.9$ 향상됨으로써, 기존의 방법에 비해 비기시성 및 견고성이 우수함을 알 수 있다.