• Title/Summary/Keyword: Robust SVM

Search Result 95, Processing Time 0.03 seconds

Design of Robust Support Vector Machine Using Genetic Algorithm (유전자 알고리즘을 이용한 강인한 Support vector machine 설계)

  • Lee, Hee-Sung;Hong, Sung-Jun;Lee, Byung-Yun;Kim, Eun-Tai
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.20 no.3
    • /
    • pp.375-379
    • /
    • 2010
  • The support vector machine (SVM) has been widely used in variety pattern recognition problems applicable to recommendation systems due to its strong theoretical foundation and excellent empirical successes. However, SVM is sensitive to the presence of outliers since outlier points can have the largest margin loss and play a critical role in determining the decision hyperplane. For robust SVM, we limit the maximum value of margin loss which includes the non-convex optimization problem. Therefore, we proposed the design method of robust SVM using genetic algorithm (GA) which can solve the non-convex optimization problem. To demonstrate the performance of the proposed method, we perform experiments on various databases selected in UCI repository.

Genetic Outlier Detection for a Robust Support Vector Machine

  • Lee, Heesung;Kim, Euntai
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.15 no.2
    • /
    • pp.96-101
    • /
    • 2015
  • Support vector machine (SVM) has a strong theoretical foundation and also achieved excellent empirical success. It has been widely used in a variety of pattern recognition applications. Unfortunately, SVM also has the drawback that it is sensitive to outliers and its performance is degraded by their presence. In this paper, a new outlier detection method based on genetic algorithm (GA) is proposed for a robust SVM. The proposed method parallels the GA-based feature selection method and removes the outliers that would be considered as support vectors by the previous soft margin SVM. The proposed algorithm is applied to various data sets in the UCI repository to demonstrate its performance.

Class Discriminating Feature Vector-based Support Vector Machine for Face Membership Authentication (얼굴 등록자 인증을 위한 클래스 구별 특징 벡터 기반 서포트 벡터 머신)

  • Kim, Sang-Hoon;Seol, Tae-In;Chung, Sun-Tae;Cho, Seong-Won
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.46 no.1
    • /
    • pp.112-120
    • /
    • 2009
  • Face membership authentication is to decide whether an incoming person is an enrolled member or not using face recognition, and basically belongs to two-class classification where support vector machine (SVM) has been successfully applied. The previous SVMs used for face membership authentication have been trained and tested using image feature vectors extracted from member face images of each class (enrolled class and unenrolled class). The SVM so trained using image feature vectors extracted from members in the training set may not achieve robust performance in the testing environments where configuration and size of each class can change dynamically due to member's joining or withdrawal as well as where testing face images have different illumination, pose, or facial expression from those in the training set. In this paper, we propose an effective class discriminating feature vector-based SVM for robust face membership authentication. The adopted features for training and testing the proposed SVM are chosen so as to reflect the capability of discriminating well between the enrolled class and the unenrolled class. Thus, the proposed SVM trained by the adopted class discriminating feature vectors is less affected by the change in membership and variations in illumination, pose, and facial expression of face images. Through experiments, it is shown that the face membership authentication method based on the proposed SVM performs better than the conventional SVM-based authentication methods and is relatively robust to the change in the enrolled class configuration.

Robust Segmentation for Low Quality Cell Images from Blood and Bone Marrow

  • Pan Chen;Fang Yi;Yan Xiang-Guo;Zheng Chong-Xun
    • International Journal of Control, Automation, and Systems
    • /
    • v.4 no.5
    • /
    • pp.637-644
    • /
    • 2006
  • Biomedical image is often complex. An applied image analysis system should deal with the images which are of quite low quality and are challenging to segment. This paper presents a framework for color cell image segmentation by learning and classification online. It is a robust two-stage scheme using kernel method and watershed transform. In first stage, a two-class SVM is employed to discriminate the pixels of object from background; where the SVM is trained on the data which has been analyzed using the mean shift procedure. A real-time training strategy is also developed for SVM. In second stage, as the post-processing, local watershed transform is used to separate clustering cells. Comparison with the SSF (Scale space filter) and classical watershed-based algorithm (those are often employed for cell image segmentation) is given. Experimental results demonstrate that the new method is more accurate and robust than compared methods.

Robust SVM Design for Multi-Class Classification - Application to Biometric data - (다중 클래스 분류를 위한 강인한 SVM 설계 방법 - 생체 인식 데이터에의 적용 -)

  • Cho, Min-Kook;Park, Hye-Young
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2005.07b
    • /
    • pp.760-762
    • /
    • 2005
  • Support vector machine(SVM)은 졸은 일반화 능력을 가진 학습시스템으로, 최근 다양한 패턴 인식 분야에서 적용되고 있다. SVM은 기본적으로 이진 분류기이므로 두 개 이상의 클래스를 분류하기 위해서는 다중 클래스 분류가 가능한 형태로의 설계 방법이 필요하다. 이를 위해 각 클래스별로 독립적인 SVM들을 만들어 결과를 병합하는 방식이 주로 사용되어 왔다. 그러나 이러한 방법은 클래스의 수는 않고 한 클래스 내의 데이터의 수가 많지 않은 경우에는 SVM의 일반화 성능을 저하시키고 노이즈에 민감해지는 문제점을 가지고 있다. 이를 해결하기 위해 본 논문에서는 각 클래스내의 데이터간의 유사도 측정을 위한 통계적 정보를 안정적으로 추출하기 위해 두 데이터의 쌍을 입력으로 받는 새로운 SVM 설계 방법을 제시한다. 제안한 방법을 실제 생체인식 데이터에 적용한 실험에서 기존의 방법보다 우수한 분류 성능을 보임을 확인할 수 있었다.

  • PDF

Development of a Robust Multiple Audio Watermarking Using Improved Quantization Index Modulation and Support Vector Machine (개선된 QIM과 SVM을 이용한 공격에 강인한 다중 오디오 워터마킹 알고리즘 개발)

  • Seo, Ye-Jin;Cho, San-Gjin;Chong, Ui-Pil
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.16 no.2
    • /
    • pp.63-68
    • /
    • 2015
  • This paper proposes a robust multiple audio watermarking algorithm using improved QIM(quantization index modulation) with adaptive stepsize for different signal power and SVM(support vector machine) decoding model. The proposed algorithm embeds watermarks into both frequency magnitude response and frequency phase response using QIM. This multiple embedding method can achieve a complementary robustness. The SVM decoding model can improve detection rate when it is not sure whether the extracted data are the watermarks or not. To evaluate robustness, 11 attacks are employed. Consequently, the proposed algorithm outperforms previous multiple watermarking algorithm, which is identical to the proposed one but without SVM decoding model, in PSNR and BER. It is noticeable that the proposed algorithm achieves improvements of maximum PSNR 7dB and BER 10%.

Eye Detection in Facial Images Using Zernike Moments with SVM

  • Kim, Hyoung-Joon;Kim, Whoi-Yul
    • ETRI Journal
    • /
    • v.30 no.2
    • /
    • pp.335-337
    • /
    • 2008
  • An eye detection method for facial images using Zernike moments with a support vector machine (SVM) is proposed. Eye/non-eye patterns are represented in terms of the magnitude of Zernike moments and then classified by the SVM. Due to the rotation-invariant characteristics of the magnitude of Zernike moments, the method is robust against rotation, which is demonstrated using rotated images from the ORL database. Experiments with TV drama videos showed that the proposed method achieved a 94.6% detection rate, which is a higher performance level than that achievable by the method that uses gray values with an SVM.

  • PDF

Weighted Support Vector Machines with the SCAD Penalty

  • Jung, Kang-Mo
    • Communications for Statistical Applications and Methods
    • /
    • v.20 no.6
    • /
    • pp.481-490
    • /
    • 2013
  • Classification is an important research area as data can be easily obtained even if the number of predictors becomes huge. The support vector machine(SVM) is widely used to classify a subject into a predetermined group because it gives sound theoretical background and better performance than other methods in many applications. The SVM can be viewed as a penalized method with the hinge loss function and penalty functions. Instead of $L_2$ penalty function Fan and Li (2001) proposed the smoothly clipped absolute deviation(SCAD) satisfying good statistical properties. Despite the ability of SVMs, they have drawbacks of non-robustness when there are outliers in the data. We develop a robust SVM method using a weight function with the SCAD penalty function based on the local quadratic approximation. We compare the performance of the proposed SVM with the SVM using the $L_1$ and $L_2$ penalty functions.

Robust Feature Parameter for Implementation of Speech Recognizer Using Support Vector Machines (SVM음성인식기 구현을 위한 강인한 특징 파라메터)

  • 김창근;박정원;허강인
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.41 no.3
    • /
    • pp.195-200
    • /
    • 2004
  • In this paper we propose effective speech recognizer through two recognition experiments. In general, SVM is classification method which classify two class set by finding voluntary nonlinear boundary in vector space and possesses high classification performance under few training data number. In this paper we compare recognition performance of HMM and SVM at training data number and investigate recognition performance of each feature parameter while changing feature space of MFCC using Independent Component Analysis(ICA) and Principal Component Analysis(PCA). As a result of experiment, recognition performance of SVM is better than 1:.um under few training data number, and feature parameter by ICA showed the highest recognition performance because of superior linear classification.

Adaptive Switching Median Filter for Impulse Noise Removal Based on Support Vector Machines

  • Lee, Dae-Geun;Park, Min-Jae;Kim, Jeong-Ok;Kim, Do-Yoon;Kim, Dong-Wook;Lim, Dong-Hoon
    • Communications for Statistical Applications and Methods
    • /
    • v.18 no.6
    • /
    • pp.871-886
    • /
    • 2011
  • This paper proposes a powerful SVM-ASM filter, the adaptive switching median(ASM) filter based on support vector machines(SVMs), to effectively reduce impulse noise in corrupted images while preserving image details and features. The proposed SVM-ASM filter is composed of two stages: SVM impulse detection and ASM filtering. SVM impulse detection determines whether the pixels are corrupted by noise or not according to an optimal discrimination function. ASM filtering implements the image filtering with a variable window size to effectively remove the noisy pixels determined by the SVM impulse detection. Experimental results show that the SVM-ASM filter performs significantly better than many other existing filters for denoising impulse noise even in highly corrupted images with regard to noise suppression and detail preservation. The SVM-ASM filter is also extremely robust with respect to various test images and various percentages of image noise.