• 제목/요약/키워드: regularization method

검색결과 301건 처리시간 0.025초

Improvement of Support Vector Clustering using Evolutionary Programming and Bootstrap

  • Jun, Sung-Hae
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제8권3호
    • /
    • pp.196-201
    • /
    • 2008
  • Statistical learning theory has three analytical tools which are support vector machine, support vector regression, and support vector clustering for classification, regression, and clustering respectively. In general, their performances are good because they are constructed by convex optimization. But, there are some problems in the methods. One of the problems is the subjective determination of the parameters for kernel function and regularization by the arts of researchers. Also, the results of the learning machines are depended on the selected parameters. In this paper, we propose an efficient method for objective determination of the parameters of support vector clustering which is the clustering method of statistical learning theory. Using evolutionary algorithm and bootstrap method, we select the parameters of kernel function and regularization constant objectively. To verify improved performances of proposed research, we compare our method with established learning algorithms using the data sets form ucr machine learning repository and synthetic data.

Semi-supervised Cross-media Feature Learning via Efficient L2,q Norm

  • Zong, Zhikai;Han, Aili;Gong, Qing
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제13권3호
    • /
    • pp.1403-1417
    • /
    • 2019
  • With the rapid growth of multimedia data, research on cross-media feature learning has significance in many applications, such as multimedia search and recommendation. Existing methods are sensitive to noise and edge information in multimedia data. In this paper, we propose a semi-supervised method for cross-media feature learning by means of $L_{2,q}$ norm to improve the performance of cross-media retrieval, which is more robust and efficient than the previous ones. In our method, noise and edge information have less effect on the results of cross-media retrieval and the dynamic patch information of multimedia data is employed to increase the accuracy of cross-media retrieval. Our method can reduce the interference of noise and edge information and achieve fast convergence. Extensive experiments on the XMedia dataset illustrate that our method has better performance than the state-of-the-art methods.

경계-보존 방향성 평활화를 이용한 양안 영상의 변이 추정과 중간 시점 영상의 재구성 (Edge-Preserving Directional Regularization Technique for Disparity Estimation and Intermediate View Reconstruction of Stereoscopic Images)

  • 김미현;강문기;이철희;최윤식;손광훈
    • 방송공학회논문지
    • /
    • 제4권1호
    • /
    • pp.59-67
    • /
    • 1999
  • 본 논문에서는 입체 영상 시스템 중 전송단에서의 영상의 입체감 분석을 위한 변이추정 과정과 수신단에서의 중간시점영상 재구성 방식에 대해 중점적으로 연구하였다. 변이추정은 기본적으로 MAE(mean absolute error)를 최소가 되도록 하는 동시에, 블록의 변이를 각 방향에서의 영상의 벼화량에 반비례하게 평활화하는 반복적 블록 정합 방식을 제안하여 적용하였다. 수신단에서는 복원된 영상과 변이 정보를 이용하여 중간시점 영상을 재구성하였으며, 보간법(interpolation)을 사용하는 동시에 좌 또는 우영상의 가려진 영역(occlusion)에서는 좌우 영상 중 한 영상에서의 외삽법(extrapolation)을 사용하여 변이-보상 변이 전달방식으로 이를 합성하였다. 이 변이 추정 방식으로영상의 평활 영역에서 일정하게 평활화된 변이를 추정하여 변이 정보에 대한 정보량을 줄이고, 경계부분에서는 평활화 방식에서 흔히 발생하는 과평활화 문제를 해결하였다. 또한 IVR 에서는 다른 방식에 비해 영상의 경계 부분을 보존하며, occlusion 영역을 잘 살리는 특성을 보였다.

  • PDF

얼굴인식해석의 Small Sample Size 문제 해결을 위한 Resampling 방법 (A Resampling Method for Small Sample Size Problems in Face Recondition)

  • 오재현;곽노준;최태영
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2008년도 심포지엄 논문집 정보 및 제어부문
    • /
    • pp.172-173
    • /
    • 2008
  • LDA를 이용한 얼굴 인식에서 발생하는 small sample sire 문제를 해결하기 위해서 regularization method를 주로 사용한다. 이 방법을 사용하게 되면 클래스 내 분산행렬의 특이성을 없앨 수 있지만, 클래스 내 분산행렬과 단위행렬 $\alpha$를 곱한 값을 더하는 과정에서 $\alpha$의 값을 임의적으로 정해주어야 되고 이 값에 따라 인식률이 개선되지 않을 수 있다는 문제점이 있다. Resampling 개념을 이용하여 학습 데이터의 수를 늘리게 되면 regularization method보다 개선된 인식률을 얻을 수 있다. 또한 경험적으로 $\alpha$값을 정해 주어야 하고, $\alpha$값에 따라 인식률의 변통이 생길 수 있는 단점이 개선되는 효과를 얻을 수 있다.

  • PDF

A note on SVM estimators in RKHS for the deconvolution problem

  • Lee, Sungho
    • Communications for Statistical Applications and Methods
    • /
    • 제23권1호
    • /
    • pp.71-83
    • /
    • 2016
  • In this paper we discuss a deconvolution density estimator obtained using the support vector machines (SVM) and Tikhonov's regularization method solving ill-posed problems in reproducing kernel Hilbert space (RKHS). A remarkable property of SVM is that the SVM leads to sparse solutions, but the support vector deconvolution density estimator does not preserve sparsity as well as we expected. Thus, in section 3, we propose another support vector deconvolution estimator (method II) which leads to a very sparse solution. The performance of the deconvolution density estimators based on the support vector method is compared with the classical kernel deconvolution density estimator for important cases of Gaussian and Laplacian measurement error by means of a simulation study. In the case of Gaussian error, the proposed support vector deconvolution estimator shows the same performance as the classical kernel deconvolution density estimator.

Modified gradient methods hybridized with Tikhonov regularization for damage identification of spatial structure

  • Naseralavi, S.S.;Shojaee, S.;Ahmadi, M.
    • Smart Structures and Systems
    • /
    • 제18권5호
    • /
    • pp.839-864
    • /
    • 2016
  • This paper presents an efficient method for updating the structural finite element model. Model updating is performed through minimizing the difference between the recorded acceleration of a real damaged structure and a hypothetical damaged one. This is performed by updating physical parameters (module of elasticity in this study) in each step using iterative process of modified nonlinear conjugate gradient (M-NCG) and modified Broyden-Fletcher-Goldfarb-Shanno algorithm (M-BFGS) separately. These algorithms are based on sensitivity analysis and provide a solution for nonlinear damage detection problem. Three illustrative test examples are considered to assess the performance of the proposed method. Finally, it is demonstrated that the proposed method is satisfactory for detecting the location and ratio of structural damage in presence of noise.

Enhancing the Reconstruction of Acoustic Source Field Using Wavelet Transformation

  • Ko Byeongsik;Lee Seung-Yop
    • Journal of Mechanical Science and Technology
    • /
    • 제19권8호
    • /
    • pp.1611-1620
    • /
    • 2005
  • This paper shows the use of wavelet transformation combined with inverse acoustics to reconstruct the surface velocity of a noise source. This approach uses the boundary element analysis based on the measured sound pressure at a set of field points, the Helmholtz integral equations and wavelet transformation for reconstructing the normal surface velocity field. The reconstructed field can be diverged due to the small measurement errors in the case of nearfield acoustic holography (NAH) using an inverse boundary element method. In order to avoid this instability in the inverse problem, the reconstruction process should include some form of regularization for enhancing the resolution of source images. The usual method of regularization has been the truncation of wave vectors associated with small singular values, although the order of an optimal truncation is difficult to determine. In this paper, a wavelet transformation is applied to reduce the computation time for inverse acoustics and to enhance the reconstructed vibration field. The computational speed-up is achieved, with solution time being reduced to $14.5\%$.

Multi-Frame Super-Resolution of High Frequency with Spatially Weighted Bilateral Total Variance Regularization

  • Lee, Oh-Young;Park, Sae-Jin;Kim, Jae-Woo;Kim, Jong-Ok
    • IEIE Transactions on Smart Processing and Computing
    • /
    • 제3권5호
    • /
    • pp.271-274
    • /
    • 2014
  • Bayesian based Multi-Frame Super-Resolution (MF-SR) has been used as a popular and effective SR model. On the other hand, the texture region is not reconstructed sufficiently because it works on the spatial domain. In this study, the MF-SR method was extended to operate on the frequency domain to improve HF information as much as possible. For this, a spatially weighted bilateral total variation model was proposed as a regularization term for a Bayesian estimation. The experimental results showed that the proposed method can recover the texture region more realistically with reduced noise, compared to conventional methods.

거리영상 개선을 위한 정칙화 기반 표면 평활화기술 (Regularized Surface Smoothing for Enhancement of Range Data)

  • 기현종;신정호;백준기
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2003년도 하계종합학술대회 논문집 Ⅳ
    • /
    • pp.1903-1906
    • /
    • 2003
  • This paper proposes an adaptive regularized noise smoothing algorithm for range image using the area decreasing flow method, which can preserve meaningful edges during the smoothing process. Although the area decreasing flow method can easily smooth Gaussian noise, it has two problems; ⅰ) it is not easy to remove impulsive noise from observed range data, and ⅱ) it is also difficult to remove noise near edge when the adaptive regularization is used. In the paper, therefore, the second smoothness constraint is addtionally incorporated into the existing regularization algorithm, which minimizes the difference between the median filtered data and the estimated data. As a result, the Proposed algorithm can effectively remove the noise of dense range data with edge preserving.

  • PDF

A Study on the Poorly-posed Problems in the Discriminant Analysis of Growth Curve Model

  • Shim, Kyu-Bark
    • Communications for Statistical Applications and Methods
    • /
    • 제9권1호
    • /
    • pp.87-100
    • /
    • 2002
  • Poorly-posed problems in the balanced discriminant analysis was considered. We restrict consideration to the case of observations and the number of variables are the same and small. When these problems exist, we do not use a maximum likelihood estimates(MLE) to estimate covariance matrices. Instead of MLE, an alternative estimate for the covariance matrices are proposed. This alternative method make good use of two regularization parameters, $\lambda$} and $\gamma$. A new test rule for the discriminant function is suggested and examined via limited hut informative simulation study. From the simulation study, it is shown that the suggested test rule gives better test result than other previously suggested method in terms of error rate criterion.