• Title/Summary/Keyword: regularization method

Search Result 301, Processing Time 0.025 seconds

An Improved method of Two Stage Linear Discriminant Analysis

  • Chen, Yarui;Tao, Xin;Xiong, Congcong;Yang, Jucheng
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.3
    • /
    • pp.1243-1263
    • /
    • 2018
  • The two-stage linear discrimination analysis (TSLDA) is a feature extraction technique to solve the small size sample problem in the field of image recognition. The TSLDA has retained all subspace information of the between-class scatter and within-class scatter. However, the feature information in the four subspaces may not be entirely beneficial for classification, and the regularization procedure for eliminating singular metrics in TSLDA has higher time complexity. In order to address these drawbacks, this paper proposes an improved two-stage linear discriminant analysis (Improved TSLDA). The Improved TSLDA proposes a selection and compression method to extract superior feature information from the four subspaces to constitute optimal projection space, where it defines a single Fisher criterion to measure the importance of single feature vector. Meanwhile, Improved TSLDA also applies an approximation matrix method to eliminate the singular matrices and reduce its time complexity. This paper presents comparative experiments on five face databases and one handwritten digit database to validate the effectiveness of the Improved TSLDA.

A time delay estimation method using canonical correlation analysis and log-sum regularization (로그-합 규준화와 정준형 상관 분석을 이용한 시간 지연 추정에 관한 연구)

  • Lim, Jun-Seok;Pyeon, Yong-Gook;Lee, Seokjin;Cheong, MyoungJun
    • The Journal of the Acoustical Society of Korea
    • /
    • v.36 no.4
    • /
    • pp.279-284
    • /
    • 2017
  • The localization of sources has a numerous number of applications. To estimate the position of sources, the relative time delay between two or more received signals for the direct signal must be determined. Although the GCC (Generalized Cross-Correlation) method is the most popular technique, an approach based on CCA (Canonical Correlation Analysis) was also proposed for the TDE (Time Delay Estimation). In this paper, we propose a new adaptive algorithm based on CCA in order to utilized the sparsity in the eigenvector of CCA based time delay estimator. The proposed algorithm uses the eigenvector corresponding to the maximum eigenvalue with log-sum regularization in order to utilize the sparsity in the eigenvector. We have performed simulations for several SNR(signal to noise ratio)s, showing that the new CCA based algorithm can estimate the time delays more accurately than the conventional CCA and GCC based TDE algorithms.

An Adaptation Method in Noise Mismatch Conditions for DNN-based Speech Enhancement

  • Xu, Si-Ying;Niu, Tong;Qu, Dan;Long, Xing-Yan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.10
    • /
    • pp.4930-4951
    • /
    • 2018
  • The deep learning based speech enhancement has shown considerable success. However, it still suffers performance degradation under mismatch conditions. In this paper, an adaptation method is proposed to improve the performance under noise mismatch conditions. Firstly, we advise a noise aware training by supplying identity vectors (i-vectors) as parallel input features to adapt deep neural network (DNN) acoustic models with the target noise. Secondly, given a small amount of adaptation data, the noise-dependent DNN is obtained by using $L_2$ regularization from a noise-independent DNN, and forcing the estimated masks to be close to the unadapted condition. Finally, experiments were carried out on different noise and SNR conditions, and the proposed method has achieved significantly 0.1%-9.6% benefits of STOI, and provided consistent improvement in PESQ and segSNR against the baseline systems.

A Fast Scheme for Inverting Single-Hole Electromagnetic Data

  • Kim Hee Joon;Lee Jung-Mo;Lee Ki Ha
    • Proceedings of the KSEEG Conference
    • /
    • 2002.04a
    • /
    • pp.167-169
    • /
    • 2002
  • The extended Born, or localized nonlinear approximation of integral equation (IE) solution has been applied to inverting single-hole electromagnetic (EM) data using a cylindrically symmetric model. The extended Born approximation is less accurate than a full solution but much superior to the simple Born approximation. When applied to the cylindrically symmetric model with a vertical magnetic dipole source, however, the accuracy of the extended Born approximation is greatly improved because the electric field is scalar and continuous everywhere. One of the most important steps in the inversion is the selection of a proper regularization parameter for stability. Occam's inversion (Constable et al., 1987) is an excellent method for obtaining a stable inverse solution. It is extremely slow when combined with a differential equation method because many forward simulations are needed but suitable for the extended Born solution because the Green's functions, the most time consuming part in IE methods, are repeatedly re-usable throughout the inversion. In addition, the If formulation also readily contains a sensitivity matrix, which can be revised at each iteration at little expense. The inversion algorithm developed in this study is quite stable and fast even if the optimum regularization parameter Is sought at each iteration step. Tn this paper we show inversion results using synthetic data obtained from a finite-element method and field data as well.

  • PDF

Joint Identification of Multiple Genetic Variants of Obesity in a Korean Genome-wide Association Study

  • Oh, So-Hee;Cho, Seo-Ae;Park, Tae-Sung
    • Genomics & Informatics
    • /
    • v.8 no.3
    • /
    • pp.142-149
    • /
    • 2010
  • In recent years, genome-wide association (GWA) studies have successfully led to many discoveries of genetic variants affecting common complex traits, including height, blood pressure, and diabetes. Although GWA studies have made much progress in finding single nucleotide polymorphisms (SNPs) associated with many complex traits, such SNPs have been shown to explain only a very small proportion of the underlying genetic variance of complex traits. This is partly due to that fact that most current GWA studies have relied on single-marker approaches that identify single genetic factors individually and have limitations in considering the joint effects of multiple genetic factors on complex traits. Joint identification of multiple genetic factors would be more powerful and provide a better prediction of complex traits, since it utilizes combined information across variants. Recently, a new statistical method for joint identification of genetic variants for common complex traits via the elastic-net regularization method was proposed. In this study, we applied this joint identification approach to a large-scale GWA dataset (i.e., 8842 samples and 327,872 SNPs) in order to identify genetic variants of obesity for the Korean population. In addition, in order to test for the biological significance of the jointly identified SNPs, gene ontology and pathway enrichment analyses were further conducted.

Measurement of velocity Pronto in Liquid Metal Flow Using Electromagnetic Tomography (전자기 토모그래피를 이용한 액체 금속 속도장 측정)

  • Ahn Yeh-Chan;Kim Moo Hwan;Choi Sang-Ho
    • Transactions of the Korean Society of Mechanical Engineers B
    • /
    • v.28 no.10
    • /
    • pp.1271-1278
    • /
    • 2004
  • In order to measure non-intrusively velocity profile in liquid metal flow, a modified electromagnetic flowmeter was designed, which was based on electromagnetic tomography technique. Under the assumption that flow is fully-developed, axisymmetric and rectilinear, the velocity profile was reconstructed after the flowmeter equation, the first kind of Fredholm integration equation, was linearized. In reconstruction process Tikhonov regularization method with regularization parameter was used. The reconstructed velocity profile had the nearly same as turbulent flow profile which was approximately represented as log law. In addition, flowmeter output fur a fixed magnet rotation angle was linearly proportional to flow rate. When magnet rotation angle was 54$^{\circ}$, axisymmetric weight function was nearly uniform so that the flowmeter gives a constant signal for any fully-developed, axisymmetric and rectilinear profile with a constant flow rate.

Camera Calibration and Barrel Undistortion for Fisheye Lens (차량용 어안렌즈 카메라 캘리브레이션 및 왜곡 보정)

  • Heo, Joon-Young;Lee, Dong-Wook
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.62 no.9
    • /
    • pp.1270-1275
    • /
    • 2013
  • A lot of research about camera calibration and lens distortion for wide-angle lens has been made. Especially, calibration for fish-eye lens which has 180 degree FOV(field of view) or above is more tricky, so existing research employed a huge calibration pattern or even 3D pattern. And it is important that calibration parameters (such as distortion coefficients) are suitably initialized to get accurate calibration results. It can be achieved by using manufacturer information or lease-square method for relatively narrow FOV(135, 150 degree) lens. In this paper, without any previous manufacturer information, camera calibration and barrel undistortion for fish-eye lens with over 180 degree FOV are achieved by only using one calibration pattern image. We applied QR decomposition for initialization and Regularization for optimization. With the result of experiment, we verified that our algorithm can achieve camera calibration and image undistortion successfully.

An SI Scheme for the Assessment of Structural Damage and Damping (구조물 손상탐지 및 감쇄평가를 위한 시간 영역에서의 SI 기법)

  • 이해성;강주성
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2003.05a
    • /
    • pp.430-433
    • /
    • 2003
  • This paper presents a system identification (SI) scheme in time domain using measured acceleration data. The error function is defined as the time integral of the least square errors between the measured acceleration and the calculated acceleration by a mathematical model. Damping parameters as well as stiffness properties of a structure are considered as system parameters. The structural damping is modeled by the Rayleigh damping in SI. The regularization technique is applied to alleviate the ill-posed characteristics of inverse problems. The validity of the proposed method is demonstrated by an experimental study on a shear building model.

  • PDF

Sparse-View CT Image Recovery Using Two-Step Iterative Shrinkage-Thresholding Algorithm

  • Chae, Byung Gyu;Lee, Sooyeul
    • ETRI Journal
    • /
    • v.37 no.6
    • /
    • pp.1251-1258
    • /
    • 2015
  • We investigate an image recovery method for sparse-view computed tomography (CT) using an iterative shrinkage algorithm based on a second-order approach. The two-step iterative shrinkage-thresholding (TwIST) algorithm including a total variation regularization technique is elucidated to be more robust than other first-order methods; it enables a perfect restoration of an original image even if given only a few projection views of a parallel-beam geometry. We find that the incoherency of a projection system matrix in CT geometry sufficiently satisfies the exact reconstruction principle even when the matrix itself has a large condition number. Image reconstruction from fan-beam CT can be well carried out, but the retrieval performance is very low when compared to a parallel-beam geometry. This is considered to be due to the matrix complexity of the projection geometry. We also evaluate the image retrieval performance of the TwIST algorithm -sing measured projection data.

Measurement of Velocity Profile in Liquid Metal Flow Using Electromagnetic Tomography (전자기 토모그래피를 이용한 액체 금속 속도장 측정)

  • Choi, Sang-Ho;Ahn, Yeh-Chan;Kim, Moo-Hwan
    • Proceedings of the KSME Conference
    • /
    • 2004.04a
    • /
    • pp.1749-1754
    • /
    • 2004
  • In order to measure non-intrusively velocity profile in liquid metal flow, a modified electromagnetic flowmeter was designed, which was based on electromagnetic tomography technique. Under the assumption that flow is fully-developed, axisymmetric and rectilinear, the velocity profile was reconstructed after the flowmeter equation, the first kind of Fredholm integration equation, was linearized. In reconstruction process Tikhonov regularization method with regularization parameter was used. The reconstructed velocity profile had the nearly same as turbulent flow profile which was approximately represented as log law. In addition, flowmeter output for a fixed magnet rotation angle was linearly proportional to flow rate. When magnet rotation angle was $54^{\circ}$, axisymmetric weight function was nearly uniform so that the flowmeter gives a constant signal for any fully-developed, axisymmetric and rectilinear profile with a constant flow rate.

  • PDF