• Title/Summary/Keyword: 최소 자승 알고리즘

Search Result 231, Processing Time 0.025 seconds

On the Behavior of the Signed Regressor Least Mean Squares Adaptation with Gaussian Inputs (가우시안 입력신호에 대한 Signed Regressor 최소 평균자승 적응 방식의 동작 특성)

  • 조성호
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.18 no.7
    • /
    • pp.1028-1035
    • /
    • 1993
  • The signed regressor (SR) algorithm employs one bit quantization on the input regressor (or tap input) in such a way that the quantized input sequences become +1 or -1. The algorithm is computationally more efficient by nature than the popular least mean square (LMS) algorithm. The behavior of the SR algorithm unfortunately is heavily dependent on the characteristics of the input signal, and there are some Inputs for which the SR algorithm becomes unstable. It is known, however, that such a stability problem does not take place with the SR algorithm when the input signal is Gaussian, such as in the case of speech processing. In this paper, we explore a statistical analysis of the SR algorithm. Under the assumption that signals involved are zero-mean and Gaussian, and further employing the commonly used independence assumption, we derive a set of nonlinear evolution equations that characterizes the mean and mean-squared behavior of the SR algorithm. Experimental results that show very good agreement with our theoretical derivations are also presented.

  • PDF

Optimal Grayscale Morphological Filters Under the LMS Criterion (LMS 알고리즘을 이용한 형태학 필터의 최적화 방안에 관한 연구)

  • 이경훈;고성제
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.19 no.6
    • /
    • pp.1095-1106
    • /
    • 1994
  • This paper presents a method for determining optimal grayscale function processing(FP) morphological filters under the least square (LMS) error criterion. The optimal erosion and dilation filters with a grayscale structuring element(GSE) are determined by minimizing the mean square error (MSE) between the desired signal and the filter output. It is shown that convergence of the erosion and dilation filters can be achieved by a proper choice of the step size parameter of the LMS algorithm. In an attempt to determine optimal closing and opening filters, a matrix representation of both opening and closing with a basis matrix is proposed. With this representation, opening and closing are accomplished by a local matrix operation rather than cascade operations. The LMS and back-propagation algorithm are utilzed for obtaining the optimal basis matrix for closing and opening. Some results of optimal morphological filters applied to 2-D images are presented.

  • PDF

The Multisignal Improvement of Adaptive Receiver using Adaptive Back-Propagation Algorithm (적응 역전파 알고리즘을 이용한 적응 수신기의 다중 신호 개선)

  • Kim, Chul-Young;Jang, Hyuk;Suk, Kyung-Hyu;Na, Sand-Dong
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2000.05a
    • /
    • pp.188-194
    • /
    • 2000
  • 이동 통신에서 제한된 대역폭 채널에 내부 심볼 간섭을 감소시키기 위해, 등화기 기법을 필요로한다. 채널간의 비선형 왜곡을 효율적으로 다루는 대안을 가진 신경망을 사용하여 새로운 활성 함수로 구성된 적응 역전파 알고리즘을 연구한다. 신경망은 적응 역전파 알고리즘을 통해 신호를 복조하도록 학습한다. 특히 수정된 적응 역전파 알고리즘이 근접된 최적 수행성을 갖는 단일 및 다중 사용자 검출을 위한 샘플링 기법은 다중 사용자 환경에서 필요한 수신기들의 수행성을 평가하기 위한 시뮬레이션을 위하여 사용이 된다. 채널간의 비선형 왜곡에 효율적으로 다루기 위한 대안을 가진 신경망을 적용하여 본 논문에서 는 새로운 활성 함수로 구성된 적응 역전파 알고리즘을 제안하고, 컴퓨터 시뮬레이션에 의해서 분석된다. 반복적 최소 평균 자승(RLS) 알고리즘을 적용한 기존 수신기 및 적응 역전파 신경망과 비교하여, 채널 왜곡이 비선형 일 때에 비트 에러율(BER)이 현저하게 개선됨을 나타낸다. 적응 역전파 알고리즘 기법을 통해 기존 수신기와 신경망을 사용한 수신기의 수행을 컴퓨터 시뮬레이션을 통해 비교 분석하여 제안된 신경망 수신기의 성능이 우수함을 인증한다.

  • PDF

Robust Face and Facial Feature Tracking in Image Sequences (연속 영상에서 강인한 얼굴 및 얼굴 특징 추적)

  • Jang, Kyung-Shik;Lee, Chan-Hee
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.14 no.9
    • /
    • pp.1972-1978
    • /
    • 2010
  • AAM(Active Appearance Model) is one of the most effective ways to detect deformable 2D objects and is a kind of mathematical optimization methods. The cost function is a convex function because it is a least-square function, but the search space is not convex space so it is not guaranteed that a local minimum is the optimal solution. That is, if the initial value does not depart from around the global minimum, it converges to a local minimum, so it is difficult to detect face contour correctly. In this study, an AAM-based face tracking algorithm is proposed, which is robust to various lighting conditions and backgrounds. Eye detection is performed using SIFT and Genetic algorithm, the information of eye are used for AAM's initial matching information. Through experiments, it is verified that the proposed AAM-based face tracking method is more robust with respect to pose and background of face than the conventional basic AAM-based face tracking method.

Online Evolving TSK fuzzy identification (온라인 진화형 TSK 퍼지 식별)

  • Kim, Kyoung-Jung;Park, Chang-Woo;Kim Eun-Tai;Park, Mignon
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.15 no.2
    • /
    • pp.204-210
    • /
    • 2005
  • This paper presents online identification algorithm for TSK fuzzy model. The proposed algorithm identify structure of premise part by using distance, and obtain the parameters of the piecewise linear function consisting consequent part by using recursive least square. Only input space was considered in Most researches on structure identification, but input and output space is considered in the proposed algorithm. By doing so, outliers are excluded in clustering effectively. The existing other algorithm has disadvantage that it is sensitive to noise by using data itself as cluster centers. The proposed algorithm is non-sensitive to noise not by using data itself as cluster centers. Model can be obtained through one pass and it is not needed to memorize many data in the proposed algorithm.

Design and Implementation of Optimal Adaptive Generalized Stack Filter for Image Restoration Using Neural Networks (신경회로망을 이용한 영상복원용 적응형 일반스택 최적화 필터의 설계 및 구현)

  • Moon, Byoung-Jin;Kim, Kwang-Hee;Lee, Bae-Ho
    • Journal of the Korean Institute of Telematics and Electronics S
    • /
    • v.36S no.7
    • /
    • pp.81-89
    • /
    • 1999
  • Image obtained by incomplete communication always include noise, blur and distortion, etc. In this paper, we propose and apply the new spatial filter algorithm, called an optimal adaptive generalized stack filter(AGSF), which optimizes adaptive generalized stack filter(AGSF) using neural network weight learning algorithm of back-propagation learning algorithm for improving noise removal and edge preservation rate. AGSF divides into two parts: generalized stack filter(GSF) and adaptive multistage median filter(AMMF), GSF improves the ability of stack filter algorithm and AMMF proposes the improved algorithm for reserving the sharp edge. Applied to neural network theory, the proposed algorithm improves the performance of the AGSF using two weight learning algorithms, such as the least mean absolute(LAM) and least mean square (LMS) algorithms. Simulation results of the proposed filter algorithm are presented and discussed.

  • PDF

Bayesian Hierachical Model using Gibbs Sampler Method: Field Mice Example (깁스 표본 기법을 이용한 베이지안 계층적 모형: 야생쥐의 예)

  • Song, Jae-Kee;Lee, Gun-Hee;Ha, Il-Do
    • Journal of the Korean Data and Information Science Society
    • /
    • v.7 no.2
    • /
    • pp.247-256
    • /
    • 1996
  • In this paper, we applied bayesian hierarchical model to analyze the field mice example introduced by Demster et al.(1981). For this example, we use Gibbs sampler method to provide the posterior mean and compared it with LSE(Least Square Estimator) and MLR(Maximum Likelihood estimator with Random effect) via the EM algorithm.

  • PDF

Study on the Airfoil Shape Design Optimization Using Database based Genetic Algorithms (데이터베이스 기반 유전 알고리즘을 이용한 효율적인 에어포일 형상 최적화에 대한 연구)

  • Kwon, Jang-Hyuk;Kim, Jin;Kim, Su-Whan
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.31 no.1
    • /
    • pp.58-66
    • /
    • 2007
  • Genetic Algorithms (GA) have some difficulties in practical applications because of too many function evaluations. To overcome these limitations, an approximated modeling method such as Response Surface Modeling(RSM) is coupled to GAs. Original RSM method predicts linear or convex problems well but it is not good for highly nonlinear problems cause of the average effect of the least square method(LSM). So the locally approximated methods. so called as moving least squares method(MLSM) have been used to reduce the error of LSM. In this study, the efficient evolutionary GAs tightly coupled with RSM with MLSM are constructed and then a 2-dimensional inviscid airfoil shape optimization is performed to show its efficiency.

Balancing of a Rigid Rotor using Genetic Algorithms (유전 알고리즘을 이용한 강성회전체의 평형잡이)

  • Yang, Bo Seok;Ju, Ho Jin
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.20 no.2
    • /
    • pp.108-108
    • /
    • 1996
  • This paper describes a new approach to solve balancing of a rigid rotor. In this paper, the balancing of the rigid rotor using genetic algorithms, which are search algorithms based on the mechanics of natural selection and natural genetics is proposed. Under the assumption that the initial vibration values used to calculate correction masses contain errors, the influence coefficient method, the least squares method and a genetic algorithm are compared. The results show that the vibration amplitude obtained with the least squares method and the genetic algorithm is smaller than that obtained with the influence coefficient method.

Balancing of a Rigid Rotor using Genetic Algorithms (유전 알고리즘을 이용한 강성회전체의 평형잡이)

  • 양보석;주호진
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.20 no.2
    • /
    • pp.40-47
    • /
    • 1996
  • This paper describes a new approach to solve balancing of a rigid rotor. In this paper, the balancing of the rigid rotor using genetic algorithms, which are search algorithms based on the mechanics of natural selection and natural genetics is proposed. Under the assumption that the initial vibration values used to calculate correction masses contain errors, the influence coefficient method, the least squares method and a genetic algorithm are compared. The results show that the vibration amplitude obtained with the least squares method and the genetic algorithm is smaller than that obtained with the influence coefficient method.

  • PDF