• 제목/요약/키워드: Minimum Entropy

검색결과 75건 처리시간 0.023초

A Consideration on Easter Convergence and Higher Reliability of The New Blind Equalization Algorithm using The Minimum Entropy Method

  • Matsumoto, Hiroki;Kusakari, Shinya;Furukawa, Toshihiro
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2002년도 ITC-CSCC -3
    • /
    • pp.1467-1470
    • /
    • 2002
  • The minimum entropy method is one of blind equalization method. A conventional algorithm using the minimum entropy method has two problems : slower convergence and lower reliability of recovered signals. We propose a new algorithm using the minimum entropy method for solving the two problems. Pina31y, we confirm the validity of the proposed algorithm through computer simulation.

  • PDF

Minimum Variance Unbiased Estimation for the Maximum Entropy of the Transformed Inverse Gaussian Random Variable by Y=X-1/2

  • Choi, Byung-Jin
    • Communications for Statistical Applications and Methods
    • /
    • 제13권3호
    • /
    • pp.657-667
    • /
    • 2006
  • The concept of entropy, introduced in communication theory by Shannon (1948) as a measure of uncertainty, is of prime interest in information-theoretic statistics. This paper considers the minimum variance unbiased estimation for the maximum entropy of the transformed inverse Gaussian random variable by $Y=X^{-1/2}$. The properties of the derived UMVU estimator is investigated.

Mixed $H_2/H_{\infty}$ Controller Realization with Entropy Integral

  • Lee, Sang-Hyuk;Kim, Ju-Sik
    • International Journal of Control, Automation, and Systems
    • /
    • 제1권2호
    • /
    • pp.206-209
    • /
    • 2003
  • An $H_2$/$H_{\infty}$ -controller realization is carried out by considering an entropy integral. Using J-spectral factorization, the parametrizations of all $H_{\infty}$ stabilizing controllers are derived. By the relation of a mixed $H_2$/$H_{\infty}$ control problem and a minimum entropy/$H_{\infty}$ control problem, the mixed $H_2$/$H_{\infty}$-controller state-space realization is presented.

Context-Based Minimum MSE Prediction and Entropy Coding for Lossless Image Coding

  • Musik-Kwon;Kim, Hyo-Joon;Kim, Jeong-Kwon;Kim, Jong-Hyo;Lee, Choong-Woong
    • 한국방송∙미디어공학회:학술대회논문집
    • /
    • 한국방송공학회 1999년도 KOBA 방송기술 워크샵 KOBA Broadcasting Technology Workshop
    • /
    • pp.83-88
    • /
    • 1999
  • In this paper, a novel gray-scale lossless image coder combining context-based minimum mean squared error (MMSE) prediction and entropy coding is proposed. To obtain context of prediction, this paper first defines directional difference according to sharpness of edge and gradients of localities of image data. Classification of 4 directional differences forms“geometry context”model which characterizes two-dimensional general image behaviors such as directional edge region, smooth region or texture. Based on this context model, adaptive DPCM prediction coefficients are calculated in MMSE sense and the prediction is performed. The MMSE method on context-by-context basis is more in accord with minimum entropy condition, which is one of the major objectives of the predictive coding. In entropy coding stage, context modeling method also gives useful performance. To reduce the statistical redundancy of the residual image, many contexts are preset to take full advantage of conditional probability in entropy coding and merged into small number of context in efficient way for complexity reduction. The proposed lossless coding scheme slightly outperforms the CALIC, which is the state-of-the-art, in compression ratio.

실제 SAR 영상에서의 최소 엔트로피 기반의 자동 초점 기법 연구 (Minimum-Entropy-Based Autofocus Method for Real SAR Images)

  • 황정훈;신현익;김환우
    • 한국전자파학회논문지
    • /
    • 제29권5호
    • /
    • pp.366-374
    • /
    • 2018
  • 항공기 탑재 SAR(Synthetic Aperture Radar)의 경우 요동의 발생은 필수적이며, 요동 보상 이후 완전히 제거되지 않은 잔여 오차에 의한 품질 저하를 개선하기 위한 자동 초점(Autofocus: AF) 기법은 반드시 필요하다. 본 논문에서는 스포트라이트 모드(spotlight mode)로 획득한 실제 SAR 영상에서 견고한 성능 개선이 가능한 최소 엔트로피(Minimum-Entropy: ME) 기반의 자동초점 기법을 제시한다. AF의 반복 적용 시마다 위상 오차 추정치가 단조 감소 조건을 만족하는지를 확인하고 이를 어긋날 경우, 조건을 만족하도록 위상 오차 추정 크기를 조정하는 기법을 제안한다. 실제 SAR 원시데이터에 제안한 방식을 적용하고 성능 비교를 수행하여 제안한 방식의 우수함을 보이도록 한다.

최소 엔트로피를 고려한 혼합 $H_2/H_{\infty}$ 제어기 구성 (Mixed $H_2/H_{\infty}$ Controller Design Considering Minimum Entropy)

  • 이상혁;서진헌
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 1996년도 하계학술대회 논문집 B
    • /
    • pp.999-1001
    • /
    • 1996
  • In this paper, we represented the relation of minimum entropy/$H_{\infty}$-controller and mixed $H_2/H_{\infty}$-controller. An $H_2$ controller design problem involving a constraint on $H_{\infty}$ disturbance attenuation is considered. By the equivalence of the mixed $H_2/H_{\infty}$ control problem and the minimum entropy/$H_{\infty}$-control problem, we presented the controller state-space realization. Decentralized case was illustrated briefly.

  • PDF

자동 윈도우 크기 결정 기법을 적용한 Minimum Entropy Clustering과 Iterative Over-Segmentation 기반 Semantic Segmentation (Semantic Segmentation using Iterative Over-Segmentation and Minimum Entropy Clustering with Automatic Window Size)

  • 최형욱;송현승;손홍규;전문구
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2014년도 춘계학술발표대회
    • /
    • pp.826-829
    • /
    • 2014
  • 본 연구에서는 야외 지형 영상 및 항공 영상 등에 대하여 각각의 영역들의 속성을 분할 및 인식 하기 위해 minimum entropy clustering 기반의 군집화 기법과 over-segmentation을 반복 적용하여 군집화 하는 두 방법을 융합한 기법을 제안하였다. 이 기법들을 기반으로 각 군집의 대표 영역을 추출한 후에 학습 데이터를 기반으로 만들어진 텍스톤 사전과 학습 데이터 각각의 텍스톤 모델을 이용하여 텍스톤 히스토그램 매칭을 통해 매칭 포인트를 얻어내고 얻어낸 매칭 포인트를 기반으로 영역의 카테고리를 결정한다. 본 논문에서는 인터넷에서 얻은 일반 야외 영상들로부터 자체적으로 제작한 지형 데이터 셋을 통해 제안한 기법의 우수성을 검증하였으며, 본 실험에서는 영역을 토양, 수풀 그리고 물 지형으로 하여 영상내의 영역을 분류 및 인식하였다.

Shannon Entropy as an Indicator of the Spatial Resolutions of the Morphologies of the Mode Patterns in an Optical Resonator

  • Park, Kyu-Won;Kim, Jinuk;Moon, Songky
    • Current Optics and Photonics
    • /
    • 제5권1호
    • /
    • pp.16-22
    • /
    • 2021
  • We present the Shannon entropy as an indicator of the spatial resolutions of the morphologies of the resonance mode patterns in an optical resonator. We obtain each optimized number of mesh points, one of minimum size and the other of maximum one. The optimized mesh-point number of minimum size is determined by the identifiable quantum number through a chi-squared test, whereas the saturation of the difference between Shannon entropies corresponds to the other mesh-point number of maximum size. We also show that the optimized minimum mesh-point increases as the (real) wave number increases and approximates the proportionality constant between them.

Information-Theoretic Approaches for Sensor Selection and Placement in Sensor Networks for Target Localization and Tracking

  • Wang Hanbiao;Yao Kung;Estrin Deborah
    • Journal of Communications and Networks
    • /
    • 제7권4호
    • /
    • pp.438-449
    • /
    • 2005
  • In this paper, we describes the information-theoretic approaches to sensor selection and sensor placement in sensor net­works for target localization and tracking. We have developed a sensor selection heuristic to activate the most informative candidate sensor for collaborative target localization and tracking. The fusion of the observation by the selected sensor with the prior target location distribution yields nearly the greatest reduction of the entropy of the expected posterior target location distribution. Our sensor selection heuristic is computationally less complex and thus more suitable to sensor networks with moderate computing power than the mutual information sensor selection criteria. We have also developed a method to compute the posterior target location distribution with the minimum entropy that could be achieved by the fusion of observations of the sensor network with a given deployment geometry. We have found that the covariance matrix of the posterior target location distribution with the minimum entropy is consistent with the Cramer-Rao lower bound (CRB) of the target location estimate. Using the minimum entropy of the posterior target location distribution, we have characterized the effect of the sensor placement geometry on the localization accuracy.