• Title/Summary/Keyword: Shannon entropy

Search Result 81, Processing Time 0.044 seconds

A View on Extension of Utility-Based on Links with Information Measures

  • Hoseinzadeh, A.R.;Borzadaran, G.R.Mohtashami;Yari, G.H.
    • Communications for Statistical Applications and Methods
    • /
    • v.16 no.5
    • /
    • pp.813-820
    • /
    • 2009
  • In this paper, we review the utility-based generalization of the Shannon entropy and Kullback-Leibler information measure as the U-entropy and the U-relative entropy that was introduced by Friedman et al. (2007). Then, we derive some relations between the U-relative entropy and other information measures based on a parametric family of utility functions.

EDISON 앱 개발 및 교육을 위한 Polymer Collapse 중 Polymer의 Entropy 및 Free Energy 계산

  • Park, Yun-Jae;Jang, Rak-U
    • Proceeding of EDISON Challenge
    • /
    • 2017.03a
    • /
    • pp.75-81
    • /
    • 2017
  • Polymer collapse transition에 대한 연구가 많이 진행되어왔다. 허나 각각의 microstate에 대한 entropy나 free energy에 대한 계산을 하지는 못하였다. 최근 local nonequilibrium thermodynamics와 관련한 논문이 발표되었는데 이는 비평형 상태에서의 각각의 microstate에 대한 확률 분포를 결정하는 물리량을 발견 및 특성을 규명하여 이 중 특별한 상태가 지니는 "information" 이라는 양이 내부에너지와 엔트로피와의 상관관계가 있음을 보였다. 또한, 이러한 information theory를 이용한 Shannon entropy를 사용하여 entropy를 정의하고 free energy와 같은 물리량을 계산하였다. 따라서 이를 이용하여 information theory를 이용한 Shannon entropy와 이로 정의된 free energy를 이용하여 polymer collapse중 entropy 및 free energy를 계산하였다.

  • PDF

EU항만의 효율성에 관한 연구 (DEA와 Shannon's Entropy의 통합모형과 DEA-Window 분석을 이용하여)

  • Park, Ho;Kim, Dong-Jin;Kim, Yul-Seong
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • 2012.10a
    • /
    • pp.109-111
    • /
    • 2012
  • 한-EU FTA 발효 등은 교역 확대가 예상되며, 항만의 역할은 더욱더 중요해 질 것이다. 항만의 성과를 측정할 수 있는 방안으로 DEA를 활용한 효율성 측정을 들 수 있으며, 본 연구에서는 DEA 측정 시 모형 선정의 어려움과 동태적 효율성을 변화를 분석하기 위해 DEA와 Shannon's Entropy 결합모형으로 효율성을 분석하고, DEA-Window 모형으로 동태적 효율변화를 분석하였다.

  • PDF

The Selection of the Optimal Gator Wavelet Shape Factor Using the Shannon Entropy Concept (Shannon 엔트로피 개념을 이용한 가보 웨이블렛 최적 형상의 선정)

  • Hong, Jin-Chul;Kim, Yoon-Young
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2002.11b
    • /
    • pp.176-181
    • /
    • 2002
  • The continuous Gabor wavelet transform (GWT) has been utilized as a useful time-frequency analysis tool to identify the rapidly-varying characteristics of some wave signals. In the application of GWT, it is important to select the Gabor wavelet with the optimal shape factor by which the time-frequency distribution of a signal can be accurately estimated. To find the signal-dependent optimal Gabor wavelet shape factor, the notion of the Shannon entropy which mesures the extent of signal energy concentration in the time-frequency plane is employed. To verify the validity of the present entropy-based scheme, we have applied it to the time-frequency analysis of a set of elastic bending wave signals generated by an impact in a solid cylinder.

  • PDF

The Selection of the Optimal Gabor Wavelet Shape Factor Using the Shannon Entropy Concept (Shannon 엔트로피 개념을 이용한 가보 웨이블렛 최적 형상의 선정)

  • Hong, Jin-Chul;Kim, Yoon-Young
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2002.11a
    • /
    • pp.324.1-324
    • /
    • 2002
  • The continuous Gabor wavelet transform (GWT) has been utilized as a useful time-frequency analysis tool to identify the rapidly-varying characteristics of some wave signals. In the application of GWT, it is important to select the Gabor wavelet with the optimal shape factor by which the time-frequency distribution of a signal can be accurately estimated. To find the signal-dependent optimal Gator wavelet shape factor, the notion of the Shannon entropy which measures the extent of signal energy concentration in the time-frequency plane is employed. (omitted)

  • PDF

A Study of Classification of Heart Murmurs using Shannon Entropy and Neural Network (샤논 엔트로피와 신경회로망을 이용한 심잡음 분류에 관한 연구)

  • Eum, Sang-Hee
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.16 no.4
    • /
    • pp.134-138
    • /
    • 2015
  • Heart sound is used for a basic clinical examination to check for abnormalities in the lungs and heart that can be heard with a stethoscope or phonocardiography. In this paper, we try to find an easier and non-invasive method to diagnose heart diseases using neural network classifier. The classifier has been developed for one normal heart sound and five murmurs by using Shannon entropy and conjugate scaled back propagation algorithm. The experimental results showed that the classification is possible with 1.63185e-6 of classification error.

Shannon Entropy as an Indicator of the Spatial Resolutions of the Morphologies of the Mode Patterns in an Optical Resonator

  • Park, Kyu-Won;Kim, Jinuk;Moon, Songky
    • Current Optics and Photonics
    • /
    • v.5 no.1
    • /
    • pp.16-22
    • /
    • 2021
  • We present the Shannon entropy as an indicator of the spatial resolutions of the morphologies of the resonance mode patterns in an optical resonator. We obtain each optimized number of mesh points, one of minimum size and the other of maximum one. The optimized mesh-point number of minimum size is determined by the identifiable quantum number through a chi-squared test, whereas the saturation of the difference between Shannon entropies corresponds to the other mesh-point number of maximum size. We also show that the optimized minimum mesh-point increases as the (real) wave number increases and approximates the proportionality constant between them.

AN EXTENSION OF JENSEN-MERCER INEQUALITY WITH APPLICATIONS TO ENTROPY

  • Yamin, Sayyari
    • Honam Mathematical Journal
    • /
    • v.44 no.4
    • /
    • pp.513-520
    • /
    • 2022
  • The Jensen and Mercer inequalities are very important inequalities in information theory. The article provides the generalization of Mercer's inequality for convex functions on the line segments. This result contains Mercer's inequality as a particular case. Also, we investigate bounds for Shannon's entropy and give some new applications in zeta function and analysis.

Meeting of Gauss and Shannon at Coin Leaf in 5G Massive MIMO (5G Massive MIMO에서 가우스(Gauss)와 샤논(Shannon)이 동전 한 닢에서 만남)

  • Kim, Jeong-Su;Lee, Moon-Ho;Park, Daechul
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.18 no.2
    • /
    • pp.89-103
    • /
    • 2018
  • A genius "Prince of Mathematician" Gaussian and "Father of Communication" Shannon comes up with the creative idea of motivation to meet each other? The answer is a coin leaf. Gaussian found some creative ideas in the matter of obtaining a sum of 1 to 100. This is the same as the probability distribution curve when a coin leaf is thrown. Shannon extended the Gaussian probability distribution to define the entropy, taking the source symbol and the reciprocal logarithm to obtain the weighted average. These where the genius Gaussian and Shannon meet in the same coin leaf. This paper focuses on this point, and easily proves Gaussian distribution and Shannon entropy. As an application example, we have obtained the capacity and transition probability of Jeongju seminal vesicle, and the Shannon channel capacity is 1 when the equivalent transition probability is 1/2.