• Title/Summary/Keyword: Entropy function

검색결과 290건 처리시간 0.037초

퍼지 엔트로피 함수를 이용한 데이터추출 (Selection of data set with fuzzy entropy function)

  • Lee, Sang-Hyuk;Cheon, Seong-Pyo;Kim, Sung-Shin
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 2004년도 춘계학술대회 학술발표 논문집 제14권 제1호
    • /
    • pp.349-352
    • /
    • 2004
  • In this literature, the selection of data set among the universe set is carried out with the fuzzy entropy function. By the definition of fuzzy entropy, we have proposed the fuzzy entropy function and the proposed fuzzy entropy function is proved through the definition. The proposed fuzzy entropy function calculate the certainty or uncertainty value of data set, hence we can choose the data set that satisfying certain bound or reference. Therefore the reliable data set can be obtained by the proposed fuzzy entropy function. With the simple example we verify that the proposed fuzzy entropy function select reliable data set.

  • PDF

Selection of data set with fuzzy entropy function

  • Lee, Sang-Hyuk;Cheon, Seong-Pyo;Kim, Sung shin
    • 한국지능시스템학회논문지
    • /
    • 제14권5호
    • /
    • pp.655-659
    • /
    • 2004
  • In this literature, the selection of data set among the universe set is carried out with the fuzzy entropy function. By the definition of fuzzy entropy, the fuzzy entropy function is proposed and the proposed fuzzy entropy function is proved through the definition. The proposed fuzzy entropy function calculate the certainty or uncertainty value of data set, hence we can choose the data set that satisfying certain bound or reference. Therefore the reliable data set can be obtained by the proposed fuzzy entropy function. With the simple example we verify that the proposed fuzzy entropy function select reliable data set.

비 컨벡스 퍼지 소속함수에 대한 퍼지 엔트로피구성 (Fuzzy Entropy Construction for Non-Convex Fuzzy Membership Function)

  • Lee, Sang-H;Kim, Jae-Hyung;Kim, Sang-Jin
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국지능시스템학회 2008년도 춘계학술대회 학술발표회 논문집
    • /
    • pp.21-22
    • /
    • 2008
  • Fuzzy entropy is designed for non-convex fuzzy membership function using well known Hamming distance measure. Design procedure of convex fuzzy membership function is represented through distance measure, furthermore characteristic analysis for non-convex function are also illustrated. Proof of proposed fuzzy entropy is discussed, and entropy computation is illustrated.

  • PDF

Analysis of Fuzzy Entropy and Similarity Measure for Non Convex Membership Functions

  • Lee, Sang-H.;Kim, Sang-Jin
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제9권1호
    • /
    • pp.4-9
    • /
    • 2009
  • Fuzzy entropy is designed for non convex fuzzy membership function using well known Hamming distance measure. Design procedure of convex fuzzy membership function is represented through distance measure, furthermore characteristic analysis for non convex function are also illustrated. Proof of proposed fuzzy entropy is discussed, and entropy computation is illustrated.

TOPOLOGICAL ENTROPY OF ONE DIMENSIONAL ITERATED FUNCTION SYSTEMS

  • Nia, Mehdi Fatehi;Moeinaddini, Fatemeh
    • 호남수학학술지
    • /
    • 제42권4호
    • /
    • pp.681-699
    • /
    • 2020
  • In this paper, topological entropy of iterated function systems (IFS) on one dimensional spaces is considered. Estimation of an upper bound of topological entropy of piecewise monotone IFS is obtained by open covers. Then, we provide a way to calculate topological entropy of piecewise monotone IFS. In the following, some examples are given to illustrate our theoretical results. Finally, we have a discussion about the possible applications of these examples in various sciences.

Bayesian and maximum likelihood estimation of entropy of the inverse Weibull distribution under generalized type I progressive hybrid censoring

  • Lee, Kyeongjun
    • Communications for Statistical Applications and Methods
    • /
    • 제27권4호
    • /
    • pp.469-486
    • /
    • 2020
  • Entropy is an important term in statistical mechanics that was originally defined in the second law of thermodynamics. In this paper, we consider the maximum likelihood estimation (MLE), maximum product spacings estimation (MPSE) and Bayesian estimation of the entropy of an inverse Weibull distribution (InW) under a generalized type I progressive hybrid censoring scheme (GePH). The MLE and MPSE of the entropy cannot be obtained in closed form; therefore, we propose using the Newton-Raphson algorithm to solve it. Further, the Bayesian estimators for the entropy of InW based on squared error loss function (SqL), precautionary loss function (PrL), general entropy loss function (GeL) and linex loss function (LiL) are derived. In addition, we derive the Lindley's approximate method (LiA) of the Bayesian estimates. Monte Carlo simulations are conducted to compare the results among MLE, MPSE, and Bayesian estimators. A real data set based on the GePH is also analyzed for illustrative purposes.

ALGEBRAIC ENTROPIES OF NATURAL NUMBERS WITH ONE OR TWO PRIME FACTORS

  • JEONG, SEUNGPIL;KIM, KYONG HOON;KIM, GWANGIL
    • 한국수학교육학회지시리즈B:순수및응용수학
    • /
    • 제23권3호
    • /
    • pp.205-221
    • /
    • 2016
  • We formulate the additive entropy of a natural number in terms of the additive partition function, and show that its multiplicative entropy is directly related to the multiplicative partition function. We give a practical formula for the multiplicative entropy of natural numbers with two prime factors. We use this formula to analyze the comparative density of additive and multiplicative entropy, prove that this density converges to zero as the number tends to infinity, and empirically observe this asymptotic behavior.

Deriving a New Divergence Measure from Extended Cross-Entropy Error Function

  • Oh, Sang-Hoon;Wakuya, Hiroshi;Park, Sun-Gyu;Noh, Hwang-Woo;Yoo, Jae-Soo;Min, Byung-Won;Oh, Yong-Sun
    • International Journal of Contents
    • /
    • 제11권2호
    • /
    • pp.57-62
    • /
    • 2015
  • Relative entropy is a divergence measure between two probability density functions of a random variable. Assuming that the random variable has only two alphabets, the relative entropy becomes a cross-entropy error function that can accelerate training convergence of multi-layer perceptron neural networks. Also, the n-th order extension of cross-entropy (nCE) error function exhibits an improved performance in viewpoints of learning convergence and generalization capability. In this paper, we derive a new divergence measure between two probability density functions from the nCE error function. And the new divergence measure is compared with the relative entropy through the use of three-dimensional plots.

ON TOPOLOGICAL ENTROPY AND TOPOLOGICAL PRESSURE OF NON-AUTONOMOUS ITERATED FUNCTION SYSTEMS

  • Ghane, Fatemeh H.;Sarkooh, Javad Nazarian
    • 대한수학회지
    • /
    • 제56권6호
    • /
    • pp.1561-1597
    • /
    • 2019
  • In this paper we introduce the notions of topological entropy and topological pressure for non-autonomous iterated function systems (or NAIFSs for short) on countably infinite alphabets. NAIFSs differ from the usual (autonomous) iterated function systems, they are given [32] by a sequence of collections of continuous maps on a compact topological space, where maps are allowed to vary between iterations. Several basic properties of topological pressure and topological entropy of NAIFSs are provided. Especially, we generalize the classical Bowen's result to NAIFSs ensures that the topological entropy is concentrated on the set of nonwandering points. Then, we define the notion of specification property, under which, the NAIFSs have positive topological entropy and all points are entropy points. In particular, each NAIFS with the specification property is topologically chaotic. Additionally, the ${\ast}$-expansive property for NAIFSs is introduced. We will prove that the topological pressure of any continuous potential can be computed as a limit at a definite size scale whenever the NAIFS satisfies the ${\ast}$-expansive property. Finally, we study the NAIFSs induced by expanding maps. We prove that these NAIFSs having the specification and ${\ast}$-expansive properties.