• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2004.04a
• /
• pp.349-352
• /
• 2004

In this literature, the selection of data set among the universe set is carried out with the fuzzy entropy function. By the definition of fuzzy entropy, we have proposed the fuzzy entropy function and the proposed fuzzy entropy function is proved through the definition. The proposed fuzzy entropy function calculate the certainty or uncertainty value of data set, hence we can choose the data set that satisfying certain bound or reference. Therefore the reliable data set can be obtained by the proposed fuzzy entropy function. With the simple example we verify that the proposed fuzzy entropy function select reliable data set.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.14 no.5
• /
• pp.655-659
• /
• 2004

In this literature, the selection of data set among the universe set is carried out with the fuzzy entropy function. By the definition of fuzzy entropy, the fuzzy entropy function is proposed and the proposed fuzzy entropy function is proved through the definition. The proposed fuzzy entropy function calculate the certainty or uncertainty value of data set, hence we can choose the data set that satisfying certain bound or reference. Therefore the reliable data set can be obtained by the proposed fuzzy entropy function. With the simple example we verify that the proposed fuzzy entropy function select reliable data set.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2008.04a
• /
• pp.21-22
• /
• 2008

Fuzzy entropy is designed for non-convex fuzzy membership function using well known Hamming distance measure. Design procedure of convex fuzzy membership function is represented through distance measure, furthermore characteristic analysis for non-convex function are also illustrated. Proof of proposed fuzzy entropy is discussed, and entropy computation is illustrated.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.9 no.1
• /
• pp.4-9
• /
• 2009

Fuzzy entropy is designed for non convex fuzzy membership function using well known Hamming distance measure. Design procedure of convex fuzzy membership function is represented through distance measure, furthermore characteristic analysis for non convex function are also illustrated. Proof of proposed fuzzy entropy is discussed, and entropy computation is illustrated.

• Honam Mathematical Journal
• /
• v.42 no.4
• /
• pp.681-699
• /
• 2020

In this paper, topological entropy of iterated function systems (IFS) on one dimensional spaces is considered. Estimation of an upper bound of topological entropy of piecewise monotone IFS is obtained by open covers. Then, we provide a way to calculate topological entropy of piecewise monotone IFS. In the following, some examples are given to illustrate our theoretical results. Finally, we have a discussion about the possible applications of these examples in various sciences.

• Communications for Statistical Applications and Methods
• /
• v.27 no.4
• /
• pp.469-486
• /
• 2020

Entropy is an important term in statistical mechanics that was originally defined in the second law of thermodynamics. In this paper, we consider the maximum likelihood estimation (MLE), maximum product spacings estimation (MPSE) and Bayesian estimation of the entropy of an inverse Weibull distribution (InW) under a generalized type I progressive hybrid censoring scheme (GePH). The MLE and MPSE of the entropy cannot be obtained in closed form; therefore, we propose using the Newton-Raphson algorithm to solve it. Further, the Bayesian estimators for the entropy of InW based on squared error loss function (SqL), precautionary loss function (PrL), general entropy loss function (GeL) and linex loss function (LiL) are derived. In addition, we derive the Lindley's approximate method (LiA) of the Bayesian estimates. Monte Carlo simulations are conducted to compare the results among MLE, MPSE, and Bayesian estimators. A real data set based on the GePH is also analyzed for illustrative purposes.

• The Pure and Applied Mathematics
• /
• v.23 no.3
• /
• pp.205-221
• /
• 2016

We formulate the additive entropy of a natural number in terms of the additive partition function, and show that its multiplicative entropy is directly related to the multiplicative partition function. We give a practical formula for the multiplicative entropy of natural numbers with two prime factors. We use this formula to analyze the comparative density of additive and multiplicative entropy, prove that this density converges to zero as the number tends to infinity, and empirically observe this asymptotic behavior.

• International Journal of Contents
• /
• v.11 no.2
• /
• pp.57-62
• /
• 2015

Relative entropy is a divergence measure between two probability density functions of a random variable. Assuming that the random variable has only two alphabets, the relative entropy becomes a cross-entropy error function that can accelerate training convergence of multi-layer perceptron neural networks. Also, the n-th order extension of cross-entropy (nCE) error function exhibits an improved performance in viewpoints of learning convergence and generalization capability. In this paper, we derive a new divergence measure between two probability density functions from the nCE error function. And the new divergence measure is compared with the relative entropy through the use of three-dimensional plots.

• Journal of the Korean Mathematical Society
• /
• v.56 no.6
• /
• pp.1561-1597
• /
• 2019

In this paper we introduce the notions of topological entropy and topological pressure for non-autonomous iterated function systems (or NAIFSs for short) on countably infinite alphabets. NAIFSs differ from the usual (autonomous) iterated function systems, they are given [32] by a sequence of collections of continuous maps on a compact topological space, where maps are allowed to vary between iterations. Several basic properties of topological pressure and topological entropy of NAIFSs are provided. Especially, we generalize the classical Bowen's result to NAIFSs ensures that the topological entropy is concentrated on the set of nonwandering points. Then, we define the notion of specification property, under which, the NAIFSs have positive topological entropy and all points are entropy points. In particular, each NAIFS with the specification property is topologically chaotic. Additionally, the ${\ast}$-expansive property for NAIFSs is introduced. We will prove that the topological pressure of any continuous potential can be computed as a limit at a definite size scale whenever the NAIFS satisfies the ${\ast}$-expansive property. Finally, we study the NAIFSs induced by expanding maps. We prove that these NAIFSs having the specification and ${\ast}$-expansive properties.

• Communications of the Korean Mathematical Society
• /
• v.14 no.3
• /
• pp.581-595
• /
• 1999

In the present paper we provide a short of the uni-form CLT for the function-indexed martingale difference process under the uniformly integrable entropy by establishing a maximal inequality.