• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2008.04a
• /
• pp.21-22
• /
• 2008

Fuzzy entropy is designed for non-convex fuzzy membership function using well known Hamming distance measure. Design procedure of convex fuzzy membership function is represented through distance measure, furthermore characteristic analysis for non-convex function are also illustrated. Proof of proposed fuzzy entropy is discussed, and entropy computation is illustrated.

• Journal of the Chungcheong Mathematical Society
• /
• v.34 no.1
• /
• pp.77-84
• /
• 2021

Let f : [0, 1] → [0, 1] be a multimodal map with positive topological entropy. The dynamics of the renormalization operator for multimodal maps have been investigated by Daniel Smania. It is proved that the measure of maximal entropy for a specific category of Cr interval maps is unique.

• International Journal of Contents
• /
• v.11 no.2
• /
• pp.57-62
• /
• 2015

Relative entropy is a divergence measure between two probability density functions of a random variable. Assuming that the random variable has only two alphabets, the relative entropy becomes a cross-entropy error function that can accelerate training convergence of multi-layer perceptron neural networks. Also, the n-th order extension of cross-entropy (nCE) error function exhibits an improved performance in viewpoints of learning convergence and generalization capability. In this paper, we derive a new divergence measure between two probability density functions from the nCE error function. And the new divergence measure is compared with the relative entropy through the use of three-dimensional plots.

• Journal of the Korea Convergence Society
• /
• v.4 no.2
• /
• pp.35-41
• /
• 2013

Data management with fuzzy entropy and similarity measure were discussed and verified by applying reliable data selection problem. Calculation of certainty or uncertainty for data, fuzzy entropy and similarity measure are designed and proved. Proposed fuzzy entropy and similarity are considered as dissimilarity measure and similarity measure, and the relation between two measures are explained through graphical illustration.Obtained measures are useful to the application of decision theory and mutual information analysis problem. Extension of data quantification results based on the proposed measures are applicable to the decision making and fuzzy game theory.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.10 no.4
• /
• pp.275-280
• /
• 2010

Verification of efficiency in data management fuzzy entropy and similarity measure were discussed and verified by applying reliable data selection problem and numerical data similarity evaluation. In order to calculate the certainty or uncertainty fuzzy entropy and similarity measure are designed and proved. Designed fuzzy entropy and similarity are considered as dissimilarity measure and similarity measure, and the relation between two measures are explained through graphical illustration. Obtained measures are useful to the application of decision theory and mutual information analysis problem. Extension of data quantification results based on the proposed measures are applicable to the decision making and fuzzy game theory.

• Communications for Statistical Applications and Methods
• /
• v.16 no.5
• /
• pp.813-820
• /
• 2009

In this paper, we review the utility-based generalization of the Shannon entropy and Kullback-Leibler information measure as the U-entropy and the U-relative entropy that was introduced by Friedman et al. (2007). Then, we derive some relations between the U-relative entropy and other information measures based on a parametric family of utility functions.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2002.12a
• /
• pp.9-12
• /
• 2002

Representation and quantification of fuzziness are required for the uncertain system modelling and controller design. Conventional results show that entropy of fuzzy sets represent the fuzziness of fuzzy sets. In this literature, the relations of fuzzy enropy, distance measure and similarity measure are discussed, and distance measure is proposed. With the help of relations of fuzzy enropy, distance measure and similarity measure, fuzzy entropy is represented by the newly proposed distance measure. With simple fuzzy set, example is illustrated.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.9 no.4
• /
• pp.269-274
• /
• 2009

Measuring uncertainty for fuzzy sets has been carried out by calculating fuzzy entropy. Fuzzy entropy of fuzzy set is derived with the help of distance measure. The distance proportional value between the fuzzy set and the corresponding crisp set is designed as the fuzzy entropy. The usefulness is verified by proving the proposed entropy. Generally, fuzzy entropy contains the complementary characteristics that the fuzzy entropies of fuzzy set and complementary fuzzy set have the same entropies. Discrepancy that low fuzzy entropy did not guarantee the data certainty was overcome by modifying fuzzy entropy formulation. Obtained fuzzy entropy is analyzed and discussed through simple example.

• Journal of Industrial Technology
• /
• v.3
• /
• pp.39-46
• /
• 1983

This paper presents a quantitative measure of the degree of part commonality and redundancy in a product line based on entropy measure of information theory. The several possible methods of analysis are discussed and the use of the entropy measure is discussed. These commonality and redundancy measure can be applied to analyze the usage pattern of part across a product line and to determine which parts have the broadest usage across the firm's product lines. An analysis of the results by entropy statistics is compared with the practical part usage in a simulation of several types of part usage's distributions.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.30 no.9C
• /
• pp.854-859
• /
• 2005

We construct the fuzzy entropy for measuring of uncertainty with the help of relation between distance measure and similarity measure. Proposed fuzzy entropy is constructed through distance measure. In this study, the distance measure is used Hamming distance measure. Also for the measure of similarity between fuzzy sets or crisp sets, we construct similarity measure through distance measure, and the proposed 려zzy entropies and similarity measures are proved.