• Journal of Environmental Science International
• /
• v.12 no.4
• /
• pp.399-417
• /
• 2003

The seasonal variation and frequency of rainfalls of Korea peninsula in Changma period show strong local weather phenomenon because of it's topographical and geographical factors in Northeast side of Asia. Based on weather entropy(statistical parameter)-the amount of average weather information-and information ratio, we can define each area's weather representativeness, which can show us more constant form included topographical and geographical factors and seasonal variation. The data used for this study are the daily precipitation and cloudiness during the recent ten years(1990-1999) at the 73 stations in Korea. To synthesize weather Entropy, information ratio of decaying tendency and half$.$decay distance, Seoul's weather representativeness has the smallest in Summer Changma period. And Puyo has the largest value in September.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.21 no.6
• /
• pp.1390-1397
• /
• 1996

In this paper, in case of segmenting an image by a fuzzy entropy, an image segmentation algorithm is derived under an extended fuzzy entropy including the probabilistic including the probabilistic information in order to cover the toal uncertainty of information contained in fuzzy sets. By describing the image with fuzzysets, the total uncertainty of a fuzzy set consists of the uncertain information arising from its fuzziness and the uncertain information arising from the randomness in its ordinary set. To optimally segment all the boundary regions in the image, the total entropy function is computed by locally applving the fuzzy and Shannon entropies within the width of the fuzzy regions and the image is segmented withthe global maximum andlocal maximawhich correspond to the boundary regions. Comtional one by detecting theboundary regions more than 5 times.

• The Korean Journal of Applied Statistics
• /
• v.24 no.2
• /
• pp.383-391
• /
• 2011

This paper presents a modified entropy-based test of fit for the inverse Gaussian distribution. The test is based on the entropy difference of the unknown data-generating distribution and the inverse Gaussian distribution. The entropy difference estimator used as the test statistic is obtained by employing Vasicek's sample entropy as an entropy estimator for the data-generating distribution and the uniformly minimum variance unbiased estimator as an entropy estimator for the inverse Gaussian distribution. The critical values of the test statistic empirically determined are provided in a tabular form. Monte Carlo simulations are performed to compare the proposed test with the previous entropy-based test in terms of power.

• Communications for Statistical Applications and Methods
• /
• v.4 no.2
• /
• pp.497-505
• /
• 1997

We attempt to get a probabilistic model of a queueing system in the maximum entropy condition. Applying the maximum entropy principle to the queueing system, we obtain the most uncertain probability model compatible with the available information expressed by moments.

• Journal of the Korean Data and Information Science Society
• /
• v.15 no.1
• /
• pp.119-127
• /
• 2004

To test uniformity of a population, we modify the test statistic based on the sample entropy in the literature, and establish its limiting distribution under weaker conditions, which improves the existing results. It is also to study the proposed test statistic based on Vasicek's entropy estimator is consistent.

• Journal of the Korean Data and Information Science Society
• /
• v.24 no.4
• /
• pp.847-856
• /
• 2013

In this paper, we deal with testing goodness-of-fit for normal distribution based on parametric and nonparametric entropy estimators. The minimum variance unbiased estimator for the entropy of the normal distribution is derived as a parametric entropy estimator to be used for the construction of a test statistic. For a nonparametric entropy estimator of a data-generating distribution under the alternative hypothesis sample entropy and its modifications are used. The critical values of the proposed tests are estimated by Monte Carlo simulations and presented in a tabular form. The performance of the proposed tests under some selected alternatives are investigated by means of simulations. The results report that the proposed tests have better power than the previous entropy-based test by Vasicek (1976). In applications, the new tests are expected to be used as a competitive tool for testing normality.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.41 no.6
• /
• pp.89-97
• /
• 2004

An object to reflect or emit light is captured by imaging system as distorted image due to various distortion. It is called image restoration that estimates original object by removing distortion. There are two categories in image restoration method. One is a deterministic method and the other is a stochastic method. In this paper, image restoration using Minimum Fisher Information(MFI), derived from B. Roy Frieden is proposed. In MFI restoration, experimental results to be made according to noise control parameter were investigated. And cross entropy(Kullback-Leibler entropy) was used as a standard measure of restoration accuracy, It is confirmed that restoration results using MFI have various roughness according to noise control parameter.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.16 no.12
• /
• pp.3889-3903
• /
• 2022

To address the problem of low detection accuracy due to training noise caused by mislabeling when Tri-training for network intrusion detection (NID), we propose a Tri-training algorithm based on cross entropy and K-nearest neighbors (TCK) for network intrusion detection. The proposed algorithm uses cross-entropy to replace the classification error rate to better identify the difference between the practical and predicted distributions of the model and reduce the prediction bias of mislabeled data to unlabeled data; K-nearest neighbors are used to remove the mislabeled data and reduce the number of mislabeled data. In order to verify the effectiveness of the algorithm proposed in this paper, experiments were conducted on 12 UCI datasets and NSL-KDD network intrusion datasets, and four indexes including accuracy, recall, F-measure and precision were used for comparison. The experimental results revealed that the TCK has superior performance than the conventional Tri-training algorithms and the Tri-training algorithms using only cross-entropy or K-nearest neighbor strategy.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.14 no.5
• /
• pp.642-647
• /
• 2004

The relations of fuzzy entropy, distance measure, and similarity measure are discussed in this paper. For the purpose of reliable signal selection, the fuzzy entropy is proposed by a distance measure. Properness of the proposed entropy is verified by the definition of the entropy measure. Fourier and Wavelet transform are applied to the stator current signal to obtain the fault features of an induction motor. Membership functions for 3-phase currents are obtained by the Bootstrap method and Central Limit Theorem. Finally, the proposed entropy is applied to measure the fault signal of an induction machine, and the fuzzy entropy values of phase currents are illustrated.

• Journal of information and communication convergence engineering
• /
• v.1 no.4
• /
• pp.205-208
• /
• 2003

Voice activity detection is a important problem in the speech recognition and speech communication. This paper introduces new feature parameter which are reconstructed by spectral entropy of information theory for robust voice activity detection in the noise environment, then analyzes and compares it with energy method of voice activity detection and performance. In experiments, we confirmed that spectral entropy and its reconstructed parameter are superior than the energy method for robust voice activity detection in the various noise environment.