• Title/Summary/Keyword: Information Measure

Search Result 6,796, Processing Time 0.036 seconds

On an Information Theoretic Diagnostic Measure for Detecting Influential Observations in LDA

  • Kim, Hea-Jung
    • Journal of the Korean Statistical Society
    • /
    • v.25 no.2
    • /
    • pp.289-301
    • /
    • 1996
  • This paper suggests a new diagnostic measure for detecting influential observations in two group linear discriminant analysis(LDA). It is developed from an information theoretic point of view using the minimum discrimination information(MDI) methodology. MDI estimator of symmetric divergence by Kullback(l967) is taken as a measure of the power of discrimination in LDA. It is shown that the effect of an observation over the power of discrimination is fully explained by the diagnostic measure. Asymptotic distribution of the proposed measure is derived as a function of independent chi-squared and standard normal variables. By means of the distributions, a couple of methods are suggested for detecting the influential observations in LDA. Performance of the suggested methods are examined through a simulation study.

  • PDF

Selecting Good Speech Features for Recognition

  • Lee, Young-Jik;Hwang, Kyu-Woong
    • ETRI Journal
    • /
    • v.18 no.1
    • /
    • pp.29-41
    • /
    • 1996
  • This paper describes a method to select a suitable feature for speech recognition using information theoretic measure. Conventional speech recognition systems heuristically choose a portion of frequency components, cepstrum, mel-cepstrum, energy, and their time differences of speech waveforms as their speech features. However, these systems never have good performance if the selected features are not suitable for speech recognition. Since the recognition rate is the only performance measure of speech recognition system, it is hard to judge how suitable the selected feature is. To solve this problem, it is essential to analyze the feature itself, and measure how good the feature itself is. Good speech features should contain all of the class-related information and as small amount of the class-irrelevant variation as possible. In this paper, we suggest a method to measure the class-related information and the amount of the class-irrelevant variation based on the Shannon's information theory. Using this method, we compare the mel-scaled FFT, cepstrum, mel-cepstrum, and wavelet features of the TIMIT speech data. The result shows that, among these features, the mel-scaled FFT is the best feature for speech recognition based on the proposed measure.

  • PDF

A Slice-based Complexity Measure (슬라이스 기반 복잡도 척도)

  • Moon, Yu-Mi;Choi, Wan-Kyoo;Lee, Sung-Joo
    • The KIPS Transactions:PartD
    • /
    • v.8D no.3
    • /
    • pp.257-264
    • /
    • 2001
  • We developed a SIFG (Slice-based Information Graph), which modelled the information flow on program on the basis of the information flow of data tokens on data slices. Then we defied a SCM (Slice-based complexity measure), which measured the program complexity by measuring the complexity of information flow on SIFG. SCM satisfied the necessary properties for complexity measure proposed by Briand et al. SCM could measure not only the control and data flow on program but also the physical size of program unlike the existing measures.

  • PDF

A Cultural Property Priority Assessment Using Information Measure Technique (정보계측기법을 이용한 문화재 중요도 평가방안)

  • Jung, Nam-Su;Lee, Jeong-Jae
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.48 no.1
    • /
    • pp.41-48
    • /
    • 2006
  • In the evaluation of rural amenities, its properties are related with social, cultural, and environmental elements. In this study, Information Measure Model (IMM) and Cultural Property Priority Assessment Model (CPPAM) were developed adapting information measure model with text based surveying data. To apply developed model not only general properties but also specific surveyed data, Specific Information Gathering and Utilizing System (SIGUS) was constructed using the data in Dusan World encyclopedia. IMM shows priorities of cultural property by information in national-designated cultural properties. And CPPAM applied in surveying data in 2004 by Rural Resources Development Institute.

Edge Detection By Fusion Using Local Information of Edges

  • Vlachos, Ioannis K.;Sergiadis, George D.
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2003.09a
    • /
    • pp.403-406
    • /
    • 2003
  • This paper presents a robust algorithm for edge detection based on fuzzy fusion, using a novel local edge information measure based on Renyi's a-order entropy. The calculation of the proposed measure is carried out using a parametric classification scheme based on local statistics. By suitably tuning its parameters, the local edge information measure is capable of extracting different types of edges, while exhibiting high immunity to noise. The notions of fuzzy measures and the Choquet fuzzy integral are applied to combine the different sources of information obtained using the local edge information measure with different sets of parameters. The effectiveness and the robustness of the new method are demonstrated by applying our algorithm to various synthetic computer-generated and real-world images.

  • PDF

Extraction of Aesthetic Measure of Stabilized Image (정지 영상에서 미도 값의 추출)

  • Rhee, Yang-Won;Lee, Hyun-Chang;Kim, Hee-Ae
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2013.05a
    • /
    • pp.122-124
    • /
    • 2013
  • The beauty is obtained by of the order in the complex. The beauty of a good harmony for several color combinations is displayed by quantitative. The greater the Aesthetic Measure, the color is beautiful. Normally Aesthetic Measure is greater than 0.5 is a beautiful color.

  • PDF

A Joint Agreement Measure Between Multiple Raters and One Standard

  • Um, Yong-Hwan
    • Journal of the Korean Data and Information Science Society
    • /
    • v.16 no.3
    • /
    • pp.621-628
    • /
    • 2005
  • This article addresses the problem of measuring a joint agreement between multiple raters and a standard set of responses. A new agreement measure based on Um's approach is proposed. The proposed agreement measure is used for multivariate interval responses. Comparison is made between the proposed measure and other corresponding agreement measures using hypothetical data set.

  • PDF

A New Agreement Measure for Interval Multivariate Observations

  • Um, Yong-Hwan
    • Journal of the Korean Data and Information Science Society
    • /
    • v.15 no.1
    • /
    • pp.263-271
    • /
    • 2004
  • This article presents a new measure of chance-corrected interobserver agreement among multivariate ratings of many observers. Modifying an approach by Berry and Mielke, a new agreement measure is proposed. The important modificaton is to use the volume of simplex composed of data points as the disagreement masure. The proposed measure accounts agreement for multivariate interval observations among many observers. Hypothetical and real-life data sets are analyzed for illustrative purpose.

  • PDF

Application of Similarity Measure for Fuzzy C-Means Clustering to Power System Management

  • Park, Dong-Hyuk;Ryu, Soo-Rok;Park, Hyun-Jeong;Lee, Sang-H.
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.8 no.1
    • /
    • pp.18-23
    • /
    • 2008
  • A FCM with locational price and regional information between locations are proposed in this paper. Any point in a networked system has its own values indicating the physical characteristics of that networked system and regional information at the same time. The similarity measure used for FCM in this paper is defined through the system-wide characteristic values at each point. To avoid the grouping of geometrically distant locations with similar measures, the locational information are properly considered and incorporated in the proposed similarity measure. We have verified that the proposed measure has produced proper classification of a networked system, followed by an example of a networked electricity system.

Singular Value Decomposition Approach to Observability Analysis of GPS/INS

  • Hong, Sin-Pyo;Chun, Ho-Hwan
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • v.1
    • /
    • pp.133-138
    • /
    • 2006
  • Singular value decomposition (SDV) approach is applied to the observability analysis of GPS/INS in this paper. A measure of observability for a subspace is introduced. It indicates the minimum size of perturbation in the information matrix that makes the subspace unobservable. It is shown that the measure has direct connections with observability of systems, error covariance, and singular structure of the information matrix. The observability measure given in this paper is applicable to the multi-input/multi-output time-varying systems. An example on the observability analysis of GPS/INS is given. The measure of observability is confirmed to be less sensitive to system model perturbation. It is also shown that the estimation error for the vertical component of gyro bias can be considered unobservable for small initial error covariance for a constant velocity horizontal motion.

  • PDF