DOI QR코드

DOI QR Code

Uncertainty Improvement of Incomplete Decision System using Bayesian Conditional Information Entropy

베이지언 정보엔트로피에 의한 불완전 의사결정 시스템의 불확실성 향상

  • Received : 2014.11.11
  • Accepted : 2014.12.12
  • Published : 2014.12.31

Abstract

Based on the indiscernible relation of rough set, the inevitability of superposition and inconsistency of data makes the reduction of attributes very important in information system. Rough set has difficulty in the difference of attribute reduction between consistent and inconsistent information system. In this paper, we propose the new uncertainty measure and attribute reduction algorithm by Bayesian posterior probability for correlation analysis between condition and decision attributes. We compare the proposed method and the conditional information entropy to address the uncertainty of inconsistent information system. As the result, our method has more accuracy than conditional information entropy in dealing with uncertainty via mutual information of condition and decision attributes of information system.

러프집합을 구성하는 식별불가능 관계를 표현하는 정보시스템에서 데이터의 중복이나 비일관성은 피할 수 없기 때문에 속성의 감축은 매우 중요하다. 러프집합이론에 있어서 일관적인 정보시스템과 비일관적인 정보시스템의 속성감축의 차이를 극복하고 자, 본 연구에서는 조건 및 결정속성에 대한 상관분석에 베이지언 사후확률을 적용한 새로운 불확실성 척도와 속성감축 알고리즘을 제안한다. 정보시스템의 불확실성에 대하여 제안된 척도와 기존의 조건부 정보엔트로피 척도를 비교해 본 결과, 정보시스템의 조건속성과 결정속성의 상호정보를 이용하여 속성간의 불확실성을 측정하는데 있어 제안된 방법이 조건부 정보엔트로피에 의한 방법보다 정확성이 있음을 보여준다.

Keywords

References

  1. Lin, T. Y.,and Cercone, N.(eds), "Rough sets and data mining-analysis of imperfect data", Boston:Klumer Academic Publishers, 1997
  2. Slowinski, R. and Stefanoqski, J., "Rough classification in incomplete information systems", Mathematical and Compute, Modeling, Vol. 12, No. 10-11, pp.1347-1357, 1989 https://doi.org/10.1016/0895-7177(89)90373-7
  3. Kryszkieqicz, M., "Rules in incomplete information systems". Information Science, Vol. 113, No. 3-4, pp. 271-292, 1998.
  4. Shannon, C., L., "The mathematical theory of communication", Bell System Technical Journal, Vol. 27, 1948
  5. Beaubouef, T., Petry, F. E. and Arora, G.,, "Information-theoretic measures of uncertainty for rough sets and rough relational databases", Information Science, Vol. 109, No. 1-4, pp. 185-195, 1998. https://doi.org/10.1016/S0020-0255(98)00019-X
  6. Grzymala-Busse, J., "Knowledge Acquisition under Uncertainty-a Rough Set Approach. Journal of Intelligent and Robotic Systems, Vol. 1, pp.3-16, 1988 https://doi.org/10.1007/BF00437317
  7. KukBoh Kim, GuBeom Jeong and KyungOk Park, "The Study on Information-Theoretic Measures of Incomplete based on Rough Sets", Institute of Korean Multimedia Society, Vol. 3 No. 5, pp. 550-556, 2000
  8. Lin Sun, "Decision Table Reduction Method Based on New Conditional Entropy for Rough Set Theory", International Workshop on Intelligent Systems and Applications, pp. 23-24, May 2009
  9. Baoxiang Liu, Ying Li, Lihong Li, Yaping Yu, "An Approximate Reduction Algorithm Based on Conditional Entropy", Information Computing and Applications, Vol. 106, pp. 319-32, 2010 https://doi.org/10.1007/978-3-642-16339-5_42
  10. Zhangyan Xu, Jianhua Zhou, Chenguang Zhang, "A Quick Attribute Reduction Algorithm Based on Incomplete Decision Table", Information Computing and Applications, Vol. 391, pp. 499-508, 2013 https://doi.org/10.1007/978-3-642-53932-9_49
  11. InKyoo Park, "Uncertainty Measurement of Incomplete Information System based on Conditional Information Entropy", The Journal of The Institute of Internet, Broadcasting and Communication, Vol. 14, No. 2, pp. 107-113, 2014 https://doi.org/10.7236/JIIBC.2014.14.2.107

Cited by

  1. Decision-making system for the resource forecasting and risk management using regression algorithms vol.15, pp.6, 2015, https://doi.org/10.7236/JIIBC.2015.15.6.311