• Title/Summary/Keyword: entropy model

Search Result 481, Processing Time 0.031 seconds

Cluster Feature Selection using Entropy Weighting and SVD (엔트로피 가중치 및 SVD를 이용한 군집 특징 선택)

  • Lee, Young-Seok;Lee, Soo-Won
    • Journal of KIISE:Software and Applications
    • /
    • v.29 no.4
    • /
    • pp.248-257
    • /
    • 2002
  • Clustering is a method for grouping objects with similar properties into a same cluster. SVD(Singular Value Decomposition) is known as an efficient preprocessing method for clustering because of dimension reduction and noise elimination for a high dimensional and sparse data set like E-Commerce data set. However, it is hard to evaluate the worth of original attributes because of information loss of a converted data set by SVD. This research proposes a cluster feature selection method, called ENTROPY-SVD, to find important attributes for each cluster based on entropy weighting and SVD. Using SVD, one can take advantage of the latent structures in the association of attributes with similar objects and, using entropy weighting one can find highly dense attributes for each cluster. This paper also proposes a model-based collaborative filtering recommendation system with ENTROPY-SVD, called CFS-CF and evaluates its efficiency and utilization.

Overfitting Reduction of Intelligence Web Search based on Enforcement Learning (강화학습에 기초한 지능형 웹 검색의 과잉적합 감소방안)

  • Han, Song-Yi;Jung, Yong-Gyu
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.9 no.3
    • /
    • pp.25-30
    • /
    • 2009
  • Recent days intellectual systems using reinforcement learning are being researched at various fields of game and web searching applications. A good training models are called to be fitted with trainning data and also classified with new records accurately. A overfitted model with training data may possibly bring the unfavored fallacy of hasty generalization. But it would be unavoidable in actual world. The entropy and mutation model are suggested to reduce the overfitting problems on this paper. It explains variation of entropy and artificial development of entropy in datamining, which can tell development of mutation to survive in nature world. Periodical generation of maximum entropy are introduced in this paper to reduce overfitting. Maximum entropy model can be considered as a periodical generalization in intensified process of intellectual web searching.

  • PDF

Adaptive Multi-class Segmentation Model of Aggregate Image Based on Improved Sparrow Search Algorithm

  • Mengfei Wang;Weixing Wang;Sheng Feng;Limin Li
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.2
    • /
    • pp.391-411
    • /
    • 2023
  • Aggregates play the skeleton and supporting role in the construction field, high-precision measurement and high-efficiency analysis of aggregates are frequently employed to evaluate the project quality. Aiming at the unbalanced operation time and segmentation accuracy for multi-class segmentation algorithms of aggregate images, a Chaotic Sparrow Search Algorithm (CSSA) is put forward to optimize it. In this algorithm, the chaotic map is combined with the sinusoidal dynamic weight and the elite mutation strategies; and it is firstly proposed to promote the SSA's optimization accuracy and stability without reducing the SSA's speed. The CSSA is utilized to optimize the popular multi-class segmentation algorithm-Multiple Entropy Thresholding (MET). By taking three METs as objective functions, i.e., Kapur Entropy, Minimum-cross Entropy and Renyi Entropy, the CSSA is implemented to quickly and automatically calculate the extreme value of the function and get the corresponding correct thresholds. The image adaptive multi-class segmentation model is called CSSA-MET. In order to comprehensively evaluate it, a new parameter I based on the segmentation accuracy and processing speed is constructed. The results reveal that the CSSA outperforms the other seven methods of optimization performance, as well as the quality evaluation of aggregate images segmented by the CSSA-MET, and the speed and accuracy are balanced. In particular, the highest I value can be obtained when the CSSA is applied to optimize the Renyi Entropy, which indicates that this combination is more suitable for segmenting the aggregate images.

Resolving Part-of-Speech Tagging Ambiguities by a Maximum Entropy Boosting Model (최대 엔트로피 부스팅 모델을 이용한 품사 모호성 해소)

  • 박성배;장병탁
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2003.04c
    • /
    • pp.522-524
    • /
    • 2003
  • 품사 결정 문제는 자연언어처리의 가장 기본적인 문제들 중 하나이며, 기계학습의 관점에서 보면 분류 문제(classification problem)로 쉽게 표현된다. 본 논문에서는 품사 결정의 모호성을 해소하기 위해서 최대 엔트로피 부스팅 모델(maximum entropy boosting model)을 이 문제에 적응하였다. 그리고, 품사 결정에서 중요한 요소 중의 하나인 미지어 처리를 위해서 특별히 설계된 일차 자질을 고려하였다. 최대 엔트로피 부스팅 모델의 장점은 쉬운 모델링인데, 실제로 품사 결정을 위한 일차 자질만 작성하는 노려만 들이고도 96.78%의 정확도를 보여 지금까지 알려진 최고의 성능과 거의 비슷한 결과를 보였다.

  • PDF

A study on man-machine system evaluation (인간-기계시스템의 평가에 관한 연구)

  • 이상도;정중희;이동춘
    • Journal of the Ergonomics Society of Korea
    • /
    • v.2 no.2
    • /
    • pp.11-16
    • /
    • 1983
  • In designing a man-machine system(machines, work surfaces, work places, etc.), human's internal and external characteristics should be considered. But the resulting system may not be perfect, and many idiosyncratic and situational errors occur while operating. The entropy model with the limited data is known as a useful method to verify the internal system status. This paper shows a quantitative method to describe the system compatability between man and machine by entropy model and error data.

  • PDF

Development of Discriminant Model of PIH Pregnant using Decision Tree

  • Park, Young-Sun;Choi, Hang-Suk;Cha, Kyung-Joon;Park, Moon-Il
    • Journal of the Korean Data and Information Science Society
    • /
    • v.16 no.1
    • /
    • pp.41-50
    • /
    • 2005
  • The various methods have been studied to develop discriminant model for pregnancy induced hypertension(PIH) as high risk pregnant. In this study, we adapt the approximate entropy which is the non-linear chaotic measuring method. Then, we develop a system to discriminant PIH pregnant using QUEST with S-PLUS.

  • PDF

Generalized half-logistic Poisson distributions

  • Muhammad, Mustapha
    • Communications for Statistical Applications and Methods
    • /
    • v.24 no.4
    • /
    • pp.353-365
    • /
    • 2017
  • In this article, we proposed a new three-parameter distribution called generalized half-logistic Poisson distribution with a failure rate function that can be increasing, decreasing or upside-down bathtub-shaped depending on its parameters. The new model extends the half-logistic Poisson distribution and has exponentiated half-logistic as its limiting distribution. A comprehensive mathematical and statistical treatment of the new distribution is provided. We provide an explicit expression for the $r^{th}$ moment, moment generating function, Shannon entropy and $R{\acute{e}}nyi$ entropy. The model parameter estimation was conducted via a maximum likelihood method; in addition, the existence and uniqueness of maximum likelihood estimations are analyzed under potential conditions. Finally, an application of the new distribution to a real dataset shows the flexibility and potentiality of the proposed distribution.

SAMPLE ENTROPY IN ESTIMATING THE BOX-COX TRANSFORMATION

  • Rahman, Mezbahur;Pearson, Larry M.
    • Journal of the Korean Data and Information Science Society
    • /
    • v.12 no.1
    • /
    • pp.103-125
    • /
    • 2001
  • The Box-Cox transformation is a well known family of power transformation that brings a set of data into agreement with the normality assumption of the residuals and hence the response variable of a postulated model in regression analysis. This paper proposes a new method for estimating the Box-Cox transformation using maximization of the Sample Entropy statistic which forces the data to get closer to normal as much as possible. A comparative study of the proposed procedure with the maximum likelihood procedure, the procedure via artificial regression estimation, and the recently introduced maximization of the Shapiro-Francia W' statistic procedure is given. In addition, we generate a table for the optimal spacings parameter in computing the Sample Entropy statistic.

  • PDF

Buckley-James Type Estimators for Entropy of Lifetimes under Random Censorship Model (임의중단모형에서 수명의 엔트로피에 대한 Buckley-James형 추정량)

  • 이재만;차영준;이우동;김종태
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.5 no.2
    • /
    • pp.62-69
    • /
    • 2000
  • In this paper, we propose two Buckley-James type nonparametric estimators for entropy of lifetimes under random censorship model. We investigate the small sample behaviors of the proposed estimators when the underlying distribution has decreasing failure rate, constant failure rate, and increasing failure rate. Also some examples are illustrated for analysing data.

  • PDF

A Qualitative Approach to eIT Project Management (e-비즈니스 IT 프로젝트 관리의 정성적 접근 모형의 개발)

  • Jeong, Gi-Ho
    • Journal of Information Technology Services
    • /
    • v.1 no.1
    • /
    • pp.45-55
    • /
    • 2002
  • This paper suggests a new approach to IT project management based on a regular project meeting results to consider the recent project environment. The greater part of recent IT projects are related to e-business transformation. Transforming to e-business is a new problem very different from those they have been worked, in several point of views. Under e-business era, therefore any IT project is being implemented in more complex, dynamic and uncertain environment than traditional. That is, project leaders must consider more factors to control projects including resources, quality, risks, and technologies, and human resources. The project organizations and software corporations thus need to develop and establish new concepts or methodologies to manage e-business projects. In this point of view, an entropy model in this study is introduced for estimating and managing the uncertainty in project control using multi-attributes of project meeting. This paper proposes a new frame work based on entropy model using project meeting results to consider eIT project environment with a small pilot study.