Browse > Article
http://dx.doi.org/10.3745/KIPSTD.2005.12D.4.637

A performance improvement methodology of web document clustering using FDC-TCT  

Ko, Suc-Bum (부경대학교 대학원 전자계산학과)
Youn, Sung-Dae (부경대학교 전자계산학과)
Abstract
There are various problems while applying classification or clustering algorithm in that document classification which requires post processing or classification after getting as a web search result due to my keyword. Among those, two problems are severe. The first problem is the need to categorize the document with the help of the expert. And, the second problem is the long processing time the document classification takes. Therefore we propose a new method of web document clustering which can dramatically decrease the number of times to calculate a document similarity using the Transitive Closure Tree(TCT) and which is able to speed up the processing without loosing the precision. We also compare the effectivity of the proposed method with those existing algorithms and present the experimental results.
Keywords
Web Document Clustering; Text Mining; Transitive Closure;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 W. Klosgen and J.M. Zytkow, 'Handbook of Data Mining and Knowledge Discovery', Oxford University Press, New York, 2002
2 M. A. Hernandez and S. J. Stolfo, 'The merge/purge problem for large databases', Proceedings of the ACM SIGMOD International Conference on Management of Data, pp.127-138, May, 1998   DOI
3 Khaled M. Hammouda and Mohamed S. Kamel, 'Efficient phrase-based document Indexing for web document clusering', IEEE tran. on knowledge and data engineering, Vol.16, No.10, pp.1279-1296, Oct. 2004   DOI   ScienceOn
4 Y. Wang, 'Use link-based clustering to improve web search results', Proceedings of 2nd. conference on web information systems engineering, Vol.1, pp.115-123, Dec., 2001
5 Khaled Alsabti, et al, 'An efficient K-Means Clustering Algorithm', IIPS 11th International Parallel Processing Symposium, 1998
6 J. C. Song and J. Y. Shen, 'A web document clustering algorithm based on concept of neighbor', Proceedings of the second international conference on machine learning and cybernatics, Xi'an, 2-5, pp.46-50, Nov., 2003
7 A. E. Monge and C. P. Elkan, 'An efficient domain independent algorithm for detecting approximately duplicate database records', Proceeding of the ACM SIGMOD workshop on research Issues on knowledge discovery and data mining, pp.125-130, 1997
8 Hwanjo Yu, Jiawei Han, and Kevin C. Chang, 'PEBL: Web Page Classification without Negative Examples', IEEE tran. on knowledge and data engineering, Vol.16, No.1, pp.70-81, Jan., 2004   DOI   ScienceOn
9 김제욱, 김한준, 이상구, '베이지언 문서분류시스템을 위한 능동적 학습 기반의 학습문서집합 구성 방법', 정보과학회논문지: 소프트웨어 및 응용, 29권, 12호, pp.966-978, 2004. 09   과학기술학회마을
10 박우창 외, '데이터 마이닝:개념 및 기법', 자유아카데미, 2003. 09
11 강동혁, 주길홍, 이원석, '대용량 문서 데이터베이스를 위한 효율적인 점진적 문서 클러스터링 기법', 정보처리학회논문지D, 제10-D권, 제1호, pp.57-66, 2003. 02   과학기술학회마을   DOI   ScienceOn
12 강승식, 'HAM : 한국어 분석 모듈', http://nlp.kookmin.ac.kr
13 W. L. Low, M. L. Lee, and T. W. Ling, 'A knowledge-based approach for duplicate elimination in data cleaning', Information Systems, Vol.26, No.8, pp.585-606, Dec., 2001   DOI   ScienceOn
14 O. Zamir and O. Etzioni, 'Fast and intuitive clustering of web document', KDD97, pp.287-290, 1997
15 P. Soucy and G. W. Mineau, 'A Simple KNN Alforithm for Text Categorization', Proceeding of 1st. IEEE international conference on data mining, Vol.28, pp.647-648, 2001   DOI
16 Ying Zhao and George Karypis, 'Web clustering: Evaluation of hierarchical clustering algorithms for document datasets', Proceedings of the eleventh international conference on Information and knowledge management, pp.515-524, Nov., 2002   DOI
17 P. S. Bradley, Uama M Fayyad, 'Refining Initial Points for K-Means Clustering', Proceedings of the Fifteenth International Conference on Machine Learning, 1998