A New Approach Combining Content-based Filtering and Collaborative Filtering for Recommender Systems

추천시스템을 위한 내용기반 필터링과 협력필터링의 새로운 결합 기법

  • 김병만 (금오공과대학교 컴퓨터공학과) ;
  • 이경 (금오공과대학교 컴퓨터공학과) ;
  • 김시관 (금오공과대학교 컴퓨터공학부) ;
  • 임은기 (금오공과대학교 컴퓨터공학부) ;
  • 김주연 (부천대학 전산정보처리과)
  • Published : 2004.03.01

Abstract

With the explosive growth of information in our real life, information filtering is quickly becoming a popular technique for reducing information overload. Information filtering technique is divided into two categories: content-based filtering and collaborative filtering (or social filtering). Content-based filtering selects the information based on contents; while collaborative filtering combines the opinions of other persons to make a prediction for the target user. In this paper, we describe a new filtering approach that seamlessly combines content-based filtering and collaborative filtering to take advantages from both of them, where a technique using user profiles efficiently on the collaborative filtering framework is introduced to predict a user's preference. The proposed approach is experimentally evaluated and compared to conventional filtering. Our experiments showed that the proposed approach not only achieved significant improvement in prediction quality, but also dealt with new users well.

엄청난 속도로 증가하고 있는 정보의 홍수 시대에서는 정보들을 선별하기 위하여 정보 필터링기법이 필요하다. 정보 필터링은 내용 기반 방법과 협력에 의한 방법으로 분류할 수 있다. 내용 기반 기법에서는 내용에 기반을 두어 정보를 추출하는 반면 협력 기법은 다른 사람들의 의견을 이용하게 된다. 본 논문에서는 기존 협력 필터링 방법의 문제점을 해결하기 위한 방법의 일환으로 내용 기반 기법과 협력 기법을 보다 유기적으로 결합시키는 연구를 수행하였다. 이를 위해 협력 필터링 틀을 그대로 유지하면서 사용자 프로파일을 효과적으로 이용하는 방법을 제안하였다. 또한, 본 논문에서 제시한 기법을 실험적으로 분석하고 기존의 필터링 기법과 비교하였다. 실험 결과, 본 방법이 예측 질 면에서 상당한 성능 향상이 있었고 새로운 사용자에게도 보다 나은 추천을 할 수 있음을 알 수 있었다.

Keywords

References

  1. Oard, D.W. and Marchionini, G., 'A conceptual framework for text filtering,' Technical Report EE-TR-96-25, CAR-TR-830, CLIS-TR-96-02, CS-TR3643, University of Maryland, College Park, 1996
  2. J. Alspector, A. Kolcz, and N. Karunanithi, 'Comparing Feature-Based and Clique-Based User Models for Movie Selection,' Proc. of the 3'rd ACM Conference on Digital Libraries, 1998 https://doi.org/10.1145/276675.276677
  3. Pazzani, M., Billsus, D., 'Learning and revising user profiles: the identification of interesting Web sites,' Machine Learning, 1997 https://doi.org/10.1023/A:1007369909943
  4. Seo, Y., Zhang, B., 'Personalized Web Document Filtering Using Reinforcement Learning,' Applied Artificial Intelligence, 2001 https://doi.org/10.1080/088395101750363993
  5. Curt Stevens, 'Automating the creation of information filters,' CACM, Vol.35, No.12, 1992 https://doi.org/10.1145/138859.138863
  6. Tak W.Yan and Hector Garcia-Molina, 'Distributed selective dissemination of information,' Proc. of the Third International Conference on Parallel and Distributed Information Systems, pp. 89-98. 1994
  7. C. C. Aggarwal, J. L. Wolf, K. Wu, and P. S. Yu. 'Horting Hatches an Egg : A New Graphtheoretic Approach to Collaborative Filtering,' Proc. of the ACM KDD'99, 1999
  8. J. S. Breese, D. Heckerman, and C. Kadie. 'Empirical analysis of predictive algorithms for collaborative fitering,' Poe. of the 14th UAI, 1998
  9. D. Goldberg, D. Nichols, B. Oki, and D. Terry, 'Using Collaborative Filtering to Weave an Informtion Tapestry,' CACM, Vol.35, No.12. pp. 61-70. 1992 https://doi.org/10.1145/138859.138867
  10. Herlocker, J., Konstan, J. Borchers, A., Riedl, J. 'An Algorithmic Framework for Performing Collaborative Filteringm,' Proc. of the 1999 Conference on Research and Development in Information Retrieval, 1999 https://doi.org/10.1145/312624.312682
  11. W. Hill, L. Stead, M. Rosenstein. and G. Furnas, 'Recommending and Evaluating Choices in a Virtual Community of Use,' Proc. of ACM CHI '95, 1995
  12. O'Conner, M. and Herlocker, J., 'Clustering items for collaborative filtering,' Proc. ACM-SIGIR Workshop on Recommender Systems, 1999
  13. B. Sarwar, G. Karypis., J. Konstan, and J. Riedl. 'Item-based Collaborative Filtering Recommendation Algorithms.' Proc. of WWW10, 2001 https://doi.org/10.1145/371920.372071
  14. Upendra S. and Patti M.. 'Social Information Filtering: Algorithms for Automating 'Word of Mouth', Proc. of ACM CHI'95 Conference on Human Factors in Computing Systems, pp. 210-217, 1995 https://doi.org/10.1145/223904.223931
  15. Donna Harman., 'Overview of the third Text Retrieval Conference(TREC-3).' D. K. Harman. editor, Overview of the Third Text Retrieval Conference (TREC-3). pp. 1-19, 1994
  16. Douglas B. Terry. 'A tour through tapestry,' Proc. of the ACM Conference on Organizational Computing Systems(COOCS). pp. 21-30. 1993 https://doi.org/10.1145/168555.168558
  17. Resnick. P., Iacovou, N., Suchak, M., Bergstorm, P. and Riedl. J., 'Groupl.ens: An open architecture for collaborative filtering of Netnews,' Proc. of ACM Conf. on Computer-Supported Cooperative Work. pp.175-186, 1994 https://doi.org/10.1145/192844.192905
  18. D. Gupta, M. Digiovanni. H. Narita, and K. Goldberg. 'Jester 2.0: A New Linear-Time Collaborative Filtering Algorithm Applied to Jokes,' Proc. of Workshop on Recommender Systems: Algorithms and Evaluation. Aug. 1999 https://doi.org/10.1145/312624.312718
  19. Hauver. D. B. and French, J. C. 'Flycasting: Using Collaborative Filtering to Generate a Play list for Online Radio,' Proc. of Int. Conf. on Web Delivery of Music. 2001
  20. M. Claypool, A. Gokhale, T. Mirana, P. Mumikv, D. Netes and M. Sartin. 'Combing Content-Based and Collaborative Filters in an Online Newspaper,' Proc. of Workshop on Recommender Systems Implementation and Evaluation, 1999
  21. A. Gokhale and M. Claypool, 'Thresholds for More Accurate Collaborative Filtering,' Proc. of the IASTED International Conference on Artificial Intelligence and Soft Computing, 1999
  22. M. Balabanovic and Y. Shoham, 'Content-based collavorative recommendation,' CACM, Vol.40, No.3, 1997 https://doi.org/10.1145/245108.245124
  23. C. Basu, H. Hirsh, and W. Cohen, 'Recommendation as Classification : Using Social and Content-Based Information in recommendation,' Proc. of AAAI, 1998
  24. B. Sarwar, J. Konstan, A. Borchers, J. Herlocker, B. Miller, and J. Riedl, 'Using Filtering Agents to Improve Predictive Quality in the GroupLens Research Collaborative Filtering System,' Proc. of the ACM CSCW, 1998
  25. Wasfi, A. M. A., 'Collecting User Access Patterns for Building user Profiles and Collaborative Filtering,' Proc. of Int. Conf. on Intelligent User Interfaces, pp. 57-64, 1999 https://doi.org/10.1145/291080.291091
  26. McClave, J. T. and Dietrich, F. H., Statistics, San FranciscoDellen Publishing Company
  27. http://www.cs.umn.edu/research/GroupLens/
  28. Delgado, J., Ishii, N. and Ura, T., 'Content-based Collaborative Information Filtering: Actively Learning to Classify and Recommend Documents,' Proc. of Second Int. Workshop, CIA '98, pp. 206-215, 1998
  29. Popescul, A., Ungar, L.. H., Pennock, D. M. and Lawrence, S., 'Probabilistic Models for Unified Collaborative and Content-Based Recommendation in Sparse-Data Environments,' Proc. of Conf. on UAI, 2001