Sparsity Effect on Collaborative Filtering-based Personalized Recommendation

협업 필터링 기반 개인화 추천에서의 평가자료의 희소 정도의 영향

  • 김종우 (한양대학교 경영학부) ;
  • 배세진 (충남대학교 자연대학 통계학과) ;
  • 이홍주 (한국과학기술원 테크노경영대학원)
  • Published : 2004.06.30

Abstract

Collaborative filtering is one of popular techniques for personalized recommendation in e-commerce sites. An advantage of collaborative filtering is that the technique can work with sparse evaluation data to predict preference scores of new alternative contents or advertisements. There is, however, no in-depth study about the sparsity effect of customer's evaluation data to the performance of recommendation. In this study, we investigate the sparsity effect and hybrid usages of customers' evaluation data and purchase data using an experiment result. The result of the analysis shows that the performance of recommendation decreases monotonically as the sparsity increases, and also the hybrid usage of two different types of data; customers' evaluation data and purchase data helps to increase the performance of recommendation in sparsity situation.

Keywords

References

  1. 김재경, 서지혜, 안도현, 조윤호, '협업 필터링 기법을 활용한 개인화된상품 추천 방법 론 개발에 관한 연구,' 한국지능정보시스템 학회논문지 제8권 제2호, 2002년 12월, pp. 139-157
  2. 김종우, 이경미, '인터넷 상점에서 개인화 광고를 위한 장바구니 분석 기법의 활용, '경영과학, 제17권 제3호, 2000 년 11월, pp. 19-30
  3. 이건창, 정남호, '데이터 마이닝 기법과 지능형 에이전트 기법을 결합한 인터넷 쇼핑 몰의 설계 및 구현에 관한 연구,' 정보기술 응용연구, 제1권 제2호, 1999년 10월, pp. 113-137
  4. 이재규, 권순범, 김우주, 김민용, 송용욱, 최형림 편저, 전자상거래원론, 법영사, 2002
  5. 황병연, '개선된 추천을 위해 클러스터링을 이용한 협동적 필터링 에이전트 시스템의 성능,' 정보처리논문지, 제7권, 제5S호, 2000년 5월, 2000, pp. 1599-1608
  6. Allen, Gift, Deborah Kania, and Yaeckel Beth, Internet World Guide to One-to-One Web Marketin, John Wiley & Sons, Inc., New York, 1998
  7. Ansari, Asim, Skander Essegaier, and Rajeev Kohli, 'Internet Recorrunendation Systems,' Journal of Marketiηg Research, Vol. 37, August 2000, pp. 363-375 https://doi.org/10.1509/jmkr.37.3.363.18779
  8. Autonomy, http://www.autonomy.com, 2004
  9. Balabanovic, Marko and Yoav Shoham, 'Content-based, Collaborative Recommen-dation,' Communication of ACM, Vol. 40, No. 3, March 1997, pp. 66-72 https://doi.org/10.1145/245108.245124
  10. BeFree, http://www.befree.com. 2004
  11. Breese, John S., David Heckerman, and Carl Kadie, "Empirical Analysis of Predictive Algorithms for Collaborative Filtering,' Te-chnical Report, MSR-TR-98-12, Microsoft Research, October 1998
  12. BroadVision, http://www.broadvision.com, 2004
  13. Cho, Yoon Ho, Jae Kyeong Kim, and Soung Hie Kim, 'A Personalized Recommender System Based on Web Usage Mining and Decision Tree Induction,' Expert Systems with Applications, Vol. 23, No. 3, 2002, pp. 329-242 https://doi.org/10.1016/S0957-4174(02)00052-0
  14. Dragon, Richard V., 'Recommendation Systems - Advice From the Web,' PC Magazine, September 9, 1997
  15. Gupta, Ohruv, Mark Digiovanni, Hiro Norita, and Ken Goldberg, 'Jester 2.0: Eval-uation of a New Linear Time Collaborative Filtering Algorithm,' 22nd International ACM SIGIR Conference on Research and Development in Information Retrieval, August 1999
  16. Gustos, http://www.gustos.com, 2004
  17. Kim, Jae Kyeong, Yoon Ho Cho, Woo Ju Kim, Je Ran Kim and Ji Hae Suh, 'A Personalized Recommendation Procedure for Internet Shopping Support,' Electronic Commerce Research and Applications, Vol. 1, No. 3/4, 2001, pp. 301-313 https://doi.org/10.1016/S1567-4223(02)00022-4
  18. Kim, Jong Woo, Byung Hun Lee, Michael J. Shaw, Hsin-Lu Chang, and Mathew Nelson, 'Application of Decision Tree Induction Techniques to Personalized Advertisements on Internet Storefront,' International Journal of Electronic Commerce, Vol. 5, No. 3, Spring 2001, pp. 45-62
  19. Konstan, J.A., B.N. Miller, D. Maltz, J.L. Herlocker, L.R. Gordon, and J. Riedl 'GroupLens: Applying Gollaborative Filtering to Usenet News,' Communication of the ACM, Vol. 40, No. 3, 1997, pp. 77-87 https://doi.org/10.1145/245108.245126
  20. Lee, Wei-Po, Chih-Hung Liu, and Cheng-Che Lu, 'Intelligent Agent-based Systems for Personalized Recommendation in Internet Commerce,' Expert Systems with Appli-cations, Vol. 22, No. 4, 2002, pp. 275-284 https://doi.org/10.1016/S0957-4174(02)00015-5
  21. Mild, Andreas and Martin Natter, 'Col-laborative Filtering or Regression Models for Internet Recommendation Systems,' Journal of Targeting, Measurement and Analysis for Marketing, Vol. 10, No. 4, Jun, 2002, pp. 304-313 https://doi.org/10.1057/palgrave.jt.5740055
  22. Mobasher, Barnshad, Robert Cookey, and Jaideep Srivastava, 'Automatic Personali-zation Based on Web Usage Mining,' Com-munication of the ACM, Vol. 43, No. 3, 2000, pp. 142-151
  23. Mulvenna, M.D., S.S. Anand, and A.G. Buchner, 'Personalization on the Net Using Web Mining,' Communication of the ACM, Vol. 43, No. 8, August, 2000, pp. 122-125
  24. Net Perception, http://www.netperceptions.com, 2004
  25. Resnick, P. N. 'Iacovou, M. Suchak, P. Bergstrom, and J. Riedl, 'CroupLens: An Open Architecture for Collaborative Filtering of Netnews,' Proceedings of the ACM 1994 Conference on Computer Supported Cooperative Work, New York, ACM, 1994, pp. 175-186
  26. Sarwar, Badrul, George Karypis, Joseph Konstan, and John Riedl, 'Analysis of Recommendation Algorithms for E-Commerce,' ACM SIC EC'00, 2000
  27. Schafer, J. Ben, Joseph Konstan, and John Riedl, 'E-Commerce Recommendation Appli-cations,' Data Minng and Knowledge Discovery, Vol. 5, No.1, 2001, pp.115-153 https://doi.org/10.1023/A:1009804230409
  28. Shardanand, U. and P. Maes, 'Social Information Filtering: Algorithms for Automating 'Word of Mouth',' Proceedings of Confer-ence on Human Factors in Computer Systems, 1995, pp. 210-217
  29. Turban, Efraim, David King, Jae K Lee, and Dennis Viehland, Electronic Commerce 2004: A Managerial Perspective, Prentice Hall, 2003
  30. Ungar, Lyle H. and Dean P. Foster, 'C;us-tering Methods for Collaborative Filtering,' AAAl-98 Workshop on Recommendation Systems, Madison, WI, July 1998, pp. 114-129