The KIPS Transactions:PartB (정보처리학회논문지B)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Reducing Noise Using Degree of Scattering in Collaborative Filtering System

협력적 여과 시스템에서 산포도를 이용한 잡음 감소

  • 고수정 (인덕대학 컴퓨터소프트웨어과)
  • Published : 2007.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Collaborative filtering systems have problems when users rate items and the rated results depend on their feelings, as there is a possibility that the results include noise. The method proposed in this paper optimizes the matrix by excluding irrelevant ratings as information for recommendations from a user-item matrix using dispersion. It reduces the noise that results from predicting preferences based on original user ratings by inflecting the information for items and users on the matrix. The method excludes the ratings values of the utmost limits using a percentile to supply the defects of coefficient of variance and composes a weighted user-item matrix by combining the user coefficient of variance with the median of ratings for items. Finally, the preferences of the active user are predicted based on the weighted matrix. A large database of user ratings for movies from the MovieLens recommender system is used, and the performance is evaluated. The proposed method is shown to outperform earlier methods significantly.

협력적 여과 시스템의 사용자-아이템 행렬은 사용자들이 아이템에 대하여 평가할 경우 사용자들의 감정 상태가 일정하지 않음으로 인하여 평가 결과에 잡음을 포함할 가능성이 높다. 이러한 문제점을 해결하기 위해 본 논문에서는 산포도를 이용하여 추천 정보로서 이용하기에 부적당한 평가값들을 제외시킴으로써 사용자-아이템 행렬을 최적화시키고, 아이템 정보와 사용자 정보를 반영하여 고유의 사용자의 평가값을 기반으로 선호도를 예측하였을 때 발생하는 잡음을 감소시킨다. 산포도의 변이계수가 갖는 단점을 보완하기 위하여 백분위수를 이용하여 극한적인 평가값을 제거하고, 사용자의 변이계수와 아이템의 중위수를 병합하여 가중치가 부여된 사용자-아이템 행렬을 구성한다. 마지막으로 이를 기반으로 새로운 사용자의 선호도를 예측한다. 제안된 방법은 영화에 대해 평가한 MovieLens 시스템의 데이터베이스를 이용하여 평가되었으며, 기존의 방법보다 성능이 높음을 보인다.

Keywords

References

  1. Basu, C., Hirsh, H., and Cohen, W. W., 'Recommendation as classification:Using social and content-based information in recommendation,' In Proc. of the Fifteenth National Conference on Artificial Intelligence, 1998
  2. Breese, John. S. and Kadie, C., 'Empirical Analysis of Predictive Algorithms for Collaborative Filtering,' In Proc. of the Conference on Uncertainty in Artificial Intelligence, Madison, WI, 1998
  3. Herlocker, J., Konstan, J., Borchers, A., and Riedl, J., 'An Algorithmic Framework for Performing Collaborative Filtering,' In Proc. of the 1999 Conference on Research and Development in Information Retrieval, 1999 https://doi.org/10.1145/312624.312682
  4. Herlocker, J., Konstan, J., Terveen, L., and Riedl, J., 'Evaluating Collaborative Filtering Recommender Systems,' ACM Transactions on Information Systems, Vol. 22, No. 1, 2004 https://doi.org/10.1145/963770.963772
  5. Konstan, J., Miller, B., Maltz, D., Herlocker, J., Gordon, L., and Riedl, J., 'GroupLens:Applying Collaborative Filtering to Usenet News,' Communications of the ACM, Vol. 40, No. 3, pp. 77-87, 1997 https://doi.org/10.1145/245108.245126
  6. Lee, W. S., 'Collaborative learning for recommender systems,' In Proc. of the Conference on Machine Learning, 1997
  7. Massa, P. and Avesani, P., 'Trust-aware Collaborative Filtering for Recommender Systems,' In Proc. of International Conference on Cooperative Information Systems, 2004
  8. MovieLens collaborative filtering data set, Hppt://www.cs.umn.edu/Research/GroupLens/index.html, GROUPLENS RESEARCH PROJECT, 2000
  9. Mui, L., Ang, C., and Mohtashemi, M., 'A Probabilistic Model for Collaborative Sanctioning,'MIT LCS Technical Memorandum 617, 2001
  10. Reddy, P. K., Kitsuregawa, P., Sreekanth, P., and Rao, S. S., 'A Graph based Approach to Extract a Neighborhood Customer Community for Collaborative Filtering,' In Proc. of Databases in Networked Information Systems, Second International Workshop, Lecture Notes in Computer Science, Springer-Verlag, 2002
  11. Rijsbergen, V. and Joost, C., Information Retrieval, Butterworths, London-second edition, 1979
  12. Robu, V. and Poutre , J.A. La, 'Learning the Structure of Utility Graphs Used in Multi-Issue Negotiation through Collaborative Filtering,' In Proc. of the 8th International Pacific Rim Workshop on Multi-Agent Systems (PRIMA'05), 2005
  13. Salton, G. and McGill, M. J., Introduction to Modern Information Retrieval, McGraw-Hill, 1983
  14. Sarwar, B. M., Karypis, G., Konstan, J. A., and Riedl, J., 'Application of Dimensionality Reduction in Recommender System-A Case Study,' In Proc. of ACM WebKDD Web Mining for E-Commerce Workshop, 2000
  15. Sarwar, B. M., Karypis, G., Konstan, J. A., and Riedl, J., 'Item-based Collaborative Filtering Recommendation Algorithms,' In Proc. of the 10th international World Wide Web Conference(WWW10), 2001
  16. Sarwar, B. M., Konstan, J. A., Borchers, A., Herlocker, J., Miller, B., and Riedl, J., 'Using Filtering Agents to Improve Prediction Quality in the GroupLens Research Collaborative Filtering System,' In Proc. of CSCW'98, 1998 https://doi.org/10.1145/289444.289509
  17. Schein, A. I., Popescul, A., Ungar, L. H., and Pennock, D. M., 'Generate Models for Cold-start Recommendations,' In Proc. of the 2001 ACM SIGIR Workshop on Recommender Systems, 2001
  18. Spiegel, Murray R. and Stephens, Larry J., Schaum's Outline of Statistics, McGraw-Hill, 1998
  19. Wang, J., Vries, Arjen P. de, and Reinders, Marcel J. T., 'Unifying User-based and Item-based Collaborative Filtering Approaches by Similarity Fusion,'In Proc. of the 29th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR06), 2006 https://doi.org/10.1145/1148170.1148257
  20. 양완연, 일반통계학, 연학사, 1995