한국인터넷방송통신학회논문지 (The Journal of the Institute of Internet, Broadcasting and Communication)

  • 제14권1호
  • /
  • Pages.101-107
  • /
  • 2014
  • /
  • 2289-0238(pISSN)
  • /
  • 2289-0246(eISSN)
한국인터넷방송통신학회 (The Institute of Internet, Broadcasting and Communication)
권호 표지
DOI QR코드

DOI QR Code

클러스터링 기반 협업 필터링 알고리즘을 사용한 분산 추천 시스템

Distributed Recommendation System Using Clustering-based Collaborative Filtering Algorithm

  • 조현제 (인하대학교 컴퓨터정보공학과) ;
  • 이필규 (인하대학교 컴퓨터정보공학과)
  • 투고 : 2014.01.17
  • 심사 : 2014.02.07
  • 발행 : 2014.02.28
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

본 논문에서는 협업 필터링 알고리즘을 클러스터링 기반으로 분산 환경에서 구현하여, 추천을 위한 수행 시간을 최적화 하는 방법에 대한 제안을 한다. 하둡 기반으로 시스템을 구성하였고, 분산 Min-hash 클러스터링 기반의 협업 필터링 방법을 제안하고, 이를 기반으로 분산 추천 시스템을 구성하였다. 분산 사용자 기반 협업 필터링 기법을 사용하여 무비렌즈 (Movie Lens)의 영화 평점 데이터를 기반으로 각각의 사용자에게 알맞은 영화를 추천해주는 분산추천 시스템을 구현하고 실험을 통하여 성능의 우수성을 검증하였다.

This paper presents an efficient distributed recommendation system using clustering collaborative filtering algorithm in distributed computing environments. The system was built based on Hadoop distributed computing platform, where distributed Min-hash clustering algorithm is combined with user based collaborative filtering algorithm to optimize recommendation performance. Experiments using Movie Lens benchmark data show that the proposed system can reduce the execution time for recommendation compare to sequential system.

키워드

참고문헌

  1. Paul Renick and Hal R. Varian, "Recommender System," Communications of the ACM" Vol 40, No.3, March. 1997
  2. Yan Shen, Hak-Chul Shin, "Reinforcement Learning Algorithm Based Hybrid Filtering Image Recommender System",The Journal of The Institute of Internet, Broadcasting and Communication, VOl. 12 No. 3, June 2012
  3. Su, X., & Khoshgoftaar, T. M. (2009). A Survey of Collaborative Filtering Techniques. Advances in Artificial Intelligence, 2009(12)
  4. Dean, J., & Ghemawat, S. (2008). MapReduce: simplified data processing on large clusters. Communications of the ACM, 51(1)
  5. Das, A. S., Datar, M., Garg, A., & Rajaram, S. (2007). Google news personalization: scalable online collaborative filtering, 271-280.
  6. http://hadoop.apache.org/
  7. http://grouplens.org/datasets/movielens/
  8. Gong, S. (2010). A collaborative filtering recommendation algorithm based on user clustering and item clustering. Journal of Software, 5(7), 745-752. doi:10.4304/jsw.5.7.745-752
  9. G Smith Linden B.; York, J. (n.d.). Amazon.com Recommendations: Item-to-item Collaborative Filtering.
  10. Davidson, J., Liebald, B., Liu, J., Nandy, P., Van Vleet, T., Gargi, U., et al. (2010). The YouTube video recommendation system, 293-296. doi:10.1145/1787275.1787324
  11. Karypis, G. "Evaluation of item-based top-n recommendation algorithms", in Proceedings of the International Conferrence on Information and Knowledge Management (CIKM'01), pp.247-254, Atlanta, Ga, USA, November 2001.
  12. http://www.netflix.com/
  13. https://news.google.com/
  14. http://www.youtube.com/
  15. H. Lee, J. Kwon, "A New Distributed Graph Data Storage System for Large-Scale Recommender Engines", Journal of Korean Institute of Information Technology, Vol. 11, No. 7, pp. 139-149, July 31, 2013.
  16. Seok-Jong Yu, "Comprehensive Temporal Filter for Expanded Collaborative Filtering Algorithm", Journal of Korean Institute of Information Technology, Vol. 11, No. 11, pp. 173-179, Nov. 30, 2013.
  17. Kitae Hwang, "Genre-based Collaborative Filtering Movie Recommendation",The Journal of The Institute of Internet, Broadcasting and Communication, VOl. 10, No. 3, June 2010