DOI QR코드

DOI QR Code

설명 가능한 개인화 영화 추천 서비스를 위한 딥러닝 기반 텍스트 요약 모델

Deep Learning-based Text Summarization Model for Explainable Personalized Movie Recommendation Service

  • 진요요 (경희대학교 대학원 경영학과) ;
  • 강경모 (경희대학교 대학원 빅데이터응용학과) ;
  • 김재경 (경희대학교 경영대학 & 대학원 빅데이터응용학과)
  • 투고 : 2022.01.20
  • 심사 : 2022.03.27
  • 발행 : 2022.04.30

초록

The number and variety of products and services offered by companies have increased dramatically, providing customers with more choices to meet their needs. As a solution to this information overload problem, the provision of tailored services to individuals has become increasingly important, and the personalized recommender systems have been widely studied and used in both academia and industry. Existing recommender systems face important problems in practical applications. The most important problem is that it cannot clearly explain why it recommends these products. In recent years, some researchers have found that the explanation of recommender systems may be very useful. As a result, users are generally increasing conversion rates, satisfaction, and trust in the recommender system if it is explained why those particular items are recommended. Therefore, this study presents a methodology of providing an explanatory function of a recommender system using a review text left by a user. The basic idea is not to use all of the user's reviews, but to provide them in a summarized form using only reviews left by similar users or neighbors involved in recommending the item as an explanation when providing the recommended item to the user. To achieve this research goal, this study aims to provide a product recommendation list using user-based collaborative filtering techniques, combine reviews left by neighboring users with each product to build a model that combines text summary methods among deep learning-based natural language processing methods. Using the IMDb movie database, text reviews of all target user neighbors' movies are collected and summarized to present descriptions of recommended movies. There are several text summary methods, but this study aims to evaluate whether the review summary is well performed by training the Sequence-to-sequence+attention model, which is a representative generation summary method, and the BertSum model, which is an extraction summary model.

키워드

과제정보

본 논문은 교육부 및 한국연구재단의 4단계 두뇌한국21 사업(4단계 BK21 사업)으로 지원된 연구임. 이 논문 또는 저서는 2020년 대한민국 교육부와 한국연구재단의 지원을 받아 수행된 연구임(NRF-2020S1A5B8103855)

참고문헌

  1. Al-Taie, M.Z. and S. Kadry, "Visualization of explanations in recommender systems", Journal of Advanced Management Science, Vol.2 No.2, 2014, 140-144. https://doi.org/10.12720/joams.2.2.140-144
  2. Arrieta, A.B., N. Diaz-Rodriguez, J. Del Ser, A. Bennetot, S. Tabik, A. Barbado, … and F. Herrera, "Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI", Information Fusion, Vol.58, 2020, 82-115. https://doi.org/10.1016/j.inffus.2019.12.012
  3. Bahdanau, D., K. Cho, and Y. Bengio, "Neural machine translation by jointly learning to align and translate", arXiv preprint arXiv: 1409.0473, 2014.
  4. Bilgic, M. and R. J. Mooney, "Explaining recommendations: Satisfaction vs. promotion.", In Beyond Personalization Workshop, IUI, Vol.5, 2005, 153.
  5. Breese, J. S., D. Heckerman, and C. Kadie, "Empirical analysis of predictive algorithms for collaborative filtering", arXiv preprint arXiv:1301.7363, 2013.
  6. Burke, R., "Hybrid Recommender Systems: Survey and Experiments", User modeling and user-adapted interaction, Vol.12, No.4, 2002, 331-370. https://doi.org/10.1023/A:1021240730564
  7. Chen, X., H. Chen, H. Xu, Y. Zhang, Y. Cao, Z. Qin, and H. Zha, "Personalized fashion recommendation with visual explanations based on multimodal attention network: Towards visually explainable recommendation", In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019, 765-774.
  8. Cho, K., B. Van Merrienboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, and Y. Bengio, "Learning phrase representations using RNN encoder-decoder for statistical machine translation", arXiv preprint arXiv: 1406.1078, 2014.
  9. Daher, J., A. Brun, and Boyer, "A review on explanations in recommender systems", Doctoral dissertation, LORIA-Universite de Lorraine, 2017.
  10. Devlin, J., M.W. Chang, K. Lee, and K. Toutanova, "Bert: Pre-training of deep bidirectional transformers for language understanding", arXiv preprint arXiv:1810.04805, 2018.
  11. Flesh, R., "A new readability yardstick", Journal of Applied Psychology, Vol.32, No.3, 1948, 221. https://doi.org/10.1037/h0057532
  12. Gedikli, F., D. Jannach, and M. Ge, "How should I explain? A comparison of different explanation types for recommender systems", International Journal of Human-Computer Studies, Vol.72, No.4, 2014, 367-382. https://doi.org/10.1016/j.ijhcs.2013.12.007
  13. Gunning, R., Technique of clear writing, McGrawHill, 1952.
  14. Han, Y.J. and G.H. Kim, "A Study on Automated Fake News Detection Using Verification Articles", KIPS Transactions on Software and Data Engineering, Vol.10, No.12, 2021, 569-578. https://doi.org/10.3745/KTSDE.2021.10.12.569
  15. He, X., T. Chen, M.Y. Kan, and X. Chen, "Trirank: Review-aware explainable recommendation by modeling aspects", Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, 2015, 1661-1670.
  16. He, X., L. Liao, H. Zhang, L. Nie, X. Hu, and T.S. Chua, "Neural collaborative filtering", In Proceedings of the 26th International Conference on World Wide Web, 2017, 173-182.
  17. Herlocker, J.L., J.A. Konstan, and J. Riedl, "Explaining collaborative filtering recommendations", Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work, 2000, 241-250.
  18. Ji, H., J. Li, C. Ren, and M. He, "Hybrid collaborative filtering model for improved recommendation", Proceedings of 2013 IEEE International Conference on Service Operations and Logistics, and Informatics, 2013, 142-145.
  19. Kim, C.Y., J.K. Lee, Y.H. Cho, and D.H. Kim, "VISCORS: A visual contents recommender system on the mobile web", IEEE Intelligent Systems, Special issue on Mining the Web for Actionable Knowledge, Vol.19, No.6, 2004, 32-39.
  20. Kim, J.K., Y.H. Cho, W.J. Kim, J.R. Kim, and J.H. Suh, "A personlized recommendation procedure for internet shopping support", Electronic Commerce Research and Applications, Vol.1, No.3-4, 2002, 301-313. https://doi.org/10.1016/S1567-4223(02)00022-4
  21. Kincaid, J.P., R.P. Fishburne Jr, R.L. Rogers, and B.S. Chissom, Derivation of new readability formulas for navy enlisted personnel, Naval Technical Training Command Milington TN Research Branch, 1975.
  22. Li, Q., B. Lee, X. Li, and J.K. Kim, "A Study on Enhancing Personalization Recommendation Service Performance with CNN-based Review Helpfulness Score Prediction", Journal of Intelligence and Information System, Vol.27, No.3, 2021, 29-56. https://doi.org/10.13088/JIIS.2021.27.3.029
  23. Lin, C.Y., "Rouge: A package for automatic evaluation of summaries", Text Summarization Branches Out, 2014, 74-81.
  24. Liu, Y. and M. Lapata, "Text summarization with pretrained encoders", arXiv preprint arXiv: 1908.08345, 2019.
  25. Liu, Y., "Fine-tune BERT for extractive summarization", arXiv preprint arXiv:1903.10 318, 2019.
  26. Lombrozo, T., "The structure and function of explanations", Trends in Cognitive Sciences, Vol.10, No.10, 2006, 464-470. https://doi.org/10.1016/j.tics.2006.08.004
  27. Luong, M.T., H. Pham, and C.D. Manning, "Effective approaches to attention-based neural machine translation", arXiv preprint arXiv:1508.04025, 2015.
  28. Mc Laughlin, G.H., "SMOG grading-a new readability formula", Journal of Reading, Vol.12, No.8, 1969, 639-646.
  29. McSherry, D., "Explanation in recommender systems", Artificial Intelligence Review, Vol.24, No.2, 2005, 179-197. https://doi.org/10.1007/s10462-005-4612-x
  30. Miller, T., "Explanation in artificial intelligence: Insights from the social sciences", Artificial Intelligence, Vol.267, 2019, 1-38. https://doi.org/10.1016/j.artint.2018.07.007
  31. Mittelstadt, B., C. Russell, and S. Wachter, "Explaining explanations in AI", Proceedings of the Conference on Fairness, Accountability, and Transparency, 2019, 279-288.
  32. Mohseni, S., N. Zarei, and E.D. Ragan, "A survey of evaluation methods and measures for interpretable machine learning", arXiv preprint arXiv:1811.11839, 2018.
  33. Tintarev, N. and J. Masthoff, "Evaluating the effectiveness of explanations for recommender systems", User Modeling and User-Adapted Interaction, Vol.22, No.4-5, 2012, 399-439. https://doi.org/10.1007/s11257-011-9117-5
  34. Papineni, K., S. Roukos, T. Ward, and W.J. Zhu, "Bleu: A method for automatic evaluation of machine translation", Proceedings of the 40th annual meeting of the Association for Computational Linguistics, 2002, 311-318.
  35. Prem, M. and S. Vikas, Recommender Systems, Encyclopedia of Mathcine Learning, Berlin: Springer-Verlag Berlin Heidelberg, 2010.
  36. Quijano-Sanchez, L., C. Sauer, J.A. Recio-Garcia, and B. Diaz-Agudo, "Make it personal: A social explanation system applied to group recommendations", Expert Systems with Applications, Vol.76, 2017, 36-48. https://doi.org/10.1016/j.eswa.2017.01.045
  37. Resnick, P., N. Iacovou, M. Suchak, P. Bergstrom, and J. Riedl, "Grouplens: An open architecture for collaborative filtering of netnews", Proceedings of the 1994 ACM conference on Computer supported cooperative work, 1994, 175-186.
  38. Schafer, J.B., D. Frankowski, J. Herlocker, and S. Sen, "Collaborative filtering recommender systems", The adaptive web, Springer, Berlin, Heidelberg, 2007, 291-324.
  39. Senter, R.J. and E.A. Smith, Automated readability index, Cincinnati Univ Oh, 1967.
  40. Sharma, A. and D. Cosley, "Do social explanations work? Studying and modeling the effects of social explanations in recommender systems", Proceedings of the 22nd InterNational Conference on World Wide Web, 2013, 1133-1144.
  41. Sutskever, I., O. Vinyals, and Q.V. Le, "Sequence to sequence learning with neural networks", Advances in neural information processing systems, 2014, 3104-3112.
  42. Tintarev, N. and J. Masthoff, "A survey of explanations in recommender systems", 2007 IEEE 23rd International Conference on Data Engineering Workshop, 2007, 801-810.
  43. Tintarev, N. and J. Masthoff, "Effective explanations of recommendations: user-centered design", Proceedings of the 2007 ACM Conference on Recommender Systems, 2007, 153-156.
  44. Vig, J., S. Sen, and J. Riedl, "Tagsplanations: explaining recommendations using tags", Proceedings of the 14th International Conference on Intelligent User Interfaces, 2009, 47-56.
  45. Wu, Y. and M. Ester, "Flame: A probabilistic model combining aspect based opinion mining and collaborative filtering", Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, 2015, 199-208.
  46. Zhang, S., L. Yao, A. Sun, and Y. Tay, "Deep learning based recommender system: A survey and new perspectives", ACM Computing Surveys (CSUR), Vol.52, No.1, 2019, 1-38. https://doi.org/10.1145/3158369
  47. Zhang, Y., "Incorporating phrase-level sentiment analysis on textual reviews for personalized recommendation", Proceedings of the eighth ACM International Conference on Web Search and Data Mining, 2015, 435-440.
  48. Zhang, Y., G. Lai, M. Zhang, Y. Zhang, Y. Liu, and S. Ma, "Explicit factor models for explainable recommendation based on phraselevel sentiment analysis", Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval, 2014, 83-92.
  49. Zhang, Z., H. Lin, K. Liu, D. Wu, G. Zhang, and J. Lu, "A hybrid fuzzy-based personalized recommender system for telecom products/services", Information Sciences, Vol.235, 2013, 117-129. https://doi.org/10.1016/j.ins.2013.01.025