Browse > Article
http://dx.doi.org/10.3837/tiis.2020.02.004

Gated Recurrent Unit Architecture for Context-Aware Recommendations with improved Similarity Measures  

Kala, K.U. (Department of Computer Science, Pondicherry University)
Nandhini, M. (Department of Computer Science, Pondicherry University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.14, no.2, 2020 , pp. 538-561 More about this Journal
Abstract
Recommender Systems (RecSys) have a major role in e-commerce for recommending products, which they may like for every user and thus improve their business aspects. Although many types of RecSyss are there in the research field, the state of the art RecSys has focused on finding the user similarity based on sequence (e.g. purchase history, movie-watching history) analyzing and prediction techniques like Recurrent Neural Network in Deep learning. That is RecSys has considered as a sequence prediction problem. However, evaluation of similarities among the customers is challenging while considering temporal aspects, context and multi-component ratings of the item-records in the customer sequences. For addressing this issue, we are proposing a Deep Learning based model which learns customer similarity directly from the sequence to sequence similarity as well as item to item similarity by considering all features of the item, contexts, and rating components using Dynamic Temporal Warping(DTW) distance measure for dynamic temporal matching and 2D-GRU (Two Dimensional-Gated Recurrent Unit) architecture. This will overcome the limitation of non-linearity in the time dimension while measuring the similarity, and the find patterns more accurately and speedily from temporal and spatial contexts. Experiment on the real world movie data set LDOS-CoMoDa demonstrates the efficacy and promising utility of the proposed personalized RecSys architecture.
Keywords
Context Aware Recommender System; Recurrent Neural Network; Sequence Aware Recommender System; Dynamic Temporal Matching; Deep Recommender System Models;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Cremonesi, A. Tripodi and R. Turrin, "Cross-Domain Recommender Systems," in Proc. of 2011 IEEE 11th International Conference on Data Mining Workshops, Vancouver, BC, pp. 496-503, 2011.
2 Shuai Zhang, Lina Yao, Aixin Sun and Yi Tay, "Deep Learning based Recommender System: A Survey and New Perspectives," ACM Comput. Surv., vol.52, no.1, 2019.
3 C. Chen and C. Chang, "Evaluation of Session-Based Recommendation Systems for Social Networks," in Proc. of 2013 IEEE 13th International Conference on Data Mining Workshops, Dallas, TX, pp. 758-765, 2013.
4 Massimo Quadrana, Paolo Cremonesi and Dietmar Jannach, "Sequence-aware Recommender Systems," in Proc. of UMAP, 373-374, 2018.
5 Toan H. Vu, An Dang, Le Dung and Jia-Ching Wang, "Self-Gated Recurrent Neural Networks for Human Activity Recognition on Wearable Devices," in Proc. of the on Thematic Workshops of ACM Multimedia 2017 (Thematic Workshops '17). ACM, New York, NY, USA, 179-185, 2017.
6 Yao-zhong, Zhang, Rui Yamaguchi, Seiya Imoto and Satoru Miyano, "Sequence-specific bias correction for RNA-seq data using recurrent neural networks," BMC Genomicsvolume, 18, Article number. 1044, 2017.
7 Vazhayil A., Vinaykumar R. and Soman K.P, "DeepProteomics: Protein family classification using Shallow and Deep Networks," ArXiv, abs/1809.04461, 2018.
8 Qiang Shi, Weiya Chen, Siqi Huang, Fanglin Jin, Yinghao Dong, Yan Wang and Zhidong Xue, "DNN-Dom: predicting protein domain boundary from sequence alone by deep neural network," Bioinformatics, btz464.
9 Nguyen Quoc and Khanh Le, "Fertility-GRU: Identifying Fertility-Related Proteins by Incorporating Deep-Gated Recurrent Units and Original Position-Specific Scoring Matrix Profiles," Journal of Proteome Research, 18 (9), 3503-3511, 2019.   DOI
10 Rendle S., Freudenthaler C. and Schmidt-Thieme L., "Factorizing personalized markov chains for next basket recommendation," in Proc. of WWW, 811-820, 2010.
11 X. Zhang and M. Lapata, "Chinese poetry generation with recurrent neural networks," in Proc. of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, October 25- 29, 2014, Doha, Qatar, A meeting of SIGDAT, a Special Interest Group of the ACL, A. Moschitti, B. Pang, and W. Daelemans, Eds. ACL, pp. 670-680, 2014.
12 Q. Wang, T. Luo, D. Wang and C. Xing, "Chinese song iambics generation with neural attention-based model," in Proc. of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI 2016, New York, NY, USA, pp. 2943-2949, 9-15 July 2016.
13 Q. Chen, X. Zhu, Z. Ling, S. Wei, H. Jiang and D. Inkpen, "Enhanced LSTM for natural language inference," in Proc. of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, July 30 - August 4, Volume 1: Long Papers, R. Barzilay and M. Kan, Eds. Association for Computational Linguistics, pp. 1657-1668, 2017.
14 Hildebrandt T., van Dongen B. F., Roglinger M. and Mendling J., "Business Process Management," Lecture Notes in Computer Science, vol. 11675, 2019.
15 Hanson J, Yang Y, Paliwal K and Zhou Y, "Improving protein disorder prediction by deep bidirectional long short-term memory recurrent neural networks," Bioinformatics, 33(5), 685-692, 2017.
16 Xueliang Leon Liu, "Deep Recurrent Neural Network for Protein Function Prediction from Sequence," BioRXiv, jan 2017.
17 Hinkka M., Lehto T., Heljanko K. and Jung A. "Classifying Process Instances Using Recurrent Neural Networks," Lecture Notes in Business Information Processing, 313-324, 2019.
18 Nolle, T., Luettgen S., Seeliger A. and Muhlhauser M., "BINet: Multi-perspective Business Process Anomaly Classification," ArXiv, abs/1902.03155, 2019.
19 B. Hidasi, A. Karatzoglou, L. Baltrunas and D. Tikk, "Session-based recommendations with recurrent neural networks," in Proc. of ICLR '16, 2016.
20 A. Greenstein-Messica, L. Rokach, and M. Friedman, "Session-based recommendations using item embedding," in Proc. of IUI '17. ACM, pp. 629-633, 2017.
21 C. Wu, J. Wang, J. Liu and W. Liu, "Recurrent neural network based recommendation for time heterogenous feedback," Knowl-Based System, 109, 90-103, 2016.   DOI
22 B. Hidasi, M. Quadrana, A. Karatzoglou, and D. Tikk, "Parallel recurrent neural network architectures for feature-rich session-based recommendations," in Proc. of RecSys '16., ACM, 241-248, 2016.
23 Y. K. Tan, X. Xu, and Y. Liu, "Improved recurrent neural networks for session-based recommendations," in Proc. of DLRS '16. ACM, pp. 17-22, 2016.
24 H. Wang, N. Wang, and D.-Y.Yeung, "Collaborative deep learning for recommender systems," in Proc. of KDD '15. ACM, pp.1235-1244, 2015.
25 C.-Y. Wu, A. Ahmed, A. Beutel, A. J. Smola and H. Jing., "Recurrent recommender networks," in Proc. of WSDM '17. ACM, 495-503, 2017.
26 Donkers Tim, Loepp Benedikt and Ziegler Jurgen, "Sequential User-based Recurrent Neural Network Recommendations," in Proc. of RecSys '17, ACM, pp.152-160, 2017.
27 Sun Yu, Zhao Peize and Zhang Honggang, "TA4REC: Recurrent Neural Networks with Time Attention Factors for Session-based Recommendations," in Proc. of IJCNN, 1-7, 2018.
28 Liu Q., Wu S., Wang D., Li Z. and Wang L., "Context-aware sequential recommendation," in Proc. of ICDM 2016, pp. 1053-1058, 2016.
29 Elena Smirnova and Flavian Vasile, "Contextual Sequence Modeling for Recommendation with Recurrent Neural Networks," in Proc. of ACM Recommender Systems conference, Como, Italy, (RecSys '17), ACM, pp. 2-9, 2017.
30 V. Tran and L. Nguyen, "Semantic refinement gru-based neural language generation for spoken dialogue systems," in Proc. of International Conference of the Pacific Association for Computational Linguistics, pp. 63-75, 2017.
31 T. Bansal, D. Belanger, and A. McCallum, "Ask the GRU: Multitask learning for deep text recommendations," in Proc. of the 10th ACM Conference on Recommender Systems, Boston, MA, USA, September 15-19, 2016, S. Sen, W. Geyer, J. Freyne, and P. Castells, Eds. ACM, pp. 107-114, 2016.
32 Shengxian Wan, YanyanLan, JiafengGuo, Jun Xu, Liang Pang and Xueqi Cheng, "Match-SRNN: Modeling the Recursive Matching Structure with Spatial RNN," in Proc. of IJCAI-2016, 2955-2928, 2016.
33 Pang, Liang, Yanyan Lan, Jiafeng Guo, Jun Xu, Jingfang Xu and Xueqi Cheng, "DeepRank: A New Deep Architecture for Relevance Ranking in Information Retrieval," CIKM, pp. 257-266, 2017.
34 Zaixiang Zheng, Hao Zhou, Shujian Huang, Lili Mou, Xinyu Dai, Jiajun Chen and Zhaopeng Tu, "Modeling Past and Future for Neural Machine Translation," Transactions of the Association for Computational Linguistics, Vol. 6, pp.145-157, 2018.   DOI
35 S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural Computation, vol. 9, no. 8, pp. 1735-1780, 1997.   DOI
36 A. Graves, N. Jaitly and A. Mohamed, "Hybrid speech recognition with deep bidirectional LSTM," in Proc. of 2013 IEEE Workshop on Automatic Speech Recognition and Understanding, Olomouc, Czech Republic, pp. 273-278, 2013.
37 K. Cho, B. van Merrienboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, and Y. Bengio, "Learning phrase representations using RNN encoder-decoder for statistical machine translation," in Proc. of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, October 25-29, 2014, Doha, Qatar, A meeting of SIGDAT, a Special Interest Group of the ACL, A. Moschitti, B. Pang, and W. Daelemans, Eds. ACL, pp. 1724-1734, 2014.
38 Fenglong Ma, Jing Gao, Qiuling Suo, Quanzeng You, Jing Zhou and Aidong Zhang, "Risk Prediction on Electronic Health Records with Prior Medical Knowledge," in Proc. of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD '18), ACM, New York, USA, 1910-1919, 2018.
39 C. Yan, X. Fu, W. Wu, S. Lu and J. Wu, "Neural Network Based Relation Extraction of Enterprises in Credit Risk Management," in Proc. of 2019 IEEE International Conference on Big Data and Smart Computing (BigComp), Kyoto, Japan, pp. 1-6, 2019.
40 Jagannatha, Abhyuday N. and Hong Yu., "Bidirectional RNN for Medical Event Detection in Electronic Health Records," in Proc. of the conference. Association for Computational Linguistics. North American Chapter, 473-482, 2016.
41 M. Pavithra, K. Saruladha and K. Sathyabama, "GRU Based Deep Learning Model for Prognosis Prediction of Disease Progression," in Proc. of 3rd International Conference on Computing Methodologies and Communication (ICCMC), Erode, India, pp. 840-844, 2019.
42 Maragatham G. and Devi Shobana, "LSTM Model for Prediction of Heart Failure in Big Data," Journal of Medical Systems, 43(5), pp. 111, Mar 2019.   DOI
43 Lee J. M. and Hauskrecht M., "Recent Context-Aware LSTM for Clinical Event Time-Series Prediction," Lecture Notes in Computer Science, 13-23, 2019.
44 Xu X., Wang Y., Jin T., and Wang J., "A Deep Predictive Model in Healthcare for Inpatients," in Proc. of 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), 2018
45 Cheng L., Ren Y., Zhang K., and Shi Y., "Medical Treatment Migration Prediction in Healthcare via Attention-Based Bidirectional GRU," Web and Big Data. APWeb-WAIM 2019. Lecture Notes in Computer Science, vol. 11641, 2019.
46 Che Z., Purushotham S., Cho K., Sontag D. and Liu, Y., "Recurrent Neural Networks for Multivariate Time Series with Missing Values," Scientific Reports, 8, pp. 1-12, 2018.
47 Kosir LDOS-CoMoDa dataset 2011.
48 Liu Q., Wu S., Wang L., Tan T., "Predicting the next location: A recurrent model with spatial and temporal contexts," in Proc. of AAAI 2016, pp. 194-200, 2016.
49 Liu J., Wang G., Hu P., Duan, L.-Y. and Kot A. C., "Global context-aware attention lstm networks for 3d action recognition," in Proc. of CVPR, 2017.
50 S. Ilarri, R. Trillo-Lado and R. Hermoso, "Datasets for Context-Aware Recommender Systems: Current Context and Possible Directions," in Proc. of IEEE 34th International Conference on Data Engineering Workshops (ICDEW), Paris, pp. 25-28, 2018.
51 Mingang Chen, Pan Liu, "Performance Evaluation of Recommender Systems," vol. 13, no. 8, pp. 1246-1256, 2017.
52 Alex Beutel, Paul Covington, Sagar Jain, Can Xu, Jia Li, Vince Gatto and H Chi, "Latent Cross: Making Use of Context in Recurrent Recommender Systems," in Proc. of WSDM, pp. 46-54, 2018.
53 Lian J., Zhang F., Xie X. and Sun G., "CCCFNet: A Content-Boosted Collaborative Filtering Neural Network for Cross Domain Recommender Systems," in Proc. of WWW, pp. 817-818, 2017.
54 M. Braunhofer, M. Elahi and F. Ricci, "STS: A context-aware mobile recommender system for places of interest," in Proc. of 22nd International Conference on User Modeling Adaptation and Personalization (UMAP), CEUR Workshop Proceedings, pp. 75-80, 2014.
55 D. J. Weller-Fahy, B. J. Borghetti , A. A. Sodemann, "A Survey of Distance and Similarity Measures Used Within Network Intrusion Anomaly Detection," IEEE Communications Surveys & Tutorials, vol. 17, no. 1, pp. 70-91, 2015.   DOI
56 L. Yao and Y. Guan, "An Improved LSTM Structure for Natural Language Processing," in Proc. of IEEE International Conference of Safety Produce Informatization (IICSPI), Chongqing, China, pp. 565-569, 2018.
57 Yao K., Cohn T., Vylomova E., Duh K. and Dyer C., "Depth-Gated LSTM," ArXiv, abs/1508.03790, 2015.
58 Viswanathan S., Anand Kumar M. and Soman K.P., "A Sequence-Based Machine Comprehension Modeling Using LSTM and GRU," Emerging Research in Electronics, Computer Science and Technology. Lecture Notes in Electrical Engineering, vol 545, pp. 47-55, 2019.
59 Jiao Z., Sun S., and Sun K., "Chinese Lexical Analysis with Deep Bi-GRU-CRF Network," arXiv e-prints arXiv:1807.01882, 2018.
60 Chen D., Wu Y., Le J., and Pan, Q., "Context-Aware End-To-End Relation Extracting from Clinical Texts with Attention-based Bi-Tree-GRU," ILP Up-and-Coming / Short Papers., 2018.
61 Nammous Mohammed. K. and Saeed, K. "Natural Language Processing: Speaker, Language, and Gender Identification with LSTM," Advanced Computing and Systems for Security, 143-156, 2019.
62 Garcia, J. C., and E. Serrano, "Automatic Music Generation by Deep Learning," in Proc. of Distributed Computing and Artificial Intelligence, 15th International Conference. Advances in Intelligent Systems and Computing, vol. 800, pp. 284-291, 2018.
63 Madhok R., Goel S. and Garg, S., "SentiMozart: Music Generation based on Emotions," in Proc. of ICAART, pp. 501-506, 2018.
64 Guangxiao Song, Zhijie Wang, Fang Han, Shenyi Ding and Muhammad Ather Iqbal, "Music auto-tagging using deep Recurrent Neural Networks," Neurocomputing, Vol. 292, pp. 104-110, 2018.   DOI
65 Xie Y., Liang R., Liang Z., Huang C., Zou C. and Schuller B., "Speech Emotion Classification Using Attention-based LSTM," IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 27, no. 11, pp. 1675-1685, 2019.   DOI
66 Douligeris C., Karagiannis D., and Apostolou D., "Knowledge Science, Engineering and Management," Lecture Notes in Computer Science, vol. 11776, 2019.
67 Yu Zhu, Yu Gong, Qingwen Liu, Yingcai Ma, Wenwu Ou, Junxiong Zhu, Beidou Wang, Ziyu Guan, and Deng Cai, "Query-based Interactive Recommendation by Meta-Path and Adapted Attention-GRU," in Proc. of CIKM '19: ACM International Conference on Information and Knowledge Management, Beijing, China. ACM, New York, NY, USA, 9 pages, 2019.
68 Jiaxuan You, Yichen Wang, Aditya Pal, Pong Eksombatchai, Chuck Rosenberg and Jure Leskovec, "Hierarchical Temporal Convolutional Networks for Dynamic Recommender Systems," in Proc. of the 2019 World Wide Web Conf. (WWW'19), San Francisco, CA, USA. ACM, NY, NY, USA, 11 pages, 2019.
69 L. Huang, Y. Ma, S. Wang and Y. Liu, "An Attention-based Spatiotemporal LSTM Network for Next POI Recommendation," IEEE Transactions on Services Computing, pp.1-1, 2019.
70 Amit Livne, Moshe Unger, Bracha Shapira, and Lior Rokach, "Deep Context-Aware Recommender System Utilizing Sequential Latent Context," 2019.
71 Doan K.D., Yang G. and Reddy C.K., "An Attentive Spatio-Temporal Neural Model for Successive Point of Interest Recommendation," Advances in Knowledge Discovery and Data Mining. PAKDD 2019. Lecture Notes in Computer Science, vol. 11441, pp. 346-358, 2019.
72 Hu F., Huang X., Gao X. and Chen G., "AGREE: Attention-Based Tour Group Recommendation with Multi-modal Data," Database Systems for Advanced Applications. DASFAA 2019. Springer Lecture Notes in Computer Science, vol. 11448, pp. 314-318, 2019.
73 X. Shu, J. Tang, G. Qi, Y. Song, Z. Li and L. Zhang, "Concurrence-Aware Long Short-Term Sub-Memories for Person-Person Action Recognition," in Proc. of 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, pp. 2176-2183, 2017.
74 HuangR.N., McIntyre S., Song M., Haihong E., and Ou Z., "An Attention-Based Recommender System to Predict Contextual Intent Based on Choice Histories across and within Sessions," 8(12), 2426, 2018.   DOI
75 Kang J., Zhang W.-Q., Liu W.-W., Liu J. and Johnson, M. T., "Advanced recurrent network-based hybrid acoustic models for low resource speech recognition," EURASIP Journal on Audio, Speech, and Music Processing, vol. 2018, 2018.
76 Shota Nakayama and Shuichi Arai, "DNN-LSTM-CRF Model for Automatic Audio Chord Recognition," in Proc. of the International Conference on Pattern Recognition and Artificial Intelligence (PRAI 2018), ACM, New York, NY, USA, 82-88, 2018.
77 Chen Z., Zhang X., Deng J., Li J., Jiang Y. and Li W., "A Practical Singing Voice Detection System Based on GRU-RNN," in Proc. of the 6th Conference on Sound and Music Technology (CSMT). Lecture Notes in Electrical Engineering, vol 568, pp. 15-25, 2019.
78 Shu X., Tang J., Qi G., Liu W., and Yang, J.X., "Hierarchical Long Short-Term Concurrent Memory for Human Interaction Recognition," ArXiv, abs/1811.00270, 2018.
79 J. Tang, X. Shu, R. Yan and L. Zhang, "Coherence Constrained Graph LSTM for Group Activity Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1-1, 2019.
80 Rui Yan, Jinhui Tang, Xiangbo Shu, Zechao Li and Qi Tian., "Participation-Contributed Temporal Dynamic Model for Group Activity Recognition," in Proc. of the 26th ACM international conference on Multimedia (MM '18). ACM, 1292-1300, 2018.
81 Macedo AA, Pollettini JT, Baranauskas JA and Chaves JC, "A Health Surveillance Software Framework to deliver information on preventive healthcare strategies," J Biomed Inform., 62, 159-170, 2016.   DOI
82 Vahora, S. and Chauhan, N., "Deep neural network model for group activity recognition using contextual relationship," Eng. Sci. Technol. Int. J. 22, 47-54, 2019.
83 Zheng H.T., Chen, J.Y., Liang N., Sangaiah A.K., Jiang Y., Zhao C.Z., "A Deep Temporal Neural Music Recommendation Model Utilizing Music and User Metadata," Appl. Sci., 9(4), 703, 2019.   DOI
84 S. Li, Z. Yan, X. Wu, A. Li and B. Zhou, "A Method of Emotional Analysis of Movie Based on Convolution Neural Network and Bi-directional LSTM RNN," in Proc. of IEEE Second International Conference on Data Science in Cyberspace (DSC), Shenzhen, pp. 156-161, 2017.
85 Sebastian Heinz, Christian Bracher, Roland Vollgraf, "An LSTM Based Dynamic Customer Model for Fashion Recommendation," in Proc. of Workshop on Temporal Reasoning in Recommender Systems, Como, Italy, 5 pages, 31st August 2017.
86 Syed Tanveer Jishan and Yiji Wang, "Audience Activity Recommendation Using Stacked-LSTM Based Sequence Learning," in Proc. of the 9th International Conference on Machine Learning and Computing (ICMLC 2017). ACM, New York, NY, USA, 98-106, 2017.
87 Francesco Ricc, Lior Rokach and Bracha Shapira, "Introduction to Recommender Systems Handbook," Recommender Systems Handbook, Springer, pp. 1-35, 2011.
88 Xiaoyuan Su, Taghi M. and Khoshgoftaar, "A survey of collaborative filtering techniques," Advances in Artificial Intelligence archive, 2009.
89 Robin Burke, "Hybrid Web Recommender Systems," the Wayback Machine, pp. 377-408, 2014.
90 Imen Ben Sassi, Sehl Mellouli and Sadok Ben Yahia, "Context-aware recommender systems in mobile environment: On the road of future research Information Systems," Information Systems, Vol. 72, pp. 27-61, 2017.   DOI
91 Y. Zhu and D. Shasha, "Warping indexes with envelope transforms," in Proc. of SIGMOD, pp. 181-192, 2003.
92 Hiroaki Sakoe and Seibi Chiba, "Dynamic Programming Algorithm Optimization for Spoken Word Recognition," Readings in speech recognition, pp. 159-165, 1990.
93 J. Aach and GM. Church, "Aligning gene expression time series with time warping algorithms," Bioinformatics, 17(6), 495-508, 2001.   DOI
94 Thanawin Rakthanmanon, Bilson Campana, Abdullah Mueen, Gustavo Batista, Brandon Westover, Qiang Zhu, Jesin Zakaria and Eamonn Keogh, "Addressing big data time series: Mining trillions of time series subsequences under dynamic time warping," ACM Trans. Knowl. Discov. Data, 7(3), 2013.
95 Chotirat Ann Ratanamahatana and Eamonn Keogh, "Everything you know about dynamic time warping is wrong," in Proc. of Third Workshop on Mining Temporal and Sequential Data, 2004.
96 I. Goodfellow, Y. Bengio, A. Courville, "Deep Learning," MIT Press, 2016.