Browse > Article
http://dx.doi.org/10.13088/jiis.2013.19.2.039

Product Recommender Systems using Multi-Model Ensemble Techniques  

Lee, Yeonjeong (Graduate School of Management, Dongguk University_Seoul)
Kim, Kyoung-Jae (Business School, Dongguk University_Seoul)
Publication Information
Journal of Intelligence and Information Systems / v.19, no.2, 2013 , pp. 39-54 More about this Journal
Abstract
Recent explosive increase of electronic commerce provides many advantageous purchase opportunities to customers. In this situation, customers who do not have enough knowledge about their purchases, may accept product recommendations. Product recommender systems automatically reflect user's preference and provide recommendation list to the users. Thus, product recommender system in online shopping store has been known as one of the most popular tools for one-to-one marketing. However, recommender systems which do not properly reflect user's preference cause user's disappointment and waste of time. In this study, we propose a novel recommender system which uses data mining and multi-model ensemble techniques to enhance the recommendation performance through reflecting the precise user's preference. The research data is collected from the real-world online shopping store, which deals products from famous art galleries and museums in Korea. The data initially contain 5759 transaction data, but finally remain 3167 transaction data after deletion of null data. In this study, we transform the categorical variables into dummy variables and exclude outlier data. The proposed model consists of two steps. The first step predicts customers who have high likelihood to purchase products in the online shopping store. In this step, we first use logistic regression, decision trees, and artificial neural networks to predict customers who have high likelihood to purchase products in each product group. We perform above data mining techniques using SAS E-Miner software. In this study, we partition datasets into two sets as modeling and validation sets for the logistic regression and decision trees. We also partition datasets into three sets as training, test, and validation sets for the artificial neural network model. The validation dataset is equal for the all experiments. Then we composite the results of each predictor using the multi-model ensemble techniques such as bagging and bumping. Bagging is the abbreviation of "Bootstrap Aggregation" and it composite outputs from several machine learning techniques for raising the performance and stability of prediction or classification. This technique is special form of the averaging method. Bumping is the abbreviation of "Bootstrap Umbrella of Model Parameter," and it only considers the model which has the lowest error value. The results show that bumping outperforms bagging and the other predictors except for "Poster" product group. For the "Poster" product group, artificial neural network model performs better than the other models. In the second step, we use the market basket analysis to extract association rules for co-purchased products. We can extract thirty one association rules according to values of Lift, Support, and Confidence measure. We set the minimum transaction frequency to support associations as 5%, maximum number of items in an association as 4, and minimum confidence for rule generation as 10%. This study also excludes the extracted association rules below 1 of lift value. We finally get fifteen association rules by excluding duplicate rules. Among the fifteen association rules, eleven rules contain association between products in "Office Supplies" product group, one rules include the association between "Office Supplies" and "Fashion" product groups, and other three rules contain association between "Office Supplies" and "Home Decoration" product groups. Finally, the proposed product recommender systems provides list of recommendations to the proper customers. We test the usability of the proposed system by using prototype and real-world transaction and profile data. For this end, we construct the prototype system by using the ASP, Java Script and Microsoft Access. In addition, we survey about user satisfaction for the recommended product list from the proposed system and the randomly selected product lists. The participants for the survey are 173 persons who use MSN Messenger, Daum Caf$\acute{e}$, and P2P services. We evaluate the user satisfaction using five-scale Likert measure. This study also performs "Paired Sample T-test" for the results of the survey. The results show that the proposed model outperforms the random selection model with 1% statistical significance level. It means that the users satisfied the recommended product list significantly. The results also show that the proposed system may be useful in real-world online shopping store.
Keywords
Product Recommender System; Multi-Model Ensemble Technique; Association Rules; Decision Tree; Artificial Neural Networks;
Citations & Related Records
Times Cited By KSCI : 8  (Citation Analysis)
연도 인용수 순위
1 Resnick, P., N. Iacovou, M. Suchak, and P. Bergstrom, "GroupLens : An open architecture for collaborative filtering of netnews," Proceedings of the ACM Conference on Computer Supported Cooperative Work, (1994), 175-186.
2 Roh, T. H., K. J. Oh, and I. Han, "The collaborative filtering recommendation based on SOM cluster-indexing CBR," Expert Systems with Applications, Vol.25, No.3(2003), 413-423.   DOI   ScienceOn
3 Sarwar, B. M., G. Karypis, J. A. Konstan, and J. Riedl, "Analysis of recommendation algorithms for e-commerce," Proceedings of Conference on ACM, (2000), 158-167.
4 Tibshirani, R. and K. Knight, "Model search and inference by bootstrap 'bumping'," Technical Report, University of Toronto, 1995.
5 Kim, J. K., Y. H. Cho, W. J. Kim, J. R. Kim, and J. H. Suh, "A personalized recommendation procedure for Internet shopping support," Electronic Commerce Research and Applications, Vol.1(2002a), 301-313.   DOI   ScienceOn
6 Kim, J. K., D. H. Ahn, and Y. H. Cho, "A Personalized Recommender System, WebCF-PT : A Collaborative Filtering using Web Mining and Product Taxonomy," Asia Pacific Journal of Information Systems, Vol.15, No.1( 2005), 63-79.   과학기술학회마을
7 Konstan, j., B. Miller, D. Maltz, J. Herlocker, L. Gordon, and J. Riedl, "GroupLens : Applying Collaborative Filtering to Usenet News," Communication of the ACM, Vol.40(1997), 77-87.   DOI   ScienceOn
8 Kim, J. K., J. H. Suh, D. H. Ahn, and Y. H. Cho, "A personalized recommendation methodology based on collaborative filtering," Journal of Intelligence and Information Systems, Vol.8, No.2(2002b), 139-157.   과학기술학회마을
9 Kim, J. W., S. J. Bae, and H. J. Lee, "Sparsity Effect on Collaborative Filtering-based Personalized Recommendation," Asia Pacific Journal of Information Systems, Vol.14, No.2(2004), 131-149.   과학기술학회마을   DOI   ScienceOn
10 Kim, K. and. B. Kim, "Product Recommender System for Online Shopping Malls using Data Mining Techniques," Journal of Intelligence and Information Systems, Vol.11, No.1(2005), 191-205.   과학기술학회마을
11 Lee, Y. and S. Kwak, "A study on training ensembles of neural networks : a case of stock price prediction," Journal of Intelligence and Information Systems, Vol.5, No.1(1999), 95-101.   과학기술학회마을
12 Park, J. H., Y. H. Cho, and J. K. Kim, "Social Network : A Novel Approach to New Customer Recommendations," Journal of Intelligence and Information Systems, Vol.15, No.1(2009), 123-140.   과학기술학회마을
13 Pazzani, M. J., "A framework for collaborative, content- based and demographic filtering," Artificial Intelligence Review, Vol.13, No.5-6(1999), 393-408.   DOI
14 Ahn, H. C., I. Han, and K. Kim, "The Product Recommender System Combining Association Rules and Classification Models : The Case of G Internet Shopping Mall," Information Systems Review, Vol.8, No.1(2006), 181-201.
15 Cho, Y. H., J. K. Kim, and S. H. Kim, "A personalized recommender system based on Web usage mining and decision tree induction," Expert Systems with Applications, Vol.23(2002), 329-342.
16 Breiman, L., "Heuristics of instability in model selection," Technical Report, Statistics Department, University of California at Berkeley, 1994.
17 Breiman, L., "Bagging predictors," Machine Learning, Vol.24, No.2(1996), 123-140.
18 Cho, Y. H. and J. K. Kim, "Application of Web usage mining and product taxonomy to collaborative recommendations in e-commerce," Expert Systems with Applications, Vol.26 (2004), 233-246.   DOI   ScienceOn
19 Cho, Y. H., S. K. Park, D. H. Ahn, and J. K. Kim, "Collaborative Recommendations using Adjusted Product Hierarchy : Methodology and Evaluation," Journal of the Korean Operations Research and Management Science Society, Vol.29, No.2(2004), 59-75.   과학기술학회마을
20 Goldberg, D., D. Nichols, B. M. Oki, and D. Terry, "Using collaborative filtering to weave an information tapestry," Communications of the ACM, Vol.35, No.12(1992), 61-70.
21 Heskes, T., "Balancing between bagging and bumping," Advances in Neural Information Processing Systems, Cambridge, MIT Press, (1996), 466-472.
22 Kang, B., "Collaborative Filtering System using Self-Organizing Map for Web Personalization," Journal of Intelligence and Information Systems, Vol.9, No.3(2003), 117-135.
23 Kim, D. and B.-J. Yum, "Collaborative filtering based on iterative principal component analysis," Expert Systems with Applications, Vol.28, No.4(2005), 823-830.   DOI   ScienceOn
24 Wu, K.-L., C. C. Aggarwal, and P. S. Yu, "Personalization with dynamic profiler," Proceedings of the Third International Workshop on Advanced Issues of E-commerce and Web-based Information Systems, (2001), 12-20.
25 Adomavicius, G. and A. Tuzhilin, "Toward the next generation of recommender systems : a survey of the state-of-the-art and possible extensions," IEEE Transactions on Knowledge and Data Engineering, Vol.17, No.6(2005), 734-749.   DOI   ScienceOn
26 Cho, Y. H. and J. H. Bang, "Applying Centrality Analysis to Solve the Cold-Start and Sparsity Problems in Collaborative Filtering," Journal of Intelligence and Information Systems, Vol.17, No.3(2009), 183-199.
27 Kim, J. K., D. H. Ahn, and Y. H. Cho, "Development of a personalized recommendation procedure based on data mining techniques for internet shopping malls," Journal of Intelligence and Information Systems, Vol.9, No.3(2003), 177-191.   과학기술학회마을
28 Kim, K. and H. Ahn, "Collaborative filtering with a user-item matrix reduction technique for recommender systems," International Journal of Electronic Commerce, Vol.16, No.1(2011), 107-128.   DOI   ScienceOn