Document Type : Original/Review Paper
Authors
1 Department of Industrial Engineering, Ferdowsi University of Mashhad, Mashhad, Iran.
2 Department of Industrial Engineering, Sadjad University of Technology, Mashhad, Iran.
Abstract
In the last decade, online shopping has played a vital role in customers' approach to purchasing different products, providing convenience to shop and many benefits for the economy. E-commerce is widely used for digital media products such as movies, images, and software. So, recommendation systems are of great importance, especially in today's hectic world, which search for content that would be interesting to an individual. In this research, a new two-steps recommender system is proposed based on demographic data and user ratings on the public MovieLens datasets. In the first step, clustering on the training dataset is performed based on demographic data, grouping customers in homogeneous clusters. The clustering includes a hybrid Firefly Algorithm (FA) and K-means approach. Due to the FA's ability to avoid trapping into local optima, which resolves K-means' main pitfall, the combination of these two techniques leads to much better performance. In the next step, for each cluster, two recommender systems are proposed based on K-Nearest Neighbor (KNN) and Naïve Bayesian Classification. The results are evaluated based on many internal and external measures like the Davies-Bouldin index, precision, accuracy, recall, and F-measure. The results showed the effectiveness of the K-means/FA/KNN compared with other extant models.
Keywords
[1] S. Rajarajeswari, S. Naik, S. Srikant, M. S. Prakash, and P. Uday, “Movie Recommendation System,” In Emerging Research in Computing, Information, Communication and Applications. Springer, Singapore, pp. 329-340, 2019.
[2] X. Yang, Y. Guo, Y. Liu, and H. Steck, “A survey of collaborative filtering based social recommender systems,” Computer communications, Vol. 41, pp. 1-10, 2014.
[3] H. Tahmasebi, R. Ravanmehr, and R. Mohamadrezaei, “Social movie recommender system based on deep autoencoder network using Twitter data,” Neural Computing and Applications, pp. 1-17, 2020.
[4] D. Cintia Ganesha Putri, J. S. Leu, and P. Seda, “Design of an Unsupervised Machine Learning-Based Movie Recommender System,” Symmetry, Vol. 12, No. 2, pp. 185, 2020.
[5] L. Esmaeili, S. Mardani, S. A. H. Golpayegani, and Z. Z. Madar, “A novel tourism recommender system in the context of social commerce,” Expert Systems with Applications, Vol. 149, pp. 113301, 2020.
[6] T. N. T. Tran, M. Atas, A. Felfernig, and M. Stettinger, “An overview of recommender systems in the healthy food domain,” Journal of Intelligent Information Systems, Vol. 50, No. 3, pp. 501-526, 2018.
[7] S. R. S. Reddy, S. Nalluri, S. Kunisetti, S. Ashok, and B. Venkatesh, “Content-based movie recommendation system using genre correlation,” In Smart Intelligent Computing and Applications Springer, Singapore, pp. 391-397, 2019.
[8] Q. Li, I. Choi, and J. Kim, Evaluation of Recommendation System for Sustainable E-Commerce: Accuracy, Diversity and Customer Satisfaction, 2020.
[9] G. Desirena, A. Diaz, J. Desirena, I. Moreno, and D. Garcia, “Maximizing Customer Lifetime Value using Stacked Neural Networks: An Insurance Industry Application,” in 18th IEEE International Conference on Machine Learning and Applications (ICMLA), IEEE, 2019, pp. 541-544.
[10] Y. Bai, S. Jia, S. Wang, and B. Tan, “Customer Loyalty Improves the Effectiveness of Recommender Systems Based on Complex Network,” Information, Vol. 11, No. 3, pp. 171, 2020.
[11] P. Vilakone, K. Xinchang, and D. S. Park, “Movie recommendation system based on users’ personal information and movies rated using the method of k-clique and normalized discounted cumulative gain,” Journal of Information Processing Systems, Vol. 16, No. 2, pp. 494-507, 2020.
[12] C. H. Lin, and H. Chi, “A novel movie recommendation system based on collaborative filtering and neural networks,” In International Conference on Advanced Information Networking and Applications. Springer, Cham, 2019, pp. 895-903.
[13] M. Y. Hsieh, W. K. Chou, and K. C. Li, “Building a mobile movie recommendation service by user rating and APP usage with linked data on Hadoop,” Multimedia Tools and Applications, Vol. 76, No. 3, pp. 3383-3401, 2017.
[14] M. Ashraf, S. Ouf, and Y. Helmy, “A Proposed Paradigm for Enhancing Customer Retention using Web Usage Mining,” International Journal of Computer Applications, Vol. 975, pp. 8887, 2020.
[15] M. Riyahi, and M. K. Sohrabi, “Providing effective recommendations in discussion groups using a new hybrid recommender system based on implicit ratings and semantic similarity,” Electronic Commerce Research and Applications, Vol. 40, pp. 100938, 2020.
[16] J. Pérez-Marcos, L. Martín-Gómez, D. M. Jiménez-Bravo, V. F. López, and M. N. Moreno-García, “Hybrid system for video game recommendation based on implicit ratings and social networks,” Journal of Ambient Intelligence and Humanized Computing, pp. 1-11, 2020.
[17] S. Kumar, K. De, and P. P. Roy, “Movie recommendation system using sentiment analysis from microblogging data,” IEEE Transactions on Computational Social Systems, 2020.
[18] R. Harakawa, D. Takehara, T. Ogawa, and M. Haseyama, “Sentiment-aware personalized tweet recommendation through multimodal FFM,” Multimedia Tools and Applications, Vol. 77, No. 14, pp. 18741-18759, 2018.
[19] H. R. Zhang, F. Min, X. He, and Y. Y. Xu, “A hybrid recommender system based on user-recommender interaction,” Mathematical Problems in Engineering, 2015.
[20] M. Ludewig, I. Kamehkhosh, N. Landia, and D. Jannach, “Effective nearest-neighbor music recommendations,” In Proceedings of the ACM Recommender Systems Challenge, pp. 1-6, 2018.
[21] M. Ludewig, and D. Jannach, “Evaluation of session-based recommendation algorithms,” User Modeling and User-Adapted Interaction, Vol. 28, No. 4-5, pp. 331-390, 2018.
[22] S. S. Pawar, A. S. Kadan, P. R. Chavhan, P. R. Ranjane, and A. S. Lohar, “Android Based Tourist Guide System,” International Journal of Engineering Technology, Management and Applied Sciences (IJETMAS), Vol. 4, No. 2, pp. 42-46, 2016.
[23] Z. H. Zhou, and Y. Yu, “Ensembling local learners Through Multimodal perturbation,” IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 35, No. 4, pp. 725-735, 2005.
[24] C. Domeniconi, and B. Yan, “Nearest neighbor ensemble,” In Proceedings of the 17th International Conference on Pattern Recognition, IEEE, Vol. 1, 2004, pp. 228-231.
[25] A. Argentini, and E. Blanzieri, “About neighborhood counting measure metric and minimum risk metric,” IEEE transactions on pattern analysis and machine intelligence, Vol. 32, No. 4, pp. 763-765, 2009.
[26] J. Derrac, I. Triguero, S. García, and F. Herrera, “Integrating instance selection, instance weighting, and feature weighting for nearest neighbor classifiers by coevolutionary algorithms,” IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 42, No. 5, pp. 1383-1397, 2012.
[27] S. Rajabi, A. Harounabadi, and V. Aghazarian, “A recommender system for the web: using user profiles and machine learning methods,” International Journal of Computer Applications, Vol. 96, No. 11, 2014.
[28] G. Guo, J. Zhang, and N. Yorke-Smith, “Trustsvd: Collaborative filtering with both the explicit and implicit influence of user trust and of item ratings,” In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 29, No. 1, 2015.
[29] T. H. Roh, K. J. Oh, and I. Han, “The collaborative filtering recommendation based on SOM cluster-indexing CBR,” Expert systems with applications, Vol. 25, No. 3, pp. 413-423, 2003.
[30] H. Koohi, and K. Kiani, “User-based Collaborative Filtering using fuzzy C-means,” Measurement, Vol. 91, pp. 134-139, 2016.
[31] A. R. Anaya, M. Luque, and T. García-Saiz, “Recommender system in collaborative learning environment using an influence diagram,” Expert Systems with Applications, Vol. 40, No. 18, pp. 7193-7202, 2013.
[32] Y. Wang, W. Dai, and Y. Yuan, “Website browsing aid: A navigation graph-based recommendation system,” Decision support systems, Vol. 45, No. 3, pp. 387-400, 2008.
[33] J. B. Schafer, J. Konstan, and J. Riedl, “Recommender systems in e-commerce,” In Proceedings of the 1st ACM conference on Electronic commerce, 1999, pp. 158-166.
[34] N. Ramakrishnan, B. J. Keller, B. J. Mirza, A. Y. Grama, and G. Karypis, “When being weak is brave: Privacy in recommender systems,” arXiv preprint cs/0105028, 2001.
[35] J. L. Herlocker, and J. A. Konstan, “Content-independent task-focused recommendation,” IEEE Internet Computing, Vol. 5, No. 6, pp. 40-47, 2001.
[36] K. W. Cheung, J. T. Kwok, M. H. Law, and K. C. Tsui, “Mining customer product ratings for personalized marketing,” Decision Support Systems, Vol. 35, No. 2, pp. 231-243, 2003.
[37] K. W. Cheung, K. C. Tsui, and J. Liu, “Extended latent class models for collaborative recommendation,” IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, Vol. 34, No. 1, pp. 143-148, 2004.
[38] P. Han, B. Xie, F. Yang, and R. Shen, “A scalable P2P recommender system based on distributed collaborative filtering,” Expert systems with applications, Vol. 27, No. 2, pp. 203-210, 2004.
[39] S. S. Weng, and M. J. Liu, “Feature-based recommendations for one-to-one marketing,” Expert Systems with Applications, Vol. 26, No. 4, pp. 493-508, 2004.
[40] C. Zeng, C. X. Xing, L. Z. Zhou, and X. H. Zheng, “Similarity measure and instance selection for collaborative filtering,” International Journal of Electronic Commerce, Vol. 8, No. 4, pp. 115-129, 2004.
[41] J. L. Herlocker, J. A. Konstan, L. G. Terveen, and J. T. Riedl, “Evaluating collaborative filtering recommender systems,” ACM Transactions on Information Systems (TOIS), Vol. 22, No. 1, pp. 5-53, 2004.
[42] B. N. Miller, J. A. Konstan, and J. Riedl, “PocketLens: Toward a personal recommender system,” ACM Transactions on Information Systems (TOIS), Vol. 22, No. 3, pp. 437-476, 2004.
[43] S. H. Min, and I. Han, “Detection of the customer time-variant pattern for improving recommender systems,” Expert Systems with Applications, Vol. 28, No. 2, pp. 189-199, 2005.
[44] Y. Li, L. Lu, and L. Xuefeng, “A hybrid collaborative filtering method for multiple-interests and multiple-content recommendation in E-Commerce,” Expert systems with applications, Vol. 28, No. 1, pp. 67-77, 2005.
[45] D. Kim, and B. J. Yum, “Collaborative filtering based on iterative principal component analysis,” Expert Systems with Applications, Vol. 28, No. 4, pp. 823-830, 2005.
[46] J. S. Lee, C. H. Jun, J. Lee, and S. Kim, “Classification-based collaborative filtering using market basket data,” Expert systems with applications, Vol. 29, No. 3, pp. 700-704, 2005.
[47] J. Salter, and N. Antonopoulos, “CinemaScreen recommender agent: combining collaborative and content-based filtering,” IEEE Intelligent Systems, Vol. 21, No. 1, pp. 35-41, 2006.
[48] P. du Boucher-Ryan, and D. Bridge, “Collaborative recommending using formal concept analysis,” In International Conference on Innovative Techniques and Applications of Artificial Intelligence. Springer, London, 2005, pp. 205-218.
[49] M. Prangl, T. Szkaliczki, and H. Hellwagner, “A framework for utility-based multimedia adaptation,” IEEE Transactions on Circuits and Systems for Video Technology, Vol. 17, No. 6, pp. 719-728, 2007.
[50] N. J. Hurley, M. P. O'Mahony, and G. C. Silvestre, “Attacking recommender systems: A cost-benefit analysis,” IEEE Intelligent Systems, Vol. 22, No. 3, pp. 64-68, 2007.
[51] I. Im, and A. Hars, “Does a one-size recommendation system fit all? effectiveness of collaborative filtering-based recommendation systems across different domains and search modes,” ACM Transactions on Information Systems (TOIS), Vol. 26, No. 1, 2007.
[52] P. Symeonidis, A. Nanopoulos, A. N. Papadopoulos, and Y. Manolopoulos, “Collaborative recommender systems: Combining effectiveness and efficiency,” Expert Systems with Applications, Vol. 34, No. 4, pp. 2995-3013, 2008.
[53] Y. L. Chen, L. C. Cheng, and C. N. Chuang, “A group recommendation system with consideration of interactions among group members,” Expert systems with applications, Vol. 34, No. 3, pp. 2082-2090, 2008.
[54] S. Russell, and V. Yoon, “Applications of wavelet data reduction in a recommender system,” Expert Systems with Applications, Vol. 34, No. 4, pp. 2316-2325, 2008.
[55] J. S. Lee, and S. Olafsson, “Two-way cooperative prediction for collaborative filtering recommendations,” Expert Systems with Applications, Vol. 36, No. 3, pp. 5353-5361, 2009.
[56] B. Jeong, J. Lee, and H. Cho, “User credit-based collaborative filtering,” Expert Systems with Applications, Vol. 36, No. 3, pp. 7309-7312, 2009.
[57] B. Jeong, J. Lee, and H. Cho, “An iterative semi-explicit rating method for building collaborative recommender systems,” Expert Systems with Applications, Vol. 36, No. 3, pp. 6181-6186, 2009.
[58] A. M. Acilar, and A. Arslan, “A collaborative filtering method based on artificial immune network,” Expert Systems with Applications, Vol. 36, No. 4, pp. 8324-8332, 2009.
[59] Y. Koren, R. Bell, and C. Volinsky, “Matrix factorization techniques for recommender systems,” Computer, Vol. 42, No. 8, pp. 30-37, 2009.
[60] G. Chen, F. Wang, and C. Zhang, “Collaborative filtering using orthogonal nonnegative matrix tri-factorization,” Information Processing & Management, Vol. 45, No. 3, pp. 368-379, 2009.
[61] J. Cho, K. Kwon, and Y. Park, “Q-rater: A collaborative reputation system based on source credibility theory,” Expert Systems with Applications, Vol. 36, No. 2, pp. 3751-3760, 2009.
[62] J. E. S. U. S. Bobadilla, F. Serradilla, and A. Hernando, “Collaborative filtering adapted to recommender systems of e-learning,” Knowledge-Based Systems, Vol. 22, No. 4, pp. 261-265, 2009.
[63] C. Julià, A. D. Sappa, F. Lumbreras, J. Serrat, and A. López, “Predicting missing ratings in recommender systems: Adapted factorization approach,” International Journal of Electronic Commerce, Vol. 14, No. 2, pp. 89-108, 2009.
[64] P. Winoto, and T. Y. Tang, “The role of user mood in movie recommendations,” Expert Systems with Applications, Vol. 37, No. 8, pp. 6086-6092, 2010.
[65] H. J. Ahn, H. Kang, and J. Lee, “Selecting a small number of products for effective user profiling in collaborative filtering,” Expert Systems with Applications, Vol. 37, No. 4, pp. 3055-3062, 2010.
[66] J. Bobadilla, F. Serradilla, and J. Bernal, “A new collaborative filtering metric that improves the behavior of recommender systems,” Knowledge-Based Systems, Vol. 23, No. 6, pp. 520-528, 2010.
[67] A. A. Ozok, Q. Fan, and A. F. Norcio, “Design guidelines for effective recommender system interfaces based on a usability criteria conceptual model: results from a college student population,” Behavior and Information Technology, Vol. 29, No. 1, pp. 57-83, 2010.
[68] S. L. Huang, “Designing utility-based recommender systems for e-commerce: Evaluation of preference-elicitation methods,” Electronic Commerce Research and Applications, Vol. 10, No. 4, pp. 398-407, 2011.
[69] M. A. Ghazanfar, and A. Prügel-Bennett, “Leveraging clustering approaches to solve the gray-sheep user’s problem in recommender systems,” Expert Systems with Applications, Vol. 41, No. 7, pp. 3261-3275, 2014.
[70] X. Li, M. Wang, and T. P. Liang, “A multi-theoretical kernel-based approach to social network-based recommendation,” Decision Support Systems, Vol. 65, pp. 95-104, 2014.
[71] W. Liang, G. Lu, X. Ji, J. Li, and D. Yuan, “Difference factor’KNN collaborative filtering recommendation algorithm,” In International Conference on Advanced Data Mining and Applications. Springer, Cham, 2014, pp. 175-184.
[72] W. Liu, C. Wu, B. Feng, and J. Liu, “Conditional preference in recommender systems,” Expert Systems with Applications, Vol. 42, No. 2, 774-788, 2015.
[73] Z. Sun, L. Han, W. Huang, X. Wang, X. Zeng, M. Wang, and H. Yan, “Recommender systems based on social networks,” Journal of Systems and Software, Vol. 99, pp. 109-119, 2015.
[74] S. Zahra, M. A. Ghazanfar, A. Khalid, M. A. Azam, U. Naeem, and A. Prugel-Bennett, “Novel centroid selection approaches for KMeans-clustering based recommender systems,” Information sciences, Vol. 320, pp. 156-189, 2015.
[75] A. Hernando, J. Bobadilla, and F. Ortega, “A non-negative matrix factorization for collaborative filtering recommender systems based on a Bayesian probabilistic model,” Knowledge-Based Systems, Vol. 97, pp. 188-202, 2016.
[76] E. Q. Da Silva, C. G. Camilo-Junior, L. M. L. Pascoal, and T. C. Rosa, “An evolutionary approach for combining results of recommender systems techniques based on collaborative filtering,” Expert Systems with Applications, Vol. 53, pp. 204-218, 2016.
[77] Y. Ar, and E. Bostanci, “A genetic algorithm solution to the collaborative filtering problem,” Expert Systems with Applications, Vol. 61, pp. 122-128, 2016.
[78] M. Nilashi, M. D. Esfahani, M. Z. Roudbaraki, T. Ramayah, and O. Ibrahim, “A multi-criteria collaborative filtering recommender system using clustering and regression techniques,” Journal of Soft Computing and Decision Support Systems, Vol. 3, No. 5, pp. 24-30, 2016.
[79] C. L. Liao, and S. J. Lee, “A clustering-based approach to improving the efficiency of collaborative filtering recommendation,” Electronic Commerce Research and Applications, Vol. 18, pp. 1-9, 2016.
[80] N. R. Kermany, and S. H. Alizadeh, “A hybrid multi-criteria recommender system using ontology and neuro-fuzzy techniques,” Electronic Commerce Research and Applications, Vol. 21, pp. 50-64, 2017.
[81] T. Ebesu, and Y. Fang, “Neural semantic personalized ranking for item cold-start recommendation,” Information Retrieval Journal, Vol. 20, No. 2, pp. 109-131, 2017.
[82] H. Koohi, and K. Kiani, “A new method to find neighbor users that improves the performance of collaborative filtering,” Expert Systems with Applications, Vol. 83, pp. 30-39, 2017.
[83] S. Park, and D. Y. Kim, “Assessing language discrepancies between travelers and online travel recommendation systems: Application of the Jaccard distance score to web data mining,” Technological Forecasting and Social Change, Vol. 123, pp. 381-388, 2017.
[84] M. K. Najafabadi, M. N. R. Mahrin, S. Chuprat, and H. M. Sarkan, “Improving the accuracy of collaborative filtering recommendations using clustering and association rules mining on implicit data,” Computers in Human Behavior, Vol. 67, pp. 113-128, 2017.
[85] P. Jomsri, “FUCL mining technique for book recommender system in library service,” Procedia Manufacturing, Vol. 22, pp. 550-557, 2018.
[86] C. Li, Z. Wang, S. Cao, and L. He, “WLRRS: A new recommendation system based on weighted linear regression models,” Computers & Electrical Engineering, Vol. 66, pp. 40-47, 2018.
[87] J. Chen, K. Li, H. Rong, K. Bilal, N. Yang, and K. Li, “A disease diagnosis and treatment recommendation system based on big data mining and cloud computing,” Information Sciences, Vol. 435, pp. 124-149, 2018.
[88] A. S. Tewari, and A. G. Barman, “Sequencing of items in personalized recommendations using multiple recommendation techniques,” Expert Systems with Applications, Vol. 97, pp. 70-82, 2018.
[89] I. Viktoratos, A. Tsadiras, and N. Bassiliades, “Combining community-based knowledge with association rule mining to alleviate the cold start problem in context-aware recommender systems,” Expert systems with applications, Vol. 101, pp. 78-90, 2018.
[90] R. Ahuja, A. Solanki, and A. Nayyar, “Movie recommender system using K-Means clustering and K-Nearest Neighbor,” In 9th International Conference on Cloud Computing, Data Science and Engineering (Confluence), IEEE, 2019, pp. 263-268.
[91] B. Hassanpour, N. Abdolvand, and S. Rajaee Harandi, “Improving Accuracy of Recommender Systems using Social Network Information and Longitudinal Data,” Journal of AI and Data Mining, Vol. 8, No. 3, pp. 379-389, 2020.
[92] R. C. Tryon, Cluster analysis: correlation profile and orthometric (factor) analysis for the isolation of unities in mind and personality, Edwards’s brother, Incorporated. Ann Arbor, 1939.
[93] K. J. Kim, and H. Ahn, “A recommender system using GA K-means clustering in an online shopping market,” Expert systems with applications, Vol. 34, No. 2, pp. 1200-1209, 2008.
[94] X. S. Yang, “Firefly algorithms for multimodal optimization,” In International symposium on stochastic algorithms Springer, Berlin, Heidelberg, pp. 169-178, 2009.
[95] S. I. Sulaiman, Z. Othman, I. Musirin, and N. S. M. Z. Abidin, “Optimization of an Artificial Neural Network using Firefly Algorithm for modeling AC power from a photovoltaic system,” In SAI Intelligent Systems Conference (IntelliSys) IEEE, 2015, pp. 591-594.
[96] R. C. Neath, and M. S. Johnson, “Discrimination and classification,” 2010.
[97] I. Portugal, P. Alencar, and D. Cowan, “The use of machine learning algorithms in recommender systems: A systematic review,” Expert Systems with Applications, Vol. 97, pp. 205-227, 2018.
[98] S. L. Lauritzen, Graphical models, Oxford University Press, 1996.
[99] J. S. Breese, D. Heckerman, and C. Kadie, “Empirical analysis of predictive algorithms for collaborative filtering,” arXiv preprint arXiv:1301.7363., 2013.
[100] H. Zhong, H. Zhang, and F. Jia, “Analysis and improvement of evaluation indexes for clustering results,” EAI Endorsed Transactions on Collaborative Computing, Vol. 4, No. 13, 2020.
[101] X. Deng, Q. Liu, Y. Deng, and S. Mahadevan, “An improved method to construct basic probability assignment based on the confusion matrix for classification problem,” Information Sciences, Vol. 340, pp. 250-261, 2016.
[102] the GroupLens Research Project at the University of Minnesota. September 19th, 1997- April 22nd, 1998. Available:https://www.kaggle.com/vedapragnareddy/movie-lens.
[103] C. F. Tsai, and C. Hung, “Cluster ensembles in collaborative filtering recommendation,” Applied Soft Computing, Vol. 12, No. 4, pp. 1417-1425, 2012.
[104] S. Renaud-Deputter, T. Xiong, and S. Wang, “Combining collaborative filtering and clustering for implicit recommender system,” In 27th International Conference on Advanced Information Networking and Applications (AINA), IEEE, 2013, pp. 748-755.
)