skip to main content
10.1145/3583780.3614770acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article
Open Access

A Two-tier Shared Embedding Method for Review-based Recommender Systems

Published:21 October 2023Publication History

ABSTRACT

Reviews are valuable resources that have been widely researched and used to improve the quality of recommendation services. Recent methods use multiple full embedding layers to model various levels of individual preferences, increasing the risk of the data sparsity issue. Although it is a potential way to deal with this issue that models homophily among users who have similar behaviors, the existing approaches are implemented in a coarse-grained way. They calculate user similarities by considering the homophily in their global behaviors but ignore their local behaviors under a specific context. In this paper, we propose a two-tier shared embedding model (TSE), which fuses coarse- and fine-grained ways of modeling homophily. It considers global behaviors to model homophily in a coarse-grained way, and the high-level feature in the process of each user-item interaction to model homophily in a fine-grained way. TSE designs a whole-to-part principle-based process to fuse these ways in the review-based recommendation. Experiments on five real-world datasets demonstrate that TSE significantly outperforms state-of-the-art models. It outperforms the best baseline by 20.50% on the root-mean-square error (RMSE) and 23.96% on the mean absolute error (MAE), respectively. The source code is available at https://github.com/dianziliu/TSE.git.

References

  1. Ali A. Amer, Hassan Ismail Abdalla, and Loc Nguyen. 2021. Enhancing recommendation systems performance using highly-effective similarity measures. Knowl. Based Syst., Vol. 217 (2021), 106842. https://doi.org/10.1016/j.knosys.2021.106842Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Jiajun Bu, Xin Shen, Bin Xu, Chun Chen, Xiaofei He, and Deng Cai. 2016. Improving Collaborative Recommendation via User-Item Subgroups. IEEE Trans. Knowl. Data Eng., Vol. 28, 9 (2016), 2363--2375. https://doi.org/10.1109/TKDE.2016.2566622Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Deng Cai, Xiaofei He, Jiawei Han, and Thomas S. Huang. 2011. Graph Regularized Nonnegative Matrix Factorization for Data Representation. IEEE Trans. Pattern Anal. Mach. Intell., Vol. 33, 8 (2011), 1548--1560. https://doi.org/10.1109/TPAMI.2010.231Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Rose Catherine and William W. Cohen. 2017. TransNets: Learning to Transform for Recommendation. In Proceedings of the Eleventh ACM Conference on Recommender Systems, RecSys 2017, Como, Italy, August 27--31, 2017, Paolo Cremonesi, Francesco Ricci, Shlomo Berkovsky, and Alexander Tuzhilin (Eds.). ACM, 288--296. https://doi.org/10.1145/3109859.3109878Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Chong Chen, Min Zhang, Yiqun Liu, and Shaoping Ma. 2018. Neural attentional rating regression with review-level explanations. In Proceedings of the 2018 World Wide Web Conference. 1583--1592.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Hongqi Chen, Zhiyong Feng, Shizhan Chen, Xiao Xue, Hongyue Wu, Yingchao Sun, Yanwei Xu, and Gaoyong Han. 2022. Capturing Users' Fresh Interests via Evolving Session-Based Social Recommendation. In IEEE International Conference on Web Services, ICWS 2022, Barcelona, Spain, July 10--16, 2022, Claudio Agostino Ardagna, Nimanthi L. Atukorala, Boualem Benatallah, Athman Bouguettaya, Fabio Casati, Carl K. Chang, Rong N. Chang, Ernesto Damiani, Chirine Ghedira Guegan, Robert Ward, Fatos Xhafa, Xiaofei Xu, and Jia Zhang (Eds.). IEEE, 182--187. https://doi.org/10.1109/ICWS55610.2022.00039Google ScholarGoogle ScholarCross RefCross Ref
  7. Jiawei Chen, Hande Dong, Xiang Wang, Fuli Feng, Meng Wang, and Xiangnan He. 2020. Bias and debias in recommender system: A survey and future directions. arXiv preprint arXiv:2010.03240 (2020).Google ScholarGoogle Scholar
  8. Jiangzhou Deng, Junpeng Guo, and Yong Wang. 2019. A Novel K-medoids clustering recommendation algorithm based on probability distribution for collaborative filtering. Knowl. Based Syst., Vol. 175 (2019), 96--106. https://doi.org/10.1016/j.knosys.2019.03.009Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Achraf Gazdar and Lotfi Hidri. 2020. A new similarity measure for collaborative filtering based recommender systems. Knowl. Based Syst., Vol. 188 (2020). https://doi.org/10.1016/j.knosys.2019.105058Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Guibing Guo, Jie Zhang, and Neil Yorke-Smith. 2013. A Novel Bayesian Similarity Measure for Recommender Systems. In IJCAI 2013, Proceedings of the 23rd International Joint Conference on Artificial Intelligence, Beijing, China, August 3--9, 2013, Francesca Rossi (Ed.). IJCAI/AAAI, 2619--2625. http://www.aaai.org/ocs/index.php/IJCAI/IJCAI13/paper/view/6615Google ScholarGoogle Scholar
  11. Guibing Guo, Jie Zhang, and Neil Yorke-Smith. 2015. Leveraging multiviews of trust and similarity to enhance clustering-based recommender systems. Knowl. Based Syst., Vol. 74 (2015), 14--27. https://doi.org/10.1016/j.knosys.2014.10.016Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Lei Guo, Hongzhi Yin, Tong Chen, Xiangliang Zhang, and Kai Zheng. 2022. Hierarchical Hyperedge Embedding-Based Representation Learning for Group Recommendation. ACM Trans. Inf. Syst., Vol. 40, 1 (2022), 3:1--3:27. https://doi.org/10.1145/3457949Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Siyuan Guo, Ying Wang, Hao Yuan, Zeyu Huang, Jianwei Chen, and Xin Wang. 2021. TAERT: Triple-Attentional Explainable Recommendation with Temporal Convolutional Network. Inf. Sci., Vol. 567 (2021), 185--200. https://doi.org/10.1016/j.ins.2021.03.034Google ScholarGoogle Scholar
  14. Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural Collaborative Filtering. In Proceedings of the 26th International Conference on World Wide Web. 173--182.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Liang Hu, Jian Cao, Guandong Xu, Longbing Cao, Zhiping Gu, and Wei Cao. 2014. Deep Modeling of Group Preferences for Group-Based Recommendation. In Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, July 27 -31, 2014, Qué bec City, Qué bec, Canada, Carla E. Brodley and Peter Stone (Eds.). AAAI Press, 1861--1867. http://www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/view/8458Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Chunli Huang, Wenjun Jiang, Jie Wu, and Guojun Wang. 2020. Personalized Review Recommendation based on Users' Aspect Sentiment. ACM Trans. Internet Techn., Vol. 20, 4 (2020), 42:1--42:26. https://doi.org/10.1145/3414841Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Wang-Cheng Kang, Derek Zhiyuan Cheng, Tiansheng Yao, Xinyang Yi, Ting Chen, Lichan Hong, and Ed H. Chi. 2021. Learning to Embed Categorical Features without Embedding Tables for Recommendation. In KDD '21: The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Virtual Event, Singapore, August 14--18, 2021, Feida Zhu, Beng Chin Ooi, and Chunyan Miao (Eds.). ACM, 840--850. https://doi.org/10.1145/3447548.3467304Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Ondrej Kassá k, Michal Kompan, and Má ria Bieliková. 2016. Personalized hybrid recommendation for group of users: Top-N multimedia recommender. Inf. Process. Manag., Vol. 52, 3 (2016), 459--477. https://doi.org/10.1016/j.ipm.2015.10.001Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Donghyun Kim, Chanyoung Park, Jinoh Oh, Sungyoung Lee, and Hwanjo Yu. 2016. Convolutional matrix factorization for document context-aware recommendation. In Proceedings of the 10th ACM conference on recommender systems. 233--240.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Chin-Hui Lai and Chia-Yu Hsu. 2021. Rating prediction based on combination of review mining and user preference analysis. Information Systems, Vol. 99 (2021), 101742.Google ScholarGoogle ScholarCross RefCross Ref
  21. Chao Li, Zhiyuan Liu, Mengmeng Wu, Yuchi Xu, Huan Zhao, Pipei Huang, Guoliang Kang, Qiwei Chen, Wei Li, and Dik Lun Lee. 2019a. Multi-Interest Network with Dynamic Routing for Recommendation at Tmall. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management, CIKM 2019, Beijing, China, November 3--7, 2019, Wenwu Zhu, Dacheng Tao, Xueqi Cheng, Peng Cui, Elke A. Rundensteiner, David Carmel, Qi He, and Jeffrey Xu Yu (Eds.). ACM, 2615--2623. https://doi.org/10.1145/3357384.3357814Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Chenliang Li, Cong Quan, Li Peng, Yunwei Qi, Yuming Deng, and Libing Wu. 2019b. A Capsule Network for Recommendation and Explaining What You Like and Dislike. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, Paris, France, July 21--25, 2019, Benjamin Piwowarski, Max Chevalier, É ric Gaussier, Yoelle Maarek, Jian-Yun Nie, and Falk Scholer (Eds.). ACM, 275--284. https://doi.org/10.1145/3331184.3331216Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Man Li, Luosheng Wen, and Feiyu Chen. 2021. A novel Collaborative Filtering recommendation approach based on Soft Co-Clustering. Physica A: Statistical Mechanics and its Applications, Vol. 561 (2021), 125140.Google ScholarGoogle Scholar
  24. Donghua Liu, Jing Li, Bo Du, Jun Chang, and Rong Gao. 2019. Daml: Dual attention mutual learning between ratings and reviews for item recommendation. In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. 344--352.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Hongtao Liu, Wenjun Wang, Qiyao Peng, Nannan Wu, Fangzhao Wu, and Pengfei Jiao. 2021a. Toward Comprehensive User and Item Representations via Three-tier Attention Network. ACM Trans. Inf. Syst., Vol. 39, 3 (2021), 25:1--25:22. https://doi.org/10.1145/3446341Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Hongtao Liu, Wenjun Wang, Hongyan Xu, Qiyao Peng, and Pengfei Jiao. 2020. Neural Unified Review Recommendation with Cross Attention. In Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25--30, 2020, Jimmy Huang, Yi Chang, Xueqi Cheng, Jaap Kamps, Vanessa Murdock, Ji-Rong Wen, and Yiqun Liu (Eds.). ACM, 1789--1792. https://doi.org/10.1145/3397271.3401249Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Tongcun Liu, Siyuan Lou, Jianxin Liao, and Hailin Feng. 2022. Dynamic and Static Representation Learning Network for Recommendation. IEEE Transactions on Neural Networks and Learning Systems (2022), 1--11. https://doi.org/10.1109/TNNLS.2022.3177611Google ScholarGoogle ScholarCross RefCross Ref
  28. Yong Liu, Susen Yang, Yinan Zhang, Chunyan Miao, Zaiqing Nie, and Juyong Zhang. 2021b. Learning hierarchical review graph representations for recommendation. IEEE Transactions on Knowledge and Data Engineering (2021).Google ScholarGoogle ScholarCross RefCross Ref
  29. Giseop Noh, Hayoung Oh, and Jaehoon Lee. 2018. Power users are not always powerful: The effect of social trust clusters in recommender systems. Inf. Sci., Vol. 462 (2018), 1--15. https://doi.org/10.1016/j.ins.2018.05.058Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Yoon-Joo Park. 2013. The Adaptive Clustering Method for the Long Tail Problem of Recommender Systems. IEEE Trans. Knowl. Data Eng., Vol. 25, 8 (2013), 1904--1915. https://doi.org/10.1109/TKDE.2012.119Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Yoon-Joo Park and Alexander Tuzhilin. 2008. The long tail of recommender systems and how to leverage it. In Proceedings of the 2008 ACM Conference on Recommender Systems, RecSys 2008, Lausanne, Switzerland, October 23--25, 2008, Pearl Pu, Derek G. Bridge, Bamshad Mobasher, and Francesco Ricci (Eds.). ACM, 11--18. https://doi.org/10.1145/1454008.1454012Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 1532--1543.Google ScholarGoogle ScholarCross RefCross Ref
  33. Ruslan Salakhutdinov and Andriy Mnih. 2007. Probabilistic Matrix Factorization. In Advances in Neural Information Processing Systems 20, Proceedings of the Twenty-First Annual Conference on Neural Information Processing Systems, Vancouver, British Columbia, Canada, December 3--6, 2007, John C. Platt, Daphne Koller, Yoram Singer, and Sam T. Roweis (Eds.). Curran Associates, Inc., 1257--1264. https://proceedings.neurips.cc/paper/2007/hash/d7322ed717dedf1eb4e6e52a37ea7bcd-Abstract.htmlGoogle ScholarGoogle Scholar
  34. Sungyong Seo, Jing Huang, Hao Yang, and Yan Liu. 2017. Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In Proceedings of the eleventh ACM conference on recommender systems. 297--305.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Leily Sheugh and Sasan Hossein Alizadeh. 2018. A novel 2D-Graph clustering method based on trust and similarity measures to enhance accuracy and coverage in recommender systems. Inf. Sci., Vol. 432 (2018), 210--230. https://doi.org/10.1016/j.ins.2017.12.007Google ScholarGoogle ScholarCross RefCross Ref
  36. Liye Shi, Wen Wu, Wang Guo, Wenxin Hu, Jiayi Chen, Wei Zheng, and Liang He. 2022. SENGR: Sentiment-Enhanced Neural Graph Recommender. Inf. Sci., Vol. 589 (2022), 655--669. https://doi.org/10.1016/j.ins.2021.12.120Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Jiliang Tang, Huiji Gao, Xia Hu, and Huan Liu. 2013. Exploiting homophily effect for trust prediction. In Sixth ACM International Conference on Web Search and Data Mining, WSDM 2013, Rome, Italy, February 4--8, 2013, Stefano Leonardi, Alessandro Panconesi, Paolo Ferragina, and Aristides Gionis (Eds.). ACM, 53--62. https://doi.org/10.1145/2433396.2433405Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Hao Tian, Can Gao, Xinyan Xiao, Hao Liu, Bolei He, Hua Wu, Haifeng Wang, and Feng Wu. 2020. SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Online, July 5--10, 2020, Dan Jurafsky, Joyce Chai, Natalie Schluter, and Joel R. Tetreault (Eds.). Association for Computational Linguistics, 4067--4076. https://doi.org/10.18653/v1/2020.acl-main.374Google ScholarGoogle ScholarCross RefCross Ref
  39. Lyle H Ungar and Dean P Foster. 1998. Clustering methods for collaborative filtering. In AAAI workshop on recommendation systems, Vol. 1. Menlo Park, CA, 114--129.Google ScholarGoogle Scholar
  40. Chong Wang and David M Blei. 2011. Collaborative topic modeling for recommending scientific articles. In Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining. 448--456.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Hao Wang, Naiyan Wang, and Dit-Yan Yeung. 2015. Collaborative deep learning for recommender systems. In Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining. 1235--1244.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Xiang Wang, Tinglin Huang, Dingxian Wang, Yancheng Yuan, Zhenguang Liu, Xiangnan He, and Tat-Seng Chua. 2021. Learning Intents behind Interactions with Knowledge Graph for Recommendation. In WWW '21: The Web Conference 2021, Virtual Event / Ljubljana, Slovenia, April 19--23, 2021, Jure Leskovec, Marko Grobelnik, Marc Najork, Jie Tang, and Leila Zia (Eds.). ACM / IW3C2, 878--887. https://doi.org/10.1145/3442381.3450133Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Zhen Wang, Chang-Ai Sun, and Marco Aiello. 2022. Context-aware IoT Service Recommendation: A Deep Collaborative Filtering-based Approach. In IEEE International Conference on Web Services, ICWS 2022, Barcelona, Spain, July 10--16, 2022, Claudio Agostino Ardagna, Nimanthi L. Atukorala, Boualem Benatallah, Athman Bouguettaya, Fabio Casati, Carl K. Chang, Rong N. Chang, Ernesto Damiani, Chirine Ghedira Guegan, Robert Ward, Fatos Xhafa, Xiaofei Xu, and Jia Zhang (Eds.). IEEE, 150--159. https://doi.org/10.1109/ICWS55610.2022.00035Google ScholarGoogle Scholar
  44. Jiahui Wen, Jingwei Ma, Hongkui Tu, Mingyang Zhong, Guangda Zhang, Wei Yin, and Jian Fang. 2020. Hierarchical text interaction for rating prediction. Knowledge-Based Systems, Vol. 206 (2020), 106344.Google ScholarGoogle ScholarCross RefCross Ref
  45. Libing Wu, Cong Quan, Chenliang Li, Qian Wang, Bolong Zheng, and Xiangyang Luo. 2019. A context-aware user-item representation learning for item recommendation. ACM Transactions on Information Systems (TOIS), Vol. 37, 2 (2019), 1--29.Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Shiwen Wu, Yuanxing Zhang, Wentao Zhang, Kaigui Bian, and Bin Cui. 2021. Enhanced review-based rating prediction by exploiting aside information and user influence. Knowledge-Based Systems (2021), 107015.Google ScholarGoogle Scholar
  47. Bin Xu, Jiajun Bu, Chun Chen, and Deng Cai. 2012. An exploration of improving collaborative recommender systems via user-item subgroups. In Proceedings of the 21st World Wide Web Conference 2012, WWW 2012, Lyon, France, April 16--20, 2012, Alain Mille, Fabien Gandon, Jacques Misselis, Michael Rabinovich, and Steffen Staab (Eds.). ACM, 21--30. https://doi.org/10.1145/2187836.2187840Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Yuanbo Xu, Yongjian Yang, Jiayu Han, En Wang, Fuzhen Zhuang, Jingyuan Yang, and Hui Xiong. 2019. NeuO: Exploiting the sentimental bias between ratings and reviews with neural networks. Neural Networks, Vol. 111 (2019), 77--88.Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Hongzhi Yin, Qinyong Wang, Kai Zheng, Zhixu Li, and Xiaofang Zhou. 2022. Overcoming Data Sparsity in Group Recommendation. IEEE Trans. Knowl. Data Eng., Vol. 34, 7 (2022), 3447--3460. https://doi.org/10.1109/TKDE.2020.3023787Google ScholarGoogle Scholar
  50. Lei Zheng, Vahid Noroozi, and Philip S Yu. 2017. Joint deep modeling of users and items using reviews for recommendation. In Proceedings of the tenth ACM international conference on web search and data mining. 425--434.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. A Two-tier Shared Embedding Method for Review-based Recommender Systems

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Article Metrics

          • Downloads (Last 12 months)288
          • Downloads (Last 6 weeks)50

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader