skip to main content
10.1145/3539618.3591627acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

A Preference Learning Decoupling Framework for User Cold-Start Recommendation

Published:18 July 2023Publication History

ABSTRACT

The issue of user cold-start poses a long-standing challenge to recommendation systems, due to the scarce interactions of new users. Recently, meta-learning based studies treat each cold-start user as a user-specific few-shot task and then derive meta-knowledge about fast model adaptation across training users. However, existing solutions mostly do not clearly distinguish the concept of new users and the concept of novel preferences, leading to over-reliance on meta-learning based adaptability to novel patterns. In addition, we also argue that the existing meta-training task construction inherently suffers from the memorization overfitting issue, which inevitably hinders meta-generalization to new users. In response to the aforementioned issues, we propose a preference learning decoupling framework, which is enhanced with meta-augmentation (PDMA), for user cold-start recommendation. To rescue the meta-learning from unnecessary adaptation to common patterns, our framework decouples preference learning for a cold-start user into two complementary aspects: common preference transfer, and novel preference adaptation. To handle the memorization overfitting issue, we further propose to augment meta-training users by injecting attribute-based noises, to achieve mutually-exclusive tasks. Extensive experiments on benchmark datasets demonstrate that our framework achieves superior performance improvements against state-of-the-art methods. We also show that our proposed framework is effective in alleviating memorization overfitting.

References

  1. Homanga Bharadhwaj. 2019. Meta-learning for user cold-start recommendation. In Proceedings of IJCNN. IEEE, 1--8.Google ScholarGoogle ScholarCross RefCross Ref
  2. Manqing Dong, Feng Yuan, Lina Yao, Xiwei Xu, and Liming Zhu. 2020. Mamo: Memory-augmented meta-optimization for cold-start recommendation. In Proceedings of KDD. 688--697.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Zhengxiao Du, Xiaowei Wang, Hongxia Yang, Jingren Zhou, and Jie Tang. 2019. Sequential scenario-specific meta learner for online recommendation. In Proceedings of KDD. 2895--2904.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Xidong Feng, Chen Chen, Dong Li, Mengchen Zhao, Jianye Hao, and Jun Wang. 2021. CMML: Contextual Modulation Meta Learning for Cold-Start Recommendation. In Proceedings of CIKM. 484--493.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017. Model-agnostic meta-learning for fast adaptation of deep networks. In Proceedings of ICML. PMLR, 1126--1135.Google ScholarGoogle Scholar
  6. Zeno Gantner, Lucas Drumond, Christoph Freudenthaler, Steffen Rendle, and Lars Schmidt-Thieme. 2010. Learning attribute-to-feature mappings for cold-start recommendations. In Proceedings of ICDM. IEEE, 176--185.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Li Gao, Hong Yang, Jia Wu, Chuan Zhou, Weixue Lu, and Yue Hu. 2018. Recommendation with multi-source heterogeneous information. In Proceedings of IJCAI.Google ScholarGoogle ScholarCross RefCross Ref
  8. Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of WWW. 173--182.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Timothy Hospedales, Antreas Antoniou, Paul Micaelli, and Amos Storkey. 2021. Meta-learning in neural networks: A survey. IEEE transactions on pattern analysis and machine intelligence, Vol. 44, 9 (2021), 5149--5169.Google ScholarGoogle Scholar
  10. Guangneng Hu, Yu Zhang, and Qiang Yang. 2018. Conet: Collaborative cross networks for cross-domain recommendation. In Proceedings of CIKM. 667--676.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Wang-Cheng Kang and Julian McAuley. 2018. Self-attentive sequential recommendation. In Proceedings of ICDM. IEEE, 197--206.Google ScholarGoogle ScholarCross RefCross Ref
  12. Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of ICLR.Google ScholarGoogle Scholar
  13. Hoyeop Lee, Jinbae Im, Seongwon Jang, Hyunsouk Cho, and Sehee Chung. 2019. Melu: Meta-learned user preference estimator for cold-start recommendation. In Proceedings of KDD. 1073--1082.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Jingjing Li, Ke Lu, Zi Huang, and Heng Tao Shen. 2019. On both cold-start and long-tail recommendation with social data. IEEE Transactions on Knowledge and Data Engineering (TKDE), Vol. 33, 1 (2019), 194--208.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Pan Li and Alexander Tuzhilin. 2020. Ddtcdr: Deep dual transfer cross domain recommendation. In Proceedings of WSDM. 331--339.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Xixun Lin, Jia Wu, Chuan Zhou, Shirui Pan, Yanan Cao, and Bin Wang. 2021. Task-adaptive Neural Process for User Cold-Start Recommendation. In Proceedings of WWW. 1306--1316.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Siwei Liu, Iadh Ounis, Craig Macdonald, and Zaiqiao Meng. 2020b. A heterogeneous graph neural model for cold-start recommendation. In Proceedings of SIGIR. 2029--2032.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Zhaoyang Liu, Haokun Chen, Fei Sun, Xu Xie, Jinyang Gao, Bolin Ding, and Yanyan Shen. 2020a. Intent Preference Decoupling for User Representation on Online Recommender System.. In Proceedings of IJCAI. 2575--2582.Google ScholarGoogle ScholarCross RefCross Ref
  19. Yuanfu Lu, Yuan Fang, and Chuan Shi. 2020. Meta-learning on heterogeneous information networks for cold-start recommendation. In Proceedings of KDD. 1563--1573.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Nikhil Mishra, Mostafa Rohaninejad, Xi Chen, and Pieter Abbeel. 2018. A Simple Neural Attentive Meta-Learner. In Proceedings of ICLR.Google ScholarGoogle Scholar
  21. Tsendsuren Munkhdalai and Hong Yu. 2017. Meta networks. In Proceedings of ICML. PMLR, 2554--2563.Google ScholarGoogle Scholar
  22. Renkun Ni, Micah Goldblum, Amr Sharaf, Kezhi Kong, and Tom Goldstein. 2021. Data augmentation for meta-learning. In Proceedings of ICML. PMLR, 8152--8161.Google ScholarGoogle Scholar
  23. Feiyang Pan, Shuokai Li, Xiang Ao, Pingzhong Tang, and Qing He. 2019. Warm up cold-start advertisements: Improving ctr predictions via learning to learn id embeddings. In Proceedings of SIGIR. 695--704.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Haoyu Pang, Fausto Giunchiglia, Ximing Li, Renchu Guan, and Xiaoyue Feng. 2022. Pnmta: A pretrained network modulation and task adaptation approach for user cold-start recommendation. In Proceedings of the ACM Web Conference 2022. 348--359.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Sujoy Roy and Sharath Chandra Guntuku. 2016. Latent factor representations for cold-start video recommendation. In Proceedings of RecSys. 99--106.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Suvash Sedhain, Aditya Krishna Menon, Scott Sanner, and Lexing Xie. 2015. Autorec: Autoencoders meet collaborative filtering. In Proceedings of WWW. 111--112.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Suvash Sedhain, Scott Sanner, Darius Braziunas, Lexing Xie, and Jordan Christensen. 2014. Social collaborative filtering for cold-start recommendations. In Proceedings of Recsys. 345--348.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Chuan Shi, Binbin Hu, Wayne Xin Zhao, and S Yu Philip. 2018. Heterogeneous information network embedding for recommendation. IEEE Transactions on Knowledge and Data Engineering (TKDE), Vol. 31, 2 (2018), 357--370.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Fei Sun, Jun Liu, Jian Wu, Changhua Pei, Xiao Lin, Wenwu Ou, and Peng Jiang. 2019. BERT4Rec: Sequential recommendation with bidirectional encoder representations from transformer. In Proceedings of CIKM. 1441--1450.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Xuehan Sun, Tianyao Shi, Xiaofeng Gao, Yanrong Kang, and Guihai Chen. 2021. FORM: Follow the Online Regularized Meta-Leader for Cold-Start Recommendation. In Proceedings of SIGIR. 1177--1186.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2018. Graph Attention Networks. In Proceedings of ICLR.Google ScholarGoogle Scholar
  32. Maksims Volkovs, Guangwei Yu, and Tomi Poutanen. 2017. Dropoutnet: Addressing cold start in recommender systems. Proceedings of NeurIPS, Vol. 30 (2017).Google ScholarGoogle Scholar
  33. Chunyang Wang, Yanmin Zhu, Haobing Liu, Tianzi Zang, Jiadi Yu, and Feilong Tang. 2022. Deep Meta-learning in Recommendation Systems: A Survey. arXiv preprint arXiv:2206.04415 (2022).Google ScholarGoogle Scholar
  34. Hongwei Wang, Fuzheng Zhang, Jialin Wang, Miao Zhao, Wenjie Li, Xing Xie, and Minyi Guo. 2018. Ripplenet: Propagating user preferences on the knowledge graph for recommender systems. In Proceedings of CIKM. 417--426.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Hongwei Wang, Fuzheng Zhang, Mengdi Zhang, Jure Leskovec, Miao Zhao, Wenjie Li, and Zhongyuan Wang. 2019c. Knowledge-aware graph neural networks with label smoothness regularization for recommender systems. In Proceedings of KDD. 968--977.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Li Wang, Binbin Jin, Zhenya Huang, Hongke Zhao, Defu Lian, Qi Liu, and Enhong Chen. 2021. Preference-adaptive meta-learning for cold-start recommendation. In Proceedings of IJCAI. 1607--1614.Google ScholarGoogle ScholarCross RefCross Ref
  37. Xiang Wang, Xiangnan He, Yixin Cao, Meng Liu, and Tat-Seng Chua. 2019a. Kgat: Knowledge graph attention network for recommendation. In Proceedings of KDD. 950--958.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Xiao Wang, Houye Ji, Chuan Shi, Bai Wang, Yanfang Ye, Peng Cui, and Philip S Yu. 2019b. Heterogeneous graph attention network. In Proceedings of WWW. 2022--2032.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Huaxiu Yao, Long-Kai Huang, Linjun Zhang, Ying Wei, Li Tian, James Zou, Junzhou Huang, et al. 2021. Improving generalization in meta-learning via task augmentation. In Proceedings of ICML. PMLR, 11887--11897.Google ScholarGoogle Scholar
  40. Huaxiu Yao, Ying Wei, Junzhou Huang, and Zhenhui Li. 2019a. Hierarchically structured meta-learning. In Proceedings of ICML. PMLR, 7045--7054.Google ScholarGoogle Scholar
  41. Huaxiu Yao, Xian Wu, Zhiqiang Tao, Yaliang Li, Bolin Ding, Ruirui Li, and Zhenhui Li. 2019b. Automated Relational Meta-learning. In Proceedings of ICLR.Google ScholarGoogle Scholar
  42. Mingzhang Yin, George Tucker, Mingyuan Zhou, Sergey Levine, and Chelsea Finn. [n. d.]. Meta-Learning without Memorization. In Proceedings of ICLR.Google ScholarGoogle Scholar
  43. Runsheng Yu, Yu Gong, Xu He, Yu Zhu, Qingwen Liu, Wenwu Ou, and Bo An. 2021. Personalized Adaptive Meta Learning for Cold-start User Preference Prediction. In Proceedings of AAAI, Vol. 35. 10772--10780.Google ScholarGoogle ScholarCross RefCross Ref
  44. Yan Zhang, Changyu Li, Ivor W Tsang, Hui Xu, Lixin Duan, Hongzhi Yin, Wen Li, and Jie Shao. 2022. Diverse Preference Augmentation with Multiple Domains for Cold-start Recommendations. In ICDE. IEEE, 2942--2955.Google ScholarGoogle Scholar
  45. Cheng Zhao, Chenliang Li, Rong Xiao, Hongbo Deng, and Aixin Sun. 2020. CATN: Cross-domain recommendation for cold-start users via aspect transfer network. In Proceedings of SIGIR. 229--238.Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Yongchun Zhu, Ruobing Xie, Fuzhen Zhuang, Kaikai Ge, Ying Sun, Xu Zhang, Leyu Lin, and Juan Cao. 2021. Learning to Warm Up Cold Item Embeddings for Cold-start Recommendation with Meta Scaling and Shifting Networks. In Proceedings of SIGIR. 1167--1176.Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Ziwei Zhu, Shahin Sefati, Parsa Saadatpanah, and James Caverlee. 2020. Recommendation for new users and new items via randomized training and mixture-of-experts transformation. In Proceedings of SIGIR. 1121--1130.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. A Preference Learning Decoupling Framework for User Cold-Start Recommendation

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      SIGIR '23: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
      July 2023
      3567 pages
      ISBN:9781450394086
      DOI:10.1145/3539618

      Copyright © 2023 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 18 July 2023

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate792of3,983submissions,20%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader