Abstract
User interests are diverse and change over time. Existing news recommendation models often do not consider the relationship and temporal changes between browsing news when modeling user characteristics. In addition, the wide range of user interests makes it difficult to match candidate news to users’ interests precisely. This paper proposes a news recommendation model based on the candidate-aware time series self-attention mechanism(CATM). The method incorporates candidate news into user modeling based on considering the temporal relationship of news sequences browsed by users, effectively improving news recommendation performance. In addition, to obtain more rich semantic news information, we design a granular network to obtain more fine-grained segment features of news. Finally, we also designed a candidate-aware attention network to build candidate-aware user interest representations further to better match candidate news with user interests. Extensive experiments on the MIND dataset demonstrate that our method can effectively improve news recommendation performance.
This work was supported in part by Shandong Province Key R &D Program (Major Science and Technology Innovation Project) Project under Grants 2020CXGC010102 and the National Key Research and Development Plan under Grant No. 2019YFB1404701.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Guo, H., Tang, R., Ye, Y., Li, Z., He, X.: DeepFM: a factorization-machine based neural network for CTR prediction. In: IJCAI (2017)
Hu, L., Li, C., Shi, C., Yang, C., Shao, C.: Graph neural news recommendation with long-term and short-term interest modeling. Inf. Process. Manage. 57(2), 102142 (2020)
Huang, J., Han, Z., Xu, H., Liu, H.: Adapted transformer network for news recommendation. Neurocomputing 469, 119–129 (2022)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: ICLR (2014)
Qi, T., Wu, F., Wu, C., Huang, Y.: News recommendation with candidate-aware user modeling. In: SIGIR (2022)
Qi, T., et al.: HieRec: hierarchical user interest modeling for personalized news recommendation. In: ACL (2021)
Rendle, S.: Factorization machines with libFM. ACM Trans.Intell. Syst. Techno. (TIST) 3(3), 1–22 (2012)
Wang, H., Wu, F., Liu, Z., Xie, X.: Fine-grained interest matching for neural news recommendation. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 836–845 (2020)
Wang, H., Zhang, F., Xie, X., Guo, M.: DKN: deep knowledge-aware network for news recommendation. In: Proceedings of the 2018 World Wide Web Conference, pp. 1835–1844 (2018)
Wang, R., Lu, W., Wang, S., Peng, X., Wu, H., Zhang, Q.: Aspect-driven user preference and news representation learning for news recommendation. IEEE Trans. Intell. Transp. Syst. 23, 25297–25307 (2022). https://doi.org/10.1109/TITS.2022.3182568
Wu, C., Wu, F., An, M., Huang, J., Huang, Y., Xie, X.: Neural news recommendation with attentive multi-view learning. In: IJCAI, pp. 3863–3869 (2019)
Wu, C., Wu, F., An, M., Huang, J., Huang, Y., Xie, X.: NPA: neural news recommendation with personalized attention. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 2576–2584 (2019)
Wu, C., Wu, F., Ge, S., Qi, T., Huang, Y., Xie, X.: Neural news recommendation with multi-head self-attention. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 6389–6394 (2019)
Wu, C., Wu, F., Huang, Y., Xie, X.: Neural news recommendation with negative feedback. CCF Trans. Pervasive Comput. Interaction 2(3), 178–188 (2020). https://doi.org/10.1007/s42486-020-00044-0
Wu, F., et al.: Mind: a large-scale dataset for news recommendation. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3597–3606 (2020)
Xie, S., Girshick, R., Dollár, P., Tu, Z., He, K.: Aggregated residual transformations for deep neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1492–1500 (2017)
Zhou, P., et al.: Attention-based bidirectional long short-term memory networks for relation classification. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (volume 2: Short papers), pp. 207–212 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Cui, L., Yang, Z., Wang, Y., Ma, K., Li, Y. (2023). CATM: Candidate-Aware Temporal Multi-head Self-attention News Recommendation Model. In: Tanveer, M., Agarwal, S., Ozawa, S., Ekbal, A., Jatowt, A. (eds) Neural Information Processing. ICONIP 2022. Communications in Computer and Information Science, vol 1793. Springer, Singapore. https://doi.org/10.1007/978-981-99-1645-0_56
Download citation
DOI: https://doi.org/10.1007/978-981-99-1645-0_56
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-1644-3
Online ISBN: 978-981-99-1645-0
eBook Packages: Computer ScienceComputer Science (R0)