Abstract
With the ever-increasing dataset size and data storage capacity, there is a strong need to build systems that can effectively utilize these vast datasets to extract valuable information. Large datasets often exhibit sparsity and pose cold start problems, necessitating the development of responsible recommender systems. Knowledge graphs have utility in responsibly representing information related to recommendation scenarios. However, many studies overlook explicitly encoding contextual information, which is crucial for reducing the bias of multi-layer propagation. Additionally, existing methods stack multiple layers to encode high-order neighbor information, while disregarding the relational information between items and entities. This oversight hampers their ability to capture the collaborative signal latent in user-item interactions. This is particularly important in health informatics, where knowledge graphs consist of various entities connected to items through different relations. Ignoring the relational information renders them insufficient for modeling user preferences. This work presents an end-to-end recommendation framework named Knowledge Graph Enhanced Contextualized Attention-Based Network (KGCAN). It explicitly encodes both relational and contextual information of entities to preserve the original entity information. Furthermore, a user-specific attention mechanism is employed to capture personalized recommendations. The proposed model is validated on three benchmark datasets through extensive experiments. The experimental results demonstrate that KGCAN outperforms existing KG-based recommendation models. Additionally, a case study from the healthcare domain is discussed, highlighting the importance of attention mechanisms and high-order connectivity in the responsible recommendation system for health informatics.
- C. Yin, J. Wang, and J. H. Park, “An improved recommendation algorithm for big data cloud service based on the trust in sociology,” Neurocomputing, vol. 256, pp. 49–55, 2017, doi: https://doi.org/10.1016/j.neucom.2016.07.079.Google Scholar
Digital Library
- Y. Koren, R. Bell, and C. Volinsky, “Matrix factorization techniques for recommender systems,” IEEE Comput., vol. 42, no. 8, pp. 30–37, 2009.Google ScholarDigital Library
- M. Jamali and M. Ester, “A Matrix Factorization Technique with Trust Propagation for Recommendation in Social Networks,” Proc. fourth ACM Conf. Recomm. Syst. - RecSys ’10, doi: 10.1145/1864708.Google ScholarDigital Library
- X. He, L. Liao, H. Zhang, L. Nie, … X. H.-P. of the 26th, and undefined 2017, “Neural collaborative filtering,” dl.acm.org, pp. 173–182, 2017, doi: 10.1145/3038912.3052569.Google ScholarDigital Library
- Y. Tay, L. Anh Tuan, and S. C. Hui, “Latent relational metric learning via memory-based attention for collaborative ranking,” in Proceedings of the 2018 World Wide Web Conference, 2018, pp. 729–739.Google ScholarDigital Library
- H. Wang et al., “RippleNet: Propagating user preferences on the knowledge graph for recommender systems,” in International Conference on Information and Knowledge Management, Proceedings, Oct. 2018, pp. 417–426. doi: 10.1145/3269206.3271739.Google ScholarDigital Library
- Y. Cao, X. Wang, X. He, Z. Hu, and T. S. Chua, “Unifying knowledge graph learning and recommendation: Towards a better understanding of user preferences,” Web Conf. 2019 - Proc. World Wide Web Conf. WWW 2019, pp. 151–161, May 2019, doi: 10.1145/3308558.3313705.Google ScholarDigital Library
- Z. Sun, J. Yang, J. Zhang, A. Bozzon, L.-K. Huang, and C. Xu, “Recurrent Knowledge Graph Embedding for Effective Recommendation,” Proc. 12th ACM Conf. Recomm. Syst., 2018, doi: 10.1145/3240323.Google ScholarDigital Library
- B. Hu, C. Shi, W. X. Zhao, and P. S. Yu, “Leveraging meta-path based context for top-n recommendation with a neural co-attention model,” Proc. ACM SIGKDD Int. Conf. Knowl. Discov. Data Min., pp. 1531–1540, Jul. 2018, doi: 10.1145/3219819.3219965.Google ScholarDigital Library
- F. Zhang, N. J. Yuan, D. Lian, X. Xie, and W. Y. Ma, “Collaborative knowledge base embedding for recommender systems,” Proc. ACM SIGKDD Int. Conf. Knowl. Discov. Data Min., vol. 13-17-August-2016, pp. 353–362, Aug. 2016, doi: 10.1145/2939672.2939673.Google ScholarDigital Library
- R. Yin, K. Li, G. Zhang, and J. Lu, “A deeper graph neural network for recommender systems,” Knowledge-Based Syst., vol. 185, p. 105020, 2019.Google ScholarDigital Library
- A. M.-I. T. on N. Networks and undefined 2009, “Neural network for graphs: A contextual constructive approach,” ieeexplore.ieee.org, Accessed: Dec. 12, 2021. [Online]. Available: https://ieeexplore.ieee.org/abstract/document/4773279Google Scholar
- C. Hsu and C. Te Li, “RetaGNN: Relational temporal attentive graph neural networks for holistic sequential recommendation,” Web Conf. 2021 - Proc. World Wide Web Conf. WWW 2021, pp. 2968–2979, 2021, doi: 10.1145/3442381.3449957.Google ScholarDigital Library
- Z. Wang, G. Lin, H. Tan, Q. Chen, and X. Liu, “CKAN: Collaborative Knowledge-aware Attentive Network for Rec-ommender Systems,” in Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2020, pp. 219–228. doi: 10.1145/3397271.Google ScholarDigital Library
- X. Wang, X. He, Y. Cao, M. Liu, and T.-S. Chua, “KGAT: Knowledge Graph Attention Network for Recommendation,” in Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2019, pp. 950–958. doi: 10.1145/3292500.Google ScholarDigital Library
- J. Zhou et al., “Graph neural networks: A review of methods and applications,” AI Open, vol. 1, pp. 57–81, 2020.Google ScholarCross Ref
- T. N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” 2017.Google Scholar
- J. Bruna, W. Zaremba, A. Szlam, and Y. LeCun, “Spectral networks and locally connected networks on graphs,” 2014.Google Scholar
- M. Defferrard, X. Bresson, P. Vandergheynst, "Convolutional neural networks on graphs with fast localized spectral filtering," Advances in neural information processing systems, vol. 29, 2016.Google Scholar
- A. Micheli, “Neural network for graphs: A contextual constructive approach,” IEEE Trans. Neural Networks, vol. 20, no. 3, pp. 498–511, 2009, doi: 10.1109/TNN.2008.2010350.Google ScholarDigital Library
- W. L. Hamilton, R. Ying, and J. Leskovec, “Inductive representation learning on large graphs,” in Proceedings of the 31st International Conference on Neural Information Processing Systems, 2017, pp. 1025–1035.Google Scholar
- P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Lio, and Y. Bengio, “Graph attention networks,” 2018.Google Scholar
- X. He, K. Deng, X. Wang, Y. Li, Y. Zhang, and M. Wang, “LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation,” in SIGIR, 2020, pp. 639–648. doi: 10.1145/3397271.3401063.Google ScholarDigital Library
- F. Liu, Z. Cheng, L. Zhu, Z. Gao, and L. Nie, “Interest-aware message-passing GCN for recommendation,” in The Web Conference 2021 - Proceedings of the World Wide Web Conference, WWW 2021, 2021, pp. 1296–1305. doi: 10.1145/3442381.3449986.Google ScholarDigital Library
- H. Wang, F. Zhang, X. Xie, and M. Guo, “DKN: Deep knowledge-aware network for news recommendation,” Web Conf. 2018 - Proc. World Wide Web Conf. WWW 2018, vol. 2, pp. 1835–1844, 2018, doi: 10.1145/3178876.3186175.Google ScholarDigital Library
- H. Wang, M. Zhao, X. Xie, W. Li, and M. Guo, “Knowledge graph convolutional networks for recommender systems,” in The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019, May 2019, pp. 3307–3313. doi: 10.1145/3308558.3313417.Google ScholarDigital Library
- H. Wang et al., “Knowledge-aware Graph Neural Networks with Label Smoothness Regularization for Recommender Systems,” in Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2019, pp. 968–977. doi: 10.1145/3292500.Google ScholarDigital Library
- X. Yu et al., “Recommendation in Heterogeneous Information Networks with Implicit User Feedback *,” Proc. 7th ACM Conf. Recomm. Syst., doi: 10.1145/2507157.Google ScholarDigital Library
- Y. Dong, N. V. Chawla, and A. Swami, “Metapath2vec: Scalable representation learning for heterogeneous networks,” in Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2017, pp. 135–144. doi: 10.1145/3097983.3098036.Google ScholarDigital Library
- Y. Liu, S. Yang, Y. Xu, C. Miao, M. Wu, and J. Zhang, “Contextualized Graph Attention Network for Recommendation with Item Knowledge Graph,” IEEE Trans. Knowl. Data Eng., vol. 4347, no. c, pp. 1–14, 2021, doi: 10.1109/TKDE.2021.3082948.Google ScholarCross Ref
- B. Zamanlooy and M. Mirhassani, “Efficient VLSI implementation of neural networks with hyperbolic tangent activation function,” IEEE Trans. Very Large Scale Integr. Syst., vol. 22, no. 1, pp. 39–48, 2014, doi: 10.1109/TVLSI.2012.2232321.Google ScholarDigital Library
- R. Memisevic, C. Zach, M. Pollefeys, and G. E. Hinton, “Gated softmax classification,” in Advances in neural information processing systems, 2010, pp. 1603–1611.Google Scholar
- H. Wang et al., “Knowledge-aware graph neural networks with label smoothness regularization for recommender systems,” dl.acm.org, vol. 19, pp. 968–977, Jul. 2019, doi: 10.1145/3292500.3330836.Google ScholarDigital Library
- L. Sang, M. Xu, S. Qian, and X. Wu, “Knowledge graph enhanced neural collaborative recommendation,” Expert Syst. Appl., vol. 164, 2021, doi: 10.1016/j.eswa.2020.113992.Google ScholarCross Ref
- D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” 2014.Google Scholar
- X. Glorot and Y. Bengio, “Understanding the difficulty of training deep feedforward neural networks,” in Proceedings of the thirteenth international conference on artificial intelligence and statistics, 2010, pp. 249–256.Google Scholar
- G. Shani and A. Gunawardana, “Evaluating recommendation systems,” in Recommender systems handbook, Springer, 2011, pp. 257–297.Google ScholarCross Ref
- F. Gräßer, S. Kallumadi, H. Malberg, and S. Zaunseder, “Aspect-based sentiment analysis of drug reviews applying cross-domain and cross-data learning,” in Proceedings of the 2018 International Conference on Digital Health, 2018, pp. 121–125.Google ScholarDigital Library
- R. Sun et al., “Multi-modal knowledge graphs for recommender systems,” in Proceedings of the 29th ACM international conference on information & knowledge management, 2020, pp. 1405–1414.Google ScholarDigital Library
- X. Sha, Z. Sun, and J. Zhang, “Hierarchical attentive knowledge graph embedding for personalized recommendation,” Electron Commer Res Appl, vol. 48, p. 101071, 2021.Google ScholarDigital Library
- H. Lin, Y. Liu, W. Wang, Y. Yue, and Z. Lin, “Learning entity and relation embeddings for knowledge resolution,” Procedia Comput Sci, vol. 108, pp. 345–354, 2017.Google ScholarCross Ref
Index Terms
- Knowledge Graph Enhanced Contextualized Attention-Based Network for Responsible User-Specific Recommendation
Recommendations
User-Oriented Interest Representation on Knowledge Graph for Long-Tail Recommendation
Advanced Data Mining and ApplicationsAbstractGraph neural networks have demonstrated impressive performance in the field of recommender systems. However, existing graph neural network recommendation approaches are proficient in capturing users’ mainstream interests and recommending popular ...
Unearthing Undiscovered Interests: Knowledge Enhanced Representation Aggregation for Long-Tail Recommendation
Integrated Uncertainty in Knowledge Modelling and Decision MakingAbstractGraph neural networks have achieved remarkable performance in the field of recommender systems. However, existing graph-based recommendation approaches predominantly focus on suggesting popular items, disregarding the significance of long-tail ...
HRS: Hybrid Recommendation System based on Attention Mechanism and Knowledge Graph Embedding
WI-IAT '21: IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent TechnologyTraditional recommendation methods often have sparsity and cold start problems in real applications. Researchers found that introducing knowledge graphs into recommender systems as a kind of auxiliary information can alleviate these problems and ...
Comments