Jhih-Chen Liu
Abstract
The growing number of publications in the field of artificial intelligence highlights the need for researchers to enhance their efficiency in searching for relevant articles. Most paper recommendation models either rely on simplistic citation relationships among papers or focus on content-based approaches, both of which overlook interactions within academic networks. To address the aforementioned problem, knowledge graph embedding (KGE) methods have been used for citation recommendations because recent research proves that graph representations can effectively improve recommendation model accuracy. However, academic networks are dynamic, leading to changes in the representations of users and items over time. The majority of KGE-based citation recommendations are primarily designed for static graphs, thus failing to capture the evolution of dynamic knowledge graph (DKG) structures. To address these challenges, we introduced the evolving knowledge graph embedding (EKGE) method. In this methodology, evolving knowledge graphs are input into time-series models to learn the patterns of structural evolution. The model has the capability to generate embeddings for each entity at various time points, thereby overcoming limitation of static models that require retraining to acquire embeddings at each specific time point. To enhance the efficiency of feature extraction, we employed a multiple attention strategy. This helped the model find recommendation lists that are closely related to a user’s needs, leading to improved recommendation accuracy. Various experiments conducted on a citation recommendation dataset revealed that the EKGE model exhibits a 1.13% increase in prediction accuracy compared to other KGE methods. Moreover, the model’s accuracy can be further increased by an additional 0.84% through the incorporation of an attention mechanism.
- [1] . 2022. Citation recommendation employing heterogeneous bibliographic network embedding. Neural Computing and Applications 34, 13 (2022), 10229–10242.Google Scholar
Digital Library
- [2] . 2017. A graph based approach to scientific paper recommendation. In Proceedings of the International Conference on Web Intelligence. ACM, 777–782.Google ScholarDigital Library
- [3] . 2019. Scientific paper recommendation: A survey. IEEE Access 7 (2019), 9324–9339.Google ScholarCross Ref
- [4] . 2018. Content-based citation recommendation. arXiv preprint arXiv:1802.08301 (2018).Google Scholar
- [5] . 2014. A semantic matching energy function for learning with multi-relational data. Machine Learning 94, 2 (2014), 233–259.Google ScholarDigital Library
- [6] . 2013. Translating embeddings for modeling multi-relational data. In Advances in Neural Information Processing Systems. 2787–2795.Google ScholarDigital Library
- [7] . 2014. Citation-enhanced keyphrase extraction from research papers: A supervised approach. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP’14). 1435–1446.Google ScholarCross Ref
- [8] . 2018. Neural attentional rating regression with review-level explanations. In Proceedings of the 2018 World Wide Web Conference. 1583–1592.Google ScholarDigital Library
- [9] Haochen Chen, Bryan Perozzi, Yifan Hu, and Steven Skiena. 2018. HARP: Hierarchical representation learning for networks. In Thirty-Second AAAI Conference on Artificial Intelligence. 2127–2134.Google Scholar
- [10] . 2020. Diachronic embedding for temporal knowledge graph completion. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 3988–3995.Google ScholarCross Ref
- [11] . 2016. Hashtag recommendation using attention-based convolutional neural network. In IJCAI. 2782–2788.Google Scholar
- [12] . 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. 173–182.Google ScholarDigital Library
- [13] . 2022. Explainable mutual fund recommendation system developed based on knowledge graph embeddings. Applied Intelligence (2022), 1–26.Google Scholar
- [14] . 2023. Attentive gated graph sequence neural network-based time-series information fusion for financial trading. Information Fusion 91 (2023), 261–276.Google ScholarDigital Library
- [15] . 2016. Towards time-aware knowledge graph completion. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. 1715–1724.Google Scholar
- [16] . 2010. A framework for tag-based research paper recommender system: An IR approach. In 2010 IEEE 24th International Conference on Advanced Information Networking and Applications Workshops. IEEE, 103–108.Google ScholarDigital Library
- [17] . 2020. Representation learning for dynamic graphs: A survey. Journal of Machine Learning Research 21, 70 (2020), 1–73.Google Scholar
- [18] . 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of NAACL-HLT, Vol. 1. 2.Google Scholar
- [19] . 2017. Attributed network embedding for learning in a dynamic environment. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 387–396.Google ScholarDigital Library
- [20] . 2015. Effective approaches to attention-based neural machine translation. arXiv preprint arXiv:1508.04025 (2015).Google Scholar
- [21] . 2018. Point-of-interest recommendation: Exploiting self-attentive autoencoders with neighbor-aware influence. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. 697–706.Google ScholarDigital Library
- [22] . 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems. 3111–3119.Google ScholarDigital Library
- [23] . 2017. Recurrent relational networks. In NeurIPS.Google Scholar
- [24] . 2020. EvolveGCN: Evolving graph convolutional networks for dynamic graphs. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 5363–5370.Google ScholarCross Ref
- [25] . 2017. Interacting attention-gated recurrent networks for recommendation. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 1459–1468.Google ScholarDigital Library
- [26] Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. 2018. Improving language understanding by generative pre-training. OpenAI Blog (2018), 12.Google Scholar
- [27] . 2018. Graph networks as learnable physics engines for inference and control. In ICML.Google Scholar
- [28] . 2018. Modeling relational data with graph convolutional networks. In European Semantic Web Conference. Springer, 593–607.Google ScholarDigital Library
- [29] . 2017. Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In Proceedings of the Eleventh ACM Conference on Recommender Systems. 297–305.Google ScholarDigital Library
- [30] . 2018. Heterogeneous information network embedding for recommendation. IEEE Transactions on Knowledge and Data Engineering 31, 2 (2018), 357–370.Google ScholarDigital Library
- [31] . 2016. A survey of heterogeneous information network analysis. IEEE Transactions on Knowledge and Data Engineering 29, 1 (2016), 17–37.Google ScholarDigital Library
- [32] . 2008. ArnetMiner: Extraction and mining of academic social networks. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 990–998.Google ScholarDigital Library
- [33] . 2018. Multi-pointer co-attention networks for recommendation. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2309–2318.Google ScholarDigital Library
- [34] . 2019. DyRep: Learning representations over dynamic graphs. In International Conference on Learning Representations.Google Scholar
- [35] . 2017. Attention is all you need. In Advances in Neural Information Processing Systems. 5998–6008.Google Scholar
- [36] . 2011. Collaborative topic modeling for recommending scientific articles. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 448–456.Google ScholarDigital Library
- [37] . 2018. GraphGAN: Graph representation learning with generative adversarial nets. In Thirty-Second AAAI Conference on Artificial Intelligence.Google ScholarCross Ref
- [38] . 2020. Content-based hybrid deep neural network citation recommendation method. In International Conference of Pioneering Computer Scientists, Engineers and Educators. Springer, 3–20.Google ScholarCross Ref
- [39] . 2021. Deep learning model for house price prediction using heterogeneous data analysis along with joint self-attention mechanism. IEEE Access 9 (2021), 55244–55259.Google ScholarCross Ref
- [40] . 2021. AutoCite: Multi-modal representation fusion for contextual citation generation. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining. 788–796.Google ScholarDigital Library
- [41] . 2023. Modeling cross-session information with multi-interest graph neural networks for the next-item recommendation. ACM Transactions on Knowledge Discovery from Data 17, 1 (2023), 1–28.Google ScholarDigital Library
- [42] . 2020. Venue topic model–enhanced joint graph modelling for citation recommendation in scholarly big data. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 20, 1 (2020), 1–15.Google ScholarDigital Library
- [43] . 2017. Dynamic attention deep model for article recommendation by learning human editors’ demonstration. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2051–2059.Google ScholarDigital Library
- [44] . 2022. DisenCite: Graph-based disentangled representation learning for context-specific citation generation. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 11449–11458.Google ScholarCross Ref
- [45] . 2022. Poisoning attacks against knowledge graph-based recommendation systems using deep reinforcement learning. Neural Computing and Applications (2022), 1–19.Google Scholar
- [46] . 2023. OpenMetaRec: Open-metapath heterogeneous dual attention network for paper recommendation. Expert Systems with Applications 231 (2023), 120806.Google ScholarDigital Library
- [47] . 2019. Temporal knowledge graph embedding model based on additive time series decomposition. arXiv preprint arXiv:1911.07893 (2019).Google Scholar
- [48] . 2023. Reinforced PU-learning with hybrid negative sampling strategies for recommendation. ACM Transactions on Intelligent Systems and Technology 14, 3 (2023), 1–25.Google ScholarDigital Library
- [49] . 2014. Recommendation in Academia: A joint multi-relational model. In 2014 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM’14). IEEE, 566–571.Google ScholarCross Ref
Index Terms
- Evolving Knowledge Graph Representation Learning with Multiple Attention Strategies for Citation Recommendation System
Recommendations
Citation Recommendation Based on Knowledge Graph and Multi-task Learning
Knowledge Science, Engineering and ManagementAbstractThe Citation Recommendation aims to address the problem of academic information overload by filtering and suggesting relevant references for researchers. Traditional content-based citation recommendation methods may not be comprehensive enough to ...
Enhancing citation recommendation using citation network embedding
AbstractAutomatic recommendation of citations has been a focal point of research in scholarly digital libraries. Many graph-based citation recommendation algorithms have been proposed; however, most of them utilize local citation behavior from the ...
A Systematic Review of Citation Recommendation Over the Past Two Decades
A citation is a reference to the source of information used in an article. Citations are very useful for students and researchers to locate relevant information on a topic. Proper citation is also important in the academic ethics of article writing. Due ...
Comments