ABSTRACT
The problem of personalization in Information Retrieval has been under study for a long time. A well-known issue related to this task is the lack of publicly available datasets to support a comparative evaluation of personalized search systems. To contribute in this respect, this paper introduces SE-PEF (StackExchange - Personalized Expert Finding), a resource useful for designing and evaluating personalized models related to the Expert Finding (EF) task. The contributed dataset includes more than 250k queries and 565k answers from 3 306 experts, which are annotated with a rich set of features modeling the social interactions among the users of a popular cQA platform. The results of the preliminary experiments conducted show the appropriateness of SE-PEF to evaluate and to train effective EF models.
- Arian Askari, Suzan Verberne, and Gabriella Pasi. 2022. Expert Finding in Legal Community Question Answering. In European Conference on Information Retrieval. Springer, Springer International Publishing, Cham, 22–30.Google Scholar
- Elias Bassani. 2022. ranx: A Blazing-Fast Python Library for Ranking Evaluation and Comparison. In ECIR (2)(Lecture Notes in Computer Science, Vol. 13186). Springer, Cham, 259–264.Google Scholar
- Elias Bassani, Pranav Kasela, and Gabriella Pasi. 2023. Denoising Attention for Query-aware User Modeling in Personalized Search. arxiv:2308.15968 [cs.IR]Google Scholar
- Elias Bassani, Pranav Kasela, Alessandro Raganato, and Gabriella Pasi. 2022. A Multi-Domain Benchmark for Personalized Search Evaluation. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management (Atlanta, GA, USA) (CIKM ’22). Association for Computing Machinery, New York, NY, USA, 3822–3827. https://doi.org/10.1145/3511808.3557536Google ScholarDigital Library
- Elias Bassani and Luca Romelli. 2022. Ranx.Fuse: A Python Library for Metasearch. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management (Atlanta, GA, USA) (CIKM ’22). Association for Computing Machinery, New York, NY, USA, 4808–4812. https://doi.org/10.1145/3511808.3557207Google ScholarDigital Library
- Marco Braga, Alessandro Raganato, and Gabriella Pasi. 2023. Personalization in BERT with Adapter Modules and Topic Modelling. In Italian Information Retrieval Workshop. https://api.semanticscholar.org/CorpusID:260500844Google Scholar
- Silvia Calegari and Gabriella Pasi. 2013. Personal ontologies: Generation of user profiles based on the YAGO ontology. Information Processing & Management 49, 3 (2013), 640–658. https://doi.org/10.1016/j.ipm.2012.07.010 Personalization and Recommendation in Information Access.Google ScholarDigital Library
- Arash Dargahi Nobari, Sajad Sotudeh Gharebagh, and Mahmood Neshati. 2017. Skill Translation Models in Expert Finding. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (Shinjuku, Tokyo, Japan) (SIGIR ’17). Association for Computing Machinery, New York, NY, USA, 1057–1060. https://doi.org/10.1145/3077136.3080719Google ScholarDigital Library
- Jinwen Guo, Shengliang Xu, Shenghua Bao, and Yong Yu. 2008. Tapping on the Potential of Q&a Community by Recommending Answer Providers. In Proceedings of the 17th ACM Conference on Information and Knowledge Management (Napa Valley, California, USA) (CIKM ’08). Association for Computing Machinery, New York, NY, USA, 921–930. https://doi.org/10.1145/1458082.1458204Google ScholarDigital Library
- Pranav Kasela, Gabriella Pasi, and Raffaele Perego. 2023. SE-PQA: Personalized Community Question Answering. arxiv:2306.16261 [cs.IR]Google Scholar
- Zeyu Li, Jyun-Yu Jiang, Yizhou Sun, and Wei Wang. 2019. Personalized Question Routing via Heterogeneous Network Embedding. Proceedings of the AAAI Conference on Artificial Intelligence 33, 01 (Jul. 2019), 192–199. https://doi.org/10.1609/aaai.v33i01.3301192Google ScholarDigital Library
- Shuyi Lin, Wenxing Hong, Dingding Wang, and Tao Li. 2017. A survey on expert finding techniques. Journal of Intelligent Information Systems 49, 2 (2017), 255–279.Google ScholarDigital Library
- Hongtao Liu, Zhepeng Lv, Qing Yang, Dongliang Xu, and Qiyao Peng. 2022. ExpertBert: Pretraining Expert Finding. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management (Atlanta, GA, USA) (CIKM ’22). Association for Computing Machinery, New York, NY, USA, 4244–4248. https://doi.org/10.1145/3511808.3557597Google ScholarDigital Library
- Xiaoyong Liu, W Bruce Croft, and Matthew Koll. 2005. Finding experts in community-based question-answering services. In Proceedings of the 14th ACM international conference on Information and knowledge management. Association for Computing Machinery, New York, NY, USA, 315–316.Google ScholarDigital Library
- Zhengyi Ma, Zhicheng Dou, Guanyue Bian, and Ji-Rong Wen. 2020. PSTIE: Time Information Enhanced Personalized Search. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management (Virtual Event, Ireland) (CIKM ’20). Association for Computing Machinery, New York, NY, USA, 1075–1084. https://doi.org/10.1145/3340531.3411877Google ScholarDigital Library
- Craig Macdonald and Iadh Ounis. 2006. Voting for Candidates: Adapting Data Fusion Techniques for an Expert Search Task. In Proceedings of the 15th ACM International Conference on Information and Knowledge Management (Arlington, Virginia, USA) (CIKM ’06). Association for Computing Machinery, New York, NY, USA, 387–396. https://doi.org/10.1145/1183614.1183671Google ScholarDigital Library
- Qiyao Peng, Hongtao Liu, Yinghui Wang, Hongyan Xu, Pengfei Jiao, Minglai Shao, and Wenjun Wang. 2022. Towards a Multi-View Attentive Matching for Personalized Expert Finding. In Proceedings of the ACM Web Conference 2022 (Virtual Event, Lyon, France) (WWW ’22). Association for Computing Machinery, New York, NY, USA, 2131–2140. https://doi.org/10.1145/3485447.3512086Google ScholarDigital Library
- Kasela Pranav, Pasi Gabriella, and Perego Raffaele. 2023. SE-PEF: a Resource for Personalized Expert Finding. https://doi.org/10.5281/zenodo.8332748Google ScholarCross Ref
- Kasela Pranav, Pasi Gabriella, and Perego Raffaele. 2023. SE-PQA: a Resource for Personalized Community Question Answering. https://doi.org/10.5281/zenodo.7940964Google ScholarCross Ref
- Fatemeh Riahi, Zainab Zolaktaf, Mahdi Shafiei, and Evangelos Milios. 2012. Finding Expert Users in Community Question Answering. In Proceedings of the 21st International Conference on World Wide Web (Lyon, France) (WWW ’12 Companion). Association for Computing Machinery, New York, NY, USA, 791–798. https://doi.org/10.1145/2187980.2188202Google ScholarDigital Library
- Fei Xu, Zongcheng Ji, and Bin Wang. 2012. Dual Role Model for Question Recommendation in Community Question Answering. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (Portland, Oregon, USA) (SIGIR ’12). Association for Computing Machinery, New York, NY, USA, 771–780. https://doi.org/10.1145/2348283.2348387Google ScholarDigital Library
- Zhou Zhao, Lijun Zhang, Xiaofei He, and Wilfred Ng. 2015. Expert Finding for Question Answering via Graph Regularized Matrix Completion. IEEE Transactions on Knowledge and Data Engineering 27, 4 (2015), 993–1004. https://doi.org/10.1109/TKDE.2014.2356461Google ScholarDigital Library
Index Terms
- SE-PEF: a Resource for Personalized Expert Finding
Recommendations
ExpertBert: Pretraining Expert Finding
CIKM '22: Proceedings of the 31st ACM International Conference on Information & Knowledge ManagementExpert Finding is an important task in Community Question Answering (CQA) platforms, which could help route questions to potential expertise users to answer. The key is to model the question content and experts based on their historical answered ...
SE-PQA: Personalized Community Question Answering
WWW '24: Companion Proceedings of the ACM on Web Conference 2024Personalization in Information Retrieval is a topic studied for a long time. Nevertheless, there is still a lack of high-quality, real-world datasets to conduct large-scale experiments and evaluate models for personalized search. This paper contributes ...
A rule-based CBR approach for expert finding and problem diagnosis
It is important to find the person with right expertise and the appropriate solutions in the specific field to solve a critical situation in a large complex system such as an enterprise level application. In this paper, we apply the experts' knowledge ...
Comments