skip to main content
10.1145/3624918.3625335acmconferencesArticle/Chapter ViewAbstractPublication Pagessigir-apConference Proceedingsconference-collections
research-article
Open Access

SE-PEF: a Resource for Personalized Expert Finding

Published:26 November 2023Publication History

ABSTRACT

The problem of personalization in Information Retrieval has been under study for a long time. A well-known issue related to this task is the lack of publicly available datasets to support a comparative evaluation of personalized search systems. To contribute in this respect, this paper introduces SE-PEF (StackExchange - Personalized Expert Finding), a resource useful for designing and evaluating personalized models related to the Expert Finding (EF) task. The contributed dataset includes more than 250k queries and 565k answers from 3 306 experts, which are annotated with a rich set of features modeling the social interactions among the users of a popular cQA platform. The results of the preliminary experiments conducted show the appropriateness of SE-PEF to evaluate and to train effective EF models.

References

  1. Arian Askari, Suzan Verberne, and Gabriella Pasi. 2022. Expert Finding in Legal Community Question Answering. In European Conference on Information Retrieval. Springer, Springer International Publishing, Cham, 22–30.Google ScholarGoogle Scholar
  2. Elias Bassani. 2022. ranx: A Blazing-Fast Python Library for Ranking Evaluation and Comparison. In ECIR (2)(Lecture Notes in Computer Science, Vol. 13186). Springer, Cham, 259–264.Google ScholarGoogle Scholar
  3. Elias Bassani, Pranav Kasela, and Gabriella Pasi. 2023. Denoising Attention for Query-aware User Modeling in Personalized Search. arxiv:2308.15968 [cs.IR]Google ScholarGoogle Scholar
  4. Elias Bassani, Pranav Kasela, Alessandro Raganato, and Gabriella Pasi. 2022. A Multi-Domain Benchmark for Personalized Search Evaluation. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management (Atlanta, GA, USA) (CIKM ’22). Association for Computing Machinery, New York, NY, USA, 3822–3827. https://doi.org/10.1145/3511808.3557536Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Elias Bassani and Luca Romelli. 2022. Ranx.Fuse: A Python Library for Metasearch. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management (Atlanta, GA, USA) (CIKM ’22). Association for Computing Machinery, New York, NY, USA, 4808–4812. https://doi.org/10.1145/3511808.3557207Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Marco Braga, Alessandro Raganato, and Gabriella Pasi. 2023. Personalization in BERT with Adapter Modules and Topic Modelling. In Italian Information Retrieval Workshop. https://api.semanticscholar.org/CorpusID:260500844Google ScholarGoogle Scholar
  7. Silvia Calegari and Gabriella Pasi. 2013. Personal ontologies: Generation of user profiles based on the YAGO ontology. Information Processing & Management 49, 3 (2013), 640–658. https://doi.org/10.1016/j.ipm.2012.07.010 Personalization and Recommendation in Information Access.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Arash Dargahi Nobari, Sajad Sotudeh Gharebagh, and Mahmood Neshati. 2017. Skill Translation Models in Expert Finding. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (Shinjuku, Tokyo, Japan) (SIGIR ’17). Association for Computing Machinery, New York, NY, USA, 1057–1060. https://doi.org/10.1145/3077136.3080719Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Jinwen Guo, Shengliang Xu, Shenghua Bao, and Yong Yu. 2008. Tapping on the Potential of Q&a Community by Recommending Answer Providers. In Proceedings of the 17th ACM Conference on Information and Knowledge Management (Napa Valley, California, USA) (CIKM ’08). Association for Computing Machinery, New York, NY, USA, 921–930. https://doi.org/10.1145/1458082.1458204Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Pranav Kasela, Gabriella Pasi, and Raffaele Perego. 2023. SE-PQA: Personalized Community Question Answering. arxiv:2306.16261 [cs.IR]Google ScholarGoogle Scholar
  11. Zeyu Li, Jyun-Yu Jiang, Yizhou Sun, and Wei Wang. 2019. Personalized Question Routing via Heterogeneous Network Embedding. Proceedings of the AAAI Conference on Artificial Intelligence 33, 01 (Jul. 2019), 192–199. https://doi.org/10.1609/aaai.v33i01.3301192Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Shuyi Lin, Wenxing Hong, Dingding Wang, and Tao Li. 2017. A survey on expert finding techniques. Journal of Intelligent Information Systems 49, 2 (2017), 255–279.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Hongtao Liu, Zhepeng Lv, Qing Yang, Dongliang Xu, and Qiyao Peng. 2022. ExpertBert: Pretraining Expert Finding. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management (Atlanta, GA, USA) (CIKM ’22). Association for Computing Machinery, New York, NY, USA, 4244–4248. https://doi.org/10.1145/3511808.3557597Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Xiaoyong Liu, W Bruce Croft, and Matthew Koll. 2005. Finding experts in community-based question-answering services. In Proceedings of the 14th ACM international conference on Information and knowledge management. Association for Computing Machinery, New York, NY, USA, 315–316.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Zhengyi Ma, Zhicheng Dou, Guanyue Bian, and Ji-Rong Wen. 2020. PSTIE: Time Information Enhanced Personalized Search. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management (Virtual Event, Ireland) (CIKM ’20). Association for Computing Machinery, New York, NY, USA, 1075–1084. https://doi.org/10.1145/3340531.3411877Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Craig Macdonald and Iadh Ounis. 2006. Voting for Candidates: Adapting Data Fusion Techniques for an Expert Search Task. In Proceedings of the 15th ACM International Conference on Information and Knowledge Management (Arlington, Virginia, USA) (CIKM ’06). Association for Computing Machinery, New York, NY, USA, 387–396. https://doi.org/10.1145/1183614.1183671Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Qiyao Peng, Hongtao Liu, Yinghui Wang, Hongyan Xu, Pengfei Jiao, Minglai Shao, and Wenjun Wang. 2022. Towards a Multi-View Attentive Matching for Personalized Expert Finding. In Proceedings of the ACM Web Conference 2022 (Virtual Event, Lyon, France) (WWW ’22). Association for Computing Machinery, New York, NY, USA, 2131–2140. https://doi.org/10.1145/3485447.3512086Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Kasela Pranav, Pasi Gabriella, and Perego Raffaele. 2023. SE-PEF: a Resource for Personalized Expert Finding. https://doi.org/10.5281/zenodo.8332748Google ScholarGoogle ScholarCross RefCross Ref
  19. Kasela Pranav, Pasi Gabriella, and Perego Raffaele. 2023. SE-PQA: a Resource for Personalized Community Question Answering. https://doi.org/10.5281/zenodo.7940964Google ScholarGoogle ScholarCross RefCross Ref
  20. Fatemeh Riahi, Zainab Zolaktaf, Mahdi Shafiei, and Evangelos Milios. 2012. Finding Expert Users in Community Question Answering. In Proceedings of the 21st International Conference on World Wide Web (Lyon, France) (WWW ’12 Companion). Association for Computing Machinery, New York, NY, USA, 791–798. https://doi.org/10.1145/2187980.2188202Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Fei Xu, Zongcheng Ji, and Bin Wang. 2012. Dual Role Model for Question Recommendation in Community Question Answering. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (Portland, Oregon, USA) (SIGIR ’12). Association for Computing Machinery, New York, NY, USA, 771–780. https://doi.org/10.1145/2348283.2348387Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Zhou Zhao, Lijun Zhang, Xiaofei He, and Wilfred Ng. 2015. Expert Finding for Question Answering via Graph Regularized Matrix Completion. IEEE Transactions on Knowledge and Data Engineering 27, 4 (2015), 993–1004. https://doi.org/10.1109/TKDE.2014.2356461Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. SE-PEF: a Resource for Personalized Expert Finding
            Index terms have been assigned to the content through auto-classification.

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Conferences
              SIGIR-AP '23: Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region
              November 2023
              324 pages
              ISBN:9798400704086
              DOI:10.1145/3624918

              Copyright © 2023 Owner/Author

              This work is licensed under a Creative Commons Attribution-ShareAlike International 4.0 License.

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 26 November 2023

              Check for updates

              Qualifiers

              • research-article
              • Research
              • Refereed limited
            • Article Metrics

              • Downloads (Last 12 months)89
              • Downloads (Last 6 weeks)16

              Other Metrics

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader

            HTML Format

            View this article in HTML Format .

            View HTML Format