skip to main content
10.1145/3583780.3615254acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
short-paper

A Comparative Study of Reference Reliability in Multiple Language Editions of Wikipedia

Published:21 October 2023Publication History

ABSTRACT

Information presented in Wikipedia articles must be attributable to reliable published sources in the form of references. This study examines over 5 million Wikipedia articles to assess the reliability of references in multiple language editions. We quantify the cross-lingual patterns of the perennial sources list, a collection of reliability labels for web domains identified and collaboratively agreed upon by Wikipedia editors. We discover that some sources (or web domains) deemed untrustworthy in one language (i.e., English) continue to appear in articles in other languages. This trend is especially evident with sources tailored for smaller communities. Furthermore, non-authoritative sources found in the English version of a page tend to persist in other language versions of that page. We finally present a case study on the Chinese, Russian, and Swedish Wikipedias to demonstrate a discrepancy in reference reliability across cultures. Our finding highlights future challenges in coordinating global knowledge on source reliability.

References

  1. Pablo Aragón and Diego Sáez-Trumper. 2021. A preliminary approach to knowledge integrity risk assessment in Wikipedia projects. arXiv preprint arXiv:2106.15940 (2021).Google ScholarGoogle Scholar
  2. Aitolkyn Baigutanova, Jaehyeon Myung, Diego Saez-Trumper, Ai-Jou Chou, Miriam Redi, Changwook Jung, and Meeyoung Cha. 2023. Longitudinal Assessment of Reference Quality on Wikipedia. In Proceedings of the ACM Web Conference 2023 (Austin, TX, USA) (WWW '23). Association for Computing Machinery, New York, NY, USA, 2831--2839. https://doi.org/10.1145/3543507.3583218Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Brent Jaron Hecht. 2013. The mining and application of diverse cultural perspectives in user-generated content. Ph.,D. Dissertation. Northwestern University.Google ScholarGoogle Scholar
  4. Sohyeon Hwang and Aaron Shaw. 2022. Rules and Rule-Making in the Five Largest Wikipedias. Proceedings of the International AAAI Conference on Web and Social Media, Vol. 16, 1 (May 2022), 347--357. https://doi.org/10.1609/icwsm.v16i1.19297Google ScholarGoogle ScholarCross RefCross Ref
  5. Włodzimierz Lewoniewski, Krzysztof Wke cel, and Witold Abramowicz. 2017. Analysis of References Across Wikipedia Languages. In Information and Software Technologies, Robertas Damavs evivc ius and Vilma Mikavs yt.e (Eds.). Springer International Publishing, Cham, 561--573.Google ScholarGoogle Scholar
  6. Włodzimierz Lewoniewski, Krzysztof Wke cel, and Witold Abramowicz. 2023. Companies in Multilingual Wikipedia: Articles Quality and Important Sources of Information. In Information Technology for Management: Approaches to Improving Business and Society, Ewa Ziemba, Witold Chmielarz, and Jarosław Wka tróbski (Eds.). Springer Nature Switzerland, Cham, 48--67.Google ScholarGoogle Scholar
  7. Hause Lin, Jana Lasser, Stephan Lewandowsky, Rocky Cole, Andrew Gully, David Rand, and Gordon Pennycook. 2022. High level of agreement across different news domain quality ratings. (2022).Google ScholarGoogle Scholar
  8. Sverrir Steinsson. 2023. Rule Ambiguity, Institutional Clashes, and Population Loss: How Wikipedia Became the Last Good Place on the Internet. American Political Science Review (2023), 1--17.Google ScholarGoogle Scholar
  9. Rodolfo Vieira Valentim, Giovanni Comarela, Souneil Park, and Diego Sáez-Trumper. 2021. Tracking knowledge propagation across wikipedia languages. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 15. 1046--1052.Google ScholarGoogle ScholarCross RefCross Ref
  10. English Wikipedia. 2023 a. List of Wikipedias Retrieved May 26, 2023 fromGoogle ScholarGoogle Scholar
  11. English Wikipedia. 2023 b. Reliable sources Noticeboard. https://en.wikipedia.org/wiki/Wikipedia:Reliable_sources/Noticeboard Retrieved May 26, 2023 fromGoogle ScholarGoogle Scholar
  12. English Wikipedia. 2023 c. Verifiability Policy. https://en.wikipedia.org/wiki/Wikipedia:Verifiability Retrieved May 26, 2023 fromGoogle ScholarGoogle Scholar
  13. English Wikipedia. 2023 d. Wikipedia: Reliable source, Perennial Source. https://en.wikipedia.org/wiki/Wikipedia:Reliable_sources/Perennial_sources Retrieved May 26, 2023 fromGoogle ScholarGoogle Scholar
  14. Puyu Yang and Giovanni Colavizza. 2022a. A Map of Science in Wikipedia. In Companion Proceedings of the Web Conference 2022. 1289--1300.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Puyu Yang and Giovanni Colavizza. 2022b. Polarization and reliability of news sources in Wikipedia. arXiv preprint arXiv:2210.16065 (2022).Google ScholarGoogle Scholar
  16. Xiang Zheng, Jiajing Chen, Erjia Yan, and Chaoqun Ni. 2023. Gender and country biases in Wikipedia citations to scholarly publications. Journal of the Association for Information Science and Technology, Vol. 74, 2 (2023), 219--233.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. A Comparative Study of Reference Reliability in Multiple Language Editions of Wikipedia

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management
      October 2023
      5508 pages
      ISBN:9798400701245
      DOI:10.1145/3583780

      Copyright © 2023 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 21 October 2023

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • short-paper

      Acceptance Rates

      Overall Acceptance Rate1,861of8,427submissions,22%

      Upcoming Conference

    • Article Metrics

      • Downloads (Last 12 months)125
      • Downloads (Last 6 weeks)32

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader