Skip to main content
Log in

What affects publications’ popularity on Twitter?

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

Social media is one of the major channels for knowledge diffusion, including scientific discovery. As a consequence, it has been under discussion whether altmetrics can be used as an alternative indicator for research evaluation, complementing the traditional indicators such as citations. The study contributes to the discussion by exploring the factors relevant to the attention that publications receive on social media. Based on 20,310 academic papers published by the Royal Society in the past ten years, the study found that posting accounts are the major force for boosting the amount of attention received on Twitter. Timely posting and accessibility also help to increase the attention. The findings suggest that publications’ social popularity can be easily influenced by non-paper factors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. https://www.altmetric.com/about-our-data/the-donut-and-score/

References

  • Adler, N. J., & Harzing, A. (2009). When knowledge wins: Transcending the sense and nonsense of academic rankings. Academy of Management Learning & Education, 8(1), 72–95.

    Article  Google Scholar 

  • Aharony, N., Bar-Ilan, J., Julien, H., Benyamin-Kahana, M., & Cooper, T. (2019). Acceptance of altmetrics by LIS scholars: An exploratory study. Journal of Librarianship and Information Science, 51(3), 843–851.

    Article  Google Scholar 

  • Alotaibi, N. M., Guha, D., Fallah, A., Aldakkan, A., Nassiri, F., Badhiwala, J. H., et al. (2016). Social media metrics and bibliometric profiles of neurosurgical departments and journals: is there a relationship? World Neurosurgery, 90, 574-579.e7.

    Article  Google Scholar 

  • Altmetric.com. (2020). The donut and Altmetric Attention Score. Retrieved December 25, 2019, from https://www.altmetric.com/about-our-data/the-donut-and-score/

  • Asaad, M., Howell, S. M., Rajesh, A., Meaike, J., & Tran, N. V. (2020). Altmetrics in plastic surgery journals: Does it correlate with citation count? Aesthetic Surgery Journal, 40(11), NP628–NP635.

    Article  Google Scholar 

  • Baek, S., Yoon, D. Y., Lim, K. J., Hong, J. H., Moon, J. Y., Seo, Y. L., &, , et al. (2020). Top-cited articles versus top Altmetric articles in nuclear medicine: A comparative bibliometric analysis. ACTA Radiologica, 61(10), 1343–1349.

    Article  Google Scholar 

  • Bar-Ilan, J., Haustein, S., Peters, I., Priem, J., Shema, H., & Terliesner, J. (2012). Beyond citations: Scholars’ visibility on the social web. Arxiv preprint, 1205, 5611.

    Google Scholar 

  • Bar-Ilan, J., Shema, H., & Thelwall, M. (2014). Bibliographic references in Web 2. 0. In B. Cronin & C. R. Sugimoto (Eds.), Beyond Bibliometrics: Harnessing Multidimensional Indicators of Scholarly Impact (pp. 307–325). Britain, MIT Press: Cambridge.

    Google Scholar 

  • Bornmann, L. (2014a). Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics. Journal of Informetrics, 8(4), 895–903.

    Article  Google Scholar 

  • Bornmann, L. (2014b). Is there currently a scientific revolution in scientometrics? Journal of the Association for Information Science and Technology, 65(3), 647–648.

    Article  Google Scholar 

  • Bornmann, L. (2014c). Validity of altmetrics data for measuring societal impact: A study using data from Altmetric and F1000Prime. Journal of Informetrics, 8(4), 935–950.

    Article  Google Scholar 

  • Bornmann, L., & Haunschild, R. (2016). How to normalize Twitter counts? A first attempt based on journals in the Twitter Index. Scientometrics, 107(3), 1405–1422.

    Article  Google Scholar 

  • Bornmann, L., & Haunschild, R. (2017). Measuring field-normalized impact of papers on specific societal groups: An altmetrics study based on mendeley data. Research Evaluation, 26(3), 230–241.

    Article  Google Scholar 

  • Bornmann, L., Schier, H., Marx, W., & Daniel, H.-D. (2012). What factors determine citation counts of publications in chemistry besides their quality? Journal of Informetrics, 6(1), 11–18.

    Article  Google Scholar 

  • Boyd, C. J., Ananthasekar, S., Kurapati, S., & King, T. W. (2020). Examining the correlation between altmetric score and citations in the plastic surgery literature. Plastic and Reconstructive Surgery, 146(6), 808E-815E.

    Article  Google Scholar 

  • Callaham, M., Wears, R. L., & Weber, E. (2002). Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer reviewed journals. JAMA-Journal of the American Medical Association, 287(21), 2847–2850.

    Article  Google Scholar 

  • Castillo, C., Mendoza, M., & Poblete, B. (2013). Predicting information credibility in time-sensitive social media. Internet Research, 23(5), 560–588.

    Article  Google Scholar 

  • Chandrashekhar, Y., & Shaw, L. (2019). Journal Editors and Altmetrics Moth to the Flame? JACC-Cardiovascular Imaging, 12(9), 1899–1902.

    Article  Google Scholar 

  • Costas, R., Zahedi, Z., & Wouters, P. (2015). Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. Journal of the Association for Information Science and Technology, 66(10), 2003–2019.

    Article  Google Scholar 

  • Dardas, L. A., Woodward, A., Scott, J., Xu, H. Z., & Sawair, F. A. (2019). Measuring the social impact of nursing research: An insight into altmetrics. Journal of Advanced Nursing, 75(7), 1394–1405.

    Article  Google Scholar 

  • Davis, P. M., & Fromerth, M. J. (2007). Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles? Scientometrics, 71(2), 203–215.

    Article  Google Scholar 

  • Dhiman, A. K. (2016). Bibliometrics to altmetrics: Changing trends in assessing research impact. Desidoc Journal of Library and Information Technology, 35(4), 310–316.

    Article  Google Scholar 

  • Dowling, G. R. (2014). Playing the citations game: From publish or perish to be cited or sidelined. Australasian Marketing Journal, 22(4), 280–287.

    Article  Google Scholar 

  • Elsevier. (2017a). Article sharing. Retrieved December 25, 2019, from https://www.elsevier.com/about/company-information/policies/sharing

  • Elsevier. (2017b). Sharing and promoting your article. Retrieved December 25, 2019, from https://www.elsevier.com/authors/journal-authors/submit-your-paper/sharing-and-promoting-your-article

  • Ezema, I. J., & Ugwu, C. I. (2019). Correlating research impact of library and information science journals using citation counts and altmetrics attention. Information Discovery and Delivery, 47(3), 143–153.

    Article  Google Scholar 

  • Galetti, M., & Costa-Pereira, R. (2017). Scientists need social media influencers. Science, 357(6354), 880.2-881.

    Article  Google Scholar 

  • Gingras, Y., & Wallace, M. L. (2010). Why it has become more difficult to predict Nobel Prize winners: A bibliometric analysis of nominees and winners of the chemistry and physics prizes (1901–2007). Scientometrics, 82(2), 401–412.

    Article  Google Scholar 

  • Glänzel, W., & Schubert, A. (2005). Handbook of Quantitative Science and Technology Research (pp. 257–276). Springer.

  • Griffin, S. A., Oliver, C. W., & Murray, A. (2018). "Altmetrics’! Can you afford to ignore it? British Journal of Sports Medicine, 52(18), 1160–1161.

    Article  Google Scholar 

  • Hassan, Saeed-Ul., Aljohani, N. R., Idrees, N., Sarwar, R., Nawaz, R., Martinez-Camara, E., &, , et al. (2020). Predicting literature’s early impact with sentiment analysis in Twitter. Knowledge-based Systems, 192, 105383.

    Article  Google Scholar 

  • Haunschild, R., & Bornmann, L. (2016). Normalization of mendeley reader counts for impact assessment. Journal of Informetrics, 10(1), 62–73.

    Article  Google Scholar 

  • Haustein, S., Larivière, V., Thelwall, M., Amyot, D., & Peters, I. (2014). Tweets vs. mendeley readers: how do these two social media metrics differ? IT-Information Technology, 56(5), 207–215.

    Article  Google Scholar 

  • Haustein, S., Peters, I., Bar-Ilan, J., Priem, J., Shema, H., & Terliesner, J. (2014b). Coverage and adoption of altmetrics sources in the bibliometric community. Scientometrics, 101(2), 1145–1163.

    Article  Google Scholar 

  • Haustein, S., Peters, I., Sugimoto, C. R., Thelwall, M., & Lariviere, V. (2014c). Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature. Journal of the Association for Information Science and Technology, 65(4), 656–669.

    Article  Google Scholar 

  • Holmberg, K., Hedman, J., Bowman, T. D., Didegah, F., & Laakso, M. (2020). Do articles in open access journals have more frequent altmetric activity than articles in subscription-based journals? An investigation of the research output of Finnish universities. Scientometrics, 122(1), 645–659.

    Article  Google Scholar 

  • Hong, J. H., Yoon, D. Y., Lim, K. J., Moon, J. Y., Baek, S., Seo, Y. L., &, , et al. (2020). Characteristics of the most cited, most downloaded, and most mentioned articles in general medical journals: a comparative bibliometric analysis. Healthcare, 8(4), 492.

    Article  Google Scholar 

  • Kunze, K. N., Polce, E. M., Vadhera, A., Williams, B. T., Nwachukwu, B. U., Nho, S. J., et al. (2020). What is the predictive ability and academic impact of the altmetrics score and social media attention? American Journal of Sports Medicine, 48(5), 1056–1062.

    Article  Google Scholar 

  • Larivière, V., Sugimoto, C. R., Macaluso, B., Milojevic, S., Cronin, B., & Thelwall, M. (2014). ArXiv e-prints and the journal of record: An analysis of roles and relationships. Journal of the Association for Information Science and Technology, 65(6), 1157–1169.

    Article  Google Scholar 

  • Leydesdorff, L., & Wagner, C. (2009). Is the United States losing ground in science? A global perspective on the world science system. Scientometrics, 78, 23–36.

    Article  Google Scholar 

  • Melero, R. (2015). Altmetrics: A complement to conventional metrics. Biochemia Medica, 25(2), 152–160.

    Article  Google Scholar 

  • Merton, R. K. (1968). The Matthew effect in science. Science, 159(3810), 56–63.

    Article  Google Scholar 

  • Moed, H. F., & Halevi, G. (2016). On full text download and citation distributions in scientific-scholarly journals. Journal of the Association for Information Science and Technology, 67(2), 412–431.

    Article  Google Scholar 

  • Mohammadi, E., Thelwall, M., Haustein, S., & Lariviere, V. (2015). Who reads research articles? an altmetrics analysis of mendeley user categories. Journal of the Association for Information Science and Technology, 66(9), 1832–1846.

    Article  Google Scholar 

  • Morales, A. J., Borondo, J., Losada, J. C., & Benito, R. M. (2014). Efficiency of human activity on information spreading on Twitter. Social Networks, 39(1), 1–11.

    Article  Google Scholar 

  • Neuhaus, C., & Daniel, H.-D. (2009). A new reference standard for citation analysis in chemistry and related fields based on the sections of Chemical Abstracts. Scientometrics, 78(2), 219–229.

    Article  Google Scholar 

  • Neylon, C., & Wu, S. (2009). Article-level metrics and the evolution of scientific impact. PLoS Biology, 7(11), e1000242.

    Article  Google Scholar 

  • Ortega, J. L. (2016). To be or not to be on twitter, and its relationship with the tweeting and citation of research papers. Scientometrics, 109(2), 1353–1364.

    Article  Google Scholar 

  • Peters, H. P. F., & van Raan, A. F. J. (1994). On determinants of citation scores: A case study in chemical engineering. Journal of the American Society for Information Science, 45(1), 39–49.

    Article  Google Scholar 

  • Piwowar, H., Priem, J., Larivière, V., Alperin, J. P., Matthias, L., Norlander, B., et al. (2018). The state of OA: a large-scale analysis of the prevalence and impact of Open Access articles. PeerJ, 6, e4375.

    Article  Google Scholar 

  • Priem, J. (2014) In B. Cronin, & C. R. Sugimoto (Eds.), Beyond Bibliometrics: Harnessing Multidimensional Indicators of Scholarly Impact (pp. 263–287). Cambridge, Britain, MIT Press.

  • Priem, J., & Hemminger, B. M. (2010). Scientometrics 2.0: New metrics of scholarly impact on the social Web. First Monday, 15(7), 16.

    Google Scholar 

  • Priem, J., Piwowar, H. A., & Hemminger, B. M. (2012). Altmetrics in the wild: Using social media to explore scholarly impact. Arxiv preprint, 1203, 4745.

    Google Scholar 

  • Saberi, M. K., & Ekhtiyari, F. (2019). Usage, captures, mentions, social media and citations of LIS highly cited papers: An altmetrics study. Performance Measurement and Metrics, 20(1), 37–47.

    Article  Google Scholar 

  • Shu, F., & Haustein, S. (2017). On the citation advantage of tweeted papers at the journal level. Proceedings of the Association for Information Science and Technology, 54(1), 366–372.

    Article  Google Scholar 

  • Shu, F., Lou, W., & Haustein, S. (2018). Can twitter increase the visibility of Chinese publications? Scientometrics, 116(1), 505–519.

    Article  Google Scholar 

  • Strevens, M. (2006). The role of the Matthew effect in science. Studies in History and Philosophy of Science, 37(2), 159–170.

    Article  Google Scholar 

  • Sud, P., & Thelwall, M. (2014). Evaluating altmetrics. Scientometrics, 98(2), 1131–1143.

    Article  Google Scholar 

  • The Royal Society. (2019). Select your journal. Retrieved December 25, 2019, from https://royalsociety.org/journals/authors/

  • Thelwall, M., Haustein, S., Larivière, V., & Sugimoto, C. R. (2013). Do altmetrics work? Twitter and ten other social web services. PLoS ONE, 8(5), e64841.

    Article  Google Scholar 

  • Van Noorden, R. (2014). Scientists and the social network. Nature, 512(7513), 126–129.

    Article  Google Scholar 

  • Wang, J., Alotaibi, N. M., Ibrahim, G. M., Kulkarni, A. V., & Lozano, A. M. (2017). The spectrum of altmetrics in neurosurgery: The Top 100 “Trending” articles in neurosurgical journals. World Neuros Urgery, 103, 883.

    Article  Google Scholar 

  • Wang, J., & Shapira, P. (2015). Is there a relationship between research sponsorship and publication impact? An analysis of funding acknowledgments in nanotechnology papers. PLoS ONE, 10(2), e0117727. https://doi.org/10.1371/journal.pone.0117727

    Article  Google Scholar 

  • Wang, J., & Zhang, L. W. (2018). Proximal advantage in knowledge diffusion: The time dimension. Journal of Informetrics, 12(3), 858–867.

    Article  Google Scholar 

  • Wang, M. Y., Yu, G., Xu, J. Z., He, H. X., Yu, D. R., & An, S. (2012). Development a case-based classifier for predicting highly cited papers. Journal of Informetrics, 6(4), 586–599.

    Article  Google Scholar 

  • Wang, X. W., Fang, Z. C., & Guo, X. H. (2016). Tracking the digital footprints to scholarly articles from social media. Scientometrics, 109(2), 1365–1376.

    Article  Google Scholar 

  • Wang, X. W., Liu, C., Mao, W. L., & Fang, Z. (2015). The open access advantage considering citation, article usage and social media attention. Scientometrics, 103(2), 555–564.

    Article  Google Scholar 

  • Warren, H. R., Raison, N., & Dasgupta, P. (2017). The rise of altmetrics. JAMA-Journal of the American Medical Association, 317(2), 131–132.

    Article  Google Scholar 

  • Warren, V. T., Patel, B., & Boyd, C. J. (2020). Analyzing the relationship between Altmetric score and literature citations in the Implantology literature. Clinical Implant Dentistry and Related Research, 22(1), 54–58.

    Article  Google Scholar 

  • Wasike, B. (2019). Citations gone #Social: Examining the effect of altmetrics on citations and readership in communication research. Social Science Computer Review, 39(3), 416–433. https://doi.org/10.1177/0894439319873563

    Article  Google Scholar 

  • Wilsdon, J., Allen, L., Belfiore, E., Campbell, P., Curry, S., & Hill, S. (2015). The metric tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management. Higher Education Funding Council for England.

  • Zahedi, Z., Costas, R., & Wouters, P. (2014). How well developed are altmetrics? A cross-disciplinary analysis of the presence of ‘alternative metrics’ in scientific publications. Scientometrics, 101(2), 1491–1513.

    Article  Google Scholar 

  • Zhang, G. Y., Wang, Y. Q., Xie, W. X., Du, H., Jiang, C. L., & Wang, X. W. (2020). The open access usage advantage: A temporal and spatial analysis. Scientometrics. https://doi.org/10.1007/s11192-020-03836-4

    Article  Google Scholar 

  • Zhang, L. W., & Wang, J. (2018). Why highly cited articles are not highly tweeted? A Biology Case. Scientometrics, 117(1), 495–509.

    Article  Google Scholar 

Download references

Acknowledgements

The study receives financial support from the National Natural Science Foundation of China (NSFC) (No. 72004118), and ISTIC-CLARIVATE Analytics Joint Laboratory for Scientometrics.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jue Wang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, L., Wang, J. What affects publications’ popularity on Twitter?. Scientometrics 126, 9185–9198 (2021). https://doi.org/10.1007/s11192-021-04152-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-021-04152-1

Keywords

Navigation