World J Mens Health. 2020 Oct;38(4):591-598. English.
Published online Apr 10, 2020.
Copyright © 2020 Korean Society for Sexual Medicine and Andrology
Original Article

Social Media Sensationalism in the Male Infertility Space: A Mixed Methodology Analysis

Kassandra E. Zaila,1,2 Vadim Osadchiy,1,2 Robert H. Shahinyan,1,2 Jesse N. Mills,1 and Sriram V. Eleswarapu1,2
    • 1Division of Andrology, Department of Urology, David Geffen School of Medicine, University of California, Los Angeles, CA, USA.
    • 2Consortium for Health Activity on Social Media (CHASM), David Geffen School of Medicine, University of California, Los Angeles, CA, USA.
Received January 17, 2020; Revised March 08, 2020; Accepted March 19, 2020.

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Purpose

Infertile couples increasingly turn to the internet for medical guidance. The aims of this study were: (1) to identify popular male infertility content on social media, and (2) to assess the accuracy and quality of this content. We hypothesized that inaccurate/misleading information proliferates online.

Materials and Methods

We used the analytics module BuzzSumo to identify article links that were most shared on Facebook, Pinterest, Reddit, and Twitter related to male infertility during September 2018 to August 2019. We excluded articles with <100 engagements, defined as “likes,” “comments,” and “shares.” Two researchers graded content as accurate, misleading, or inaccurate by comparing content to references cited and contemporary research. Inter-rater reliability was determined with Cohen's κ. Binary logistic regression was performed to compare user engagement with accurate versus inaccurate/misleading articles.

Results

Fifty-two unique article links were identified, with 421,004 total engagements. Thirty-four articles referenced 15 scientific studies; no reference was available for 18 links. Fifty-six percent of articles were accurate and 44% misleading/inaccurate (κ=0.743). No significant difference was found in total engagement between accurate vs. misleading/inaccurate links (p=0.805). Twenty-four percent of engagements referenced studies using non-human models, and 26% of studies had sample sizes <100.

Conclusions

Social media platforms foster engagement with male infertility information. However, sensationalism predominates, as patients are highly likely to encounter misleading/inaccurate information, articles that overstate implications of animal research, and conclusions made based on limited sample sizes. Urologists should consider adding social media to their armamentarium to stave off misinformation and engage proactively with patients.

Keywords
Infertility, male; Internet; Social media; Sperm

INTRODUCTION

The internet has profoundly altered how individuals obtain information regarding their health [1], and men's health is no exception. Although men are less likely than women to pursue preventative health care and more likely to develop chronic cardiovascular and metabolic disease [2, 3], the rise of online social media platforms may play a role in challenging this disproportion.

Men contending with infertility increasingly turn to social media platforms for information, guidance, and discussion with peers. A male factor contributes to nearly 60% of all cases of infertility [4], yet cultural and societal constructs of masculinity create psychosocial barriers to consultation with a physician. Social media platforms enfranchise men to take an active role in understanding causes and treatments for infertility by providing anonymity absent from face-to-face encounters [5].

Although health information online is becoming more readily accessible, it escapes the scrutiny of scientific publication guidelines, allowing for the propagation of non-evidenced-based material. Social media tends to amplify the most sensational content and headlines. Literature assessing the quality of male infertility content available online remains scarce, although a recent review has shown that urological conditions as a whole suffer from a spread of misinformation on social media [6]. Social media analytics tools have emerged that provide detailed, quantitative metrics, but these tools have not yet been applied to content in the male infertility space.

Given the proliferation of sensationalism on social media, we hypothesized that content about male infertility shared on social media platforms may be largely inaccurate or misleading. Using a combination of an analytics tool and a quality rating system, we performed a quantitative and qualitative analysis of male infertility content shared on social media. These data may inform how men's health specialists should approach patient education about male infertility, as well as ways in which they engage with social media in the future.

MATERIALS AND METHODS

1. Study methods

We used the social media analytics tool BuzzSumo (www.buzzsumo.com, London, UK) to identify the most shared male infertility content from September 2018 through August 2019. BuzzSumo gathers data across the social media platforms Facebook, Pinterest, Reddit, and Twitter to generate a list of article links with the highest online engagement. Engagement is defined as the total number of interactions that users have with a particular article link, including actions, such as “liking,” “commenting,” and “sharing” on social media [7].

Two urologists with advanced fellowship training in male reproductive medicine initially screened a total of 20 search terms related to male infertility using BuzzSumo. Ten terms were then selected based on having the highest total engagements (1,000 or more engagements) for BuzzSumo interrogation: fertility in men, low sperm treatment, male fertility, male fertility testosterone, male infertility, semen analysis, sperm count, sperm motility, sperm quality, and sperm testosterone. Terms were further excluded if no associated article links generated sufficient engagement (100 or more engagements [8]).

Fig. 1 summarizes the workflow for selecting article links from final search term results. The most popular article links for each search term were identified, followed by analysis of social media engagement. Links were excluded if they were not written in the English language, were not related to male infertility, were audio podcasts, were broken/expired, or had fewer than 100 total engagements, a metric that has been used in prior investigations to exclude low impact content [8].

Fig. 1
Methodology for content assessment using a quantitative social media analytics tool.

Two medical student reviewers with curricular training in critical evaluation of the literature independently graded content as accurate, misleading, or inaccurate by assessing references cited, as well as comparing the content to existing peer-reviewed literature (Supplement Table). Article links were classified as inaccurate if the content was not supported by scientific literature. Content was classified as misleading if it contained a combination of accurate and inaccurate information, or if it extrapolated animal data to make inappropriate conclusions about human fertility. The senior authors, two urologists with advanced fellowship training in male reproductive medicine, were blinded to the two reviewer decisions and adjudicated all discordances.

Cohen's κ was used to calculate inter-rater reliability between the two independent reviewers. Binary logistic regression was used to compare user engagement with accurate versus inaccurate/misleading article links; a separate regression was run for total engagement, to limit collinearity among variables. Statistical significance was set at p<0.05. Statistical analysis was performed using IBM SPSS ver. 25 (IBM Corp., Armonk, NY, USA).

2. Ethics statement

Consistent with previous investigations on social media data, this work was exempt by the Institutional Review Board of the University of California, Los Angeles as it involves publicly available data and does not involve human subjects.

RESULTS

After applying exclusion criteria, eight search terms and 52 article links remained. Of the original ten search terms, the two exclusions due to insufficient engagement were “male fertility testosterone” and “low sperm treatment.” The 52 article links were stratified into four categories: (1) scientific peer-reviewed journal, (2) medical center or hospital affiliated website, (3) news organization website, and (4) alternative media (e.g., blog, marketing agency). Overall, the majority of links came from websites in the alternative media category (54%), followed by news organizations (37%). Scientific peer-reviewed journal websites and medical center websites comprised the fewest article links, at 8% and 2%, respectively. High-engagement articles hosted on alternative media websites were more accurate (57%) compared to misleading/inaccurate (43%). Articles from each remaining category tended to have similar user engagement between accurate and misleading/inaccurate content (Table 1).

Table 2 outlines engagement data stratified by search term and social media platform. “Sperm count” emerged as the most popular search term, capturing 50% of the total engagement across all platforms. Facebook was the most popular platform for sharing male infertility content (average of 6,297 engagements per link), followed by Reddit (1,687), Twitter (113), and Pinterest (0.5). All search terms experienced highest engagement on Facebook, with the exception of “fertility in men,” which was most popular on Reddit.

Table 2
Search term engagements by social media platform

Overall, 56% of articles were graded as accurate and 44% as misleading or inaccurate (κ=0.743). No significant difference was found in engagements between accurate versus inaccurate/misleading links (Table 3).

Table 3
Statistical comparison of engagement by platform with graded accuracy of article links

Fifteen peer-reviewed research studies comprised the primary citations used by 34 of the 52 total articles links (Table 4) [9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22]. The remaining 18 links did not cite original peer-reviewed scientific studies, or purported study data were not accessible. Of the 34 links with scientific evidence, 17 (50%) referenced the same two original research studies and captured twice as many engagements as the remaining 13 studies combined. Studies relying upon animal or insect models comprised 24% of total engagements, and 90% of these links were graded as misleading. Among all 15 peerreviewed studies, 26% had sample sizes <100 subjects. The highest user engagement was found for article links discussing the effects of cannabis and chemical contaminants on sperm characteristics.

Table 4
Characteristics of studies referenced online

DISCUSSION

Though male infertility content proliferates on the internet, little is known about the sources and quality of information encountered by users who may make health care decisions based on what they read online. Prior work has shown that misinformation about urological conditions thrives on social media [6], but an in-depth analysis of male infertility content has been lacking. To this end, we quantified internet user engagement with male infertility content across a variety of social media platforms, then evaluated the accuracy of information shared on these platforms.

We found that social media users encounter misleading or inaccurate information about male infertility at similar rates to accurate content. Nearly a quarter of user engagement focused on article links reporting on experimental results in non-human models, and 90% of these articles were determined to be misleading — the original studies were routinely misinterpreted as having immediate implications for human fertility, then amplified on social media. For example, in a study by Sales et al [23], male insects exposed to increasing heatwave conditions (thermal incubation) had significantly lower sperm function and offspring production, and this effect showed transgenerational impact. The study draws no conclusions about human fertility, yet an article in USA Today reported, “…[T]he scientists used beetles to test their theory. But researchers say the insects can be used as a proxy for people,” [24] and concluded that human fertility is directly impacted by climate change. Despite the inappropriate extrapolation, the USA Today link alone received a total of 21,812 social media engagements.

We found that over 90% of male infertility content online comes from non-peer-reviewed sources, such as news organizations and alternative media (e.g., blogs and marketing websites). These data suggest that the scientific and medical establishment have limited traction with an increasingly sensationalized consumer culture. Scientific journal and medical center websites typically target their male infertility content toward scientifically literate health care professionals, rather than the general public. A potential way to mitigate the misinterpretation of scientific research may be for academic institutions to take a greater role in creating press releases or making researchers available for news media comment.

The proliferation of misleading conjectures about scientifically sound research becomes subjected to the “illusory truth effect,” the tendency to believe false information to be accurate due to repeated exposure [25]. Sensationalism on social media perpetuates unrealistic expectations of fertility treatments and can have significant economic implications for infertile couples, whose out-of-pocket expenditures related to male factor infertility may reach $15,000 in their quest to conceive a pregnancy [26]. Indeed, a thriving market for male fertility vitamins and nutritional supplements has emerged online despite a paucity of evidence for a positive effect on semen analysis parameters [27].

Although 15 research studies were cited in article links over the one-year study period, just two of these studies drew 50% of citations [9, 10]. The most popular study (140,926 engagements) focused on the effect of marijuana smoking on sperm parameters and reproductive hormones, and the authors of this study cautioned that their data may not be generalizable to men from the general population [10]. The other study that drew the second highest engagements (73,024) examined the effect of chemical exposures on sperm function using a limited sample size of only nine humans and a comparison group of eleven canines [9], yet was featured in an article link that inappropriately generalized the data to imply wide translatability of the results [28]. Our findings suggest that a few studies are tokenized and amplified to guide discussion about male infertility on social media, despite having crucial limitations that are overlooked.

We also found that the most popular social media platform to share male infertility content was Facebook with 3× more engagements than Reddit and 56× more engagements than Twitter (Table 2). Facebook's higher level of engagement may be attributed to its indepth engagement dimensions and primary purpose of connecting with friends and family. For example, Facebook has a larger audience of various age ranges and users have the ability to share videos and engage with posts on a longer-term basis [29]. This is in stark contrast to Twitter, whose primary purpose is to share ideas in 140 characters or less in a fast-paced nature making it difficult for posts to gain traction for very long as posts become quickly buried by new Tweets [29]. Reddit is another platform which allows for longer-term engagement with conversations within Reddit subforums, which may account for it being the platform with the second highest engagements. Our findings suggest that platforms with the ability to keep posts visible to users for longer periods of time plays a role in overall engagements.

Overall, our study findings highlight the need to facilitate online health interventions designed to offer users men's health information that is both accurate, engaging, and tailored to the general public. Discussions about male infertility are no longer occurring in the confines of medical offices and urologists should consider adding social media to their armamentarium to stave off misinformation and engage proactively with patients.

The present study is not without limitations. This study focuses only on the accuracy and engagement of male infertility content; little is known on how that engagement directly influences an individual's behaviors beyond the act of “sharing,” “liking” or “commenting” on social media. We acknowledge that engagement with the content on social media does not equate to attributing the links content to be accurate by the user. Additionally, our study has the underlying assumption that all social media platforms allow users to engage similarly without accounting for the unique experience and engagement dimensions each platform offers. Further investigation into this topic may allow for better stratification of how users engage with male infertility content.

CONCLUSIONS

Male infertility content on social media is widely shared, but sensationalism predominates, as misleading and inaccurate information tends to be amplified by user engagement. To our knowledge, this is the first study to use social media analytics in the male infertility space. Overall, implementing the use of social media metrics allows for better understanding of how internet users engage with male infertility content and may aid urologists in creating content that is tailored to men's needs and ensures a wider audience reach.

Supplementary Materials

Supplementary materials can be found via https://doi.org/10.5534/wjmh.200009.

Supplement Table

Quality rating designated independently by two independent reviewers with training in critical evaluation of literature

Click here to view.(194K, pdf)

Notes

Conflict of Interest:Sriram V. Eleswarapu is a consultant for Metuchen Pharmaceuticals. Jesse N. Mills is a consultant for Antares Pharma, Boston Scientific, and Endo Pharmaceuticals. The other authors have nothing to disclose.

Author Contribution:

  • Conceptualization: KEZ, VO, RHS, SVE.

  • Data curation: KEZ, VO, RHS, SVE.

  • Formal analysis: KEZ, VO, RHS, JNM, SVE.

  • Funding acquisition: SVE.

  • Investigation: KEZ, VO, RHS, SVE.

  • Methodology: KEZ, VO, RHS, JNM, SVE.

  • Project administration: JNM, SVE.

  • Resources: JNM, SVE.

  • Software: KEZ, VO, RHS, SVE.

  • Supervision: JNM, SVE.

  • Validation: VO, SVE.

  • Visualization: JNM, SVE.

  • Writing — original draft: KEZ.

  • Writing — review & editing: KEZ, VO, RHS, JNM, SVE.

ACKNOWLEDGEMENTS

Sriram V. Eleswarapu is supported by a Research Scholar Award from the Urology Care Foundation and the American Urological Association. These organizations played no role in the collection, analysis, and interpretation of data, in the writing of the manuscript, and in the decision to submit the manuscript for publication.

The authors thank Mr. Manuel A. Ardines, for his technical assistance on figure preparation.

Data Sharing Statement

The data analyzed for this study have been deposited in HARVARD Dataverse and are available at https://doi.org/10.7910/DVN/H4ASMP.

References

    1. Cotten SR. Implications of internet technology for medical sociology in the new millennium. Sociol Spectr 2001;21:319–340.
    1. Farrimond H. Beyond the caveman: rethinking masculinity in relation to men's help-seeking. Health (London) 2012;16:208–225.
    1. Wang Y, Hunt K, Nazareth I, Freemantle N, Petersen I. Do men consult less than women? An analysis of routinely collected UK general practice data. BMJ Open 2013;3:e003320
    1. Quallich SA. Male factor infertility: an area of health disparity. J Nurse Pract 2016;12:e235–e236.
    1. Hanna E, Gough B. Searching for help online: an analysis of peer-to-peer posts on a male-only infertility forum. J Health Psychol 2018;23:917–928.
    1. Loeb S, Taylor J, Borin JF, Mihalcea R, Perez-Rosas V, Byrne N, et al. Fake news: spread of misinformation about urological conditions on social media. Eur Urol Focus 2020;6:437–439.
    1. Teoh JY, Mackenzie G, Tortolero L, Rivas JG. Social media analytics: What you need to know as a urologist. Eur Urol Focus 2020;6:434–436.
    1. Alsyouf M, Stokes P, Hur D, Amasyali A, Ruckle H, Hu B. ‘Fake news’ in urology: evaluating the accuracy of articles shared on social media in genitourinary malignancies. BJU Int. 2019 [doi: 10.1111/bju.14787]
      [Epub].
    1. Sumner RN, Tomlinson M, Craigon J, England GCW, Lea RG. Independent and combined effects of diethylhexyl phthalate and polychlorinated biphenyl 153 on sperm quality in the human and dog. Sci Rep 2019;9:3409
    1. Nassan FL, Arvizu M, Mínguez-Alarcón L, Williams PL, Attaman J, Petrozza J, et al. EARTH Study Team. Marijuana smoking and markers of testicular function among men from a fertility centre. Hum Reprod 2019;34:715–723.
    1. Tiegs AW, Landis J, Garrido N, Scott RT Jr, Hotaling JM. Total motile sperm count trend over time: evaluation of semen analyses from 119,972 men from subfertile couples. Urology 2019;132:109–116.
    1. Yildirim ME, Kaynar M, Badem H, Cavis M, Karatas OF, Cimentepe E. What is harmful for male fertility: cell phone or the wireless Internet? Kaohsiung J Med Sci 2015;31:480–484.
    1. Chang S, Nazem TG, Gounko D, Lee J, Bar-Chama N, Shamonki JM, et al. Eleven year longitudinal study of U.S. sperm donors demonstrates declining sperm count and motility. Fertil Steril 2018;110:e54–e55.
    1. Shen ZQ, Shi B, Wang TR, Jiao J, Shang XJ, Wu QJ, et al. Characterization of the sperm proteome and reproductive outcomes with in vitro, fertilization after a reduction in male ejaculatory abstinence period. Mol Cell Proteomics 2019;18 Suppl 1:S109–S117.
    1. Murphy SK, Itchon-Ramos N, Visco Z, Huang Z, Grenier C, Schrott R, et al. Cannabinoid exposure and altered DNA methylation in rat and human sperm. Epigenetics 2018;13:1208–1221.
    1. Nassan F, Jørgensen N, Jensen T, Priskorn L, Halldorsson T, Chavarro J. Dietary patterns and testicular function in young men; Paper presented at: the 35th Annual Meeting of European Society of Human Reproduction and Embryology; 2019 Jun 23–26; Vienna, Austria. pp. 132.
    1. Rahban R, Priskorn L, Senn A, Stettler E, Galli F, Vargas J, et al. Semen quality of young men in Switzerland: a nationwide cross-sectional population-based study. Andrology 2019;7:818–826.
    1. Hamilton TR, Mendes CM, de Castro LS, de Assis PM, Siqueira AF, Delgado Jde C, et al. Evaluation of lasting effects of heat stress on sperm profile and oxidative status of ram semen and epididymal sperm. Oxid Med Cell Longev 2016;2016:1687657
    1. Umehara T, Tsujita N, Shimada M. Activation of Toll-like receptor 7/8 encoded by the X chromosome alters sperm motility and provides a novel simple technology for sexing sperm. PLoS Biol 2019;17:e3000398
    1. Lee Y, Dang JT, Switzer N, Yu J, Tian C, Birch DW, et al. Impact of bariatric surgery on male sex hormones and sperm quality: a systematic review and meta-analysis. Obes Surg 2019;29:334–346.
    1. Arafa M, Majzoub A, Agarwal A, Alsaid S, Elbardisi H. Is there a role for oral antioxidants in the treatment of infertile men with high sperm DNA fragmentation? [Internet]. Doha: Hamad Medical Corporation; c2018 [cited 2019 Dec 15].
    1. Hosseini B, Nourmohamadi M, Hajipour S, Taghizadeh M, Asemi Z, Keshavarz SA, et al. The effect of omega-3 fatty acids, EPA, and/or DHA on male infertility: a systematic review and meta-analysis. J Diet Suppl 2019;16:245–256.
    1. Sales K, Vasudeva R, Dickinson ME, Godwin JL, Lumley AJ, Michalczyk Ł, et al. Experimental heatwaves compromise sperm function and cause transgenerational damage in a model insect. Nat Commun 2018;9:4771
    1. Rice, D. Sperm don't like heat, so climate change could damage male fertility, study says [Internet]. McLean (VA): USA TODAY; c2018 [cited 2019 Dec 15].
    1. Pennycook G, Cannon TD, Rand DG. Prior exposure increases perceived accuracy of fake news. J Exp Psychol Gen 2018;147:1865–1880.
    1. Leung AK, Henry MA, Mehta A. Gaps in male infertility health services research. Transl Androl Urol 2018;7 Suppl 3:S303–S309.
    1. Kuchakulla M, Soni Y, Patel P, Parekh N, Ramasamy R. A systematic review and evidence-based analysis of ingredients in popular male fertility supplements. Urology 2020;136:133–141.
    1. Houser K. Sperm quality is falling. Chemicals in your home may be to blame [Internet]. New York: Futurism; c2019 [cited 2019 Dec 15].
    1. Forsey C. Twitter, Facebook, or Instagram? Which platform(s) you should be on [Internet]. Cambridge (MA): HubSpot; c2020 [cited 2020 Mar 8].

Metrics
Share
Figures

1 / 1

Tables

1 / 4

PERMALINK