Abstract
Achieving satisfactory retention in online HIV prevention trials typically has proven difficult, particularly over extended timeframes. The overall aim of this study was to assess factors associated with retention in the Men’s INTernet Study II (MINTS-II), a randomized controlled trial of a sexual risk reduction intervention for men who have sex with men. Participants were recruited via e-mails and banner advertisements in December, 2007 to participate in the MINTS-II Sexpulse intervention and followed over a 12-month period. Retention across the treatment and control arms was 85.2% at 12 months. Factors associated with higher retention included: randomization to the control arm, previous participation in a study by the research team, e-mail and telephone reminders to complete a survey once it was available online, and fewer e-mail contacts between surveys. The results provide evidence that achieving satisfactory retention is possible in online HIV prevention trials, and suggest best practices for maximizing retention.
Similar content being viewed by others
References
Couper MP, Miller PV. Web survey methods: introduction. Public Opin Q. 2008;72:831–5.
Pequegnat W, Rosser BR, Bowen AM, et al. Conducting Internet-based HIV/STD prevention survey research: considerations in design and evaluation. AIDS Behav. 2007;11:505–21.
Naglieri JA, Drasgow F, Schmit M, et al. Psychological testing on the Internet: new problems, old issues. Am Psychol. 2004;59:150–62.
Wantland D, Portillo C, Holzemer W, Slaughter R, McGhee E. The effectiveness of Web-based vs non-Web-based interventions: a meta-analysis of behavioral change outcomes. J Med Internet Res. 2004;6:e40.
Griffiths F, Lindenmeyer A, Powell J, Lowe P, Thorogood M. Why are health care interventions delivered over the internet? A systematic review of the published literature. J Med Internet Res. 2006;8:e10.
Noar SM, Black HG, Pierce LB. Efficacy of computer technology-based HIV prevention interventions: a meta-analysis. AIDS. 2009;23:107–15.
Verheijden MW, Jans MP, Hildebrandt VH, Hopman-Rock M. Rates and determinants of repeated participation in a web-based behavior change program for healthy body weight and healthy lifestyle. J Med Internet Res. 2007;9:e1.
Glasgow RE, Nelson CC, Kearney KA, et al. Reach, engagement, and retention in an Internet-based weight loss program in a multi-site randomized controlled trial. J Med Internet Res. 2007;9:e11.
Alexander GL, McClure JB, Calvi JH, et al. A randomized clinical trial evaluating online interventions to improve fruit and vegetable consumption. Am J Public Health. 2010;100:319–26.
Stevens VJ, Funk KL, Brantley PJ, et al. Design and implementation of an interactive website to support long-term maintenance of weight loss. J Med Internet Res. 2008;10:e1.
Lorig KR, Ritter PL, Dost A, Plant K, Laurent DD, McNeil I. The expert patients programme online, a 1-year study of an Internet-based self-management programme for people with long-term conditions. Chronic Illn. 2008;4:247–56.
West R, Gilsenan A, Coste F, et al. The ATTEMPT cohort: a multi-national longitudinal study of predictors, patterns and consequences of smoking cessation; introduction and evaluation of internet recruitment and data collection methods. Addiction. 2006;101:1352–61.
Koski-Jannes A, Cunningham J, Tolonen K. Self-assessment of drinking on the Internet—3-, 6- and 12-month follow-ups. Alcohol Alcohol. 2009;44:301–5.
Van’t Riet J, Crutzen R, De Vries H. Investigating predictors of visiting, using, and revisiting an online health-communication program: a longitudinal study. J Med Internet Res. 2010;12:e37.
McFarlane M, Kachur R, Klausner JD, Roland E, Cohen M. Internet-based health promotion and disease control in the 8 cities: Successes, barriers, and future plans. Sex Transm Dis. 2005;32(Supplement):S60–4.
Roberto AJ, Zimmerman RS, Carlyle KE, Abner EL. A computer-based approach to preventing pregnancy, STD, and HIV in rural adolescents. J Health Commun. 2007;12:53–76.
Bowen A, Williams M, Daniel C, Clayton S. Internet based HIV prevention research targeting rural MSM: feasibility, acceptability, and preliminary efficacy. J Behav Med. 2008;31:463–77.
Kok G, Harterink P, Vriens P, de Zwart O, Hospers H. The gay cruise: developing a theory- and evidence-based Internet HIV-prevention intervention. Sex Res Soc Policy. 2006;3:52–67.
Bull S, Lloyd L, Rietmeijer C, McFarlane M. Recruitment and retention of an online sample for an HIV prevention intervention targeting men who have sex with men: the Smart Sex Quest Project. AIDS Care. 2004;16:931–43.
Goritz A. Incentives in Web studies: methodological issues and a review. Int J Internet Sci. 2006;1:58–70.
Goritz AS, Wolff H-G. Lotteries as incentives in longitudinal Web studies. Soc Sci Comput Rev. 2007;25:99–110.
Cook C, Heath F, Thompson RL. A meta-analysis of response rates in Web- or Internet-based surveys. Educ Psychol Meas. 2000;60:821–36.
Bull S, Vallejos D, Levine D, Ortiz C. Improving recruitment and retention for an online randomized controlled trial: experience from the Youthnet study. AIDS Care. 2008;20:887–93.
Rosser BRS, Oakes JM, Horvath KJ, Konstan JA, Peterson JA. HIV sexual risk behavior by men who use the Internet to seek sex with men: results of the Men’s INTernet Sex Study-II (MINTS-II). AIDS Behav. 2009;13:488–98.
Rosser BRS, Oakes JM, Konstan J, et al. Reducing HIV risk behavior of MSM through persuasive computing: results of the Men’s INTernet Study (MINTS-II). AIDS. 2010;24(13):2099–107.
StataCorp. Stata statistical software. 9th ed. College Station: StataCorp LP; 2005.
Bowen AM, Horvath K, Williams ML. A randomized control trial of Internet-delivered HIV prevention targeting rural MSM. Health Educ Res. 2007;22(1):120–7.
Robles N, Flaherty DG, Day NL. Retention of resistant subjects in longitudinal studies: description and procedures. Am J Drug Alcohol Abuse. 1994;20:87–100.
Evans ME, Mejia-Maya LJ, Zayas LH, Boothroyd RA, Rodriguez O. Conducting research in culturally diverse inner-city neighborhoods: some lessons learned. J Transcult Nurs. 2001;12:6–14.
Steinhauser KE, Clipp EC, Hays JC, et al. Identifying, recruiting, and retaining seriously-ill patients and their caregivers in longitudinal research. Palliat Med. 2006;20:745–54.
James N, Busher H. Credibility, authenticity and voice: dilemmas in online interviewing. Qual Res. 2006;6:403–20.
Rosser B, Gurak L, Horvath KJ, Oakes J, Konstan J, Danilenko GP. The challenges of ensuring participant consent in Internet-based sex studies: a case study of the men’s INTernet sex (MINTS-I and II) studies. J Comput Mediat Commun. 2009;14:602–26.
Schulz CH, Wasserman J, Ostwald SK. Recruitment and retention of stroke survivors: The CAReS Experience. Phys Occup Ther Geriatr. 2006;25:17–29.
Wipke-Tevis DD, Pickett MA. Impact of the Health Insurance Portability and Accountability Act on participant recruitment and retention. West J Nurs Res. 2008;30:39–53.
Formica M, Kabbara K, Clark R, McAlindon T. Can clinical trials requiring frequent participant contact be conducted over the Internet? Results from an online randomized controlled trial evaluating a topical ointment for herpes labialis. J Med Internet Res. 2004;6:e6.
McFarlane M, Bull SS, Reitmeijer CA. The Internet as a newly emerging risk environment for sexually transmitted diseases. J Am Med Assoc. 2000;284:443–6.
Acknowledgement
Funding for this study was provided by the National Institute of Mental Health (grant 5 R01 MH063688-05). We express our appreciation to the study participants for their time and effort devoted to this research.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Horvath, K.J., Nygaard, K., Danilenko, G.P. et al. Strategies to Retain Participants in a Long-term HIV Prevention Randomized Controlled Trial: Lessons from the MINTS-II Study. AIDS Behav 16, 469–479 (2012). https://doi.org/10.1007/s10461-011-9957-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10461-011-9957-3