Skip to main content

Advertisement

Log in

Strategies to Retain Participants in a Long-term HIV Prevention Randomized Controlled Trial: Lessons from the MINTS-II Study

  • Original Paper
  • Published:
AIDS and Behavior Aims and scope Submit manuscript

Abstract

Achieving satisfactory retention in online HIV prevention trials typically has proven difficult, particularly over extended timeframes. The overall aim of this study was to assess factors associated with retention in the Men’s INTernet Study II (MINTS-II), a randomized controlled trial of a sexual risk reduction intervention for men who have sex with men. Participants were recruited via e-mails and banner advertisements in December, 2007 to participate in the MINTS-II Sexpulse intervention and followed over a 12-month period. Retention across the treatment and control arms was 85.2% at 12 months. Factors associated with higher retention included: randomization to the control arm, previous participation in a study by the research team, e-mail and telephone reminders to complete a survey once it was available online, and fewer e-mail contacts between surveys. The results provide evidence that achieving satisfactory retention is possible in online HIV prevention trials, and suggest best practices for maximizing retention.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  1. Couper MP, Miller PV. Web survey methods: introduction. Public Opin Q. 2008;72:831–5.

    Article  Google Scholar 

  2. Pequegnat W, Rosser BR, Bowen AM, et al. Conducting Internet-based HIV/STD prevention survey research: considerations in design and evaluation. AIDS Behav. 2007;11:505–21.

    Article  PubMed  Google Scholar 

  3. Naglieri JA, Drasgow F, Schmit M, et al. Psychological testing on the Internet: new problems, old issues. Am Psychol. 2004;59:150–62.

    Article  PubMed  Google Scholar 

  4. Wantland D, Portillo C, Holzemer W, Slaughter R, McGhee E. The effectiveness of Web-based vs non-Web-based interventions: a meta-analysis of behavioral change outcomes. J Med Internet Res. 2004;6:e40.

    Article  PubMed  Google Scholar 

  5. Griffiths F, Lindenmeyer A, Powell J, Lowe P, Thorogood M. Why are health care interventions delivered over the internet? A systematic review of the published literature. J Med Internet Res. 2006;8:e10.

    Article  PubMed  Google Scholar 

  6. Noar SM, Black HG, Pierce LB. Efficacy of computer technology-based HIV prevention interventions: a meta-analysis. AIDS. 2009;23:107–15.

    Article  PubMed  Google Scholar 

  7. Verheijden MW, Jans MP, Hildebrandt VH, Hopman-Rock M. Rates and determinants of repeated participation in a web-based behavior change program for healthy body weight and healthy lifestyle. J Med Internet Res. 2007;9:e1.

    Article  PubMed  Google Scholar 

  8. Glasgow RE, Nelson CC, Kearney KA, et al. Reach, engagement, and retention in an Internet-based weight loss program in a multi-site randomized controlled trial. J Med Internet Res. 2007;9:e11.

    Article  PubMed  Google Scholar 

  9. Alexander GL, McClure JB, Calvi JH, et al. A randomized clinical trial evaluating online interventions to improve fruit and vegetable consumption. Am J Public Health. 2010;100:319–26.

    Article  PubMed  Google Scholar 

  10. Stevens VJ, Funk KL, Brantley PJ, et al. Design and implementation of an interactive website to support long-term maintenance of weight loss. J Med Internet Res. 2008;10:e1.

    Article  PubMed  Google Scholar 

  11. Lorig KR, Ritter PL, Dost A, Plant K, Laurent DD, McNeil I. The expert patients programme online, a 1-year study of an Internet-based self-management programme for people with long-term conditions. Chronic Illn. 2008;4:247–56.

    Article  PubMed  Google Scholar 

  12. West R, Gilsenan A, Coste F, et al. The ATTEMPT cohort: a multi-national longitudinal study of predictors, patterns and consequences of smoking cessation; introduction and evaluation of internet recruitment and data collection methods. Addiction. 2006;101:1352–61.

    Article  PubMed  Google Scholar 

  13. Koski-Jannes A, Cunningham J, Tolonen K. Self-assessment of drinking on the Internet—3-, 6- and 12-month follow-ups. Alcohol Alcohol. 2009;44:301–5.

    PubMed  Google Scholar 

  14. Van’t Riet J, Crutzen R, De Vries H. Investigating predictors of visiting, using, and revisiting an online health-communication program: a longitudinal study. J Med Internet Res. 2010;12:e37.

    Google Scholar 

  15. McFarlane M, Kachur R, Klausner JD, Roland E, Cohen M. Internet-based health promotion and disease control in the 8 cities: Successes, barriers, and future plans. Sex Transm Dis. 2005;32(Supplement):S60–4.

    Article  PubMed  Google Scholar 

  16. Roberto AJ, Zimmerman RS, Carlyle KE, Abner EL. A computer-based approach to preventing pregnancy, STD, and HIV in rural adolescents. J Health Commun. 2007;12:53–76.

    Article  PubMed  Google Scholar 

  17. Bowen A, Williams M, Daniel C, Clayton S. Internet based HIV prevention research targeting rural MSM: feasibility, acceptability, and preliminary efficacy. J Behav Med. 2008;31:463–77.

    Article  PubMed  CAS  Google Scholar 

  18. Kok G, Harterink P, Vriens P, de Zwart O, Hospers H. The gay cruise: developing a theory- and evidence-based Internet HIV-prevention intervention. Sex Res Soc Policy. 2006;3:52–67.

    Article  Google Scholar 

  19. Bull S, Lloyd L, Rietmeijer C, McFarlane M. Recruitment and retention of an online sample for an HIV prevention intervention targeting men who have sex with men: the Smart Sex Quest Project. AIDS Care. 2004;16:931–43.

    Article  PubMed  Google Scholar 

  20. Goritz A. Incentives in Web studies: methodological issues and a review. Int J Internet Sci. 2006;1:58–70.

    Google Scholar 

  21. Goritz AS, Wolff H-G. Lotteries as incentives in longitudinal Web studies. Soc Sci Comput Rev. 2007;25:99–110.

    Article  Google Scholar 

  22. Cook C, Heath F, Thompson RL. A meta-analysis of response rates in Web- or Internet-based surveys. Educ Psychol Meas. 2000;60:821–36.

    Article  Google Scholar 

  23. Bull S, Vallejos D, Levine D, Ortiz C. Improving recruitment and retention for an online randomized controlled trial: experience from the Youthnet study. AIDS Care. 2008;20:887–93.

    Article  PubMed  CAS  Google Scholar 

  24. Rosser BRS, Oakes JM, Horvath KJ, Konstan JA, Peterson JA. HIV sexual risk behavior by men who use the Internet to seek sex with men: results of the Men’s INTernet Sex Study-II (MINTS-II). AIDS Behav. 2009;13:488–98.

    Article  PubMed  Google Scholar 

  25. Rosser BRS, Oakes JM, Konstan J, et al. Reducing HIV risk behavior of MSM through persuasive computing: results of the Men’s INTernet Study (MINTS-II). AIDS. 2010;24(13):2099–107.

    Article  PubMed  Google Scholar 

  26. StataCorp. Stata statistical software. 9th ed. College Station: StataCorp LP; 2005.

    Google Scholar 

  27. Bowen AM, Horvath K, Williams ML. A randomized control trial of Internet-delivered HIV prevention targeting rural MSM. Health Educ Res. 2007;22(1):120–7.

    Article  PubMed  Google Scholar 

  28. Robles N, Flaherty DG, Day NL. Retention of resistant subjects in longitudinal studies: description and procedures. Am J Drug Alcohol Abuse. 1994;20:87–100.

    Article  PubMed  CAS  Google Scholar 

  29. Evans ME, Mejia-Maya LJ, Zayas LH, Boothroyd RA, Rodriguez O. Conducting research in culturally diverse inner-city neighborhoods: some lessons learned. J Transcult Nurs. 2001;12:6–14.

    Article  PubMed  CAS  Google Scholar 

  30. Steinhauser KE, Clipp EC, Hays JC, et al. Identifying, recruiting, and retaining seriously-ill patients and their caregivers in longitudinal research. Palliat Med. 2006;20:745–54.

    Article  PubMed  Google Scholar 

  31. James N, Busher H. Credibility, authenticity and voice: dilemmas in online interviewing. Qual Res. 2006;6:403–20.

    Article  Google Scholar 

  32. Rosser B, Gurak L, Horvath KJ, Oakes J, Konstan J, Danilenko GP. The challenges of ensuring participant consent in Internet-based sex studies: a case study of the men’s INTernet sex (MINTS-I and II) studies. J Comput Mediat Commun. 2009;14:602–26.

    Article  Google Scholar 

  33. Schulz CH, Wasserman J, Ostwald SK. Recruitment and retention of stroke survivors: The CAReS Experience. Phys Occup Ther Geriatr. 2006;25:17–29.

    Google Scholar 

  34. Wipke-Tevis DD, Pickett MA. Impact of the Health Insurance Portability and Accountability Act on participant recruitment and retention. West J Nurs Res. 2008;30:39–53.

    Article  PubMed  Google Scholar 

  35. Formica M, Kabbara K, Clark R, McAlindon T. Can clinical trials requiring frequent participant contact be conducted over the Internet? Results from an online randomized controlled trial evaluating a topical ointment for herpes labialis. J Med Internet Res. 2004;6:e6.

    Article  PubMed  Google Scholar 

  36. McFarlane M, Bull SS, Reitmeijer CA. The Internet as a newly emerging risk environment for sexually transmitted diseases. J Am Med Assoc. 2000;284:443–6.

    Article  CAS  Google Scholar 

Download references

Acknowledgement

Funding for this study was provided by the National Institute of Mental Health (grant 5 R01 MH063688-05). We express our appreciation to the study participants for their time and effort devoted to this research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Keith J. Horvath.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Horvath, K.J., Nygaard, K., Danilenko, G.P. et al. Strategies to Retain Participants in a Long-term HIV Prevention Randomized Controlled Trial: Lessons from the MINTS-II Study. AIDS Behav 16, 469–479 (2012). https://doi.org/10.1007/s10461-011-9957-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10461-011-9957-3

Keywords

Navigation