Abstract
Purpose of Review
Behavioral therapies are proven treatments for many neurologic conditions. However, the COVID-19 pandemic has posed significant challenges for conducting behavioral research. This article aims to (1) highlight the challenges of running behavioral clinical trials during the pandemic, (2) suggest approaches to maximize generalizability of pandemic-era studies, and (3) offer strategies for successful behavioral trials beyond the pandemic.
Recent Findings
Thousands of clinical trials have been impacted by the COVID-19 pandemic, from undergoing protocol revisions to suspension altogether. Furthermore, for ongoing trials, recruitment of diverse populations has suffered, thereby exacerbating existing inequities in clinical research. Patient adherence and retention have been affected by a myriad of pandemic-era restraints, and medical, psychiatric, and other complications from the pandemic have the potential to have long-term effects on pandemic-era study results.
Summary
In the development of post-pandemic study protocols, attention should be given to designing studies that incorporate successful aspects of pre-pandemic and pandemic-era strategies to (1) broaden recruitment using new techniques, (2) improve access for diverse populations, (3) expand protocols to include virtual and in-person participation, and (4) increase patient adherence and retention.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Behavioral therapies, such as biofeedback, cognitive behavioral therapy (CBT), and relaxation techniques, are proven, non-pharmacologic treatments for a range of neurologic conditions. They offer benefit in individuals with headache, multiple sclerosis, epilepsy, and Parkinson’s disease [1,2,3,4,5]. In related conditions, such as chronic pain, insomnia, and psychiatric disorders, a meta-analysis demonstrated that CBT alone had higher response rates than comparison conditions [6].
Clinically, behavioral therapies offer several advantages: They benefit a wide spectrum of patients, from children, to adults, to older populations [1, 7, 8]; they may be used as add-on therapies to standard medical treatments [1]; and additionally, they may provide successful monotherapy for individuals who are unable to undergo pharmacologic treatment, or for those disinclined toward typical medical therapies [1, 9, 10].
The high efficacy and wide-reaching potential of behavioral strategies underscores the importance of rigorous clinical trials to further establish therapeutic behavioral approaches. However, participation in behavioral clinical trials is often low due to participants’ lack of knowledge about these therapies, negative beliefs about behavioral treatments, decreased motivation or support for new therapies, and poor self-efficacy [11,12,13]. This behavioral research conundrum has been further exacerbated by the COVID-19 pandemic, which has hindered or halted more than 20,000 clinical trials, affecting approximately 80% of non-COVID-related studies worldwide [14, 15•]. Of the ongoing trials during the pandemic, behavioral studies arguably have been disproportionately impacted by social distancing guidelines, as behavioral studies often involve face-to-face interaction for delivery of a therapeutic intervention. Furthermore, the pandemic’s reduction in sheer number of clinical trials may disproportionally affect vulnerable patient populations [16]. Therefore, the authors suggest adopting strategies learned from the COVID-19 pandemic into current behavioral research practices both to avoid disruption in research in the future and to take advantage of successes devised during the pandemic.
Based on the authors’ behavioral clinical research experiences during the COVID-19 pandemic and upon literature review, this article aims to (1) highlight the challenges of running behavioral clinical trials during the pandemic, (2) suggest approaches to maximize generalizability of pandemic-era studies, and (3) offer strategies for successful behavioral trials beyond the pandemic.
Study Design and Institutional Review Board Approval
Challenges
During the pandemic, studies were affected by a range of institution-specific aspects of the Institutional Review Board (IRB) approval process. Many IRBs recommended human subject trials be conducted remotely to reduce the spread of the COVID-19 virus [15•]. Institutions, such as Columbia University, University of Michigan at Ann Arbor, Harvard University, and the California Institute of Technology, suspended (with limited exceptions) in-person human subjects research [17]. The inability to shift appropriately to virtual alternatives of in-person research contributed to the halting of many behavioral trials [18••]. Given the emphasis on in-person interactions in behavioral studies, these trials were at increased risk of being impacted.
Strategies
In the development of post-pandemic studies, attention should be given to implementing protocols that allow for flexibility in offering both in-person and virtual options for face-to-face interactions (e.g., virtual interviews and behavioral interventions, online and/or telephone-based surveys). Study designs should allow for flexibility in visits (virtual and in-person) without requiring IRB protocol modification [19•]. To limit in-person interactions, researchers should consider electronic distribution of study materials (e.g., email or text messages) or postal service delivery to trial participants. Extra time should be allotted to the study protocol in case of delays in research. Research teams should become familiar with their IRB’s updated, post-pandemic support systems, such as (1) educational and training sessions for investigators regarding updated IRB parameters, (2) expanded IRB virtual office hours, and (3) increased email news updates [19•].
Participant Recruitment
Challenges
For years, trials in neurology have struggled to include underrepresented populations [20, 21, 22••, 23••], resulting in diverse groups receiving decreased access to therapies offered in studies, as well as limiting the medical field’s ability to interpret study results [24]. The pandemic further impacted study recruitment, as traditional routes (e.g., flyers, brochures, and word of mouth, and routine in-person clinical visits) were affected by stay-at-home orders and social distancing [25].
Strategies
Telemedicine visits surged during the pandemic, with some neurology practices experiencing at least a 500% increase in virtual operations [26•]. The ability of the medical field to adapt to such changes demonstrates promise in new and virtual enrollment methods. Post-pandemic strategies include expanded use of digital health platforms for participant recruitment [27••] and integration of recruitment into existing clinic telehealth structures. For example, at the completion of a patient visit, a research study team member may join the telehealth visit remotely to facilitate rapid recruitment (i.e., to explain the study, confirm eligibility, and expedite consent for those interested).
Furthermore, as the field aims to expand clinical trial enrollment of underrepresented and/or vulnerable populations to improve public health inequities [28•, 29, 30], social media advertisements have emerged as a powerful tool [27••, 31•]. The benefit of recruitment through social media has additional advantages: in one clinical trial on Parkinson’s disease, recruitment via social media resulted in quicker and more cost-effective enrollment than even mass media techniques [32]. Therefore, public networks should be considered for the optimization of patient recruitment and enrollment, as in Table 1. Social media methods may include (1) advertising on Google, Facebook, and YouTube with web links to the clinical trial website; (2) implementing a Twitter campaign to raise research awareness; and (3) collaborating with online advocacy/peer-support groups related to the research topic (e.g., Parkinson’s disease support groups).
Altered Demographics of Study Participants
Challenges
The COVID-19 pandemic has variably impacted lives of many. Essential workers, parents, and others may have more demanding schedules, rendering them unable to participate in studies. Others have lost employment or no longer commute to work, resulting in perhaps more free time and interest in free access to behavioral therapies. Others who are less technologically savvy may have less interest in technology-focused studies. Patients with pre-existing health conditions may avoid in-person interactions during the pandemic. As a result, the demographics of individuals interested and able to participate in pandemic-era behavioral research may be skewed.
During the pandemic, a Pew Research Center survey of more than 5000 US full-time and part-time workers showed that most teleworkers had increased flexibility in their schedules since the start of the pandemic [33]. Although clinical research may benefit from participants with increased control over their schedules, attention to increasing diversity of recruitment is warranted. In addition, as clinical trials expand to include remote platforms, there is risk of further slanting a recruited population toward individuals who own digital tools and/or have the technical abilities to use them [15•]. One study revealed a stark digital divide in the nation: As of June 2021, about a quarter of adults with incomes below $30,000 a year did not own a smartphone; 43% did not have home broadband services; 41% did not have a computer [34]. Racial/ethnic minority community members may also be excluded disproportionately from studies, as Black and Hispanic Americans lag behind Caucasian Americans in internet adoption even after controlling for income [35•]. Therefore, relying exclusively on digital/virtual study recruitment and protocols risks exclusion of those of lower socioeconomic status and minorities.
Strategies
When planning study protocols, consider minimizing the time commitment required for the study and favor home-based behavioral treatments. Choose technologies (e.g., headache diary applications) with which patients may already be familiar. To ensure demographic transparency in virtual studies, published protocol reports should include detailed demographic information [36] to clarify how interventions may impact those of many cultures and ethnicities. To improve inclusion rates of participants from wide range of economic statuses in virtual era studies, efforts should be made to provide temporary internet access and digital devices to low-income participants (e.g., purchasing mobile hotspots for participants). These efforts are relevant both during the pandemic and beyond, particularly as the field aims to improve equity across all arenas [36].
Participant Adherence
Challenges
A range of psychological factors, such as lack of motivation, negative attitudes and beliefs, poor awareness of triggers, external locus of control, poor self-efficacy, low levels of acceptance, and engagement in maladaptive coping styles, have been observed to contribute to nonadherence in neurologic behavioral trials [11,12,13]. The pandemic arguably may have increased nonadherence rates, as influences of pandemic-related psychological changes (e.g., increased depression and anxiety) may affect patient motivation [37]. Limited in-person interactions also may contribute to decreased adherence, as communication and good rapport between researchers and participants are integral to patient retention, especially in underrepresented and/or vulnerable groups [38]. Poor adherence may contribute to inadequate participant retention, an established barrier to completing behavioral clinical trials in neurology [39].
Strategies
Devise strategies to bolster patient adherence and retention. Establish rapport with study participants early on; consider initial virtual or telephone meetings with the study coordinator to further engage participants. Ensure participants are aware of several methods through which they can contact the study coordinator (e.g., telephone, text, email, or virtual platforms) during defined on-call hours. Request permission from patients to text and/or email reminders to complete behavioral therapies. Provide participants with electronic “study news” updates. Consider incorporating additional behavioral modifications, such as motivational interviewing and/or principles of behavioral economics to help with engagement.
Generalizability of Behavioral Treatments to a Non-pandemic Era
Challenges
Conducting behavioral research during a pandemic raises concerns about generalizability of results to a non-pandemic era. In particular, the COVID-19 pandemic saw an increase in mood symptoms in the general population [37, 40]. In neurologic conditions, such as headache, comorbidities including stress, anxiety, and depression have a bidirectional relationship [41]; at the same time, therapeutic behavioral approaches used for headache also may impact mood [42•]. Therefore, pandemic-era behavioral study results may be dually confounded [43•, 44].
Furthermore, the neurological manifestations of COVID-19 (e.g., dizziness, headache, myalgias, hypogeusia, hyposmia) may overlap with the neurologic symptoms assessed in behavioral trials, affecting study results [44]. Certain medical comorbidities associated with COVID-19, including the consequences of stay-at-home orders (e.g., decreased physical activity) and the long-term effects of the COVID-19 itself in some participants, may impact study results. Therefore, caution must be taken when analyzing and interpreting results of pandemic-era behavioral studies.
Strategies
To increase generalizability to a non-pandemic era, incorporate measures to evaluate for mood- and anxiety-related comorbidities into statistical analysis. Consider studying behavioral approaches that are novel and interesting to the patient, so that patients will be engaged with therapy in both pandemic and non-pandemic times. Use behavioral techniques that are complementary to usual healthcare. Throughout the study, teach methods to incorporate behavioral strategies into patients’ daily routines. Reinforce the clinical benefits with patients during the pandemic and thereafter.
Conclusions
The COVID-19 pandemic has influenced behavioral research in a myriad of ways, and ultimately, the pandemic’s impact will be determined over time. However, the constraints of the pandemic encourage application of creative approaches to both study design and to the development of methods to improve participant recruitment, adherence, and retention, and generalizability of results in behavioral trials.
In particular, innovation in study design should be continued post-pandemic to optimize research while maintaining both in-person and virtual options for patients, as needed. Patient recruitment and retention strategies, including less traditional digital approaches, should be pursued to ensure enrollment of diverse patient populations, and to improve adherence and retention in studies. Focus groups may be performed to analyze patients’ experiences in trials during and post-pandemic. As these strategies are integrated, more research is needed to devise methods to protect clinical trials from pandemic-related or other disruptions in the future.
Overall, the pandemic has created an opportunity for researchers and clinicians to re-evaluate the established norms of clinical behavioral research, and to take a leap forward, merging the most effective aspects of pre-pandemic- and pandemic-era studies. These new approaches may be applied both during the pandemic and beyond.
References
Papers of particular interest, published recently, have been highlighted as: • Of importance •• Of major importance
Silberstein SD. Practice parameter: evidence-based guidelines for migraine headache (an evidence-based review): report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology. 2000;55(6):754–62.
Chalah MA, Ayache SS. Cognitive behavioral therapies and multiple sclerosis fatigue: a review of literature. J Clin Neurosci. 2018;52:1–4.
Michaelis R, Tang V, Wagner JL, Modi AC, LaFrance WC Jr, Goldstein LH, et al. Cochrane systematic review and meta-analysis of the impact of psychological treatments for people with epilepsy on health-related quality of life. Epilepsia. 2018;59(2):315–32.
Koychev I, Okai D. Cognitive-behavioural therapy for non-motor symptoms of Parkinson’s disease: a clinical review. Evid Based Ment Health. 2017;20(1):15–20.
Dobkin RD, Mann SL, Gara MA, Interian A, Rodriguez KM, Menza M. Telephone-based cognitive behavioral therapy for depression in Parkinson disease: a randomized controlled trial. Neurology. 2020;94(16):e1764–73.
Hofmann SG, Asnaani A, Vonk IJ, Sawyer AT, Fang A. The efficacy of cognitive behavioral therapy: a review of meta-analyses. Cogn Ther Res. 2012;36(5):427–40.
Gould RL, Coulson MC, Howard RJ. Efficacy of cognitive behavioral therapy for anxiety disorders in older people: a meta-analysis and meta-regression of randomized controlled trials. J Am Geriatr Soc. 2012;60(2):218–29.
Bergez KC, Ramirez AC, Grebe SC, Perez MI, Viana AG, Storch EA, et al. Efficacy of exposure-based cognitive behavioral therapy for youth anxiety and obsessive-compulsive disorder. Exposure therapy for children with anxiety and OCD: Elsevier; 2020. p. 21-37.
Felder JN, Epel ES, Neuhaus J, Krystal AD, Prather AA. Efficacy of digital cognitive behavioral therapy for the treatment of insomnia symptoms among pregnant women: a randomized clinical trial. JAMA Psychiat. 2020;77(5):484–92.
Meyers RS, Thackray J, Matson KL, McPherson C, Lubsch L, Hellinga RC, et al. Key Potentially Inappropriate Drugs in Pediatrics: the KIDs List. J Pediatr Pharmacol Ther. 2020;25(3):175–91.
Matsuzawa Y, Lee YSC, Fraser F, Langenbahn D, Shallcross A, Powers S, et al. Barriers to behavioral treatment adherence for headache: an examination of attitudes, beliefs, and psychiatric factors. Headache. 2019;59(1):19–31.
Minen MT, Morio K, Schaubhut KB, Powers SW, Lipton RB, Seng E. Focus group findings on the migraine patient experience during research studies and ideas for future investigations. Cephalalgia. 2020;40(7):712–34.
Langenbahn D, Matsuzawa Y, Lee YSC, Fraser F, Penzien DB, Simon NM, et al. Underuse of behavioral treatments for headache: a narrative review examining societal and cultural factors. Journal of general internal medicine 2021:1–10.
van Dorn A. COVID-19 and readjusting clinical trials. The Lancet. 2020;396(10250):523–4.
• Gaudino M, Arvind V, Hameed I, Di Franco A, Spadaccio C, Bhatt DL, et al. Effects of the COVID-19 pandemic on active non-COVID clinical trials. J Am Coll Cardiol. 2020;76(13):1605–6.. (This paper detailed how the pandemic negatively affected many active non-COVID clinical trials by halting or terminating them.)
North CM, Dougan ML, Sacks CA. Improving clinical trial enrollment—in the Covid-19 era and beyond. N Engl J Med. 2020;383(15):1406–8.
Parry M. As coronavirus spreads, universities stall their research to keep human subjects safe. The Chronicle of Higher Education 2020 03/18.
•• Loucks TL, Tyson C, Dorr D, Garovic VD, Hill J, McSwain SD, et al. Clinical research during the COVID-19 pandemic: the role of virtual visits and digital approaches. Journal of Clinical and Translational Science 2021;5(1). (This article detailed the necessity of remote capabilities in future study designs to ensure the longevity of studies.)
• Cola P, Williams M. Implications to IRB operations due to the COVID-19 pandemic. 2020; Available at: https://case.edu/medicine/ctsc/IRB-Implications-COVID-19-Pandemic. Accessed 06/21, 2021. (This article addressed how IRBs across the nation have been accommodating in-person research during the pandemic.)
Williams MM, Scharff DP, Mathews KJ, Hoffsuemmer JS, Jackson P, Morris JC, et al. Barriers and facilitators of African American participation in Alzheimer disease biomarker research. Alzheimer Dis Assoc Disord. 2010;24(Suppl):S24–9.
Ajrouch KJ, Vega IE, Antonucci TC, Tarraf W, Webster NJ, Zahodne LB. Partnering with Middle Eastern/Arab American and Latino Immigrant Communities to Increase Participation in Alzheimer’s Disease Research. Ethn Dis. 2020;30(Suppl 2):765–74.
•• Begasse de Dhaem O, Kiarashi J, Armand CE, Charleston L 4th, Szperka CL, Lee YS, et al. Ten Eleven things to facilitate participation of underrepresented groups in headache medicine research. Headache. 2021;61(6):951–60.. ((This paper acknowledged the existing challenge in including underrepresented groups in headache medicine research and revealed methods to increase participation in those groups.).)
•• Kiarashi J, VanderPluym J, Szperka CL, Turner S, Minen MT, Broner S, et al. Factors associated with, and mitigation strategies for, healthcare disparities faced by patients with headache disorders. Neurology 2021. (This paper addressed the inequities faced by underrepresented groups in headache medicine and provided strategies to solve disparities in the management of headache medicine.)
Roberts J, Waddy S, Kaufmann P. Recruitment and retention monitoring: facilitating the mission of the National Institute of Neurological Disorders and Stroke (NINDS). J Vasc Interv Neurol. 2012;5(supp):14–9.
The Physician’s Foundation. The Physicians Foundation 2020 Physician Survey: Part 1. 2020; Available at: https://physiciansfoundation.org/physician-and-patient-surveys/2020physiciansurvey/. Accessed June 29, 2021.
• McGinley MP, Ontaneda D, Wang Z, Weber M, Shook S, Stanton M, et al. Teleneurology as a solution for outpatient care during the COVID-19 pandemic. Telemedicine J E Health. 2020;26(12):1537–9.. (This source demonstrated that teleneurology is an effective way to treat neurology patients during the pandemic.)
•• Gaba P, Bhatt DL. The COVID-19 pandemic: a catalyst to improve clinical trials. Nat Rev Cardiol. 2020;17(11):673–5.. (This article emphasized the beneficial role of social media in patient recruitment to clinical trials.)
• National Academies of Sciences, Engineering, and Medicine. Communities in action: Pathways to health equity. 2017. (This article outlined solutions to maintain active clinical trials in the pandemic and highlighted the importance of continuing trials, as their suspension has led to an increase in off-trial and off-label use of medication.)
Erves JC, Mayo-Gamble TL, Malin-Fair A, Boyer A, Joosten Y, Vaughn YC, et al. Needs, priorities, and recommendations for engaging underrepresented populations in clinical research: a community perspective. J Community Health. 2017;42(3):472–80.
Brown Speights JS, Nowakowski AC, De Leon J, Mitchell MM, Simpson I. Engaging African American women in research: an approach to eliminate health disparities in the African American community. Fam Pract. 2017;34(3):322–9.
• Ali SH, Foreman J, Capasso A, Jones AM, Tozan Y, DiClemente RJ. Social media as a recruitment platform for a nationwide online survey of COVID-19 knowledge, beliefs, and practices in the United States: methodology and feasibility analysis. BMC Med Res Methodol. 2020;20:1–11.. (This study supported the usage of social media as an effective method to recruit diverse participants into studies and collect survey data rapidly.)
Agarwal P, Ray S, Burdick D. Strategizing clinical trial recruitment in the digital age (P1.9–072). Neurology 2019 05/05;92(15).
Parker K, Horowitz JM, Minkin R. How the coronavirus outbreak has – and hasn’t – changed the way Americans work. 2020; Available at: https://www.pewresearch.org/social-trends/2020/12/09/how-the-coronavirus-outbreak-has-and-hasnt-changed-the-way-americans-work/. Accessed 07/05, 2021.
Vogels EA. Digital divide persists even as Americans with lower incomes make gains in tech adoption. 2021; Available at: https://www.pewresearch.org/fact-tank/2021/06/22/digital-divide-persists-even-as-americans-with-lower-incomes-make-gains-in-tech-adoption/. Accessed 06/29, 2021.
• Lourenco SF, Tasimi A. No participant left behind: conducting science during COVID-19. Trends Cogn Sci (Regul Ed ). 2020;24(8):583–4.. (This paper showed how Black and Hispanic Americans are left behind in virtual studies that are conducted during the pandemic due to the digital divide in America.)
Fansiwala K, Southwick L, Goldmann E, Parikh NS, Madubuonwu J, Boden-Albala B. Abstract TP409: reporting of key demographic characteristics in neurological trials registered on ClinicalTrials. gov. Stroke 2017;48(suppl_1):ATP409-ATP409.
Huang Y, Zhao N. Generalized anxiety disorder, depressive symptoms and sleep quality during COVID-19 outbreak in China: a web-based cross-sectional survey. Psychiatry Res. 2020;288:112954.
Kim NH, Wilson N, Mashburn T, Reist L, Westrick SC, Look K, et al. Lessons learned recruiting a diverse sample of rural study participants during the COVID-19 pandemic. International Journal of Drug Policy 2021:103344.
Beishuizen CR, Coley N, van Charante Moll, Eric P, van Gool WA, Richard E, Andrieu S. Determinants of dropout and nonadherence in a dementia prevention randomized controlled trial: the prevention of dementia by intensive vascular care trial. J Am Geriatr Soc. 2017;65(7):1505–13.
Rizzoli P, Mullally WJ. Headache. Am J Med. 2018;131(1):17–24.
Minen MT, Begasse De Dhaem O, Kroon Van Diest A, Powers S, Schwedt TJ, Lipton R, et al. Migraine and its psychiatric comorbidities. J Neurol Neurosurg Psychiatry. 2016;87(7):741–9.
• Gazerani P. Migraine and mood in children. Behav Sci. 2021;11(4):52.. (This paper examined the bidirectional relationship between mood and migraines in children and proposed interventions to improve the quality of life in children with migraines.)
• Fleming TR, Labriola D, Wittes J. Conducting clinical research during the COVID-19 pandemic: protecting scientific integrity. JAMA. 2020;324(1):33–4.. (This paper demonstrated how concurrent illnesses with COVID-19 can confound pandemic trial results.)
Tsivgoulis G, Palaiodimou L, Katsanos AH, Caso V, Köhrmann M, Molina C, et al. <? covid19?> Neurological manifestations and implications of COVID-19 pandemic. Ther Adv Neurol Disord. 2020;13:1756286420932036.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
Ami Cuneo and Kazi Maisha each declare no potential conflict of interest.
Mia Minen has received a grant from the National Institute of Health and contributed to developing intellectual property being used in this study that is co-owned by NYU and IRODY. If the research is successful, NYU and IRODY may benefit from the outcome.
Human and Animal Rights and Informed Consent
This article does not contain any studies with human or animal subjects performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the Topical Collection on Behavior
Rights and permissions
About this article
Cite this article
Cuneo, A.Z., Maisha, K. & Minen, M.T. Strategies for Behavioral Research in Neurology: Lessons Learned During the COVID-19 Pandemic and Applications for the Future. Curr Neurol Neurosci Rep 21, 63 (2021). https://doi.org/10.1007/s11910-021-01146-7
Accepted:
Published:
DOI: https://doi.org/10.1007/s11910-021-01146-7