Skip to content
ALL Metrics
-
Views
64
Downloads
Get PDF
Get XML
Cite
Export
Track
Study Protocol

Implementation of telemedicine consultations for people with mental health conditions in the community: a protocol for a systematic review

[version 1; peer review: 2 approved with reservations]
PUBLISHED 06 Dec 2021
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

Abstract

Background: The COVID-19 pandemic response has led to an exponential increase in the use and spread of telemedicine internationally. In community mental health care settings, telemedicine services were implemented within a few weeks, with little time for rigorous planning. Despite the reported acceptability of telemedicine by patients and clinicians, barriers to its implementation have come to light. There is now a need to investigate these barriers, and facilitators, as telemedicine begins to show potential promise beyond the pandemic. We propose a review that aims to identify the factors affecting the implementation of telemedicine consultations for patients with mental health conditions in the community.
Methods: A systematic review will be conducted and reported according to the PRISMA guidelines. Five electronic databases will be searched using a pre-defined search strategy from 2016 to 2021. Only studies of synchronous, interactive telemedicine consultations conducted via video, phone or live messaging between patients and providers will be included. Quantitative, qualitative and mixed methods studies will be eligible for inclusion. Only studies published in the English language will be included. Titles and abstracts will be screened by two reviewers. Full text articles will be screened by a single reviewer, with a random 20% sample screened by a second reviewer. The methodological quality of studies will be assessed using the Mixed Method Appraisal Tool (MMAT) by two reviewers. Data will be extracted and tabulated to address the aims of the review. A narrative synthesis will be conducted and reported factors will be mapped to the domains of the Consolidated Framework for Implementation Research (CFIR).
Conclusion: By identifying the factors that influence the implementation of telemedicine consultations for patients with mental conditions in the community, consideration can be given to both barriers and facilitators that could be addressed in future mental health services planning.
PROSPERO registration: CRD42021273422 (04/10/2021)

Keywords

telemedicine, remote consultations, telepsychiatry, mental health, COVID-19

Introduction

The COVID-19 pandemic response caused swift, unprecedented changes in the delivery of healthcare. One such change was the rapid and widespread expansion of telemedicine services to comply with social distancing policies and reduce the spread of the virus1,2. Telemedicine is defined as the provision of healthcare at a distance through telecommunications and information technologies3. Worldwide, longstanding regulatory barriers to telemedicine delivery were amended to facilitate its use during the pandemic4. In community settings, telemedicine allowed for the continued and essential access to mental health services during the pandemic. This use of telemedicine in mental health care is often referred to as telepsychiatry, or telemental health, and is defined as the use of telecommunication for the provision or support of psychiatric services over a distance5. Heterogeneous definitions of telemedicine exist in the literature, so for the purposes of this review, telemedicine refers to live, synchronous remote consultations between provider and patient, using video, audio, or live messaging modalities.

In the past two decades, telemedicine in mental health care has emerged as a safe and acceptable method of improving mental health care access for those who are disenfranchised or hard-to-reach. Systematic reviews and meta-analyses have shown that treatment effects of telepsychiatry are comparable to face-to-face mental health care69. There is also a body of evidence supporting the equivalence of telepsychiatry to face-to-face care with regards to patient satisfaction and therapeutic alliance1012. Despite a steady increase in use and evidence for its effectiveness, telemedicine constitutes a small portion of all mental health services prior to the pandemic13,14. The under-utilisation of telemedicine in mental health services is attributed to a number of reasons including strict licensure regulations and insurance policies that limit the reimbursement of telemedicine services15,16 and reluctance by clinicians17,18.

The rapid and highly variable adoption of telemedicine in mental health care settings during the COVID-19 pandemic has shed some light on this research- implementation gap. A number of challenges and barriers have come to light, including lack of technological infrastructure, privacy concerns, difficulty in establishing rapport and problems with conducting high quality assessments19,20. Despite these challenges, patients and clinicians have reported satisfaction with, and acceptance of, telepsychiatry services during the pandemic21,22. Moreover, some patients and service users have expressed the desire to continue to use telepsychiatry services in the future14,23; a view mirrored by policy makers and mental health professionals24,25. To harness the possible potential of telemedicine in future mental health care, a systematic exploration of the factors that affect successful telemedicine implementation in community mental health services is now needed. Identifying these factors, both enabling and hindering, will help ensure its acceptable and effective use going forward.

To gain a thorough understanding of the factors that influence the implementation of telemedicine into community mental health services, a strong theoretical foundation to guide interpretation of these factors is required. Various theories, models and frameworks have been developed in the area of implementation research to understand the determinants of translating research into practice26. One such framework is the Consolidated Framework for Implementation Research (CFIR)27. The CFIR consolidates the various terms used in implementation research into five domains considered to be important moderators or mediators of implementing practice into research27. These five domains include 1) intervention characteristics, 2) outer setting, 3) inner setting, 4) characteristics of individuals and 5) process. This framework has been used to assess the implementation of evidence-based practices in health and mental health settings28,29. The CFIR encompasses terms and concepts from numerous implementation frameworks and has therefore been selected to map the findings of this review. Its comprehensiveness allows for the categorization of various implementation factors across a variety of study designs and patient populations27, which is relevant to this review.

To our knowledge, no systematic review exists of the factors that affect implementation of telemedicine for patients with mental health conditions in community settings. In consideration of the swift and variable adoption of telemedicine in the COVID-19 pandemic, a number of overlooked factors may emerge as likely determinants of successful telemedicine implementation. This review is pertinent as mental health professionals and policy makers are now interested in the continued, long-term use of telemedicine in mental services beyond the COVID-19 pandemic13,30. Moreover, this review is particularly relevant given the unprecedented rise in mental health problems and increased demand on mental health services arising from the pandemic31,32. It is crucial that we now take stock of the available evidence regarding the challenges and successes of implementing telemedicine to identify key factors for its acceptable adoption into routine community mental health care. Subsequently, consideration can be given to solutions that address these factors by stakeholders involved in mental health services planning.

The primary aim of this review is to identify, summarise and interpret the key factors affecting the implementation of telemedicine consultations for patients with mental health conditions in the community. The secondary aim is to map these factors to the domains of the CFIR.

Protocol

This protocol has been prepared following the PRISMA-P (Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Protocols) 2015 checklist33,34 (See Reporting Guidelines). The protocol is registered on the International Prospective Register of Systematic Reviews (PROSPERO) as CRD42021273422.

Eligibility criteria

Studies will be selected for inclusion in the systematic review according to the following PEO acronym criteria (population, exposure and outcome).

Population. The population will include adults and children (aged < 18 years) with a diagnosis of a mental disorder or in receipt of care from a psychiatrist or mental health professional. Mental disorders included will be in accordance with the International Classification of Diseases (ICD-11) criteria for mental and behavioural disorders (WHO, 2019). We will include common mental disorders such as depression, generalised anxiety disorder, social anxiety disorder, obsessive-compulsive disorder and post-traumatic stress disorder. Severe mental disorders such as schizophrenia and other psychotic disorders, and bipolar disorder will also be included. Neurocognitive disorders, such as dementia, perinatal mental disorders, disorders associated with substance abuse, disorders associated with stress, eating disorders and neurodevelopmental disorders, such as ADHD, will be included. Studies that focus on people learning difficulties, intellectual disabilities, and people with mental health problems secondary due to physical illness will also be included. We will include studies which include health care professionals (e.g. doctors, nurses, allied health professionals) involved in the provision of telemedicine to patients with the above conditions.

Exposure. Studies evaluating synchronous, live, interactive telemedicine consultations between patient and provider, including video-conferencing, telephone and live-messaging only will be included. Studies will be restricted to those that use synchronous (real-time) consultations between a patient and one, or more, health care professionals. Studies will be excluded if they use asynchronous methods, in which the healthcare professional and patient do not interact in real-time, such as email communications. Studies exploring telemedicine consultations between practitioners, such as when a health care professional seeks advice from another practitioner, will be excluded.

Outcome. Studies with data on the factors that affect the implementation of telemedicine consultations for people with mental health conditions in the community will be included. Studies that explore the views and experiences of patients, parents/carers of patients, and/or healthcare professionals on the implementation of telemedicine consultations for patients with mental health conditions in the community are eligible for inclusion. Studies only exploring anticipated or hypothetical views will be excluded.

Study design. Qualitative, quantitative and mixed-methods studies will be included in the review. Systematic reviews, meta-analyses and study protocols will be excluded as they do not contain primary research. We will only include full-text studies reported in the English language, due to constraints on resources to translate studies. Grey literature will be excluded, including non-peer reviewed articles, conference proceedings, case reports, editorials, opinion papers, and letters.

Setting. Only studies in primary care, community, or outpatient settings will be included. Studies in inpatient hospital settings, residential care homes, and prisons will be excluded.

Information sources and search strategy

An initial search of the MEDLINE database will be conducted to identify articles on the topic. Five electronic databases will be systematically searched for studies published between 2016 and 2021; MEDLINE (PubMed), Embase, Web of Science, CINAHL, and APA PsycINFO. This timeframe (2016 to 2021) was chosen to include studies prior to, and during, the pandemic to ensure a comprehensive review of implementation-related factors. The search strategy will contain terms pertaining to mental health conditions, telemedicine, community settings and implementation. See Extended Data for the PubMed sample search strategy34. Forward and backward citation searches of included articles will also be conducted.

Study selection

Two reviewers (EG and JH) will independently screen titles and abstracts for all articles in order to identify studies that meet the inclusion and exclusion criteria. The full texts of all selected articles will be collected and examined by one reviewer (EG), with a 20% random sample of full text articles cross-checked by a second reviewer (JH). Any disagreements will be mediated through a third reviewer (SC). Duplicates will be excluded. A PRISMA flow chart will display the articles examined at each stage, detailing the number of papers included and excluded and reasons for exclusions.

Data extraction and management

The following data items will be extracted from all studies by one reviewer (EG):

  • 1. Author(s)

  • 2. Publication year

  • 3. Date of data collection

  • 4. Country of publication

  • 5. Study aims

  • 6. Population characteristics

  • 7. Sample size

  • 8. Study design

  • 9. Telemedicine consultation type (video/phone/messaging)

  • 10. Key relevant outcomes relating to the research question

In addition, reported factors will be extracted and categorised into the five domains of the CFIR by one reviewer (EG). Microsoft Excel software will be used to organize the extracted data. Any uncertainties regarding data will be resolved by attempting to conduct study authors via email. Selected articles will be stored and managed using EndNote X9 Reference Manager Library.

Quality assessment

Two reviewers (EG and JH) will independently assess the methodological quality of the included studies using the Mixed-Methods Appraisal Tool (MMAT) (Hong et al., 2018). Any discrepancies between study assessments will be discussed and resolved. Studies will not be excluded based on quality.

Data synthesis

One reviewer (EG) will perform a thematic synthesis on the extracted qualitative findings following Thomas and Harden’s35 guidance. This will involve coding the qualitative findings and analysing the identifying themes relating to the implementation factors. This inductive approach was chosen to ensure all relevant implementation factors were identified, including those that may not fit in an existing framework. This synthesis will be verified by a second reviewer (JH). Quantitative findings will be summarised narratively. One reviewer (EG) will map the reported factors to the five domains of the CFIR (outer-setting, inner-setting, intervention, individual or process) and present them in a table format. We will use the GRADE Confidence in the Evidence from Reviews of Qualitative Research (CERQual) to rate the overall confidence in the qualitative evidence synthesis and the narrative summaries of the quantitative data36.

Study status

The database searches were completed in August 2021. Full-text screening was completed in November 2021. It is anticipated that this review will be completed in March 2022.

Discussion

The rapid and unprecedented uptake of telemedicine since the COVID-19 pandemic has brought this modality of healthcare to the forefront of health services research. The potential of telemedicine to increase access to mental health services and alleviate the mental health burden is promising. Moreover, the satisfaction with telemedicine by patients and clinicians indicates that the partial adoption of remotely delivered mental health care may be welcomed beyond the pandemic24,37. However, challenges to its implementation in current mental health services are still present, such as the potential exacerbation of inequalities and technological barriers38. To ensure the long term sustainability of telemedicine, these issues, and many others, need to be addressed. This review will aim to shed light on the factors that may enable or hinder the implementation of telemedicine for people with mental health conditions in the community. By identifying and interpreting these factors, consideration can be given to solutions that can optimise remotely-delivered mental health care for patients in the community.

A strength of this review is the use of a determinant framework, the CFIR, to map the findings to as it aids the transferability and generalisability of findings to other implementation studies27. Furthermore, the CFIR incorporates concepts from multiple implementation theories which makes it less likely that important factors will be overlooked27. A number of steps will be undertaken to minimise the risk of meta-biases in the review. Firstly, the systematic review will be conducted and reported using the PRISMA guidelines39. Secondly, the risk of selection bias will be minimised by two independent reviewers performing title and abstract screening. Thirdly, two independent reviewers will appraise the quality of the included studies. A limitation of the review is that the studies will be restricted to those conducted in the English language due to financial constraints which may bias the results. In addition, excluding unpublished studies and grey literature may increase the risk of publication bias. Another potential limitation is the heterogeneity of implementation factors and patient populations reported in the included studies. This may make it difficult to synthesise and compare the findings from each study.

Despite these limitations, this review will be an important and timely contribution to understanding how to improve the implementation of telemedicine for patients with mental health conditions in the community. Findings of the review may advise policy makers and other stakeholders involved in the implementation of telemedicine services, informing their future development. The results of the systematic review will be reported in a peer-reviewed journal, presented at national and international conferences and included in a PhD thesis.

Data availability

Underlying data

No underlying data are associated with this article.

Extended data

Open Science Framework: Implementation of telemedicine consultations for people with mental health conditions in the community: a protocol for a systematic review. https:///doi.org/10.17605/OSF.IO/CKBEQ34.

This project contains the following extended data:

  • Sample Search Strategy PubMed.pdf (PubMed Search Strategy)

Reporting guidelines

Open Science Framework: PRISMA-P checklist for "Implementation of telemedicine consultations for people with mental health conditions in the community: a protocol for a systematic review", https:///doi.org/10.17605/OSF.IO/CKBEQ34.

Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).

Comments on this article Comments (0)

Version 3
VERSION 3 PUBLISHED 06 Dec 2021
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
VIEWS
468
 
downloads
64
Citations
CITE
how to cite this article
Galvin E, Desselle S, Gavin B et al. Implementation of telemedicine consultations for people with mental health conditions in the community: a protocol for a systematic review [version 1; peer review: 2 approved with reservations] HRB Open Res 2021, 4:125 (https://doi.org/10.12688/hrbopenres.13435.1)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 06 Dec 2021
Views
30
Cite
Reviewer Report 07 Mar 2022
Shalini Lal, School of Rehabilitation, University of Montreal, Montreal, QC, Canada 
Rossana Peredo, University of Montreal, Montreal, Canada 
Approved with Reservations
VIEWS 30
The authors present a protocol of a systematic review that aims to identify and summarize the key factors that affect the implementation of telemedicine based on recent literature. This purpose is particularly timely given that the use of telemedicine has ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Lal S and Peredo R. Reviewer Report For: Implementation of telemedicine consultations for people with mental health conditions in the community: a protocol for a systematic review [version 1; peer review: 2 approved with reservations]. HRB Open Res 2021, 4:125 (https://doi.org/10.21956/hrbopenres.14639.r30996)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 09 Jun 2022
    Emer Galvin, School of Pharmacy and Biomolecular Sciences, Royal College of Surgeons in Ireland, Dublin, Ireland
    09 Jun 2022
    Author Response
    Dear Dr Shalini Lal & Dr Rossana Peredo,

    Thank you very much for your comments. We appreciate your valuable comments and have responded to each one below.

    Comment: ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 09 Jun 2022
    Emer Galvin, School of Pharmacy and Biomolecular Sciences, Royal College of Surgeons in Ireland, Dublin, Ireland
    09 Jun 2022
    Author Response
    Dear Dr Shalini Lal & Dr Rossana Peredo,

    Thank you very much for your comments. We appreciate your valuable comments and have responded to each one below.

    Comment: ... Continue reading
Views
31
Cite
Reviewer Report 14 Feb 2022
Karen Jean Day, School of Population Health, The University of Auckland, Auckland, New Zealand 
Approved with Reservations
VIEWS 31
Thank you for the opportunity to review this literature review protocol about telemedicine consultations for people with mental health conditions in the community. Overall, it is very well-written, clearly stating the review purpose, what is planned, how it will be ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Day KJ. Reviewer Report For: Implementation of telemedicine consultations for people with mental health conditions in the community: a protocol for a systematic review [version 1; peer review: 2 approved with reservations]. HRB Open Res 2021, 4:125 (https://doi.org/10.21956/hrbopenres.14639.r31312)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 09 Jun 2022
    Emer Galvin, School of Pharmacy and Biomolecular Sciences, Royal College of Surgeons in Ireland, Dublin, Ireland
    09 Jun 2022
    Author Response
    Dear Dr Karen Day,

    Sincere thanks for your comments. We appreciate your valuable input and have responded to your comments below. Please see the amendments in the revised paper.
    ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 09 Jun 2022
    Emer Galvin, School of Pharmacy and Biomolecular Sciences, Royal College of Surgeons in Ireland, Dublin, Ireland
    09 Jun 2022
    Author Response
    Dear Dr Karen Day,

    Sincere thanks for your comments. We appreciate your valuable input and have responded to your comments below. Please see the amendments in the revised paper.
    ... Continue reading

Comments on this article Comments (0)

Version 3
VERSION 3 PUBLISHED 06 Dec 2021
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions

Are you a HRB-funded researcher?

Submission to HRB Open Research is open to all HRB grantholders or people working on a HRB-funded/co-funded grant on or since 1 January 2017. Sign up for information about developments, publishing and publications from HRB Open Research.

You must provide your first name
You must provide your last name
You must provide a valid email address
You must provide an institution.

Thank you!

We'll keep you updated on any major new updates to HRB Open Research

Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.