Skip to main content

Implementation strategies in the context of medication reconciliation: a qualitative study

Abstract

Background

Medication reconciliation (MedRec) is an important patient safety initiative that aims to prevent patient harm from medication errors. Yet, the implementation and sustainability of MedRec interventions have been challenging due to contextual barriers like the lack of interprofessional communication (among pharmacists, nurses, and providers) and limited organizational capacity. How to best implement MedRec interventions remains unclear. Guided by the Expert Recommendations for Implementing Change (ERIC) taxonomy, we report the differing strategies hospital implementation teams used to implement an evidence-based MedRec Toolkit (the MARQUIS Toolkit).

Methods

A qualitative study was conducted with implementation teams and executive leaders of hospitals participating in the federally funded “Implementation of a Medication Reconciliation Toolkit to Improve Patient Safety” (known as MARQUIS2) research study. Data consisted of transcripts from web-based focus groups and individual interviews, as well as meeting minutes. Interview data were transcribed and analyzed using content analysis and the constant comparison technique.

Results

Data were collected from 16 hospitals using 2 focus groups, 3 group interviews, and 11 individual interviews, 10 sites’ meeting minutes, and an email interview of an executive. Major categories of implementation strategies predominantly mirrored the ERIC strategies of “Plan,” “Educate,” “Restructure,” and “Quality Management.” Participants rarely used the ERIC strategies of finance and attending to policy context. Two new non-ERIC categories of strategies emerged—“Integration” and “Professional roles and responsibilities.” Of the 73 specific strategies in the ERIC taxonomy, 32 were used to implement the MARQUIS Toolkit and 11 new, and non-ERIC strategies were identified (e.g., aligning with existing initiatives and professional roles and responsibilities).

Conclusions

Complex interventions like the MARQUIS MedRec Toolkit can benefit from the ERIC taxonomy, but adaptations and new strategies (and even categories) are necessary to fully capture the range of approaches to implementation.

Peer Review reports

Background

More than 50% of hospitalized patients experience one or more unintentional medication discrepancies (UMDs), defined as unexplained differences in medication regimens across different sites of care, with some having the potential for significant harm [1,2,3,4,5,6,7,8]. The majority occur during care transitions, when patients are admitted, transferred between units, or discharged home [9]. Medication reconciliation (MedRec) reduces the risk of UMDs and harmful adverse drug events [6, 7, 10,11,12,13] that increase hospitalization cost and length of stay [10, 14]. MedRec is the process of “creating the most accurate list possible of all medications a patient is taking and comparing that list against the physician’s admission, transfer, and/or discharge orders, with the goal of providing correct medications to the patient at all transition points within the hospital” [15].

MedRec implementation is complex. It requires extensive use of resources [8, 16], wide-scale organizational change [17,18,19], interprofessional collaboration [20], and workflow redesign [8, 16, 19, 21, 22]. Reports demonstrate these complexities create multiple barriers to successful MedRec implementation including a lack of role clarity, insufficient interprofessional collaboration, and limited organizational capacity including personnel resources and time commitments [10, 19, 22,23,24,25]. Despite identified MedRec implementation challenges [19, 20], and growing recognition that implementation strategies are key to successfully adopting and implementing healthcare interventions, existing MedRec studies focus predominantly on clinical outcomes of MedRec [26,27,28,29]. We know comparatively little about the specific strategies used to effectively implement MedRec interventions [30]. Furthermore, MedRec provides a good context to assess how well an existing taxonomy can be applied to describe implementation strategies used for this complex healthcare intervention. Careful consideration of how MedRec interventions are implemented and deployed in hospitals may help future efforts to overcome initial implementation barriers to successfully adopt MedRec and ensure their long-term sustainability.

Implementation strategies

Implementation strategies, defined as systematic processes used to adopt and integrate evidence-based healthcare interventions into usual care within specific settings [31], can be discrete (e.g., education) or multifaceted (e.g., asses for readiness and identify barriers) and have varying degrees of complexity (e.g., reallocate staff and change workflow). The Expert Recommendations for Implementing Change (ERIC) taxonomy [30] summarizes 73 discrete implementation strategies into six categories including plan (e.g., conduct a local need assessment), educate (e.g., develop educational materials), finance (e.g., fund clinical innovation), restructure (e.g., change record systems), quality management (e.g., audit and feedback systems), and attend to policy context (e.g., change accreditation or membership requirements). Despite general guidance regarding the effective deployment of implementation strategies [32], studies of MedRec have yet to offer detailed descriptions of the specific strategies, their deployment, and effectiveness.

MARQUIS and MARQUIS2

The Multicenter Medication Reconciliation Quality Improvement Study (i.e., MARQUIS) [1, 33] and the Implementation of a Medication Reconciliation Toolkit to Improve Patient Safety study (i.e., MARQUIS2) [25, 33], developed an evidence-based MedRec Toolkit (i.e., MARQUIS Toolkit) and evaluated the effect of the toolkit on medication discrepancies in 5 hospitals and 18 hospitals, respectively. Seventeen system-level interventions representing 8 domains comprise the latest version of the MARQUIS Toolkit [33]. In MARQUIS2, the setting for this current analysis, sites worked with an experienced mentor to implement the toolkit, with each site implementing 1 to 15 toolkit components. The most common were taking a best possible medication history (BPMH), identifying high-risk patients, clarifying roles and responsibilities among clinical staff, providing audit and feedback on MedRec roles, and identifying high-risk patients. A mentor, who had expertise in MedRec and quality improvement, was assigned to each site and conducted one site visit and monthly mentor meetings to help guide implementation. However, mentors provided only general implementation guidance (e.g., identify key stakeholders, assemble a multidisciplinary QI team analyze care delivery, and track performance)). Thus, implementation of the MARQUIS Toolkit depended upon the unique local conditions facing mentors and local implementation teams.

Objective

The first author leveraged the MARQUIS2 study to investigate contextual factors as potential drivers in the selection of implementation strategies and subsequent sustainability. As part of that study, the authors conducted a robust qualitative exploration of strategies hospitals used to implement the toolkit. This paper reports MARQUIS2 Toolkit implementation strategies and how implementation teams operationalized these strategies. Understanding these strategies and their associated operationalizations are important as MARQUIS is recognized as the premier evidence-based approach to MedRec and is being spread through the Society of Hospital Medicine’s national collaborative [34].

Methods

Study design and sample

We designed a cross-sectional descriptive qualitative study using content analysis and the constant comparison technique. Using purposive sampling, the principal investigator (PI) (DPS) recruited implementation teams, site leaders, and executive leaders for interviews. Recruitment strategies included emails and/or phone calls, phone/videoconferencing, a study flyer, and participation in monthly mentor meetings. The PI worked closely with the MARQUIS2 research team and project staff to facilitate recruitment, including obtaining a contact list of site leaders and team members from project staff and MARQUIS research staff introducing the PI and her research study to the 18 sites during mentor meetings. Site leaders aided in recruitment efforts and gaining access to eligible executive leaders. A recruitment letter was emailed to all potential participants, followed by two reminders sent at 7 and 14 days from the initial solicitation. In some instances, site leaders preferred to keep contact information confidential and instead forward the study information to executive leaders. Eligible participants were (a) employees of hospitals that participated in MARQUIS2, (b) implementation team members, or (c) be executive leaders to whom the implementation team reported [e.g., Chief Medical Officer or Chief Nursing Officer].

Data collection

The PI conduced web-based focus group (FGs) or interviews using Blue Jeans Network® web conferencing. When fewer than four participants per hospital were recruited or team members were hesitant to participate in FGs, the PI conducted individual interviews. Using private office space and assigning pseudonyms for hospitals and participants ensured confidentiality. A semi-structured interview guide developed by the research team and consisting of main questions and prompts provided the structure for the 45–50-min interviews (average of 44 min). Select constructs from the Consolidated Framework for Implementation Research (CFIR) [35] and the Stages of Implementation Completion (SIC) framework [36] HA-guided question development and capturing three distinct phases (i.e., pre-implementation, implementation, and post-implementation). Interviews/FGs were digitally recorded and transcribed. Field notes helped to inform data analysis. After encountering recruitment difficulties, monthly mentor-call meeting minutes were collected and, as an alternative to personal interviews, executive leaders were asked to respond by email to five key interview guide questions identified by the research team. Even after data saturation was evident by repetition of themes and strategies, the PI completed additional interviews with all who agreed to be interviewed to obtain representation from as many MARQUIS2 hospitals as possible.

Data analysis

The Miles and Huberman [37] framework of data reduction, data display, and drawing conclusions guided data analysis of interviews, meeting minutes, and email responses. Data reduction occurred through content analysis of transcribed interviews and focus groups, meeting minutes, and email responses. Codes were assigned to relevant data segments using an a priori codebook consisting of the six ERIC categories of plan, educate, finance, restructuring, quality management, and attend to policy context. New codes were assigned when needed and added to the Codebook. A research assistant and the PI independently coded the data and met to review codes and to resolve coding differences. The PI also consulted with faculty experts in qualitative research methods for guidance and trouble-shooting and used their Microsoft Excel template for coding the data. The accuracy of the data was facilitated through verbatim transcription and verifying the accuracy of transcription, the use of two coders and a codebook with clearly defined codes, and establishing an audit trail to record decision-making throughout the research process. The local university’s Institutional Review Board reviewed and approved the study. Informed consent was obtained prior to each focus group or interview.

Results

Sample characteristics

We invited 108 implementation team members and site leaders and 30 responded to our interview invitation (30% response rate). Of these, two declined to participate, one withdrew, and one respondent was unresponsive to emails to schedule the interview. Recruitment of hospital executive leaders was difficult as the researchers were dependent on-site contacts to facilitate access to leadership. Of those leaders who were contacted (n = 6), only two agreed to participate (33% response rate). To glean more representation, we offered an option for leaders to respond to five key interview questions via email and requested access to the MARQUIS2 monthly meeting minutes. The final sample consisted of 27 participants representing 14 sites, and we successfully conducted two focus groups (4–5 members/group), three group interviews (2–3 members/group), 11 individual interviews, and one email “interview.” Table 1 indicates participant characteristics. Ten sites agreed to share their minutes. With these additional data collection approaches, we were able to obtain data from 16 of the 18 sites. In the next section, major and minor themes and associated implementation strategies are reported and conclude with recommendations for others who wishes to implement the MARQUIS Toolkit.

Table 1 Participant characteristics

Major themes of strategies important for MedRec implementation

Participants repeatedly reported the use of various implementation strategies, represented by the ERIC taxonomy, which were therefore classified as major themes. The overarching implementation themes, their theoretical definitions, and associated list of implementation strategies are listed in Table 2. Of the themes identified, restructuring, quality management, planning, and educating were the most frequently mentioned by participants. Within these themes, some strategies were also mentioned more often than others and these are noted in the various sections below.

Table 2 Implementation categories, associated strategies, and examples of operationalization

Restructuring

Restructuring strategies that altered staffing, professional roles, physical structures, equipment, and data systems were used to implement the toolkit (see Table 2). As one hospital’s team member noted: “We just restructured our current workflow, and we actually had [pharmacist] come on as a new hire. . . made sure that she [pharmacist] would have some dedicated time to do this [MedRec].” Several implementation strategies were used, with changing record systems and changing workflow systems reported across all sites and mentioned extensively by participants. For example, hospitals revised professional roles by allowing non-physician professionals to document medication-related changes in the electronic health record (EHR) or health information technology (HIT) systems and shifted the MedRec responsibility to pharmacy technicians (Pharm Techs) or reallocated MedRec tasks from the physician to nurse practitioners. Hospitals changed record systems by adopting and/or adapting electronic processes to better support MedRec, including the use of tracking boards and specific icons to identify patients with priority need for MedRec.

Keyboard shortcuts with MedRec-related common phrases and special medical software programs enhanced documentation and communication between disciplines. Workflow system changes included the addition of PharmTechs to MedRec workflow, their oversight by pharmacists, and a new EHR progress note to facilitate PharmTechs documentation in the EHR.

Quality management (QM)

Participants reported several QM steps including the use of data and reporting for monitoring and evaluation. As one participant noted: “With the QI team we did process mapping and then we did an HFMEA [healthcare failure mode and effect analysis] and then we just picked through the various problems and went after them.” Quality management strategies mentioned by most participants across all sites include the use of advisory boards and audit and feedback. Advisory boards included physicians, nurses, pharmacists, patient safety officers, quality improvement staff, and patient safety managers. They typically facilitated connecting various departments to help improve workflow efficiency and to remove implementation barriers.

Audit and feedback included providing leaders with medication discrepancy rates and providers with gaps in individual performance such as report cards on the accuracy of PharmTechs medication histories. Feedback occurred on a one-on-one basis or at meetings. Pharmacists used a mobile application to observe and provide feedback to the PharmTechs MedRec related activities and behaviors. Purposefully re-examining implementation strategies was another strategy used to reevaluate how the hospital’s participation in MARQUIS2 was proceeding. Most hospitals used change management processes to guide implementation, like telling people why MARQUIS2 participation was important and providing evidence of medication errors avoided to demonstrate the value of MARQUIS2 participation.

MARQUIS mentors, as quality improvement advisors, in addition to local hospital quality experts (e.g., nursing quality management, performance management/improvement, and director of quality improvement), played a key role in implementation. Tools developed for quality monitoring included, for example, Excel spreadsheets to track the number of patients seen by pharmacy technicians, an EHR template to assess MedRec quality, and customizing EHR reports for quality monitoring. Implementation teams obtained consumer feedback from physicians, nurses, and pharmacy staff (consumers of MedRec) on the MedRec changes they wanted to see implemented, the efficacy of MedRec notes in the EHR, and the helpfulness of EHR pharmacy notes during care delivery. Feedback resulted in improvements in EHR processes including adaptations to existing EHR MedRec modules and the addition of EHR templates for interdisciplinary communication.

One implementation strategy not described in the ERIC taxonomy emerged from these data. This strategy differs from audit and feedback as it focused on developing specific structures and processes to facilitate monitoring individual performance. This strategy, labeled as “determining project-related goals for individual performance measures,” centered on activities for monitoring individual’s performance as they related to the project’s resource needs and overall goals. Included here were monitoring an individual’s time to perform MedRec, the number of MedRec cases completed per hour, and developing a rubric of expectations for MedRec and using the rubric to evaluate staff performance of the MedRec PharmTechs.

Planning

Implementation teams prepared for implementing the toolkit in many ways. For example, one participant noted gathering information “. . . we actually did a survey, a baseline survey to providers, and . . . we also added in our own questions to really sort of help light the fire in terms of, "Do you think this [MedRec] is a good process or bad process?” They also garnered stakeholder buy-in by marketing MARQUIS2 as “This is our ticket, this is our way to get things fast tracked, where we could get experts to support us.” Implementation teams conducted local needs assessments and assessed for readiness and identified barriers using Gantt charts, swim lane evaluations, and gap analyses. They built stakeholder buy-in through strategies like identifying and preparing champions who would engage staff in MedRec and help to garner support from key stakeholders. Participants involved executive boards by reviewing with them MedRec data, reporting on how the MARQUIS project was going, and asking for their help with the selection of units for participation.

In addition, hospitals focused on tailoring their implementation strategies to overcome organizational barriers and honor preferences by determining what was achievable for the hospital. For example, some hospitals focused on improvement of MedRec at discharge or overcoming communication challenges by setting clear expectations for physician communication with pharmacists regarding patients discharge medication lists. In addition, relationships were developed by building a coalition such as a MedRec steering committee or implementation team.

Educating

Education was provided to inform stakeholders about the toolkit and associated implementation efforts. As participants noted “. . . staff meeting . . . we did a kickoff to explain it [MARQUIS2] and did a little presentation about it.” and “. . . we did some presentations at our physician meeting. . . at the patient safety meeting.” Most participants and research sites reported the strategies of conducting educational meetings and informing local opinion leaders. Educational materials included pocket cards, help sheets, electronic modules, and checklists to educate staff. Ongoing consultation with quality improvement experts, pharmacy staff, and the MARQUIS mentor, and, conducting ongoing education of new and existing staff occurred throughout the year or when performance gaps were identified. Educational meetings were conducted with different professional groups (e.g., hospitalists) and key stakeholders. Training sessions were individualized to meet the needs of each profession (e.g., PharmTechs versus physicians). To inform and influence stakeholders, information about MARQUIS2 was spread to the community using mass media (e.g., TV presentations and newspaper advertisements) and posters and emails to inform hospital staff.

Minor themes of strategies important for MedRec implementation

Two other ERIC categories, finance and attend to policy context, emerged from the data. However, participants mentioned these implementation strategies less often, so they were classified as minor themes of strategies.

The use of incentives and reallocation of funding was important. One participant noted “... our institutional goals to have BPMH completed for our three intervention units. We met that goal and so all of the staff that were involved in meeting that goal got a $25 gift certificate or gift card.” Another noted “. . . but it’s a pay-for-performance incentive for our providers. . . [them] documenting a good MedRec on admission and discharge. . . also the actual discrepancy rate.” Participants reported highlighting instances where the use of the toolkit mitigated risk and reduced liabilities or prevented adverse drug events by identifying and correcting medication discrepancies. Participants rarely mentioned the ERIC finance strategies of accessing new funding. Very few hospitals accessed new funding through other grant funding mechanisms (other than the AHRQ funded MARQUIS grant) or allocated risk pool funding that remained at year-end for use to foster MARQUIS2 implementation.

Participants rarely mentioned the use of attend to policy context strategies, even though MedRec is a Joint Commission National Patient Safety Goal (NPSG.03.06.01, https://www.jointcommission.org). Participants at only one hospital noted an upcoming accreditation hospital visit as a driving force for MedRec changes: “. . . their next round of accreditation, and if we don’t have a process in place, then they’re going to have a big problem. That is extremely helpful, that accreditation. I’ve been trying to work on medication reconciliation for probably 10 years. . . but really didn’t start to gain any momentum until. . . our last accreditation cycle”. At this hospital, organizational policies were changed to improve the robustness of their MedRec program by allowing non-physician clinicians to correct medication lists in the EHR, which improved the MedRec workflow in the hospital.

New themes of implementation strategies not captured by the ERIC taxonomy

Integration

Integration of the MedRec interventions was possible by using the strategies of “Adapting existing interventions” and “aligning with existing interventions”. Hospitals used integration in different ways. As one participant noted: “Ever since we enrolled in MARQUIS. . .there were some tools in place already, but I think we adjusted them and changed them, based on the findings of MARQUIS1 to make sure that we followed the MARQUIS2 protocol.”

Adapting existing interventions included adapting high-risk patient criteria provided in the toolkit and the medication history module in the EHR. Participants reported Alignment with existing initiatives occurred by using the existing pre-surgical phone call to obtain medication histories and aligning the MARQUIS project with the hospital’s strategic quality plan, which helped with garnering support and resources for the project.

Professional roles and task responsibilities

Many participants felt the need for clear direction on the roles and task responsibilities of the various team members, given that MedRec requires collaboration across multiple disciplines. One participant noted their struggle “. . . who was going to be responsible for taking the best possible medication history at the time of admission . . . Eventually we agreed that it would be the sole responsibility of the pharmacy technician and no longer be a requirement for the nurses or the MDs.” In addition, participants felt that PharmTechs were empowered to play a significant role in MedRec by developing EHR templates and receiving access to areas of the EHR not previously available to them to foster effective and independent work.

Recommendations for future success

At the end of the interview, we asked participants “Now that you have done it, what would you do differently carrying out the QI initiative?” Dominant themes focused on the project and people. Project recommendations included increasing the scope of the project, either through more diverse interventions, disseminating it to other hospital units, or making their MedRec programs more robust: “So I would increase the program, for them to do reconciliation on patients not admitted through the ED.” Recommendations regarding people included examining who the right people are for the team. “I think before even embarking on another journey like this again it would be, do we have the right people and what is it going to take to get there”. The need for project consultation and planning early on with stakeholders were noted. “I think what we could do differently is maybe arrange a meeting with all the leaders across the hospital . . . so if we could get them to come to a meeting, like maybe nursing, and the emergency department, at the very beginning of the project, to kind of share our ideas, and brain storm what we could do together to work in collaboration. . . letting everyone know ahead of time what we are doing with the project.”

Discussion

Members of MARQUIS2 hospitals reported using a variety of implementation strategies during MARQUIS Toolkit implementation, 32 of which aligned with the ERIC taxonomy and the plan, educate, restructure, and quality management categories (Table 2). Strategies related to finance and attend to policy were rarely cited. Importantly, this study identified two additional categories—integration and professional roles and responsibilities—and 11 new strategies not previously described in the ERIC framework. Our findings suggest that complex interventions like MedRec can use the ERIC taxonomy. But additional descriptors are needed to capture the diversity of approaches used to address hospital contexts such as the availability of resources (e.g., ED based pharmacy technicians, decentralized pharmacists), existing structures (e.g., quality improvement departments; EHR MedRec modules), and processes (e.g., physicians consulting with pharmacy prior to writing the discharge medication list).

Powell and colleagues [30] reported examples of how hospitals could operationalize the various strategies (see Additional file 6 in their article). This research enhances and refines their work by demonstrating numerous ways through which hospitals executed various strategies in practice (see Table 2). For example, for audit and feedback, both Powell et al. and this study identified the use of a variety of sources like medical records and direct observation to obtain information. Similarly, hospitals translated into practice the strategy called “change record systems” by modifying progress notes and treatment plans to reflect the implementation of evidence-based practice, in this case the MARQUIS Toolkit.

This study is the first study to use the complete ERIC taxonomy to investigate implementation of MedRec, a complex interprofessional healthcare intervention. The study findings provide hospitals who wish to adopt MedRec interventions with evidence regarding the most employed strategies from the ERIC taxonomy as well as several novel strategies and specific tactics to execute selected strategies in real-world settings. Our study aligns well with others that have successfully used the ERIC taxonomy of implementation strategies to investigate the implementation of different healthcare interventions (e.g., hepatitis virus C treatment) [38]. These studies have similarly found that not all strategies were applicable to their setting or intervention during implementation [39, 40]. Specifically, the most frequently used strategies included data warehousing techniques (e.g., dashboards) and intervening with patients to promote uptake and adherence. In contrast, in the current study, most sites used predominantly planning and education-related implementation strategies (Table 2). This further shows the need for research on using ERIC for a variety of interventions.

Other MedRec studies have demonstrated the need for implementation strategies including hiring pharmacists, adopting an electronic MedRec system [28, 41, 42], and using multidisciplinary groups to plan for implementation [43]. In addition, prior studies have identified the need for planning strategies [19] such as the use of executive boards and/or sponsors like medication safety boards [44] to enhance the implementation of medication safety strategies. MacKeigen et al. [45] examined the implementation of a reimbursed medication review program and found important strategies to include task shifting, staff training, and software adaptations. Researchers have also emphasized the need for implementation strategies such as ongoing education [46] standardization such as scripts to assist physician-patient discussions and the use of multidisciplinary teams [47, 48], role clarification [49], and audit and feedback [48]. However, this study goes beyond prior research by using the holistic, theory-driven ERIC taxonomy. In doing so, the current study integrates and summarizes previously reported strategies into a cohesive, conceptually organized approach to guide the future implementation of MedRec interventions.

Our work demonstrates the importance of multimodal and multifaceted implementation strategies for implementing complex healthcare interventions like MedRec. This finding aligns with others who have similarly found that implementation strategies were multifaceted [45]. The MARQUIS Toolkit challenges implementation efforts because it is comprehensive consisting of multiple components and organizational levels (i.e., organization, unit, individual staff member or patient) to change entrenched behaviors [50]. Thus, implementation strategies and tactics must target behaviors and the different organizational levels to facilitate change and improve organizational performance, and this is only possible when employing a multifaceted approach to implementation.

Increasingly, researchers recognize the need to tailor implementation strategies to specific contexts to overcome their specific barriers and make use of their unique facilitators [51, 52]. Future research should build on this study’s findings regarding implementation strategies and tactics to examine the contextual antecedents (e.g., leadership, team cohesion) that may drive the selection of particular implementation strategies and approaches to implementing them. It would be especially valuable in the context of MedRec to investigate the contextual factors that drive the selection of strategies, the association between implementation strategies (and operationalization of them), and clinical outcomes like unintentional medication discrepancies as well as, for example, implementation outcomes such as feasibility, acceptability, fidelity, and sustainability [53] of MedRec interventions in hospitals that participated in the study.

This study was limited to MARQUIS2 participating hospitals selected in an application process that required executive leadership support and a desire to improve their MedRec processes. Thus, participating hospitals were contextually at a high level of readiness, without the need for new policy-driven strategies. It is possible that our findings would be different in hospitals less ready to change. For example, although The Joint Commission lists MedRec as a national patient safety goal (NPSG.03.06.01), accreditation was not a major driver for MARQUIS2 participation but rather gap analyses of existing MedRec processes and other motivators, such as reduced staffing levels in the emergency room of nurses who completed MedRec. Accreditation bodies can play a significant role in forcing change in organizations resistant to change but their role in organizations with a high level of readiness appears muted. Although this study did not find finance and policy context to be common drivers, the researchers still recommend their inclusion in future efforts involving more uncertain policy contexts and with hospitals where readiness for change and contextual factors driving implementation might be different.

We identified two additional categories of the Integration and Professional Roles and Responsibilities. Integration through adapting existing structures and processes and aligning the project with existing initiatives likely enhanced implementation. Integration of newly adopted interventions is key in quality improvement and system change [54, 55]. Given the vital role of adaptation to the sustainability of interventions [56, 57], using these integration strategies in the implementation process will likely also enhance sustainability. Future research should further explore the strategies most likely to facilitate implementation sustainability. Regarding professional roles, specifying the role of team members in implementation efforts reduces role ambiguity, which plays a role in employees job stress, satisfaction, overall performance, and employee turnover [58]. Role clarity also facilitates interprofessional collaboration [59], which is vital for success of interprofessional implementation teams. Clarifying roles might also limit the duplication of team members’ efforts and thereby ensure the judicious use of organizational resources. Given the interprofessional nature of MedRec and many healthcare interventions, role clarification might be a particularly important strategy.

Study limitations

Although the study sample size was relatively small as only 16 hospitals participated in this study, data saturation was achieved with consistent themes emerging across hospitals prior to the completion of all interviews. Of the two hospitals not represented in this report, one also demonstrated limited engagement with and did not collect sufficient data during MARQUIS2 study to be included in the analysis of the primary outcomes. The other hospital participated in the larger MARQUIS2 study, but the researchers were unable to recruit implementation team members for interviews. As noted above, selection bias is possible as MARQUIS2 hospitals were limited to those that applied to participate and they may inherently be different from those hospitals that did not apply to participate in MARQUIS2. Although the study results underrepresent the voices of executive leaders, implementation team members indicated ways executives supported toolkit implementation as reflected in the planning strategy of “Involve executive boards and/or sponsors.”

Response bias, including social desirability, are additional potential study limitations. However, phrasing questions to prevent leading participants towards a specific answer, asking questions in a non-threatening, neutral manner, and using simple, unbiased language helped to mitigate this risk. Although generalizability may be limited, the hospitals were heterogeneous in type, size, and location, and thus, the findings may be applicable to hospitals with similar characteristics.

This study used web conferencing to conduct the interviews. Interviews were conducted ethically and confidentially by informing participants of all present in the room like the PI conducting the interview and the RA taking notes and that interviews were being recorded. The use of technology allowed interacting with participants remotely and eliminated the travel time and costs associated with face-to-face interviews. It was the most practical and feasible option to achieve the research aims in the presence of cost constraints.

Conclusions

This study demonstrated that implementation strategies and how they are operationalized can guide the implementation of complex interventions like MedRec in acute care hospitals. The ERIC taxonomy categories of plan, educate, restructure, and quality management emerged as especially central to implementation efforts. In addition, two novel categories emerged emphasizing the importance of integration and professional roles and responsibilities. The findings of this study also suggest that finance and policy strategies were less important, at least at hospitals ready for implementation. In sum, the ERIC taxonomy of implementation strategies provides a strong foundation for evaluating implementation of a complex healthcare intervention such as MedRec. However, additional categories and strategies were needed to describe the approaches reported. It is likely that the type of intervention or the implementation context might drive the selection of strategies. Future research should explore the drivers of implementation strategy selection and their operationalization. Identifying the most effective implementation strategies to achieve positive clinical and implementation outcomes, which might depend on the hospital context, is also needed.

Availability of data and materials

The dataset supporting the conclusions of this article will not be publicly available due to ongoing data analyses related to all study aims but are available from the corresponding author on reasonable written request.

References

  1. Salanitro AH, Kripalani S, Resnic J, Mueller SK, Wetterneck TB, Haynes KT, et al. Rationale and design of the Multicenter Medication Reconciliation Quality Improvement Study (MARQUIS). BMC Health Serv Res. 2013;13(1):230. https://doi.org/10.1186/1472-6963-13-230.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Vasileff HM, Whitten LE, Pink JA, Goldsworthy SJ, Angley MT. The effect on medication errors of pharmacists charting medication in an emergency department. Pharm World Sci. 2009;31(3):373–9. https://doi.org/10.1007/s11096-008-9271-y.

    Article  PubMed  Google Scholar 

  3. Belda-Rustarazo S, Cantero-Hinojosa J, Salmeron-Garcia A, Gonzalez-Garcia L, Cabeza-Barrera J, Galvez J. Medication reconciliation at admission and discharge: an analysis of prevalence and associated risk factors. Int J Clin Pract. 2015;69(11):1268–74. https://doi.org/10.1111/ijcp.12701.

    Article  CAS  PubMed  Google Scholar 

  4. Eggink RN, Lenderink AW, Widdershoven JW, van den Bemt PM. The effect of a clinical pharmacist discharge service on medication discrepancies in patients with heart failure. Pharm World Sci. 2010;32(6):759–66. https://doi.org/10.1007/s11096-010-9433-6.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Kripalani S, Roumie CL, Dalal AK, Cawthon C, Businger A, Eden SK, et al. Effect of a pharmacist intervention on clinically important medication errors after hospital discharge: a randomized trial. Ann Intern Med. 2012;157(1):1–10. https://doi.org/10.7326/0003-4819-157-1-201207030-00003.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Gleason KM, McDaniel MR, Feinglass J, Baker DW, Lindquist L, Liss D, et al. Results of the Medications at Transitions and Clinical Handoffs (MATCH) study: an analysis of medication reconciliation errors and risk factors at hospital admission. J Gen Intern Med. 2010;25(5):441–7. https://doi.org/10.1007/s11606-010-1256-6.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Zoni AC, Duran Garcia ME, Jimenez Munoz AB, Salomon Perez R, Martin P, Herranz AA. The impact of medication reconciliation program at admission in an internal medicine department. Eur J Intern Med. 2012;23(8):696–700. https://doi.org/10.1016/j.ejim.2012.08.013.

    Article  PubMed  Google Scholar 

  8. Mendes AE, Lombardi NF, Andrzejevski VS, Frandoloso G, Correr CJ, Carvalho M. Medication reconciliation at patient admission: a randomized controlled trial. Pharm Pract. 2016;14(1):656.

    Google Scholar 

  9. Breuker C, Macioce V, Mura T, Castet-Nicolas A, Audurier Y, Boegner C, et al. Medication errors at hospital admission and discharge: risk factors and impact of medication reconciliation process to improve healthcare. J Patient Saf. 2017. https://doi.org/10.1097/PTS.0000000000000420.

  10. Vira T, Colquhoun M, Etchells E. Reconcilable differences: correcting medication errors at hospital admission and discharge. Qual Saf Health Care. 2006;15(2):122–6. https://doi.org/10.1136/qshc.2005.015347.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Mekonnen AB, McLachlan AJ, Brien JA. Effectiveness of pharmacist-led medication reconciliation programmes on clinical outcomes at hospital transitions: a systematic review and meta-analysis. BMJ Open. 2016;6(2):e010003. https://doi.org/10.1136/bmjopen-2015-010003.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Mekonnen AB, McLachlan AJ, Brien JA. Pharmacy-led medication reconciliation programmes at hospital transitions: a systematic review and meta-analysis. J Clin Pharm Ther. 2016;41(2):128–44. https://doi.org/10.1111/jcpt.12364.

    Article  PubMed  Google Scholar 

  13. Curatolo N, Gutermann L, Devaquet N, Roy S, Rieutord A. Reducing medication errors at admission: 3 cycles to implement, improve and sustain medication reconciliation. Int J Clin Pharm. 2015;37(1):113–20. https://doi.org/10.1007/s11096-014-0047-2.

    Article  PubMed  Google Scholar 

  14. Hug BL, Keohane C, Seger DL, Yoon C, Bates DW. The costs of adverse drug events in community hospitals. Jt Comm J Qual Patient Saf. 2012;38(3):120–6.

    PubMed  Google Scholar 

  15. Institute for Healthcare Improvement. Medicaton reconciliation review. 2007: http://www.ihi.org/Topics/ADEsMedicationReconciliation/Pages/default.aspx.

  16. Silva PA, Bernstam EV, Markowitz E, Johnson TR, Zhang J, Herskovic JR. Automated medication reconciliation and complexity of care transitions. AMIA Annu Symp Proc. 2011;2011:1252–60.

    PubMed  Google Scholar 

  17. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. https://doi.org/10.1111/j.0887-378X.2004.00325.x.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Weng YH, Kuo KN, Yang CY, Lo HL, Chen C, Chiu YW. Implementation of evidence-based practice across medical, nursing, pharmacological and allied healthcare professionals: a questionnaire survey in nationwide hospital settings. Implement Sci. 2013;8(1):112. https://doi.org/10.1186/1748-5908-8-112.

    Article  PubMed  PubMed Central  Google Scholar 

  19. van Sluisveld N, Zegers M, Natsch S, Wollersheim H. Medication reconciliation at hospital admission and discharge: Insufficient knowledge, unclear task reallocation and lack of collaboration as major barriers to medication safety. BMC Health Serv Res. 2012;12(1):170. https://doi.org/10.1186/1472-6963-12-170.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Lee JY, Leblanc K, Fernandes OA, Huh JH, Wong GG, Hamandi B, et al. Medication reconciliation during internal hospital transfer and impact of computerized prescriber order entry. Ann Pharmacother. 2010;44(12):1887–95. https://doi.org/10.1345/aph.1P314.

    Article  PubMed  Google Scholar 

  21. Lee KP, Hartridge C, Corbett K, Vittinghoff E, Auerbach AD. “Whose job is it, really?” Physicians’, nurses’, and pharmacists’ perspectives on completing inpatient medication reconciliation. J Hosp Med. 2015;10(3):184–6. https://doi.org/10.1002/jhm.2289.

    Article  PubMed  Google Scholar 

  22. Boockvar KS, Santos SL, Kushniruk A, Johnson C, Nebeker JR. Medication reconciliation: barriers and facilitators from the perspectives of resident physicians and pharmacists. J Hosp Med. 2011;6(6):329–37. https://doi.org/10.1002/jhm.891.

    Article  PubMed  Google Scholar 

  23. Mueller SK, Kripalani S, Stein J, Kaboli P, Wetterneck TB, Salanitro AH, et al. A toolkit to disseminate best practices in inpatient medication reconciliation: multi-center Medication Reconciliation Quality Improvement Study (MARQUIS). Jt Comm J Qual Improv. 2013;39(8):371–82.

    Google Scholar 

  24. Schnipper JL, Mixon A, Stein J, Wetterneck TB, Kaboli PJ, Mueller S, et al. Effects of a multifaceted medication reconciliation quality improvement intervention on patient safety: final results of the MARQUIS study. BMJ Qual Saf. 2018;27(12):954–64. https://doi.org/10.1136/bmjqs-2018-008233.

    Article  PubMed  Google Scholar 

  25. Mixon AS, Smith GR Jr, Mallouk M, Nieva HR, Kripalani S, Rennke S, et al. Design of MARQUIS2: study protocol for a mentored implementation study of an evidence-based toolkit to improve patient safety through medication reconciliation. BMC Health Serv Res. 2019;19(1):659. https://doi.org/10.1186/s12913-019-4491-5.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Mixon AS, Neal E, Bell S, Powers JS, Kripalani S. Care transitions: a leverage point for safe and effective medication use in older adults--a mini-review. Gerontology. 2015;61(1):32–40. https://doi.org/10.1159/000363765.

    Article  PubMed  Google Scholar 

  27. Kripalani S, Jackson AT, Schnipper JL, Coleman EA. Promoting effective transitions of care at hospital discharge: a review of key issues for hospitalists. J Hosp Med. 2007;2(5):314–23. https://doi.org/10.1002/jhm.228.

    Article  PubMed  Google Scholar 

  28. Mueller SK, Sponsler KC, Kripalani S, Schnipper JL. Hospital-based medication reconciliation practices: a systematic review. Arch Intern Med. 2012;172(14):1057–69. https://doi.org/10.1001/archinternmed.2012.2246.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Schnipper JL, Hamann C, Ndumele CD, Liang CL, Carty MG, Karson AS, et al. Effect of an electronic medication reconciliation application and process redesign on potential adverse drug events: a cluster-randomized trial. Arch Intern Med. 2009;169(8):771–80. https://doi.org/10.1001/archinternmed.2009.51.

    Article  PubMed  Google Scholar 

  30. Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69(2):123–57. https://doi.org/10.1177/1077558711430690.

    Article  PubMed  Google Scholar 

  31. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8(1):139. https://doi.org/10.1186/1748-5908-8-139.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Society of Hospital Medicine Meidcation Reconciliation Implementation Guide [Website]. Society of Hospital Medicine; https://shm.hospitalmedicine.org/acton/media/25526/download-shms-med-rec-guide. Accessed 7 May 2019.

  33. Schnipper JL, Nieva HR, Mallouk M, et al. Effects of a refined evidence-based toolkit and mentored implementation on medication reconciliation at 18 hospitals: results of the MARQUIS2 study. BMJ Qual Saf. 2021.

  34. SHMs MARQUIS Med Rec Collaborative [Website]. Society of Hospital Medicine; https://www.hospitalmedicine.org/clinical-topics/medication-reconciliation/marquis-med-rec-collaborative/. Accessed 22 July 2020.

  35. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50. https://doi.org/10.1186/1748-5908-4-50.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Chamberlain P, Brown CH, Saldana L. Observational measure of implementation progress in community based settings: the stages of implementation completion (SIC). Implement Sci. 2011;6(1):116. https://doi.org/10.1186/1748-5908-6-116.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Miles MB, Huberman AM, Saldana J. Qualitative data analysis: a methods sourcebook. Thousand Oaks: Sage Publications, Inc.; 2013.

    Google Scholar 

  38. Waltz TJ, Powell BJ, Fernández ME, Abadie B, Damschroder LJ. Choosing implementation strategies to address contextual barriers: diversity in recommendations and future directions. Implement Sci. 2019;14(1):42. https://doi.org/10.1186/s13012-019-0892-4.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Rogal SS, Yakovchenko V, Waltz TJ, Powell BJ, Kirchner JE, Proctor EK, et al. The association between implementation strategy use and the uptake of hepatitis C treatment in a national sample. Implement Sci. 2017;12(1):60. https://doi.org/10.1186/s13012-017-0588-6.

    Article  PubMed  PubMed Central  Google Scholar 

  40. DeSisto CL, Estrich C, Kroelinger CD, Goodman DA, Pliska E, Mackie CN, et al. Using a multi-state learning community as an implementation strategy for immediate postpartum long-acting reversible contraception. Implement Sci. 2017;12(1):138. https://doi.org/10.1186/s13012-017-0674-9.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Monkman H, Borycki EM, Kushniruk AW, Kuo MH. Exploring the contextual and human factors of electronic medication reconciliation research: a scoping review. Stud Health Technol Inform. 2013;194:166–72.

    PubMed  Google Scholar 

  42. Mueller SK, Kripalani S, Stein J, Kaboli P, Wetterneck TB, Salanitro AH, et al. A toolkit to disseminate best practices in inpatient medication reconciliation: multi-center medication reconciliation quality improvement study (MARQUIS). Tools to Make Medication Reconciliation Work 2013.

  43. Varkey P, Cunningham J, O’Meara J, Bonacci R, Desai N, Sheeler R. Multidisciplinary approach to inpatient medication reconciliation in an academic setting. Am J Health Syst Pharm. 2007;64(8):850–4. https://doi.org/10.2146/ajhp060314.

    Article  PubMed  Google Scholar 

  44. Seidling HM, Stutzle M, Hoppe-Tichy T, Allenet B, Bedouch P, Bonnabry P, et al. Best practice strategies to safeguard drug prescribing and drug administration: an anthology of expert views and opinions. Int J Clin Pharm. 2016;38(2):362–73. https://doi.org/10.1007/s11096-016-0253-1.

    Article  PubMed  Google Scholar 

  45. MacKeigan LD, Ijaz N, Bojarski EA, Dolovich L. Implementation of a reimbursed medication review program: corporate and pharmacy level strategies. Res Soc Adm Pharm. 2017;13(5):947–58. https://doi.org/10.1016/j.sapharm.2017.03.057.

    Article  Google Scholar 

  46. Lea M, Barstad I, Mathiesen L, Mowe M, Molden E. Effect of teaching and checklist implementation on accuracy of medication history recording at hospital admission. Int J Clin Pharm. 2016;38(1):20–4. https://doi.org/10.1007/s11096-015-0218-9.

    Article  PubMed  Google Scholar 

  47. Gregory NS, Seley JJ, Dargar SK, Galla N, Gerber LM, Lee JI. Strategies to prevent readmission in high-risk patients with diabetes: the importance of an interdisciplinary approach. Curr Diab Rep. 2018;18(8):54. https://doi.org/10.1007/s11892-018-1027-z.

    Article  PubMed  Google Scholar 

  48. Jokanovic N, Wang KN, Dooley MJ, Lalic S, Tan EC, Kirkpatrick CM, et al. Prioritizing interventions to manage polypharmacy in Australian aged care facilities. Res Soc Adm Pharm. 2017;13(3):564–74. https://doi.org/10.1016/j.sapharm.2016.06.003.

    Article  Google Scholar 

  49. Hicks RW, Wanzer LJ, Denholm B. Implementing AORN recommended practices for medication safety. AORN J. 2012;96(6):605–22. https://doi.org/10.1016/j.aorn.2012.09.012.

    Article  PubMed  Google Scholar 

  50. Boren SA, Balas AE. Evidence-based quality measurement. J Ambul Care Manage. 1999;22(3):17–23. https://doi.org/10.1097/00004479-199907000-00005.

    Article  CAS  PubMed  Google Scholar 

  51. Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, Proctor EK, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Serv Res. 2017;44(2):177–94. https://doi.org/10.1007/s11414-015-9475-6.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Leeman J, Birken SA, Powell BJ, Rohweder C, Shea CM. Beyond “implementation strategies”: classifying the full range of strategies used in implementation science and practice. Implement Sci. 2017;12(1):125. https://doi.org/10.1186/s13012-017-0657-x.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Pol Ment Health. 2011;38(2):65–76. https://doi.org/10.1007/s10488-010-0319-7.

    Article  Google Scholar 

  54. O'Heron CT, Jarman BT. A strategic approach to quality improvement and patient safety education and resident integration in a general surgery residency. J Surg Educ. 2014;71(1):18–20. https://doi.org/10.1016/j.jsurg.2013.09.018.

    Article  PubMed  Google Scholar 

  55. Tillman M, Wehbe-Janek H, Hodges B, Smythe WR, Papaconstantinou HT. Surgical care improvement project and surgical site infections: can integration in the surgical safety checklist improve quality performance and clinical outcomes? J Surg Res. 2013;184(1):150–6.

    Article  PubMed  Google Scholar 

  56. Slaghuis SS, Strating MM, Bal RA, Nieboer AP. A measurement instrument for spread of quality improvement in healthcare. Int J Qual Health Care. 2013;25(2):125–31.

    Article  CAS  PubMed  Google Scholar 

  57. Stirman SW, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7(1):17. https://doi.org/10.1186/1748-5908-7-17.

    Article  Google Scholar 

  58. Hassan S. The importance of role clarification in workgroups: effects on perceived role clarity, work satisfaction, and turnover rates. Public Adm Rev. 2013;73(5):716–25. https://doi.org/10.1111/puar.12100.

    Article  Google Scholar 

  59. Brault I, Kilpatrick K, D’Amour D, Contandriopoulos D, Chouinard V, Dubois C-A, et al. Role clarification processes for better integration of nurse practitioners into primary healthcare teams: a multiple-case study. Nurs Res Pract. 2014;2014:170514.

    PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We acknowledge the support of MARQUIS2 mentors and the Society of Hospital Medicine during the conduct of this research study.

Funding

Dr. Stolldorf is currently funded by a grant from the Agency for Healthcare Research and Quality (K01HS025486), and some work was supported by grant UL1 TR000445 from the NCATS/NIH.

Author information

Authors and Affiliations

Authors

Contributions

DPS conceived the study, determined the methodology, and conducted the formal analysis. SK, SHR, and TJV provided the study supervision and guidance. JLS assisted with access to the research sites and study oversight. MSD and CLR provided support in the larger study conceptualization, design, and supervision. DPS and the qualitative core assisted with qualitative data analysis tools for data management and consolidation as well as data analysis oversight. DPS wrote the original manuscript draft with review and editing by all co-authors.

Corresponding author

Correspondence to Deonni P. Stolldorf.

Ethics declarations

Ethics approval and consent to participate

We received the Institutional Review Board (IRB) approval from the Vanderbilt University Medical Center IRB (IRB# 170736) to conduct this study. All participants were consented prior to participation in interviews.

Consent for publication

Not applicable.

Competing interests

Nothing to declare by DPS, SHR, TJV, CLR, MSD, and SK. JLS was the recipient of funding from the Mallinckrodt Pharmaceuticals to conduct an investigator-initiated study of opioid-related adverse drug events in surgical patients.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Implementation strategies and supporting quotes

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Stolldorf, D.P., Ridner, S.H., Vogus, T.J. et al. Implementation strategies in the context of medication reconciliation: a qualitative study. Implement Sci Commun 2, 63 (2021). https://doi.org/10.1186/s43058-021-00162-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s43058-021-00162-5

Keywords