The intervention: The Children and Young People’s Health Partnership (CYPHP) Evelina London Model of Care

The CYPHP Evelina London Model of Care is a complex model comprising several interventions for CYP (0–16 years) and service providers. The aim of all interventions within the CYPHP Evelina London Model of Care is to improve CYP health, healthcare quality, and strengthen the health system.

To facilitate the design and operationalisation of the programme, the measurement and analysis of the implementation and outcomes of the CYPHP Evelina London Model of Care, the components of the programme have been conceptualised as a theoretical framework (or logic model; see figure 1). The theoretical framework has been guided by the WHO health systems building blocks concept9 and was developed using workshop methods with the CYPHP programme team and wider stakeholders. The framework in figure 1 shows how the CYPHP guiding principles (eg, early intervention and prevention) and health system building blocks (eg, technology) are reflected in outputs (eg, interventions and targeted/universal services), that are in turn reflected in outcomes (eg, improved child health).

The interventions within this framework were guided by the Theoretical Domains Framework (TDF),10 which describes 12 behavioural domains which interventions may target to influence behaviour change. In brief, the targeted and universal interventions within the CYPHP Model have been designed to target barriers to effective management of physical, mental, and social determinants of health at both the service-provider and patient-level to maximise behaviour change. In our accompanying paper, the hypothesised active components of each individual intervention have been mapped onto the TDF to evidence the proposed mechanisms of action through which the intervention may become effective.8 In addition, the mechanism of action across the whole programme, at the service provider, family, and system level is detailed in figure 1.

Providing care that is responsive to CYP’s needs will be achieved through roll-out of several universal and targeted services, examples of which are described below:

• Universal Services: interventions for all eligible CYP and service providers in Lambeth and Southwark.

  • Education and Training: training to improve awareness of difficulties within CYP’s health and provision of young person-friendly training to service providers and school staff. These interventions aim to increase provider knowledge and skills, to improve delivery of CYP healthcare.

  • CYPHP Clinics: integrated child health clinics run by General Practitioners (GPs) and local ‘Patch Paediatricians’ in primary care settings. These clinics are typically for CYP who would otherwise have been referred to hospital for an outpatient appointment with a general paediatrician. This intervention provides shared learning opportunities to develop service provider competence, and encourages team working between primary and secondary care, to provide better quality care and earlier access to healthcare for CYP.

• Targeted Services: interventions for eligible CYP with prespecified tracer conditions (asthma, eczema, epilepsy, constipation). Tracer conditions were chosen as they are examples of long-term and common conditions, which will provide generalisable lessons about improving outcomes for CYP with ongoing conditions. The intention is to design a generalisable model of care for CYP with common and chronic conditions as part of a health system response to the epidemiological transition to chronic disease.

  • Care for CYP with ongoing conditions: CYP with tracer conditions are eligible for a tailored clinical service delivered by the multidisciplinary CYPHP Health Team in primary and community settings. Care includes heath promotion, preventative and reactive care and all decisions are documented and shared with GPs through electronic health records. Through the CYPHP Clinical Team, we anticipate that CYP motivation and goals will be targeted, changing CYP’s perceived competence and knowledge, allowing self-management of health.

To aid implementation of the CYPHP Evelina London Model of Care, regular meetings with primary and secondary care providers, local Clinical Commissioning Groups, GP Federations and materials to aid implementation using established behaviour change techniques were used. The implementation of the CYPHP Evelina London Model of Care across Lambeth and Southwark will occur in stages. This phased roll-out allowed the application of an opportunistic cRCT design, where for the first stage (approximately 2 years) GP practices are randomised to be offered either the CYPHP model (ie, delivery of targeted and universal services to eligible CYP) or enhanced usual care (ie, delivery of universal services only to eligible CYP). Details of the evaluation design are presented in the accompanying protocol paper.8

In summary, the evaluation has four component parts: the outcome evaluation consists of a pseudoanonymised population-based evaluation for all CYP in participating GP practices to explore changes in health service use across control and intervention arms; an evaluation of CYP with selected tracer conditions to understand changes in health and healthcare across control and intervention arms; and an economic evaluation to assess the costs of delivery and cost effectiveness of the CYPHP Evelina London Model of Care across tracer conditions. Alongside the outcome evaluation, a nested process evaluation, detailed in this paper, aims to understand how and why the CYPHP Evelina London model is effective or ineffective in achieving health, healthcare and health service use outcomes and to identify contextually relevant strategies for successful implementation as well as practical difficulties in adoption, delivery and maintenance to inform wider implementation.

The process of implementing a new clinical service

The process evaluation will focus on measures of implementation success, including reach, fidelity, adoption and maintenance of the CYPHP Evelina London Model of Care. Implementation science specifically looks at ways to enhance and promote the uptake of research findings and evidence-based practices into routine healthcare; implementation evaluation is therefore a key component of a comprehensive process evaluation for a complex intervention evaluation.11 12 Variation in implementation of the CYPHP Evelina London Model of Care is inevitable, due to multiple intervention components, diverse contexts and participants. Practices’ differing characteristics influence their care arrangements for CYP and will affect the roles and expectations of clinical and administrative staff. Similarly, patients' previous experience and expectations of care affects care-seeking behaviour. These differences, in the context of evolving local healthcare environments, policies and priorities may affect the successful implementation of the new model of care.13

Process evaluations need to be designed, delivered and analysed within a theoretical framework to allow clearer articulation of research questions, validated instruments to assess outcomes and theory-driven explanations for success or failure of implementation efforts. This is essential to understand the mechanisms which underlie the programme’s effectiveness and to application in other populations and settings. Glasgow’s RE-AIM Framework14 proposes five domains that can influence the implementation of new services across a range of stakeholders. The framework’s five domains guide the assessment of:

1. Reach, which captures the percentage of people from a given population who participate in a programme and describes their characteristics.

2. Effectiveness, which refers to the positive and negative outcomes of the programme

3. Adoption, which is generally defined as the per cent of possible settings (eg, organisations) and staff that have agreed to participate in the programme.

4. Implementation, which is an indicator of the extent to which the programme was delivered as intended and its cost.

5. Maintenance, which, at the individual level, reflects maintenance of the primary outcomes (>6 months).

The RE-AIM Framework has been applied to understand intervention impact across a variety of healthcare settings and acknowledges the value of qualitative data to complement quantitative measures.15 The core aspects of the RE-AIM Framework will be incorporated into our process evaluation and used to understand the interpretation of qualitative findings.

Aim

The overall aim of the CYPHP process evaluation is to better understand how and why the CYPHP Evelina London Model of Care was effective or ineffective; to identify contextually relevant strategies for successful implementation and to identify practical difficulties and facilitators in adoption, delivery and maintenance to inform wider implementation. The overarching questions guiding the evaluation for the CYPHP Evelina London model of care are:

1. What factors contribute to the effectiveness (or ineffectiveness) of the CYPHP Evelina London Model of Care?

2. What factors contribute to successful or challenging implementation across study sites?

Patient and public involvement

The CYPHP Evelina London Model was developed with key stakeholders including CYP, carers, front line practitioners and health service commissioners. Stakeholders were involved in the development of the theoretical framework for CYPHP, identification of research questions and refining the research methodology, including the development of questions for qualitative interviews and focus groups.

Setting/target groups for process evaluation

The intervention components of the CYPHP Evelina London Model of Care are situated in primary care settings and the community. These interventions target service providers (GP receptionists, practice nurses, primary care providers), CYP and families. Commissioners of healthcare services in Lambeth and Southwark are not directly targeted by the intervention components, but as influential participants, they are included in the process evaluation.

Data collection

The process evaluation will use a mixed methods approach to data collection and analysis. We will use the following methods of data collection: (1) surveys of all stakeholders; (2) analysis of routine clinical and administrative data; (3) interviews and/or focus groups with stakeholders and (4) a review of policy documents during the planning and delivery of the CYPHP Evelina Model of Care. Data collection will be guided by the RE-AIM framework. The process indicators as per the RE-AIM framework are mapped into the logic model and presented in table 1.

Surveys of all stakeholders

All primary care service providers participating in the intervention arms of the CYPHP Evelina Model of Care will be invited to complete the Normalisation Process Theory tool (NoMAD).16 Normalisation Process Theory (NPT)17 focuses on the implementation of new practices and how these new practices become embedded and sustained in their social contexts. The NoMAD is the NPT’s accompanying tool. The NoMAD tool consists of 23 items that measure the process of implementation from the perspectives of professionals directly involved in implementing complex interventions. The NoMAD tool was selected as it is the first validated measure to assess implementation processes and can be used across multiple stakeholders and settings, providing insight into the adoption of new services at the service provider level. In addition, routinely collected service satisfaction data from CYP and family surveys will be audited to assess satisfaction with the CYPHP services. Surveys will be distributed across service provider and commissioner channels across Lambeth and Southwark (eg, GP events, mailing lists and locality meetings), after implementation of the full CYPHP Evelina London Model of Care. The quantitative data collected from the NoMAD tool and service satisfaction questionnaires will be analysed using descriptive statistics.

Routine clinical and administrative data

Routinely collected data will be used to assess the proportion of service users and service providers who participate in each part of the CYPHP Evelina Model of Care (outlined in figure 1). Outcomes of service users who receive any element of the CYPHP Evelina London Model of Care and description of any relevant adverse clinical events will be documented (as detailed in table 1).

• Download figure
• Open in new tab
• Download powerpoint

Figure 1

Theoretical Framework for the CYPHP Evelina London Model of Care; [x] represents process indicators which are detailed in table 1. The CYPHP Evelina London Model of Care provides numerous universal and targeted services; the interventions described here are provided as an example and are not exhaustive. CYP, children and young people; CYPHP, The Children and Young People’s Health Partnership.

GP practices in the intervention arm will be profiled for size, organisational characteristics, GP characteristics (eg, number and whole time equivalent of GP partners and salaried staff, years qualified, proportion who have additional paediatric qualifications or special interests in child health) and the number of patients registered with the practice. This will facilitate assessment of practice context and effects of contextual variation. The quantitative data collected from all practices will be analysed using descriptive statistics to provide information about the differential implementation rates of the intervention components of the CYPHP Evelina London Model of Care. This will be related to trial outcomes and will facilitate comparison of practices regarding implementation fidelity and reach.

Interviews and/or focus groups with all stakeholders

Qualitative data will be collected through interviews and focus groups with commissioners, service providers, CYP and families who have participated in any component of the intervention arm of the CYPHP Evelina Model of Care. CYP and families will be invited to take part in a focus group or interview after discharge from the CYPHP Evelina London Model of Care. Children under 12 years will only participate alongside their carer. Families will be reimbursed for any travel expenses, but no other form of incentive will be offered.

Sampling will be purposive rather than statistical, to include CYP and families from diverse settings with a wide range of circumstances that may influence responsiveness and accessibility to healthcare. Families will be contacted via the researcher, who is blinded to time, intensity or outcome of treatment.

Topic guides aim to elucidate narrative data on: the experience of CYPHP interventions, healthcare use, self-management and perspectives on care. A range of appropriate art-based methods (eg, pipe cleaners, drawing, puppets) will be used to engage younger children in the discussions.18 A facilitator, who is experienced in working with CYP and families, will guide discussions, which will be audio-recorded.

Primary care service providers involved in the delivery of the CYPHP Evelina London Model of Care will be invited to take part in one-to-one interviews. Completion of NoMAD surveys and administrative data (previously described) will be used as an indicator of engagement and implementation strength to inform recruitment of service providers to these interviews. This will result in sufficient heterogeneity to provide examples of relatively poor and good adoption, delivery and maintenance and will allow us to identify barriers and facilitators to implementation and to generate hypotheses about factors that may be associated with differing outcomes. Topic guides explore common issues when working with the CYPHP Evelina London Model of Care, the perceived effectiveness of the model, the use and understanding of the model of care and changes in practice attributed to the model of care.

Topic guides for interviews with commissioners of healthcare services in Lambeth and Southwark are designed to elicit perceptions on the motivation for commissioning child health service programmes including the CYPHP Evelina London Model of Care, the ambitions for the model of care and the facilitators and barriers to commissioning healthcare services within Lambeth and Southwark.

Analysis of qualitative data will be largely inductive, drawing on the principles of thematic analysis, but informed by the RE-AIM Framework.19 20 Inductive themes will emerge through repeated examination and comparison; tabulation and mapping. In reports, they will be illustrated with anonymised verbatim quotes from participants.

Review of policy documents

Information relating to the context of the trial that may affect the implementation and/or outcomes of the CYPHP Evelina London Model of Care will be documented. In addition, a review of policy documents over the duration of the CYPHP trial will take place. Information will be reviewed and relevant information extracted into a timeline. The timeline will be available to consult when results from other sources (both quantitative and qualitative) begin to emerge, to understand patterns appearing in those data over time and between health centres and catchment areas.

Triangulation of data sources

Credibility and validity will be maximised through cross verification and exploration of differences between the outcomes of the various methods. This takes place in four ways:

1. Maximising validity in analysis of qualitative data within the research team by techniques such as discussing coding, constant comparison, accounting for deviant cases, systematic coding.

2. Triangulation of interviews with results from the NoMAD questionnaire, exploring and accounting for differences.

3. Mapping the perspectives of commissioners, service managers, healthcare providers, CYP and caregivers to give a complete view of stakeholder perspectives.

4. Conducting multiple focus groups sampled from service user, managers and commissioners in different GP clusters.

Ethics and dissemination

This process evaluation has been reviewed by NHS REC Cornwall & Plymouth (17/SW/0275). The study has been registered with Clinicaltrials.gov (Identifier: NCT03461848; pre-results). The results of the study will be disseminated via presentations at local, national and international conferences, peer-reviewed journals and workshops with all stakeholders. The findings of this process evaluation will be crucial for scaling up implementation both within and outside of the boroughs of Lambeth and Southwark, London.