The concepts and guidance are presented approximately in the order of the life cycle of a traditional trial and the key points are summarised in Table 1.
1. Communication
When explaining a potentially complex trial design, it is essential to consider the intended audiences (e.g. potential participants, clinicians, regulators, ethics committees, the public) and tailor the information appropriately: what does this audience already know about trial designs, what are they most likely interested in or need to know, and what sort of language is appropriate?
A clear diagram of the trial design and the flow of what could happen to each participant in the trial should help all audiences, although the level of detail required will vary. Labels such as “platform,” “basket,” or “umbrella” lack universally-accepted definitions and some example protocols described trials that fall across multiple categories. We recommend greater emphasis on developing clear graphical depictions of the design rather than on relying on terminology (see Supplementary file 1 for examples).
All text for potential participants should explain the relevant components of the trial. Patient representatives on STAMPEDE (ISRCTN78818544) often remind the Trial Management Group (TMG) that, while design features may fascinate many researchers, individual patients are more likely interested in the aspects that directly affect them. This can be addressed by making clear the treatment groups to which they could potentially be randomised, and de-emphasising discussion of treatments assessed in other elements of the protocol. Similarly, ethics committees and funders are primarily interested in what the design can achieve, rather than its novelty.14, 15
A particular format that was found to be useful was a staged informed consent process. This can avoid overloading potential participants with unnecessary information and ease the burden on those discussing consent. Potential participants need to be given sufficient, applicable detail to enable an informed decision at that stage. For example, at the first stage of consent participants could be given detail about being tested for a biomarker as screening for entry and at the second stage of consent, when the biomarker is known, participants could be given detail about which treatments they may be randomised between.
Communication between sites and the trial teams is key and trial teams for such protocols can be large. Therefore, we recommend dividing sites across operations members of trial teams so site teams have a dedicated person to contact centrally with questions.
2. Funding
Researchers need to recognise that funding may need to be sought from multiple sources across the life of a platform protocol and this multiple collaboration will take more time than if there was one funder. Cancer examples (e.g. CompARE, FLAIR, STAMPEDE, plasmaMATCH, AML LI-1) started with both a research trial infrastructure grant from a cancer charity (Cancer Research UK or Blood Cancer UK) and support in some form from an industry partner e.g. FLAIR with Jansen; STAMPEDE with Pfizer, Novartis and Sanofi; plasmaMATCH with AstraZeneca and Puma; AML LI-1 Cyclacel, Ambit and Sunesis), together with flexible use of core MRC funding for STAMPEDE. Each new comparisons must come with sufficient funding and include a contribution to fund the overall infrastructure. For example, new comparisons in these trials have included collaboration with and support from Abbvie, Astellas, AstraZeneca, Bayer BCTI, Synta, Cell Therapeutics, Karyopharm and Janssen, demonstrating that key international pharmaceutical companies are open to supporting comparisons within ongoing platform protocols.
Protocols determined upfront to be platform protocols are still relatively new for most charitable funders. It is important in each application to make clear the potential savings in using this efficient design in terms of time, patient numbers and cost versus running separate trials, and the potential gain in terms of answering additional questions, even if the form does not explicitly ask for this information. For example STAMPEDE, a MAMS platform protocol in prostate cancer, will report over a 20 year period comparisons of 10 potential treatments against the contemporary standard‑of‑care, each powered to detect a benefit in overall survival. To achieve this through 10 traditional 2-arm trials delivered sequentially might be expected to take more than 3 decades and involve many more patients receiving control therapies.
Drawing new comparisons into an existing platform feels operationally more efficient than opening a new traditional trial which competes for patients or recruits subsequently, but this choice requires wide support from the research community within the disease area. Some of the efficiency is derived from the same team building out of the same protocol and statistical analysis plans. However, the CompARE, FLAIR and STAMPEDE teams estimated time from initial meeting to discuss an additional arm until first site activated for the new comparison was a median of 30 months (range 12-35 months). These teams followed the usual due diligence processes in assessing the importance of the clinical question and to consider potential issues in operationalisation. Timelines can be impacted by infrequent meetings of funding review panels. Therefore, getting to first site activated may be no quicker than for a separate standalone traditional two-arm randomised controlled trial (RCT) but getting to full speed of recruitment is often quicker. For example within STAMPEDE, the first 80 sites took 5 years to open, whereas for the first added comparison, it took less than 3 months to get to first patient entered in 80 sites..
Due to the occasional need for many tasks to be done at the same time (for example, analysing and closing out one arm whilst opening a new comparison) or the longer time required to design such trials, there is often a need at some point in a platform protocol for funding outside of a grant (for example through a trials unit infrastructure award). Trials units should be aware of this risk before taking on a platform trial.
3. Protocol
Careful protocol development is essential for effective conduct of a platform protocol. Two structures have arisen: modular and single protocols with their merits and challenges discussed extensively elsewhere.7 In short, a “single protocol” approach (e.g. AddAspirin provides one document to capture all aspects of the trial but sections, particularly the treatment or eligibility section, can become long and unwieldy over time. “Modular protocols” (master plus comparison-specific appendices, e.g. FOCUS4) may circumvent this issue through grouping relevant information, but may entail many documents under separate version control which then require careful oversight to ensure the correct documents being used. The choice of protocol structure is best made as the most future-proofed option considering in particular how many new arms are expected (fewer favours a single protocol) and whether sites will take part in all arms (If not, a modular protocol is more user-friendly). In general, the more separate the questions or the more separate the diseases the more likely a modular protocol would be more useful. We recommend explicitly stating in the protocol from the outset that future comparisons will be incorporated into the protocol where appropriate, as this facilitates making such additions via a protocol amendment.
Platform protocols may involve pre-planned interim analyses and the protocol must adequately explain the actions arising from early stopping of recruitment to one or more comparisons and flag any potential for new comparisons. The protocol structure and content should be regularly reviewed for compliance with regulations and good practice: platform protocols will often run for longer than standard 2-arm protocols and are therefore more likely to be exposed to such changes. Eligibility criteria could be common across the whole trial or specific to each treatment comparison. This has implications for the practicalities of recruitment at sites with clarity about which participants can, or do, contribute to which comparisons, and should be considered clearly in dissemination of findings and their generalisability.
Many regulators encourage trial teams to discuss all aspects in detail before submitting a platform protocol. Early engagement and ongoing communication with the regulator is essential in these trials.16 Trialists should aim for review by an ethics committee with previous experience and training in platform protocols.17
4. Database and Randomisation System
Thorough consideration is needed for each platform protocol in choosing a database and choosing a structure for the database. Platform protocols require databases with flexible, scalable designs, and capacity to incorporate changes and growth. The randomisation system must cope with stopping and adding arms while maintaining unbiased randomisation, and varied activation times at individual sites.
Platform trials will employ either a single database or a modular database design with shared elements; the database structure decision can be separate to the decision about protocol structure. A modular approach is likely preferable if the current (or future) arms may differ in terms of the information required e.g. toxicity or efficacy reporting requirements.
The larger and more complex the platform protocol, the more data management, programmer and statistical expertise is required to develop and maintain the databases; this may be little recognised by funders. Example challenges in developing case report forms (CRFs) and databases for adaptive trials, with recommendations for possible approaches, are detailed elsewhere.6 Notable challenges arise from adding or closing comparisons or from updates in the standard-of-care or medical coding dictionaries. Platform protocols may employ generic CRFs for all comparisons, comparison-specific CRFs, or a mix. The right choice will depend on the trial and data in question, which can be elicited by a risk assessment of data collection within and across comparisons; the risk assessment always needs updating when a new comparison is added and is usefully revisited when a comparison is closed out. Collecting data to effectively monitor patient safety should be paramount in all comparisons.
The platform approach also may not necessarily offer savings in central data management despite the shared infrastructure. In PLATO, outcome measures are similar across the three sub-trials but each of them has specific eligibility criteria, interventions, assessment timings, and pharmacovigilance reporting requirements, thus each sub-trial needed dedicated CRFs. The sub-trials differed in target sample size, numbers of treatment arms, and recruitment and analysis periods, and so three separate databases were built and separate randomisation services used. A one-size-fits-all approach is likely inappropriate and anything other than a tailored approach may need to be robustly justified to funders.
Trialists should ensure the choice of randomisation system can incorporate changes to eligibility, sample size, multi-randomisation sub-groups, weightings and stratification factors.
5. Patient and Public Involvement (PPI)
The importance of PPI in designing and delivering RCTs is increasingly recognised and should be considered vital in platform protocols. For example, the plasmaMATCH (ISRCTN16945804) and PHOENIX (ISRCTN47127434) trial teams sought PPI at an early stage, getting input from multiple patient advocate groups and discussion at targeted forums of patients. Although it is good to have experienced PPI input on oversight committees, it is important to seek views from a broader group. Early involvement of PPI members ensures alignment with the patient pathway and improved acceptability of a complex trial design. PPI members helped the teams produce participant information materials to communicate in accessible language the research aims and activities. By naming the patient advocates as collaborators on the grant applications, teams can ensure continued PPI engagement throughout trial development. The PHOENIX team found PPI members were better able than the trial team to communicate to regulators and ethics committees the acceptability and importance of the novel trial design to patients. Hence we encourage their attendance at regulatory advisory and ethics committee meetings. PPI engagement must continue as the platform evolves, with PPI representatives supported in understanding the design implications to enable input on the development of new comparisons and closure of existing ones. PPI input should be appropriately budgeted for in the grant. In larger trials, it may enable better support of the PPI representatives if each PPI member is associated with one of the comparisons to make their workload more manageable.
6. Contracts and Agreements
Platform protocols assessing investigational agents (CTIMP trials) may require interaction with, and support from, multiple pharmaceutical companies. Contracts may also be needed with further parties (e.g. multiple academic institutions, hospitals, and industry partners) and each needs to encompass the long-term nature of platform trials. This aspect likely takes more time to agree than for any standard two-arm trial. Pushing for a standard template with the same terms and conditions may be valuable e.g. as in plasmaMATCH. As the importance of genetic profiling increases, in order to define potential pathways within these complex trials, contractual arrangements with laboratories are critical and must be in place before such work is undertaken. Regulatory compliance of all partners should be assured within contractual arrangements, for the protection of patients and to ensure robustness of data. Another option is to have a start-up contract so that the trials unit can get to the stage of ethics and regulatory submission whilst the main contract is being discussed.
7. External Trial Oversight
Long-term protocols require external oversight committees (such as Data Monitoring Committees) comprised of researchers with practical experience of running such trials. Charters for such oversight committee may define a committee of standard size and function as in traditional trial designs but the committee should expect greater longevity and to face a greater workload if the trial has many comparisons with separate interim analyses or frequent addition of new arms. A larger committee may help to make the meetings quorate when some members cannot attend. The oversight committees must ensure that recruitment to the protocol is not being hampered by an infeasible or an unpopular comparison. Statistical members must fully understand the original design and the implications of any adaptations. Replacement of committee members is more likely needed in long-term trials or in those with intense meeting and review schedules so handover to new members must be well organised. A summary of historical decisions should ideally be prepared for new members, and the new and departing member should aim to attend at least one meeting together.
8. Trial Management Group
Platform trials are supported by large Trial Management Groups e.g. FOCUS4’s TMG peaked at 34 members. The responsibilities of such large TMGs can usefully be delegated to specific sub-committees, each responsible for components of the platform. A functional TMG is prepared to adapt its leadership structure, engage the most suitable expertise at each trial stage, and recognise those involved, including through authorship and exposure at conferences. An overall Chief Investigator (CI) and trial team can be usefully supported by Comparison CIs (CCIs) and Comparison Co-CI (CoCCI) who can play major roles in development, conduct and reporting of each comparison.7 Within such a structure, platform trials offer an important opportunity for development of potential CIs of the future.
9. Trial Staffing
Like all trials, platform protocols need to be adequately resourced, but prediction of requirements is often more difficult. In traditional trials, tasks usually happen sequentially; in platform protocols, tasks relating to set-up, process improvement and oversight happen concurrently and continuously as new comparisons are developed, costed, and opened or closed over time.6, 18 Sufficient resources must be available and allocated to oversee safety and data quality in ongoing arms and timely set‑up of new comparisons. Site staff will require more support than expected for a traditional trial design. Trials unit staff may need to develop new processes and skill sets to deliver these trials successfully, adding to the resource burden. Succession planning for platform protocol staff is essential, requiring more input from senior staff.
An illustration of this, based on three real trials, is provided in Table 2. PlasmaMATCH approximately aimed to screen 1200 patients to recruit 200 patients into the platform’s therapeutic components, forming five arms. The trial aimed to recruit relatively few participants: three arms required <16 participants, the others 69 and 78. However, 1.5 full-time equivalent/year (FTE/yr) trial management and 1.5 FTE/yr data management staff were required for delivery. A traditional trial recruiting the same number of participants is likely to require two thirds this staffing. These numbers are not unique: FOCUS4, a platform protocol approximately aimed to screen 1400 to recruit 400, required 2 FTE/yr trial management and 2 FTE/yr data management staff.
Larger staffing numbers and greater scientific and operational complexity requires more senior-level project management oversight. PlasmaMATCH allocated 1 FTE/yr senior-level project management staff whilst participants were receiving active treatment, three times that typical for this trials unit for a traditional trial with similar participant numbers. Similarly, FOCUS4 allocated 1 FTE/yr senior-level project management staff to manage the team. These platforms may appear staffing-intensive but are staffing-efficient compared to multiple separate trials and screening programmes assessing the same number of primary hypotheses.
Some trials units may struggle to resource platform protocols appropriately if the recruitment rate is higher than anticipated or new processes or training are required to support the delivery of new trial adaptations. For example, the data management resources allocated in PlasmaMATCH were considered insufficient to manage the rapidly accumulating data while adapting the platform to include new arms. Negotiating funding for these posts can prove difficult since commercial funders may wish to focus on funding the comparison relevant to their treatment rather than the totality of the platform. Funders must recognise the scale and complexity of platform designs to ensure sufficient funding is available to support safe, efficient trial and data management activities. Trials units need to develop and maintain ongoing communication with funders, particularly those providing infrastructure costs, as funding changes happen throughout the trial as arms are added and dropped, and other major changes happen.
10. Data Management
Platform protocols present specific data management challenges requiring bespoke solutions. Data volume at a trials unit and the numbers of participants and participating centres are likely to be on a much larger scale than for most traditional trials. Data cleaning and checking should be considered an ongoing process, not an activity performed only prior to analysis, both so as not to overwhelm sites and so that all arms are cleaned with a similar frequency. This avoids any bias when reporting the results from one or many arms. The data cleaning process needs to be set up as a functional system not reliant on a particular person. As the data burden tends to be greater in platform protocols, extra care should be given to minimising the volume of data collected and/or targeting data cleaning at data items that will soon be used. If we consider each comparison as a trial that happens to share its protocol with other trials, the requests to sites are no different within each trial. However, as all requests are under one protocol and platform trials tend to continue for longer, communications can lead a busy site to feel overburdened. Some trials have found it useful to have a dedicated committee across sites and role functions to capture and address site experiences (eg “Site Advisory Group”).
11. Statistical Considerations
One statistical analysis plan may cover the entire platform protocol, eg PLATO and CompARE, but this will not be appropriate for every platform protocol; the choice will depend on how similar are the outcome measures, the timing of analyses and the potential for new analysis methods developed later. Within a platform protocol team, it is important to have a senior statistician involved in analyses during the trial who will attend Independent Data Monitoring Committee (IDMC) meetings and to give consideration to avoiding bias by including a senior statistician, who is unaware of the accumulating data analysis, in decisions around adaptations. Design issues are discussed elsewhere.19
12. Safety
In principle, serious adverse event (SAE) processing is the same in platform trials as in other trials. With multiple treatment arms, there are more contemporaneous treatments against which sites (principle investigators) and safety reviewers must assess relatedness and expectedness and trials unit staff likely have more work in ensuring that the correct reference safety information (RSI) is being used. In these trials, with several interventions from different pharmaceutical collaborators for example, there are more parties to choose between to notify of an SAE. It may help to have a dedicated member of staff for managing SAEs, who can develop expertise in this area.
13. Training
Due to the potential longevity of platform trials, training materials and documentation for site and trials unit staff will need to be updated regularly. Approaches to training sites need to be kept fresh and inspiring throughout in order to avoid training fatigue. Long-term trials should also benefit from “history training” for new trials unit staff.
Sites might usefully be aware of any forthcoming interim lack-of-benefit analyses and of potential actions that may be needed in response.9 Streamlined training may be suitable for sites who are demonstrably familiar with the design. Site and CTU staff could usefully understand why recruitment need not be paused around interim analyses.
14. Reporting
Although the emphasis for reporting to participants should be on information pertinent to their comparison, many participants will wish to hear about all aspects of the protocol; participants may talk together and it is fairer to transparently offer results from across the protocol’s activities to all participants should they want it.20 Communicating efficacy results and emerging safety data requires careful tailoring to participants who were in the comparison, participants whose future management in the trial may be impacted by the findings and participants elsewhere in the platform. Ideally, participants would flag whether they wanted findings from only “their” comparisons, results from other comparisons, or no results. This could potentially be incorporated into the informed consent process.
The minimum necessary information about the overall protocol needed to contextualise recruitment, treatment, follow-up and analysis considerations should be given. Although CONSORT extensions for multi-arm randomised controlled trials21 and adaptive trials22 provide pertinent guidance, a tool for building a bespoke CONSORT-based checklist for each platform protocol publication is needed.
Better guidance also needed on when results of a published comparison should be uploaded to trial registers and better trial register systems are needed to hold these results.
Clear publication plans are required for platform protocols to ensure that all comparisons are reported at the appropriate time while minimising clashes of staff time. Publication plans should also ensure that all individuals supporting each comparison and the overall protocol are appropriately credited. At comparison set‑up, authorship principles should be codified; authorship and order of authors need not be the same for each comparison. It is important to consider how the release of results from one comparison will impact the ongoing comparisons, for example plasmaMATCH reported 4 cohorts within 3 years of opening to recruitment. Trials need to have plans in place to mitigate the risks around this.
15. Adding and Closing Comparisons
Adding comparisons to a platform is similar to starting a new trial, except that a protocol amendment process can be followed rather than a new application to the Competent Authority or Ethics Committee, and participating sites are already experienced in running most aspects of the platform. Agreement for adding a comparison to a platform is needed from the appropriate oversight committees and sponsor, with assent from sites prior to seeking funding. Working through a checklist for deciding whether to incorporate a new clinical research question into an ongoing protocol is useful (see Table 1 of Schiavone 2019 Trials).7 A new, dedicated Comparison Chief Investigator can share workloads and responsibilities as the clinical lead for a comparison. Once funding is secured, the new registration and randomisation processes should be set‑up with new CRFs and updates to the pharmacovigilance system. Added comparisons currently pass through amendment sub-committees at UK ethics committees, but we encourage review by, and attendance at, a full ethics committee meeting.17
Closing recruitment to the relevant arms of a comparison requires careful planning. The Participant Information Sheet (PIS) need not be amended immediately if recruitment to some arms is stopped at short notice.9
Trialists should aim to close-out elements of each comparison as soon as practicable rather than leaving all comparisons open, and carefully document this process. This makes implementation easier for sites and potential audit/inspection easier for regulatory inspectors. Removal of references to a treatment arm no longer recruiting will simplify the protocol, but safety information relating to a closed arm (dose reductions, long-term effects, etc.) should remain available to sites as long as any patients remain on treatment. Aspects of closing out a completed comparison may follow normal trial closure and quality assurance guidelines. Most trials units’ close-out processes and regulatory timelines will have been designed for traditional trial designs and may require adaptation. Before submitting an “End-of-Trial Notification”, discussion is encouraged with regulators around reporting requirements and ongoing consent issues (with regard to future data and/or sample sharing), and with funders around long-term follow-up of participants. Archiving requirements may exceed the scope of the original funding.
When reporting results of a platform trial across time, it is worth thinking of them as the result of separate trials because sites’ recruitment may vary across a trial’s eligibility spectrum over time. For example, after recruitment completed to the original, chemotherapy-based arms of STAMPEDE, the average age of incoming patients increased – some sites had not been randomising older participants with the same vigour, even without age-based eligibility criteria.23 Other elements of follow-up and assessment can also change over time with changes in needs of active comparisons.
16. Maintaining Relevant Control Arm
Randomised trials need to always compare against an up-to-date standard‑of‑care. In long‑running platform protocols, new data may emerge that leads to changes in the standard-of-care for ongoing comparisons. Each research treatment should be assessed against the relevant concurrent standard-of-care at the point of recruitment. In a platform protocol, the data leading to such a change may come from another comparison within the platform and/or from other trials. STAMPEDE has updated its standard-of-care five times, once for an eligibility subset based on data from another trial, once for a subset of patients based on results from a STAMPEDE comparison, and thrice based on a combination of STAMPEDE and other trial results.
17. Data Sharing
Data and sample sharing are important aspects of modern clinical trials. It is important to recognise that data sharing applications are likely to come in for comparisons with primary results reported while other comparisons are still ongoing and so may feel more burdensome. There is an onus on applicants to be clear on exactly which data are required from which comparison. Sharing data from completed comparisons must not compromise ongoing or future work in the platform – applicants and researchers should consider any contractual arrangements in place and any obligations to report a comparison before data is shared.