Elsevier

Contemporary Clinical Trials

Volume 83, August 2019, Pages 81-87
Contemporary Clinical Trials

Bridging blinded and unblinded analysis for ongoing safety monitoring and evaluation

https://doi.org/10.1016/j.cct.2019.06.022Get rights and content

Abstract

In order to better characterize the safety profile of investigational new drugs (INDs) during clinical development, more interest and attention have been paid to ongoing safety monitoring and evaluation. The 2015 US FDA IND safety reporting draft guidance compels sponsors to periodically evaluate unblinded safety data. However, maintaining the trial blind is necessary to avoid jeopardizing the validity of study findings. In this article, we propose an innovative new approach which includes analyzing both blinded and unblinded data. The proposed two-stage framework incorporates periodic analyses of blinded safety data to detect and flag adverse events that may have potential risk elevation related to experimental treatment, as well as planned unblinded analyses to quantify associations between the drug and adverse events, and to determine thresholds for referring adverse events for medical review and safety reporting.

Introduction

Evaluating patient safety is an integral and essential part of the clinical trial process. Safety monitoring and evaluation from ongoing clinical trials has a direct impact on the safety and clinical care of patients enrolled during and after completion of these trials. Goals of ongoing safety evaluation from clinical trials include early detection of important safety signals, protecting patients from unnecessary risks, and developing the safety profile of the experimental treatment. The regulatory landscape for safety monitoring of health care products has changed considerably in recent years. The US FDA published a final rule amending the safety reporting requirements under 21 CFR part 312 and 21 CFR part 320 in September 2010. The final rule has placed strong emphasis on expediting reports of serious events with a reasonable possibility of being associated with the experimental treatment, so that safety evaluations are not confounded with excessive noise and product safety can be assessed more meaningfully [1]. In particular, the 2012 final guidance on IND safety reporting (Safety Reporting Requirements for Investigational New Drug (IND) and Bioavailability/Bioequivalence (BA/BE) Studies) recommends that sponsors conduct ongoing safety evaluations, including periodic review and analysis of the entire safety database, not only for IND safety reporting purposes, but also to update the investigator brochure (IB), protocol, and consent forms with new safety information [2].

Moreover, the 2015 draft guidance (Safety Assessment for IND Safety Reporting) provides recommendations on the composition and role of a safety assessment committee (SAC), how it differs from a data monitoring committee (DMC), and how and when to unblind safety data. Specifically, the US FDA recommends “unblinding to allow a comparison of event rates and detection of numerical imbalances across treatment groups to identify important safety information.” [3]. It is generally agreed that unblinding during ongoing clinical trials, by an independent expert committee (such as a DMC or SAC), is needed to identify and evaluate important imbalances in serious adverse events while studies are ongoing [3,4]. With randomized and blinded clinical trials, it is also necessary to maintain the blind of study personnel to treatment assignment in order to avoid jeopardizing the validity of study findings. Auspiciously, ongoing analysis of blinded safety data can be used to inform relationships between the drug and adverse events. With an expected range of event rates from internal and/or external data sources, we can assess whether there is a possible risk elevation due to experimental treatment. Furthermore, evidence from a blinded safety analysis could be used to evaluate the need for performing an unblinded safety analysis [5,6]. Therefore, it is feasible and potentially advantageous to combine the strength of both periodic blinded analyses and planned unblinded analyses for monitoring and evaluation of accumulating safety data.

In this article, we propose a two-stage framework for ongoing safety monitoring and evaluation. In the first stage, we periodically analyze blinded safety data to detect and flag adverse events that may have potential risk elevation related to experimental treatment. In the second stage, we conduct planned unblinded analyses to quantify associations between the drug and adverse events, and to determine thresholds for referring adverse events for medical review and possible safety reporting. The remainder of this article is organized as follows: In Section 2, we describe the proposed two-stage framework for ongoing safety monitoring and evaluation. Extensive simulations are presented in Section 3 to evaluate the performance of the proposed approach, in comparison to a single-stage approach with only an unblinded analysis. Practical considerations and related issues are discussed in Section 4.

Section snippets

General framework

Many adverse events are anticipated to occur in patients during the course of a clinical trial. These events are recognized on the basis of prior experiences (both clinical and non-clinical studies) with the product under investigation and with related products. The safety monitoring and evaluation process needs to distinguish between events that are adverse drug reactions (i.e., events likely caused by the investigational product) from those that likely would have occurred in the absence of

Numerical results

We illustrate our two-stage safety monitoring procedure with a hypothetical trial inspired by a phase III trial. This hypothetical trial randomized 4000 patients into treatment and control arms with a 1:1 randomization ratio. The priors and critical pooled rates were based on the RSI from previously completed trials. Out of 1000 adverse events (in preferred term) simulated, 50 events were previously recognized as adverse reactions.

Discussion

In the process of characterizing the product safety profile and identifying possible causal relationships between experimental treatment and adverse events while studies are ongoing and blinded, we propose a two-stage framework for safety monitoring and evaluation. The two-stage approach allows us to explore early safety signals and flag potential adverse reactions during the first stage blinded analysis. The second stage unblinded analysis enables us to validate and report adverse reactions,

References (24)

  • G. Ball

    Continuous safety monitoring for randomized controlled clinical trials with blinded treatment information: part 4: one method

    Contemp. Clin. Trials

    (2011)
  • US Department of Health and Human Services

    Food and Drug Administration, Investigational new drug safety reporting requirements for human drug and biological products and safety reporting requirements for bioavailability and bioequivalence studies in humans

    Fed. Regist.

    (2010)
  • US Department of Health and Human Services

    Food and Drug Administration, Safety Reporting Requirements for INDs and BA/BE Studies, Guidance for Industry and Investigators

    (2012)
  • US Department of Health and Human Services, Food and Drug Administration

    Safety Assessment for IND Safety Reporting, Draft Guidance for Industry and Investigators

    (2015)
  • P. Archdeacon et al.

    Optimizing expedited safety reporting for drugs and biologics subject to an investigational new drug application

    Ther. Innov. Regul. Sci.

    (2014)
  • P.M. Schnell et al.

    A bayesian exposure-time method for clinical trial safety monitoring with blinded data

    Ther. Innov. Regul. Sci.

    (2016)
  • A.L. Gould et al.

    Monitoring potential adverse event rate differences using data from blinded trials: the canary in the coal mine

    Stat. Med.

    (2017)
  • P.A. Lachenbruch et al.

    Sentinel event methods for monitoring unanticipated adverse events

    Adv. Stat. Methods Health Sci.

    (2007)
  • L. Zhu et al.

    Statistical monitoring of safety in clinical trials

    Stat. Biopharm. Res.

    (2016)
  • B. Yao et al.

    Safety monitoring in clinical trials

    Pharmaceutics

    (2013)
  • J. Herson

    Safety Monitoring

    (2014)
  • G. Ball et al.

    Blinded safety signal monitoring for the fda ind reporting final rule

    Stat. Applic. Clin. Trials Personalized Med. Financ. Bus. Analytics

    (2016)
  • Cited by (0)

    View full text