Abstract
The data-mining statistical methods used for disproportionality analysis of drug-adverse event combinations from large drug safety databases such as the FDA’s Adverse Event Reporting System (FAERS), consisting of spontaneous reports on adverse events for postmarket drugs, are called passive surveillance methods. However, the statistical signal detection methods for longitudinal data, as the data accrue in time, are called active surveillance methods. A review of the most commonly used passive surveillance statistical methods and the relationships among them is presented with unified notations. These methods are applied to the 2006–2012 FAERS data; the number of drug signals of disproportionate rates (SDRs) detected by each of these methods with the common SDRs from all of these methods, for the adverse event myocardial infarction, are given. Finally, there is a brief discussion on the recently developed active surveillance methods.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Rothman KJ, Lanes S, Sacks ST. The reporting odds ratio and its advantages over the proportional reporting ratio. Pharmacoepidemiol Drug Saf. 2004;13:519–523.
Evans SJ, Waller PC, Davis S. Use of proportional reporting ratios (PRRs) for signal generation from spontaneous adverse drug reaction reports. Pharmacoepidemiol Drug Saf. 2001;10:483–486.
Greenwood PE, Nikulin MS. A Guide to Chi-Squared Testing. New York, NY: Wiley; 1996.
Yates F. Contingency table involving small numbers and the χ2 test. J R Stat Soc. 1934;1:217–235.
Yule GV, Kendall MG. An Introduction to the Theory of Statistics. 14th ed. London, England: Griffin; 1950.
Huang L, Zalkikar J, Tiwari R. A likelihood ratio test based method for signal detection with application to FDAs drug safety data. J Am Stat Assoc. 2011;106:1230–1241.
Bate A, Lindquist M, Edwards IR, et al. A Bayesian neural network method for adverse drug reaction signal generation. Eur J Clin Pharmacol. 1998;54:315–321.
Noren GN, Bate A, Orre R, Edwards IR. Extending the methods used to screen the WHO drug safety database towards analysis of complex associations and improved accuracy for rare events. Stat Med. 2006;25:3740–3757.
DuMouchel W. Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system. Am Stat. 1999;53:177–190.
Szarfman A, Machado SG, O’Neill RT. Use of screening algorithms and computer systems to efficiently signal higher-than-expected combinations of drugs and events in the US FDA’s spontaneous reports database. Drug Saf. 2002;25:381–392.
Huang L, Zalkikar J, Tiwari R. Likelihood ratio test based method for signal detection in drug classes using FDA’s AERS database. J Biopharm Stat. 2013;21:178–200.
Cook AJ, Wellman RD, Tiwari RC, et al. Statistical approaches to group sequential monitoring of postmarket safety surveillance data: current state of the art for use in the mini-sentinel pilot. Pharmacoepidemiol Drug Saf. 2012;21(suppl):72–81.
Kulldorff M, Davis RL, Kolczak M, Lewis E, Lieu T, Platt R. A maximized sequential probability ratio test for drug and vaccine safety surveillance. Seq Anal. 2011;30:58–78.
Schuemie MJ. Methods for drug safety signal detection in longitudinal observational databases: LGPS and LEOPARD. Pharmacoepidemiol Drug Saf. 2011;20:292–299.
Li L. A conditional sequential sampling procedure for drug safety surveillance. Stat Med. 2009;28:3124–3138.
Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B. 1995;57:289–300.
Ahmed I, Haramburu F, Fourrier-Reglat A, et al. Bayesian pharmacovigilance signal detection methods revisited in a multiple comparison setting. Stat Med. 2009;28:1774–1792.
Ahmed I, Thiessard F, Miremont-Salame G, Begaud B, Tubert-Bitter P. Pharmacovigilance data mining with methods based on false discovery rates: a comparative simulation study. Clin Pharmacol Ther. 2010;88:492–498.
Cao H, Hripcsak G, Markatou M. A statistical methodology for analyzing co-occurrence data from a large sample. J Biomed Inform. 2007;40:343–352.
Domínguez-Almendros S, Benitez-Parejo N, Gonzalez-Ramirez AR. Logistic regression models. Allergol Immunopathol (Madr). 2011;39:295–305.
Gibbons JM, Cox GM, Wood ATA, et al. Applying Bayesian model averaging to mechanistic models: an example and comparison of methods. Environ Model Soft. 2008;23:973–985.
Madigan D, Genkin A, Lewis DD, Fradkin D. Bayesian multinomial logistic regression for author identification. In: Proceedings of the 25th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering (MaxEnt 05). Melville, NY: American Institute of Physics; 2005:509–516.
Pearl J. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Mateo, CA: Morgan Kaufmann; 1988.
Gould AL. Practical pharmacovigilance analysis strategies. Pharmacoepidemiol Drug Saf. 2003;12:559–574.
DuMouchel W, Pregibon D. Empirical bayes screening for multi-item associations. In: KDD’ 01: Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York, NY: ACM; 2001:67–76.
Banks D, Woo EJ, Burwen DR, Perucci P, Braun MM, Ball R. Comparing data mining methods on the VAERS database. Pharmacoepidemiol Drug Saf. 2005;14:601–609.
Noren GN, Edwards R. Opportunities and challenges of adverse drug reaction surveillance in electronic patient records. Pharmacovigil Rev. 2010;4:17–20.
Noren GN, Sundberg R, Bate A, Edwards IR. A statistical methodology for drug-drug interaction surveillance. Statistics in Medicine. 2008;17:3057–3070.
Noren GN, Hopstadius J, Bate A, Star K, Edwards IR. Temporal pattern discovery in longitudinal eletrionic patient records. Data Min Knowl Disc. 2010;20:361–387.
Caster O, Norén GN, Madigan D, Bate A. Large-scale regression-based pattern discovery: the example of screening the WHO global drug safety database. Stat Anal Data Mining. 2010;3:197–208.
Deshpande G, Gogolak V. Data mining in drug safety. Pharm Med. 2010;24:37–43.
Oracle Corporation. Empirica signal: signal management training exercises. https://inside.fda.gov:9003/downloads/ProgramsInitiatives/Drugs/ComputationalScienceCenter/UCM241760.pdf. Published 2011.
Roux E, Thiessard F, Fourrier A, Begaud B, Tubert-Bitter P. Evaluation of statistical association measures for the automatic signal generation in pharmacovigilance. IEEE Trans Inf Technol Biomed. 2005;9:518–527.
Woo EJ, Ball R, Burwen DR, Braun MM. Effects of stratification on data mining in the US Vaccine Adverse Event Reporting System (VAERS). Drug Saf. 2008;31:667–674.
Madigan D, Ryan P. What can we really learn from observational studies? The need for empirical assessment of methodology for active drug safety surveillance and comparative effectiveness research. Epidemiology. 2011;22:629–631.
Zorych I, Madigan D, Ryan P, Bate A. Disproportionality methods for pharmacovigilance in longitudinal observational databases. https://www.stat.columbia.edu/∼madigan/PAPERS/zorych.pdf. Published 2011.
Author information
Authors and Affiliations
Corresponding author
Additional information
Author Note
The views expressed in this article do not necessarily represent those of the US Food and Drug Administration.
Rights and permissions
About this article
Cite this article
Huang, L., Guo, T., Zalkikar, J.N. et al. A Review of Statistical Methods for Safety Surveillance. Ther Innov Regul Sci 48, 98–108 (2014). https://doi.org/10.1177/2168479013514236
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1177/2168479013514236