Abstract
Drug repositioning, the process of discovering, validating, and marketing previously approved drugs for new indications, is of growing interest to academia and industry due to reduced time and costs associated with repositioned drugs. Computational methods for repositioning are appealing because they putatively nominate the most promising candidate drugs for a given indication. Comparing the wide array of computational repositioning methods, however, is a challenge due to inconsistencies in method validation in the field. Furthermore, a common simplifying assumption, that all novel predictions are false, is intellectually unsatisfying and hinders reproducibility. We address this assumption by providing a gold standard database, repoDB, that consists of both true positives (approved drugs), and true negatives (failed drugs). We have made the full database and all code used to prepare it publicly available, and have developed a web application that allows users to browse subsets of the data (http://apps.chiragjpgroup.org/repoDB/).
Design Type(s) | data integration objective • database creation objective |
Measurement Type(s) | Concomitant Medication Use Indication |
Technology Type(s) | digital curation |
Factor Type(s) |
Machine-accessible metadata file describing the reported data (ISA-Tab format)
Similar content being viewed by others
Background & Summary
Drug repositioning is the process of discovering, validating, and marketing previously approved drugs for new indications. The drug repositioning field is growing rapidly, due to the promise of reduced costs and expedited approval schedules1. Unsurprisingly, the number of publications in PubMed with the text ‘drug repositioning’ in their abstracts has ballooned from only 11 articles per year in 2007 to 274 in 2015. Prevalent among repositioning publications are computational methods, which perform in silico experiments to determine the most promising repositioning candidates for further preclinical testing2,3. Computational repositioning methods have been developed that use a variety of direct and indirect evidence for hypothesis generation, including molecular4–7, literature-derived8–11, and clinical12,13 data. In many computational repositioning methods papers, authors claim that their methods are analytically validated in some way. Authors typically present either case studies, in which they describe a single well-supported example, or sensitivity- and specificity-based analyses to support their claims. Sensitivity- and specificity-based methods rely on comparing the full spectrum of predictions made by a repositioning method to currently approved or investigational drug-indication pairs14.
It is difficult, however, to directly compare and/or independently assess computational methods or reported new repositioning candidates due to the variety of analytic validation methodologies favored by different groups (or impossible if only case studies are provided). Furthermore, studies that claim to use unbiased validation methods like predictive ‘area under the receiver-operator curve’ (AUROC)15 rely on true, approved drug-indication pairs only, and typically assume that all other drug-indication pairs are false. This assumption is unsatisfying because it relies on a database of approved drugs (the choice of which varies widely in the repositioning literature14), and suggests that all novel repositioning predictions are false.
To address these concerns, we present repoDB, a database of approved and failed drugs and their indications. repoDB approved indications were drawn from DrugCentral, which contains United Medical Language System (UMLS) indications mapped from free-text mentions in drug labels16,17. The UMLS is a large biomedical thesaurus that contains information about a wide variety of medical concepts16. Failed indications were drawn from the American Association of Clinical Trials Database (the ‘AACT Database’, Clinical Trials Transformation Initiative, 2016), which contains structured records from the National Library of Medicine’s ClinicalTrials.gov database service. Indications in the AACT database are again annotated using medical subject heading (MeSH) terms (a subset of UMLS terms), and represent a mix of investigator-submitted and automatically extracted annotations (see Table 1 for database characteristics and Fig. 1a for an overview of our methodology)18. repoDB spans 1,571 drugs and 2,051 UMLS disease concepts, accounting for 6,677 approved and 4,123 failed drug-indication pairs (see Table 2 and Fig. 1b for trial status breakdown). To further assist investigators, we provide a web application (http://apps.chiragjpgroup.org/repoDB/) that enables browsing of the full repoDB database and allows users to download either the full database (or portions relevant to their work). repoDB will enable investigators to not only benchmark their computational repositioning methods, but also gain insight into trends in the drug discovery field and avenues that have not yet been explored.
Methods
Approved indication retrieval
As our source of information on currently approved drugs and their indications, we downloaded the full DrugCentral PostgreSQL database, and extracted the tables containing DrugBank identifiers, synonyms for all drugs, and UMLS-mapped indication terms (http://drugcentral.org/, DrugCentral [Full PostgreSQL Database], Data Citation 1)17. DrugCentral provides comprehensive information about approved and investigational drugs, including UMLS-mapped approved indication(s) and, important for the construction of repoDB, all synonyms for a given drug. DrugCentral uses the OMOP annotation pipeline to map free text drug labels to UMLS terms, which achieves high annotation accuracy (F1 measures around 0.98)19. We retrieved all DrugCentral synonyms for all Food and Drug Administration of the United States (FDA) approved drugs. A list FDA approved drugs was derived from DrugBank, a large drug database that is commonly used by computational drug repositioning methods and is frequently updated with new information (see Fig. 1a)20.
Failed indication retrieval
As our source of information on unsuccessful drug-indication pairs, we downloaded the AACT database from the Clinical Trials Transformation Initiative website (https://www.ctti-clinicaltrials.org/aact-database, March 27, 2016 version, AACT [Pipe Delimited] Data Citation 1)18. The AACT database contains structured clinical trial records from the National Library of Medicine’s ClinicalTrials.gov service, and includes information about current trial status and interventions (e.g., drugs, life-style changes) studied in each trial. We chose to use AACT/ClinicalTrials.gov as our source for trial information because the sponsors of most failed trials do not publish their results in the scientific literature (around 78% fail to publish)21. We loaded and parsed the full database in R statistical programming environment22, and took only those trials that included: 1) an annotated phase between phase 0 and phase 3, 2) a current, overall status of suspended, terminated, or withdrawn, and 3) a MeSH term-mapped intervention (provided by AACT), and 4) a UMLS term-mapped indication (provided by investigators and/or MetaMap analysis of free-text trial descriptions). While the majority of terms are derived from investigator supplied UMLS terms, ClinicalTrials.gov supplements these using the NLM Medical Text Indexer (MTI) to map text to high confidence MeSH/UMLS (F1 measure around 0.55)23. We mapped all annotated interventions to DrugCentral synonyms and excluded trials that were not mappable to at least one approved drug (Fig. 1a). Indication information was mapped to UMLS identifiers using the UMLS REST API16.
Final database compilation
As the final step in creating the repoDB database, we reconciled the approved and failed indication information. We removed all failed trial information for drug-indication pairs that were currently approved: for example, metformin is an FDA-approved drug for diabetes mellitus; there are, however, trials marked as terminated with metformin as a primary intervention (e.g., metformin combination therapies, see NCT00762957) and these trials were removed. After combining the approved and failed indications, we kept only those drug-indication pairs for which the indication fell within a UMLS semantic type related to disease ('Disease or Syndrome', 'Neoplastic Process', 'Pathologic Function', 'Finding', 'Mental or Behavioral Dysfunction', 'Sign or Symptom', 'Injury or Poisoning', 'Congenital Abnormality', 'Acquired Abnormality', and 'Cell or Molecular Dysfunction'). Semantic types describe broad categories of disease as well as other medicine-related concepts; it is therefore necessary to filter out non-disease terms, including those with semantic types such as, ‘Health Care Related Organization.’ See Supplementary Table 1 for the highest frequency terms by semantic type. The final database (see Fig. 2) was used to create an interactive R/Shiny application (http://apps.chiragjpgroup.org/repodb) whose contents are available for download (Table 2, repoDB [Final Database] Data Citation 1)24.
Code availability
R code used to (1) pre-process DrugCentral and AACT, (2) compile the final repoDB database, and (3) deploy the repoDB R shiny application is available from figshare (repoDB Production Code, Data Citation 1) and from GitHub (https://github.com/adam-sam-brown/repoDB).
Data Records
We downloaded the full DrugCentral database on November 16, 2016. We have provided a static snapshot of the tables containing DrugBank identifiers, synonyms for all drugs, and UMLS-mapped indication terms used to construct repoDB through figshare in raw form (DrugCentral [Full PostgreSQL Database], Data Citation 1). We downloaded the AACT database of clinical trials on September 2, 2016 (March 27, 2016 version). The database contains structured and free-text fields for 113,571 clinical trials (retrievable using R, AACT [Pipe Delimited], Data Citation 1). We have provided a static version through figshare in raw form. The final repoDB database, constructed using the R source code above, spans 1,571 drugs, and 2,051 diseases/indications, accounting for 6,677 approved and 4,123 failed drug-indication pairs. The database is available for download in both comma-separated value and R Data format (repoDB [Final Database], Data Citation 1).
Technical Validation
The drug-indication pairs provided herein are derived from automated annotations of FDA-approved drug labels (in DrugCentral) and investigator-submitted clinical trial records (in AACT). More information about the accuracy of the annotations can be found in the methods, as well as in publications describing the Medical Text Indexer and the Observational Medical Outcomes Partnership (F1 measures of 0.55 and 0.98, used in AACT and DrugCentral respectively)17–19,23. We note here that the methods upon which repoDB relies are not the only tools available for named entity recognition in the medical field. Other databases of drug information may therefore vary widely in terms of the granularity (e.g., ‘diabetes’ versus ‘maturity onset diabetes of the young, type I,’ among others) of the indication information contained therein.
Usage Notes
To ensure that all investigators have easy access to repoDB, we have developed a web application (http://apps.chiragjpgroup.org/repoDB/) using Shiny (an R Studio project, https://shiny.rstudio.com/). With the R/Shiny application, users can:
-
1
View summary characteristics of repoDB.
-
2
Search for information about specific drugs, including the indications that have been investigated for that drug, as well as the current status (Approve, Program Terminated, Not Approved, or Trial Halted) and detailed information on the reasons for trial failure (if available). Users can then filter and download results of their search by the current status of the selected drug.
-
3
Search for information about specific indications, including all drugs that have been investigated for that indication, as well as their current status. As with drug search, users can refine their search by status and download the final search results.
-
4
Get information on how to cite repoDB.
-
5
Download the full database.
By using the repoDB database, users agree to cite both our work, as well as both AACT and DrugBank for their role in data curation. This data is available under a Creative Commons Attribution 4.0 International License (see https://creativecommons.org/licenses/by/4.0/ for details).
Additional Information
How to cite this article: Brown, A. S. & Patel, C. J. A standard database for drug repositioning. Sci. Data 4:170029 doi: 10.1038/sdata.2017.29 (2017).
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
References
Rodriguez-Esteban, R. A Drug-Centric View of Drug Development: How Drugs Spread from Disease to Disease. PLoS Comput. Biol. 12, e1004852 (2016).
Li, J. et al. A survey of current trends in computational drug repositioning. Brief. Bioinform. 17, 2–12 (2015).
Shameer, K., Readhead, B. & Dudley, J. T. Computational and experimental advances in drug repositioning for accelerated therapeutic stratification. Curr. Top. Med. Chem. 15, 5–20 (2015).
Lamb, J. et al. The Connectivity Map: using gene-expression signatures to connect small molecules, genes, and disease. Science 313, 1929–1935 (2006).
Gottlieb, A., Stein, G. Y., Ruppin, E. & Sharan, R. PREDICT: a method for inferring novel drug indications with application to personalized medicine. Mol. Syst. Biol. 7, 496 (2011).
Huang, H. et al. DMAP: a connectivity map database to enable identification of novel drug repositioning candidates. BMC Bioinformatics 16 (Suppl 13): S4 (2015).
Brown, A. S., Kong, S. W., Kohane, I. S. & Patel, C. J. ksRepo: a generalized platform for computational drug repositioning. BMC Bioinformatics 17, 78 (2016).
Qu, X. A., Gudivada, R. C., Jegga, A. G., Neumann, E. K. & Aronow, B. J. Inferring novel disease indications for known drugs by semantically linking drug action and disease mechanism relationships. BMC Bioinformatics 10 (Suppl 5): S4 (2009).
Cheung, W. A., Ouellette, B. F. F. & Wasserman, W. W. Quantitative biomedical annotation using medical subject heading over-representation profiles (MeSHOPs). BMC Bioinformatics 13, 249 (2012).
Kissa, M., Tsatsaronis, G. & Schroeder, M. Prediction of drug gene associations via ontological profile similarity with application to drug repositioning. Methods 74, 71–82 (2015).
Patchala, J. & Jegga, A. G. Concept Modeling-based Drug Repositioning. AMIA Jt Summits Transl Sci Proc 2015, 222–226 (2015).
Ryan, P. B., Madigan, D., Stang, P. E., Schuemie, M. J. & Hripcsak, G. Medication-wide association studies. CPT Pharmacometrics Syst Pharmacol 2, e76 (2013).
Xu, H. et al. Validating drug repurposing signals using electronic health records: a case study of metformin associated with reduced cancer mortality. J. Am. Med. Inform. Assoc 22, 179–191 (2015).
Brown, A. S. & Patel, C. J. A review of validation strategies for computational drug repositioning. Brief. Bioinform. 10.1093/bib/bbw110 (2016).
Fawcett, T. An Introduction to ROC Analysis. Pattern Recognit. Lett 27, 861–874 (2006).
Bodenreider, O. The Unified Medical Language System (UMLS): integrating biomedical terminology. Nucleic Acids Res. 32, D267–D270 (2004).
Ursu, O. et al. DrugCentral: online drug compendium. Nucleic Acids Res. 45, D932–D939 (2016).
Tasneem, A. et al. The database for aggregate analysis of ClinicalTrials.gov (AACT) and subsequent regrouping by clinical specialty. PLoS ONE 7, e33677 (2012).
Overhage, J. M., Ryan, P. B., Reich, C. G., Hartzema, A. G. & Stang, P. E. Validation of a common data model for active safety surveillance research. J. Am. Med. Inform. Assoc 19, 54–60 (2012).
Wishart, D. S. et al. DrugBank: a comprehensive resource for in silico drug discovery and exploration. Nucleic Acids Res. 34, D668–D672 (2006).
Williams, R. J., Tse, T., DiPiazza, K. & Zarin, D. A. Terminated Trials in the ClinicalTrials.gov Results Database: Evaluation of Availability of Primary Outcome Data and Reasons for Termination. PLoS ONE 10, e0127242 (2015).
Development Core Team, R. R. A Language and Environment for Statistical Computing. (The R Foundation for Statistical Computing, 2011).
Mork, J. G., Jimeno-Yepes, A. & Aronson, A. R. The NLM medical text indexer system for indexing biomedical literature. In BioASQ@CLEF (2013).
Kent, A., Berry, M. M., Luehrs, F. U. & Perry, J. W. Machine literature searching VIII. Operational criteria for designing information retrieval systems. Amer. Doc 6, 93–101 (1955).
Data Citations
Brown, A. S. Figshare http://dx.doi.org/10.6084/m9.figshare.c.3462048 (2017)
Acknowledgements
A.S.B. was supported by an National Institutes of Health (NIH) Training grant from the National Human Genome Research Institute (NHGRI), T32HG002295-12. C.J.P. is supported by a National Institute of Environmental Health Sciences (NIEHS) R00 ES023504, R21 ES025052, an NIH Common Fund/NHGRI U54 HG007963-03, and a gift from Agilent Technologies. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Author information
Authors and Affiliations
Contributions
A.S.B. and C.J.P. conceived of the study. A.S.B. conducted all statistical analyses. A.S.B. and C.J.P. wrote the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing financial interests.
ISA-Tab metadata
Supplementary information
Rights and permissions
This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0 Metadata associated with this Data Descriptor is available at http://www.nature.com/sdata/ and is released under the CC0 waiver to maximize reuse.
About this article
Cite this article
Brown, A., Patel, C. A standard database for drug repositioning. Sci Data 4, 170029 (2017). https://doi.org/10.1038/sdata.2017.29
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/sdata.2017.29
This article is cited by
-
Random walk with restart on multilayer networks: from node prioritisation to supervised link prediction and beyond
BMC Bioinformatics (2024)
-
Identifying patterns to uncover the importance of biological pathways on known drug repurposing scenarios
BMC Genomics (2024)
-
DrugRep-HeSiaGraph: when heterogenous siamese neural network meets knowledge graphs for drug repurposing
BMC Bioinformatics (2023)
-
Multitask joint strategies of self-supervised representation learning on biomedical networks for drug discovery
Nature Machine Intelligence (2023)
-
GCMM: graph convolution network based on multimodal attention mechanism for drug repurposing
BMC Bioinformatics (2022)