Cited by 17Pharmacovigilance and Adverse Drug ReactionsBiomedical Text Mining and OntologiesComputational Drug Discovery Methods

OnSIDES database: Extracting adverse drug events from drug labels using natural language processing models

Open access
Tanaka, Yutaro, Chen, Hsin Yi, Belloni, Pietro, Gisladottir, Undina, Kefeli, Jenna, Patterson, Jason, Srinivasan, Apoorva, Zietz, Michael +4 more·2025·Med

Abstract

OnSIDES database: Extracting adverse drug events from drug labels using natural language processing models

Integrity signals

Registry

Crossref · 10.1016/j.medj.2025.100642

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

24 of 56 cited sources checked · 8 supported · 0 flagged · accuracy not yet measured

  • Premisereasoning

    No currently up-to-date, computable databases exist for on-label ADEs.

    “However, as SIDER was most recently updated in 2015, no currently up-to-date, computable databases exist for on-label ADEs.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [13] source

      The Introduction (Table 1; page not provided) lists SIDER 4’s release year as 2015, and the paper describes SIDER as a machine-readable ADR database. It does not establish that 2015 was SIDER’s last update or that no up-to-date, computable database for on-label ADEs currently exists. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
  • Premisecitation

    SIDER was most recently updated in 2015.

    “However, as SIDER was most recently updated in 2015, no currently up-to-date, computable databases exist for on-label ADEs.”
    Quote in the paperSubstantial claim1 of 1 sources checked
  • Interpretationcitation

    This analysis recapitulates general trends in enriched occurrence of specific classes of ADEs suggested by prior relevant research efforts.

    “This analysis recapitulates general trends in the enriched occurrence of specific classes of ADEs suggested by prior relevant research efforts11,27.”
    Quote in the paperNot a substantial claim2 of 2 sources checked
    • cites [11] source
    • cites [27] source

      The Methods and Results describe a reference set of selected drug–event pairs, including positive associations, rather than measuring how often classes of adverse drug events occur. The Discussion considers frequent and rare events but does not report enrichment of any specific event class. I searched for event-class frequency and enrichment in the indexed copy. (LLM, conf=0.75)

      Experimental — accuracy not yet measured
  • Premisecitation

    Previous studies suggest significant international differences in ADEs listed on drug labels depending on the ADE and therapeutic area, due to differences in drug safety regulation and drug approvals.

    “Previous studies have suggested that there is a significant inter-national difference in ADE listed on drug labels depending on the ADE in question and therapeutic area given the differences in drug safety regulation and drug approvals46.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [46] source

      The Introduction (p. 1) and Conclusion (p. 9) discuss SHAP and interpreting model predictions, not adverse drug events on labels. Searches for international ADE-label differences and for drug safety regulation or approvals found no passage addressing the claim. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
  • Premisecitation

    In FDA SPL labels, ADE information is mainly found in the Adverse Reactions, Boxed Warnings, and Warnings and Precautions sections.

    “In these labels, the ADE related information is primarily described in the “Adverse Reactions” (AR), “Boxed Warnings” (BW), and “Warnings and Precautions” (WP) sections.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [36] source

      The MEDICUS EXTENSION section (page not provided) mentions FDA drug labels linked to DailyMed, but does not describe where adverse drug event information appears within those labels. Searches for the three named label sections and for adverse drug events in FDA structured product labels found no supporting passage in our copy. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
  • May combine two claims. 43
  • Classified as probably not a substantial claim. 28
  • The quote only partly states this claim. 1
  • May combine two claims.

    Premisecitation

    SIDER is one of the most widely utilized ADE databases derived from drug label data, constructed using dictionary-based named entity recognition to extract adverse event terms from FDA Structured Product Labeling drug labels.

    “One of the most widely utilized ADE databases derived from drug label data is SIDER, constructed using a dictionary-based named entity recognition (NER) method to extract adverse event terms from FDA Structured Product Labeling (SPLs) drug labels13.”
    Quote in the paperSubstantial claim1 of 1 sources checked
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A number of publicly available ADE databases exist, constructed from sources including drug labels, electronic health records, research literature, social media, and pharmacovigilance programs.

    “A number of publicly available ADE databases exist, which have been constructed by extracting, stratifying or detecting signals from a variety of sources, including drug labels, electronic health records, research literature, social media, and adverse event reporting pharmacovigilance programs7–11.”
    Quote in the paperNot a substantial claim3 of 5 sources checked
    • cites [7] source

      The Materials and Methods ‘Data source’ section describes SIDER as mined from drug labels and identifies FDA and Canadian adverse-event reporting databases. The paper also makes its own ADE databases publicly available, but it does not describe databases constructed from research literature or social media; it uses electronic medical records to validate findings, not as a source for those databases. Page numbers are unavailable in our copy. (LLM, conf=0.87)

      Experimental — accuracy not yet measured
    • cites [8] source

      The Background and Summary identifies electronic health records, spontaneous reporting systems, social media, and literature mining as sources of drug-safety evidence. The Usage Notes describe a harmonized evidence base combining product labels, published literature, observational data, and spontaneous reports; the Methods and Data Records describe a publicly available FAERS-derived dataset. The paper does not establish that publicly available ADE databases have been constructed from each listed source, particularly social media. (LLM, conf=0.82)

      Experimental — accuracy not yet measured
    • cites [9] source
    • cites [10] source
    • cites [11]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Efforts have fine-tuned BERT models to classify drug label text blocks into predefined sections and outperformed baseline models.

    “For example, a number of efforts have fine-tuned BERT models to classify drug label text blocks into predefined sections of the label and outperformed baseline models for this task22–23.”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites [22] source

      Section 2.3.5 (p. 9) describes classifying PubMed abstracts by cancer hallmark, and Section 2.4 (p. 12) describes BERT-based document classification. Neither the supplied passages nor searches for drug-label text blocks and label-section classification found a passage addressing that task or its performance against baselines. (LLM, conf=0.75)

      Experimental — accuracy not yet measured
    • cites [23]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationcitation

    These research efforts present promising results in extracting true ADE mentions, indicating suitability of NLP methods for this task.

    “These research efforts present promising results in extracting true ADE mentions from drug label text, indicating the suitability of using NLP methods for this task.”
    Quote in the paperSubstantial claim2 of 4 sources checked
    • cites [20] source
    • cites [21] source
    • cites [22] source

      The Named Entity Recognition section (p. 7) describes NLP models for detecting drug and disease entities, and the results table (p. 17) reports performance on biomedical extraction tasks. These support the broader suitability of NLP for such tasks, but the cited paper does not report extracting true adverse drug event mentions from drug label text; its described datasets use PubMed abstracts. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
    • cites [23]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The TAC 2017 task was conducted to encourage development of computational methods to recognize ADE mentions from drug labels and their relationships.

    “Of note, the “Adverse Drug Reaction Extraction from Drug Labels” task of the Text Analysis Conference (TAC) 2017 was conducted to encourage the development of computational methods to recognize mentions of ADEs from drug labels and their relationships.”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites [18]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [19] source

      The Background & Summary identifies the TAC 2017 task as an evaluation of adverse-reaction extraction from drug labels, and Technical Validation describes its mention-level annotations and training and test sets. Our copy does not say that the task aimed to recognize relationships between ADE mentions, so that part of the claim is unsupported. (LLM, conf=0.83)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Numerous biomedical models such as BioBERT, MedBERT, and BiomedBERT have been developed by training on relevant text corpora.

    “In biomedical informatics, numerous models utilizing this approach, such as BioBERT, MedBERT, and BiomedBERT, have been developed by training models on various relevant text corpora, such as EHR data and biomedical academic literature15–17.”
    Quote in the paperNot a substantial claim1 of 3 sources checked
    • cites [15]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [16]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [17] source

      The Introduction identifies Med-BERT as a pretrained model trained on structured EHR diagnosis data. It explicitly says those data are ICD codes, unlike the free text used to train most BERT variants, so describing Med-BERT as trained on a text corpus is inaccurate. (LLM, conf=0.90)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A number of NLP methods have been proposed to extract ADE terms from drug label text utilizing the TAC 2017 dataset.

    “A number of NLP methods have been proposed to extract ADE terms from drug label text utilizing this dataset20–21.”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites [20] source
    • cites [21] source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The TAC 2017 organizers published a manually annotated gold-standard reference dataset for extracting ADEs from 200 FDA SPLs.

    “As part of this task, the organizers published a manually annotated, gold-standard reference dataset for extracting adverse drug events from 200 FDA SPLs18–19.”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites [18]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [19] source
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    EU, UK, and Japan represent some of the largest pharmaceutical markets outside the US and have different drug regulatory processes independent of the US.

    “These nations/regions represent some of the largest pharmaceutical markets in the world outside of the US, and have different drug regulatory processes independent to that of the US25–26.”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites [25]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [26] source

      The Summary (page unavailable) describes the US and EU as major locations for drug investigation and approval and says their regulatory systems differ. The European Regulation of Drugs section describes EU approval routes distinct from the FDA’s. The paper does not establish the claimed market standing of the UK or Japan or describe Japan’s regulatory process; it discusses the UK within the EU framework rather than as a separate regulatory system. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Significant advances in chemoinformatics and AI to drug discovery and repurposing have increased research into in-silico driven development of new medications.

    “Significant advances in chemoinformatics and the application of artificial intelligence to drug compound discovery and the repurposing of existing drugs have greatly increased research into in-silico driven development of new, effective medications for a variety of indications30.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [30] source

      The Introduction (page unavailable) describes growing drug-discovery data resources, predictive models that may aid drug repurposing, and a need for computer-aided drug discovery. The model-development sections (page unavailable) also discuss cheminformatics and in-silico approaches, but the paper does not establish that advances in AI and repurposing have greatly increased research into new, effective medications. (LLM, conf=0.79)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    DrugBank mainly contains drug indications extracted from drug labels, while MEDI uses public internet sources for drug indications.

    “DrugBank primarily contains drug indications extracted from drug labels, while MEDI utilizes public internet sources to drug indications, and is a well utilized resource of drug indications.”
    Quote in the paperNot a substantial claim2 of 2 sources checked
    • cites [48] source

      In “New and enhanced interface features” (page unavailable), the paper says DrugBank’s new linked indications were manually curated from drug labels, but specifies that these were available only for currently marketed products. It does not address MEDI, its use of public internet sources, or how widely MEDI is used. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
    • cites [49] source

      The Methods > Data sources section (page unavailable) says MEDI draws indications from four public resources, including the MedlinePlus website and Wikipedia. The paper does not identify DrugBank as a source or say that DrugBank's indications primarily come from drug labels; its discussion of label-derived indications concerns SIDER instead. It also does not establish that MEDI is well utilized. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    ChemBERTa performed better than Chemprop on several other MoleculeNet benchmark tasks.

    “However, ChemBERTa was found to perform better than Chemprop on a number of other MoleculeNet benchmark tasks51”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [51] source

      The Results and discussion section and Table 3 in the Conclusions compare other models on MoleculeNet tasks, but neither reports a ChemBERTa–Chemprop comparison. Searches for both model names and their comparative performance found no passage addressing the claimed result. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The SPL format includes a broad range of information such as indications, clinical pharmacology, contraindications, warnings, and ADEs.

    “The SPL format incorporates a broad range of information including the drug’s indications, clinical pharmacology, contraindications, warnings, and ADEs36.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [36] source

      The MEDICUS EXTENSION section mentions FDA drug labels linked to DailyMed, but does not describe the SPL format or what information it contains. Searches for SPL and the listed label contents found no passage addressing the claim. (LLM, conf=0.77)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Findingown data

    OnSIDES contains 3,610,120 ADEs and 114,322 Boxed Warning ADEs from 47,211 drug labels, covering 3,233 unique drug ingredient combinations and 4,510 unique ADEs.

    “OnSIDES contains over 3.6 million drug-ADE pairs for 3,233 unique drug ingredient combinations extracted from 47,211 labels.”
    • Also stated in: § Generating the OnSIDES Database · plain
      “As of the February 2024 release, the OnSIDES database contains 3,610,120 ADEs and 114,322 Boxed Warning ADEs from 47,211 drug labels, listing 3,233 unique drug ingredient combinations (1,873 single-ingredient drugs, 1,360 multi-ingredient drugs) and 4,510 unique ADEs.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The model achieved F1 0.90, AUROC 0.92, and AUPR 0.95 at extracting ADEs from the Adverse Reactions section.

    “We achieve an F1 score of 0.90, AUROC of 0.92, and AUPR of 0.95 at extracting ADEs from the labels’ “Adverse Reactions” section.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingnone given

    The method was used to extract pediatric-specific ADEs, serious ADEs from Boxed Warnings, and ADEs from UK, EU, and Japan labels to build OnSIDES-INTL.

    “We further utilize this method to extract pediatric-specific ADEs, serious ADEs from labels’ “Boxed Warnings” section, and ADEs from drug labels of other major nations—the UK, EU, and Japan—to build a complementary OnSIDES-INTL database.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    SIDER contains 1,430 unique drugs and 4,251 unique side effects.

    “SIDER contains 1,430 unique drugs and 4,251 unique side effects.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    An OnSIDES-trained linear regression model performs moderately in predicting whether a given drug has a specific drug target based on its side-effect profile (AUROC = 0.667) and outperforms a SIDER-trained model (AUROC = 0.590).

    “Additionally, we find that an OnSIDES-trained linear regression model performs moderately in predicting whether a given drug has a specific drug target based on its side-effect profile (AUROC = 0.667) and outperforms a SIDER-trained model (AUROC = 0.590) (Figure 4B).”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Drug target and indication data from DrugBank, OpenTargets, and MEDI are accurate.
  • May combine two claims.

    Findingown data

    There was notable overlap in sensory organ drugs between US and UK, and antineoplastic and immunomodulating agent drugs among all data sources.

    “However, there was some notable overlap in sensory organ drugs between the US and UK, and also antineoplastic and immunomodulating agent drugs among all data sources.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    OnSIDES-INTL contains 108,958, 705,917, and 237,827 unique drug-ADE pairs from 1,048, 9,003, and 6,541 drug labels, with 929, 1,889, and 1,441 unique drug ingredient combinations and 3,570, 4,848, and 3,296 unique ADEs from European, British, and Japanese labels respectively.

    “By doing so, we construct additional databases with 108,958, 705,917, and 237,827 unique drug-ADE pairs from 1,048, 9,003, and 6,541 drug labels, with 929, 1,889, and 1,441 unique drug ingredient combinations and 3,570, 4,848, and 3,296 unique ADEs from European, British, and Japanese drug labels respectively.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    OnSIDES contains 1,485 unique single-ingredient drugs and 4,345 unique side effects.

    “OnSIDES contains 1,485 unique single-ingredient drugs and 4,345 unique side effects”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    OnSIDES performs best in predicting existing therapeutic indications identified in both DrugBank and MEDI (AUROC = 0.77) and better than SIDER (AUROC = 0.715).

    “We further find that OnSIDES performs best in terms of predicting the existing therapeutic indications that are identified in both DrugBank and MEDI (AUROC = 0.77) and better than SIDER in these predictions also (AUROC = 0.715), suggesting these models perform well in predicting indications of high confidence (Figure 4D).”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Drug target and indication data from DrugBank, OpenTargets, and MEDI are accurate.
  • May combine two claims.

    Findingown data

    SOCs identified across the fewest drug labels were product issues, pregnancy and related conditions, and congenital, familial, and genetic disorders while general disorders and administration site conditions, gastrointestinal, skin and subcutaneous tissue, nervous system disorders, and vascular disorders were identified on the largest number of drug labels.

    “Overall, the SOCs identified across the fewest number of drug labels were “product issues”, “pregnancy and related conditions”, and “congenital, familial, and genetic disorders” while “general disorders and administration site conditions”, “gastrointestinal”, “skin and subcutaneous tissue”, “nervous system disorders”, and “vascular disorders” were identified on the largest number of drug labels.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The annotated dataset has many ADEs in vascular disorders, investigations, and skin and subcutaneous tissue disorders, and few in endocrine disorders, social circumstances, and congenital, familial, and genetic disorders.

    “we find a significant proportion of annotated ADEs that fall into the “vascular disorders”, “investigations”, and “skin and subcutaneous tissue disorders” categories, and relatively few “endocrine disorders”, “social circumstances”, and “congenital, familial, and genetic disorders” (Supplementary Figure 1B).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The antineoplastics and immunomodulators drug class had the largest number of ADEs while antiparasitics and insecticides consistently had the fewest across all data sources.

    “We also find that the “antineoplastics and immunomodulators” drug class had the largest number of ADEs while the “antiparasitics and insecticides” class drugs consistently have the fewest identified across all data sources.”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingreasoning

    The method was extended to extract ADE data from EU, UK, and Japanese drug labels to create additional computable resources.

    “we leverage the method to expand the database to incorporate ADE data found in drug labels of other nations/regions.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingnone given

    FDA SPL labels mainly present ADEs as free text, while labels from other regulatory agencies present the ADE section as structured lists, tables, or a mix.

    “While the FDA SPL drug labels primarily list the ADEs in a free text format, drug labels from other regulatory agencies format the ADE section in structured lists, tables, or a combination of the three formats.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    The extraction method makes errors: some side effects are missed and some predicted adverse events are wrong.

    “computational extraction methods are prone to errors, with some side effects not extracted accurately, and some predicted adverse events being incorrect.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    General ADE descriptions were standardized across drug labels and label types, but pediatric ADE descriptions were often nested in general ADE sections or absent due to lack of information.

    “While general ADE descriptions were found to be standardized across drug labels / label types, pediatric ADE descriptions were often found nested in the general ADE sections, or did not exist anywhere in the label text due to the lack of information.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Optimal input string length is 125 words, with 87.5% of the words coming after the candidate term.

    “We first determine the optimal input text string format, concluding that optimal input string length is 125 words, with 87.5% of the words coming after the candidate term (Figure 1A).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Drugs tend to have the highest degree in US data, followed by UK, while Japanese data tends to assign the lowest degree.

    “Drugs tend to have the highest degree (number of ADEs) in the US data, followed by the UK data, while the Japanese data tends to assign the lowest degree.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    With the optimal parameter combination, PubMedBERT achieved an F1 score of 0.874 and an AUROC of 0.899.

    “we achieve F1 Scores of 0.861 and 0.874, and AUROC Scores of 0.896 and 0.899, respectively for the ClinicalBERT and PubMedBERT models.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    In comparison between OnSIDES and OnSIDES-PED, there was enrichment of a large number of Skin and Subcutaneous Tissue and Gastrointestinal ADEs, and very few Social Circumstances and Pregnancy, Puerperium and Perinatal Conditions ADEs enriched.

    “In the comparison between OnSIDES and OnSIDES-PED, we observed an enrichment of a large number of “Skin and Subcutaneous Tissue” and “Gastrointestinal” ADEs, and very few “Social Circumstances” and “Pregnancy, Puerperium and Perinatal Conditions” ADEs enriched.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    OnSIDES-PED contains 359,213 drug label-ADE pairs from 1,161 unique drug ingredient combinations, 1,526 unique ADEs, and 20,014 drug labels derived from special populations section.

    “We use this adapted method to construct a large pediatric-specific ADE database of 359,213 drug label-ADE pairs from 1,161 unique drug ingredient combinations, 1,526 unique ADEs, and 20,014 drug labels derived from the drug labels’ special populations section.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The fine-tuned PubMedBERT model outperforms all TAC 2017 models and the SIDER database.

    “We find that our model outperforms all TAC 2017 models and the SIDER database as presented in (Supplementary Figure 3B).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Between OnSIDES-PED and KidSIDES, there was enrichment of ADEs in Nervous System and General and Administration Site Conditions MedDRA SOC classes, and a relative lack of ADEs reported in Ear and Labyrinth and Social Circumstances classes in KidSIDES.

    “Between OnSIDES-PED and KidSIDES, we observed an enrichment of ADEs in the “Nervous System” and “General and Administration Site Conditions” MedDRA SOC classes, and a relative lack of ADEs reported in the “Ear and Labyrinth” and “Social Circumstances” classes in KidSIDES.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The OnSIDES-trained model was able to predict drug indications from each database, and outperforms a SIDER-trained model.

    “We find that the OnSIDES-trained model was able to predict drug indications from each database, and outperforms a SIDER-trained model (Figure 4C).”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Drug target and indication data from DrugBank, OpenTargets, and MEDI are accurate.
  • May combine two claims.

    Findingown data

    The PubMedBERT-based model gives a modest performance improvement over the ClinicalBERT-based model and performs more consistently across the two evaluations.

    “The PubMedBERT-based model achieves a modest performance improvement over the ClinicalBERT-based model, and notably it performs more consistently across the two different evaluations.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The annotated dataset overrepresents antineoplastic and immunomodulating agents and underrepresents dermatologicals, systemic hormonal preparations, and antiparasitic products.

    “we find that there is a significant representation of drugs that are “antineoplastic and immunomodulating agents”, and very few “dermatologicals”, “systemic hormonal preparations”, and “antiparasitic products” (Supplementary Figure 1A).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    With the optimal parameter combination, ClinicalBERT achieved an F1 score of 0.861 and an AUROC of 0.896.

    “we achieve F1 Scores of 0.861 and 0.874, and AUROC Scores of 0.896 and 0.899, respectively for the ClinicalBERT and PubMedBERT models.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    US drug labels tend to have more listed ADEs than other nations, although considerable variation exists between drugs.

    “These results show that US drug labels tend to have more listed ADEs than that of other nations, although considerable variation exists between drugs.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    MEDI has 1,257 drugs with indications for OnSIDES and 1,155 for SIDER.

    “There are 1,474 and 1,347 drugs with indications listed in DrugBank, and 1,257 and 1,155 drugs with indications listed in MEDI for OnSIDES and SIDER respectively.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    DrugBank has 1,474 drugs with indications for OnSIDES and 1,347 for SIDER.

    “There are 1,474 and 1,347 drugs with indications listed in DrugBank, and 1,257 and 1,155 drugs with indications listed in MEDI for OnSIDES and SIDER respectively.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Findingnone given

    Pediatric mentions in the general AR section are difficult to systematically separate from non-pediatric-specific mentions.

    “as the pediatric mentions in this section are difficult to systematically separate from those that are non-pediatric specific.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Significant advancements in NLP methods, including BERT models, have been made.

    “In recent years, significant advancements have been made in Natural Language Processing (NLP) methods, including the development of BERT (Bidirectional Encoder Representations from Transformers) models14.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [14] source
  • May combine two claims.

    Premisecitation

    Few machine-readable databases of adverse drug events exist, which limits broad systematic study of drug safety.

    “However, few machine-readable databases of ADEs exist, limiting our capacity to study drug safety on a broader, systematic scale.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [5]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [6] source
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    OnSIDES can be utilised as a comprehensive resource to study and enhance drug safety.

    “OnSIDES can be utilised as a comprehensive resource to study and enhance drug safety.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisenone given

    Drug label repositories are collections of raw text or PDF files and are difficult for secondary research because they are not standardized or optimized for machine readability.

    “However, these repositories are a collection of individual raw text or PDF files, and are difficult to utilize for secondary research purposes as they are not standardized or optimized for machine readability.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    To comprehensively study ADEs, high-quality machine-readable databases encompassing the breadth of drugs currently used are required.

    “As such, to comprehensively study ADEs, we require high-quality, machine-readable databases encompassing the breadth of drugs currently used.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    More context helps performance, but an overly long input string may dilute relevant context with unrelated information.

    “This suggests that more context aids performance, but too long of an input string may dilute the relevant context with unrelated information.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Some known ADEs may not appear on drug labels and may be found in other sources like adverse event reporting systems.

    “there may be known ADEs that are not yet reflected on drug labels that may appear in other sources, such as adverse event reporting systems.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Knowledge of ADEs in pediatric patients is limited, with few RCTs conducted on these populations due to restricted population and ethical concerns.

    “For example, while the risk of serious ADEs is greater for pediatric patients, our knowledge is limited for this population, with few RCTs being conducted on these populations given the restricted population and ethical concerns24.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [24]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationnone given

    To the best of the authors' knowledge, OnSIDES is the largest and only current up-to-date drug label-derived ADE database.

    “To the best of our knowledge, OnSIDES is the largest and only, current, up-to-date, drug label-derived ADE database.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    PubMedBERT and ClinicalBERT were selected because they are trained on biomedical language similar to drug label text and have performed well on relevant NLP tasks.

    “We chose to consider and evaluate these models as they are trained on biomedical language similar to drug label text, and have been demonstrated to perform well on relevant NLP tasks37.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [37]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Study design and conductown data

    The manually annotated dataset was used to evaluate the model's accuracy in the generated datasets.

    “We use this manually annotated dataset to evaluate the accuracy of our model in the generated datasets.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Campillios et al. previously suggested the similarity of two drugs' side effect profiles is positively correlated with the probability that these drugs share a common target.

    “The work of Campillios et al. previously suggested the similarity of two drugs’ side effect profiles is positively correlated with the probability that these drugs share a common target28.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [28] source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Yang and Agarwal showed side-effect profile similarities can also predict shared indications.

    “In a similar manner, Yang and Agarwal showed side-effect profile similarities can also predict shared indications29.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [29]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationown data

    The limited description and subsequent extraction of pediatric-specific ADEs in drug label text is highlighted by KidSIDES having more drugs in each category.

    “Again, KidSIDES had more drugs in each category, highlighting the limited description and subsequent extraction of pediatric-specific ADEs in drug label text.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    OnSIDES could be used as a potential resource for drug repurposing applications, identifying existing drugs that may be used for novel therapeutic indications, and to identify potential drug off-targets.

    “This suggests that OnSIDES could be used as a potential resource for drug repurposing applications, identifying existing drugs that may be used for novel therapeutic indications, and to identify potential drug off-targets.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Premisereasoning

    Further challenges lie in applying these methods to systematically construct a comprehensive and readily accessible database to aid further pan-medication study of ADEs.

    “However, further challenges lie in applying these methods to systematically construct a comprehensive and readily accessible database to aid further pan-medication study of ADEs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The accuracy of machine translation for Japanese labels is a limitation of OnSIDES-INTL.

    “Another limitation is the machine translation accuracy of the Japanese labels.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Chemprop performed better than ChemBERTa for ClinTox classification.

    “Ahmad et al.32 found that Chemprop performed better than ChemBERTa for ClinTox classification, a drug-toxicity classification task.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Ahmad et al.32

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The EMA, MHRA, and PMDA are the regulatory bodies overseeing pharmaceutical product approval in the EU, UK, and Japan, respectively.

    “In each country/region, the EMA (European Medicines Agency), MHRA (Medicines and Healthcare products Regulatory Agency), and PMDA (Pharmaceuticals and Medical Devices Agency) are the respective regulatory bodies overseeing pharmaceutical product approval38–40.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [38]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [39]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [40]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    All entities submitting drug approval applications to the FDA must submit documentation in SPL format.

    “All entities that submit drug approval applications to the FDA are required to submit documentation in this format35.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [35]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    Enrichment in the number of adverse events per adverse event type for each drug class was evaluated using Fisher's exact test with a Bonferroni adjustment.

    “we evaluated enrichment in the number of adverse events per adverse event type for each drug class using Fisher’s exact test, as listed in the axis labels in Figure 3C. We used a Bonferroni adjustment to p-values from these tests due to testing all drug classes in parallel.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    ChemBERTa is a transformer-based RoBERTa model that takes SMILES strings as input and can be fine-tuned to predict chemical and physical targets.

    “ChemBERTa is a transformer-based model of RoBERTa architecture52 that takes SMILES strings as input and can be fine-tuned to predict various chemical and physical targets”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [52]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The SPL drug label format is an XML-based HL7 clinical and administrative standard document markup format used by the FDA.

    “The SPL drug label format is a XML-based HL7 clinical and administrative standard document markup format utilized by the FDA to uniformly present relevant pharmaceutical information text34.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [34]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The SHAP method is a game theory-based approach that explains model predictions by assigning importance values to individual features.

    “The SHAP method is a game theory-based approach that explains model predictions by assigning individual features an importance value for a specific prediction, allowing for a better understanding of how individual features impact model decisions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [45]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

68 of 68
  • The paper relies on this without support.

    Fewer broad-scale studies of ADEs exist compared to studies of individual medications.

    “While many drug safety studies are conducted on individual medications during clinical trials and through postmarketing surveillance programs, far fewer studies have studied the occurrence of ADEs more broadly.”
  • The paper relies on this without support.

    The MedDRA vocabulary terms used as a reference dictionary cover all potential ADE terms in drug labels.

    “we first extract potential ADE terms from the drug label using MedDRA vocabulary terms as a reference dictionary”
  • The paper relies on this without support.

    GPT-4 machine translation of Japanese free text into English preserves ADE term meaning sufficiently for extraction.

    “The free text sections are machine translated using GPT-4 into English, and then we use the fine-tuned model to predict ADE terms.”
  • The paper relies on this without support.

    Exact string matching against MedDRA-J for Japanese tabular sections correctly identifies ADE mentions.

    “we use MedDRA-J, the Japanese MedDRA vocabulary dictionary, to perform exact string matching for the tabular sections.”
  • The paper relies on this without support.

    The manually annotated 200 drug labels for pediatric and international tasks are representative of all labels.

    “we manually annotate 200 randomly sampled drug labels to evaluate the fine-tuned PubMedBERT model’s performance.”
  • The paper relies on this without support.

    The 10 severe ADEs selected for ChemBERT are representative of severe ADEs.

    “We predict whether these drugs are known to cause any of the 10 severe ADEs selected, which were mapped to MedDRA HLTs (High-Level Terms).”
  • The paper relies on this without support.

    Drug target and indication data from DrugBank, OpenTargets, and MEDI are accurate.

    “Drug target and indication data for these drugs are mapped from the DrugBank, OpenTargets, and MEDI databases”
  • The paper relies on this without support.

    Drug labels are the gold standard source of ADE information.

    “Drug labels continue to be the gold standard for ADE information.”
  • The paper relies on this without support.

    No actively maintained comprehensive ADE databases exist.

    “However, no actively maintained comprehensive ADE databases exist, making it difficult to leverage computational tools to study ADEs broadly.”
9 of 9

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Target-prediction model is called both logistic and linear regression

    Minor

    The methods describe logistic regression for predicting shared drug targets, whereas the results call the OnSIDES target-prediction model linear regression. These name different regression methods.

  • FDA label counts differ for the February 2024 release

    Minor

    The results say the February 2024 database draws from 47,211 drug labels, but the methods say 46,686 FDA labels were downloaded as of the same month. The text does not explain the additional 525 labels.

2 of 2

Cites

Flagged first, then by citations

5 of the 45 references couldn’t be matched to a known paper.

Research works printed but not linked: 5

  1. 2018, PLoS One, 13
  2. 2012, PLoS One, 7
  3. 2019, PLoS Comput. Biol., 15
  4. 2019, Bioinformatics, 36, 1234
  5. 2011, PLoS One, 6

Cited by

Sorted by citations

Authors
Tanaka, Y., Chen, H. Y., Belloni, P., Gisladottir, U., Kefeli, J., Patterson, J., Srinivasan, A., Zietz, M., Sirdeshmukh, G., Berkowitz, J., LaRow Brown, K., & Tatonetti, N. P.
Affiliations
  • Columbia University Irving Medical Center (US)
  • University of Padua (IT)
  • Cedars-Sinai Medical Center (US)
Corresponding author
Tatonetti, Nicholas P.
Venue
Med
Publisher
Elsevier BV
Published
2025-07
Volume
6
Issue
7
Pages
100642
ISSN
2666-6340 (ISSN-L)
OpenAlex
W4409150806
Cited by
17
References
45
Citations by year
2026: 6 · 2025: 11
FWCI
8.63
Type
journal article
Language
en
Open access
Locations
  • Med (acceptedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
  • Padua Research Archive (University of Padova) (submittedVersion)
Funders
  • National Library of Medicine (T15LM007079)
  • National Institutes of Health
  • NIH National Institute of General Medical Sciences (R35GM131905, T32GM145440)
Topics
  • Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Toxicology › Pharmacovigilance and Adverse Drug Reactions
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Biomedical Text Mining and Ontologies
  • Physical Sciences › Computer Science › Computational Theory and Mathematics › Computational Drug Discovery Methods
Keywords
adverse drug reactions, drug labels, drug safety, natural language processing, BERT, PubMedBERT, black box warning, drug target prediction
MeSH terms
Drug Labeling, Humans, Natural Language Processing, United States, United States Food and Drug Administration, Databases, Factual, Drug-Related Side Effects and Adverse Reactions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-09-28.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-28.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review