PreprintCited by 9Pharmacovigilance and Adverse Drug ReactionsBiomedical Text Mining and OntologiesComputational Drug Discovery Methods

UniTox: Leveraging LLMs to Curate a Unified Dataset of Drug-Induced Toxicity from FDA Labels

Open access
Silberg, Jake, Swanson, Kyle, Simon, Elana, Zhang, Angela, Ghazizadeh, Zaniar, Ogden, Scott, Hamadeh, Hisham, Zou, James·2024·neural information processing systems

Abstract

Drug-induced toxicity is one of the leading reasons new drugs fail clinical trials. Machine learning models that predict drug toxicity from molecular structure could help researchers prioritize less toxic drug candidates. However, current toxicity datasets are typically small and limited to a single organ system (e.g., cardio, renal, or liver). Creating these datasets often involved time-intensive expert curation by parsing drug label documents that can exceed 100 pages per drug. Here, we introduce UniTox 1 , a unified dataset of 2,418 FDA-approved drugs with drug-induced toxicity summaries and ratings created by using GPT-4o to process FDA drug labels. UniTox spans eight types of toxicity: cardiotoxicity, liver toxicity, renal toxicity, pulmonary toxicity, hematological toxicity, dermatological toxicity, ototoxicity, and infertility. This is, to the best of our knowledge, the largest such systematic human in vivo database by number of drugs and toxicities, and the first covering nearly all FDA-approved medications for several of these toxicities. We recruited clinicians to validate a random sample of our GPT-4o annotated toxicities, and UniTox’s toxicity ratings concord with clinician labelers 87–96% of the time. Finally, we benchmark a graph neural network trained on UniTox to demonstrate the utility of this dataset for building molecular toxicity prediction models.

Integrity signals

Registry

Crossref · 10.1101/2024.06.21.24309315

Cites

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cited by

Sorted by citations

Authors
Silberg, J., Swanson, K., Simon, E., Zhang, A., Ghazizadeh, Z., Ogden, S., Hamadeh, H., & Zou, J.
Affiliations
  • Stanford University (US)
  • Genmab (United States) (US)
Corresponding author
Silberg, Jake
Venue
neural information processing systems
Publisher
openRxiv
Published
2024-06-22
Pages
12078-12093
ISSN
1049-5258 (ISSN-L)
OpenAlex
W4415798795
Cited by
9
References
0
Citations by year
2026: 2 · 2025: 7
FWCI
18.10
Type
conference paper
Language
en
Open access
Licence
cc-by-nd
Locations
  • neural information processing systems (publishedVersion)
  • medRxiv (acceptedVersion, cc-by-nd)
Topics
  • Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Toxicology › Pharmacovigilance and Adverse Drug Reactions
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Biomedical Text Mining and Ontologies
  • Physical Sciences › Computer Science › Computational Theory and Mathematics › Computational Drug Discovery Methods
Keywords
drug toxicity, FDA drug labels, large language models, adverse drug reactions, drug safety

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review