Cited by 161Drug-Induced Hepatotoxicity and ProtectionPharmacovigilance and Adverse Drug ReactionsDrug-Induced Adverse Reactions

The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index; 2 of the 12 sources its claims cite were checked for support.

A revised electronic version of RUCAM for the diagnosis of DILI

Open access
Hayashi, Paul H., Lucena, M. Isabel, Fontana, Robert J., Bjornsson, Einar S., Aithal, Guruprasad P., Barnhart, Huiman, Gonzalez‐Jimenez, Andres, Yang, Qinghong, Gu, Jiezhun, Andrade, Raul J., Hoofnagle, Jay H.·2022·Hepatology

Abstract

Background and Aims: Roussel Uclaf Causality Assessment Method (RUCAM) for DILI has been hindered by subjectivity and poor reliability. We sought to improve the RUCAM using data from the Drug‐Induced Liver Injury Network (DILIN) and the Spanish DILI Registry, published literature, and iterative computer modeling. Approach and Results: RUCAM criteria were updated, clarified, and computerized. We removed criteria 3 (risk factors) for lack of added value and criteria 4 because we felt it more useful to assess each drug separately. Criteria 6 (drug‐specific risk) was anchored to LiverTox likelihood scores. Iterative testing in subsets of 50–100 single‐agent, nonherbal cases from both registries was done to optimize performance. We used classification tree analysis to establish diagnostic cutoffs for this revised electronic causality assessment method (RECAM) and compared RECAM with RUCAM for correlation with expert opinion diagnostic categories in 194 DILI cases (98 DILIN, 96 Spanish DILI). Area under receiver operator curves for identifying at least probable DILI were the same at 0.89 for RECAM and RUCAM. However, RECAM diagnostic categories have better observed overall agreement with expert opinion (0.62 vs. 0.56 weighted kappa, p = 0.14), and had better sensitivity to detect extreme diagnostic categories (73 vs. 54 for highly likely or high probable, p = 0.02; 65 vs. 48 for unlikely/excluded, p = 0.08) than RUCAM diagnostic categories. Conclusions: RECAM is an evidence‐based update that is at least as capable as RUCAM in diagnosing DILI compared with expert opinion but is better than RUCAM at the diagnostic extremes. RECAM’s increased objectivity and clarity will improve precision, reliability, and standardization of DILI diagnosis, but further refinement and validation in other cohorts are needed.

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

RECAM is a revised, computerized version of RUCAM for diagnosing drug-induced liver injury (DILI), developed with data from the US DILIN and Spanish DILI Registry. In 194 DILI cases, RECAM and RUCAM had the same AUC of 0.89 for identifying at least probable DILI, but RECAM showed better agreement with expert opinion and better sensitivity at diagnostic extremes.

Key findings

  • RECAM reduced the original 7 RUCAM criteria to 5 domains, removed risk factors and concomitant-drug criteria, anchored drug-specific risk to LiverTox® likelihood scores, and added automatic warnings/stops for alternate diagnoses or inconsistent timing.
  • For identifying at least probable DILI, RECAM and RUCAM had the same AUC of 0.89; overall percent agreement with expert opinion was 62% for RECAM vs. 59% for RUCAM (p=0.44).
  • Weighted kappa agreement with expert opinion was 0.62 for RECAM vs. 0.56 for RUCAM (p=0.14 in the abstract; p=0.16 in Results).
  • RECAM had better sensitivity for extreme categories: 73 vs. 54 for highly likely/high probable (p=0.02) and 65 vs. 48 for unlikely/excluded (p=0.08).

Methods

  • RECAM was developed iteratively from 2015 onward through 5 stages and 12 versions, using DILIN and Spanish DILI Registry cases, published literature, expert opinion, and computer modeling; development was restricted to single-agent, non-herbal/dietary supplement cases.
  • Final testing used 98 DILIN and 96 Spanish DILI Registry single-agent, non-HDS cases; DILIN cases were stratified equally across its 5 likelihood categories, and cases were categorized by R-value as hepatocellular, cholestatic, or mixed.
  • RECAM scoring was semi-automated via computer extraction and scoring; classification tree analysis established diagnostic cut-offs, and performance was compared with RUCAM using AUCs, Spearman’s Rho, percent agreement, weighted kappa, sensitivity, and specificity against expert opinion.

Limitations

  • The paper states RECAM was developed in US and Spanish cohorts, so performance in other regions—particularly Asia—is unknown; both registries have minimum liver enzyme and bilirubin enrollment criteria, so performance in less severe injuries is unclear.
  • The paper states RECAM needs testing in a broader group of clinicians including non-hepatologists, is limited to single-agent medication cases, is not designed or tested for herbal and dietary supplement liver injury, and increases data entry compared with RUCAM.
  • The paper states some clinical judgment remains necessary, such as judging whether a biliary stricture is clinically insignificant and scoring drugs not included in LiverTox®; it also notes an AUC ceiling of 0.85–0.89 because algorithms cannot capture factors such as delayed care, death/transplant, or chronic DILI, and concludes RECAM is not a standalone diagnostic tool.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1002/hep.32327

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

24 Own interpretation · 13 Own result · 4 Not checked yet · 4 No basis given · 3 Own method · 1 Partly supported · accuracy not yet measured

Verify all 7 references — free account
  • It may state two separate claims as one. 19
  • Probably not a substantial claim. 8
23 of 23
  • The paper relies on this without support.

    Spanish experts rely more on RUCAM for their diagnostic categories.

    “as the Spanish experts rely more on RUCAM for their diagnostic categories.”
  • The paper relies on this without support.

    DILIN often excludes cases that have definitive competing diagnoses arise during screening, while the Spanish group retains such cases for data analyses.

    “because the DILIN often excludes cases that have definitive competing diagnoses arise during screening, while the Spanish group retains such cases for data analyses.”
  • The paper relies on this without support.

    A positive prospective rechallenge is highly indicative of DILI.

    “a positive prospective rechallenge is highly indicative of DILI and awarded more points than any other component in the RECAM (+6).”
  • The paper relies on this without support.

    DILI is a diagnosis of exclusion where competing causes should only hurt the case.

    “because DILI is a diagnosis of exclusion where competing causes should only hurt the case.”
  • The paper relies on this without support.

    Liver histology is uncommonly diagnostic of DILI.

    “Liver histology is uncommonly diagnostic of DILI, so points awarded were limited.”
  • The paper relies on this without support.

    The heterogeneity of DILI phenotypes makes it difficult to develop a single, easy-to-use diagnostic tool for all medications.

    “The heterogeneity of DILI phenotypes makes it difficult to develop a single, easy-to-use diagnostic tool for all medications.”
6 of 6

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 21 references

Cited by

Sorted by citations

See all 161

Metadata

Authors
Hayashi, P. H., Lucena, M. I., Fontana, R. J., Bjornsson, E. S., Aithal, G. P., Barnhart, H., Gonzalez‐Jimenez, A., Yang, Q., Gu, J., Andrade, R. J., & Hoofnagle, J. H.
Affiliations
  • United States Food and Drug Administration (US)
  • Centro de Investigación Biomédica en Red de Enfermedades Hepáticas y Digestivas (ES)
  • University of Michigan (US)
  • University of Iceland (IS)
  • Nottingham University Hospitals NHS Trust (GB)
  • Duke University (US)
  • Servicio de Aparato Digestivo y de Farmacología Clínica,Hospital Universitario Virgen de la Victoria,Instituto de Investigación Biomédica de Málaga‐IBIMA,Facultad de Medicina,Universidad de Málaga,Málaga,Spain
  • National Institute of Diabetes and Digestive and Kidney Diseases (US)
Corresponding author
Hayashi, Paul H.
Venue
Hepatology
Published
2022-03-22
Volume
76
Issue
1
Pages
18-31
ISSN
  • 0270-9139 (ISSN-L)
  • 1527-3350
OpenAlex
W4206399120
Cited by
160
References
21
Citations by year
2026: 36 · 2025: 29 · 2024: 46 · 2023: 25 · 2022: 22
FWCI
17.75
Type
journal article
Language
en
Open access
Locations
  • Hepatology (publishedVersion)
  • PubMed (publishedVersion)
  • Repositorio Institucional de la Universidad de Málaga (University of Málaga) (publishedVersion, cc-by-nc-nd)
  • PubMed Central (acceptedVersion)
  • Deep Blue (University of Michigan) (submittedVersion)
  • Repository@Nottingham (University of Nottingham) (submittedVersion, cc-by)
  • Opin vísindi (Opin vísindi) (submittedVersion, cc-by-nc-sa)
  • RISalud Institutional Health Repository of Andalucía (submittedVersion, other-oa)
  • Opin vísindi (Opin vísindi) (submittedVersion, other-oa)
  • Repositorio Institucional de la Universidad de Málaga (University of Málaga) (submittedVersion, other-oa)
Funders
  • American Association for the Study of Liver Diseases
  • University of Pennsylvania (UL1 RR024986, UL1 RR024134, U01-DK100928)
  • University of Texas Southwestern Medical Center (UL1TR000083, UL1‐RR024982, U01-DK083027, U01-DK083020, U01-DK082992, UL1 RR024986, UL1 RR024150, UL1 RR024134, U01-DK100928, UL1 RR025761)
  • Georgia Clinical and Translational Science Alliance (UL1RR024986, UL1TR000083, UL1RR024982, UL1 RR024150, UL1 RR025761, UL1 RR024134)
  • National Institutes of Health (5u01dk065211-22, UL1TR000083, 5u01dk065238-11, 5u01dk065193-05, 5u01dk065184-22, U01-DK065211)
  • University of California, San Francisco
  • Instituto de Salud Carlos III (PT 20/00127, PI18/01804)
  • European Regional Development Fund (PI18/01804)
  • National Cancer Institute
  • National Institute of Diabetes and Digestive and Kidney Diseases (U01 DK-065238, U01‐DK065193, U01 DK-065184, DK065211, U24DK065176, U01DK083023, DK065184, U01 DK-065211, U01DK082992, DK065176, DK065238, U01DK100928, U01DK083027, U01DK065201, U01DK083020)
  • National Center for Research Resources (UL1RR024986, UL1RR024982, UL1RR025761, UL1RR024134, UL1RR024150)
  • National Center for Advancing Translational Sciences
Topics
  • Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Drug-Induced Hepatotoxicity and Protection
  • Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Toxicology › Pharmacovigilance and Adverse Drug Reactions
  • Health Sciences › Medicine › Pharmacology (medical) › Drug-Induced Adverse Reactions
Keywords
drug-induced liver injury, RUCAM, causality assessment, diagnostic criteria, Drug-Induced Liver Injury Network, classification trees
MeSH terms
Dyphylline, Electronics, Humans, Reproducibility of Results, Causality, Chemical and Drug Induced Liver Injury

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review