The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index; 13 of the 44 sources its claims cite were checked for support.
Performance assessment and economic analysis of a human Liver-Chip for predictive toxicology
Open accessAbstract
Conventional preclinical models often miss drug toxicities, meaning the harm these drugs pose to humans is only realized in clinical trials or when they make it to market. This has caused the pharmaceutical industry to waste considerable time and resources developing drugs destined to fail. Organ-on-a-Chip technology has the potential improve success in drug development pipelines, as it can recapitulate organ-level pathophysiology and clinical responses; however, systematic and quantitative evaluations of Organ-Chips' predictive value have not yet been reported. 870 Liver-Chips were analyzed to determine their ability to predict drug-induced liver injury caused by small molecules identified as benchmarks by the Innovation and Quality consortium, who has published guidelines defining criteria for qualifying preclinical models. An economic analysis was also performed to measure the value Liver-Chips could offer if they were broadly adopted in supporting toxicity-related decisions as part of preclinical development workflows. Here, we show that the Liver-Chip met the qualification guidelines across a blinded set of 27 known hepatotoxic and non-toxic drugs with a sensitivity of 87% and a specificity of 100%. We also show that this level of performance could generate over $3 billion annually for the pharmaceutical industry through increased small-molecule R&D productivity. The results of this study show how incorporating predictive Organ-Chips into drug development workflows could…
Overview
CoChat Summary
## TL;DR
This study systematically evaluated a human Liver-Chip for drug-induced liver injury (DILI) prediction using 870 chips and a blinded set of 27 drugs. The Liver-Chip met IQ consortium qualification criteria and, when protein binding was accounted for, achieved 87% sensitivity and 100% specificity, with the authors estimating an annual industry value of over $3 billion.
## Key findings
- Across a blinded set of 27 known hepatotoxic and non-toxic drugs, the Liver-Chip achieved 87% sensitivity and 100% specificity after accounting for protein binding.
- In the 15 toxic drugs tested using two donors, the Liver-Chip correctly predicted toxicity in 12 out of 15 drugs, yielding 80% sensitivity; the paper reports this was compared with 42% sensitivity for 3D hepatic spheroids and 67% specificity for spheroids.
- Using the protein-binding-corrected analysis, the Spearman correlation with the Garside DILI severity scale was 0.78, versus 0.43 with the lower-threshold, uncorrected approach.
- The economic model estimated a 2.8% NPV uplift for drug development and an annual industry gain of about $3 billion ($2.1B–$3.4B, 95% CI) if Liver-Chips were broadly adopted for small-molecule DILI prediction; extending the approach to four additional Organ-Chip models could yield over $24 billion annually.
## Methods
- The study used 870 Liver-Chips run in five consecutive cycles over 20 weeks, testing 27 drugs in a blinded design with three human hepatocyte donors; drug preparation, dosing, and analysis were split across teams to preserve blinding.
- Liver-Chip performance was assessed using structural and functional endpoints including albumin, ALT, urea, morphology scoring, live/fixed imaging, and gene expression, with toxicity called from concentration- and time-dependent responses across days 1, 3, and 7.
- An economic model extending prior pipeline models was used to estimate how improved preclinical toxicology prediction would change false negative rate (FNR), net present value (NPV), and annual R&D productivity.
## Limitations
- The authors note that the PDMS chip material may be problematic for some small molecules because of non-specific binding, and they recommend checking binding experimentally with an acellular chip; this is a limitation stated in the Discussion.
- The paper notes that only small molecules were assessed, and that performance against large molecules and biologic therapies still needs investigation; this is stated in the Discussion.
- Evident from the text: the study only tested five of six additional IQ-suggested drugs in the second DILI challenge set because one drug was not obtained and another was considered to need a more complex immune configuration.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
8 Valid · 4 Not valid · 19 Not checked · 86 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“This was almost double the sensitivity of 3D hepatic spheroids for the same drug set (42%) based on previously published data31,47,48”
§ Performance assessment and economic analysis of a human Liver-Chip for predictive toxicology > Results > Improved sensitivity for DILI prediction compared to spheroids and animal models
What the sources say
- Disputedcites [31] Proctor, W. R. et al. Utility of spherical human liver microtissues for prediction of clinical drug-induced liver injury. Arch. Toxicol. 91, 2849–2863 (2017). sourceExperimental — accuracy not yet measured
In Results (Statistical analysis employing practical fixed thresholds; page unavailable), the paper reports 60.9% sensitivity for its 3D liver spheroids at a 100 μM threshold, not 42%. Its Discussion gives a sensitivity range of 19–61% depending on the threshold. The Results figure of 42 is the number of DILI-positive drugs detected out of 69, not a percentage. (LLM, conf=0.85)
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [47] Hendriks, D. F. G. et al. Mechanisms of chronic fialuridine hepatotoxicity as revealed in primary human hepatocyte spheroids. Toxicol. Sci. 171, 385–395 (2019). source
- Not checked — no full text of the sourcecites [48] Li, F., Cao, L., Parikh, S. & Zuo, R. Three-dimensional spheroids with primary human liver cells and differential roles of Kupffer cells in drug-induced liver injury. J. Pharm. Sci. 109, 1912–1923 (2020). source
plainn = 2- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“a preclinical model that is currently widely used in pharma and was only able to correctly identify 8 out of the 19 toxic drugs in the set (Table 5).”
§ Performance assessment and economic analysis of a human Liver-Chip for predictive toxicology > Results > Improved sensitivity for DILI prediction compared to spheroids and animal models
What the sources say
- Disputedcites [31] Proctor, W. R. et al. Utility of spherical human liver microtissues for prediction of clinical drug-induced liver injury. Arch. Toxicol. 91, 2849–2863 (2017). sourceExperimental — accuracy not yet measured
The Results (Statistical analysis employing practical fixed thresholds; page unavailable) report that the 3D liver microtissue assay tested 69 DILI-positive drugs, identifying 13 to 42 depending on the threshold. The cited paper does not report identifying 8 of 19 toxic drugs; its reported test set and results are different. (LLM, conf=0.86)
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [47] Hendriks, D. F. G. et al. Mechanisms of chronic fialuridine hepatotoxicity as revealed in primary human hepatocyte spheroids. Toxicol. Sci. 171, 385–395 (2019). source
- Not checked — no full text of the sourcecites [48] Li, F., Cao, L., Parikh, S. & Zuo, R. Three-dimensional spheroids with primary human liver cells and differential roles of Kupffer cells in drug-induced liver injury. J. Pharm. Sci. 109, 1912–1923 (2020). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Importantly, the toxicities of these 8 drugs have been shown to be poorly predicted by hepatic spheroids31,32.”
§ Performance assessment and economic analysis of a human Liver-Chip for predictive toxicology > Results > Improved sensitivity for DILI prediction compared to spheroids and animal models
What the sources say
- Partly supportedcites [31] Proctor, W. R. et al. Utility of spherical human liver microtissues for prediction of clinical drug-induced liver injury. Arch. Toxicol. 91, 2849–2863 (2017). sourceExperimental — accuracy not yet measured
The Results section, ‘Comparison of predictive value in PHH and hLiMT across different DILI categories’ (page unavailable), reports false negatives in hepatic microtissues, so the paper supports the point that spheroids missed some drug toxicities. It does not establish that the eight drugs referred to in the citing sentence were the ones missed. (LLM, conf=0.79)
- Partly supportedcites [32] Vorrink, S. U., Zhou, Y., Ingelman-Sundberg, M. & Lauschke, V. M. Prediction of drug-induced hepatotoxicity using long-term stable primary hepatic 3D spheroid cultures in chemically defined conditions. Toxicol. Sci. 163, 655–665 (2018). sourceExperimental — accuracy not yet measured
The Results (page unavailable) report that the spheroid model detected 48 of 70 drugs with human hepatotoxicity liabilities, so it did miss some toxic drugs. The paper does not identify the citing sentence’s particular eight drugs, however, and reports good overall predictive performance rather than describing those eight as a group. (LLM, conf=0.78)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“previously, the same Liver-Chip has been shown to exhibit Phase I and II functional activities that are comparable to freshly isolated human hepatocytes and 3D hepatic spheroids26,30”
§ Performance assessment and economic analysis of a human Liver-Chip for predictive toxicology > Results > Liver-Chip satisfies IQ MPS affiliate guidelines
What the sources say
- Not checked — no full text of the sourcecites [26] Jang, K.-J. et al. Reproducing human and cross-species drug toxicities using a Liver-Chip. Sci. Transl. Med. 11, eaax5516 (2019). source
- Partly supportedcites [30] Foster, A. J. et al. Integrated in vitro models for hepatic safety and metabolism: evaluation of a human Liver-Chip and liver spheroid. Arch. Toxicol. 93, 1021–1037 (2019). sourceExperimental — accuracy not yet measured
Our copy of Foster et al. (2019) supports the Liver-Chip-vs-3D-spheroid half of the claim: the Discussion (APAP metabolite quantification / Discussion sections) states 'APAP-glucuronide and APAP-sulfate formation is present during the culture period demonstrating phase II metabolism at comparable levels in both systems', and CYP activity profiling (Results, 'CYP activity profiling in Liver-Chips and liver spheroids') says Phase I activity was maintained in both models over the study. The benchmark against human hepatocytes is narrower than the claim states: for the Liver-Chip the Discussion explicitly reports comparability only for CYP2C19, and against 'freshly thawed cryopreserved human hepatocytes' (Brown et al. 2007) rather than freshly isolated cells; the broader hepatocyte comparability statements (including the CYP2E1 36-fold shortfall) are made for the spheroid model, and the paper notes activity levels 'varied between and within experiments' with lower CYP1A2/CYP2D6 at later time points. So a blanket 'Phase I and II activities comparable to freshly isolated human hepatocytes' overstates what this source demonstrates. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“whereas the 3D hepatic spheroids did (only 67% specificity)31”
§ Performance assessment and economic analysis of a human Liver-Chip for predictive toxicology > Results > Improved sensitivity for DILI prediction compared to spheroids and animal models
What the sources say
- Partly supportedcites [31] Proctor, W. R. et al. Utility of spherical human liver microtissues for prediction of clinical drug-induced liver injury. Arch. Toxicol. 91, 2849–2863 (2017). sourceExperimental — accuracy not yet measured
The Results section, “Statistical analysis employing practical fixed thresholds” (page unavailable), reports that the 3D liver microtissue assay falsely classified some DILI-negative drugs as toxic. But its reported specificity was 80.5–97.6% across the tabulated thresholds, not 67%. (LLM, conf=0.91)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
55 more claims · 1 with their cited sources checked
Create a free account to see all 117 claims and to verify the 5 references still open.
- It may state two separate claims as one. 43
- Probably not a substantial claim. 21
- The quote only partly states this claim. 2
Citations
Cites
ggplot2: Elegant Graphics for Data Analysis
Wickham, H. (2009) · doi:10.1007/978-0-387-98141-3 · Cited by 14,447
Reconstituting organ-level lung functions on a chip
Huh, D., Matthews, B. D., Mammoto, A., Montoya-Zavala, M., Hsin, H. Y., & Ingber, D. E. (2010) · Science · doi:10.1126/science.1188302 · Cited by 4,250
Self-citationCan the pharmaceutical industry reduce attrition rates?
Kola, I., & Landis, J. (2004) · Nature Reviews Drug Discovery · doi:10.1038/nrd1470 · Cited by 4,167
Dose-Response Analysis Using R
Ritz, C., Baty, F., Streibig, J. C., & Gerhard, D. (2015) · PLOS ONE · doi:10.1371/journal.pone.0146021 · Cited by 3,658
How to improve R&D productivity: the pharmaceutical industry's grand challenge
Paul, S. M., Mytelka, D. S., Dunwiddie, C. T., Persinger, C. C., Munos, B. H., Lindborg, S. R., & Schacht, A. L. (2010) · Nature Reviews Drug Discovery · doi:10.1038/nrd3078 · Cited by 3,566
Bhatia, S. N., & Ingber, D. E. (2014) · Nature Biotechnology · doi:10.1038/nbt.2989 · Cited by 3,305
Self-citationDiagnosing the decline in pharmaceutical R&D efficiency
Scannell, J. W., Blanckley, A., Boldon, H., & Warrington, B. (2012) · Nature Reviews Drug Discovery · doi:10.1038/nrd3681 · Cited by 1,981
Self-citationMale sex identified by global COVID-19 meta-analysis as a risk factor for death and ITU admission
Peckham, H., de Gruijter, N. M., Raine, C., Radziszewska, A., Ciurtin, C., Wedderburn, L. R., Rosser, E. C., Webb, K., & Deakin, C. T. (2020) · Nature Communications · doi:10.1038/s41467-020-19741-6 · Cited by 1,503
Lessons learned from the fate of AstraZeneca's drug pipeline: a five-dimensional framework
Cook, D., Brown, D., Alexander, R., March, R., Morgan, P., Satterthwaite, G., & Pangalos, M. N. (2014) · Nature Reviews Drug Discovery · doi:10.1038/nrd4309 · Cited by 1,344
Godoy, P., Hewitt, N. J., Albrecht, U., Andersen, M. E., Ansari, N., Bhattacharya, S., Bode, J. G., Bolleyn, J., Borner, C., Böttger, J., et al. (2013) · Archives of Toxicology · doi:10.1007/s00204-013-1078-5 · Cited by 1,280
Research works printed but not linked: 3
- Redfern, W. S. et al. Impact and frequency of different toxicities throughout the pharmaceutical life cycle. Toxicologist 114, 1081 (2010).
- Lomitapide. LiverTox: Clinical and Research Information on Drug-Induced Liver Injury. https://www.ncbi.nlm.nih.gov/books/NBK548458/ (2019).
- Lloyd, I. Pharma R&D Annual Review 2021, 1–45. (Citeline Informa Pharma Intelligence, 2021).
Cited by
Organ-on-a-chip meets artificial intelligence in drug evaluation
Deng, S., Li, C., Cao, J., Cui, Z., Du, J., Fu, Z., Yang, H., & Chen, P. (2023) · Theranostics · doi:10.7150/thno.87266 · Cited by 260
“Meanwhile, the largest OoCs study to date, in which 780 liver OoC devices were used to evaluate the toxicity risk of a blinded group of 27 known hepatotoxic and nontoxic drugs, showed a sensitivity and specificity of 87% and 100% for liver OoCs, respectively [119].”
BackgroundStrategies to reduce the risks of mRNA drug and vaccine toxicity
Bitounis, D., Jacquinet, E., Rogers, M. A., & Amiji, M. M. (2024) · Nature Reviews Drug Discovery · doi:10.1038/s41573-023-00859-3 · Cited by 224
“Its potential for de-risking purposes has also been established in multiple liver-on-chip drug toxicity studies 228,237,238 .”
Towards in vitro models for reducing or replacing the use of animals in drug testing
Stresser, D. M., Kopec, A. K., Hewitt, P., Hardwick, R. N., Van Vleet, T. R., Mahalingaiah, P. K. S., O’Connell, D., Jenkins, G. J., David, R., Graham, J., et al. (2023) · Nature Biomedical Engineering · doi:10.1038/s41551-023-01154-7 · Cited by 94
Self-citationGangwal, A., & Lavecchia, A. (2025) · Drug Discovery Today · doi:10.1016/j.drudis.2025.104360 · Cited by 129
Complex in vitro model: A transformative model in drug development and precision medicine
Wang, L., Hu, D., Xu, J., Hu, J., & Wang, Y. (2023) · Clinical and Translational Science · doi:10.1111/cts.13695 · Cited by 105
“69 The classical chip of TissUse GmbH has a round hole linked by different microfluidic channels (Figure 3b).”
Background
Metadata
- Authors
- Ewart, L., Apostolou, A., Briggs, S. A., Carman, C. V., Chaff, J. T., Heng, A. R., Jadalannagari, S., Janardhanan, J., Jang, K.-J., Joshipura, S. R., Kadam, M. M., Kanellias, M., Kujala, V. J., Kulkarni, G., Le, C. Y., Lucchesi, C., Manatakis, D. V., Maniar, K. K., Quinn, M. E., Ravan, J. S., Rizos, A. C., Sauld, J. F. K., Sliz, J. D., Tien-Street, W., Trinidad, D. R., Velez, J., Wendell, M., Irrechukwu, O., Mahalingaiah, P. K., Ingber, D. E., Scannell, J. W., & Levner, D.
- Affiliations
- Emulate (United States) (US)
- AbbVie (United States) (US)
- Boston Children's Hospital (US)
- Corresponding author
- Ewart, Lorna
- ORCID
- Ewart, Lorna
- Apostolou, Athanasia
- Briggs, Skyler A.
- Carman, Christopher V.
- Chaff, Jake T.
- Heng, Anthony R.
- Jadalannagari, Sushma
- Janardhanan, Jeshina
- Jang, Kyung-Jin
- Joshipura, Sannidhi R.
- Kanellias, Marianne
- Kujala, Ville J.
- Kulkarni, Gauri
- Le, Christopher Y.
- Lucchesi, Carolina
- Manatakis, Dimitris V.
- Maniar, Kairav K.
- Ravan, Joseph S.
- Sliz, Josiah D.
- Tien-Street, William
- Wendell, Max
- Irrechukwu, Onyi
- Mahalingaiah, Prathap Kumar
- Ingber, Donald E.
- Scannell, Jack W.
- Venue
- Communications Medicine
- Published
- 2022-12-06
- Volume
- 2
- Issue
- 1
- Pages
- 154-154
- ISSN
- 2730-664X (ISSN-L)
- PMC
- PMC9727064
- OpenAlex
- W4310952187
- Cited by
- 337
- References
- 56
- Citations by year
- 2026: 124 · 2025: 97 · 2024: 69 · 2023: 45 · 2022: 2
- FWCI
- 48.61
- Type
- journal article
- Language
- en
- Update notices
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Communications Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Drug-Induced Hepatotoxicity and Protection
- Physical Sciences › Engineering › Biomedical Engineering › 3D Printing in Biomedical Research
- Health Sciences › Veterinary › Small Animals › Animal testing and alternatives
- Keywords
- organ-on-a-chip, drug-induced liver injury, hepatotoxicity prediction, predictive toxicology, preclinical toxicity testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Performance assessment and economic analysis of a human Liver-Chip for predictive toxicology. https://app.cochat.ai/papers/10.1038/s43856-022-00209-1
- The paper
- Ewart, L., Apostolou, A., Briggs, S. A., Carman, C. V., Chaff, J. T., Heng, A. R., Jadalannagari, S., Janardhanan, J., Jang, K.-J., Joshipura, S. R., Kadam, M. M., Kanellias, M., Kujala, V. J., Kulkarni, G., Le, C. Y., Lucchesi, C., Manatakis, D. V., Maniar, K. K., Quinn, M. E., . . . Levner, D. (2022). Performance assessment and economic analysis of a human Liver-Chip for predictive toxicology. Communications Medicine. https://doi.org/10.1038/s43856-022-00209-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.