Liver-on-chips for drug discovery and development
Open accessThe DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Abstract
Recent FDA modernization act 2.0 has led to increasing industrial R&D investment in advanced in vitro 3D models such as organoids, spheroids, organ-on-chips, 3D bioprinting, and in silico approaches. Liver-related advanced in vitro models remain the prime area of interest, as liver plays a central role in drug clearance of compounds. Growing evidence indicates the importance of recapitulating the overall liver microenvironment to enhance hepatocyte maturity and culture longevity using liver-on-chips (LoC) in vitro. Hence, pharmaceutical industries have started exploring LoC assays in the two of the most challenging areas: accurate in vitro-in vivo extrapolation (IVIVE) of hepatic drug clearance and drug-induced liver injury. We examine the joint efforts of commercial chip manufacturers and pharmaceutical companies to present an up-to-date overview of the adoption of LoC technology in the drug discovery. Further, several roadblocks are identified to the rapid adoption of LoC assays in the current drug development framework. Finally, we discuss some of the underexplored application areas of LoC models, where conventional 2D hepatic models are deemed unsuitable. These include clearance prediction of metabolically stable compounds, immune-mediated drug-induced liver injury (DILI) predictions, bioavailability prediction with gut-liver systems, hepatic clearance prediction of drugs given during pregnancy, and dose adjustment studies in disease conditions. We conclude the review by discussing the importance of PBPK modeling with LoC, digital twins, and AI/ML integration with LoC.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Concordance of the toxicity of pharmaceuticals in humans and in animals
Olson, H., Betton, G., Robinson, D., Thomas, K., Monro, A., Kolaja, G., Lilly, P., Sanders, J., Sipes, G., Bracken, W., et al. (2000) · Regulatory Toxicology and Pharmacology · doi:10.1006/rtph.2000.1399 · Cited by 2,050 · cited 1×
“Historical data suggest that nonrodents failed to flag 37 % of the compounds, and rodent species missed detecting 57 % of the 150 compounds, that were found toxic to humans [112].”
BackgroundHuman organs-on-chips for disease modelling, drug development and personalized medicine
Ingber, D. E. (2022) · Nature Reviews Genetics · doi:10.1038/s41576-022-00466-9 · Cited by 1,589
Three-dimensional bioprinting of thick vascularized tissues
Kolesky, D. B., Homan, K. A., Skylar-Scott, M. A., & Lewis, J. A. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1521342113 · Cited by 1,492 · cited 3×
“2(b – i)) [74] or needles Fig.”
BackgroundMethodMartignoni, M., Groothuis, G. M. M., & de Kanter, R. (2006) · Expert Opinion on Drug Metabolism & Toxicology · doi:10.1517/17425255.2.6.875 · Cited by 1,478
Michalopoulos, G. K. (2007) · Journal of Cellular Physiology · doi:10.1002/jcp.21172 · Cited by 1,384 · cited 1×
“All of them play a key role in liver regeneration after partial hepatectomy by secreting important growth factors, well-documented in previous literature [60,61].”
BackgroundGodoy, P., Hewitt, N. J., Albrecht, U., Andersen, M. E., Ansari, N., Bhattacharya, S., Bode, J. G., Bolleyn, J., Borner, C., Böttger, J., et al. (2013) · Archives of Toxicology · doi:10.1007/s00204-013-1078-5 · Cited by 1,280
Microscale culture of human liver cells for drug development
Khetani, S. R., & Bhatia, S. N. (2008) · Nature Biotechnology · doi:10.1038/nbt1361 · Cited by 1,219 · cited 2×
“Hence, sandwich cultures [16] and micropatterned models [17] have been developed.”
BackgroundHofer, M., & Lutolf, M. P. (2021) · Nature Reviews Materials · doi:10.1038/s41578-021-00279-y · Cited by 1,184 · cited 1×
“We believe that the dynamic culture of organoids can improve their maturation and functional activity in LoC models [127,128].”
BackgroundZhao, Z., Chen, X., Dowbaj, A. M., Sljukic, A., Bratlie, K., Lin, L., Fong, E. L. S., Balachander, G. M., Chen, Z., Soragni, A., et al. (2022) · Nature Reviews Methods Primers · doi:10.1038/s43586-022-00174-y · Cited by 1,082
The Prediction of Human Pharmacokinetic Parameters from Preclinical and in Vitro Metabolism Data
Obach, R. S., Baxter, J. G., Liston, T. E., Silber, B. M., Jones, B. C., Macintyre, F., Rance, D. J., & Wastall, P. (1997) · The Journal of Pharmacology and Experimental Therapeutics · doi:10.1016/s0022-3565(24)36999-x · Cited by 987
Flow-enhanced vascularization and maturation of kidney organoids in vitro
Homan, K. A., Gupta, N., Kroll, K. T., Kolesky, D. B., Skylar-Scott, M., Miyoshi, T., Mau, D., Valerius, M. T., Ferrante, T., Bonventre, J. V., et al. (2019) · Nature Methods · doi:10.1038/s41592-019-0325-y · Cited by 939 · cited 1×
“We believe that the dynamic culture of organoids can improve their maturation and functional activity in LoC models [127,128].”
BackgroundKim, H. J., Li, H., Collins, J. J., & Ingber, D. E. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1522193112 · Cited by 922
Maschmeyer, I., Lorenz, A. K., Schimek, K., Hasenberg, T., Ramme, A. P., Hübner, J., Lindner, M., Drewell, C., Bauer, S., Thomas, A., et al. (2015) · Lab on a Chip · doi:10.1039/c5lc00392j · Cited by 861
Park, S. E., Georgescu, A., & Huh, D. (2019) · Science · doi:10.1126/science.aaw7894 · Cited by 847
Long-Term Expansion of Functional Mouse and Human Hepatocytes as 3D Organoids
Hu, H., Gehart, H., Artegiani, B., LÖpez-Iglesias, C., Dekkers, F., Basak, O., van Es, J., Chuva de Sousa Lopes, S. M., Begthel, H., Korving, J., et al. (2018) · Cell · doi:10.1016/j.cell.2018.11.013 · Cited by 837
Bell, C. C., Hendriks, D. F. G., Moro, S. M. L., Ellis, E., Walsh, J., Renblom, A., Fredriksson Puigvert, L., Dankers, A. C. A., Jacobs, F., Snoeys, J., et al. (2016) · Scientific Reports · doi:10.1038/srep25187 · Cited by 739 · cited 5×
“Moreover, 3D spheroids have been extensively characterized to detect drug-induced cholestasis and steatosis [67,118].”
BackgroundMethodInfluentialMicrofluidic assay for simultaneous culture of multiple cell types on surfaces or within hydrogels
Shin, Y., Han, S., Jeon, J. S., Yamamoto, K., Zervantonakis, I. K., Sudo, R., Kamm, R. D., & Chung, S. (2012) · Nature Protocols · doi:10.1038/nprot.2012.051 · Cited by 617
Reproducing human and cross-species drug toxicities using a liver-chip
Jang, K.-J., Otieno, M. A., Ronxhi, J., Lim, H.-K., Ewart, L., Kodella, K. R., Petropolis, D. B., Kulkarni, G., Rubins, J. E., Conegliano, D., et al. (2019) · Science Translational Medicine · doi:10.1126/scitranslmed.aax5516 · Cited by 511 · cited 4×
“Similarly, Jang et al. captured species-specific (human, dog, rat) albumin production rates in dynamic LoC (Emulate) platform, that were significantly higher than static sandwich cultures [55].”
BackgroundInfluentialPerformance assessment and economic analysis of a human Liver-Chip for predictive toxicology
Ewart, L., Apostolou, A., Briggs, S. A., Carman, C. V., Chaff, J. T., Heng, A. R., Jadalannagari, S., Janardhanan, J., Jang, K.-J., Joshipura, S. R., et al. (2022) · Communications Medicine · doi:10.1038/s43856-022-00209-1 · Cited by 337 · cited 8×
“Bonn et al. For sandwich culture of liver hepatocytes and co-culture with other liver specific cells for toxicity prediction [13] V. Mehta et al. demonstrated that conventional PHH culture could only predict clearance of two out of six low-clearance compounds within a 2-fold range [92].”
BackgroundMethodInfluentialVascularized cancer on a chip: the effect of perfusion on growth and drug delivery of tumor spheroid
Nashimoto, Y., Okada, R., Hanada, S., Arima, Y., Nishiyama, K., Miura, T., & Yokokawa, R. (2020) · Biomaterials · doi:10.1016/j.biomaterials.2019.119547 · Cited by 332 · cited 2×
“Integrating vasculature into LoC may enhance proliferation and viability of hepatic tissues; however, their adoption in industries is likely to remain low for DILI and clearance predictions due to high complexity involved in imaging and culturing the system with endothelial cells [86].”
BackgroundInflammatory Cytokine TNFα Promotes the Long-Term Expansion of Primary Hepatocytes in 3D Culture
Peng, W. C., Logan, C. Y., Fish, M., Anbarchian, T., Aguisanda, F., Álvarez-Varela, A., Wu, P., Jin, Y., Zhu, J., Li, B., et al. (2018) · Cell · doi:10.1016/j.cell.2018.11.012 · Cited by 331
Bell, C. C., Dankers, A. C. A., Lauschke, V. M., Sison-Young, R., Jenkins, R., Rowe, C., Goldring, C. E., Park, K., Regan, S. L., Walker, T., et al. (2018) · Toxicological Sciences · doi:10.1093/toxsci/kfx289 · Cited by 327
Multi-cell type human liver microtissues for hepatotoxicity testing
Messner, S., Agarkova, I., Moritz, W., & Kelm, J. M. (2013) · Archives of Toxicology · doi:10.1007/s00204-012-0968-2 · Cited by 319
Lee, S.-A., No, D. Y., Kang, E., Ju, J., Kim, D.-S., & Lee, S.-H. (2013) · Lab on a Chip · doi:10.1039/c3lc50197c · Cited by 297
Hepatocytes in collagen sandwich: evidence for transcriptional and translational regulation.
Dunn, J. C., Tompkins, R. G., & Yarmush, M. L. (1992) · The Journal of cell biology · doi:10.1083/jcb.116.4.1043 · Cited by 295 · cited 1×
“Hence, sandwich cultures [16] and micropatterned models [17] have been developed.”
Esch, M. B., Mahler, G. J., Stokol, T., & Shuler, M. L. (2014) · Lab Chip · doi:10.1039/c4lc00371c · Cited by 281 · cited 1×
“Apart from bioavailability prediction, the liver-gut system has also been applied to study various diseases such as inflammatory bowel disease [139], air pollution-related metabolic disturbances [140], nanoparticle-induced liver injury [141], and hepatic steatosis [142].”
BackgroundMimicking liver sinusoidal structures and functions using a 3D-configured microfluidic chip
Du, Y., Li, N., Yang, H., Luo, C., Gong, Y., Tong, C., Gao, Y., Lü, S., & Long, M. (2017) · Lab on a Chip · doi:10.1039/c6lc01374k · Cited by 241 · cited 4×
“In another report, Du et al. demonstrated neutrophil recruitment through ICAM-1 expressing LSECs in a similar membrane based two compartment liver-chip using lipopolysaccharide (LPS) stimulation [21].”
BackgroundMethodResultInfluentialWang, Y., Wang, H., Deng, P., Chen, W., Guo, Y., Tao, T., & Qin, J. (2018) · Lab on a Chip · doi:10.1039/c8lc00869h · Cited by 222 · cited 3×
“Although 3D iHep-based culture models are promising, their albumin secretion rate remains significantly lower than in vivo values over 5 weeks under dynamic flow ( 1 μ g/day/million cells) [51,52].”
BackgroundResultPoor Translatability of Biomedical Research Using Animals — A Narrative Review
Marshall, L. J., Bailey, J., Cassotta, M., Herrmann, K., & Pistollato, F. (2023) · Alternatives to Laboratory Animals · doi:10.1177/02611929231157756 · Cited by 219
Animal versus human oral drug bioavailability: Do they correlate?
Musther, H., Olivares-Morales, A., Hatley, O. J. D., Liu, B., & Rostami Hodjegan, A. (2014) · European Journal of Pharmaceutical Sciences · doi:10.1016/j.ejps.2013.08.018 · Cited by 211 · cited 1×
“Animal models have been poor predictors of bioavailability in humans [133].”
BackgroundVorrink, S. U., Zhou, Y., Ingelman-Sundberg, M., & Lauschke, V. M. (2018) · Toxicological Sciences · doi:10.1093/toxsci/kfy058 · Cited by 187
Monticello, T. M., Jones, T. W., Dambach, D. M., Potter, D. M., Bolt, M. W., Liu, M., Keller, D. A., Hart, T. K., & Kadambi, V. J. (2017) · Toxicology and Applied Pharmacology · doi:10.1016/j.taap.2017.09.006 · Cited by 186 · cited 1×
“[10], and (4) poor prediction rate of human hepatotoxicity from the animal studies [11,12].”
BackgroundPrantil-Baun, R., Novak, R., Das, D., Somayaji, M. R., Przekwas, A., & Ingber, D. E. (2018) · Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-010716-104748 · Cited by 176 · cited 1×
“With the advent of multi-organs-Table V. Mehta et al. on-chips, prediction of PK profile and PK parameters are possible through PBPK modeling of the tissue-chips [164].”
Multi-cellular 3D human primary liver cell culture elevates metabolic activity under fluidic flow
Esch, M. B., Prot, J.-M., Wang, Y. I., Miller, P., Llamas-Vidales, J. R., Naughton, B. A., Applegate, D. R., & Shuler, M. L. (2015) · Lab on a Chip · doi:10.1039/c5lc00237k · Cited by 173
Mechanosensing by β1 integrin induces angiocrine signals for liver growth and survival
Lorenz, L., Axnick, J., Buschmann, T., Henning, C., Urner, S., Fang, S., Nurmi, H., Eichhorst, N., Holtmeier, R., Bódis, K., et al. (2018) · Nature · doi:10.1038/s41586-018-0522-3 · Cited by 171
Drug induced liver injury – a 2023 update
Allison, R., Guraka, A., Shawa, I. T., Tripathi, G., Moritz, W., & Kermanizadeh, A. (2023) · Journal of Toxicology and Environmental Health, Part B · doi:10.1080/10937404.2023.2261848 · Cited by 167 · cited 1×
“Detailed DILI mechanisms have been discussed in the recent review paper with a focus on idiosyncratic liver injury [115].”
BackgroundHepatic 3D spheroid models for the detection and study of compounds with cholestatic liability
Hendriks, D. F. G., Fredriksson Puigvert, L., Messner, S., Mortiz, W., & Ingelman-Sundberg, M. (2016) · Scientific Reports · doi:10.1038/srep35434 · Cited by 156
Standardisation needs for organ on chip devices
Piergiovanni, M., Leite, S. B., Corvi, R., & Whelan, M. (2021) · Lab on a Chip · doi:10.1039/d1lc00241d · Cited by 155
Baudy, A. R., Otieno, M. A., Hewitt, P., Gan, J., Roth, A., Keller, D., Sura, R., Van Vleet, T. R., & Proctor, W. R. (2020) · Lab on a Chip · doi:10.1039/c9lc00768g · Cited by 150 · cited 5×
“More-over, the stable expression of phase I and phase II metabolic enzymes and drug-relevant uptake and efflux transporters should be maintained and match the levels reported in freshly thawed hepatocytes [34,35].”
BackgroundMethodInfluentialOn being the right size: scaling effects in designing a human-on-a-chip
Moraes, C., Labuz, J. M., Leung, B. M., Inoue, M., Chun, T.-H., & Takayama, S. (2013) · Integrative Biology · doi:10.1039/c3ib40040a · Cited by 134
Scalable production of tissue-like vascularized liver organoids from human PSCs
Harrison, S. P., Siller, R., Tanaka, Y., Chollet, M. E., de la Morena-Barrio, M. E., Xiang, Y., Patterson, B., Andersen, E., Bravo-Pérez, C., Kempf, H., et al. (2023) · Experimental & Molecular Medicine · doi:10.1038/s12276-023-01074-1 · Cited by 119 · cited 1×
“Recently, Harrison et al. demonstrated that induced pluripotent stem cells derived liver organoids contained the non-parenchymal population including kupffer cells, cholangiocyte and stellate cells [69].”
BackgroundFoster, A. J., Chouhan, B., Regan, S. L., Rollison, H., Amberntsson, S., Andersson, L. C., Srivastava, A., Darnell, M., Cairns, J., Lazic, S. E., et al. (2019) · Archives of Toxicology · doi:10.1007/s00204-019-02427-4 · Cited by 117 · cited 1×
“Their findings indicated comparable DILI sensitivity across both platforms [119].”
In vitro grafting of hepatic spheroids and organoids on a microfluidic vascular bed
Bonanini, F., Kurek, D., Previdi, S., Nicolas, A., Hendriks, D., de Ruiter, S., Meyer, M., Clapés Cabrer, M., Dinkelberg, R., García, S. B., et al. (2022) · Angiogenesis · doi:10.1007/s10456-022-09842-9 · Cited by 112
Fowler, S., Chen, W. L. K., Duignan, D. B., Gupta, A., Hariparsad, N., Kenny, J. R., Lai, W. G., Liras, J., Phillips, J. A., & Gan, J. (2020) · Lab on a Chip · doi:10.1039/c9lc00857h · Cited by 109 · cited 3×
“Besides, we also compare the functional parameters of these models against the standard guidelines given by pharmaceutical industries (IQ-MPS) [34,35].”
BackgroundMethodHemodynamic flow improves rat hepatocyte morphology, function, and metabolic activity in vitro
Dash, A., Simmers, M. B., Deering, T. G., Berry, D. J., Feaver, R. E., Hastings, N. E., Pruett, T. L., LeCluyse, E. L., Blackman, B. R., & Wamhoff, B. R. (2013) · American Journal of Physiology-Cell Physiology · doi:10.1152/ajpcell.00331.2012 · Cited by 108
Niiya, T., Murakami, M., Aoki, T., Murai, N., Shimizu, Y., & Kusano, M. (1999) · Journal of Hepato-Biliary-Pancreatic Surgery · doi:10.1007/s005340050118 · Cited by 96 · cited 1×
“Increased blood flow after partial hepatectomy leads to hepatocyte proliferation and regeneration in mice, as shown by previous report [45].”
ResultTowards in vitro models for reducing or replacing the use of animals in drug testing
Stresser, D. M., Kopec, A. K., Hewitt, P., Hardwick, R. N., Van Vleet, T. R., Mahalingaiah, P. K. S., O’Connell, D., Jenkins, G. J., David, R., Graham, J., et al. (2023) · Nature Biomedical Engineering · doi:10.1038/s41551-023-01154-7 · Cited by 94 · cited 1×
“Recently published IQ-MPS survey results highlighted that the majority of the companies used liver-on-chips for mechanistic studies and internal decision process [30, 31].”
BackgroundIn vitro metabolic zonation through oxygen gradient on a chip
Tonon, F., Giobbe, G. G., Zambon, A., Luni, C., Gagliano, O., Floreani, A., Grassi, G., & Elvassore, N. (2019) · Scientific Reports · doi:10.1038/s41598-019-49412-6 · Cited by 76 · cited 1×
“…survival and functional activity of hepatocytes [21,22], (2) accumulation of cell-secreted molecules (for autocrine and paracrine signaling) due to low volume to cell ratio in microchannels [23], and (3) various gradients including oxygen gradient to maintain in vivo-like metabolic conditions [24].”
BackgroundLiver three-dimensional cellular models for high-throughput chemical testing
Yang, S., Ooka, M., Margolis, R. J., & Xia, M. (2023) · Cell Reports Methods · doi:10.1016/j.crmeth.2023.100432 · Cited by 75 · cited 2×
“Furthermore, evaluation of the LoC studies with standard guidelines (IQ-MPS) was lacking in the previous reports [38 – 41].”
MethodMaass, C., Stokes, C. L., Griffith, L. G., & Cirit, M. (2017) · Integrative Biology · doi:10.1039/c6ib00243a · Cited by 72
Sung, J. H., Wang, Y., & Shuler, M. L. (2019) · APL Bioengineering · doi:10.1063/1.5097675 · Cited by 66
Kostrzewski, T., Snow, S., Battle, A. L., Peel, S., Ahmad, Z., Basak, J., Surakala, M., Bornot, A., Lindgren, J., Ryaboshapkina, M., et al. (2021) · Communications Biology · doi:10.1038/s42003-021-02616-x · Cited by 52 · cited 1×
“Furthermore, co-culturing in LoC with stellate cells and kupffer cells is also required for making disease models of NASH [120].”
BackgroundArakawa, H., Sugiura, S., Kawanishi, T., Shin, K., Toyoda, H., Satoh, T., Sakai, Y., Kanamori, T., & Kato, Y. (2020) · Lab on a Chip · doi:10.1039/c9lc00884e · Cited by 48 · cited 1×
“Arakawa et al. used a liver-gut system to predict concentration profiles of phase I and phase II metabolites of triazolam in humans, which closely matched the reported human plasma profiles [136].”
BackgroundMicrophysiological Systems Evaluation: Experience of TEX-VAL Tissue Chip Testing Consortium
Rusyn, I., Sakolish, C., Kato, Y., Stephan, C., Vergara, L., Hewitt, P., Bhaskaran, V., Davis, M., Hardwick, R. N., Ferguson, S. S., et al. (2022) · Toxicological Sciences · doi:10.1093/toxsci/kfac061 · Cited by 43 · cited 5×
“Additionally, the shear stresses applied to cellular systems are far from the physiologically relevant values in most of the cases [144].”
BackgroundMethodInfluentialKang, S. G., Choi, Y. Y., Mo, S. J., Kim, T. H., Ha, J. H., Hong, D. K., Lee, H., Park, S. D., Shim, J.-J., Lee, J.-L., et al. (2023) · Nano Convergence · doi:10.1186/s40580-022-00350-6 · Cited by 37 · cited 1×
“Recently, co-culture with gut microbiome enhanced albumin and urea secretion activity of HepG2 spheroids on a chip [155].”
BackgroundYang, J., Hirai, Y., Imamura, S., Tsuchiya, T., Tabata, O., & Kamei, K.-I. (2022) · doi:10.1101/2022.01.31.478467 · Cited by 21 · cited 1×
“Apart from bioavailability prediction, the liver-gut system has also been applied to study various diseases such as inflammatory bowel disease [139], air pollution-related metabolic disturbances [140], nanoparticle-induced liver injury [141], and hepatic steatosis [142].”
BackgroundA similarity scaling approach for organ-on-chip devices
Feng, J. J., & Hedtrich, S. (2022) · Lab on a Chip · doi:10.1039/d2lc00641c · Cited by 13 · cited 2×
“Contrary to the functional approaches, Feng et al. demonstrated a similarity scaling approach based on π -theorem, which is used widely in the mechanical engineering domain [106].”
Method
Cited by
Liver organoids: Current advances and future applications for hepatology
Kim, Y., Kang, M., Mamo, M. G., Adisasmita, M., Huch, M., & Choi, D. (2025) · Clinical and Molecular Hepatology · doi:10.3350/cmh.2024.1040 · Cited by 26
Myszczyszyn, A., Muench, A., Lehmann, V., Sinnige, T., van Steenbeek, F. G., Bouwmeester, M., Samsom, R.-A., Keuper-Navis, M., van der Made, T. K., Kogan, D., et al. (2025) · Biofabrication · doi:10.1088/1758-5090/adc3ce · Cited by 14
(2026) · doi:10.3389/fphar.2026.1769883 · Cited by 1
Metadata
- Authors
- Mehta, V., Karnam, G., & Madgula, V.
- Venue
- Materials Today Bio
- Publisher
- Elsevier BV
- Published
- 2024-08
- Volume
- 27
- Pages
- 101143
- ISSN
- 2590-0064 (ISSN-L)
- OpenAlex
- W4400250553
- Cited by
- 35
- References
- 57
- FWCI
- 3.68
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.