Process Analytical Technology for Advanced Process Control in Biologics Manufacturing with the Aid of Macroscopic Kinetic Modeling
Open accessThe DOI matches its Crossref record; 53 of the 54 references it cites were found in a registry or an index.
Abstract
Productivity improvements of mammalian cell culture in the production of recombinant proteins have been made by optimizing cell lines, media, and process operation. This led to enhanced titers and process robustness without increasing the cost of the upstream processing (USP); however, a downstream bottleneck remains. In terms of process control improvement, the process analytical technology (PAT) initiative, initiated by the American Food and Drug Administration (FDA), aims to measure, analyze, monitor, and ultimately control all important attributes of a bioprocess. Especially, spectroscopic methods such as Raman or near-infrared spectroscopy enable one to meet these analytical requirements, preferably in-situ. In combination with chemometric techniques like partial least square (PLS) or principal component analysis (PCA), it is possible to generate soft sensors, which estimate process variables based on process and measurement models for the enhanced control of bioprocesses. Macroscopic kinetic models can be used to simulate cell metabolism. These models are able to enhance the process understanding by predicting the dynamic of cells during cultivation. In this article, in-situ turbidity (transmission, 880 nm) and ex-situ Raman spectroscopy (785 nm) measurements are combined with an offline macroscopic Monod kinetic model in order to predict substrate concentrations. Experimental data of Chinese hamster ovary cultivations in bioreactors show a sufficiently linear correlation (R2 ≥ 0.97) between turbidity and total cell concentration. PLS regression of Raman spectra generates a prediction model, which was validated via offline viable cell concentration measurement (RMSE ≤ 13.82, R2 ≥ 0.92). Based on these measurements, the macroscopic Monod model can be used to determine different process attributes, e.g., glucose concentration. In consequence, it is possible to approximately calculate (R2 ≥ 0.96) glucose concentration based on online cell concentration measurements using turbidity or Raman spectroscopy. Future approaches will use these online substrate concentration measurements with turbidity and Raman measurements, in combination with the kinetic model, in order to control the bioprocess in terms of feeding strategies, by employing an open platform communication (OPC) network—either in fed-batch or perfusion mode, integrated into a continuous operation of upstream and downstream.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![Figure 1 Main correlations between process, state, and target variables according to [22]. In this experimental set-up green, red, and blue variables can be measured/controlled online, offline, or via a soft sensor/kinetic model, respectively (left). The target variable biomass can be measured indirectly via turbidity (linear correlation) or Raman spectroscopy (PLS). The substrate consumption, e.g., glucose, can be calculated due to the relationship between cell and substrate concentration in a macroscopic model based on Monod equations (right).](https://figures.cochat.ai/paper-figures/117b1e57671f4d11a1e33ac63c2a00d4/process-analytical-technology-for-advanced-process-control-in-biologics-figure-1.jpg)
![Figure 2 Schematic overview of the main catabolic metabolism divided into three stages, adapted from [32].](https://figures.cochat.ai/paper-figures/04521d66f0504ac5a903b648a04b0619/process-analytical-technology-for-advanced-process-control-in-biologics-figure-2.jpg)

![Figure 4 Citrate cycle, which represents the entry point into the energy metabolism, adapted from [37].](https://figures.cochat.ai/paper-figures/bb6717c8ae3549c496b021b5fc782911/process-analytical-technology-for-advanced-process-control-in-biologics-figure-4.jpg)








Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These include a Raman microscope coupled to an automated plate reader to support early-stage scale-down conditions [70], an academic study that used in-line viscosity and off-line Raman measurements as input into a Monad model of CHO cell metabolism, [71] and an off-line time-gated Raman/SERS microscopy approach coupled to a custom microwell plate for E. coli fermentations [20].”
From The role of Raman spectroscopy in biopharmaceuticals from development to manufacturing (2022) · cites this paper as [71]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Production of recombinant protein therapeutics in cultivated mammalian cells
Wurm, F. M. (2004) · Nature Biotechnology · doi:10.1038/nbt1026 · Cited by 2,032
Glutamine and glutamate—their central role in cell metabolism and function
Newsholme, P., Procopio, J., Lima, M. M. R., Pithon‐Curi, T. C., & Curi, R. (2003) · Cell Biochemistry and Function · doi:10.1002/cbf.1003 · Cited by 701 · cited 4×
“The also critical by-product ammonium (NH4) is mainly produced via the metabolism of glutamine [38,39,43].”
BackgroundInfluentialEffects of ammonia and lactate on hybridoma growth, metabolism, and antibody production
Ozturk, S. S., Riley, M. R., & Palsson, B. O. (1992) · Biotechnology and Bioengineering · doi:10.1002/bit.260390408 · Cited by 370 · cited 1×
“However, it is difficult to determine an exact threshold for the ammonium concentration, since different critical values, between 2 and 10 mM, are given in the literature [39,40,44].”
BackgroundEsmonde-White, K. A., Cuellar, M., Uerpmann, C., Lenain, B., & Lewis, I. R. (2017) · Analytical and Bioanalytical Chemistry · doi:10.1007/s00216-016-9824-1 · Cited by 332 · cited 1×
“Raman spectroscopy, in combination with chemometric analysis methods, can, for example, be used for the determination of the total or viable cell concentration, as well as for the substrate and metabolite concentration [4,20].”
MethodTrends in Upstream and Downstream Process Development for Antibody Manufacturing
Gronemeyer, P., Ditz, R., & Strube, J. (2014) · Bioengineering · doi:10.3390/bioengineering1040188 · Cited by 329
Self-citationAlt, N., Zhang, T. Y., Motchnik, P., Taticek, R., Quarmby, V., Schlothauer, T., Beck, H., Emrich, T., & Harris, R. J. (2016) · Biologicals · doi:10.1016/j.biologicals.2016.06.005 · Cited by 294 · cited 1×
“, structure, post-translational modifications, and efficacy) [7,8].”
Cell Culture Technology for Pharmaceutical and Cell-Based Therapies
(2005) · CRC Press eBooks · doi:10.1201/9780849351068 · Cited by 291 · cited 4×
“However, the reduction of pH, as well as the inhibition of cell growth and production of IgG, constitutes side-effects, resulting in the increase of lactate [37].”
BackgroundInfluentialBioreactor monitoring with spectroscopy and chemometrics: a review
Lourenço, N. D., Lopes, J. A., Almeida, C. F., Sarraguça, M. C., & Pinheiro, H. M. (2012) · Analytical and Bioanalytical Chemistry · doi:10.1007/s00216-012-6073-9 · Cited by 275 · cited 4×
“Depending on the location of the analysis, bioreactor monitoring techniques distinguish between in-situ, which can be invasive, non-invasive, or placed in a sampling loop, or ex-situ [9].”
BackgroundMethodInfluentialSoft sensors in bioprocessing: A status report and recommendations
Luttmann, R., Bracewell, D. G., Cornelissen, G., Gernaey, K. V., Glassey, J., Hass, V. C., Kaiser, C., Preusse, C., Striedner, G., & Mandenius, C. (2012) · Biotechnology Journal · doi:10.1002/biot.201100506 · Cited by 238 · cited 1×
“The combination of turbidity and/or Raman spectroscopy with a macroscopic model such as the soft sensor enables the estimation and/or prediction of process variables, which are not directly measureable [21].”
BackgroundSensor systems for bioprocess monitoring
Biechele, P., Busse, C., Solle, D., Scheper, T., & Reardon, K. (2015) · Engineering in Life Sciences · doi:10.1002/elsc.201500014 · Cited by 224
Process analytical technologies in the pharmaceutical industry: the FDA’s PAT initiative
Hinz, D. C. (2006) · Analytical and Bioanalytical Chemistry · doi:10.1007/s00216-005-3394-y · Cited by 206
Lactate metabolism shift in CHO cell culture: the role of mitochondrial oxidative activity
Zagari, F., Jordan, M., Stettler, M., Broly, H., & Wurm, F. M. (2013) · New Biotechnology · doi:10.1016/j.nbt.2012.05.021 · Cited by 202 · cited 2×
“The consumption of lactate is observed during the stationary phase upon depletion of glutamine and is desirable, since it seems to correlate to improved optimal process performance [42].”
BackgroundAdvances in on-line monitoring and control of mammalian cell cultures: Supporting the PAT initiative
Teixeira, A. P., Oliveira, R., Alves, P. M., & Carrondo, M. J. T. (2009) · Biotechnology Advances · doi:10.1016/j.biotechadv.2009.05.003 · Cited by 193 · cited 2×
“However, the analysis and interpretation of spectral data can be complex, and the correlation between responses and factors may not always be obvious [13].”
BackgroundZhou, M., Crawford, Y., Ng, D., Tung, J. K., Pynn, A. F. J., Meier, A., Yuk, I. H. Y., Vijayasankaran, N., Leach, K., Joly, J. C., et al. (2011) · Journal of Biotechnology · doi:10.1016/j.jbiotec.2011.03.003 · Cited by 190
Sommerfeld, S., & Strube, J. (2005) · Chemical Engineering and Processing: Process Intensification · doi:10.1016/j.cep.2005.03.006 · Cited by 186
Self-citationApplications of Raman Spectroscopy in Biopharmaceutical Manufacturing: A Short Review
Buckley, K., & Ryder, A. G. (2017) · Applied Spectroscopy · doi:10.1177/0003702817703270 · Cited by 160 · cited 1×
“Methods are available that can acquire spectra and integrate them into PLS models, resulting in the online determination of viable cell, substrate, and metabolite concentrations [46,47].”
BackgroundIn‐situ near infrared spectroscopy to monitor key analytes in mammalian cell cultivation
Arnold, S. A., Crowley, J., Woods, N., Harvey, L. M., & McNeil, B. (2003) · Biotechnology and Bioengineering · doi:10.1002/bit.10738 · Cited by 149
Berry, B., Moretto, J., Matthews, T., Smelko, J., & Wiltberger, K. (2015) · Biotechnology Progress · doi:10.1002/btpr.2035 · Cited by 142
Catabolic Control of Mammalian Cell Culture
Glacken, M. W. (1988) · Nature Biotechnology · doi:10.1038/nbt0988-1041 · Cited by 140 · cited 3×
“As a result, the basic energy requirement for maintaining the organism increases significantly and can therefore no longer be used for the proliferation or production of the antibody [36].”
BackgroundInfluentialdel Val, I. J., Kontoravdi, C., & Nagy, J. M. (2010) · Biotechnology Progress · doi:10.1002/btpr.470 · Cited by 139 · cited 1×
“, structure, post-translational modifications, and efficacy) [7,8].”
Andersen, D. C., & Goochee, C. F. (1995) · Biotechnology and Bioengineering · doi:10.1002/bit.260470112 · Cited by 120 · cited 3×
“The also critical by-product ammonium (NH4) is mainly produced via the metabolism of glutamine [38,39,43].”
BackgroundFluorescence Spectroscopy and Chemometric Modeling for Bioprocess Monitoring
Faassen, S., & Hitzmann, B. (2015) · Sensors · doi:10.3390/s150510271 · Cited by 120 · cited 1×
“Techniques such as Principal Component Analysis (PCA), Principal Components Regression (PCR), and Partial Least Squares Regression (PLS) are used in order to describe the correlation between responses and factors, especially in spectral data [4,9,14,15].”
MethodModeling kinetics of a large‐scale fed‐batch CHO cell culture by Markov chain Monte Carlo method
Xing, Z., Bishop, N., Leister, K. J., & Li, Z. J. (2009) · Biotechnology Progress · doi:10.1002/btpr.284 · Cited by 107 · cited 12×
“8 mM [49] KDamm Monod constant ammonium for death 6.”
BackgroundMethodInfluentialModelling of Mammalian Cells and Cell Culture Processes
Sidoli, F. R., Mantalaris, A., & Asprey, S. P. (2004) · Cytotechnology · doi:10.1023/b:cyto.0000043397.94527.84 · Cited by 104 · cited 1×
“Macroscopic kinetic models are being used in order to simulate the cellular state and productivity in-silico [23,24,29,49].”
MethodOptimization of Parameter Selection for Partial Least Squares Model Development
Zhao, N., Wu, Z.-S., Zhang, Q., Shi, X.-Y., Ma, Q., & Qiao, Y.-J. (2015) · Scientific Reports · doi:10.1038/srep11647 · Cited by 90 · cited 1×
“By increasing the range of these validation data sets it is possible to reduce the model error significantly [48].”
BackgroundBhatia, H., Mehdizadeh, H., Drapeau, D., & Yoon, S. (2018) · Engineering in Life Sciences · doi:10.1002/elsc.201700084 · Cited by 87 · cited 1×
“Methods are available that can acquire spectra and integrate them into PLS models, resulting in the online determination of viable cell, substrate, and metabolite concentrations [46,47].”
BackgroundRhiel, M., Ducommun, P., Bolzonella, I., Marison, I., & von Stockar, U. (2002) · Biotechnology and Bioengineering · doi:10.1002/bit.10134 · Cited by 83
Macroscopic modeling of mammalian cell growth and metabolism
Yahia, B. B., Malphettes, L., & Heinzle, E. (2015) · Applied Microbiology and Biotechnology · doi:10.1007/s00253-015-6743-6 · Cited by 81 · cited 4×
“According to [23], the relationship between input (e.”
BackgroundMethodInfluentialJang, J. D., & Barford, J. P. (2000) · Biochemical Engineering Journal · doi:10.1016/s1369-703x(99)00041-8 · Cited by 81
Goudar, C. T., Joeris, K., Konstantinov, K. B., & Piret, J. M. (2008) · Biotechnology Progress · doi:10.1021/bp050018j · Cited by 78
Continuous Biomanufacturing ‐ Innovative Technologies and Methods
Subramanian, G. (2017) · Wiley eBooks · doi:10.1002/9783527699902 · Cited by 77
Hong, J. K., Cho, S. M., & Yoon, S. K. (2010) · Applied Microbiology and Biotechnology · doi:10.1007/s00253-010-2790-1 · Cited by 69 · cited 2×
“The also critical by-product ammonium (NH4) is mainly produced via the metabolism of glutamine [38,39,43].”
BackgroundCHO gene expression profiling in biopharmaceutical process analysis and design
Schaub, J., Clemens, C., Schorn, P., Hildebrandt, T., Rust, W., Mennerich, D., Kaufmann, H., & Schulz, T. W. (2010) · Biotechnology and Bioengineering · doi:10.1002/bit.22549 · Cited by 63
Host Cell Proteins in Biologics Manufacturing: The Good, the Bad, and the Ugly
Kornecki, M., Mestmäcker, F., Zobel‐Roos, S., de Figueiredo, L. H., Schlüter, H., & Strube, J. (2017) · Antibodies · doi:10.3390/antib6030013 · Cited by 58
Self-citationCraven, S., Shirsat, N., Whelan, J., & Glennon, B. (2013) · Biotechnology Progress · doi:10.1002/btpr.1664 · Cited by 57 · cited 2×
“Literature data were determined using fed-batch CHO cell culture and the markov chain monte carlo method for parameter estimation [49] or by the differential evolution technique [50].”
MethodXing, Z., Li, Z., Chow, V., & Lee, S. S. (2008) · Biotechnology Progress · doi:10.1021/bp070466m · Cited by 52 · cited 1×
“However, it is difficult to determine an exact threshold for the ammonium concentration, since different critical values, between 2 and 10 mM, are given in the literature [39,40,44].”
BackgroundDesign and Operation of Continuous Countercurrent Chromatography in Biotechnological Production
Zobel‐Roos, S., Helling, C., Ditz, R., & Strube, J. (2014) · Industrial & Engineering Chemistry Research · doi:10.1021/ie403103c · Cited by 50
Self-citationSchaub, J., Clemens, C., Kaufmann, H., & Schulz, T. W. (2011) · Springer eBooks · doi:10.1007/10_2010_98 · Cited by 48
Advanced Process and Control Strategies for Bioreactors
Pörtner, R., Barradas, O. P., Frahm, B., & Hass, V. C. (2016) · Elsevier eBooks · doi:10.1016/b978-0-444-63663-8.00016-1 · Cited by 45 · cited 1×
“This makes turbidity sensors a viable monitoring and controlling technique for bioprocesses [16,18] (especially for continuous bioprocessing, e.”
MethodKonakovsky, V., Clemens, C., Müller, M., Bechmann, J., Berger, M., Schlatter, S., & Herwig, C. (2016) · Bioengineering · doi:10.3390/bioengineering3010005 · Cited by 44
What can mathematical modelling say about CHO metabolism and protein glycosylation?
Galleguillos, S. N., Ruckerbauer, D., Gerstl, M. P., Borth, N., Hanscho, M., & Zanghellini, J. (2017) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2017.01.005 · Cited by 44 · cited 1×
“Metabolic networks, however, represent a more detailed image of the cell [30].”
BackgroundHuang, Z., Lee, D., & Yoon, S. (2017) · Biotechnology and Bioengineering · doi:10.1002/bit.26384 · Cited by 39 · cited 2×
“However, the construction of such models is more time consuming than empirical observations, if reaction and flux rates of metabolic pathways are experimentally determined using metabolomics and not adapted from literature [31].”
BackgroundSoft sensor for monitoring biomass subpopulations in mammalian cell culture processes
Kröll, P., Stelzer, I. V., & Herwig, C. (2017) · Biotechnology Letters · doi:10.1007/s10529-017-2408-0 · Cited by 34 · cited 3×
“This makes turbidity sensors a viable monitoring and controlling technique for bioprocesses [16,18] (especially for continuous bioprocessing, e.”
BackgroundMethodKlein, T., Heinzel, N., Kröll, P., Brunner, M., Herwig, C., & Neutsch, L. (2015) · Journal of Biotechnology · doi:10.1016/j.jbiotec.2015.04.021 · Cited by 33 · cited 2×
“Regarding the productivity of secondary metabolites or recombinant proteins like monoclonal antibodies in the stationary phase of a (fed‐)batch culture, the cellular state of the culture, and therefore its viability, is of utmost importance [45].”
BackgroundZobel-Roos, S., Mouellef, M., Siemers, C., & Strube, J. (2017) · Antibodies · doi:10.3390/antib6040024 · Cited by 31
Self-citationSegmented linear modeling of CHO fed‐batch culture and its application to large scale production
Yahia, B. B., Gourévitch, B., Malphettes, L., & Heinzle, E. (2016) · Biotechnology and Bioengineering · doi:10.1002/bit.26214 · Cited by 27
Biochemie und Molekularbiologie: Eine Einführung in 40 Lerneinheiten
Christen, P., Jaussi, R., & Benoit, R. (2015) · Springer eBooks · doi:10.1007/978-3-662-46430-4 · Cited by 25 · cited 2×
“Schematic overview of the main catabolic metabolism divided into three stages, adapted from [32].”
BackgroundMusmann, C., Joeris, K., Markert, S., Solle, D., & Scheper, T. H. (2016) · Engineering in Life Sciences · doi:10.1002/elsc.201500122 · Cited by 23 · cited 3×
“Techniques such as Principal Component Analysis (PCA), Principal Components Regression (PCR), and Partial Least Squares Regression (PLS) are used in order to describe the correlation between responses and factors, especially in spectral data [4,9,14,15].”
BackgroundMethodComputer programs for modeling mammalian cell batch and fed-batch cultures using logistic equations
Goudar, C. T. (2012) · Cytotechnology · doi:10.1007/s10616-011-9425-y · Cited by 14
Robust parameter estimation during logistic modeling of batch and fed‐batch culture kinetics
Goudar, C. T., Konstantinov, K. B., & Piret, J. M. (2009) · Biotechnology Progress · doi:10.1002/btpr.154 · Cited by 13
Integration of Upstream and Downstream in Continuous Biomanufacturing
Gronemeyer, P., Thiess, H., Zobel‐Roos, S., Ditz, R., & Strube, J. (2017) · Wiley eBooks · doi:10.1002/9783527699902.ch17 · Cited by 11
Self-citationPresent Status of Automation for Industrial Bioprocesses
Hausmann, R., Henkel, M., Hecker, F. T., & Hitzmann, B. (2016) · Elsevier eBooks · doi:10.1016/b978-0-444-63663-8.00025-2 · Cited by 10 · cited 1×
“Inline turbidity measurement techniques distinguish between transmission, absorption, reflection, or light scattering [2,17].”
BackgroundProcess parameters impacting product quality
Bechmann, J., Rudolph, F., Gebert, L., Schaub, J., Greulich, B., Dieterle, M., & Bradl, H. (2015) · BMC Proceedings · doi:10.1186/1753-6561-9-s9-o7 · Cited by 6
Research works printed but not linked: 1
- Otto M. Chemometrics. Statistics and Computer Application in Analytical Chemistry 3rd ed. Wiley-VCH Verlag GmbH et Co. KGaA Weinheim, Germany 2017
Cited by
Tripathi, N. K., & Shrivastava, A. (2019) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2019.00420 · Cited by 575
“The implementation of Quality by Design (QbD) and process analytical technologies (PAT) tools has improved biopharmaceutical production strategies (Kornecki and Strube, 2018; Shekhawat et al., 2019).”
MethodProcess Analytical Technologies – Advances in bioprocess integration and future perspectives
Gerzon, G., Sheng, Y., & Kirkitadze, M. (2022) · Journal of Pharmaceutical and Biomedical Analysis · doi:10.1016/j.jpba.2021.114379 · Cited by 176
The role of Raman spectroscopy in biopharmaceuticals from development to manufacturing
Esmonde-White, K. A., Cuellar, M., & Lewis, I. R. (2022) · Analytical and Bioanalytical Chemistry · doi:10.1007/s00216-021-03727-4 · Cited by 152
Bioprocess Control: Current Progress and Future Perspectives
Rathore, A. S., Mishra, S., Nikita, S., & Priyanka, P. (2021) · Life · doi:10.3390/life11060557 · Cited by 141
Bioreactor control systems in the biopharmaceutical industry: a critical perspective
Mitra, S., & Murthy, G. S. (2021) · Systems Microbiology and Biomanufacturing · doi:10.1007/s43393-021-00048-6 · Cited by 136
Metadata
- Authors
- Kornecki, M., & Strube, J.
- Affiliations
- Clausthal University of Technology (DE)
- Corresponding author
- Strube, Jochen
- ORCID
- Strube, Jochen
- Venue
- Bioengineering
- Publisher
- MDPI AG
- Published
- 2018-03-16
- Volume
- 5
- Issue
- 1
- Pages
- 25
- ISSN
- 2306-5354 (ISSN-L)
- PMC
- PMC5874891
- OpenAlex
- W2793216914
- Cited by
- 61
- References
- 54
- Citations by year
- 2026: 4 · 2025: 8 · 2024: 3 · 2023: 7 · 2022: 6 · 2021: 14 · 2020: 9 · 2019: 6 · 2018: 4
- FWCI
- 2.94
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Bioengineering (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Publikationsserver der Technischen Universität Clausthal (submittedVersion, cc-by)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Viral Infectious Diseases and Gene Expression in Insects
- Physical Sciences › Chemistry › Analytical Chemistry › Spectroscopy and Chemometric Analyses
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Biophysics › Spectroscopy Techniques in Biomedical and Chemical Research
- Keywords
- process analytical technology, bioprocess control, Raman spectroscopy, near-infrared spectroscopy, turbidity measurement, soft sensors, Monod kinetics, partial least squares regression, CHO cells, recombinant protein expression, glucose concentration prediction, fed-batch bioreactor, perfusion bioreactor
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.