OptORF: Optimal metabolic and regulatory perturbations for metabolic engineering of microbial strains
Open accessThe DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Computational modeling and analysis of metabolic networks has been successful in metabolic engineering of microbial strains for valuable biochemical production. Limitations of currently available computational methods for metabolic engineering are that they are often based on reaction deletions rather than gene deletions and do not consider the regulatory networks that control metabolism. Due to the presence of multi-functional enzymes and isozymes, computational designs based on reaction deletions can sometimes result in strategies that are genetically complicated or infeasible. Additionally, strains might not be able to grow initially due to regulatory restrictions. To overcome these limitations, we have developed a new approach (OptORF) for identifying metabolic engineering strategies based on gene deletion and overexpression. RESULTS: Here we propose an effective method to systematically integrate transcriptional regulatory networks and metabolic networks. This allows for the formulation of linear optimization problems that search for metabolic and/or regulatory perturbations that couple biomass and biochemical production, thus proposing adaptive evolutionary strain designs. Using genome-scale models of Escherichia coli, we have implemented the OptORF algorithm (which considers gene deletions and transcriptional regulation) and compared its metabolic engineering strategies for ethanol production to those found using OptKnock (which considers reaction deletions). Our results found that the reaction-based strategies often require more gene deletions to remove the identified reactions (2 more genes than reactions), and result in lethal growth phenotypes when transcriptional regulation is considered (162 out of 200 cases). Finally, we present metabolic engineering strategies for producing ethanol and higher alcohols (e.g. isobutanol) in E. coli using our OptORF approach. We have found common genetic modifications such as deletion of pgi and overexpression of edd, as well as chemical specific strategies for producing different alcohols. CONCLUSIONS: By taking regulatory effects into account, OptORF can propose changes such as the overexpression of metabolic genes or deletion of transcriptional factors, in addition to the deletion of metabolic genes, that may lead to faster evolutionary trajectories. While biofuel production in E. coli is evaluated here, the developed OptORF approach is general and can be applied to optimize the production of different compounds in other biological systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Construction of Escherichia coli K‐12 in‐frame, single‐gene knockout mutants: the Keio collection
Baba, T., Ara, T., Hasegawa, M., Takai, Y., Okumura, Y., Baba, M., Datsenko, K. A., Tomita, M., Wanner, B. L., & Mori, H. (2006) · Molecular Systems Biology · doi:10.1038/msb4100050 · Cited by 7,858 · cited 1×
“An integrated model is also capable of predicting essential transcription factors (e.g. cysB and metR ) as well as metabolic genes in E. coli [19,24,25].”
BackgroundNon-fermentative pathways for synthesis of branched-chain higher alcohols as biofuels
Atsumi, S., Hanai, T., & Liao, J. C. (2008) · Nature · doi:10.1038/nature06450 · Cited by 1,945 · cited 2×
“Since E. coli does not naturally produce these higher alcohols, we have augmented the iMC1010 v2 network with non-fermentative reactions and corresponding GPR associations for synthesis of these alcohols based on a recent study [20].”
BackgroundMethodFaith, J. J., Hayete, B., Thaden, J. T., Mogno, I., Wierzbowski, J., Cottarel, G., Kasif, S., Collins, J. J., & Gardner, T. S. (2007) · PLoS Biology · doi:10.1371/journal.pbio.0050008 · Cited by 1,563 · cited 1×
“The number of microbial transcriptional regulatory network models continues to grow, which has been enabled by high-throughput datasets and computational analysis [46-52].”
BackgroundFeist, A. M., Henry, C. S., Reed, J. L., Krummenacker, M., Joyce, A. R., Karp, P. D., Broadbelt, L. J., Hatzimanikatis, V., & Palsson, B. Ø. (2007) · Molecular Systems Biology · doi:10.1038/msb4100155 · Cited by 1,383 · cited 1×
“For example, the most recent metabolic reconstruction of E. coli K-12 MG1655 [23] includes 2,381 reactions, but only 1,260 ORFs are accounted for.”
BackgroundSelf-citationAnalysis of optimality in natural and perturbed metabolic networks
Segrè, D., Vitkup, D., & Church, G. M. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.232349399 · Cited by 1,362
Burgard, A. P., Pharkya, P., & Maranas, C. D. (2003) · Biotechnology and Bioengineering · doi:10.1002/bit.10803 · Cited by 1,256 · cited 2×
“Some computational methods, such as OptKnock [8], identify knockout strains that would have improved biochemical production capabilities after undergoing adaptive evolution.”
MethodInferring Genetic Networks and Identifying Compound Mode of Action via Expression Profiling
Gardner, T. S., di Bernardo, D., Lorenz, D., & Collins, J. J. (2003) · Science · doi:10.1126/science.1081900 · Cited by 1,117 · cited 1×
“A previous study has shown that the behavior of a transcriptional regulatory network can be well approximated by a system of linear equations near a steady-state, where gene expression does not substantially change [41].”
BackgroundVarma, A., & Palsson, B. O. (1994) · Applied and Environmental Microbiology · doi:10.1128/aem.60.10.3724-3731.1994 · Cited by 1,051 · cited 2×
“Although the use of Boolean variables do not exactly represent the dynamic nature of metabolism and regulation, it has been previously shown that constraint-based models using these approximations successfully predict the cellular behavior in continuous and batch culture [1,19,21,24].”
MethodInfluentialAn expanded genome-scale model of Escherichia coli K-12 (iJR904 GSM/GPR)
Reed, J. L., Vo, T. D., Schilling, C. H., & Palsson, B. O. (2003) · Genome Biology · doi:10.1186/gb-2003-4-9-r54 · Cited by 999 · cited 1×
“Using genome-scale metabolic and regulatory models of E. coli [18,19], we have identified metabolic engineering strategies for ethanol production using Opt-Knock (which considers reaction deletions) and compared these strategies to those found using our new approach OptORF (which considers gene…”
MethodSelf-citationIntegrating high-throughput and computational data elucidates bacterial networks
Covert, M. W., Knight, E. M., Reed, J. L., Herrgard, M. J., & Palsson, B. O. (2004) · Nature · doi:10.1038/nature02456 · Cited by 792 · cited 5×
“Although the use of Boolean variables do not exactly represent the dynamic nature of metabolism and regulation, it has been previously shown that constraint-based models using these approximations successfully predict the cellular behavior in continuous and batch culture [1,19,21,24].”
BackgroundMethodInfluentialSelf-citationSystematic evaluation of objective functions for predicting intracellular fluxes in Escherichia coli
Schuetz, R., Kuepfer, L., & Sauer, U. (2007) · Molecular Systems Biology · doi:10.1038/msb4100162 · Cited by 677 · cited 1×
“Computational models of metabolism have been successful in predicting the consequences of gene deletions at a systems level [1-4].”
BackgroundNetwork-based prediction of human tissue-specific metabolism
Shlomi, T., Cabili, M. N., Herrgård, M. J., Palsson, B. Ø., & Ruppin, E. (2008) · Nature Biotechnology · doi:10.1038/nbt.1487 · Cited by 637 · cited 1×
“The OptORF approach could be improved by applying these linear approximations in the regulatory part of the model, in order to describe varying gene expression levels, and using approaches to constrain metabolic fluxes based on predicted gene expression levels [42-44].”
MethodPark, J. H., Lee, K. H., Kim, T. Y., & Lee, S. Y. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0702609104 · Cited by 592 · cited 1×
“In Escherichia coli, genome-scale models of metabolic networks have been used to identify metabolic engineering strategies such as gene deletions or additions to maximize production of primary or secondary metabolites [5-7].”
MethodThe growing scope of applications of genome-scale metabolic reconstructions using Escherichia coli
Feist, A. M., & Palsson, B. Ø. (2008) · Nature Biotechnology · doi:10.1038/nbt1401 · Cited by 545 · cited 1×
“As such, it will have impacts on the biological production of a wide variety of products, ranging from biofuels and other commodity chemicals to specialty chemicals [ 53-55 ].”
BackgroundOptStrain: A computational framework for redesign of microbial production systems
Pharkya, P., Burgard, A. P., & Maranas, C. D. (2004) · Genome Research · doi:10.1101/gr.2872004 · Cited by 497
Regulatory on/off minimization of metabolic flux changes after genetic perturbations
Shlomi, T., Berkman, O., & Ruppin, E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0406346102 · Cited by 458 · cited 1×
“at a systems level [1-4].”
Evolutionary programming as a platform for in silico metabolic engineering
Patil, K. R., Rocha, I., Förster, J., & Nielsen, J. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-308 · Cited by 456 · cited 1×
“A number of variations on Opt-Knock have appeared recently which use alternative search algorthims, add non-native pathways, and consider deviations from wildtype flux levels [5,11,12].”
BackgroundAlper, H., Miyaoku, K., & Stephanopoulos, G. (2005) · Nature Biotechnology · doi:10.1038/nbt1083 · Cited by 433 · cited 1×
“In Escherichia coli , genome-scale models of metabolic networks have been used to identify metabolic engineering strategies such as gene deletions or additions to maximize production of primary or secondary metabolites [5-7].”
MethodColijn, C., Brandes, A., Zucker, J., Lun, D. S., Weiner, B., Farhat, M. R., Cheng, T.-Y., Moody, D. B., Murray, M., & Galagan, J. E. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000489 · Cited by 430 · cited 1×
“The OptORF approach could be improved by applying these linear approximations in the regulatory part of the model, in order to describe varying gene expression levels, and using approaches to constrain metabolic fluxes based on predicted gene expression levels [42-44].”
MethodEngineering for biofuels: exploiting innate microbial capacity or importing biosynthetic potential?
Alper, H., & Stephanopoulos, G. (2009) · Nature Reviews Microbiology · doi:10.1038/nrmicro2186 · Cited by 389 · cited 1×
“As such, it will have impacts on the biological production of a wide variety of products, ranging from biofuels and other commodity chemicals to specialty chemicals [53-55].”
BackgroundHerring, C. D., Raghunathan, A., Honisch, C., Patel, T., Applebee, M. K., Joyce, A. R., Albert, T. J., Blattner, F. R., van den Boom, D., Cantor, C. R., et al. (2006) · Nature Genetics · doi:10.1038/ng1906 · Cited by 381 · cited 1×
“Given that a finite number of mutations are found in adaptively evolved strains [38], it seems likely that cells could get stuck in a local maxima in the fitness landscape, where they would need to change the regulation of multiple gene products to improve fitness.”
BackgroundIn silico design and adaptive evolution of Escherichia coli for production of lactic acid
Fong, S. S., Burgard, A. P., Herring, C. D., Knight, E. M., Blattner, F. R., Maranas, C. D., & Palsson, B. O. (2005) · Biotechnology and Bioengineering · doi:10.1002/bit.20542 · Cited by 363 · cited 4×
“First, previously experimentally implemented E. coli strains designed for lactate production [9] were re-assessed using the integrated metabolic and regulatory models.”
MethodInfluentialTranscriptional Regulation in Constraints-based Metabolic Models of Escherichia coli
Covert, M. W., & Palsson, B. Ø. (2002) · Journal of Biological Chemistry · doi:10.1074/jbc.m201691200 · Cited by 339 · cited 1×
“These Boolean relationships can be effectively formulated as linear constraints using binary variables and matrices, which are more systematic and/or computationally efficient than previously suggested formulations for modeling GPR associations and integrating metabolic and regulatory models [ 13-17 ].”
MethodPharkya, P., & Maranas, C. D. (2006) · Metabolic Engineering · doi:10.1016/j.ymben.2005.08.003 · Cited by 327 · cited 4×
“Notable differences from the previously reported strain designs [12] are that these strategies include the deletion of transcription factors (e.g. Fnr, ArcA, or GntR) and electron transport chain components (e.g. NDH-1) as well as overexpression of metabolic genes (e.g. edd or fbp ).”
BackgroundMethodResultInfluentialGosset, G. (2005) · Microbial Cell Factories · doi:10.1186/1475-2859-4-14 · Cited by 302
Fong, S. S., & Palsson, B. Ø. (2004) · Nature Genetics · doi:10.1038/ng1432 · Cited by 296 · cited 4×
“Although the use of Boolean variables do not exactly represent the dynamic nature of metabolism and regulation, it has been previously shown that constraint-based models using these approximations successfully predict the cellular behavior in continuous and batch culture [1,19,21,24].”
BackgroundMethodInfluentialMinimal Escherichia coli Cell for the Most Efficient Production of Ethanol from Hexoses and Pentoses
Trinh, C. T., Unrean, P., & Srienc, F. (2008) · Applied and Environmental Microbiology · doi:10.1128/aem.02708-07 · Cited by 278 · cited 1×
“Some of the gene deletions presented here have been used previously to engineer un-evolved and evolved strains of E. coli for ethanol production [26,37].”
BackgroundFong, S. S., Joyce, A. R., & Palsson, B. Ø. (2005) · Genome Research · doi:10.1101/gr.3832305 · Cited by 265 · cited 1×
“The simulation conditions were the same as the ethanol case. ferent end points, and in some cases achieve only sub-optimal behaviors [9,39,40].”
MethodExperimental and Computational Assessment of Conditionally Essential Genes in Escherichia coli
Joyce, A. R., Reed, J. L., White, A., Edwards, R., Osterman, A., Baba, T., Mori, H., Lesely, S. A., Palsson, B. Ø., & Agarwalla, S. (2006) · Journal of Bacteriology · doi:10.1128/jb.00740-06 · Cited by 265 · cited 2×
“cysB and metR) as well as metabolic genes in E. coli [19, 24 ,25].”
BackgroundMethodSelf-citationMethylglyoxal production in bacteria: suicide or survival?
Ferguson, G. P., Tötemeyer, S., MacLean, M. J., & Booth, I. R. (1998) · Archives of Microbiology · doi:10.1007/s002030050635 · Cited by 262 · cited 1×
“A ΔtpiA mutant alone could cause meth-ylglyoxal accumulation and inhibit the anaerobic growth [34], but re-directing flux to the ED pathway should prevent methylglyoxal accumulation.”
BackgroundEngineering Escherichia coli for efficient conversion of glucose to pyruvate
Causey, T. B., Shanmugam, K. T., Yomano, L. P., & Ingram, L. O. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0308171100 · Cited by 260 · cited 1×
“However, multiple studies have shown that the mutations in the ack-pta pathway cause accumulation of pyruvate [ 31-33 ], and the integrated metabolic and regulatory model predicts the secretion of pyruvate (64% mol pyruvate/mol glucose) in a ΔptaΔeutD mutant.”
BackgroundShlomi, T., Eisenberg, Y., Sharan, R., & Ruppin, E. (2007) · Molecular Systems Biology · doi:10.1038/msb4100141 · Cited by 254 · cited 1×
“GPR associations and transcriptional regulatory constraints are systematically formulated using three dimensional arrays, which differ from recently reported approaches [13,15,17].”
BackgroundComparative Genomic Reconstruction of Transcriptional Regulatory Networks in Bacteria
Rodionov, D. A. (2007) · Chemical Reviews · doi:10.1021/cr068309+ · Cited by 218 · cited 1×
“The number of microbial transcriptional regulatory network models continues to grow, which has been enabled by high-throughput datasets and computational analysis [46-52].”
BackgroundAsadollahi, M. A., Maury, J., Patil, K. R., Schalk, M., Clark, A., & Nielsen, J. (2009) · Metabolic Engineering · doi:10.1016/j.ymben.2009.07.001 · Cited by 213 · cited 1×
“A recent study has used a genetic algorithm to design strains with un-coupled metabolite and biomass production, where a bi-level problem is used and the inner problem uses an objective function to predict un-evolved cellular phenotypes [45].”
MethodMetabolic engineering for drug discovery and development
Khosla, C., & Keasling, J. D. (2003) · Nature Reviews Drug Discovery · doi:10.1038/nrd1256 · Cited by 207 · cited 1×
“As such, it will have impacts on the biological production of a wide variety of products, ranging from biofuels and other commodity chemicals to specialty chemicals [53-55].”
BackgroundMoxley, J. F., Jewett, M. C., Antoniewicz, M. R., Villas-Boas, S. G., Alper, H., Wheeler, R. T., Tong, L., Hinnebusch, A. G., Ideker, T., Nielsen, J., et al. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0811091106 · Cited by 171 · cited 1×
“The OptORF approach could be improved by applying these linear approximations in the regulatory part of the model, in order to describe varying gene expression levels, and using approaches to constrain metabolic fluxes based on predicted gene expression levels [42-44].”
MethodGenome‐scale gene/reaction essentiality and synthetic lethality analysis
Suthers, P. F., Zomorrodi, A., & Maranas, C. D. (2009) · Molecular Systems Biology · doi:10.1038/msb.2009.56 · Cited by 165 · cited 2×
“GPR associations and transcriptional regulatory constraints are systematically formulated using three dimensional arrays, which differ from recently reported approaches [13,15,17].”
BackgroundLarge‐scale identification of genetic design strategies using local search
Lun, D. S., Rockwell, G., Guido, N. J., Baym, M., Kelner, J. A., Berger, B., Galagan, J. E., & Church, G. M. (2009) · Molecular Systems Biology · doi:10.1038/msb.2009.57 · Cited by 155 · cited 2×
“GPR associations and transcriptional regulatory constraints are systematically formulated using three dimensional arrays, which differ from recently reported approaches [13,15,17].”
BackgroundKim, Y., Ingram, L. O., & Shanmugam, K. T. (2007) · Applied and Environmental Microbiology · doi:10.1128/aem.02456-06 · Cited by 143 · cited 3×
“Some of the gene deletions presented here have been used previously to engineer un-evolved and evolved strains of E. coli for ethanol production [26,37].”
BackgroundWhy does Escherichia coli have two primary pathways for synthesis of glutamate?
Helling, R. B. (1994) · Journal of Bacteriology · doi:10.1128/jb.176.15.4664-4668.1994 · Cited by 134 · cited 1×
“This pathway is encoded by glutamate dehydrogenase ( gdhA ), the deletion of which would require cells to use the ATP-dependent pathway that normally operates when the concentration of ammonia is low [36].”
BackgroundZhu, J., & Shimizu, K. (2004) · Applied Microbiology and Biotechnology · doi:10.1007/s00253-003-1499-9 · Cited by 133 · cited 1×
“The regulatory model indicates that expression of pflD requires either ArcA or Fnr as activators, and a previous study showed that PFL activity was still detected in pflA or pflB mutant [28].”
BackgroundKim, Y., Ingram, L. O., & Shanmugam, K. T. (2008) · Journal of Bacteriology · doi:10.1128/jb.00104-08 · Cited by 128 · cited 1×
“Thus, deletion of fnr , pflB , and tdcE would abolish PFL activity and require cells to use pyruvate dehydrogenase (PDH) [26,30], whose expression is repressed by Fnr and ArcA in anaerobic conditions.”
BackgroundFong, S. S., Marciniak, J. Y., & Palsson, B. Ø. (2003) · Journal of Bacteriology · doi:10.1128/jb.185.21.6400-6408.2003 · Cited by 119 · cited 1×
“The simulation conditions were the same as the ethanol case. ferent end points, and in some cases achieve only sub-optimal behaviors [9,39,40].”
MethodEffect of oxygen on the Escherichia coli ArcA and FNR regulation systems and metabolic responses
Shalel‐Levanon, S., San, K., & Bennett, G. N. (2005) · Biotechnology and Bioengineering · doi:10.1002/bit.20381 · Cited by 110 · cited 1×
“Another study revealed that a fnr deletion alone is sufficient to decrease PFL activity down to the level of ΔfnrΔarcA strain, while an arcA deletion alone did not decrease PFL activity [29].”
BackgroundIdentifying the conserved network of cis-regulatory sites of a eukaryotic genome
Wang, T., & Stormo, G. D. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0505147102 · Cited by 84
Dittrich, C. R., Vadali, R. V., Bennett, G. N., & San, K. (2005) · Biotechnology Progress · doi:10.1021/bp049730r · Cited by 84 · cited 1×
“However, multiple studies have shown that the mutations in the ack-pta pathway cause accumulation of pyruvate [31-33], and the integrated metabolic and regulatory model predicts the secretion of pyruvate (64% mol pyruvate/mol glucose) in a ΔptaΔeutD mutant.”
BackgroundAutomatic reconstruction of a bacterial regulatory network using Natural Language Processing
Rodriguez-Penagos, C. G., Salgado, H., Martínez‐Flores, I., & Collado‐Vides, J. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-293 · Cited by 55
Iterative Reconstruction of Transcriptional Regulatory Networks: An Algorithmic Approach
Barrett, C. L., & Palsson, B. O. (2006) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0020052 · Cited by 52 · cited 1×
“The number of microbial transcriptional regulatory network models continues to grow, which has been enabled by high-throughput datasets and computational analysis [46-52].”
BackgroundFunctional States of the Genome-Scale Escherichia Coli Transcriptional Regulatory System
Gianchandani, E. P., Joyce, A. R., Palsson, B. Ø., & Papin, J. A. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000403 · Cited by 36 · cited 1×
“These Boolean relationships can be effectively formulated as linear constraints using binary variables and matrices, which are more systematic and/or computationally efficient than previously suggested formulations for modeling GPR associations and integrating metabolic and regulatory models [13-17].”
MethodGenome-wide de novo prediction of cis-regulatory binding sites in prokaryotes
Zhang, S., Xu, M., Li, S., & Su, Z. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkp248 · Cited by 33
Baumbach, J., Rahmann, S., & Tauch, A. (2009) · BMC Systems Biology · doi:10.1186/1752-0509-3-8 · Cited by 30 · cited 1×
“The number of microbial transcriptional regulatory network models continues to grow, which has been enabled by high-throughput datasets and computational analysis [46-52].”
Background
Cited by
Constraining the metabolic genotype–phenotype relationship using a phylogeny of in silico methods
Lewis, N. E., Nagarajan, H., & Palsson, B. O. (2012) · Nature Reviews Microbiology · doi:10.1038/nrmicro2737 · Cited by 779
“The advances beyond microbial metabolism provide additional targets for drug discovery and metabolic engineering 133 , and allow studies on medicine and crop engineering.”
BackgroundSystems metabolic engineering of microorganisms for natural and non-natural chemicals
Lee, J. W., Na, D., Park, J. M., Lee, J., Choi, S., & Lee, S. Y. (2012) · Nature Chemical Biology · doi:10.1038/nchembio.970 · Cited by 735
Xu, P., Ranganathan, S., Fowler, Z. L., Maranas, C. D., & Koffas, M. A. G. (2011) · Metabolic Engineering · doi:10.1016/j.ymben.2011.06.008 · Cited by 346
Basic and applied uses of genome‐scale metabolic network reconstructions of Escherichia coli
McCloskey, D., Palsson, B. Ø., & Feist, A. M. (2013) · Molecular Systems Biology · doi:10.1038/msb.2013.18 · Cited by 315
Microbial laboratory evolution in the era of genome‐scale science
Conrad, T. M., Lewis, N. E., & Palsson, B. Ø. (2011) · Molecular Systems Biology · doi:10.1038/msb.2011.42 · Cited by 282
Metadata
- Authors
- Kim, J., & Reed, J. L.
- Venue
- BMC Systems Biology
- Published
- 2010-04-28
- Volume
- 4
- Issue
- 1
- Pages
- 53-53
- ISSN
- 1752-0509 (ISSN-L)
- OpenAlex
- W2109880272
- Cited by
- 217
- References
- 51
- FWCI
- 8.03
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.