Rising complexity and falling explanatory power in ecology
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Analyses of published research can provide a realistic perspective on the progress of science. By analyzing more than 18 000 articles published by the preeminent ecological societies, we found that (1) ecological research is becoming increasingly statistically complex, reporting a growing number of P values per article and (2) the value of reported coefficient of determination ( R 2 ) has been falling steadily, suggesting a decrease in the marginal explanatory power of ecology. These trends may be due to changes in the way ecology is studied or in the way the findings of investigations are reported. Determining the reason for increasing complexity and declining marginal explanatory power would require a critical review of the scientific process in ecology, from research design to dissemination, and could influence the public interpretation and policy implications of ecological findings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“assessments in various disciplines suggest that, far from becoming increasingly short and trivial, published studies are getting longer, more complex, and richer in data (e.g., refs. 32 -34).”
From Is science really facing a reproducibility crisis, and do we need it to? (2018) · cites this paper as [34]
Citations
Cites
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049 · cited 2×
“…output has provided several insights into the trajectory of scientific disciplines, including a better understanding of shifts in topic selection (Griffiths and Steyvers 2004; Perc 2013), shifts in patterns of scientific collaboration (Wuchty et al. 2007), and the consequences of selective…”
BackgroundWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
The Increasing Dominance of Teams in Production of Knowledge
Wuchty, S., Jones, B. F., & Uzzi, B. (2007) · Science · doi:10.1126/science.1136099 · Cited by 3,615
Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546
Statistical Methods for Research Workers
(1926) · Journal of Comparative Pathology and Therapeutics · doi:10.1016/s0368-1742(26)80018-9 · Cited by 1,283
A variance explanation paradox: When a little is a lot.
Abelson, R. P. (1985) · Psychological Bulletin · doi:10.1037/0033-2909.97.1.129 · Cited by 1,045
Ecological Forecasts: An Emerging Imperative
Clark, J. S., Carpenter, S. R., Barber, M., Collins, S., Dobson, A., Foley, J. A., Lodge, D. M., Pascual, M., Pielke, R., Pizer, W., et al. (2001) · Science · doi:10.1126/science.293.5530.657 · Cited by 913
Rescuing US biomedical research from its systemic flaws
Alberts, B., Kirschner, M. W., Tilghman, S., & Varmus, H. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1404402111 · Cited by 817 · cited 2×
“Among these are the relative strengths of the incentives offered to researchers for undertaking marginal improvements on existing studies rather than risk-taking and original research (Alberts et al. 2014), and for their capacity to produce statistically significant results rather than for their ability to explain and…”
Background
Research works printed but not linked: 1
- Connor RO., 2000, Why ecology lags behind biology, The Scientist, 14, 35
Cited by
A brief introduction to mixed effects modelling and multi-model inference in ecology
Harrison, X. A., Donaldson, L., Correa-Cano, M. E., Evans, J., Fisher, D. N., Goodwin, C. E. D., Robinson, B. S., Hodgson, D. J., & Inger, R. (2018) · PeerJ · doi:10.7717/peerj.4794 · Cited by 2,094
Is science really facing a reproducibility crisis, and do we need it to?
Fanelli, D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708272114 · Cited by 416
Addressing context dependence in ecology
Catford, J. A., Wilson, J. R. U., Pyšek, P., Hulme, P. E., & Duncan, R. P. (2022) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2021.09.007 · Cited by 344
Evidence of experimental bias in the life sciences: why we need blind data recording
Holman, L., Head, M. L., Lanfear, R., & Jennions, M. D. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002190 · Cited by 263
Heino, J., Melo, A. S., Bini, L. M., Altermatt, F., Al‐Shami, S. A., Angeler, D. G., Bonada, N., Brand, C., Callisto, M., Cottenie, K., et al. (2015) · Ecology and Evolution · doi:10.1002/ece3.1439 · Cited by 196
Gomes, D. G. E. (2022) · PeerJ · doi:10.7717/peerj.12794 · Cited by 189
Bannar‐Martin, K. H., Kremer, C. T., Ernest, S. K. M., Leibold, M. A., Auge, H., Chase, J., Declerck, S. A. J., Eisenhauer, N., Harpole, S., Hillebrand, H., et al. (2018) · Ecology Letters · doi:10.1111/ele.12895 · Cited by 168
Indirect effects of overfishing on Caribbean reefs: sponges overgrow reef-building corals
Loh, T., McMurray, S. E., Henkel, T. P., Vicente, J., & Pawlik, J. R. (2015) · PeerJ · doi:10.7717/peerj.901 · Cited by 135
Progress and Challenges in Coupled Hydrodynamic-Ecological Estuarine Modeling
Ganju, N. K., Brush, M. J., Rashleigh, B., Aretxabaleta, A. L., del Barrio, P., Grear, J. S., Harris, L. A., Lake, S. J., McCardell, G., O’Donnell, J., et al. (2015) · Estuaries and Coasts · doi:10.1007/s12237-015-0011-y · Cited by 134
Metaresearch for Evaluating Reproducibility in Ecology and Evolution
Fidler, F., Chee, Y. E., Wintle, B. C., Burgman, M. A., McCarthy, M. A., & Gordon, A. (2017) · BioScience · doi:10.1093/biosci/biw159 · Cited by 94
Ecological uniqueness of stream and lake diatom communities shows different macroecological patterns
Vilmi, A., Karjalainen, S. M., & Heino, J. (2017) · Diversity and Distributions · doi:10.1111/ddi.12594 · Cited by 116
The role of geodiversity in providing ecosystem services at broad scales
Alahuhta, J., Ala‐Hulkko, T., Tukiainen, H., Purola, L., Akujärvi, A., Lampinen, R., & Hjort, J. (2018) · Ecological Indicators · doi:10.1016/j.ecolind.2018.03.068 · Cited by 111
Aquatic hyphomycetes in a changing environment
Bärlocher, F. (2015) · Fungal ecology · doi:10.1016/j.funeco.2015.05.005 · Cited by 86
Plant species diversity affects soil–atmosphere fluxes of methane and nitrous oxide
Niklaus, P. A., Roux, X. L., Poly, F., Buchmann, N., Scherer‐Lorenzen, M., Weigelt, A., & Barnard, R. L. (2016) · Oecologia · doi:10.1007/s00442-016-3611-8 · Cited by 85
Carbon dioxide fluxes of an urban tidal marsh in the Hudson‐Raritan estuary
Schäfer, K. V. R., Tripathee, R., Artigas, F. J., Morin, T. H., & Bohrer, G. (2014) · Journal of Geophysical Research Biogeosciences · doi:10.1002/2014jg002703 · Cited by 65
Is catchment geodiversity a useful surrogate of aquatic plant species richness?
Toivanen, M., Hjort, J., Heino, J., Tukiainen, H., Aroviita, J., & Alahuhta, J. (2019) · Journal of Biogeography · doi:10.1111/jbi.13648 · Cited by 56
Ferreira, A. S., Peres, C. A., Dodonov, P., & Cassano, C. R. (2020) · Agroforestry Systems · doi:10.1007/s10457-020-00553-y · Cited by 54
A new R2-based metric to shed greater insight on variable importance in artificial neural networks
Giam, X., & Olden, J. D. (2015) · Ecological Modelling · doi:10.1016/j.ecolmodel.2015.06.034 · Cited by 54
Zhong, Q., Wang, K., Lai, Q., Zhang, C., Zheng, L., & Wang, J. (2015) · Estuaries and Coasts · doi:10.1007/s12237-015-9997-4 · Cited by 52
Biases in studies of spatial patterns in insect herbivory
Zvereva, E. L., & Kozlov, M. V. (2019) · Ecological Monographs · doi:10.1002/ecm.1361 · Cited by 51
The possibility of deep naturalism: a philosophy for ecology
Price, L. (2019) · Journal of Critical Realism · doi:10.1080/14767430.2019.1667169 · Cited by 50
Low R2 in ecology: Bitter, or B-side?
Lin, Y., & Wiegand, K. (2023) · Ecological Indicators · doi:10.1016/j.ecolind.2023.110406 · Cited by 48
Accounting for uncertainty in dormant life stages in stochastic demographic models
Paniw, M., Quintana-Ascencio, P. F., Ojeda, F., & Salguero‐Gómez, R. (2016) · Oikos · doi:10.1111/oik.03696 · Cited by 45
Liu, R., van Kleunen, M., Pierce, S., Chytrý, M., Guo, K., Pyšek, P., & Guo, W. (2025) · Journal of Ecology · doi:10.1111/1365-2745.70146 · Cited by 40
Main predictors of periphyton species richness depend on adherence strategy and cell size
Algarte, V. M., Siqueira, T., Landeiro, V. L., Rodrigues, L., Bonecker, C. C., Rodrigues, L. C., Santana, N. F., Thomaz, S. M., & Bini, L. M. (2017) · PLoS ONE · doi:10.1371/journal.pone.0181720 · Cited by 39
A depth-resolved artificial neural network model of marine phytoplankton primary production
Mattei, F., Franceschini, S., & Scardi, M. (2018) · Ecological Modelling · doi:10.1016/j.ecolmodel.2018.05.003 · Cited by 37
Embracing Complexity and Complexity-Awareness in Marine Megafauna Conservation and Research
Lewison, R. L., Johnson, A. F., & Verutes, G. M. (2018) · Frontiers in Marine Science · doi:10.3389/fmars.2018.00207 · Cited by 35
Wojciechowski, J., Heino, J., Bini, L. M., & Padial, A. A. (2017) · Hydrobiologia · doi:10.1007/s10750-017-3245-9 · Cited by 33
Geographical variation in bill size provides evidence for Allen’s rule in a cosmopolitan raptor
Romanò, A., Séchaud, R., & Roulin, A. (2019) · Global Ecology and Biogeography · doi:10.1111/geb.13007 · Cited by 33
Brittain, J. E., Heino, J., Friberg, N. R., Aroviita, J., Kahlert, M., Karjalainen, S. M., Keck, F., Lento, J., Liljaniemi, P., Mykrä, H., et al. (2020) · Freshwater Biology · doi:10.1111/fwb.13616 · Cited by 30
Heckley, A. M., Pearce, A. E., Gotanda, K. M., Hendry, A. P., & Oke, K. B. (2022) · Journal of Evolutionary Biology · doi:10.1111/jeb.14086 · Cited by 30
Assessing the habitat suitability of 10 serious weed species in global croplands
Wang, C., & Wan, J. (2020) · Global Ecology and Conservation · doi:10.1016/j.gecco.2020.e01142 · Cited by 28
Maceda‐Veiga, A., Nally, R. M., & de Sostoa, A. (2018) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2018.06.304 · Cited by 25
Foliar optical traits indicate that sealed planting conditions negatively affect urban tree health
Yu, K., Geel, M. V., Ceulemans, T., Geerts, W., Ramos, M. A., Sousa, N. R., Castro, P. M. L., Kastendeuch, P. P., Najjar, G., Améglio, T., et al. (2018) · Ecological Indicators · doi:10.1016/j.ecolind.2018.08.047 · Cited by 24
Mattei, F., & Scardi, M. (2020) · Ecological Modelling · doi:10.1016/j.ecolmodel.2020.108985 · Cited by 23
Siqueira, T., Bini, L. M., Thomaz, S. M., & Fontaneto, D. (2014) · Hydrobiologia · doi:10.1007/s10750-014-2071-6 · Cited by 22
Alahuhta, J., Toivanen, M., Hjort, J., Ecke, F., Johnson, L. B., Sass, L., & Heino, J. (2017) · Freshwater Biology · doi:10.1111/fwb.12936 · Cited by 22
The balance between concepts and complexity in ecology
Johnson, A. F., & Lidström, S. (2018) · Nature Ecology & Evolution · doi:10.1038/s41559-018-0507-5 · Cited by 22
Malandrino, A. (2023) · Quality & Quantity · doi:10.1007/s11135-023-01753-1 · Cited by 21
Du, A., & Alemseged, Z. (2018) · Journal of Human Evolution · doi:10.1016/j.jhevol.2018.07.004 · Cited by 20
Environmental determinants of lake macrophyte communities in Baikal Siberia
Alahuhta, J., Rosbakh, S. A., Chepinoga, V. V., & Heino, J. (2020) · Aquatic Sciences · doi:10.1007/s00027-020-0710-8 · Cited by 20
Ascensão, F., Latombe, G., Anadón, J. D., Abellán, P., Cardador, L., Carrete, M., Tella, J. L., & Capinha, C. (2020) · Biological Invasions · doi:10.1007/s10530-020-02196-7 · Cited by 19
Does agroecosystem model improvement increase simulation accuracy for agricultural N2O emissions?
Zhang, Y., & Yu, Q. (2020) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2020.108281 · Cited by 18
Scrosati, R. A., Freeman, M. J., Ellrich, J. A., & Petzold, W. (2022) · Frontiers in Marine Science · doi:10.3389/fmars.2022.987162 · Cited by 18
Alahuhta, J., Virtala, A., Hjort, J., Ecke, F., Johnson, L. B., Sass, L., & Heino, J. (2017) · Oecologia · doi:10.1007/s00442-017-3847-y · Cited by 18
Temporal Variability of Primary Production Explains Marine Ecosystem Structure and Function
Schlenger, A. J., Libralato, S., & Ballance, L. T. (2018) · Ecosystems · doi:10.1007/s10021-018-0272-y · Cited by 18
Adult firefly abundance is linked to weather during the larval stage in the previous year
Evans, T. R., Salvatore, D., van de Pol, M., & Musters, C. J. M. (2018) · Ecological Entomology · doi:10.1111/een.12702 · Cited by 18
Rivaes, R. P., Pinheiro, A. N., Egger, G., & Ferreira, T. (2017) · Frontiers in Plant Science · doi:10.3389/fpls.2017.01612 · Cited by 17
Ideas in Ecology and Evolution
(editor, L. A. (2019) · Ideas in Ecology and Evolution · doi:10.4033/iee · Cited by 17
Costa, A. P. L., Takemoto, R. M., Lizama, M. D. L. A. P., & Padial, A. A. (2021) · Hydrobiologia · doi:10.1007/s10750-021-04695-7 · Cited by 14
Landing force reveals new form of motion-induced sound camouflage in a wild predator
Schalcher, K., Milliet, E., Séchaud, R., Bühler, R., Almasi, B., Potier, S., Becciu, P., Roulin, A., & Shepard, E. L. C. (2023) · eLife · doi:10.1101/2023.03.07.531523 · Cited by 14
Shevchuk, O., Roshchyna, N. V., Lazarenko, I. S., & Stets, O. (2023) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/1269/1/012018 · Cited by 14
Vadas, R. L., Beal, B. F., Dudgeon, S. R., & Wright, W. A. (2015) · Journal of Shellfish Research · doi:10.2983/035.034.0337 · Cited by 14
Population and community ecology: past progress and future directions
Krebs, C. J., Boutin, S. A., & Boonstra, R. (2024) · Integrative Zoology · doi:10.1111/1749-4877.12863 · Cited by 13
Patten, B. C. (2016) · Ecological Modelling · doi:10.1016/j.ecolmodel.2015.10.020 · Cited by 13
Keke, U. N., Arimoro, F. O., Edegbene, A. O., Akamagwuna, F. C., Assie, F. A. G. J., & Odume, O. N. (2022) · Frontiers in Environmental Science · doi:10.3389/fenvs.2022.1022776 · Cited by 12
Ecology, Evidence, and Objectivity: In Search of a Bias-Free Methodology
Brittan, G. G., & Bandyopadhyay, P. S. (2019) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2019.00399 · Cited by 12
Ding, C., Cai, J., Hu, Y., & Liang, Y. (2025) · Avian Research · doi:10.1016/j.avrs.2025.100304 · Cited by 11
Dochtermann, N. A., Sekhar, M. A., & Nakagawa, S. (2026) · Animal Behaviour · doi:10.1016/j.anbehav.2026.123542 · Cited by 9
Navarro, J. J. P., Rodríguez‐Estrella, R., & Abraham, A. G. (2019) · Natural Areas Journal · doi:10.3375/043.039.0404 · Cited by 9
Accelerating social science knowledge production with the coordinated open-source model
Turek, K. (2025) · Quality & Quantity · doi:10.1007/s11135-024-02020-7 · Cited by 8
Thomas, F., Vesk, P. A., & Hauser, C. E. (2018) · Ecological Applications · doi:10.1002/eap.1801 · Cited by 8
Fanelli, D. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780190938550.003.0004 · Cited by 7
Generalized Additive Modeling of Ecological Data With mgcv: New Adequacy Assessment Tools
Mainguy, J., McInerney, R., Millar, R. B., Valiquette, É., Bélanger, M., & Moral, R. D. A. (2026) · Ecology and Evolution · doi:10.1002/ece3.72825 · Cited by 6
Mathematizing Nature's Messiness: Graphical Representations of Variation in Ecology, 1930-Present
Martin, L. J. (2016) · Environmental Humanities · doi:10.1215/22011919-3616335 · Cited by 6
A call for statistical editors in ecology
von Wehrden, H., Schultner, J., & Abson, D. J. (2015) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2015.03.013 · Cited by 6
Mays, C., Amores, M., & Mays, A. (2025) · PLoS ONE · doi:10.1371/journal.pone.0320887 · Cited by 5
O Impacto de Pagamentos de Serviços Ambientais na Mata Atlântica: Um Estudo Geoespacial
Cerveira, R., do Prado, N. B., Tonini, G., & da Cunha, C. F. (2024) · Revista de Administração Contemporânea · doi:10.1590/1982-7849rac2024240020.en · Cited by 4
Wernli, P., Royer, M. A., Kügler, A., Lammers, M. O., Holland, K. N., & Meyer, C. G. (2025) · Scientific Reports · doi:10.1038/s41598-025-27742-y · Cited by 3
Interpretable and Predictive Models Based on High‐Dimensional Data in Ecology and Evolution
Jahner, J. P., Buerkle, C. A., Gannon, D. G., Grames, E. M., McFarlane, S. E., Siefert, A., Bell, K. L., DeLeo, V. L., Forister, M. L., Harrison, J. G., et al. (2026) · Molecular Ecology Resources · doi:10.1111/1755-0998.70191 · Cited by 3
Virgílio, L. R., de Melo, H. P. S., Lima, F. D. S., Takemoto, R. M., Camargo, L. M. A., & Meneguetti, D. U. D. O. (2023) · Parasitology Research · doi:10.1007/s00436-023-08013-z · Cited by 3
Pei, Q., Sheng, J., Grant, J., & Sui, Y. (2024) · ATMOSPHERE-OCEAN · doi:10.1080/07055900.2024.2394029 · Cited by 2
Gutiérrez‐Arellano, C., Newbold, T., & Hodgson, J. A. (2025) · Global Ecology and Biogeography · doi:10.1111/geb.70170 · Cited by 2
Wang, X., Zhao, L., Teng, Y., Hu, W., Xu, Y., Ma, J., Song, J., Ren, W., Zhang, J., Zhu, H., et al. (2026) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2026.141760 · Cited by 2
Li, Q., Yuan, J., Cao, Q., Cubino, J. P., Nizamani, M. M., Zhu, M., Wang, G., Bai, Y., & Wang, H. (2026) · Journal of Forestry Research · doi:10.1007/s11676-026-02027-w · Cited by 2
Think like a Bayesian and avoid pitfalls from our frequentist past
Doll, J. C., & Feiner, Z. S. (2022) · Ideas in Ecology and Evolution · doi:10.24908/iee.2022.15.1.c · Cited by 2
Landing force reveals new form of motion-induced sound camouflage in a wild predatorPreprint
Schalcher, K., Milliet, E., Séchaud, R., Bühler, R., Almasi, B., Potier, S., Becciu, P., Roulin, A., & Shepard, E. L. C. (2024) · eLife · doi:10.7554/elife.87775.2 · Cited by 2
Clarity over complexity: Statistical reporting that resonates
Midway, S. R., & Daugherty, D. J. (2025) · Fisheries · doi:10.1093/fshmag/vuaf043 · Cited by 1
Ganderton, P. (2022) · Oxford University Press eBooks · doi:10.1093/obo/9780199830060-0238 · Cited by 1
Incorporando a variabilidade: o uso de modelos de efeitos mistos em ecologia
Leite, M. D. S. (2022) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.41.2022.tde-22032023-120555 · Cited by 1
Mcdermott Long, O. (2017) · UEA Digital Repository (University of East Anglia) · Cited by 1
Modeling and mathematical analysis of the dynamics of soil organic carbon
Hammoudi, A. (2015) · theses.fr (ABES) · doi:10.70675/9ce8c6c8za610z49d2z9eeaz41fa1d1afb54 · Cited by 1
Social networks and individual behaviour variation in wild crickets
Fisher, D. N. (2016) · Figshare
Schlenger, A. J. (2017) · eScholarship (California Digital Library)
Simpson, M. P. (2016) · RODIN (Universidad de Cádiz)
Factors contributing to the spatial variation of stream communities in boreal and tropical regions
Jyrkänkallio‐Mikkola, J. (2018) · Helda - University of Helsinki Institutional Repository
Sezer, A. (2018) · Applied Ecology and Environmental Research · doi:10.15666/aeer/1602_19731982
Hui, C., & Richardson, D. M. (2022) · Cambridge University Press eBooks · doi:10.1017/9781108778374.006
Metadata
- Authors
- Low-Décarie, E., Chivers, C., & Granados, M.
- Affiliations
- McGill University (CA)
- ORCID
- Chivers, Corey
- Venue
- Frontiers in Ecology and the Environment
- Publisher
- Wiley
- Published
- 2014-08-20
- Volume
- 12
- Issue
- 7
- Pages
- 412-418
- ISSN
- 1540-9295 (ISSN-L)
- 1540-9309
- OpenAlex
- W2108866660
- Cited by
- 111
- References
- 43
- Citations by year
- 2026: 10 · 2025: 7 · 2024: 9 · 2023: 6 · 2022: 14 · 2021: 2 · 2020: 7 · 2019: 7 · 2018: 23 · 2017: 7 · 2016: 5 · 2015: 12 · 2014: 2
- FWCI
- 8.48
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Frontiers in Ecology and the Environment (publishedVersion)
- Open Access at Essex (University of Essex) (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- statistical complexity, explanatory power, R-squared, p-values, publication analysis, ecological society, research design, environmental policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.