CoChat

A novel bias correction methodology for climate impact simulations

Open access
Sippel, S., Otto, F. E. L., Forkel, M., Allen, M. R., Guillod, B. P., Heimann, M., Reichstein, M., Seneviratne, S. I., Thonicke, K., Mahecha, M. D. · 2016 · Earth System Dynamics

Published version of a preprint

Cited by 84

The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.

Abstract

Understanding, quantifying and attributing the impacts of extreme weather and climate events in the terrestrial biosphere is crucial for societal adaptation in a changing climate. However, climate model simulations generated for this purpose typically exhibit biases in their output that hinder any straightforward assessment of impacts. To overcome this issue, various bias correction strategies are routinely used to alleviate climate model deficiencies, most of which have been criticized for physical inconsistency and the nonpreservation of the multivariate correlation structure. In this study, we introduce a novel, resampling-based bias correction scheme that fully preserves the physical consistency and multivariate correlation structure of the model output. This procedure strongly improves the representation of climatic extremes and variability in a large regional climate model ensemble (HadRM3P, climateprediction.net/weatherathome), which is illustrated for summer extremes in temperature and rainfall over Central Europe. Moreover, we simulate biosphere–atmosphere fluxes of carbon and water using a terrestrial ecosystem model (LPJmL) driven by the bias-corrected climate forcing. The resampling-based bias correction yields strongly improved statistical distributions of carbon and water fluxes, including the extremes. Our results thus highlight the importance of carefully considering statistical moments beyond the mean for climate impact simulations. In conclusion, the present study introduces an approach to alleviate climate model biases in a physically consistent way and demonstrates that this yields strongly improved simulations of climate extremes and associated impacts in the terrestrial biosphere. A wider uptake of our methodology by the climate and impact modelling community therefore seems desirable for accurately quantifying changes in past, current and future extremes.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.5194/esd-7-71-2016

Cites

14 of 14 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 67

  1. Allen, M.: Liability for climate change, Nature, 421, 891–892, 2003. · DOI · Paper page
  2. Beer, C., Weber, U., Tomelleri, E., Carvalhais, N., Mahecha, M., and Reichstein, M.: Harmonized European Long-Term Climate Data for Assessing the Effect of Changing Temporal Variability on Land–Atmosphere CO2 Fluxes, J. Clim., 27, 4815–4834, 2014. · DOI
  3. Bellprat, O., Kotlarski, S., Lüthi, D., and Schär, C.: Physical constraints for temperature biases in climate models, Geophys. Res. Lett., 40, 4042–4047, 2013. · DOI
  4. Bindoff, N.L., Stott, P. A., AchutaRao, K. M., Allen, M. R., Gillett, N., Gutzler, D., Hansingo, K., Hegerl, G., Hu, Y., Jain, S., Mokhov, I. I., Overland, J., Perlwitz, J., Sebbari, R., and Zhang, X.: Detection and attribution of climate change: from global to regional, in: Climate Change 2013: The Physical Science Basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change, Cambridge University Press, Cambridge, UK and New York, NY, USA, 867–952, 2013. · DOI · Paper page
  5. Boberg, F. and Christensen, J. H.: Overestimation of Mediterranean summer temperature projections due to model deficiencies, Nat. Clim. Change, 2, 433–436, 2012. · DOI · Paper page
  6. Bondeau, A., Smith, P. C., Zaehle, S., Schaphoff, S., Lucht, W., Cramer, W., Gerten, D., Lotze-Campen, H., Müller, C., Reichstein, M., and Smith B.: Modelling the role of agriculture for the 20th century global terrestrial carbon balance, Global Change Biol., 13, 679–706, 2007. · DOI · Paper page
  7. Chapin III, F. S., Woodwell, G. M., Randerson, J. T., Rastetter, E. B., Lovett, G. M., Baldocchi, D. D., Clark, D. A., Harmon, M. E., Schimel, D. S., Valentini, R., Wirth, C., Aber, J. D., Cole, J. J., Goulden, M. L., Harden, J. W., Heimann, M., Howarth, R. W., Matson, P. A., McGuire, A. D., Melillo, J. M., Mooney, H. A., Neff, J. C., Houghton, R. A., Pace, M. L., Ryan, M. G., Running, S. W., Sala, O. E., Schlesinger, W. H., and Schulze, E.-D.: Reconciling carbon-cycle concepts, terminology, and methods, Ecosystems, 9, 1041–1050, 2006. · DOI · Paper page
  8. Christensen, J., Kjellström, E., Giorgi, F., Lenderink, G., and Rummukainen, M.: Weight assignment in regional climate models, Clim. Res., 44, 179–194, 2010. · DOI · Paper page
  9. Ciais, P., Reichstein, M., Viovy, N., Granier, A., Ogée, J., Allard, V., Aubinet, M., Buchmann, N., Bernhofer, C., Carrara, A., Chevallier, F., De Noblet, N., Friend, A. D., Friedlingstein, P., Grünwald, T., Heinesch, B., Keronen, P., Knohl, A., Krinner, G., Loustau, D., Manca, G., Matteucci, G., Miglietta, F., Ourcival, J. M., Papale, D., Pilegaard, K., Rambal, S., Seufert, G., Soussana, J. F., Sanz, M. J., Schulze, E.-D., Vesala, T., and Valentini, R.: Europe-wide reduction in primary productivity caused by the heat and drought in 2003, Nature, 437, 529–533, 2005. · DOI · Paper page
  10. Collins, M.: Ensembles and probabilities: a new era in the prediction of climate change, Philos. Trans. R. Soc., A, 365, 1957–1970, 2007. · DOI · Paper page
  11. Dee, D. P, Uppala, S. M., Simmons, A. J., Berrisford, P., Poli, P., Kobayashi, S., Andrae, U., Balmaseda, M. A., Balsamo, G., Bauer, P., Bechtold, P., Beljaars, A. C. M., van de Berg, L., Bidlot, J., Bormann, N., Delsol, C., Dragani, R., Fuentes, M., Geer, A. J., Haimberger, L., Healy, S. B., Hersbach, H., Holm, E. V., Isaksen, L., Kallberg, P., Kohler, M., Matricardi, M., McNally, A. P., Monge-Sanz, B. M., Morcrette, J. J., Park, B. K., Peubey, C., de Rosnay, P., Tavolato, C., Thepaut, J. N., and Vitart, F.: The ERA-Interim reanalysis: Configuration and performance of the data assimilation system, Quart. J. Roy. Meteor. Soc., 137, 553–597, 2011. · DOI · Paper page
  12. Donat, M. G., Alexander, L. V., Yang, H., Durre, I., Vose, R., Dunn, R. J. H., Willett, K. M., Aguilar, E., Brunet, M., Caesar, J., Hewitson, B., Jack, C., Tank, A. M. G. K., Kruger, A. C., Marengo, J., Peterson, T. C., Renom, M., Rojas, C. O., Rusticucci, M., Salinger, J., Elrayah, A. S., Sekele, S. S., Srivastava, A. K., Trewin, B., Villarroel, C., Vincent, L. A., Zhai, P., Zhang, X., and Kitching, S.: Updated analyses of temperature and precipitation extreme indices since the beginning of the twentieth century: The HadEX2 dataset, J. Geophys. Res.-Atmos., 118, 2098–2118, 2013. · DOI · Paper page
  13. Ehret, U., Zehe, E., Wulfmeyer, V., Warrach-Sagi, K., and Liebert, J.: HESS Opinions “Should we apply bias correction to global and regional climate model data?”, Hydrol. Earth Syst. Sci., 16, 3391–3404, 10.5194/hess-16-3391-2012, 2012. · DOI · Paper page
  14. Forkel, M., Carvalhais, N., Schaphoff, S., v. Bloh, W., Migliavacca, M., Thurner, M., and Thonicke, K.: Identifying environmental controls on vegetation greenness phenology through model-data integration, Biogeosciences, 11, 7025–7050, 10.5194/bg-11-7025-2014, 2014. · doi:10.5194/bg-11-7025-2014
  15. Forkel, M., Migliavacca, M., Thonicke, K., Reichstein, M., Schaphoff, S., Weber, U., and Carvalhais, N.: Co-dominant water control on global inter-annual variability and trends in land surface phenology and greenness, Global Change Biol., 21, 3414–3435, 2015. · DOI · Paper page
  16. Fritsch, F. N. and Carlson, R. E.: Monotone piecewise cubic interpolation, SIAM J. Numer. Anal., 17, 238–246, 1980. · DOI · Paper page
  17. Gerten, D., Schaphoff, S., Haberlandt, U., Lucht, W., and Sitch, S.: Terrestrial vegetation and water balance-hydrological evaluation of a dynamic global vegetation model, J. Hydrol., 286, 249–270, 2004. · DOI · Paper page
  18. Giorgi, F., Jones, C., and Asrar, G. R.: Addressing climate information needs at the regional level: the CORDEX framework, World Meteorological Organization (WMO) Bulletin, 58, 175, 2009.
  19. Haerter, J., Hagemann, S., Moseley, C., and Piani, C.: Climate model bias correction and the role of timescales, Hydrol. Earth Syst. Sci., 15, 1065–1079, 2011. · DOI · Paper page
  20. Harris, I., Jones, P., Osborn, T., and Lister, D.: Updated high-resolution grids of monthly climatic observations–the CRU TS3. 10 Dataset, Int. J. Climatol., 34, 623–642, 2014. · DOI · Paper page
  21. Haxeltine, A. and Prentice, I. C.: BIOME3: An equilibrium terrestrial biosphere model based on ecophysiological constraints, resource availability, and competition among plant functional types, Global Biogeochem. Cy., 10, 693–709, 1996. · DOI · Paper page
  22. Haylock, M., Hofstra, N., Klein Tank, A., Klok, E., Jones, P., and New, M.: A European daily high-resolution gridded data set of surface temperature and precipitation for 1950–2006, J. Geophys. Res.-Atmos., 113, 2008. · DOI · Paper page
  23. Hoffmann, H. and Rath, T.: Meteorologically consistent bias correction of climate time series for agricultural models, Theor. Appl. Climatol., 110, 129–141, 2012. · DOI
  24. IPCC: Summary for Policymakers, in: Managing the risks of extreme events and disasters to advance climate change adaptation: special report of the intergovernmental panel on climate change, edited by: Field, C., Barros, V., Stocker, T., Dahe, Q., Dokken, D., Ebi, K., Mastrandrea, M., Mach, K., Plattner, G., Allen, S., Tignor, M., and Midgley, P., Cambridge University Press, 2012.
  25. Jones, P. W.: First-and second-order conservative remapping schemes for grids in spherical coordinates, Mon. Weather Rev., 127, 2204–2210, 1999. · DOI · Paper page
  26. Jung, M., Reichstein, M., Margolis, H. A., Cescatti, A., Richardson, A. D., Arain, M. A., Arneth, A., Bernhofer, C., Bonal, D., Chen, J. Q., Gianelle, D., Gobron, N., Kiely, G., Kutsch, W., Lasslop, G., Law, B. E., Lindroth, A., Merbold, L., Montagnani, L., Moors, E. J., Papale, D., Sottocornola, M., Vaccari, F., and Williams, C.: Global patterns of land-atmosphere fluxes of carbon dioxide, latent heat, and sensible heat derived from eddy covariance, satellite, and meteorological observations, J. Geophys. Res.-Biogeosci., 116, G00J07, 10.1029/2010JG001566, 2011. · DOI · Paper page
  27. Katz, R. W. and Brown, B. G.: Extreme events in a changing climate: variability is more important than averages, Clim. Chang., 21, 289–302, 1992. · DOI · Paper page
  28. Knutti, R.: The end of model democracy?, Clim. Chang., 102, 395–404, 2010. · DOI · Paper page
  29. Leonard, M., Westra, S., Phatak, A., Lambert, M., van den Hurk, B., McInnes, K., Risbey, J., Schuster, S., Jakob, D., and Stafford-Smith, M.: A compound event framework for understanding extreme impacts, Wiley Interdiscip. Rev. Clim. Change, 5, 113–128, 2014. · DOI · Paper page
  30. Li, C., Sinha, E., Horton, D. E., Diffenbaugh, N. S., and Michalak, A. M.: Joint bias correction of temperature and precipitation in climate model simulations, J. Geophys. Res.-Atmos., 119, 13–153, 2014. · DOI
  31. Maraun, D.: Nonstationarities of regional climate model biases in European seasonal mean temperature and precipitation sums, Geophys. Res. Lett., 39, L06706, 10.1029/2012GL051210, 2012. · DOI · Paper page
  32. Maraun, D.: Bias correction, quantile mapping, and downscaling: Revisiting the inflation issue, J. Clim., 26, 2137–2143, 2013. · DOI · Paper page
  33. Maraun, D., Wetterhall, F., Ireson, A. M., Chandler, R. E., Kendon, E. J., Widmann, M., Brienen, S., Rust, H. W., Sauter, T., Themessl, M., Venema, V. K. C., Chun, K. P., Goodess, C. M., Jones, R. G., Onof, C., Vrac, M., and Thiele-Eich, I.: Precipitation downscaling under climate change: Recent developments to bridge the gap between dynamical models and the end user, Rev. Geophys., 48, RG3003, 10.1029/2009RG000314, 2010. · DOI · Paper page
  34. Massey, N., Jones, R., Otto, F., Aina, T., Wilson, S., Murphy, J., Hassell, D., Yamazaki, Y., and Allen, M.: weather@home-development and validation of a very large ensemble modelling system for probabilistic event attribution, Q. J. Roy. Meteor. Soc., 141, 1528–1545, 10.1002/qj.2455, 2014. · DOI · Paper page
  35. Mueller, B. and Seneviratne, S.: Systematic land climate and evapotranspiration biases in CMIP5 simulations, Geophys. Res. Lett., 41, 128–134, 2014. · DOI · Paper page
  36. Piani, C. and Haerter, J.: Two dimensional bias correction of temperature and precipitation copulas in climate models, Geophys. Res. Lett., 39, L20401, 10.1029/2012GL053839, 2012. · DOI · Paper page
  37. Piani, C., Frame, D., Stainforth, D., and Allen, M.: Constraints on climate change from a multi-thousand member ensemble of simulations, Geophys. Res. Lett., 32, L23825, 10.1029/2005GL024452, 2005. · DOI · Paper page
  38. Pope, V., Gallani, M., Rowntree, P., and Stratton, R.: The impact of new physical parametrizations in the Hadley Centre climate model: HadAM3, Clim. Dynam., 16, 123–146, 2000. · DOI · Paper page
  39. Rammig, A., Wiedermann, M., Donges, J., Babst, F., von Bloh, W., Frank, D., Thonicke, K., and Mahecha, M.: Coincidences of climate extremes and anomalous vegetation responses: comparing tree ring patterns to simulated productivity, Biogeosciences, 12, 373–385, 10.5194/bg-12-373-2014, 2014. · doi:10.5194/bg-12-373-2014
  40. Reichstein, M., Bahn, M., Ciais, P., Frank, D., Mahecha, M., Seneviratne, S., Zscheischler, J., Beer, C., Buchmann, N., and Frank, D.: Climate extremes and the carbon cycle, Nature, 500, 287–295, 2013. · DOI · Paper page
  41. Reyer, C. P. O., Leuzinger, S., Rammig, A., Wolf, A., Bartholomeus, R. P., Bonfante, A., de Lorenzi, F., Dury, M., Gloning, P., Abou Jaoudé, R., Klein, T., Kuster, T. M., Martins, M., Niedrist, G., Riccardi, M., Wohlfahrt, G., de Angelis, P., de Dato, G., Francois, L., Menzel, A., and Pereira, M.: A plant's perspective of extremes: terrestrial plant responses to changing climatic variability, Global Change Biol., 19, 75–89, 2013. · DOI · Paper page
  42. Rolinski, S., Rammig, A., Walz, A., von Bloh, W., Van Oijen, M., and Thonicke, K.: A probabilistic risk assessment for the vulnerability of the European carbon cycle to weather extremes: the ecosystem perspective, Biogeosciences, 12, 1813–1831, 10.5194/bg-12-1813-2015, 2015. · DOI
  43. Schaphoff, S., Heyder, U., Ostberg, S., Gerten, D., Heinke, J., and Lucht, W.: Contribution of permafrost soils to the global carbon budget, Environ. Res. Lett., 8, 014026, 10.1088/1748-9326/8/1/014026, 2013. · DOI · Paper page
  44. Schiermeier, Q.: Extreme measures, Nature, 477, 131–132, 2011. · doi:10.1038/477131b
  45. Schulze, E.-D.: Biological control of the terrestrial carbon sink, Biogeosciences, 3, 147–166, 10.5194/bg-3-147-2006, 2006. · DOI · Paper page
  46. Seneviratne, S. I., Lüthi, D., Litschi, M., and Schär, C.: Land–atmosphere coupling and climate change in Europe, Nature, 443, 205–209, 2006. · DOI · Paper page
  47. Seneviratne, S. I., Donat, M. G., Mueller, B., and Alexander, L. V.: No pause in the increase of hot temperature extremes, Nat. Clim. Change, 4, 161–163, 2014. · DOI · Paper page
  48. Sheather, S. J. and Jones, M. C.: A reliable data-based bandwidth selection method for kernel density estimation, J. R. Stat. Soc. Series B Stat. Meth., 53, 683–690, 1991. · DOI · Paper page
  49. Sillmann, J., Kharin, V., Zwiers, F., Zhang, X., and Bronaugh, D.: Climate extremes indices in the CMIP5 multimodel ensemble: Part 2. Future climate projections, J. Geophys. Res.-Atmos., 118, 2473–2493, 2013. · DOI · Paper page
  50. Sippel, S. and Otto, F.: Beyond climatological extremes-assessing how the odds of hydrometeorological extreme events in South-East Europe change in a warming climate, Clim. Change, 125, 381–398, 2014. · DOI · Paper page
  51. Sippel, S., Mitchell, D., Black, M. T., Dittus, A. J., Harrington, L., Schaller, N., and Otto, F. E.: Combining large model ensembles with extreme value statistics to improve attribution statements of rare events, Weather Clim. Extrem., 9, 25–35, 2015a. · DOI · Paper page
  52. Sippel, S., Walton, P., and Otto, F. E.: Stakeholder Perspectives on the Attribution of Extreme Weather Events: An Explorative Enquiry, Weather Clim. Soc., 7, 224–237, 2015b. · DOI · Paper page
  53. Sitch, S., Smith, B., Prentice, I. C., Arneth, A., Bondeau, A., Cramer, W., Kaplan, J. O., Levis, S., Lucht, W., Sykes, M. T., Thonicke, K., and Venevsky, S.: Evaluation of ecosystem dynamics, plant geography and terrestrial carbon cycling in the LPJ dynamic global vegetation model, Global Change Biol., 9, 161–185, 2003. · DOI · Paper page
  54. Stone, D. A., Auffhammer, M., Carey, M., Hansen, G., Huggel, C., Cramer, W., Lobell, D., Molau, U., Solow, A., Tibig, L., and Yohe, G.: The challenge to detect and attribute effects of climate change on human and natural systems, Clim. Change, 121, 381–395, 2013. · DOI · Paper page
  55. Stone, D. A., Allen, M. R., Stott, P. A., Pall, P., Min, S.-K., Nozawa, T., and Yukimoto, S.: The detection and attribution of human influence on climate, Ann. Rev. Environ. Resour., 34, 1–16, 2009. · DOI · Paper page
  56. Stott, P. A. and Walton, P.: Attribution of climate-related events: understanding stakeholder needs, Weather, 68, 274–279, 2013. · DOI
  57. Stott, P. A., Allen, M., Christidis, N., Dole, R. M., Hoerling, M., Huntingford, C., Pall, P., Perlwitz, J., and Stone, D.: Attribution of weather and climate-related events, in: Climate Science for Serving Society, 307–337, Springer, Dordrecht Heidelberg New York London, 2013. · DOI
  58. Teutschbein, C. and Seibert, J.: Bias correction of regional climate model simulations for hydrological climate-change impact studies: Review and evaluation of different methods, J. Hydrol., 456, 12–29, 2012. · DOI · Paper page
  59. Van Oijen, M., Balkovi, J., Beer, C., Cameron, D. R., Ciais, P., Cramer, W., Kato, T., Kuhnert, M., Martin, R., Myneni, R., Rammig, A., Rolinski, S., Soussana, J.-F., Thonicke, K., Van der Velde, M., and Xu, L.: Impact of droughts on the carbon cycle in European vegetation: a probabilistic risk analysis using six vegetation models, Biogeosciences, 11, 6357–6375, 10.5194/bg-11-6357-2014, 2014. · DOI
  60. Vautard, R., Gobiet, A., Jacob, D., Belda, M., Colette, A., Déqué, M., Fernandez, J., García-Díez, M., Goergen, K., Güttler, I., Halenka, T., Karacostas, T., Katragkou, E., Keuler, K., Kotlarski, S., Mayer, S., van Meijgaard, E., Nikulin, G., Patarcic, M., Scinocca, J., Sobolowski, S., Suklitsch, M., Teichmann, C., Warrach-Sagi, K., Wulfmeyer, V., and Yiou, P.: The simulation of European heat waves from an ensemble of regional climate models within the EURO-CORDEX project, Clim. Dyn., 41, 2555–2575, 2013. · DOI · Paper page
  61. von Buttlar, J., Zscheischler, J., and Mahecha, M. D.: An extended approach for spatiotemporal gapfilling: dealing with large and systematic gaps in geoscientific datasets, Nonlinear Proc. Geoph., 21, 203–215, 2014. · DOI
  62. Wang, C., Zhang, L., Lee, S.-K., Wu, L., and Mechoso, C. R.: A global perspective on CMIP5 climate model biases, Nat. Clim. Change, 4, 201–205, 2014. · DOI · Paper page
  63. Weedon, G., Gomes, S., Viterbo, P., Shuttleworth, W., Blyth, E., Österle, H., Adam, J., Bellouin, N., Boucher, O., and Best, M.: Creation of the WATCH forcing data and its use to assess global and regional reference crop evaporation over land during the twentieth century, J. Hydrometeorol., 12, 823–848, 2011. · DOI · Paper page
  64. Weedon, G., Balsamo, G., Bellouin, N., Gomes, S., Best, M. J., and Viterbo, P.: The WFDEI meteorological forcing data set: WATCH Forcing Data methodology applied to ERA-Interim reanalysis data, Water Resour. Res., 50, 7505–7514, 2014. · DOI · Paper page
  65. Wood, A. W., Leung, L. R., Sridhar, V., and Lettenmaier, D.: Hydrologic implications of dynamical and statistical approaches to downscaling climate model outputs, Clim. Chang., 62, 189–216, 2004. · DOI · Paper page
  66. Zscheischler, J., Mahecha, M. D., von Buttlar, J., Harmeling, S., Jung, M., Rammig, A., Randerson, J. T., Schölkopf, B., Seneviratne, S. I., Tomelleri, E., Zaehle, S., and Reichstein, M.: A few extreme events dominate global interannual variability in gross primary production, Environ. Res. Lett., 9, 035001, 2014a. · DOI · Paper page
  67. Zscheischler, J., Reichstein, M., Harmeling, S., Rammig, A., Tomelleri, E., and Mahecha, M. D.: Extreme events in gross primary production: a characterization across continents, Biogeosciences, 11, 2909–2924, 10.5194/bg-11-2909-2014, 2014.b. · DOI

Cited by

See all 84

Metadata

Authors
Sippel, S., Otto, F. E. L., Forkel, M., Allen, M. R., Guillod, B. P., Heimann, M., Reichstein, M., Seneviratne, S. I., Thonicke, K., & Mahecha, M. D.
Venue
Earth System Dynamics
Published
2016-02-02
Volume
7
Issue
1
Pages
71-88
ISSN
  • 2190-4979 (ISSN-L)
  • 2190-4987
OpenAlex
W1774403588
Cited by
84
References
14
FWCI
11.69
Type
journal article
Language
en
Open access
gold
Funders
Studienstiftung des Deutschen Volkes (-)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.