How Much Should We Trust the Dictator’s GDP Growth Estimates?
Open accessThe DOI matches its Crossref record; 69 of the 70 references it cites were found in a registry or an index.
Abstract
I study the overstatement of economic growth in autocracies by comparing self-reported GDP figures to night-time light recorded by satellites from outer space. I show that the night-time-light elasticity of GDP is larger in authoritarian regimes, even accounting for differences in multiple country characteristics. This autocracy gradient in the elasticity is greater when the incentive to exaggerate economic growth is stronger or when the constraints on exaggeration are weaker. The results suggest that autocracies overstate yearly GDP growth by approximately 35%. Adjusting the data for manipulation leads to a more nuanced view on the recent economic success of autocracies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Econometric policy evaluation: A critique
Lucas, R. E. (1976) · Carnegie-Rochester Conference Series on Public Policy · doi:10.1016/s0167-2231(76)80003-6 · Cited by 6,110
Competitive Authoritarianism: Hybrid Regimes after the Cold War
Levitsky, S., & Way, L. A. (2010) · doi:10.1017/cbo9780511781353 · Cited by 3,459 · cited 6×
“Many of them do not hold elections, although there has been a recent increase in the number of hybrid regimes that do so (Levitsky and Way, 2010).”
InfluentialDemocracy and Development: Political Institutions and Well-Being in the World, 1950–1990
Przeworski, A., Alvarez, M. E., Cheibub, J. A., & Limongi, F. (2000) · doi:10.1017/cbo9780511804946 · Cited by 2,845
Measuring Economic Growth from Outer Space
Henderson, J. V., Storeygard, A., & Weil, D. N. (2012) · American Economic Review · doi:10.1257/aer.102.2.994 · Cited by 2,596 · cited 18×
“This set-up is very similar to Henderson et al. (2012) and Pinkovskiy and Sala-i Martin (2016). The two innovations are the explicit distinction between the sources of economic growth in democracies and autocracies and the possibility of manipulation of GDP growth figures in the latter.”
InfluentialDemocracy and dictatorship revisited
Cheibub, J. A., Gandhi, J., & Vreeland, J. R. (2010) · Public Choice · doi:10.1007/s11127-009-9491-2 · Cited by 2,481 · cited 1×
“Political regimes are defined based on information from Freedom House and Cheibub et al. (2010). See Appendix text for details.”
How Censorship in China Allows Government Criticism but Silences Collective Expression
KING, G., PAN, J., & ROBERTS, M. E. (2013) · American Political Science Review · doi:10.1017/s0003055413000014 · Cited by 2,415 · cited 3×
“and Leigh, A. (2010). Do Output Contractions Trigger Democratic Change? American Economic Journal: Macroeconomics, 2(4):124–57.”
Kamenica, E., & Gentzkow, M. (2011) · American Economic Review · doi:10.1257/aer.101.6.2590 · Cited by 1,903 · cited 1×
“7 Gehlbach, Sonin, and Svolik (2016, 578) provide a sketch of a model of manipulation of information in autocracies, in the spirit of Kamenica and Gentzkow (2011).”
Monitoring Corruption: Evidence from a Field Experiment in Indonesia
Olken, B. A. (2007) · Journal of Political Economy · doi:10.1086/517935 · Cited by 1,593
Acemoglu, D., Naidu, S., Restrepo, P., & Robinson, J. A. (2019) · Journal of Political Economy · doi:10.1086/700936 · Cited by 1,524 · cited 5×
“I also consider a hybrid measure of democracy proposed by Acemoglu et al. (2016), which combines information from Freedom House, Polity IV and DD. I use the FiW index as the baseline measure of autocracy for several reasons. Relative to other sources of information, Freedom House has data for a larger number of countr…”
InfluentialUsing luminosity data as a proxy for economic statistics
Chen, X., & Nordhaus, W. D. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1017031108 · Cited by 1,188 · cited 10×
“Chen, X. and Nordhaus, W. D. (2011). Using Luminosity Data as a Proxy for Economic Statistics. Proceedings of the National Academy of Sciences, 108(21):8589–8594. Chen, Y., Li, H., and Zhou, L.-A. (2005). Relative Performance Evaluation and the Turnover of Provincial Leaders in China. Economics Letters, 88(3):421 – 42…”
InfluentialKING, G., PAN, J., & ROBERTS, M. E. (2017) · American Political Science Review · doi:10.1017/s0003055417000144 · Cited by 1,028 · cited 1×
“King, Pan, and Roberts (2013, 2017) document censorship and fabrication of online content.”
Tax Rates and Tax Evasion: Evidence from “Missing Imports” in China
Fisman, R., & Wei, S. (2004) · Journal of Political Economy · doi:10.1086/381476 · Cited by 749 · cited 1×
“…source of discrepancy between sources.4 Relatedly, I also contribute to the burgeoning literature in forensic economics (Zitzewitz 2012), where I follow the lead of previous studies that compare data from different sources to uncover hidden behavior (Fisman and Wei 2004, 2009; Olken 2007).”
Hodler, R., & Raschky, P. A. (2014) · The Quarterly Journal of Economics · doi:10.1093/qje/qju004 · Cited by 709
Mapping regional economic activity from night-time light satellite imagery
Doll, C. N. H., Muller, J.-P., & Morley, J. G. (2006) · Ecological Economics · doi:10.1016/j.ecolecon.2005.03.007 · Cited by 692 · cited 1×
“…5 byi,t 1 ei,t , (2) ĝi,t 5 ð1 1 jai,tÞgi,t : (3) Several studies have documented a positive and robust correlation between economic activity and night-time light recorded by satellites from outer space (Doll, Muller, and Morley 2006; Chen and Nordhaus 2011; Henderson, Storeygard, and Weil 2012).”
Measuring Poverty in a Growing World (or Measuring Growth in a Poor World)
Deaton, A. (2005) · Review of Economics and Statistics · doi:10.1162/0034653053327612 · Cited by 673
Lorentzen, P. (2014) · American Journal of Political Science · doi:10.1111/ajps.12065 · Cited by 602 · cited 2×
“…which they interpret as evidence of data manipulation.3 The econometric model I develop 1 Theoretical papers on this topic include Egorov, Guriev, and Sonin (2009), Edmond (2013), Gehlbach and Sonin (2014), Lorentzen (2014), Gehlbach, Sonin, and Svolik (2016), and Guriev and Treisman (2020).”
Media and Political Persuasion: Evidence from Russia
Enikolopov, R., Petrova, M., & Zhuravskaya, E. (2011) · American Economic Review · doi:10.1257/aer.101.7.3253 · Cited by 568 · cited 1×
“However, these elections are not effective tools for political accountability, as they are easily manipulated through the intimidation of opponents, political propaganda, or outright fraud (Enikolopov, Petrova, and Zhuravskaya 2011; Enikolopov et al. 2013).”
Guriev, S., & Treisman, D. (2019) · Journal of Economic Perspectives · doi:10.1257/jep.33.4.100 · Cited by 560
Why Resource-poor Dictators Allow Freer Media: A Theory and Evidence from Panel Data
EGOROV, G., GURIEV, S., & SONIN, K. (2009) · American Political Science Review · doi:10.1017/s0003055409990219 · Cited by 546
Electoral Accountability: Recent Theoretical and Empirical Work
Ashworth, S. (2012) · Annual Review of Political Science · doi:10.1146/annurev-polisci-031710-103823 · Cited by 535 · cited 1×
“In democracies, canonical models of political accountability predict that voters base their decisions on observable measures of government performance (Ashworth 2012).”
Papaioannou, E., & Siourounis, G. (2008) · The Economic Journal · doi:10.1111/j.1468-0297.2008.02189.x · Cited by 470
Hollyer, J. R., Rosendorff, B. P., & Vreeland, J. R. (2011) · The Journal of Politics · doi:10.1017/s0022381611000880 · Cited by 450
Information Manipulation, Coordination, and Regime Change*
Edmond, C. (2013) · The Review of Economic Studies · doi:10.1093/restud/rdt020 · Cited by 433
Rain and the Democratic Window of Opportunity
(2011) · Econometrica · doi:10.3982/ecta8183 · Cited by 429
Poor Numbers: How We Are Misled by African Development Statistics and What to Do about It
Jerven, M. (2019) · Cornell University Press eBooks · doi:10.7591/9780801467615 · Cited by 428
Government control of the media
Gehlbach, S., & Sonin, K. (2014) · Journal of Public Economics · doi:10.1016/j.jpubeco.2014.06.004 · Cited by 425
GDP: a brief but affectionate history
(2014) · Choice Reviews Online · doi:10.5860/choice.52-0370 · Cited by 423 · cited 2×
“They increasingly rely on their alleged 5 Systematic measurement of national income only began in the 1930s and became increasingly sophisticated in response to the need for detailed economic information during World War II (Coyle 2014).”
Juking the Stats? Authoritarian Information Problems in China
Wallace, J. L. (2016) · British Journal of Political Science · doi:10.1017/s0007123414000106 · Cited by 360 · cited 3×
“3 Wallace (2016) provides a similar result using electricity consumption.”
Liberation Technology: Mobile Phones and Political Mobilization in Africa
Manacorda, M., & Tesei, A. (2020) · Econometrica · doi:10.3982/ecta14392 · Cited by 339
von Hagen, J., & Wolff, G. B. (2006) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2006.05.011 · Cited by 302 · cited 1×
“Another strand of literature has studied creative accounting in response to EU budget rules (von Hagen and Wolff 2006; Alt, Lassen, and Wehner 2014).”
BackgroundPower and the Vote: Elections and Electricity in the Developing World
Min, B. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781316272121 · Cited by 284
Lights, Camera … Income! Illuminating the National Accounts-Household Surveys Debate *
Pinkovskiy, M., & Sala-i-Martin, X. (2016) · The Quarterly Journal of Economics · doi:10.1093/qje/qjw003 · Cited by 281 · cited 3×
“Table D12 replicates the analysis using NTL data from previous studies, including Henderson, Storeygard, and Weil (2012) and Pinkovskiy and Sala-i-Martin (2016).”
Can Technology Solve the Principal-Agent Problem? Evidence from China’s War on Air Pollution
Greenstone, M., He, G., Jia, R., & Liu, T. (2022) · American Economic Review: Insights · doi:10.1257/aeri.20200373 · Cited by 271
Young, A. (2012) · Journal of Political Economy · doi:10.1086/668501 · Cited by 259 · cited 2×
“This paper also complements a strand of literature that has used data from various other sources to assess and complement the information on living standards contained in the national accounts (Deaton, 2005; Chen and Nordhaus, 2011; Henderson et al., 2012; Young, 2012; Pinkovskiy and Sala-i Martin, 2014, 2016).”
The Impact of Media Censorship: 1984 or Brave New World?
Chen, Y., & Yang, D. Y. (2019) · American Economic Review · doi:10.1257/aer.20171765 · Cited by 250 · cited 1×
“Modern autocracies are characterized by strict controls over information (Chen and Yang 2019).”
BackgroundTransparency, Protest, and Autocratic Instability
HOLLYER, J. R., ROSENDORFF, B. P., & VREELAND, J. R. (2015) · American Political Science Review · doi:10.1017/s0003055415000428 · Cited by 246 · cited 1×
“One prominent alternative explanation for the main result revolves around limitations in statistical capacity thatmay prevent some countries, gdp growth estimates in autocracies 2749 which happen to disproportionately be dictatorships, from accurately measuring economic activity ( Jerven 2013).”
Formal Models of Nondemocratic Politics
Gehlbach, S., Sonin, K., & Svolik, M. W. (2016) · Annual Review of Political Science · doi:10.1146/annurev-polisci-042114-014927 · Cited by 227 · cited 2×
“…which they interpret as evidence of data manipulation.3 The econometric model I develop 1 Theoretical papers on this topic include Egorov, Guriev, and Sonin (2009), Edmond (2013), Gehlbach and Sonin (2014), Lorentzen (2014), Gehlbach, Sonin, and Svolik (2016), and Guriev and Treisman (2020).”
A theory of informational autocracy
Guriev, S., & Treisman, D. (2020) · Journal of Public Economics · doi:10.1016/j.jpubeco.2020.104158 · Cited by 205
Online and official price indexes: Measuring Argentina’s inflation
Cavallo, A. (2013) · Journal of Monetary Economics · doi:10.1016/j.jmoneco.2012.10.002 · Cited by 204
Understanding National Accounts: Second Edition
Lequiller, F., & Blades, D. (2014) · OECD eBooks · doi:10.1787/9789264214637-en · Cited by 198
Cities and Stability: Urbanization, Redistribution, and Regime Survival in China
Wallace, J. (2014) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199378982.001.0001 · Cited by 181 · cited 1×
“In Table D4, I further consider the impact of changes in population growth and urbanization rates, which plausibly correlate with regime type and could naturally affect the mapping of changes in NTL to changes in GDP (Wallace, 2014).”
Do Output Contractions Trigger Democratic Change?
Burke, P. J., & Leigh, A. (2010) · American Economic Journal: Macroeconomics · doi:10.1257/mac.2.4.124 · Cited by 176
The effect of aid on growth: evidence from a Quasi-experiment
Galiani, S., Knack, S., Xu, L. C., & Zou, B. (2017) · Journal of Economic Growth · doi:10.1007/s10887-016-9137-4 · Cited by 168
Field experiment estimate of electoral fraud in Russian parliamentary elections
Enikolopov, R., Korovkin, V., Petrova, M., Sonin, K., & Zakharov, A. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1206770110 · Cited by 160 · cited 1×
“However, these elections are not effective tools for political accountability, as they are easily manipulated through the intimidation of opponents, political propaganda, or outright fraud (Enikolopov, Petrova, and Zhuravskaya 2011; Enikolopov et al. 2013).”
LETTER GRADING GOVERNMENT EFFICIENCY
Chong, A., La Porta, R., Lopez-de-Silanes, F., & Shleifer, A. (2014) · Journal of the European Economic Association · doi:10.1111/jeea.12076 · Cited by 155 · cited 5×
“Table D8 looks at a complementary measure of state capacity using data from Chong et al. (2014) on the number of days it takes for a wrongly-addressed letter to be returned.”
InfluentialFisman, R., & Wei, S.-J. (2009) · American Economic Journal: Applied Economics · doi:10.1257/app.1.3.82 · Cited by 151
Zitzewitz, E. (2012) · Journal of Economic Literature · doi:10.1257/jel.50.3.731 · Cited by 147 · cited 2×
“…manipulation as a potential source of discrepancy between sources.4 Relatedly, I also contribute to the burgeoning literature in forensic economics (Zitzewitz 2012), where I follow the lead of previous studies that compare data from different sources to uncover hidden behavior (Fisman and Wei…”
It Isn't Just about Greece: Domestic Politics, Transparency and Fiscal Gimmickry in Europe
Alt, J. E., Lassen, D. D., & Wehner, J. (2014) · British Journal of Political Science · doi:10.1017/s0007123414000064 · Cited by 144 · cited 1×
“Another strand of literature has studied creative accounting in response to EU budget rules (von Hagen and Wolff 2006; Alt, Lassen, and Wehner 2014).”
Pinkovskiy, M. L., & Sala-i-Martín, X. (2014) · Journal of Economic Growth · doi:10.1007/s10887-014-9103-y · Cited by 142 · cited 1×
“This setup is very similar to those in Henderson, Storeygard, and Weil (2012) and Pinkovskiy and Sala-i-Martin (2016). The main innovation is”
The Political Economy of Bad Data: Evidence from African Survey and Administrative Statistics
Sandefur, J., & Glassman, A. (2015) · The Journal of Development Studies · doi:10.1080/00220388.2014.968138 · Cited by 142 · cited 1×
“Sandefur and Glassman (2015) study misinformation by public employees in charge of service provision in the developing world.”
Does the World Economy Swing National Elections?*
Leigh, A. (2009) · Oxford Bulletin of Economics and Statistics · doi:10.1111/j.1468-0084.2008.00545.x · Cited by 137 · cited 3×
“autocracies (Leigh 2009; Burke and Leigh 2010; Brückner and Ciccone 2011).”
Reconsidering Regime Type and Growth: Lies, Dictatorships, and Statistics
Magee, C., & Doces, J. A. (2014) · International Studies Quarterly · doi:10.1111/isqu.12143 · Cited by 126 · cited 1×
“In related work, Magee and Doces (2015) report a positive correlation between GDP growth and autocracy after controlling for NTL growth, which they interpret as evidence of data manipulation.3 The econometric model I develop 1 Theoretical papers on this topic include Egorov, Guriev, and Sonin…”
Information Manipulation, Coordination and Regime ChangePreprint
Edmond, C. (2007) · SSRN Electronic Journal · doi:10.2139/ssrn.1026312 · Cited by 125
Are Chinese Growth and Inflation Too Smooth? Evidence from Engel Curves
Nakamura, E., Steinsson, J., & Liu, M. (2016) · American Economic Journal Macroeconomics · doi:10.1257/mac.20150074 · Cited by 117
A Tear in the Iron Curtain: The Impact of Western Television on Consumption Behavior
Bursztyn, L., & Cantoni, D. (2016) · Review of Economics and Statistics · doi:10.1162/rest_a_00522 · Cited by 116
(2017) · Macat Library eBooks · doi:10.4324/9781912282104 · Cited by 115
A Forensic Examination of China's National Accounts
Chen, W., Chen, X., Hsieh, C., & Song, Z. M. (2019) · Brookings Papers on Economic Activity · doi:10.1353/eca.2019.0001 · Cited by 109 · cited 5×
“Some studies argue that Chinese GDP growth has been systematically exaggerated in the national accounts (Young, 2003; Madisson, 2006; Chen et al., 2019).”
InfluentialDo Countries Falsify Economic Data Strategically? Some Evidence That They Might
Michalski, T., & Stoltz, G. (2010) · The Review of Economics and Statistics · doi:10.1162/rest_a_00274 · Cited by 107 · cited 3×
“More generally, Michalski and Stoltz (2013) find that balance of payments data fail to satisfy Benford’s law. gdp growth estimates in autocracies 2735 suggests that this result could be confounded by differences in the mapping of real growth to NTL across political regimes or by differential rates…”
InfluentialThe Distortionary Effects of Incentives in Government: Evidence from China's “Death Ceiling” Program
Fisman, R. J., & Wang, Y. (2017) · American Economic Journal Applied Economics · doi:10.1257/app.20160008 · Cited by 102 · cited 1×
“2 Research on China’s official statistics includes GDP growth (Mehrotra and Pääkkönen 2011; Nakamura, Steinsson, and Liu 2016; Chen et al. 2019; Clark, Pinkovskiy, and Sala-iMartin 2020), air pollution (Greenstone et al. 2022), and workplace safety (Fisman and Wang 2017).”
BackgroundSoviet growth and American textbooks: An endogenous past
Levy, D. M., & Peart, S. J. (2011) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2010.12.012 · Cited by 81 · cited 1×
“However, Levy and Peart (2011) document the systematic overestimation of the Soviet Union’s GDP growth rate in widely used economics textbooks throughout the twentieth century.”
China's GDP growth may be understated
Clark, H. L., Pinkovskiy, M. L., & Sala-i-Martín, X. (2018) · China Economic Review · doi:10.1016/j.chieco.2018.10.010 · Cited by 76
Does it pay to be poor? Testing for systematically underreported GNI estimates
Kerner, A., Jerven, M., & Beatty, A. (2015) · The Review of International Organizations · doi:10.1007/s11558-015-9239-3 · Cited by 51 · cited 1×
“Kerner, Jerven, and Beatty (2017) argue that countries that are highly dependent on foreign aid manipulate GNI around the IDA eligibility threshold.”
Updated data on institutions and elections 1960–2012: presenting the IAEP dataset version 2.0
Wig, T., Hegre, H., & Regan, P. M. (2015) · Research & Politics · doi:10.1177/2053168015579120 · Cited by 50 · cited 3×
“Appendix Table C1 provides basic correlations of the FIW index with observable political characteristics from the IAEP dataset (Wig et al., 2015).”
The 1937 census and the limits of Stalinist rule
Merridale, C. (1996) · The Historical Journal · doi:10.1017/s0018246x00020744 · Cited by 40 · cited 4×
“The execution of the civil servants in charge of the 1937 population census of the USSR following its unsatisfactory findings serves as an extreme example (Merridale, 1996).”
InfluentialComparing China’s GDP statistics with coincident indicators
Mehrotra, A. N., & Pääkkönen, J. (2011) · Journal of Comparative Economics · doi:10.1016/j.jce.2011.03.003 · Cited by 38
Learning from Potentially Biased Statistics
Cavallo, A. F., Cruces, G., & Truglia, R. N. P. (2016) · Brookings Papers on Economic Activity · doi:10.1353/eca.2016.0013 · Cited by 36
Can Technology Solve the Principal-Agent Problem? Evidence from Chinaâ's War on Air PollutionPreprint
Greenstone, M. A., He, G., Jia, R., & Liu, T. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3649866 · Cited by 21
THE ESTABLISHMENT, REFORM, AND DEVELOPMENT OF CHINA'S SYSTEM OF NATIONAL ACCOUNTS
Xu, X. (2009) · Review of Income and Wealth · doi:10.1111/j.1475-4991.2009.00326.x · Cited by 17 · cited 1×
“In the case of China, the transition started in 1985 and ended in 1992 (Xu 2009).”
BackgroundComparing China's GDP Statistics with Coincident IndicatorsPreprint
Mehrotra, A. N., & Pääkkönen, J. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1767811 · Cited by 6
Research works printed but not linked: 9
- Bueno de Mesquita B., 2004, Cambridge, MA: MIT Press.
- Chen Y., 2019, A.E.R., 109, 2294
- Enikolopov R., 2011, A.E.R., 101, 3253
- Freedom House, 2021, Freedom in the World 2021 Methodology
- Henderson J. V., 2012, A.E.R., 102, 994
- Kamenica E., 2011, A.E.R., 101, 2590
- Lequiller F., 2014, Paris: OECD.
- Li X., 2020, Nature: Sci. Data, 7, 1
- Montesquieu C., The Spirit of the Laws. Translated and edited by A. M. Cohler et al
Cited by
NIGHT LIGHTS IN ECONOMICS: SOURCES AND USES1
Gibson, J., Olivia, S., & Boe‐Gibson, G. (2020) · Journal of Economic Surveys · doi:10.1111/joes.12387 · Cited by 181
GDP Growth Incentives and Earnings Management: Evidence from China
Chen, X., Cheng, Q., Hao, Y., & Liu, Q. (2019) · Review of Accounting Studies · doi:10.1007/s11142-020-09547-8 · Cited by 138
Policy Experimentation in China: The Political Economy of Policy Learning
Wang, S., & Yang, D. Y. (2025) · Journal of Political Economy · doi:10.1086/734873 · Cited by 149
Cornell, A., Knutsen, C. H., & Teorell, J. (2020) · Comparative Political Studies · doi:10.1177/0010414020912262 · Cited by 124
Measuring the size and growth of cities using nighttime light
Ch, R., Martin, D. A., & Vargas, J. F. (2020) · Journal of Urban Economics · doi:10.1016/j.jue.2020.103254 · Cited by 100
Metadata
- Authors
- Martínez, L. R.
- Venue
- Journal of Political Economy
- Publisher
- University of Chicago Press
- Published
- 2022-10-01
- Volume
- 130
- Issue
- 10
- Pages
- 2731-2769
- ISSN
- 0022-3808 (ISSN-L)
- 1537-534X
- OpenAlex
- W4226247813
- Cited by
- 228
- References
- 70
- Citations by year
- 2026: 37 · 2025: 66 · 2024: 52 · 2023: 47 · 2022: 20
- FWCI
- 18.41
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- Journal of Political Economy (publishedVersion)
- SSRN Electronic Journal (acceptedVersion)
- Topics
- Physical Sciences › Environmental Science › Global and Planetary Change › Impact of Light on Environment and Health
- Social Sciences › Sociology and Political Science › Corruption and Economic Development
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Economic Growth and Productivity
- Keywords
- authoritarian regimes, nighttime lights, satellite data, data manipulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.