The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Macroeconomics and Reality
Abstract
Existing strategies for econometric analysis related to macroeconomics are subject to a number of serious objections, some recently formulated, some old. These objections are summarized in this paper, and it is argued that taken together they make it unlikely that macroeconomic models are in fact over identified, as the existing statistical theory usually assumes. The implications of this conclusion are explored, and an example of econometric work in a non-standard style, taking account of the objections to the standard style, is presented. THE STUDY OF THE BUSINESS cycle, fluctuations in aggregate measures of economic activity and prices over periods from one to ten years or so, constitutes or motivates a large part of what we call macroeconomics. Most economists would agree that there are many macroeconomic variables whose cyclical fluctuations are of interest, and would agree further that fluctuations in these series are interrelated. It would seem to follow almost tautologically that statistical models involving large numbers of macroeconomic variables ought to be the arena within which macroeconomic theories confront reality and thereby each other. Instead, though large-scale statistical macroeconomic models exist and are by some criteria successful, a deep vein of skepticism about the value of these models runs through that part of the economics profession not actively engaged in constructing or using them. It is still rare for empirical research in macroeconomics to be planned and executed within the framework of one of the large models. In this lecture I intend to discuss some aspects of this situation, attempting both to offer some explanations and to suggest some means for improvement. I will argue that the style in which their builders construct claims for a connection between these models and reality-the style in which is achieved for these models-is inappropriate, to the point at which claims for identification in these models cannot be taken seriously. This is a venerable assertion; and there are some good old reasons for believing it;2 but there are also some reasons which have been more recently put forth. After developing the conclusion that the identification claimed for existing large-scale models is incredible, I will discuss what ought to be done in consequence. The line of argument is: large-scale models do perform useful forecasting and policy-analysis functions despite their incredible identification; the restrictions imposed in the usual style of identification are neither essential to constructing a model which can perform these functions nor innocuous; an alternative style of identification is available and practical. Finally we will look at some empirical work based on an alternative style of macroeconometrics. A six-variable dynamic system is estimated without using 1 Research for this paper was supported by NSF Grant Soc-76-02482. Lars Hansen executed the computations. The paper has benefited from comments by many people, especially Thomas J. Sargent
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Conditional logit analysis of qualitative choice behavior
McFadden, D. L. (1972) · eScholarship (California Digital Library) · Cited by 14,203
Rules Rather than Discretion: The Inconsistency of Optimal Plans
Kydland, F. E., & Prescott, E. C. (1977) · Journal of Political Economy · doi:10.1086/260580 · Cited by 7,905
"Rational" Expectations, the Optimal Monetary Instrument, and the Optimal Money Supply Rule
Sargent, T. J., & Wallace, N. (1975) · Journal of Political Economy · doi:10.1086/260321 · Cited by 2,168
Kendall, M. G., & Ord, J. K. (1973) · Cited by 1,356
Pitfalls in Financial Model-BuildingPreprint
Brainard, W. C., & Tobin, J. G. (1968) · RePEc: Research Papers in Economics · Cited by 1,037
Business Cycle Modeling Without Pretending to Have Too Much A Priori Economic Theory
Sims, C. A., & Sargent, T. J. (1977) · doi:10.21034/wp.55 · Cited by 641
Self-citationThe Prediction Performance of the FRB-MIT-PENN Model of the U.S. Economy
Nelson, C. R. (1972) · American Economic Review · Cited by 399
Inflation: Its Mechanics and Welfare Costs
Okun, A. M., Fellner, W., & Wachter, M. (1975) · Brookings Papers on Economic Activity · doi:10.2307/2534106 · Cited by 225
The Rigidity of Wages and the Persistence of Unemployment
Hall, R. E., Sims, C. A., Solow, R. M., & Gordon, R. A. (1975) · Brookings Papers on Economic Activity · doi:10.2307/2534105 · Cited by 156
Self-citationOn the Structural Form of Interdependent Systems
Hurwicz, L. (1966) · Studies in logic and the foundations of mathematics · doi:10.1016/s0049-237x(09)70590-7 · Cited by 153
Cited by
Postwar U.S. Business Cycles: An Empirical Investigation
Hodrick, R. J., & Prescott, E. C. (1997) · Journal of Money, Credit and Banking · doi:10.2307/2953682 · Cited by 7,349
Generalized impulse response analysis in linear multivariate models
Pesaran, H. H., & Shin, Y. (1998) · Economics Letters · doi:10.1016/s0165-1765(97)00214-0 · Cited by 6,097
Time to Build and Aggregate Fluctuations
Kydland, F. E., & Prescott, E. C. (1982) · Econometrica · doi:10.2307/1913386 · Cited by 5,825
Better to give than to receive: Predictive directional measurement of volatility spillovers
Diebold, F. X., & Yilmaz, K. (2012) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2011.02.006 · Cited by 5,756
Estimation and Inference of Impulse Responses by Local Projections
Jordà, Ò. (2005) · American Economic Review · doi:10.1257/0002828053828518 · Cited by 4,677
On the network topology of variance decompositions: Measuring the connectedness of financial firms
Diebold, F. X., & Yılmaz, K. (2014) · Journal of Econometrics · doi:10.1016/j.jeconom.2014.04.012 · Cited by 4,642
A Survey of Weak Instruments and Weak Identification in Generalized Method of Moments
Stock, J. H., Wright, J. H., & Yogo, M. (2002) · Journal of Business & Economic Statistics · doi:10.1198/073500102288618658 · Cited by 4,274
Inside the black box: the credit channel of monetary policy transmission
Bernanke, B. S., & Gertler, M. (1995) · Journal of Economic Perspectives · doi:10.1257/jep.9.4.27 · Cited by 4,211
Empirical exchange rate models of the seventies
Meese, R. A., & Rogoff, K. (1983) · Journal of International Economics · doi:10.1016/0022-1996(83)90017-x · Cited by 4,107
Oil and the Macroeconomy since World War II
Hamilton, J. D. (1983) · Journal of Political Economy · doi:10.1086/261140 · Cited by 3,786
Introductory Econometrics for Finance
Brooks, C. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108524872 · Cited by 3,657
Detecting Causality in Complex Ecosystems
Sugihara, G., May, R., Ye, H., Hsieh, C.-H., Deyle, E., Fogarty, M., & Munch, S. (2012) · Science · doi:10.1126/science.1227079 · Cited by 2,539
Trusov, M., Bucklin, R. E., & Pauwels, K. (2009) · Journal of Marketing · doi:10.1509/jmkg.73.5.90 · Cited by 2,451
What are the effects of monetary policy on output? Results from an agnostic identification procedure
Uhlig, H. (2005) · Journal of Monetary Economics · doi:10.1016/j.jmoneco.2004.05.007 · Cited by 2,307
Let's Take the Con out of Econometrics
Leamer, E. E. (2026) · Journal of Business Cycle Research · doi:10.1007/s41549-026-00137-2 · Cited by 2,202
Forecasting and testing in co-integrated systems
Engle, R. F., & Yoo, B. S. (1987) · Journal of Econometrics · doi:10.1016/0304-4076(87)90085-6 · Cited by 1,867
Interpreting the macroeconomic time series facts
Sims, C. A. (1992) · European Economic Review · doi:10.1016/0014-2921(92)90041-t · Cited by 1,855
Self-citationCampbell, J. Y. (1996) · Journal of Political Economy · doi:10.1086/262026 · Cited by 1,785
Angrist, J. D., & Pischke, J.-S. (2010) · Journal of Economic Perspectives · doi:10.1257/jep.24.2.3 · Cited by 1,566
Alternative explanations of the money-income correlation
Bernanke, B. S. (1986) · Carnegie-Rochester Conference Series on Public Policy · doi:10.1016/0167-2231(86)90037-0 · Cited by 1,497
Chapter 2 Monetary policy shocks: What have we learned and to what end?
Christiano, L. J., Eichenbaum, M., & Evans, C. L. (1999) · Handbook of Macroeconomics · doi:10.1016/s1574-0048(99)01005-8 · Cited by 1,479
Modeling Regional Interdependencies Using a Global Error-Correcting Macroeconometric Model
Pesaran, M. H., Schuermann, T., & Weiner, S. M. (2004) · Journal of Business & Economic Statistics · doi:10.1198/073500104000000019 · Cited by 1,456
Emerging Market Business Cycles: The Cycle Is the Trend
Aguiar, M., & Gopinath, G. (2007) · Journal of Political Economy · doi:10.1086/511283 · Cited by 1,439
International Transmission of Stock Market Movements
Eun, C. S., & Shim, S. (1989) · The Journal of Financial and Quantitative Analysis · doi:10.2307/2330774 · Cited by 1,412
Pitfalls and Opportunities: What Macroeconomists Should Know about Unit Roots
Campbell, J. Y., & Perron, P. (1991) · NBER Macroeconomics Annual · doi:10.1086/654163 · Cited by 1,255
Risk, uncertainty and monetary policy
Bekaert, G., Hoerova, M., & Lo Duca, M. (2013) · Journal of Monetary Economics · doi:10.1016/j.jmoneco.2013.06.003 · Cited by 1,235
Handbook of Economic Forecasting
(2013) · Handbook of Economic Forecasting · doi:10.1016/b978-0-444-53683-9.00023-2 · Cited by 1,210
Forecasting and Conditional Projection Using Realistic Prior Distributions
Doan, T., Litterman, R., & Sims, C. (1983) · National Bureau of Economic Research · doi:10.3386/w1202 · Cited by 1,206
Self-citationForecasting and conditional projection using realistic prior distributions
Doan, T., Litterman, R., & Sims, C. (1984) · Econometric Reviews · doi:10.1080/07474938408800053 · Cited by 1,202
Self-citationThe World Price of Earnings Opacity
Bhattacharya, U., Daouk, H., & Welker, M. (2003) · The Accounting Review · doi:10.2308/accr.2003.78.3.641 · Cited by 1,201
Stock, J. H., & Watson, M. W. (2001) · Journal of Economic Perspectives · doi:10.1257/jep.15.4.101 · Cited by 1,150
Hendry, D. F. (1995) · doi:10.1093/0198283164.001.0001 · Cited by 1,148
Forecasting With Bayesian Vector Autoregressions—Five Years of Experience
Litterman, R. B. (1986) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1986.10509491 · Cited by 1,137
Peasants or Bankers? The American Electorate and the U.S. Economy
MacKuen, M. B., Erikson, R. S., & Stimson, J. A. (1992) · American Political Science Review · doi:10.2307/1964124 · Cited by 1,093
Leeper, E. M., Sims, C. A., Zha, T., Hall, R. E., & Bernanke, B. S. (1996) · Brookings Papers on Economic Activity · doi:10.2307/2534619 · Cited by 1,056
Self-citationFederal Reserve Information and the Behavior of Interest Rates
Romer, C. D., & Romer, D. H. (2000) · American Economic Review · doi:10.1257/aer.90.3.429 · Cited by 1,047
Estimation of Panel Vector Autoregression in Stata
Abrigo, M. R. M., & Love, I. (2016) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x1601600314 · Cited by 1,019
Charfeddine, L., & Kahia, M. (2019) · Renewable Energy · doi:10.1016/j.renene.2019.01.010 · Cited by 1,006
Macroeconomic Shocks and Their Propagation
(2016) · Handbook of Macroeconomics · doi:10.1016/bs.hesmac.2016.03.003 · Cited by 1,001
Common stochastic trends in international stock markets
Kasa, K. (1992) · Journal of Monetary Economics · doi:10.1016/0304-3932(92)90025-w · Cited by 944
The contribution of tourism development to economic growth in the Korean economy
Oh, C.-O. (2005) · Tourism Management · doi:10.1016/j.tourman.2003.09.014 · Cited by 932
Forecasting: theory and practice
Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., Bergmeir, C., Bessa, R. J., Bijak, J., Boylan, J. E., et al. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.001 · Cited by 921
What happened to the oil price-macroeconomy relationship?
Hooker, M. A. (1996) · Journal of Monetary Economics · doi:10.1016/s0304-3932(96)01281-0 · Cited by 918
Exchange rate anomalies in the industrial countries: A solution with a structural VAR approach
Kim, S., & Roubini, N. (2000) · Journal of Monetary Economics · doi:10.1016/s0304-3932(00)00010-6 · Cited by 915
Structural Vector Autoregressions: Theory of Identification and Algorithms for Inference
RUBIO-RAMÍREZ, J. F., WAGGONER, D. F., & ZHA, T. (2010) · Review of Economic Studies · doi:10.1111/j.1467-937x.2009.00578.x · Cited by 901
Formulating and estimating dynamic linear rational expectations models
Hansen, L. (1980) · Journal of Economic Dynamics and Control · doi:10.1016/0165-1889(80)90012-3 · Cited by 875
Asymmetric causality tests with an application
Hatemi-J, A. (2012) · Empirical Economics · doi:10.1007/s00181-011-0484-x · Cited by 872
Investment shocks and business cycles
Justiniano, A., Primiceri, G. E., & Tambalotti, A. (2010) · Journal of Monetary Economics · doi:10.1016/j.jmoneco.2009.12.008 · Cited by 869
Implications of Dynamic Factor Models for VAR Analysis
Stock, J., & Watson, M. (2005) · National Bureau of Economic Research · doi:10.3386/w11467 · Cited by 860
Kristoufek, L. (2013) · Scientific Reports · doi:10.1038/srep03415 · Cited by 857
Estimating Long-Run Economic Equilibria
Phillips, P. C. B., & Loretan, M. (1991) · The Review of Economic Studies · doi:10.2307/2298004 · Cited by 853
Economic growth, CO2 emissions and energy consumption: What causes what and where?
Acheampong, A. O. (2018) · Energy Economics · doi:10.1016/j.eneco.2018.07.022 · Cited by 852
Oil price shocks and real GDP growth: empirical evidence for some OECD countries
Jiménez-Rodríguez *, R., & Sánchez, M. (2005) · Applied Economics · doi:10.1080/0003684042000281561 · Cited by 843
Meteor Showers or Heat Waves? Heteroskedastic Intra-Daily Volatility in the Foreign Exchange Market
Engle, R. F., Ito, T., & Lin, W.-L. (1990) · Econometrica · doi:10.2307/2938189 · Cited by 840
Dritsakis, N. (2004) · Tourism Economics · doi:10.5367/0000000041895094 · Cited by 823
Financial development and economic growth: New evidence from panel data
Hassan, M. K., Sanchez, B., & Yu, J.-S. (2011) · The Quarterly Review of Economics and Finance · doi:10.1016/j.qref.2010.09.001 · Cited by 795
Meteor Showers or Heat Waves? Heteroskedastic Intra-Daily Volatility in the Foreign Exchange Market
Engle, R., Ito, T., & Lin, W.-L. (1988) · National Bureau of Economic Research · doi:10.3386/w2609 · Cited by 786
ELK ALTER HABITAT SELECTION AS AN ANTIPREDATOR RESPONSE TO WOLVES
Creel, S., Winnie, J., Maxwell, B., Hamlin, K., & Creel, M. (2005) · Ecology · doi:10.1890/05-0032 · Cited by 774
Energy and economic growth in the USA
Stern, D. I. (1993) · Energy Economics · doi:10.1016/0140-9883(93)90033-n · Cited by 777
Apergis, N., & Payne, J. E. (2009) · Energy Economics · doi:10.1016/j.eneco.2008.09.002 · Cited by 775
Can Government Purchases Stimulate the Economy?
Ramey, V. A. (2011) · Journal of Economic Literature · doi:10.1257/jel.49.3.673 · Cited by 772
Does self-employment reduce unemployment?
Thurik, A. R., Carree, M. A., van Stel, A., & Audretsch, D. B. (2008) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2008.01.007 · Cited by 748
Oil Shocks and Aggregate Macroeconomic Behavior: The Role of Monetary Policy: A Comment
Hamilton, J. D., & Herrera, A. M. (2004) · Journal of Money, Credit, and Banking · doi:10.1353/mcb.2004.0012 · Cited by 734
Local Projections and VARs Estimate the Same Impulse Responses
Plagborg-Møller, M., & Wolf, C. K. (2021) · Econometrica · doi:10.3982/ecta17813 · Cited by 732
Ji, Q., & Zhang, D. (2019) · Energy Policy · doi:10.1016/j.enpol.2018.12.047 · Cited by 714
Atheoretical macroeconometrics: A critique
Cooley, T. F., & Leroy, S. F. (1985) · Journal of Monetary Economics · doi:10.1016/0304-3932(85)90038-8 · Cited by 711
Prior Selection for Vector Autoregressions
Giannone, D., Lenza, M., & Primiceri, G. E. (2015) · Review of Economics and Statistics · doi:10.1162/rest_a_00483 · Cited by 710
What Is Wrong with Taylor Rules? Using Judgment in Monetary Policy through Targeting Rules
Svensson, L. E. O. (2003) · Journal of Economic Literature · doi:10.1257/002205103765762734 · Cited by 703
Sign Restrictions in Structural Vector Autoregressions: A Critical Review
Fry, R., & Pagan, A. (2011) · Journal of Economic Literature · doi:10.1257/jel.49.4.938 · Cited by 688
Measuring the Effects of Monetary Policy: A Factor-Augmented Vector Autoregressive (FAVAR) Approach*
Bernanke, B. S., Boivin, J., & Eliasz, P. (2005) · Quarterly Journal of Economics · doi:10.1162/qjec.2005.120.1.387 · Cited by 682
Relationships between oil price shocks and stock market: An empirical analysis from China
Cong, R.-G., Wei, Y.-M., Jiao, J.-L., & Fan, Y. (2008) · Energy Policy · doi:10.1016/j.enpol.2008.06.006 · Cited by 665
Variable Trends in Economic Time Series
Stock, J. H., & Watson, M. W. (1988) · Journal of Economic Perspectives · doi:10.1257/jep.2.3.147 · Cited by 661
Cologni, A., & Manera, M. (2008) · Energy Economics · doi:10.1016/j.eneco.2006.11.001 · Cited by 648
Identification and Estimation of Dynamic Causal Effects in Macroeconomics Using External Instruments
Stock, J. H., & Watson, M. W. (2018) · The Economic Journal · doi:10.1111/ecoj.12593 · Cited by 644
Econometrics: Alchemy or Science?: Essays in Econometric Methodology
Hendry, D. F. (2000) · doi:10.1093/0198293542.001.0001 · Cited by 634
Return connectedness across asset classes around the COVID-19 outbreak
Bouri, E., Cepni, O., Gabauer, D., & Gupta, R. (2021) · International Review of Financial Analysis · doi:10.1016/j.irfa.2020.101646 · Cited by 629
Estimation and Control of a Macroeconomic Model with Rational Expectations
Taylor, J. B. (1979) · Econometrica · doi:10.2307/1911962 · Cited by 627
Trade Credit and the Bank Lending Channel
Nilsen, J. H. (2002) · Journal of Money, Credit, and Banking · doi:10.1353/mcb.2002.0032 · Cited by 622
Stock prices of clean energy firms, oil and carbon markets: A vector autoregressive analysis
Kumar, S., Managi, S., & Matsuda, A. (2012) · Energy Economics · doi:10.1016/j.eneco.2011.03.002 · Cited by 619
Financial Intermediaries and Monetary Economics
Adrian, T., & Song Shin, H. (2010) · Handbook of Monetary Economics · doi:10.1016/b978-0-444-53238-1.00012-0 · Cited by 611
On the formulation of empirical models in dynamic econometrics
Hendry, D. F., & Richard, J.-F. (1982) · Journal of Econometrics · doi:10.1016/0304-4076(82)90101-4 · Cited by 603
The Effects of Traditional and Social Earned Media on Sales: A Study of a Microlending Marketplace
Stephen, A. T., & Galak, J. (2012) · Journal of Marketing Research · doi:10.1509/jmr.09.0401 · Cited by 600
On the Network Topology of Variance Decompositions: Measuring the Connectedness of Financial Firms
Diebold, F. X., & Yilmaz, K. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.2316285 · Cited by 596
Deep Learning for Anomaly Detection in Time-Series Data: Review, Analysis, and Guidelines
Choi, K., Yi, J., Park, C., & Yoon, S. (2021) · IEEE Access · doi:10.1109/access.2021.3107975 · Cited by 588
Christiano, L. J. (1992) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1992.10509903 · Cited by 587
Can digital financial inclusion promote China's economic growth?
Liu, Y., Luan, L., Wu, W., Zhang, Z., & Hsu, Y. (2021) · International Review of Financial Analysis · doi:10.1016/j.irfa.2021.101889 · Cited by 584
Some Impossibility Theorems in Econometrics With Applications to Structural and Dynamic Models
Dufour, J.-M. (1997) · Econometrica · doi:10.2307/2171740 · Cited by 556
Systemic risk and the macroeconomy: An empirical evaluation
Giglio, S., Kelly, B., & Pruitt, S. (2016) · Journal of Financial Economics · doi:10.1016/j.jfineco.2016.01.010 · Cited by 555
Interpreting the evidence on money-income causality
Stock, J. H., & Watson, M. W. (1989) · Journal of Econometrics · doi:10.1016/0304-4076(89)90035-3 · Cited by 554
Causal Relations Among Stock Returns, Interest Rates, Real Activity, and Inflation
LEE, B. (1992) · The Journal of Finance · doi:10.1111/j.1540-6261.1992.tb04673.x · Cited by 551
Permanent and Transitory Components of GNP and Stock Prices
Cochrane, J. H. (1994) · The Quarterly Journal of Economics · doi:10.2307/2118434 · Cited by 548
Non-causality due to omitted variables
Lütkepohl, H. (1982) · Journal of Econometrics · doi:10.1016/0304-4076(82)90011-2 · Cited by 544
Commodity prices, interest rates and the dollar
Akram, Q. F. (2009) · Energy Economics · doi:10.1016/j.eneco.2009.05.016 · Cited by 542
BARBERÁ, P., CASAS, A., NAGLER, J., EGAN, P. J., BONNEAU, R., JOST, J. T., & TUCKER, J. A. (2019) · American Political Science Review · doi:10.1017/s0003055419000352 · Cited by 539
The robustness of identified VAR conclusions about money
Faust, J. (1998) · Carnegie-Rochester Conference Series on Public Policy · doi:10.1016/s0167-2231(99)00009-3 · Cited by 537
What have we learned from a decade of empirical research on growth? Growth Empirics and Reality
Brock, W. A. (2001) · The World Bank Economic Review · doi:10.1093/wber/15.2.229 · Cited by 529
Brock, W., & Durlauf, S. (2000) · National Bureau of Economic Research · doi:10.3386/t0258 · Cited by 528
What does Monetary Policy do to Long‐term Interest Rates at the Zero Lower Bound?
Wright, J. H. (2012) · The Economic Journal · doi:10.1111/j.1468-0297.2012.02556.x · Cited by 527
Cointegration and speed of convergence to equilibrium
Pesaran, M. H., & Shin, Y. (1996) · Journal of Econometrics · doi:10.1016/0304-4076(94)01697-6 · Cited by 525
Chapter 1 Business cycle fluctuations in us macroeconomic time series
Stock, J. H., & Watson, M. W. (1999) · Handbook of Macroeconomics · doi:10.1016/s1574-0048(99)01004-6 · Cited by 519
Metadata
- Authors
- Sims, C. A.
- Venue
- Econometrica
- Publisher
- JSTOR
- Published
- 1980-01
- Volume
- 48
- Issue
- 1
- Pages
- 1
- ISSN
- 0012-9682 (ISSN-L)
- OpenAlex
- W2019459021
- Cited by
- 12,727
- References
- 13
- FWCI
- 116.79
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.