The DOI matches its Crossref record.
Specification Searches: Ad Hoc Inference with Non-Experimental Data.
Abstract
Offers a radically new approach to inference with nonexperimental data when the statistical model is ambiguously defined. Examines the process of model searching and its implications for inference. Identifies six different varieties of specification searches, discussing the inferential consequences of each in detail.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Bayesian model selection in social research
Raftery, A. E. (1995) · Sociological Methodology · doi:10.2307/271063 · Cited by 6,823
Unobservable Selection and Coefficient Stability: Theory and Evidence
Oster, E. (2019) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2016.1227711 · Cited by 5,367
The analysis of household surveys: A microeconometric approach to development policy
Deaton, A. (1997) · doi:10.1596/0-8018-5254-4 · Cited by 4,877
Lebreton, J.-D., Burnham, K. P., Clobert, J., & Anderson, D. R. (1992) · Ecological Monographs · doi:10.2307/2937171 · Cited by 4,517
Trends and random walks in macroeconomic time series
Perron, P. (1988) · Journal of Economic Dynamics and Control · doi:10.1016/0165-1889(88)90043-7 · Cited by 2,433
Shared Mental Models: Ideologies and Institutions
DENZAU, A. T., & NORTH, D. C. (1994) · Kyklos · doi:10.1111/j.1467-6435.1994.tb02246.x · Cited by 2,194
Forward Exchange Rates as Optimal Predictors of Future Spot Rates: An Econometric Analysis
Hansen, L. P., & Hodrick, R. J. (1980) · Journal of Political Economy · doi:10.1086/260910 · Cited by 2,111
A Reality Check for Data Snooping
White, H. (2000) · Econometrica · doi:10.1111/1468-0262.00152 · Cited by 1,851
An analysis of intertemporal and cross-sectional determinants of earnings response coefficients
Collins, D. W., & Kothari, S. P. (1989) · Journal of Accounting and Economics · doi:10.1016/0165-4101(89)90004-9 · Cited by 1,685
Model modifications in covariance structure analysis: The problem of capitalization on chance.
MacCallum, R. C., Roznowski, M., & Necowitz, L. B. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.111.3.490 · Cited by 1,632
Does Academic Research Destroy Stock Return Predictability?
MCLEAN, R. D., & PONTIFF, J. (2016) · The Journal of Finance · doi:10.1111/jofi.12365 · Cited by 1,566
Beyond the Running Tally: Partisan Bias in Political Perceptions
Bartels, L. M. (2002) · Political Behavior · doi:10.1023/a:1021226224601 · Cited by 1,468
Patent Quality and Research Productivity: Measuring Innovation with Multiple Indicators
Lanjouw, J. O., & Schankerman, M. (2004) · The Economic Journal · doi:10.1111/j.1468-0297.2004.00216.x · Cited by 1,392
What does research reproducibility mean?
Goodman, S. N., Fanelli, D., & Ioannidis, J. P. A. (2016) · Science Translational Medicine · doi:10.1126/scitranslmed.aaf5027 · Cited by 1,293
Children's social and scholastic lives in kindergarten: related spheres of influence?
Ladd, G. W., Birch, S. H., & Buhs, E. S. (1999) · Child Development · doi:10.1111/1467-8624.00101 · Cited by 1,136
The origin of predictable behavior
(1983) · Mathematical Social Sciences · doi:10.1016/0165-4896(83)90055-0 · Cited by 1,127
Model uncertainty, data mining and statistical inference
Chatfield, C. (1995) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983440 · Cited by 1,103
Avoiding Invalid Instruments and Coping with Weak Instruments
Murray, M. P. (2006) · Journal of Economic Perspectives · doi:10.1257/jep.20.4.111 · Cited by 1,092
Mixtures of g Priors for Bayesian Variable Selection
Liang, F., Paulo, R., Molina, G., Clyde, M. A., & Berger, J. O. (2008) · Journal of the American Statistical Association · doi:10.1198/016214507000001337 · Cited by 1,089
Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization
Peherstorfer, B., Willcox, K., & Gunzburger, M. (2018) · SIAM Review · doi:10.1137/16m1082469 · Cited by 1,061
Hand, D. J. (2007) · Drug Safety · doi:10.2165/00002018-200730070-00010 · Cited by 1,044
Benchmark priors for Bayesian model averaging
Fernández, C., Ley, E., & Steel, M. F. J. (2001) · Journal of Econometrics · doi:10.1016/s0304-4076(00)00076-2 · Cited by 1,030
Use of structural equation modeling in operations management research: Looking back and forward
Shah, R., & Goldstein, S. M. (2006) · Journal of Operations Management · doi:10.1016/j.jom.2005.05.001 · Cited by 976
Research Commentary —Too Big to Fail: Large Samples and the p -Value Problem
Lin, M., Lucas, H. C., & Shmueli, G. (2013) · Information Systems Research · doi:10.1287/isre.2013.0480 · Cited by 972
Spatial data analysis: theory and practice
(2004) · Choice Reviews Online · doi:10.5860/choice.41-3486 · Cited by 965
Happiness is greater in natural environments
MacKerron, G., & Mourato, S. (2013) · Global Environmental Change · doi:10.1016/j.gloenvcha.2013.03.010 · Cited by 899
Model uncertainty in cross‐country growth regressions
Fernández, C., Ley, E., & Steel, M. F. J. (2001) · Journal of Applied Econometrics · doi:10.1002/jae.623 · Cited by 891
Heckman, J. (1989) · National Bureau of Economic Research · doi:10.3386/w2861 · Cited by 882
Specification searches in covariance structure modeling.
MacCallum, R. (1986) · Psychological Bulletin · doi:10.1037//0033-2909.100.1.107 · Cited by 854
Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
Berger, J. O., & Sellke, T. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478397 · Cited by 775
Bayesian Analysis for the Social Sciences
Jackman, S. (2009) · Wiley Series in Probability and Statistics · doi:10.1002/9780470686621 · Cited by 756
Hedonic Pricing Models: A Selective and Applied Review
Malpezzi, S. (2002) · Housing Economics and Public Policy · doi:10.1002/9780470690680.ch5 · Cited by 747
Age, Size, Growth and Survival: UK Companies in the 1980s
Dunne, P., & Hughes, A. (1994) · The Journal of Industrial Economics · doi:10.2307/2950485 · Cited by 747
Exploratory Modeling for Policy Analysis
Bankes, S. (1993) · Operations Research · doi:10.1287/opre.41.3.435 · Cited by 706
Sign Restrictions in Structural Vector Autoregressions: A Critical Review
Fry, R., & Pagan, A. (2011) · Journal of Economic Literature · doi:10.1257/jel.49.4.938 · Cited by 688
Berger, J. O., & Delampady, M. (1987) · Statistical Science · doi:10.1214/ss/1177013238 · Cited by 664
Tipping and the Dynamics of Segregation*
Card, D., Mas, A., & Rothstein, J. (2008) · Quarterly Journal of Economics · doi:10.1162/qjec.2008.123.1.177 · Cited by 637
Econometrics: Alchemy or Science?: Essays in Econometric Methodology
Hendry, D. F. (2000) · doi:10.1093/0198293542.001.0001 · Cited by 634
Stock return predictability and model uncertainty
Avramov, D. (2002) · Journal of Financial Economics · doi:10.1016/s0304-405x(02)00131-9 · Cited by 634
Approximate Bayes factors and accounting for model uncertainty in generalised linear models
Raftery, A. (1996) · Biometrika · doi:10.1093/biomet/83.2.251 · Cited by 633
Tarka, P. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0469-8 · Cited by 617
On the formulation of empirical models in dynamic econometrics
Hendry, D. F., & Richard, J.-F. (1982) · Journal of Econometrics · doi:10.1016/0304-4076(82)90101-4 · Cited by 603
Self-citationSoftware development cost estimation approaches — A survey
Boehm, B., Abts, C., & Chulani, S. (2000) · Annals of Software Engineering · doi:10.1023/a:1018991717352 · Cited by 588
How Deliberation Affects Policy Opinions
BARABAS, J. (2004) · American Political Science Review · doi:10.1017/s0003055404041425 · Cited by 487
Data mining reconsidered: encompassing and the general‐to‐specific approach to specification search
Hoover, K. D., & Perez, S. J. (1999) · The Econometrics Journal · doi:10.1111/1368-423x.00025 · Cited by 486
Firm size and the information content of prices with respect to earnings
Collins, D. W., Kothari, S. P., & Rayburn, J. D. (1987) · Journal of Accounting and Economics · doi:10.1016/0165-4101(87)90002-4 · Cited by 453
Raftery, A. E., Kárný, M., & Ettler, P. (2010) · Technometrics · doi:10.1198/tech.2009.08104 · Cited by 452
An Examination of the Robustness of the Weekend Effect
Connolly, R. A. (1989) · The Journal of Financial and Quantitative Analysis · doi:10.2307/2330769 · Cited by 437
Hendry, D. F., & Mizon, G. E. (2000) · Econometrics: Alchemy or Science? · doi:10.1093/0198293542.003.0007 · Cited by 430
Markov Chain Monte Carlo Methods: Computation and Inference
Chib, S. (2001) · Handbook of Econometrics · doi:10.1016/s1573-4412(01)05010-3 · Cited by 417
Sign Restrictions, Structural Vector Autoregressions, and Useful Prior Information
Baumeister, C., & Hamilton, J. D. (2015) · Econometrica · doi:10.3982/ecta12356 · Cited by 412
Market Conduct in the Airline Industry: An Empirical Investigation
Brander, J. A., & Zhang, A. (1990) · The RAND Journal of Economics · doi:10.2307/2555469 · Cited by 409
Hart, P. E., & Oulton, N. (1996) · The Economic Journal · doi:10.2307/2235518 · Cited by 409
Angrist, J. D., & Pischke, J.-S. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1639809 · Cited by 381
The Humanitarian Foundation of Public Support for Social Welfare
Feldman, S., & Steenbergen, M. R. (2001) · American Journal of Political Science · doi:10.2307/2669244 · Cited by 376
Robust Bayesian analysis: sensitivity to the prior
Berger, J. O. (1990) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(90)90079-a · Cited by 371
Consistent Sets of Estimates for Regressions with Errors in All Variables
Klepper, S., & Leamer, E. E. (1984) · Econometrica · doi:10.2307/1911466 · Cited by 362
Self-citationThe Empirical Foundations of Calibration
Hansen, L. P., & Heckman, J. J. (1996) · Journal of Economic Perspectives · doi:10.1257/jep.10.1.87 · Cited by 359
Determinants of Foreign Direct Investment
Blonigen, B., & Piger, J. (2011) · National Bureau of Economic Research · doi:10.3386/w16704 · Cited by 355
A comparison of two model averaging techniques with an application to growth empirics
Magnus, J. R., Powell, O., & Prüfer, P. (2010) · Journal of Econometrics · doi:10.1016/j.jeconom.2009.07.004 · Cited by 355
The Insignificance of Null Hypothesis Significance Testing
Gill, J. (1999) · Political Research Quarterly · doi:10.1177/106591299905200309 · Cited by 338
New evidence on the nature of size-related anomalies in stock prices
Brown, P., Kleidon, A. W., & Marsh, T. A. (1983) · Journal of Financial Economics · doi:10.1016/0304-405x(83)90026-0 · Cited by 337
Eicher, T. S., Papageorgiou, C., & Raftery, A. E. (2011) · Journal of Applied Econometrics · doi:10.1002/jae.1112 · Cited by 331
The role of administrative data in the big data revolution in social science research
Connelly, R., Playford, C. J., Gayle, V., & Dibben, C. (2016) · Social Science Research · doi:10.1016/j.ssresearch.2016.04.015 · Cited by 330
Hendry, D. F., & Ericsson, N. R. (1989) · International Finance Discussion Papers · doi:10.17016/ifdp.1989.355 · Cited by 324
Public Schooling, Indoctrination, and Totalitarianism
Lott, Jr. (1999) · Journal of Political Economy · doi:10.1086/250106 · Cited by 323
Reporting the Fragility of Regression Estimates
Leamer, E., & Leonard, H. (1983) · The Review of Economics and Statistics · doi:10.2307/1924497 · Cited by 322
Self-citationUnion Rent Seeking, Intangible Capital, and Market Value of the Firm
Connolly, R. A., Hirsch, B. T., & Hirschey, M. (1986) · The Review of Economics and Statistics · doi:10.2307/1924515 · Cited by 318
Bayesian analysis of empirical software engineering cost models
Chulani, S., Boehm, B., & Steece, B. (1999) · IEEE Transactions on Software Engineering · doi:10.1109/32.799958 · Cited by 310
Alquist, R., Kilian, L., & Vigfusson, R. J. (2013) · Handbook of Economic Forecasting · doi:10.1016/b978-0-444-53683-9.00008-6 · Cited by 307
Profit Sharing: Does It Make a Difference?
Kruse, D. L. (1993) · doi:10.17848/9780585261614 · Cited by 300
Are all Economic Hypotheses False?
De Long, J. B., & Lang, K. (1992) · Journal of Political Economy · doi:10.1086/261860 · Cited by 295
The GDP-Temperature relationship: Implications for climate change damages
Newell, R. G., Prest, B. C., & Sexton, S. E. (2021) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2021.102445 · Cited by 280
Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)
Imbens, G. W. (2010) · Journal of Economic Literature · doi:10.1257/jel.48.2.399 · Cited by 278
A comprehensive look at financial volatility prediction by economic variables
Christiansen, C., Schmeling, M., & Schrimpf, A. (2012) · Journal of Applied Econometrics · doi:10.1002/jae.2298 · Cited by 272
Variable selection and Bayesian model averaging in case‐control studies
Viallefont, V., Raftery, A. E., & Richardson, S. (2001) · Statistics in Medicine · doi:10.1002/sim.976 · Cited by 266
Fagiolo, G., Moneta, A., & Windrum, P. (2007) · Computational Economics · doi:10.1007/s10614-007-9104-4 · Cited by 265
Monetary Policy Under Uncertainty in Micro-Founded Macroeconometric Models
Levin, A., Onatski, A., Williams, J., & Williams, N. (2005) · National Bureau of Economic Research · doi:10.3386/w11523 · Cited by 264
International Evidence on the Robustness of the Day-of-the-Week Effect
Chang, E. C., Pinegar, J. M., & Ravichandran, R. (1993) · The Journal of Financial and Quantitative Analysis · doi:10.2307/2331162 · Cited by 260
The Gifi system of descriptive multivariate analysis
Michailidis, G., & de Leeuw, J. (1998) · Statistical Science · doi:10.1214/ss/1028905828 · Cited by 260
Vector Autoregression and the Study of Politics
Freeman, J. R., Williams, J. T., & Lin, T.-M. (1989) · American Journal of Political Science · doi:10.2307/2111112 · Cited by 258
Changes in urban air quality during urbanization in China
Lin, B., & Zhu, J. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.03.293 · Cited by 256
Estimation and Inference via Bayesian Simulation: An Introduction to Markov Chain Monte Carlo
Jackman, S. (2000) · American Journal of Political Science · doi:10.2307/2669318 · Cited by 254
Discussion: Performance of Bayesian Model Averaging
Raftery, A. E., & Zheng, Y. (2003) · Journal of the American Statistical Association · doi:10.1198/016214503000000891 · Cited by 252
Tantalus on the Road to Asymptopia
Leamer, E. E. (2010) · Journal of Economic Perspectives · doi:10.1257/jep.24.2.31 · Cited by 252
Self-citationPrediction via Orthogonalized Model Mixing
Clyde, M., Desimone, H., & Parmigiani, G. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476989 · Cited by 145
Vague Theory and Model Uncertainty in Macrosociology
Western, B. (1996) · Sociological Methodology · doi:10.2307/271022 · Cited by 133
Mauro, R. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.2.314 · Cited by 130
Law and (Norms of) Order in the Inner City
Meares, T. L., & Kahan, D. M. (1998) · Law & Society Review · doi:10.2307/827740 · Cited by 123
Corbière, M., Zaniboni, S., Lecomte, T., Bond, G., Gilles, P.-Y., Lesage, A., & Goldner, E. (2011) · Journal of Occupational Rehabilitation · doi:10.1007/s10926-011-9315-3 · Cited by 120
Technical trading: is it still beating the foreign exchange market?
Hsu, P.-H., Taylor, M. P., & Wang, Z. (2016) · Journal of International Economics · doi:10.1016/j.jinteco.2016.03.012 · Cited by 113
Wöhling, T., & Vrugt, J. A. (2008) · Water Resources Research · doi:10.1029/2008wr007154 · Cited by 86
Significance testing in empirical finance: a critical review and assessment
Kim, J. H., & Ji, P. I. (2015) · Journal of Empirical Finance · doi:10.1016/j.jempfin.2015.08.006 · Cited by 86
(1998) · doi:10.1007/3-540-26577-5_17 · Cited by 15
Metadata
- Authors
- Richard, J.-F., & Leamer, E. E.
- Venue
- Economica
- Publisher
- JSTOR
- Published
- 1981-05
- Volume
- 48
- Issue
- 190
- Pages
- 210
- ISSN
- 0013-0427 (ISSN-L)
- OpenAlex
- W2159740989
- Cited by
- 1,114
- References
- 0
- FWCI
- 23.36
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.