The DOI matches its Crossref record; 227 of the 227 references it cites were found in a registry or an index.
Transparency, Reproducibility, and the Credibility of Economics Research
Open accessAbstract
There is growing interest in enhancing research transparency and reproducibility in economics and other scientific fields. We survey existing work on these topics within economics and discuss the evidence suggesting that publication bias, inability to replicate, and specification searching remain widespread in the discipline. We next discuss recent progress in this area, including through improved research design, study registration and pre-analysis plans, disclosure standards, and open sharing of data and materials, drawing on experiences in both economics and other social sciences. We discuss areas where consensus is emerging on new practices, as well as approaches that remain controversial, and speculate about the most effective ways to make economics research more credible in the future. ( JEL A11, C18, I23)
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
3 retracted
Items 201–227 of 227
IS THE TIME‐SERIES EVIDENCE ON MINIMUM WAGE EFFECTS CONTAMINATED BY PUBLICATION BIAS?
Neumark, D., & Wascher, W. L. (1998) · Economic Inquiry · doi:10.1111/j.1465-7295.1998.tb01728.x · Cited by 70
Female hurricanes are not deadlier than male hurricanes
Malter, D. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1411428111 · Cited by 68
Are female hurricanes really deadlier than male hurricanes?
Christensen, B., & Christensen, S. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1410910111 · Cited by 68
Why null results rarely see the light of day
Mervis, J. (2014) · Science · doi:10.1126/science.345.6200.992 · Cited by 65
Gerber, A. S., Arceneaux, K., Boudreau, C., Dowling, C. M., Hillygus, S., Palfrey, T. R., Biggers, D. R., & Hendry, D. J. (2014) · Journal of Experimental Political Science · doi:10.1017/xps.2014.11 · Cited by 65
Statistics show no evidence of gender bias in the public's hurricane preparedness
Maley, S. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1413079111 · Cited by 61
Replicating Sachs and Warner’s Working Papers on the Resource Curse
Davis, G. A. (2013) · The Journal of Development Studies · doi:10.1080/00220388.2013.807501 · Cited by 60
Stimulating Local Public Employment: Do General Grants Work?
Lundqvist, H., Dahlberg, M., & Mörk, E. (2014) · American Economic Journal Economic Policy · doi:10.1257/pol.6.1.167 · Cited by 59
The Registration of Observational Studies—When Metaphors Go Bad
(2010) · Epidemiology · doi:10.1097/ede.0b013e3181eafbcf · Cited by 56
Hicks, J. H., Kremer, M. R., & Miguel, E. A. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv129 · Cited by 51
Self-citationFrey, R. L., Frey, B. S., & Eichenberger, R. (1999) · Kyklos · doi:10.1111/j.1467-6435.1999.tb00219.x · Cited by 49
Plagiarism in the Economics Profession: A Survey
Enders, W., & Hoover, G. A. (2006) · Challenge · doi:10.2753/0577-5132490506 · Cited by 48
Mcnutt, M. K. (2016) · Science · doi:10.1126/science.aag2359 · Cited by 46
Walking the talk: the need for a trial registry for development interventions
Rasmussen, O. D., Malchow‐Møller, N., & Andersen, T. B. (2011) · Journal of Development Effectiveness · doi:10.1080/19439342.2011.605160 · Cited by 42
Verifying the Solution from a Nonlinear Solver: A Case Study: Comment
Drukker, D. M., & Wiggins, V. (2004) · American Economic Review · doi:10.1257/000282804322970896 · Cited by 40
Population matters when modeling hurricane fatalities
Bakkensen, L., & Larson, W. D. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1417030111 · Cited by 39
S -values: Conventional context-minimal measures of the sturdiness of regression coefficients
Leamer, E. E. (2016) · Journal of Econometrics · doi:10.1016/j.jeconom.2015.10.013 · Cited by 39
Three ‘Rs’ of Econometrics: Repetition, Reproduction and Replication
Camfield, L., & Palmer‐Jones, R. (2013) · The Journal of Development Studies · doi:10.1080/00220388.2013.807504 · Cited by 35
Introduction: is data mining a methodological problem?
Backhouse, R. E., & Morgan, M. S. (2000) · Journal of Economic Methodology · doi:10.1080/13501780050045065 · Cited by 35
Replication of quantitative work in development studies: Experiences and suggestions
Duvendack, M., & Palmer‐Jones, R. (2013) · Progress in Development Studies · doi:10.1177/1464993413490480 · Cited by 35
FDA and CPMP Rulings on Subgroup Analyses
Maggioni, A. P., Darné, B. M., Atar, D., Abadie, E., Pitt, B., & Zannad, F. M. (2006) · Cardiology · doi:10.1159/000094508 · Cited by 34
In Search of an Association Between Conception Risk and Prejudice
Hawkins, C. B., Fitzgerald, C. E., & Nosek, B. A. (2015) · Psychological Science · doi:10.1177/0956797614553121 · Cited by 32
Verifying the Solution from a Nonlinear Solver: A Case Study: Reply
McCullough, B. D., & Vinod, H. D. (2004) · American Economic Review · doi:10.1257/000282804322970904 · Cited by 29
A Skeptical View of the National Science Foundation's Role in Economic Research
Cowen, T., & Tabarrok, A. T. (2016) · The Journal of Economic Perspectives · doi:10.1257/jep.30.3.235 · Cited by 28
In Defense of the NSF Economics Program
Moffitt, R. (2016) · The Journal of Economic Perspectives · doi:10.1257/jep.30.3.213 · Cited by 25
(1984) · The Quarterly Journal of Economics · doi:10.1093/qje/99.2.383 · Cited by 7
Verifying the Solution from a Nonlinear Solver: A Case Study: Reply
McCullough, B. D., & Vinod, H. D. (2004) · American Economic Review · doi:10.1257/000282804322970887 · Cited by 7
Cited by
Hou, K., Xue, C., & Zhang, L. (2020) · The Review of Financial Studies · doi:10.1093/rfs/hhy131 · Cited by 989
RCTs to Scale: Comprehensive Evidence From Two Nudge Units
DellaVigna, S., & Linos, E. (2022) · Econometrica · doi:10.3982/ecta18709 · Cited by 480
Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics
Brodeur, A., Cook, N., & Heyes, A. (2020) · American Economic Review · doi:10.1257/aer.20190687 · Cited by 333
Model Averaging and Its Use in Economics
Steel, M. F. J. (2020) · Journal of Economic Literature · doi:10.1257/jel.20191385 · Cited by 321
Swedberg, R. (2020) · The Production of Knowledge · doi:10.1017/9781108762519.002 · Cited by 293
Metadata
- Authors
- Christensen, G., & Miguel, E.
- Venue
- Journal of Economic Literature
- Publisher
- American Economic Association
- Published
- 2018-09-01
- Volume
- 56
- Issue
- 3
- Pages
- 920-980
- ISSN
- 0022-0515 (ISSN-L)
- OpenAlex
- W2561942675
- Cited by
- 446
- References
- 227
- FWCI
- 78.15
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.