CoChat

Are Psychology Journals Anti-replication? A Snapshot of Editorial Practices

Open access
Martin, G. N., Clarke, Richard M. · 2017 · Frontiers in Psychology
Cited by 116

The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.

Abstract

Recent research in psychology has highlighted a number of replication problems in the discipline, with publication bias - the preference for publishing original and positive results, and a resistance to publishing negative results and replications- identified as one reason for replication failure. However, little empirical research exists to demonstrate that journals explicitly refuse to publish replications. We reviewed the instructions to authors and the published aims of 1151 psychology journals and examined whether they indicated that replications were permitted and accepted. We also examined whether journal practices differed across branches of the discipline, and whether editorial practices differed between low and high impact journals. Thirty three journals (3%) stated in their aims or instructions to authors that they accepted replications. There was no difference between high and low impact journals. The implications of these findings for psychology are discussed.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3389/fpsyg.2017.00523

Cites

17 of 17 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 21

  1. American Psychological Society, 2015, Replication in psychological science., Psychol. Sci., 26, 1827, 10.1177/0956797615616374 · DOI · Paper page
  2. Bozarth, 1972, Signifying significant significance., Am. Psychol., 27, 774, 10.1037/h0038034 · DOI · Paper page
  3. Brown, 1976, Building a replication tradition in marketing., Marketing, 1776, 622
  4. Coursol, 1986, Effect of positive findings on submission and acceptance rates: a note on meta-analysis bias., Prof. Psychol. Res. Pract., 17, 136, 10.1037/0735-7028.17.2.136 · doi:10.1037/0735-7028.17.2.136 · Paper page
  5. Evanschitzky, 2010, Replications of forecasting research., Int. J. Forecast., 26, 4, 10.1016/j.ijforecast.2009.09.003 · DOI
  6. Evanschitzky, 2007, Replication research’s disturbing trend., J. Bus. Res., 60, 411, 10.1016/j.jbusres.2006.12.003 · DOI · Paper page
  7. Hubbard, 1994, Replications and extensions in marketing: rarely published but quite contrary., Int. J. Res. Mark., 11, 233, 10.1016/0167-8116(94)90003-5 · DOI · Paper page
  8. Hubbard, 1991, Replications in the finance literature: an empirical study., Q. J. Bus. Econ., 30, 70
  9. Hubbard, 1996, An empirical comparison of published replication research in accounting, economics, finance, management, and marketing., J. Bus. Res., 35, 153, 10.1016/0148-2963(95)00084-4 · DOI · Paper page
  10. Jones, 2010, An investigation of the prevalence of replication research in human factors., Hum. Factors, 52, 586, 10.1177/0018720810384394 · DOI · Paper page
  11. Kerr, 1977, Manuscript characteristics which influence acceptance for management and social science journals., Acad. Manag. J., 20, 132, 10.2307/255467 · DOI · Paper page
  12. Laws, 2013, Negativland-a home for all findings in psychology., BMC Psychol., 1, 10.1186/2050-7283-1-2 · DOI · Paper page
  13. Maxwell, 2015, Is psychology suffering from a replication crisis?, Am. Psychol., 70, 487, 10.1037/a0039400 · DOI · Paper page
  14. Neuliep, 1990, Editorial bias against replication research., J. Soc. Behav. Pers., 5, 85
  15. Neuliep, 1993a, Reviewer bias against replication research., J. Soc. Behav. Pers., 8, 21
  16. Neuliep, 1993b, Everyone was wrong: there are lots of replications out there., J. Soc. Behav. Pers., 8, 1
  17. Pashler, 2012, Is the replicability crisis overblown? Three arguments examined., Perspect. Psychol. Sci., 7, 531, 10.1177/1745691612463401 · DOI · Paper page
  18. Reid, 1981, Replication in advertising research: 977,1978, 1979., J. Advert., 10, 3, 10.1080/00913367.1981.10672750 · DOI · Paper page
  19. Rosenthal, 1979, The file drawer problem and tolerance for null results., Psychol. Bull., 86, 638, 10.1037/0033-2909.86.3.638 · DOI · Paper page
  20. Schooler, 2011, Unpublished results hide the decline effect., Nature, 470, 10.1038/470437a · DOI · Paper page
  21. Smart, 1964, The importance of negative results in psychological research., Can. Psychol., 5a, 225, 10.1037/h0083036 · DOI

Cited by

See all 116

Metadata

Authors
Martin, G. N., & Clarke, R. M.
Venue
Frontiers in Psychology
Published
2017-04-11
Volume
8
Pages
523-523
ISSN
1664-1078 (ISSN-L)
OpenAlex
W2607067892
Cited by
116
References
17
FWCI
17.66
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.