The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Pre-registration in social psychology—A discussion and suggested template
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
The ASA Statement on p -Values: Context, Process, and Purpose
Wasserstein, R. L., & Lazar, N. A. (2016) · The American Statistician · doi:10.1080/00031305.2016.1154108 · Cited by 6,306
Leys, C., Ley, C., Klein, O., Bernard, P., & Licata, L. (2013) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2013.03.013 · Cited by 4,147
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“…2003; Turner, Matthews, Linardatos, Tell, & Rosenthal, 2008), and of low replication rates of published medical research in registered clinical trials (e.g., Begley & Ellis, 2012; Mullane & Williams, 2013; Prinz, Schlange & Asadullah, 2011), led to calls for greater openness in registration.”
BackgroundA practical solution to the pervasive problems ofp values
Wagenmakers, E.-J. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194105 · Cited by 2,490
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Accounting for the effects of accountability.
Lerner, J. S., & Tetlock, P. E. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.2.255 · Cited by 2,383
HARKing: Hypothesizing after the results are known
Kerr, N. L. (1998) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0203_4 · Cited by 1,989
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888
Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546
Unmasking Multivariate Outliers and Leverage Points
Rousseeuw, P. J., & van Zomeren, B. C. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10474920 · Cited by 1,508
Investigating Variation in Replicability: A “Many Labs” Replication Project
Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B., Bahník, Š., Bernstein, M. J., Bocian, K., Brandt, M. J., Brooks, B., Brumbaugh, C. C., et al. (2014) · Social Psychology · doi:10.1027/1864-9335/a000178 · Cited by 1,208
Self-citationAn Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042
The Statistical Crisis in Science
Gelman, A., & Loken, E. (2014) · American Scientist · doi:10.1511/2014.111.460 · Cited by 963
Theory-Testing in Psychology and Physics: A Methodological Paradox
Meehl, P. E. (1967) · Philosophy of Science · doi:10.1086/288135 · Cited by 962
Why Summaries of Research on Psychological Theories are Often Uninterpretable
Meehl, P. E. (1990) · Psychological Reports · doi:10.2466/pr0.1990.66.1.195 · Cited by 909
Publication bias: evidence of delayed publication in a cohort study of clinical research projects
Stern, J. M., & Simes, R. J. (1997) · BMJ · doi:10.1136/bmj.315.7109.640 · Cited by 818
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010271 · Cited by 805
Publication bias: the case for an international registry of clinical trials.
Simes, R. J. (1986) · Journal of Clinical Oncology · doi:10.1200/jco.1986.4.10.1529 · Cited by 747
Registered Reports: A Method to Increase the Credibility of Published Results
Nosek, B. A., & Lakens, D. (2014) · Social Psychology · doi:10.1027/1864-9335/a000192 · Cited by 716
The Replication Recipe: What makes for a convincing replication?
Brandt, M. J., IJzerman, H., Dijksterhuis, A., Farach, F. J., Geller, J., Giner-Sorolla, R., Grange, J. A., Perugini, M., Spies, J. R., & van 't Veer, A. (2014) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2013.10.005 · Cited by 705
Self-citationReducing implicit racial preferences: I. A comparative investigation of 17 interventions.
Lai, C. K., Marini, M., Lehr, S. A., Cerruti, C., Shin, J.-E. L., Joy-Gaba, J. A., Ho, A. K., Teachman, B. A., Wojcik, S. P., Koleva, S. P., et al. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0036260 · Cited by 679
Melander, H., Ahlqvist-Rastad, J., Meijer, G., & Beermann, B. (2003) · BMJ · doi:10.1136/bmj.326.7400.1171 · Cited by 635
Ioannidis, J. P. A. (1998) · JAMA · doi:10.1001/jama.279.4.281 · Cited by 632
An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science
Open Science Collaboration (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612462588 · Cited by 614
Ferguson, C. J., & Heene, M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459059 · Cited by 603
Reporting standards for research in psychology: why do we need them? What might they be?
APA Publications and Communications Board Working Group on Journal Article Reporting Standards (2008) · American Psychologist · doi:10.1037/0003-066x.63.9.839 · Cited by 571
We Need Both Exploratory and Confirmatory
Tukey, J. W. (1980) · The American Statistician · doi:10.1080/00031305.1980.10482706 · Cited by 571
Dickersin, K. (2003) · JAMA · doi:10.1001/jama.290.4.516 · Cited by 512
Many Labs 3: Evaluating participant pool quality across the academic semester via replication
Ebersole, C. R., Atherton, O. E., Belanger, A. L., Skulborstad, H. M., Allen, J. M., Banks, J. B., Baranski, E., Bernstein, M. J., Bonfiglio, D. B. V., Boucher, L., et al. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.10.012 · Cited by 468
The secret lives of experiments: Methods reporting in the fMRI literature
Carp, J. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.07.004 · Cited by 457
Do frequency representations eliminate conjunction effects? An exercise in adversarial collaboration
Mellers, B., Hertwig, R., & Kahneman, D. (2001) · Psychological Science · doi:10.1111/1467-9280.00350 · Cited by 448
Performing high‐powered studies efficiently with sequential analyses
Lakens, D. (2014) · European Journal of Social Psychology · doi:10.1002/ejsp.2023 · Cited by 414
Scientific Utopia: I. Opening Scientific Communication
Nosek, B. A., & Bar-Anan, Y. (2012) · Psychological Inquiry · doi:10.1080/1047840x.2012.692215 · Cited by 368
Likelihood of Null Effects of Large NHLBI Clinical Trials Has Increased over Time
Kaplan, R. M., & Irvin, V. L. (2015) · PLOS ONE · doi:10.1371/journal.pone.0132382 · Cited by 356
The Behavior of the P-Value When the Alternative Hypothesis is True
Hung, H. M. J., O'Neill, R. T., Bauer, P., & Kohne, K. (1997) · Biometrics · doi:10.2307/2533093 · Cited by 281
Giner-Sorolla, R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612457576 · Cited by 274
Self-citationDoing Qualitative Research in Psychology: A Practical Guide
Sullivan, C., Forrester, M. A., & Hulme, J. A. (2019) · Psychology Teaching Review · doi:10.53841/bpsptr.2019.25.2.124 · Cited by 260
Eich, E. (2014) · Psychological Science · doi:10.1177/0956797613512465 · Cited by 255
Funder, D. C., Levine, J. M., Mackie, D. M., Morf, C. C., Sansone, C., Vazire, S., & West, S. G. (2014) · Personality and Social Psychology Review · doi:10.1177/1088868313507536 · Cited by 245
Adopted by the 18th WMA General Assembly, H. (2001) · HIV Clinical Trials · doi:10.1310/gtfr-2drx-m6ye-elxr · Cited by 227
On the Detection of Many Outliers
Rosner, B. (1975) · Technometrics · doi:10.2307/1268354 · Cited by 226
Learning and Innovative Elements of Strategy Adoption Rules Expand Cooperative Network Topologies
Wang, S., Szalay, M. S., Zhang, C., & Csermely, P. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001917 · Cited by 223
D. Chambers, C., 1 Cardiff University Brain Research Imaging Centre, S. O. P., Feredoes, E., D. Muthukumaraswamy, S., & J. Etchells, P. (2014) · AIMS Neuroscience · doi:10.3934/neuroscience.2014.1.4 · Cited by 213
On the Detection of Many Outliers
ROSNER, B. A. (1975) · Technometrics · doi:10.1080/00401706.1975.10489305 · Cited by 213
Mullane, K., & Williams, M. (2013) · Biochemical Pharmacology · doi:10.1016/j.bcp.2012.11.014 · Cited by 213
Bakker, M., & Wicherts, J. M. (2014) · Psychological Methods · doi:10.1037/met0000014 · Cited by 209
Testing competing models of loss aversion: an adversarial collaboration
Bateman, I., Kahneman, D., Munro, A., Starmer, C., & Sugden, R. (2005) · Journal of Public Economics · doi:10.1016/j.jpubeco.2004.06.013 · Cited by 208
Safeguard Power as a Protection Against Imprecise Power Estimates
Perugini, M., Gallucci, M., & Costantini, G. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614528519 · Cited by 198
de Groot, A. D. (2014) · Acta Psychologica · doi:10.1016/j.actpsy.2014.02.001 · Cited by 188
Conceptualizing and evaluating the replication of research results
Fabrigar, L. R., & Wegener, D. T. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.07.009 · Cited by 165
LeBel, E. P., & Peters, K. R. (2011) · Review of General Psychology · doi:10.1037/a0025172 · Cited by 162
Experiences of collaborative research
Kahneman, D. (2003) · American Psychologist · doi:10.1037/0003-066x.58.9.723 · Cited by 149
HARKing's Threat to Organizational Research: Evidence From Primary and Meta‐Analytic Sources
Bosco, F. A., Aguinis, H., Field, J. G., Pierce, C. A., & Dalton, D. R. (2015) · Personnel Psychology · doi:10.1111/peps.12111 · Cited by 140
Research Practices That Can Prevent an Inflation of False-Positive Rates
Murayama, K., Pekrun, R. H., & Fiedler, K. (2013) · Personality and Social Psychology Review · doi:10.1177/1088868313496330 · Cited by 136
The effect of horizontal eye movements on free recall: A preregistered adversarial collaboration.
Matzke, D., Nieuwenhuis, S., van Rijn, H., Slagter, H. A., van der Molen, M. W., & Wagenmakers, E. (2015) · Journal of Experimental Psychology General · doi:10.1037/xge0000038 · Cited by 113
PsychDisclosure.org: Grassroots Support for Reforming Reporting Standards in Psychology
LeBel, E. P., Borsboom, D., Giner‐Sorolla, R., Hasselman, F., Peters, K. R., Ratliff, K. A., & Smith, C. T. (2013) · Perspectives on Psychological Science · doi:10.1177/1745691613491437 · Cited by 107
Self-citationVazire, S. (2015) · Social Psychological and Personality Science · doi:10.1177/1948550615603955 · Cited by 90
Bostyn, D. H., & Roets, A. (2015) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.11.005 · Cited by 69
Approaching a fair deal for significance and other concerns
Giner‐Sorolla, R. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2016.01.010 · Cited by 44
Self-citationHow can preregistration contribute to research in our field?
Jonas, K. J., & Cesario, J. (2015) · Comprehensive Results in Social Psychology · doi:10.1080/23743603.2015.1070611 · Cited by 39
Badges to Acknowledge Open PracticesPreprint
Blohowiak, B. B., Cohoon, J., de‐Wit, L., Eich, E., Farach, F. J., Hasselman, F., Holcombe, A. O., Humphreys, M., Lewis, M., Nosek, B. A., et al. (n.d.) · OSF Preprints (OSF Preprints) · Cited by 32
Self-citationNier, J. A., & Campbell, S. D. (2012) · Sex Roles · doi:10.1007/s11199-012-0154-2 · Cited by 17
Rationale and guidelines for empirical adversarial collaboration: AThinking & Reasoninginitiative
Rakow, T., Thompson, V. L., Ball, L. J., & Markovits, H. (2014) · Thinking & Reasoning · doi:10.1080/13546783.2015.975405 · Cited by 15
Veer, A. E. V. Â., Gallucci, M., Stel, M., & van Beest, I. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00672 · Cited by 13
Cited by
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
The association between adolescent well-being and digital technology use
Orben, A., & Przybylski, A. K. (2019) · Nature Human Behaviour · doi:10.1038/s41562-018-0506-1 · Cited by 1,500
Teenagers, screens and social media: a narrative review of reviews and key studies
Orben, A. (2020) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-019-01825-4 · Cited by 706
Nelson, L. D., Simmons, J., & Simonsohn, U. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011836 · Cited by 548
Crowdsourcing Consumer Research
Goodman, J. K., & Paolacci, G. (2017) · Journal of Consumer Research · doi:10.1093/jcr/ucx047 · Cited by 588
Metadata
- Authors
- van 't Veer, A. E., & Giner-Sorolla, R.
- Venue
- Journal of Experimental Social Psychology
- Publisher
- Elsevier BV
- Published
- 2016-11
- Volume
- 67
- Pages
- 2-12
- ISSN
- 0022-1031 (ISSN-L)
- OpenAlex
- W2519024764
- Cited by
- 439
- References
- 68
- FWCI
- 51.06
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.