The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
The Replication Recipe: What makes for a convincing replication?
Open accessAbstract
Psychological scientists have recently started to reconsider the importance of close replications in building a cumulative knowledge base; however, there is no consensus about what constitutes a convincing close replication study. To facilitate convincing close replication attempts we have developed a Replication Recipe, outlining standard criteria for a convincing close replication. Our Replication Recipe can be used by researchers, teachers, and students to conduct meaningful replication studies and integrate replications into their scholarly habits.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Behavioral Study of obedience.
Milgram, S. (1963) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0040525 · Cited by 4,918 · cited 1×
“Burger (2009) successfully replicated Milgram's famous obedience experiments (e.g., Milgram, 1963), suggesting that when well-conducted replications are successful they can provide us with greater con fi dence about the veracity of the predicted effect.”
BackgroundMood and judgment: The affect infusion model (AIM).
Forgas, J. P. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.117.1.39 · Cited by 3,470
Social class, solipsism, and contextualism: How the rich are different from the poor.
Kraus, M. W., Piff, P. K., Mendoza-Denton, R., Rheinschmidt, M. L., & Keltner, D. (2012) · Psychological Review · doi:10.1037/a0028756 · Cited by 1,397
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences
Schmidt, S. (2009) · Review of General Psychology · doi:10.1037/a0015108 · Cited by 1,125
An Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042 · cited 1×
“suspect ulterior motives of the replicator, and makes it more difficult to exercise liberty in choosing an analytic method to exploit the chances of declaring the findings in favor of (or against) the hypothesis (Simmons et al., 2011; Wagenmakers et al., 2012).”
MethodConsequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022 · cited 1×
“Because effect sizes in the published literature are likely to be overestimates of the true effect size (Greenwald, 1975), researchers should err conservatively, toward higher levels of power.”
BackgroundRecommendations for Increasing Replicability in Psychology
Asendorpf, J. B., Conner, M., De Fruyt, F., De Houwer, J., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R., Nosek, B. A., et al. (2013) · European Journal of Personality · doi:10.1002/per.1919 · Cited by 823
Self-citationReplication and Theory Development in Organizational Science: A Critical Realist Perspective
Tsang, E. W. K., & Kwan, K.-M. (1999) · The Academy of Management Review · doi:10.2307/259353 · Cited by 821
Replications in Psychology Research: How Often Do They Really Occur?
Makel, M. C., Plucker, J. A., & Hegarty, B. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612460688 · Cited by 750
Behavioral Priming: It’s all in the Mind, but whose Mind?
Doyen, S., Klein, O., Pichon, C.-L., & Cleeremans, A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0029081 · Cited by 670
Scherbaum, C. A., & Ferreter, J. M. (2009) · Organizational Research Methods · doi:10.1177/1094428107308906 · Cited by 665
Replicating Milgram: Would people still obey today?
Burger, J. M. (2009) · American Psychologist · doi:10.1037/a0010932 · Cited by 638
Personality, mood, and cognitive processing of emotional information: Three conceptual frameworks.
Rusting, C. L. (1998) · Psychological Bulletin · doi:10.1037//0033-2909.124.2.165 · Cited by 618
An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science
Open Science Collaboration (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612462588 · Cited by 614
Under what conditions does theory obstruct research progress?
Greenwald, A. G., Pratkanis, A. R., Leippe, M. R., & Baumgardner, M. H. (1986) · Psychological Review · doi:10.1037/0033-295x.93.2.216 · Cited by 574
Sample Size Planning for Statistical Power and Accuracy in Parameter Estimation
Maxwell, S. E., Kelley, K., & Rausch, J. R. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093735 · Cited by 542
How are we doing in soft psychology?
Rosenthal, R. (1990) · American Psychologist · doi:10.1037//0003-066x.45.6.775 · Cited by 515
The Thermometer of Social Relations: Mapping Social Proximity on Temperature
IJzerman, H., & Semin, G. R. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02434.x · Cited by 440
Self-citationMiddle class and marginal? Socioeconomic status, stigma, and self-regulation at an elite university.
Johnson, S. E., Richeson, J. A., & Finkel, E. J. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0021956 · Cited by 297
Most Reported Genetic Associations With General Intelligence Are Probably False Positives
Chabris, C. F., Hebert, B. M., Benjamin, D. J., Beauchamp, J., Cesarini, D., van der Loos, M., Johannesson, M., Magnusson, P. K. E., Lichtenstein, P., Atwood, C. S., et al. (2012) · Psychological Science · doi:10.1177/0956797611435528 · Cited by 278
Defensive Zeal and the Uncertain Self: What Makes You So Sure?
McGregor, I., & Marigold, D. C. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.5.838 · Cited by 259
Jasny, B. R., Chin, G., Chong, L., & Vignieri, S. (2011) · Science · doi:10.1126/science.334.6060.1225 · Cited by 245
Funder, D. C., Levine, J. M., Mackie, D. M., Morf, C. C., Sansone, C., Vazire, S., & West, S. G. (2014) · Personality and Social Psychology Review · doi:10.1177/1088868313507536 · Cited by 245
Brandt, M. J. (2013) · Journal of Personality and Social Psychology · doi:10.1037/a0031751 · Cited by 230
Self-citationReplication in behavioral research.
Rosenthal, R. (1990) · Journal of social behavior and personality · Cited by 214
Shieh, G. (2009) · Organizational Research Methods · doi:10.1177/1094428108320370 · Cited by 198
Replication Research in the Social Sciences
Madden, C. S., & Neuliep, J. W. (1992) · Journal of Marketing · doi:10.2307/1251993 · Cited by 195
Low-status compensation: A theory for understanding the role of status in cultures of honor.
Henry, P. J. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0015476 · Cited by 174
Replication in prevention science
Valentine, J. C., Biglan, A., Boruch, R. F., Castro, F. G., Collins, L. M., Flay, B. R., Kellam, S., Mościcki, E. K., & Schinke, S. P. (2011) · Prevention Science · doi:10.1007/s11121-011-0217-6 · Cited by 166
LeBel, E. P., & Peters, K. R. (2011) · Review of General Psychology · doi:10.1037/a0025172 · Cited by 162
Lakens, D. (2011) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0024955 · Cited by 136
Research Practices That Can Prevent an Inflation of False-Positive Rates
Murayama, K., Pekrun, R. H., & Fiedler, K. (2013) · Personality and Social Psychology Review · doi:10.1177/1088868313496330 · Cited by 136
Applied Power Analysis for the Behavioral Sciences
Aberson, C. L. (2011) · Routledge eBooks · doi:10.4324/9780203860274 · Cited by 120
Bonett, D. G. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412459512 · Cited by 118
RTbox: A device for highly accurate response time measurements
Li, X., Liang, Z., Kleiner, M., & Lu, Z. (2010) · Behavior Research Methods · doi:10.3758/brm.42.1.212 · Cited by 110
Plant, R. R., & Turner, G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.3.598 · Cited by 96
Statistical power analysis for growth curve models using SAS
Zhang, Z. J., & Wang, L. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1083 · Cited by 69
Bite-size science and its undesired side effects
Bertamini, M., & Munafò, M. R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691611429353 · Cited by 62
Can the goal of honesty be primed?
Pashler, H., Rohrer, D., & Harris, C. R. (2013) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2013.05.011 · Cited by 55
Heightened Sensitivity to Temperature Cues in Individuals With High Anxious Attachment
LeBel, E. P., & Campbell, L. (2013) · Psychological Science · doi:10.1177/0956797613486983 · Cited by 40
Evaluating Replication ResultsPreprint
Simonsohn, U. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2259879 · Cited by 38
Special Issue of Social Psychology on “Replications of Important Results in Social Psychology”
Nosek, B. A., & Lakens, D. (2013) · Social Psychology · doi:10.1027/1864-9335/a000143 · Cited by 26
Rejoice! In ReplicationPreprint
IJzerman, H., & Brandt, M. J. (2017) · doi:10.31234/osf.io/cmdq8 · Cited by 20
Self-citationHow Much Do Incidental Values Affect the Judgment of Time?
Matthews, W. J. (2012) · Psychological Science · doi:10.1177/0956797612441609 · Cited by 19
Dissociating influences of key and hand separation on the Stroop color-identification effect
Proctor, R. W., & Chen, J. (2012) · Acta Psychologica · doi:10.1016/j.actpsy.2012.06.005 · Cited by 12
Cited by
Investigating Variation in Replicability: A “Many Labs” Replication Project
Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B., Bahník, Š., Bernstein, M. J., Bocian, K., Brandt, M. J., Brooks, B., Brumbaugh, C. C., et al. (2014) · Social Psychology · doi:10.1027/1864-9335/a000178 · Cited by 1,208
Self-citationConstraints on Generality (COG): A Proposed Addition to All Empirical Papers
Simons, D. J., Shoda, Y., & Lindsay, D. S. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617708630 · Cited by 986
Is psychology suffering from a replication crisis? What does “failure to replicate” really mean?
Maxwell, S. E., Lau, M. Y., & Howard, G. S. (2015) · American Psychologist · doi:10.1037/a0039400 · Cited by 1,005
Westfall, J., Kenny, D. A., & Judd, C. M. (2014) · Journal of Experimental Psychology: General · doi:10.1037/xge0000014 · Cited by 928
Kleiman, E. M., Turner, B. J., Fedor, S., Beale, E. E., Huffman, J. C., & Nock, M. K. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000273 · Cited by 831
Metadata
- Authors
- Brandt, M. J., IJzerman, H., Dijksterhuis, A., Farach, F. J., Geller, J., Giner-Sorolla, R., Grange, J. A., Perugini, M., Spies, J. R., & van 't Veer, A.
- Venue
- Journal of Experimental Social Psychology
- Publisher
- Elsevier BV
- Published
- 2014-01
- Volume
- 50
- Pages
- 217-224
- ISSN
- 0022-1031 (ISSN-L)
- OpenAlex
- W3124580540
- Cited by
- 705
- References
- 50
- FWCI
- 49.00
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.