CoChat
Sign Up
Cited by 86Meta-analysis and systematic reviewsPsychology Research and BibliometricsScientific Computing and Data Management

The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.

Data from Investigating Variation in Replicability: A “Many Labs” Replication Project

Open access
Richard Anthony Klein, Kate A. Ratliff, Michelangelo Vianello, Reginald B. Adams, Štěpán Bahník, Michael Jason Bernstein, Konrad Bocian, Mark John Brandt, Beach Smith Brooks, Claudia Chloe Brumbaugh, Zeynep Cemalcılar, Jesse Chandler, Winnee Cheong, William E. Davis, Thierry Devos, Matthew Eisner, Natalia Frankowska, David R. Furrow, Elisa Maria Galliani, Fred Hasselman, Joshua A. Hicks, James F. Hovermale, S. Jane Hunt, Jeffrey R. Huntsinger, Hans IJzerman, Melissa‐Sue John, Jennifer Alana Joy-Gaba, Heather Barry Kappes, Lacy E. Krueger, Jaime Kurtz, Carmel Levitan, Robyn K. Mallett, Wendy L. Morris, Anthony J. Nelson, Jason A. Nier, Grant M. Packard, Ronaldo Pilati, Abraham M. Rutchick, Kathleen Schmidt, Jeanine Lee McHugh Skorinko, Robert W. Smith, Troy G. Steiner, Justin Storbeck, Lyn M. Van Swol, Donna Thompson, Anna van 't Veer, Leigh Ann Vaughn, Marek Albert Vranka, Aaron Lee Wichman, Julie A. Woodzicka, Brian A. Nosek·2014·Journal of Open Psychology Data
DOI 10.5334/jopd.ad

Published version of a preprint

Open this paper in CoChat — free accountOpen PDF

Abstract

This dataset is from the Many Labs Replication Project in which 13 effects were replicated across 36 samples and over 6,000 participants. Data from the replications are included, along with demographic variables about the participants and contextual information about the environment in which the replication was conducted. Data were collected in-lab and online through a standardized procedure administered via an online link. The dataset is stored on the Open Science Framework website. These data could be used to further investigate the results of the included 13 effects or to study replication and generalizability more broadly.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.5334/jopd.ad

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 15

  1. Klein, Investigating variation in replicability: A “many labs” replication project, Social Psychology
  2. Open Science Collaboration, 2012, An open, large-scale, collaborative effort to estimate the reproducibility of psychological science, Perspectives on Psychological Science, 7, 657, 10.1177/1745691612462588 · DOI
  3. Makel, 2012, Replications in Psychology Research How Often Do They Really Occur?, Perspectives on Psychological Science, 7, 537, 10.1177/1745691612460688 · DOI · Paper page
  4. Ioannidis, 2005, Why most published research findings are false, PLoS medicine, 2, e124, 10.1371/journal.pmed.0020124 · DOI · Paper page
  5. Oppenheimer, 2009, Instructional manipulation checks: Detecting satisficing to increase statistical power, Journal of Experimental Social Psychology, 45, 867, 10.1016/j.jesp.2009.03.009 · DOI · Paper page
  6. Jacowitz, 1995, Measures of anchoring in estimation tasks, Personality and Social Psychology Bulletin, 21, 1161, 10.1177/01461672952111004 · DOI
  7. Oppenheimer, 2009, The retrospective gambler’s fallacy: Unlikely events, constructing the past, and multiple universes, Judgment and Decision Making, 4, 326, 10.1017/S1930297500001170 · DOI
  8. Schwarz, 1985, Response scales: Effects of category range on reported behavior and comparative judgments, Public Opinion Quarterly, 49, 388, 10.1086/268936 · DOI
  9. Hyman, 1950, The Teaching of Contemporary Affairs, 11
  10. Rugg, 1941, Experiments in wording questions: II, Public Opinion Quarterly, 10.1086/265467 · DOI
  11. Lorge, 1936, Prestige, suggestion, and attitudes, The Journal of Social Psychology, 7, 386, 10.1080/00224545.1936.9919891 · DOI
  12. Carter, 2011, A single exposure to the American flag shifts support toward Republicanism up to 8 months later, Psychological science, 22, 1011, 10.1177/0956797611414726 · DOI
  13. Caruso, 2013, Mere exposure to money increases endorsement of free-market systems and social inequality, Journal of Experimental Psychology: General, 142, 301, 10.1037/a0029288 · DOI
  14. Husnu, 2010, Elaboration enhances the imagined contact effect, Journal of Experimental Social Psychology, 46, 943, 10.1016/j.jesp.2010.05.014 · DOI
  15. Nosek, 2002, Math = Male, Me = Female, therefore Math ≠ Me, Journal of Personality and Social Psychology, 83, 44, 10.1037/0022-3514.83.1.44 · DOI

Cited by

Sorted by citations

Metadata

Authors
Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B., Bahník, Š., Bernstein, M. J., Bocian, K., Brandt, M. J., Brooks, B. S., Brumbaugh, C. C., Cemalcılar, Z., Chandler, J., Cheong, W., Davis, W. E., Devos, T., Eisner, M., Frankowska, N., Furrow, D. R., Galliani, E. M., Hasselman, F., Hicks, J. A., Hovermale, J. F., Hunt, S. J., Huntsinger, J. R., IJzerman, H., John, M., Joy-Gaba, J. A., Kappes, H. B., Krueger, L. E., Kurtz, J., Levitan, C., Mallett, R. K., Morris, W. L., Nelson, A. J., Nier, J. A., Packard, G. M., Pilati, R., Rutchick, A. M., Schmidt, K., Skorinko, J. L. M., Smith, R. W., Steiner, T. G., Storbeck, J., Swol, L. M. V., Thompson, D., Veer, A. V. '., Vaughn, L. A., Vranka, M. A., Wichman, A. L., Woodzicka, J. A., & Nosek, B. A.
Affiliations
  • University of Florida (US)
  • University of Padua (IT)
  • Pennsylvania State University (US)
  • University of Würzburg (DE)
  • Uniwersytet SWPS (PL)
  • Tilburg University (NL)
  • Queens College, CUNY (US)
  • Koç University (TR)
  • University of Michigan (US)
  • HELP University (MY)
  • Texas A&M University (US)
  • San Diego State University (US)
  • Mount Saint Vincent University (CA)
  • Radboud University Nijmegen (NL)
  • Virginia Commonwealth University (US)
  • East Texas A&M University (US)
  • Loyola University Chicago (US)
  • Worcester Polytechnic Institute (US)
  • London School of Economics and Political Science (GB)
  • James Madison University (US)
  • Occidental College (US)
  • McDaniel College (US)
  • Connecticut College (US)
  • Wilfrid Laurier University (CA)
  • Universidade de Brasília (BR)
  • California State University, Northridge (US)
  • University of Virginia (US)
  • The Ohio State University (US)
  • University of Wisconsin–Madison (US)
  • Ithaca College (US)
  • Charles University (CZ)
  • Western Kentucky University (US)
  • Washington and Lee University (US)
  • Center for Open Science (US)
ORCID
Venue
Journal of Open Psychology Data
Publisher
Ubiquity Press, Ltd.
Published
2014-04-04
Volume
2
Issue
1
Pages
e4
ISSN
2050-9863 (ISSN-L)
DOI
10.5334/jopd.ad
OpenAlex
W2126632863
Cited by
86
References
2
Citations by year
2026: 2 · 2025: 5 · 2024: 8 · 2023: 5 · 2022: 13 · 2021: 9 · 2020: 9 · 2019: 5 · 2018: 9 · 2017: 7 · 2016: 5 · 2015: 6 · 2014: 3
FWCI
6.86
Type
journal article
Language
en
Open access
Licence
Locations
  • Journal of Open Psychology Data (publishedVersion, cc-by)
  • Tilburg University Research Portal (publishedVersion, other-oa)
  • Research portal (Tilburg University) (publishedVersion, other-oa)
  • JOPD - Journal of Open Psychology Data (submittedVersion, cc-by)
  • Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • PsyArXiv (OSF Preprints) (submittedVersion)
  • PsyArXiv (OSF Preprints) (submittedVersion, public-domain)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
  • Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
Keywords
replication, replicability, many labs, replication study, generalizability, effect size, participant demographics, online data collection

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review