Cited by 185Psychology Research and BibliometricsMeta-analysis and systematic reviewsMemory Processes and Influences

The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.

Using Nonnaive Participants Can Reduce Effect Sizes

Chandler, Jesse, Paolacci, Gabriele, Peer, Eyal, Mueller, Pam, Ratliff, Kate A.·2015·Psychological Science

Open this paper in CoChat — free account

Abstract

Although researchers often assume their participants are naive to experimental materials, this is not always the case. We investigated how prior exposure to a task affects subsequent experimental results. Participants in this study completed the same set of 12 experimental tasks at two points in time, first as a part of the Many Labs replication project and again a few days, a week, or a month later. Effect sizes were markedly lower in the second wave than in the first. The reduction was most pronounced when participants were assigned to a different condition in the second wave. We discuss the methodological implications of these findings.

Integrity signals

Registry

Crossref · 10.1177/0956797615585115

Cites

29 of 29 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1149 · Cited by 37,615
The Framing of Decisions and the Psychology of Choice
Tversky, A., & Kahneman, D. (1981) · Science · doi:10.1126/science.7455683 · Cited by 18,497 · cited 1×
“In the gain-versus-loss-framing task (Tversky & Kahneman, 1981), participants read a disease scenario framed in terms of either gains or losses.”
Method
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
Instructional manipulation checks: Detecting satisficing to increase statistical power
Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.03.009 · Cited by 3,493
Source monitoring.
Johnson, M. K., Hashtroudi, S., & Lindsay, D. S. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.1.3 · Cited by 3,392
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Paolacci, G., & Chandler, J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414531598 · Cited by 2,136
One Hundred Years of Social Psychology Quantitatively Described
Richard, F. D., Bond, C. F., & Stokes-Zoota, J. J. (2003) · Review of General Psychology · doi:10.1037/1089-2680.7.4.331 · Cited by 1,558
Experimental methods: Between-subject and within-subject design
Charness, G., Gneezy, U., & Kuhn, M. A. (2012) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2011.08.009 · Cited by 1,469
Investigating Variation in Replicability: A “Many Labs” Replication Project
Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B., Bahník, Š., Bernstein, M. J., Bocian, K., Brandt, M. J., Brooks, B., Brumbaugh, C. C., et al. (2014) · Social Psychology · doi:10.1027/1864-9335/a000178 · Cited by 1,208
Ambiguity Aversion and Comparative Ignorance
Fox, C. R., & Tversky, A. (1995) · The Quarterly Journal of Economics · doi:10.2307/2946693 · Cited by 1,072

Flagged first, then by citations

Show all 29 references

Research works printed but not linked: 2

Hyman H. H., 1950, The teaching of contemporary affairs, 11
Lipsey M. W., 2001, Applied Social Research Methods Series: Vol. 49. Practical meta-analysis

Sorted by citations

Items 101–183 of 183

Investigating the Relationship Between Self-Perceived Moral Superiority and Moral Behavior Using Economic Games
Tappin, B. M., & McKay, R. (2018) · Social Psychological and Personality Science · doi:10.1177/1948550617750736 · Cited by 10
Parasocial forgiveness: The roles of parasocial closeness and offense perceptions
Osterman, L. L., & Hecmanczuk, T. (2019) · Journal of Social and Personal Relationships · doi:10.1177/0265407519879511 · Cited by 10
Who can serve as the proxy for public employees in public administration experiments? a cross-sample comparison
Lu, X., Wang, W., & Xu, H. (2020) · Public Management Review · doi:10.1080/14719037.2020.1864014 · Cited by 10
A network analysis of Facebook use and well-being in relation to key psychological variables: Replication and extension.
Faelens, L., de Putte, E. V., Hoorelbeke, K., Raedt, R. D., & Koster, E. H. W. (2020) · Psychology of Popular Media · doi:10.1037/ppm0000325 · Cited by 12
Weighing the moral worth of altruistic actions: A discrepancy between moral evaluations and prescriptive judgments
Deviatko, I. F., & Bykov, A. V. (2021) · Philosophical Psychology · doi:10.1080/09515089.2021.1950666 · Cited by 8
Crowdsourcing in observational and experimental research
Zallot, C., Paolacci, G., Chandler, J., & Sisso, I. (2021) · Routledge eBooks · doi:10.4324/9781003025245-12 · Cited by 8
Consumption experiences in the research process
Gould, S. J. J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502001 · Cited by 11
Platform over procedure: Online platforms that pre-vet participants yield higher data quality without sacrificing diversityPreprint
Péer, E., Rothschild, D. M., & Gordon, A. (2023) · doi:10.31234/osf.io/buzwn · Cited by 8
What's in a trauma? Using machine learning to unpack what makes an event traumatic
Jones, P. J. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.07.066 · Cited by 7
Teachers’ and Administrators’ Perceptions of Police-to-Student Encounters: The Impact of Student Race, Police Legitimacy, and Legal Authoritarianism
Watson, A., & Stevenson, M. C. (2020) · Race and Justice · doi:10.1177/2153368720922286 · Cited by 8
Can we reduce facial biases? Persistent effects of facial trustworthiness on sentencing decisionsPreprint
Jaeger, B., Todorov, A. T., Evans, A. M., & van Beest, I. (2019) · doi:10.31234/osf.io/a8w2d · Cited by 9
Crowdsourcing the Implicit Association Test: Limitations and Best Practices
Connors, S. W., Spangenberg, K., Perkins, A. W., & Forehand, M. (2020) · Journal of Advertising · doi:10.1080/00913367.2020.1806155 · Cited by 6
Grasping for Metaphors: Identity Ambiguity Contributes to the Preference for Metaphor Usage
Bultmann, M. N., Wheeler, N., Jimenez, T., & Arndt, J. (2019) · Journal of Language and Social Psychology · doi:10.1177/0261927x19894032 · Cited by 7
No effects of synchronicity in online social dilemma experiments: A registered report
Evans, A. M., Kogler, C., & Sleegers, W. W. A. (2021) · Judgment and Decision Making · doi:10.1017/s1930297500008007 · Cited by 5
MTurk ‘Unscrubbed’: Exploring the Good, the ‘Super’, and the Unreliable on Amazon's Mechanical TurkPreprint
Deetlefs, J., Chylinski, M., & Ortmann, A. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2654056 · Cited by 6
Time Pressure and Honesty in a Deception GamePreprint
Capraro, V., Schulz, J., & Rand, D. G. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3184537 · Cited by 6
Could classic psychedelics influence immigrants’ acculturation process? A narrative review contemplating how
Korman, B. A. (2023) · Drug Science Policy and Law · doi:10.1177/20503245231191400 · Cited by 5
Does a Professional Sport Team's Corporate Social Responsibility (CSR) Initiative Increase Fans’ Trust in the Team and CSR Participation Intention? A Moderated Mediation Model
Oh, Y. S., Arthur-Banning, S. G., Mamo, Y., & Chiu, W. (2024) · Sport Marketing Quarterly · doi:10.32731/smq.334.122024.05 · Cited by 5
Encouraging Parental Sexual Communication with Teen Sons: A Social Norms Experiment
Pariera, K. L., & Brody, E. (2021) · Health Communication · doi:10.1080/10410236.2021.2010352 · Cited by 5
Death, ideology, and worldview: Evidence of death anxiety but not mortality salience effects on political ideology and worldviewPreprint
Nilsson, A., & Sinclair, S. (2021) · doi:10.31234/osf.io/anh8v · Cited by 5
Moving Experimental Psychology Online: How to Maintain Data Quality When We Can’t See Our ParticipantsPreprint
Rodd, J. M. (2023) · doi:10.31234/osf.io/2fhcb · Cited by 5
Human factors in digital manufacturing technology adoption: a workforce perspective
Oostveen, A., Eimontaite, I., & Fletcher, S. (2025) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-025-16524-5 · Cited by 9
Framing parents’ attitudes toward career and technical education
Ecton, W. G. (2023) · Education Policy Analysis Archives · doi:10.14507/epaa.31.7980 · Cited by 4
Does the evaluability bias hold when giving to animal charities?
Spiteri, G. W. (2022) · Judgment and Decision Making · doi:10.1017/s1930297500009128 · Cited by 4
Longitudinal Pathways from Parent Internalizing Symptoms to Parent and Youth Emotion Functioning
Hare, M. M., Feeney, K. E., & Parent, J. M. (2022) · Child Psychiatry & Human Development · doi:10.1007/s10578-022-01482-w · Cited by 7
Influencing and Measuring Behaviour in Crowdsourced Activities
Gould, S. J. J., Cox, A. L., & Brumby, D. P. (2018) · Human-computer interaction series · doi:10.1007/978-3-319-73374-6_7 · Cited by 4
Do Pandemics Trigger Death Thoughts?
Leung, H.-T., Chew, P. K. H., & Caltabiano, N. J. (2024) · Journal of Humanistic Psychology · doi:10.1177/00221678241273422 · Cited by 3
Consistency and contrast effects in moral evaluation of euthanasia
Bahník, Š., & Vranka, M. A. (2018) · Current Psychology · doi:10.1007/s12144-018-0012-7 · Cited by 3
Deliberation Favours Social Efficiency by Making People Disregard Their Relative Shares: Evidence from US and IndiaPreprint
Capraro, V., Corgnet, B., Espín, A., & Hérnan-Gonzalez, R. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2799850 · Cited by 3
Entering into a self-regulated learning mode prevents detrimental effects of feedback removal on memory
Vavra, P., Sokolovič, L., Porcu, E., Ripollés, P., Rodríguez‐Fornells, A., & Noesselt, T. (2023) · npj Science of Learning · doi:10.1038/s41539-022-00150-x · Cited by 2
Amazon Mechanical Turk: The Human Sciences’ Labor Problem
Wei, J. T. (2024) · Labor Studies in Working-Class History of the Americas · doi:10.1215/15476715-11199970 · Cited by 2
Users’ mental models within human–AI interaction: a systematic scoping review
Bodamer, W. G., Schoenmakers, S., Castellar, E. N., & IJsselsteijn, W. A. (2026) · AI & Society · doi:10.1007/s00146-026-03038-1 · Cited by 4
(Non-) impact of task experience on behavioral economic decision-making.
Strickland, J. C., Bolin, B. L., & Marks, K. R. (2021) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000438 · Cited by 3
Comparing Foodie Calls in Poland, the United Kingdom, and the United States: A Registered Replication Report
Orhan, M. A., Collisson, B., Howell, J. L., Kowal, M., & Pollet, T. V. (2023) · Psychological Reports · doi:10.1177/00332941231164079 · Cited by 2
Lay beliefs about self-control: A linguistic analysis
Vaughn, L. A., & Burkins, P. G. (2023) · Current Research in Behavioral Sciences · doi:10.1016/j.crbeha.2023.100107 · Cited by 3
The Influence of Observation on Cooperative Decision Making
Rotella, A. (2015) · The Atrium (University of Guelph) · Cited by 2
How does Stakeholder Engagement and Social Capital Influence Project Performance Outcomes?
Arias, J. J. (2021) · FIU - Digital Commons (Florida International University) · doi:10.25148/etd.fidc010180 · Cited by 3
Challenging the Public Stigma of Alcohol Use Disorder in the UK Using Video ‘Education’ and ‘Contact’ Interventions: A Pilot Study
Hytner, S., Josselin, D., Belin, D., & Bowden‐Jones, O. (2024) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-024-01393-y · Cited by 1
Mechanical Turk: A Versatile Tool in the Behavioral Scientist’s Toolkit
Moss, A. J., Hauser, D., Rosenzweig, C., Robinson, J., & Litman, L. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009000796.003 · Cited by 1
Does negative buzz result in social media discontinuation? Investigating the effects of negative word of mouth in the United States, India, and Finland
Farooq, A., Salminen, J. O., Dahabiyeh, L., Javed, Y., & Jansen, B. J. J. (2025) · Technology in Society · doi:10.1016/j.techsoc.2025.103103 · Cited by 1
Examining the Utility of Behavioral Economic Demand in Addiction Science
Strickland, J. C. (2019) · UKnowledge (University of Kentucky) · doi:10.13023/etd.2019.030 · Cited by 1
Conducting Surveys and Experiments on the Internet
Stern, C., & Axt, J. R. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009170123.012 · Cited by 1
Horizontal Versus Vertical Synergy: Exploring the Impact of Generative AI Synergies in Higher Education
Lee, C. T., & Pan, L.-Y. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2531280 · Cited by 2
Canadians’ Attitudes Toward Community Reintegration of Those with a Mental Health Disorder Who Have Committed a Sexual Offense
Barry, B., Coish, M., Fields, D., McPhee, P., Monaghan, J., & Ternes, M. (2025) · International Journal of Forensic Mental Health · doi:10.1177/14999013251366447 · Cited by 1
Approaches from cognitive neuroscience and comparative cognition
Koushik, C. S. N., Choubey, S. B., & Choubey, A. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-819445-4.00001-1 · Cited by 1
Increasing Altruistic and Cooperative Behaviour with Simple Moral NudgesPreprint
Capraro, V., Jagfeld, G., Klein, R., Mul, M., & van de Pol, I. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3064004 · Cited by 1
Using an Integrated Choice and Latent Variable Model to Understand the Impact of 'Professional' Respondents in a Stated Preference SurveyPreprint
Sandorf, E. D., Persson, L., & Broberg, T. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3368948 · Cited by 1
Control and Intimate Partner Aggression
Dempsey, F. (2021) · doi:10.26686/wgtn.15131094.v1 · Cited by 1
A Three-Layered Sample Selection Model for Contingent Valuation: Application to Carbon Capture and StoragePreprint
Creppy, P., Sandorf, E. D., Dugstad, A., Zuch, M., & Ladenburg, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5806565 · Cited by 1
Sharing a screen while shopping : understanding the motivations and mechanisms of screen-Sharing : an application to shop assistants-customers interactions
Roten, Y. S. (2019) · theses.fr (ABES) · doi:10.70675/e8d37ea2z6f63z4eeaz9d2ez17efae4d6859 · Cited by 1
Rationalizing undeserved outcomes:effects of random positive events on reactions to victims
Elmore, J. D. (2017)
Direct replications in the era of open sampling
Paolacci, G., & Chandler, J. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000808
Lost In The Crowd
Behrend, T. S., & Ravid, D. M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108649636.029
Time pressure and honesty in a deception gamePreprint
Capraro, V., Schulz, J., & Rand, D. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09841
An existential function of doomsday: the effects of existential vulnerability and apocalyptic beliefs on meaning in life
Kaslon, S. W. (2019) · doi:10.7282/t3-0007-ma21
From the Distal to the Proximate: Exploring Social Cognitions in Risk-taking
Wuth, A. (2019) · oURspace (University of Regina) · doi:10.82465/7244
Online Research and Education
Kuratomi, K. (2020) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.32.3_92
Exploring Challenges and the Evolution of the Retail Industry: A Consumer PerspectivePreprint
Marzolf, M. J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4529798
Strategic Reasoning Online: Experiments on the Beauty ContestPreprint
Engelhardt, R., & Galeazzi, P. (2023) · Research Square · doi:10.21203/rs.3.rs-3604793/v1
The Relation of Possible Selves and Self-Concept Clarity to Generalized Anxiety Disorder
Zheng, S. (2024) · doi:10.32920/25219199
The Relation of Possible Selves and Self-Concept Clarity to Generalized Anxiety Disorder
Zheng, S. (2024) · doi:10.32920/25219199.v1
Apologies, Cheap Talk, and Silence: How People Think About Reputations in Public Goods Scenarios
Constantin, K., Sell, J. A., & Murphy, C. J. (2025) · Social Science Quarterly · doi:10.1111/ssqu.70007
4. Conducting Online Psychological Experiments Using Crowdsourcing
Majima, Y. (2021) · The Journal of The Institute of Image Information and Television Engineers · doi:10.3169/itej.75.480
Internal attentional window affects the processing of external stimuli depending on predictability
Kim, Y., & Jeong, S. K. (2025) · Attention Perception & Psychophysics · doi:10.3758/s13414-025-03050-5
Foundational tests of the need-support model: A framework for bridging regulatory focus theory and self-determination theoryPreprint
Vaughn, L. A. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/bfr5s_v1
How shared leadership and task complexity shape expectations of team effectiveness
Xie, W., & Fisher, C. M. (2025) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2025.2495968
Multilingualism and malleability of verbal abilities: Parents’ practices and beliefs about learning two languages in early childhood
Hadi, S. G. E., & Rowe, M. L. (2025) · Applied Developmental Science · doi:10.1080/10888691.2025.2503845
Spoken Language Dual-Task Effects in Typical Aging: A Systematic Review
Salis, C., Murray, L. L., & Jarrar, R. (2025) · Journal of Speech Language and Hearing Research · doi:10.1044/2025_jslhr-24-00826
Reevaluating the Necessity of Attention Check QuestionsPreprint
Péer, E., Rothschild, D. M., & Andrew, G. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5398006
Narrative Dead-Ends Down Memory Lane
Ryall, A., & Willis, N. (2025) · Topoi · doi:10.1007/s11245-025-10265-6
Earmarking donations to boost study participation? Evidence from a field experiment
Raff, A., BOHM, R. M., & Fuchs, C. (2025) · PLoS ONE · doi:10.1371/journal.pone.0331498
A Cyclical Time Concept Increases the Perceived Predictability of the Future and Reduces the Perceived Risk of Unlikely, but not Likely Risks
Lammers, J., & Liu, Z. Z. (2025) · Journal of Pacific Rim Psychology · doi:10.1177/18344909251386470 · Cited by 1
Addressing demand artifacts in psychological research (and beyond)
Corneille, O., Bernard, C. F., & Lush, P. (2026) · Behavior Research Methods · doi:10.3758/s13428-026-03155-1 · Cited by 2
Intuitive prosociality: heterogeneous treatment effects or false positive?
Kvarven, A., Strømland, E., & Torsvik, G. (2025) · Journal of Economic Psychology · doi:10.1016/j.joep.2025.102873
Behavioral Experiments on Decision Horizons in Conflict Analysis Theory Education
Wu, J., Xie, H., Zhao, S., Addae, B. A., & Yang, H. H. (2025) · Journal of Visualized Experiments · doi:10.3791/69552
38 Current Practices and Innovations in Sampling
Petro, G., Gonzales, A. L., & McLeod, C. N. (2025) · De Gruyter eBooks · doi:10.1515/9783111292144-046
Steering socially sustainable behaviour: how digital platforms can drive sustainable mobility
Misal, N., Bhimani, H., Väätänen, J., & Mention, A. (2026) · The TQM Journal · doi:10.1108/tqm-03-2025-0188
Propositions de stratégies communicatives pour une action jointe Humain-Robot efficace, fluide et durable
Belhassein, K. (2021) · theses.fr (ABES) · doi:10.70675/f4d36796z2b61z4cd3zbf91zeda88e221a76
Implied motion but real effect : how implied motion influences consumers’ attention, evaluation, and purchase-related behavior
Yu, J. (2022) · theses.fr (ABES) · doi:10.70675/4480c5d1z2c55z441dzabf5zf5f465695469
The Price of Diversity: A Costly Choice Screens for Cooperative Intent and Yields Higher Performance in Mixed-Gender TeamsPreprint
Levine, S. S., Sima, Y., Reypens, C., & Stark, D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6667999
The Price of Diversity: A Costly Choice Screens for Cooperative Intent and Yields Higher Performance in Mixed-Gender TeamsPreprint
Levine, S. S., Sima, Y., Reypens, C., & Stark, D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6667918
Beyond the Turk: Alternative platforms for crowdsourcing behavioral researchPreprint
Acquisti, A., Brandimarte, L., Samat, S., & Peer, E. (2017) · OSF Preprints (OSF Preprints)
(UN)qualified immunity? Public support for qualified immunity in policing
Hodge, G., Graham, A., Dawson, A. J., & Posick, C. (2026) · Policing A Journal of Policy and Practice · doi:10.1093/police/paag021

Authors: Chandler, J., Paolacci, G., Peer, E., Mueller, P., & Ratliff, K. A.
Affiliations: University of Michigan (US)
Erasmus University Rotterdam (NL)
Graduate School of Business Administration, Bar-Ilan University
Princeton University (US)
University of Florida (US)
ORCID: Chandler, Jesse
Paolacci, Gabriele
Ratliff, Kate A.
Venue: Psychological Science
Publisher: SAGE Publications
Published: 2015-06-10
Volume: 26
Issue: 7
Pages: 1131-1139
ISSN: 0956-7976 (ISSN-L)
1467-9280
DOI: 10.1177/0956797615585115
OpenAlex: W2162475434
Cited by: 185
References: 29
Citations by year: 2026: 6 · 2025: 20 · 2024: 10 · 2023: 15 · 2022: 10 · 2021: 23 · 2020: 20 · 2019: 21 · 2018: 14 · 2017: 27 · 2016: 15 · 2015: 3
FWCI: 29.35
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Psychological Science (publishedVersion)
PubMed (publishedVersion)
EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
Topics: Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
Keywords: replication, task familiarity, within-participant design
MeSH terms: Adult, Female, Humans, Male, Patient Participation, Patient Selection

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Using Nonnaive Participants Can Reduce Effect Sizes

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks