The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Constraints on Generality (COG): A Proposed Addition to All Empirical Papers
Abstract
Psychological scientists draw inferences about populations based on samples—of people, situations, and stimuli—from those populations. Yet, few papers identify their target populations, and even fewer justify how or why the tested samples are representative of broader populations. A cumulative science depends on accurately characterizing the generality of findings, but current publishing standards do not require authors to constrain their inferences, leaving readers to assume the broadest possible generalizations. We propose that the discussion section of all primary research articles specify Constraints on Generality (i.e., a “COG” statement) that identify and justify target populations for the reported findings. Explicitly defining the target populations will help other researchers to sample from the same populations when conducting a direct replication, and it could encourage follow-up studies that test the boundary conditions of the original finding. Universal adoption of COG statements would change publishing incentives to favor a more cumulative science.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Embracing intellectual humility in science via transparent and systematic reporting on limitations of scientific models and constraints on generality has the potential to improve the scientific enterprise 155 .”
From Predictors and consequences of intellectual humility (2022) · cites this paper as [155]
In the citing paper
“While our comparison sample captured a wide range of ages and education levels, our clinical samples were more homogeneous and our conclusions are thus subject to certain constraints on generality (Simons et al., 2017).”
From Are prediction error modifications domain specific in autism but domain general in ADHD? (2025) · cites this paper as Simons et al., 2017
In the citing paper
“At the same time, bolder framing such as this may be a deliberate choice resulting from perverse incentives, when scientists have to convince journals, funding agencies, and the broader public of the importance of their research (14,51,52).”
From Generic language in scientific communication (2019) · cites this paper as [14]
In the citing paper
“Simons et al. ([2017], p. 1123) note: 'Psychological scientists draw inferences about populations based on samples-of people, situations, and stimuli-from those populations.Yet, few articles identify their target populations, and even fewer justify how or why the tested samples are representative of broader populations'.”
From Science Communication and the Problematic Impact of Descriptive Norms (2023) · cites this paper as Simons et al. [2017]
In the citing paper
“While ten years have passed since Henrich et al.'s article, there is reason to believe that key aspects of the problem that the article highlighted still persist today.”
From Science Communication and the Problematic Impact of Descriptive Norms (2023) · cites this paper as Simons et al. [2017]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Kruger, J., & Dunning, D. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1121 · Cited by 7,731
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Nature · doi:10.1038/466029a · Cited by 3,441
The language-as-fixed-effect fallacy: A critique of language statistics in psychological research
Clark, H. H. (1973) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(73)80014-3 · Cited by 2,222
The Replication Recipe: What makes for a convincing replication?
Brandt, M. J., IJzerman, H., Dijksterhuis, A., Farach, F. J., Geller, J., Giner-Sorolla, R., Grange, J. A., Perugini, M., Spies, J. R., & van 't Veer, A. (2014) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2013.10.005 · Cited by 705
Is the Replicability Crisis Overblown? Three Arguments Examined
Pashler, H., & Harris, C. R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463401 · Cited by 697
Stimulus Sampling and Social Psychological Experimentation
Wells, G. L., & Windschitl, P. D. (1999) · Personality and Social Psychology Bulletin · doi:10.1177/01461672992512005 · Cited by 684
The Value of Direct Replication
Simons, D. J. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691613514755 · Cited by 630
Self-citationUnder what conditions does theory obstruct research progress?
Greenwald, A. G., Pratkanis, A. R., Leippe, M. R., & Baumgardner, M. H. (1986) · Psychological Review · doi:10.1037/0033-295x.93.2.216 · Cited by 574
True Photographs and False Memories
Lindsay, D. S., Hagen, L., Read, J. D., Wade, K. A., & Garry, M. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.01503002.x · Cited by 265
Self-citationGeneralizability: The trees, the forest, and the low-hanging fruit
Kukull, W. A., & Ganguli, M. (2012) · Neurology · doi:10.1212/wnl.0b013e318258f812 · Cited by 239
Research works printed but not linked: 1
- Shoda Y., 2014, Handbook of personality processes and individual differences, 491
Cited by
Racial Inequality in Psychological Research: Trends of the Past and Recommendations for the Future
Roberts, S. O., Bareket-Shavit, C., Dollins, F. A., Goldie, P. D., & Mortenson, E. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691620927709 · Cited by 1,049
“Proposed by Simons, Shoda, and Lindsay (2017), this recommendation makes clear the extent to which authors’ conclusions generalize across samples.”
Rad, M. S., Martingano, A. J., & Ginges, J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1721165115 · Cited by 746
“(9), who suggest authors should be asked to include statements regarding constraints on the generality of their findings.”
BackgroundReplicability, Robustness, and Reproducibility in Psychological Science
Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., Fidler, F., Hilgard, J., Kline Struhl, M., Nuijten, M. B., et al. (2022) · Annual Review of Psychology · doi:10.1146/annurev-psych-020821-114157 · Cited by 770
Yarkoni, T. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x20001685 · Cited by 701
Behavioural science is unlikely to change the world without a heterogeneity revolution
Bryan, C. J., Tipton, E., & Yeager, D. S. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01143-3 · Cited by 537
Metadata
- Authors
- Simons, D. J., Shoda, Y., & Lindsay, D. S.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- University of Washington (US)
- University of Victoria (CA)
- Corresponding author
- Simons, Daniel J.
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2017-08-30
- Volume
- 12
- Issue
- 6
- Pages
- 1123-1128
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W2751778071
- Cited by
- 986
- References
- 16
- Citations by year
- 2026: 104 · 2025: 102 · 2024: 107 · 2023: 132 · 2022: 125 · 2021: 139 · 2020: 125 · 2019: 80 · 2018: 61 · 2017: 11
- FWCI
- 98.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Perspectives on Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Funders
- University of Illinois at Urbana-Champaign
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- target population, sample representativeness, generalizability of findings, cumulative science, direct replication, boundary conditions
- MeSH terms
- Humans, Peer Review, Periodicals as Topic, Psychology, Research Design, Reproducibility of Results, Editorial Policies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Constraints on Generality (COG): A Proposed Addition to All Empirical Papers. https://app.cochat.ai/papers/10.1177/1745691617708630
- The paper
- Simons, D. J., Shoda, Y., & Lindsay, D. S. (2017). Constraints on Generality (COG): A Proposed Addition to All Empirical Papers. Perspectives on Psychological Science. https://doi.org/10.1177/1745691617708630
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.