The DOI matches its Crossref record; 139 of the 139 references it cites were found in a registry or an index.
Small Effects: The Indispensable Foundation for a Cumulative Psychological Science
Open accessAbstract
We draw on genetics research to argue that complex psychological phenomena are most likely determined by a multitude of causes and that any individual cause is likely to have only a small effect. Building on this, we highlight the dangers of a publication culture that continues to demand large effects. First, it rewards inflated effects that are unlikely to be real and encourages practices likely to yield such effects. Second, it overlooks the small effects that are most likely to be real, hindering attempts to identify and understand the actual determinants of complex psychological phenomena. We then explain the theoretical and practical relevance of small effects, which can have substantial consequences, especially when considered at scale and over time. Finally, we suggest ways in which scholars can harness these insights to advance research and practices in psychology (i.e., leveraging the power of big data, machine learning, and crowdsourcing science; promoting rigorous preregistration, including prespecifying the smallest effect size of interest; contextualizing effects; changing cultural norms to reward accurate and meaningful effects rather than exaggerated and unreliable effects). Only once small effects are accepted as the norm, rather than the exception, can a reliable and reproducible cumulative psychological science be built.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
The UK Biobank resource with deep phenotyping and genomic data
Bycroft, C., Freeman, C., Petkova, D., Band, G., Elliott, L. T., Sharp, K., Motyer, A., Vukcevic, D., Delaneau, O., O’Connell, J., et al. (2018) · Nature · doi:10.1038/s41586-018-0579-z · Cited by 8,876
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“…in line with a rising recognition that, in contrast to widespread underpowered studies in psychology, which likely report exaggerated effect sizes (Button et al., 2013; Schäfer & Schwarz, 2019; Szucs & Ioannidis, 2017), effect sizes obtained from well-powered preregistered studies (Funder &…”
Hindorff, L. A., Sethupathy, P., Junkins, H. A., Ramos, E. M., Mehta, J. P., Collins, F. S., & Manolio, T. A. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0903103106 · Cited by 4,013
10 Years of GWAS Discovery: Biology, Function, and Translation
Visscher, P. M., Wray, N. R., Zhang, Q., Sklar, P., McCarthy, M. I., Brown, M. A., & Yang, J. (2017) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2017.06.005 · Cited by 3,719
Experimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Evaluating Effect Size in Psychological Research: Sense and Nonsense
Funder, D. C., & Ozer, D. J. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919847202 · Cited by 3,295 · cited 10×
“Furthermore, special efforts should be made to eliminate confounding variables and improve measurement precision to further increase the reliability and reproducibility of psychological effects (De Boeck & Jeon, 2018; Funder & Ozer, 2019).”
BackgroundInfluentialEffect size guidelines for individual differences researchers
Gignac, G. E., & Szodorai, E. T. (2016) · Personality and Individual Differences · doi:10.1016/j.paid.2016.06.069 · Cited by 2,860
An Expanded View of Complex Traits: From Polygenic to Omnigenic
Boyle, E. A., Li, Y. I., & Pritchard, J. K. (2017) · Cell · doi:10.1016/j.cell.2017.05.038 · Cited by 2,851
Experiments in Intergroup Discrimination
Tajfel, H. (1970) · Scientific American · doi:10.1038/scientificamerican1170-96 · Cited by 2,577
A 61-million-person experiment in social influence and political mobilization
Bond, R. M., Fariss, C. J., Jones, J. J., Kramer, A. D. I., Marlow, C., Settle, J. E., & Fowler, J. H. (2012) · Nature · doi:10.1038/nature11421 · Cited by 2,575
23andMe Research Team, Lee, J. J., COGENT (Cognitive Genomics Consortium), Social Science Genetic Association Consortium, Wedow, R., Okbay, A., Kong, E., Maghzian, O., Zacher, M., Nguyen-Viet, T. A., et al. (2018) · Nature Genetics · doi:10.1038/s41588-018-0147-3 · Cited by 2,470
Meta-analysis of the heritability of human traits based on fifty years of twin studies
Polderman, T. J. C., Benyamin, B., de Leeuw, C. A., Sullivan, P. F., van Bochoven, A., Visscher, P. M., & Posthuma, D. (2015) · Nature Genetics · doi:10.1038/ng.3285 · Cited by 2,467 · cited 1×
“There is ample evidence that personality is affected by a multitude of diverse factors, ranging from proximal influences such as genetics (e.g., Bouchard, 2004; McCrae et al., 2000; Mõttus et al., 2017; Polderman et al., 2015; Turkheimer et al., 2014), childhood experiences (e.”
BackgroundRoberts, B. W., Kuncel, N. R., Shiner, R., Caspi, A., & Goldberg, L. R. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00047.x · Cited by 2,361 · cited 1×
“A particularly compelling example of this phenomenon is personality, for which effects accumulate over entire lifetimes (Noftle & Robins, 2007; Prentice & Miller, 1992) and across most major life domains, including occupational attainment, social success, personal relationships, financial security, and mortality (Ozer…”
BackgroundGenomic atlas of the human plasma proteome
Sun, B. B., Maranville, J. C., Peters, J. E., Stacey, D., Staley, J. R., Blackshaw, J., Burgess, S., Jiang, T., Paige, E., Surendran, P., et al. (2018) · Nature · doi:10.1038/s41586-018-0175-2 · Cited by 2,268
Personality and the Prediction of Consequential Outcomes
Ozer, D. J., & Benet-Martínez, V. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.57.102904.190127 · Cited by 2,170
The preregistration revolution
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708274114 · Cited by 1,998 · cited 1×
“First, to combat the issue of inflated effect sizes, we reaffirm preregistration (Nosek et al., 2018; Wagenmakers et al., 2012) and registered reports (Chambers, 2019; Hardwicke & Ioannidis, 2018; Nosek & Lakens, 2014) as potent means to gain a more realistic understanding of actual effect sizes in psychological scien…”
BackgroundHARKing: Hypothesizing after the results are known
Kerr, N. L. (1998) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0203_4 · Cited by 1,989
Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning
Yarkoni, T., & Westfall, J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617693393 · Cited by 1,916
23andMe Research Team, Liu, M., Psychiatry, H. A.-I., Jiang, Y., Wedow, R., Li, Y., Brazel, D. M., Chen, F., Datta, G., Davila-Velderrain, J., et al. (2019) · Nature Genetics · doi:10.1038/s41588-018-0307-5 · Cited by 1,896
Meta-Analysis: Recent Developments in Quantitative Methods for Literature Reviews
Rosenthal, R., & DiMatteo, M. R. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.59 · Cited by 1,780 · cited 1×
“…2001), ibuprofen intake and pain alleviation (r = .14; Funder & Ozer, 2019; Meyer et al., 2001), or cardiac patient education and exercise (r = .09; Rosenthal & DiMatteo, 2001) are small to minimal, according to Cohen’s (1988) classic guidelines, but still highly consequential from a…”
BackgroundTemperament and personality: Origins and outcomes.
Rothbart, M. K., Ahadi, S. A., & Evans, D. E. (2000) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.78.1.122 · Cited by 1,698
One Hundred Years of Social Psychology Quantitatively Described
Richard, F. D., Bond, C. F., & Stokes-Zoota, J. J. (2003) · Review of General Psychology · doi:10.1037/1089-2680.7.4.331 · Cited by 1,558 · cited 1×
“That is, an effect should be evaluated in light of typical effects sizes from the immediately relevant, specialized literature (Bosco et al., 2015; Gignac & Szodorai, 2016; Richard et al., 2003) rather than generic one-size-fits-all thresholds such as those proposed by Cohen (1988).”
BackgroundCamerer, C. F., Dreber, A., Holzmeister, F., Ho, T.-H., Huber, J., Johannesson, M., Kirchler, M., Nave, G., Nosek, B. A., Pfeiffer, T., et al. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0399-z · Cited by 1,521
A national experiment reveals where a growth mindset improves achievement
Yeager, D. S., Hanselman, P., Walton, G. M., Murray, J. S., Crosnoe, R., Muller, C., Tipton, E., Schneider, B., Hulleman, C. S., Hinojosa, C. P., et al. (2019) · Nature · doi:10.1038/s41586-019-1466-y · Cited by 1,513
Psychological testing and psychological assessment: A review of evidence and issues.
Meyer, G. J., Finn, S. E., Eyde, L. D., Kay, G. G., Moreland, K. L., Dies, R. R., Eisman, E. J., Kubiszyn, T. W., & Reed, G. M. (2001) · American Psychologist · doi:10.1037//0003-066x.56.2.128 · Cited by 1,469
Genetic Mapping in Human Disease
Altshuler, D., Daly, M. J., & Lander, E. S. (2008) · Science · doi:10.1126/science.1156409 · Cited by 1,452 · cited 1×
“, 2018); to identifying etiologic pathways for diseases such as cancer, diabetes, hypertension, inflammatory bowel disease, obesity, and multiple sclerosis (Altshuler et al., 2008; Anderson et al., 2011; Hindorff et al., 2009; Son et al., 2017); to mapping loci that influence adult height (Weedon et al.”
BackgroundSubjective well-being and adaptation to life events: A meta-analysis.
Luhmann, M., Hofmann, W., Eid, M., & Lucas, R. E. (2012) · Journal of Personality and Social Psychology · doi:10.1037/a0025948 · Cited by 1,410
Large-Scale Psychological Differences Within China Explained by Rice Versus Wheat Agriculture
Talhelm, T., Zhang, X., Oishi, S., Shimin, C., Duan, D., Lan, X., & Kitayama, S. (2014) · Science · doi:10.1126/science.1246850 · Cited by 1,374 · cited 2×
“…degrees, by a broad range of proximal (e.g., Hufer et al., 2020; Hutteman et al., 2015; Krapohl et al., 2014; Krauss et al., 2020; Luhmann et al., 2012; Orth, 2018) and distal factors (e.g., Ofosu et al., 2019; Paluck, 2009; Talhelm et al., 2014; Tankard & Paluck, 2017; Uskul et al., 2008).”
Beyond Power Calculations: Assessing Type S (Sign) and Type M (Magnitude) Errors
Gelman, A., & Carlin, J. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614551642 · Cited by 1,343
Anderson, C. A., Boucher, G., Lees, C. W., Franke, A., D'Amato, M., Taylor, K. D., Lee, J. C., Goyette, P., Imielinski, M., Latiano, A., et al. (2011) · Nature Genetics · doi:10.1038/ng.764 · Cited by 1,320
Specht, J., Egloff, B., & Schmukle, S. C. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0024950 · Cited by 1,318
Evaluating replicability of laboratory experiments in economics
Camerer, C. F., Dreber, A., Forsell, E., Ho, T.-H., Huber, J., Johannesson, M., Kirchler, M., Almenberg, J., Altmejd, A., Chan, T., et al. (2016) · Science · doi:10.1126/science.aaf0918 · Cited by 1,314 · cited 1×
“In doing so, the publication culture will contribute to the lack of replicability plaguing the social sciences in general (Camerer et al., 2016, 2018) and psychology in particular (Open Science Collaboration, 2015).”
BackgroundThe genetics of quantitative traits: challenges and prospects
Mackay, T. F. C., Stone, E. A., & Ayroles, J. F. (2009) · Nature Reviews Genetics · doi:10.1038/nrg2612 · Cited by 1,303
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
Interpreting effect sizes of education interventions
Kraft, M. A. (2020) · Educational Researcher · doi:10.3102/0013189x20912798 · Cited by 1,281
Sisk, V. F., Burgoyne, A. P., Sun, J., Butler, J. L., & Macnamara, B. N. (2018) · Psychological Science · doi:10.1177/0956797617739704 · Cited by 1,159
Personality predictors of academic outcomes: Big five correlates of GPA and SAT scores.
Noftle, E. E., & Robins, R. W. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.93.1.116 · Cited by 1,068
A variance explanation paradox: When a little is a lot.
Abelson, R. P. (1985) · Psychological Bulletin · doi:10.1037/0033-2909.97.1.129 · Cited by 1,045
An Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042 · cited 1×
“First, to combat the issue of inflated effect sizes, we reaffirm preregistration (Nosek et al., 2018; Wagenmakers et al., 2012) and registered reports (Chambers, 2019; Hardwicke & Ioannidis, 2018; Nosek & Lakens, 2014) as potent means to gain a more realistic understanding of actual effect sizes…”
BackgroundThe Genetic Basis of Complex Human Behaviors
Plomin, R., Owen, M. J., & McGuffin, P. (1994) · Science · doi:10.1126/science.8209254 · Cited by 1,019
Study, L. C., Okbay, A., Baselmans, B. M. L., De Neve, J.-E., Turley, P., Nivard, M. G., Fontana, M. A., Meddens, S. F. W., Linnér, R. K., Rietveld, C. A., et al. (2016) · Nature Genetics · doi:10.1038/ng.3552 · Cited by 1,013
Nature over nurture: Temperament, personality, and life span development.
McCrae, R. R., Costa, P. T., Ostendorf, F., Angleitner, A., Hřebíčková, M., Avia, M. D., Sanz, J., Sánchez-Bernardos, M. L., Kusdil, M. E., Woodfield, R., et al. (2000) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.78.1.173 · Cited by 1,012
When small effects are impressive
Prentice, D. A., & Miller, D. T. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.1.160 · Cited by 1,008
Empirical Benchmarks for Interpreting Effect Sizes in Research
Hill, C. J., Bloom, H. S., Black, A. R., & Lipsey, M. W. (2008) · Child Development Perspectives · doi:10.1111/j.1750-8606.2008.00061.x · Cited by 950
Many Labs 2: Investigating variation in replicability across samples and settings
Klein, R. A., Vianello, M., Hasselman, F., Adams, B. G., Adams, R. B., Alper, S., Aveyard, M., Axt, J. R., Babalola, M. T., Bahník, Š., et al. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918810225 · Cited by 944
Kosinski, M., Matz, S. C., Gosling, S. D., Popov, V., & Stillwell, D. (2015) · American Psychologist · doi:10.1037/a0039210 · Cited by 925
Self-citationReducing intergroup prejudice and conflict using the media: A field experiment in Rwanda.
Paluck, E. L. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0011989 · Cited by 902
Psychological targeting as an effective approach to digital mass persuasion
Matz, S. C., Kosinski, M., Nave, G., & Stillwell, D. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1710966114 · Cited by 892
Genome-wide association analysis identifies 20 loci that influence adult height
Initiative, D. G., Weedon, M. N., The Wellcome Trust Case Control Consortium, Cambridge GEM Consortium, Lango, H., Lindgren, C. M., Wallace, C., Evans, D. M., Mangino, M., Freathy, R. M., et al. (2008) · Nature Genetics · doi:10.1038/ng.121 · Cited by 826
Schäfer, T., & Schwarz, M. A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00813 · Cited by 774
Correlational effect size benchmarks
Bosco, F. A., Aguinis, H., Singh, K., Field, J. G., & Pierce, C. A. (2015) · Journal of Applied Psychology · doi:10.1037/a0038047 · Cited by 768
Szucs, D., & Ioannidis, J. P. A. (2017) · PLOS Biology · doi:10.1371/journal.pbio.2000797 · Cited by 761 · cited 2×
“…effect sizes (Button et al., 2013; Schäfer & Schwarz, 2019; Szucs & Ioannidis, 2017), effect sizes obtained from well-powered preregistered studies (Funder & Ozer, 2019; Miller, 2019; Schäfer & Schwarz, 2019; Schooler, 2011; Szucs & Ioannidis, 2017) accurately capture highly reliable effects.”
BackgroundWicherts, J. M., Veldkamp, C. L. S., Augusteijn, H. E. M., Bakker, M., van Aert, R. C. M., & van Assen, M. A. L. M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01832 · Cited by 754
Neighborhood Effects on the Long-Term Well-Being of Low-Income Adults
Ludwig, J., Duncan, G. J., Gennetian, L. A., Katz, L. F., Kessler, R. C., Kling, J. R., & Sanbonmatsu, L. (2012) · Science · doi:10.1126/science.1224648 · Cited by 747
Psychology, Science, and Knowledge Construction: Broadening Perspectives from the Replication Crisis
Shrout, P. E., & Rodgers, J. L. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011845 · Cited by 725
Registered Reports: A Method to Increase the Credibility of Published Results
Nosek, B. A., & Lakens, D. (2014) · Social Psychology · doi:10.1027/1864-9335/a000192 · Cited by 716 · cited 1×
“…of inflated effect sizes, we reaffirm preregistration (Nosek et al., 2018; Wagenmakers et al., 2012) and registered reports (Chambers, 2019; Hardwicke & Ioannidis, 2018; Nosek & Lakens, 2014) as potent means to gain a more realistic understanding of actual effect sizes in psychological science.”
BackgroundArbitrary metrics in psychology
Blanton, H., & Jaccard, J. (2006) · American Psychologist · doi:10.1037/0003-066x.61.1.27 · Cited by 681
Life Events and Personality Trait Change.
Bleidorn, W., Hopwood, C. J., & Lucas, R. E. (2018) · Journal of personality · doi:10.1111/jopy.12286 · Cited by 588
Nelson, L. D., Simmons, J., & Simonsohn, U. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011836 · Cited by 548 · cited 1×
“, 2012), such as p-hacking (Nelson et al., 2018), optional stopping (Lakens, 2019), HARKing (Kerr, 1998), and other questionable research practices (Wicherts et al.”
BackgroundThe meanings and measurement of clinical significance.
Kazdin, A. E. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.67.3.332 · Cited by 522
Preliminary Report: Findings from the Aspirin Component of the Ongoing Physicians' Health Study
The Steering Committee of the Physicians' Health Study Research Group (1988) · New England Journal of Medicine · doi:10.1056/nejm198801283180431 · Cited by 520
How are we doing in soft psychology?
Rosenthal, R. (1990) · American Psychologist · doi:10.1037//0003-066x.45.6.775 · Cited by 515
Harari, G. M., Lane, N. D., Wang, R., Crosier, B. S., Campbell, A. T., & Gosling, S. D. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616650285 · Cited by 515
Self-citationStatistically small effects of the Implicit Association Test can have societally large effects.
Greenwald, A. G., Banaji, M. R., & Nosek, B. A. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000016 · Cited by 505
The Effect of a Supreme Court Decision Regarding Gay Marriage on Social Norms and Personal Attitudes
Tankard, M. E., & Paluck, E. L. (2017) · Psychological Science · doi:10.1177/0956797617709594 · Cited by 498
Genetic Influence on Human Psychological Traits: A Survey
Bouchard, T. J. (2004) · Current Directions in Psychological Science · doi:10.1111/j.0963-7214.2004.00295.x · Cited by 486
How Can Evolutionary Psychology Successfully Explain Personality and Individual Differences?
Buss, D. M. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01138.x · Cited by 482
Soto, C. J. (2019) · Psychological Science · doi:10.1177/0956797619831612 · Cited by 470
Effect sizes for experimenting psychologists.
Rosnow, R. L., & Rosenthal, R. (2003) · Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale · doi:10.1037/h0087427 · Cited by 416
Moshontz, H., Campbell, L., Ebersole, C. R., IJzerman, H., Urry, H. L., Forscher, P. S., Grahe, J. E., McCarthy, R. J., Musser, E. D., Antfolk, J., et al. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918797607 · Cited by 377
Mõttus, R., Kandler, C., Bleidorn, W., Riemann, R., & McCrae, R. R. (2017) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000100 · Cited by 367
Meta-assessment of bias in science
Fanelli, D., Costas, R., & Ioannidis, J. P. A. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1618569114 · Cited by 364
Ecocultural basis of cognition: Farmers and fishermen are more holistic than herders
Uskul, A. K., Kitayama, S., & Nisbett, R. E. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0803874105 · Cited by 362
Progress and challenges in genome-wide association studies in humans
Donnelly, P. (2008) · Nature · doi:10.1038/nature07631 · Cited by 361
The Fourth Law of Behavior Genetics
Chabris, C. F., Lee, J. J., Cesarini, D., Benjamin, D. J., & Laibson, D. I. (2015) · Current Directions in Psychological Science · doi:10.1177/0963721415580430 · Cited by 347
Unpublished results hide the decline effect
Schooler, J. (2011) · Nature · doi:10.1038/470437a · Cited by 333
Button, K. S., Kounali, D., Thomas, L., Wiles, N. J., Peters, T. J., Welton, N. J., Ades, A. E., & Lewis, G. (2015) · Psychological Medicine · doi:10.1017/s0033291715001270 · Cited by 332
Krapohl, E., Rimfeld, K., Shakeshaft, N. G., Trzaskowski, M., McMillan, A., Pingault, J.-B., Asbury, K., Harlaar, N., Kovas, Y., Dale, P. S., et al. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1408777111 · Cited by 323
Oishi, S. (2014) · Annual Review of Psychology · doi:10.1146/annurev-psych-030413-152156 · Cited by 317
Jokela, M., Bleidorn, W., Lamb, M. E., Gosling, S. D., & Rentfrow, P. J. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1415800112 · Cited by 300
Self-citationConscientiousness: Origins in childhood?
Eisenberg, N., Duckworth, A. L., Spinrad, T. L., & Valiente, C. (2014) · Developmental Psychology · doi:10.1037/a0030977 · Cited by 269
Genetics and general cognitive ability
Plomin, R. (1999) · Nature · doi:10.1038/35011520 · Cited by 260
Same-sex marriage legalization associated with reduced implicit and explicit antigay bias
Ofosu, E. K., Chambers, M. K., Chen, J. M., & Hehman, E. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806000116 · Cited by 256
Using Machine Learning to Advance Personality Assessment and Theory
Bleidorn, W., & Hopwood, C. J. (2019) · Personality and Social Psychology Review · doi:10.1177/1088868318772990 · Cited by 255
Funder, D. C., Levine, J. M., Mackie, D. M., Morf, C. C., Sansone, C., Vazire, S., & West, S. G. (2014) · Personality and Social Psychology Review · doi:10.1177/1088868313507536 · Cited by 245
The policy relevance of personality traits.
Bleidorn, W., Hill, P. L., Back, M. D., Denissen, J. J. A., Hennecke, M., Hopwood, C. J., Jokela, M., Kandler, C., Lucas, R. E., Luhmann, M., et al. (2019) · American Psychologist · doi:10.1037/amp0000503 · Cited by 245
Multiple determinants and effect size.
Ahadi, S., & Diener, E. (1989) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.56.3.398 · Cited by 244
Using anchor-based methods to determine the smallest effect size of interest
Anvari, F., & Lakens, D. (2021) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2021.104159 · Cited by 231
A Short (Personal) Future History of Revolution 2.0
Spellman, B. A. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615609918 · Cited by 213 · cited 1×
“If we are to progress as a science, we must adjust our expectations and align our incentive structures to reward accurate and meaningful effects rather than exaggerated and unreliable effects (De Boeck & Jeon, 2018; Lindsay, 2020; Munafò et al., 2017; Spellman, 2015).”
BackgroundFamily environment and self-esteem development: A longitudinal study from age 10 to 16.
Krauss, S., Orth, U., & Robins, R. W. (2020) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000263 · Cited by 209
Kitayama, S., Conway, L. G., Pietromonaco, P. R., Park, H., & Plaut, V. C. (2010) · American Psychologist · doi:10.1037/a0020277 · Cited by 206
The influence of the family environment on personality: Accounting for sibling differences.
Hoffman, L. W. (1991) · Psychological Bulletin · doi:10.1037//0033-2909.110.2.187 · Cited by 203
A phenotypic null hypothesis for the genetics of personality.
Turkheimer, E., Pettersson, E., & Horn, E. E. (2014) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143752 · Cited by 194 · cited 1×
“There is ample evidence that personality is affected by a multitude of diverse factors, ranging from proximal influences such as genetics (e.g., Bouchard, 2004; McCrae et al., 2000; Mõttus et al., 2017; Polderman et al., 2015; Turkheimer et al., 2014), childhood experiences (e.”
BackgroundMoney Buys Happiness When Spending Fits Our Personality
Matz, S., Gladstone, J. J., & Stillwell, D. J. (2016) · Psychological Science · doi:10.1177/0956797616635200 · Cited by 186
Nutrition and cognitive achievement: An evaluation of the School Breakfast Program
Frisvold, D. E. (2015) · Journal of Public Economics · doi:10.1016/j.jpubeco.2014.12.003 · Cited by 184
Scientific Utopia III: Crowdsourcing Science
Uhlmann, E. L., Ebersole, C. R., Chartier, C. R., Errington, T. M., Kidwell, M. C., Lai, C. K., McCarthy, R. J., Riegelman, A., Silberzahn, R., & Nosek, B. A. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619850561 · Cited by 174
Revelle, W. (1995) · Annual Review of Psychology · doi:10.1146/annurev.ps.46.020195.001455 · Cited by 168
Orth, U. (2018) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000143 · Cited by 167
Hutteman, R., Nestler, S., Wagner, J., Egloff, B., & Back, M. D. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000015 · Cited by 166
The Value of Preregistration for Psychological Science: A Conceptual AnalysisPreprint
Lakens, D. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/jbh4w · Cited by 165
Nature and nurture of the interplay between personality traits and major life goals.
Bleidorn, W., Kandler, C., Hülsheger, U. R., Riemann, R., Angleitner, A., & Spinath, F. M. (2010) · Journal of Personality and Social Psychology · doi:10.1037/a0019982 · Cited by 163
A practical guide to big data research in psychology.
Chen, E. E., & Wojcik, S. P. (2016) · Psychological Methods · doi:10.1037/met0000111 · Cited by 160
The dark side of going abroad: How broad foreign experiences increase immoral behavior.
Lu, J. G., Quoidbach, J., Gino, F., Chakroff, A., Maddux, W. W., & Galinsky, A. D. (2016) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000068 · Cited by 156
Mapping the universe of registered reports
Hardwicke, T. E., & Ioannidis, J. P. A. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0444-y · Cited by 154
What’s next for Registered Reports?
Chambers, C. (2019) · Nature · doi:10.1038/d41586-019-02674-6 · Cited by 154
Big data in psychology: A framework for research advancement.
Adjerid, I., & Kelley, K. (2018) · American Psychologist · doi:10.1037/amp0000190 · Cited by 148
Götz, F. M., Gvirtz, A., Galinsky, A. D., & Jachimowicz, J. (2020) · American Psychologist · doi:10.1037/amp0000740 · Cited by 141
Self-citationGuiding the Development and Use of Cost-Effectiveness Analysis in Education
Levin, H. M., & Belfield, C. (2014) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2014.915604 · Cited by 135
Regional ambient temperature is associated with human personality
Wei, W., Lu, J. G., Galinsky, A. D., Wu, H., Gosling, S. D., Rentfrow, P. J., Yuan, W., Zhang, Q., Guo, Y., Zhang, M., et al. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0240-0 · Cited by 129
Self-citationObschonka, M., Stuetzer, M., Rentfrow, P. J., Shaw-Taylor, L., Satchell, M., Silbereisen, R. K., Potter, J., & Gosling, S. D. (2018) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000175 · Cited by 127
Self-citationSutin, A. R., Luchetti, M., Stéphan, Y., Robins, R. W., & Terracciano, A. (2017) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000137 · Cited by 116
Can Psychological Traits Be Inferred From Spending? Evidence From Transaction Data
Gladstone, J. J., Matz, S., & Lemaire, A. (2019) · Psychological Science · doi:10.1177/0956797619849435 · Cited by 112
Toward Policy-Relevant Benchmarks for Interpreting Effect Sizes: Combining Effects With Costs
Harris, D. N. (2008) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373708327524 · Cited by 98
Physical topography is associated with human personality
Götz, F. M., Stieger, S., Gosling, S. D., Potter, J., & Rentfrow, P. J. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0930-x · Cited by 98
Self-citationSon, H., Hwangbo, Y., Yoo, S., Im, S.-W., Yang, S., Kwak, S.-J., Park, M. S., Kwak, S. H., Cho, S. W., Ryu, J., et al. (2017) · Nature Communications · doi:10.1038/ncomms15966 · Cited by 92
Latitudinal Psychology: An Ecological Perspective on Creativity, Aggression, Happiness, and Beyond
Van de Vliert, E., & Van Lange, P. A. M. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619858067 · Cited by 80
Matz, S., Gladstone, J. J., & Stillwell, D. J. (2017) · Psychological Science · doi:10.1177/0956797617697445 · Cited by 79
Perceived crisis and reforms: Issues, explanations, and remedies.
de Boeck, P. A. L., & Jeon, M. (2018) · Psychological Bulletin · doi:10.1037/bul0000154 · Cited by 75
Current Perspectives in the Study of Personality Across Cultures
Church, A. T. (2010) · Perspectives on Psychological Science · doi:10.1177/1745691610375559 · Cited by 64
Garretsen, H., Stoker, J. I., Soudis, D., Martin, R., & Rentfrow, P. J. (2018) · Cambridge Journal of Regions Economy and Society · doi:10.1093/cjres/rsx031 · Cited by 60
Self-citationSawaoka, T., & Monin, B. (2018) · Psychological Science · doi:10.1177/0956797618780658 · Cited by 54
A Short-Run Cost-Benefit Analysis of Community-Based Interventions for Juvenile Offenders
Robertson, A. A., Grimes, P. W., & Rogers, K. E. (2001) · Crime & Delinquency · doi:10.1177/0011128701047002006 · Cited by 54
Smith-Woolley, E., Selzam, S., & Plomin, R. (2019) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000241 · Cited by 50
Grand, J. A., Rogelberg, S. G., Banks, G. C., Landis, R. S., & Tonidandel, S. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691618767883 · Cited by 49
Jokela, M. M. (2020) · Journal of Research in Personality · doi:10.1016/j.jrp.2020.103953 · Cited by 45
When Do Growth Mindset Interventions Work?
Miller, D. I. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.08.005 · Cited by 42
Fischer, R., Lee, A., & Verzijden, M. N. (2018) · Scientific Reports · doi:10.1038/s41598-017-18784-y · Cited by 40
Hufer, A., Kornadt, A. E., Kandler, C., & Riemann, R. (2019) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000258 · Cited by 40
The social-safety system: Fortifying relationships in the face of the unforeseeable.
Murray, S. L., Lamarche, V. M., Seery, M. D., Jung, H. Y., Griffin, D. W., & Brinkman, C. S. (2020) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000245 · Cited by 35
StudySwap: A Platform for Interlab Replication, Collaboration, and Resource Exchange
Chartier, C. R., Riegelman, A., & McCarthy, R. J. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918808767 · Cited by 28
Penny Wise and Effect Size Foolish
Duncan, G. J., & Magnuson, K. (2007) · Child Development Perspectives · doi:10.1111/j.1750-8606.2007.00009.x · Cited by 26
Seven steps toward transparency and replicability in psychological science.
Lindsay, D. S. (2020) · Canadian Psychology/Psychologie canadienne · doi:10.1037/cap0000222 · Cited by 26
Götz, F. M., Yoshino, S., & Oshio, A. (2020) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2020.101438 · Cited by 20
Self-citationWho Are the Scrooges? Personality Predictors of Holiday Spending
Weston, S. J., Gladstone, J., Graham, E., Mroczek, D., & Condon, D. (2018) · Social Psychology and Personality Science · doi:10.1177/1948550618792883 · Cited by 14
Furnham, A. F., & Cheng, H. (2018) · Personality and Individual Differences · doi:10.1016/j.paid.2018.07.026 · Cited by 8
Research works printed but not linked: 7
- 10.1037/0022-3514.56.3.398 · doi:10.1037/0022-3514.56.3.398 · Paper page
- 10.31234/osf.io/syp5a · DOI
- 10.1037/0033-2909.110.2.187 · doi:10.1037/0033-2909.110.2.187 · Paper page
- 10.1037/0022-006X.67.3.332 · DOI · Paper page
- 10.1037/0003-066X.56.2.128 · doi:10.1037/0003-066x.56.2.128 · Paper page
- 10.1037/0003-066X.45.6.775 · DOI · Paper page
- 10.1037/0022-3514.78.1.122 · DOI · Paper page
Cited by
Loneliness across time and space
Luhmann, M., Buecker, S., & Rüsberg, M. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00124-1 · Cited by 197
Twenge, J. M., Haidt, J., Lozano, J., & Cummins, K. M. (2022) · Acta Psychologica · doi:10.1016/j.actpsy.2022.103512 · Cited by 191
Personality and intelligence: A meta-analysis.
Anglim, J., Dunlop, P. D., Wee, S., Horwood, S., Wood, J. K., & Marty, A. (2022) · Psychological Bulletin · doi:10.1037/bul0000373 · Cited by 125
“In particular, although many of the facet-level correlations between personality and intelligence are small, the combined effect of these smaller relationships can represent something larger (Götz et al., 2022).”
Backgroundvan IJzendoorn, M. H., Schuengel, C., Wang, Q., & Bakermans-Kranenburg, M. J. (2023) · Development and Psychopathology · doi:10.1017/s0954579421001462 · Cited by 116
“, 2021), but even these benchmarksmay put the bar higher than necessary because they are mostly based on correlational studies instead of intervention experiments with immediate translational potential (Götz et al., 2021; Kraft, 2020).”
InfluentialSauce, B., Liebherr, M., Judd, N., & Klingberg, T. (2022) · Scientific Reports · doi:10.1038/s41598-022-11341-2 · Cited by 74
Metadata
- Authors
- Götz, F. M., Gosling, S. D., & Rentfrow, P. J.
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2021-07-02
- Volume
- 17
- Issue
- 1
- Pages
- 205-215
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W3160129852
- Cited by
- 538
- References
- 139
- FWCI
- 47.19
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.