How Diverse Are the Samples Used in the Journals ‘Evolution & Human Behavior’ and ‘Evolutionary Psychology’?
Open accessAbstract
Psychologists regularly draw inferences about populations based on data from small samples of people, and so have long been interested in how well those samples generalise to wider populations. There is a consensus that psychology probably relies too much on samples from Western, Educated, Industrialised, Rich and Democratic (WEIRD) societies and among those from university students. Online surveys might be used to increase sample diversity, although online sampling still reaches only a restricted range of participants. Studies from evolutionary psychology often seek to uncover aspects of evolved universal characteristics, and so might demonstrate a particular interest in the use of diverse samples. Here, we empirically examine the samples used in the 2015–2016 volumes of ‘Evolution & Human Behavior’ (104 articles) and ‘Evolutionary Psychology’ (76 articles). Our database consists of 311 samples of humans (median sample size = 186). The majority of samples were either online or student samples (70% of samples), followed by other adult Western samples (19%). Two hundred fifty-three (81%) of the samples were classified as ‘Western’ (Europe/North America/Australia). The remaining samples were predominantly from Asia (N = 37; 12%, mostly Japan). Only a small fraction of the samples were taken from Latin American and Caribbean (N = 8) or African (N = 6) countries. The median sample size did not differ significantly between continents, but online samples (both paid and unpaid) were typically larger than samples sourced offline. It seems that the samples used are more diverse than those that have been reported in reviews of the literature from social and developmental psychology, perhaps because evolutionary psychology has a greater inherent need to test hypotheses about an evolved and universal human nature. However, it is also apparent that the majority of samples within contemporary evolutionary psychology research remain WEIRD.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The majority of current research on reciprocal relations between motivation and academic achievement has suffered from a sampling bias problem, conducted using homogenous samples in ethnicity and cultural background.
“the majority of current research on the reciprocal relations between motivation and academic achievement has suffered from what can be considered a sampling bias problem (Pollet & Saxton, 2019), i.e., conducted using homogenous samples in terms of ethnicity (Marsh & Martin, 2011) and cultural background (Henrich et al., 2010).”
From Motivation-Achievement Cycles in Learning: a Literature Review and Research Agenda (2022) · cites this paper as Pollet & Saxton, 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,706 · see citing works
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · see citing works
Nonparametric Statistics for the Behavioral Sciences
Guitton, H., & Siegel, S. (1958) · Revue économique · doi:10.2307/3498751 · Cited by 35,281 · see citing works
Studies of interference in serial verbal reactions
Stroop, J. R. (1935) · Journal of Experimental Psychology · doi:10.1037/h0054651 · Cited by 18,622 · see citing works
ggplot2: Elegant Graphics for Data Analysis
Wickham, H. (2009) · doi:10.1007/978-0-387-98141-3 · Cited by 14,447 · see citing works
The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641 · see citing works
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653 · see citing works
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996 · see citing works
Sex differences in human mate preferences: Evolutionary hypotheses tested in 37 cultures
Buss, D. M. (1989) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00023992 · Cited by 4,484 · see citing works
WEIRD languages have misled us, too
Majid, A., & Levinson, S. C. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1000018x · Cited by 4,169 · see citing works
Nonparametric Statistics : for the Behavioral Sciences
Siegel, S. (1956) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 3,314 · see citing works
Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P. (2004) · American Psychologist · doi:10.1037/0003-066x.59.2.93 · Cited by 2,932 · see citing works
What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?
Levitt, S. D., & List, J. A. (2007) · Journal of Economic Perspectives · doi:10.1257/jep.21.2.153 · Cited by 2,668 · see citing works
Causal inference in statistics: An overview
Pearl, J. (2009) · Statistics Surveys · doi:10.1214/09-ss057 · Cited by 2,336 · cited 1× · see citing works
“More broadly, the field would benefit from setting out the conditions under which causal inferences can be made (Pearl 2009a, b).”
BackgroundSears, D. O. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.3.515 · Cited by 2,138 · see citing works
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Paolacci, G., & Chandler, J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414531598 · Cited by 2,136 · see citing works
“Economic man” in cross-cultural perspective: behavioral experiments in 15 small-scale societies
Henrich, J., Boyd, R., Bowles, S., Camerer, C., Fehr, E., Gintis, H., McElreath, R., Alvard, M., Barr, A., Ensminger, J., et al. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000142 · Cited by 1,898 · see citing works
The neglected 95%: why American psychology needs to become less American.
Arnett, J. (2008) · American Psychologist · doi:10.1037/0003-066x.63.7.602 · Cited by 1,656 · see citing works
Evaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617 · see citing works
The evolution of desire: strategies of human mating
(1994) · Choice Reviews Online · doi:10.5860/choice.32-1010 · Cited by 1,545 · see citing works
Evaluating replicability of laboratory experiments in economics
Camerer, C. F., Dreber, A., Forsell, E., Ho, T.-H., Huber, J., Johannesson, M., Kirchler, M., Almenberg, J., Altmejd, A., Chan, T., et al. (2016) · Science · doi:10.1126/science.aaf0918 · Cited by 1,314 · see citing works
Sex Differences in Jealousy: Evolution, Physiology, and Psychology
Buss, D. M., Larsen, R. J., Westen, D., & Semmelroth, J. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00038.x · Cited by 1,263 · see citing works
Peterson, R. A. (2001) · Journal of Consumer Research · doi:10.1086/323732 · Cited by 1,258 · see citing works
In defense of external invalidity.
Mook, D. G. (1983) · American Psychologist · doi:10.1037/0003-066x.38.4.379 · Cited by 1,221 · see citing works
Evolutionary Psychology: A New Paradigm for Psychological Science
Buss, D. M. (1995) · Psychological Inquiry · doi:10.1207/s15327965pli0601_1 · Cited by 1,198 · see citing works
Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable
Elwert, F., & Winship, C. (2014) · Annual Review of Sociology · doi:10.1146/annurev-soc-071913-043455 · Cited by 1,168 · cited 1× · see citing works
“From a statistical point of view, restricted sampling can lead to selection bias which in turn can lead to confounding (Bareinboim and Pearl 2012; Elwert and Winship 2014; Fiedler 2000; Rohrer 2018).”
BackgroundMeasurement in Cross-Cultural Psychology
Hui, C.-C. H., & Triandis, H. C. (1985) · Journal of Cross-Cultural Psychology · doi:10.1177/0022002185016002001 · Cited by 1,092 · see citing works
Heine, S. J., Lehman, D. R., Peng, K., & Greenholtz, J. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.82.6.903 · Cited by 1,080 · see citing works
The persistent sampling bias in developmental psychology: A call to action
Nielsen, M., Haun, D. B. M., Kärtner, J., & Legare, C. H. (2017) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2017.04.017 · Cited by 1,023 · see citing works
Tooby, J., & Cosmides, L. (1990) · Journal of Personality · doi:10.1111/j.1467-6494.1990.tb00907.x · Cited by 1,005 · see citing works
Thinking Clearly About Correlations and Causation: Graphical Causal Models for Observational Data
Rohrer, J. M. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245917745629 · Cited by 1,002 · cited 1× · see citing works
“From a statistical point of view, restricted sampling can lead to selection bias which in turn can lead to confounding (Bareinboim and Pearl 2012; Elwert and Winship 2014; Fiedler 2000; Rohrer 2018).”
BackgroundConstraints on Generality (COG): A Proposed Addition to All Empirical Papers
Simons, D. J., Shoda, Y., & Lindsay, D. S. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617708630 · Cited by 986 · see citing works
Schmitt, D. P. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000051 · Cited by 974 · see citing works
Green, L. W., & Glasgow, R. E. (2006) · Evaluation & the Health Professions · doi:10.1177/0163278705284445 · Cited by 922 · see citing works
Human Research and Data Collection via the Internet
Birnbaum, M. H. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.141601 · Cited by 864 · see citing works
Age preferences in mates reflect sex differences in human reproductive strategies
Kenrick, D. T., & Keefe, R. C. (1992) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00067595 · Cited by 839 · see citing works
Social desirability, anonymity, and internet-based questionnaires
Joinson, A. (1999) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200723 · Cited by 818 · see citing works
From vigilance to violence: Mate retention tactics in married couples.
Buss, D. M., & Shackelford, T. K. (1997) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.72.2.346 · Cited by 773 · see citing works
The Evolution of Desire: Strategies of Human Mating
Symons, D. K., & Buss, D. M. (1994) · Journal of Marriage and the Family · doi:10.2307/353621 · Cited by 768 · see citing works
Electronic Survey Methodology: A Case Study in Reaching Hard-to-Involve Internet Users
Andrews, D. C., Nonnecke, B., & Preece, J. (2003) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc1602_04 · Cited by 741 · see citing works
Are samples drawn from Mechanical Turk valid for research on political ideology?
Clifford, S., Jewell, R., & Waggoner, P. (2015) · Research & Politics · doi:10.1177/2053168015622072 · Cited by 680 · see citing works
Schaller, M., & Murray, D. R. (2008) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.95.1.212 · Cited by 647 · see citing works
Causal inference and the data-fusion problem
Bareinboim, E., & Pearl, J. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510507113 · Cited by 621 · see citing works
Graham, S. (1992) · American Psychologist · doi:10.1037/0003-066x.47.5.629 · Cited by 595 · see citing works
Methods and data analysis of comparative research
van de Vijver, F. J. R., & Leung, K. (1997) · Tilburg University Research Portal · Cited by 559 · see citing works
Science, ethnicity, and bias: Where have we gone wrong?
Sue, S. (1999) · American Psychologist · doi:10.1037/0003-066x.54.12.1070 · Cited by 552 · see citing works
Seriousness checks are useful to improve data validity in online research
Aust, F., Diedenhofen, B., Ullrich, S., & Musch, J. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0265-2 · Cited by 528 · see citing works
Adaptive individual differences within single populations
Wilson, D. S. (1998) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.1998.0202 · Cited by 522 · see citing works
The log transformation is special
Keene, O. N. (1995) · Statistics in Medicine · doi:10.1002/sim.4780140810 · Cited by 516 · see citing works
Zwaan, R. A., Etz, A. J., Lucas, R. E., & Donnellan, M. B. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x17001972 · Cited by 474 · see citing works
Lakens, D., Adolfi, F., Albers, C. J., Anvari, F., Apps, M. A. J., Argamon, S., Baguley, T. S., Becker, R. B., Benning, S. D., Bradford, D. E., et al. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0311-x · Cited by 472 · see citing works
Many Labs 3: Evaluating participant pool quality across the academic semester via replication
Ebersole, C. R., Atherton, O. E., Belanger, A. L., Skulborstad, H. M., Allen, J. M., Banks, J. B., Baranski, E., Bernstein, M. J., Bonfiglio, D. B. V., Boucher, L., et al. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.10.012 · Cited by 468 · see citing works
Beware of samples! A cognitive-ecological sampling approach to judgment biases.
Fiedler, K. (2000) · Psychological Review · doi:10.1037/0033-295x.107.4.659 · Cited by 460 · see citing works
Universal dimensions of human mate preferences
Shackelford, T. K., Schmitt, D. P., & Buss, D. M. (2005) · Personality and Individual Differences · doi:10.1016/j.paid.2005.01.023 · Cited by 432 · see citing works
Validity of Web-Based Psychological Research
Krantz, J. H., & Dalal, R. S. (2000) · Elsevier eBooks · doi:10.1016/b978-012099980-4/50003-4 · Cited by 425 · see citing works
Do women’s mate preferences change across the ovulatory cycle? A meta-analytic review.
Gildersleeve, K. A., Haselton, M. G., & Fales, M. R. (2014) · Psychological Bulletin · doi:10.1037/a0035438 · Cited by 370 · see citing works
mir: Management International Review
(2003) · Gabler Verlag eBooks · doi:10.1007/978-3-663-01562-8 · Cited by 341 · see citing works
EQUIVALENCE OF CROSS‐CULTURAL DATA: AN OVERVIEW OF BASIC ISSUES
Poortinga, Y. H. (1989) · International Journal of Psychology · doi:10.1080/00207598908247842 · Cited by 339 · see citing works
The Comparative Method in Anthropology [and Comments and Reply]
Mace, R. H., Pagel, M. D., Bowen, J. R., Otterbein, K. F., Ridley, M., Schweizer, T., & Voland, E. (1994) · Current Anthropology · doi:10.1086/204317 · Cited by 313 · see citing works
An open investigation of the reproducibility of cancer biology research
Errington, T. M., Iorns, E., Gunn, W., Tan, F. E., Lomax, J., & Nosek, B. A. (2014) · eLife · doi:10.7554/elife.04333 · Cited by 312 · see citing works
The Importance of External Validity
Steckler, A., & McLeroy, K. R. (2007) · American Journal of Public Health · doi:10.2105/ajph.2007.126847 · Cited by 295 · see citing works
From the Editors: Student samples in international business research
Bello, D. C., Leung, K. Y., Radebaugh, L. H., Tung, R. L., & van Witteloostuijn, A. C. (2009) · Journal of International Business Studies · doi:10.1057/jibs.2008.101 · Cited by 277 · see citing works
Henry, P. J. (2008) · Psychological Inquiry · doi:10.1080/10478400802049936 · Cited by 272 · see citing works
The human subject in psychological research
Schultz, D. P. (1968) · PsycEXTRA Dataset · doi:10.1037/e515702009-001 · Cited by 212 · see citing works
Human preferences for sexually dimorphic faces may be evolutionarily novel
Scott, I. M. L., Clark, A. P., Josephson, S. C., Boyette, A. H., Cuthill, I. C., Fried, R. L., Gibson, M. A., Hewlett, B. S., Jamieson, M., Jankowiak, W., et al. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1409643111 · Cited by 203 · see citing works
Rosenthal, R. (1965) · Human Relations · doi:10.1177/001872676501800407 · Cited by 201 · see citing works
The human subject in psychological research.
Schultz, D. P. (1969) · Psychological Bulletin · doi:10.1037/h0027880 · Cited by 195 · see citing works
Acknowledging the Whiteness of Motivation Research: Seeking Cultural Relevance
Usher, E. L. (2018) · Educational Psychologist · doi:10.1080/00461520.2018.1442220 · Cited by 195 · see citing works
Krantz, J. H., Ballard, J., & Scher, J. (1997) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204824 · Cited by 180 · see citing works
Wintre, M. G., North, C., & Sugar, L. A. (2001) · Canadian Psychology/Psychologie canadienne · doi:10.1037/h0086893 · Cited by 164 · see citing works
Human prosociality from an evolutionary perspective: variation and correlations at a city-wide scale
Wilson, D. S., O'Brien, D. T., & Sesma, A. (2009) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2008.12.002 · Cited by 162 · cited 1× · see citing works
“Indeed, we do not always need to go far to find diverse samples (e.g. Hill et al. 2014; Nettle 2017; Wilson 2011; Wilson et al. 2009).”
BackgroundWhat Can Cross-Cultural Correlations Teach Us about Human Nature?
Pollet, T. V., Tybur, J. M., Frankenhuis, W. E., & Rickard, I. J. (2014) · Human Nature · doi:10.1007/s12110-014-9206-3 · Cited by 158 · see citing works
Self-citationGalton's Problem in Cross-National Research
Ross, M. H., & Homer, E. (1976) · World Politics · doi:10.2307/2010045 · Cited by 151 · see citing works
Insuring sample equivalence across internet and paper-and-pencil assessments
Epstein, J., Klinkenberg, W. D., Wiley, D. C., & McKinley, L. (2001) · Computers in Human Behavior · doi:10.1016/s0747-5632(01)00002-4 · Cited by 150 · see citing works
Kenrick, D. T., Keefe, R. C., Bryan, A. D., Barr, A., & Brown, S. L. (1995) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.69.6.1166 · Cited by 147 · see citing works
Medin, D., Ojalehto, B., Marin, A., & Bang, M. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0088 · Cited by 146 · see citing works
Variation in Cooperative Behaviour within a Single City
Nettle, D., Colléony, A., & Cockerill, M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026922 · Cited by 139 · see citing works
Bergman, M., & Jean, V. A. (2015) · Industrial and Organizational Psychology · doi:10.1017/iop.2015.70 · Cited by 138 · see citing works
Subject selection bias in psychological research.
Smart, R. G. (1966) · The Canadian Psychologist · doi:10.1037/h0083096 · Cited by 125 · see citing works
Conceptualizing and evaluating replication across domains of behavioral research
Tackett, J. L., & McShane, B. B. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000882 · Cited by 125 · see citing works
Wired but not WEIRD: The promise of the Internet in reaching more diverse samples
Gosling, S. D., Sandy, C. J., John, O. P., & Potter, J. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10000300 · Cited by 119 · see citing works
Burchett, H., Umoquit, M. J., & Dobrow, M. (2011) · Journal of Health Services Research & Policy · doi:10.1258/jhsrp.2011.010124 · Cited by 110 · see citing works
Assortative mating for human height: A meta‐analysis
Stulp, G., Simons, M. J. P., Grasman, S., & Pollet, T. V. (2017) · American Journal of Human Biology · doi:10.1002/ajhb.22917 · Cited by 96 · see citing works
Self-citationEcological influences on human behavioural diversity: a review of recent findings
Nettle, D. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2009.05.013 · Cited by 95 · see citing works
Dynamic Documents with R and knitr, Second Edition
Xie, Y. (2015) · Chapman & Hall/CRC eBooks · doi:10.1201/9781315382487 · Cited by 95 · see citing works
Nettle, D. (2015) · Open Book Publishers · doi:10.11647/obp.0084 · Cited by 94 · see citing works
Advanced methods for conducting online behavioral research.
(2010) · American Psychological Association eBooks · doi:10.1037/12076-000 · Cited by 92 · see citing works
Controlling Selection Bias in Causal Inference
Bareinboim, E., & Pearl, J. (2011) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v25i1.8056 · Cited by 92 · see citing works
Achieving a global psychology.
Berry, J. W. (2013) · Canadian Psychology/Psychologie canadienne · doi:10.1037/a0031246 · Cited by 83 · see citing works
The neighborhood project: using evolution to improve my city, one block at a time
(2012) · Choice Reviews Online · doi:10.5860/choice.49-3936 · Cited by 78 · see citing works
Behavioral immune system methods: Surveying the present to shape the future.
Tybur, J. M., Frankenhuis, W. E., & Pollet, T. V. (2014) · Evolutionary Behavioral Sciences · doi:10.1037/ebs0000017 · Cited by 77 · see citing works
Self-citationHuman Universals and their Implications
Brown, D. E. (2000) · De Gruyter eBooks · doi:10.1515/9783110822809.156 · Cited by 73 · see citing works
Television exposure predicts body size ideals in rural Nicaragua
Boothroyd, L. G., Jucker, J., Thornborrow, T., Jamieson, M., Burt, D. M., Barton, R. A., Evans, E. H., & Tovée, M. J. (2016) · British Journal of Psychology · doi:10.1111/bjop.12184 · Cited by 71 · see citing works
Matzat, U., & Snijders, C. C. P. (2009) · Social Networks · doi:10.1016/j.socnet.2009.08.002 · Cited by 67 · see citing works
The Effect of $1, $5 and $10 Stakes in an Online Dictator Game
Raihani, N., Mace, R. H., & Lamba, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073131 · Cited by 66 · see citing works
Cross-cultural evolutionary psychology
Apicella, C. L., & Barrett, H. C. (2015) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2015.08.015 · Cited by 64 · see citing works
How international is psychology?
Adair, J. G., Coêlho, A. E. L., & Luna, J. R. (2002) · International Journal of Psychology · doi:10.1080/00207590143000351 · Cited by 59 · see citing works
Batres, C., & Perrett, D. I. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100966 · Cited by 58 · see citing works
Internationalism in psychology: We need it now more than ever.
Cole, M. (2006) · American Psychologist · doi:10.1037/0003-066x.61.8.904 · Cited by 45 · see citing works
Greenwood, J. D. (1982) · Journal for the Theory of Social Behaviour · doi:10.1111/j.1468-5914.1982.tb00449.x · Cited by 39 · see citing works
Social capital across urban neighborhoods: A comparison of self-report and observational data.
Hill, J. M., Jobling, R., Pollet, T. V., & Nettle, D. (2014) · Evolutionary Behavioral Sciences · doi:10.1037/h0099131 · Cited by 38 · see citing works
Self-citationBuss, D. M. (2000) · Evolution and Human Behavior · doi:10.1016/s1090-5138(00)00048-9 · Cited by 37 · see citing works
Ceci, S. J., Kahan, D. M., & Braman, D. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10000063 · Cited by 35 · see citing works
International Representation in the Psychological Literature
Bauserman, R. L. (1997) · International Journal of Psychology · doi:10.1080/002075997400908 · Cited by 26 · see citing works
The neighborhood project using evolution to improve my city, one block at a time
Wilson, D. S. 1. (2011) · Cited by 25 · see citing works
Rochat, P. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10000233 · Cited by 17 · see citing works
Psychologists grow increasingly dependent on online research subjects
(2017) · AAAS Articles DO Group · doi:10.1126/science.aag0592 · Cited by 8 · see citing works
Konečni, V. J. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10000142 · Cited by 7 · see citing works
Flagged first, then by citations
4 of the 112 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- Brown, D. E. (1991). Human universals. New York, NY: McGraw-Hill.
- Naroll, R. (1965). Galton's problem: the logic of cross-cultural analysis. Social Research, 32(4), 428-451.
- Pearl, J. (2009a). Causality. Cambridge: Cambridge University Press.
- Xie, Y. (2015). Dynamic documents with R and knitr (2nd ed.). Boca Raton, FL: CRC Press.
Cited by
Sorted by citations
Beyond WEIRD: A review of the last decade and a look ahead to the global laboratory of the future
Apicella, C. L., Ara Norenzayan, A., & Henrich, J. (2020) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2020.07.015 · Cited by 282 · see citing works
Motivation-Achievement Cycles in Learning: a Literature Review and Research Agenda
Vu, T., Magis-Weinberg, L., Jansen, B. R. J., van Atteveldt, N., Janssen, T. W. P., Lee, N. C., van der Maas, H. L. J., Raijmakers, M. E. J., Sachisthal, M. S. M., & Meeter, M. (2022) · Educational Psychology Review · doi:10.1007/s10648-021-09616-7 · Cited by 224 · see citing works
How diverse are the samples used to study intimate relationships? A systematic review
Williamson, H. C., Bornstein, J. X., Cantu, V., Ciftci, O., Farnish, K. A., & Schouweiler, M. T. (2021) · Journal of Social and Personal Relationships · doi:10.1177/02654075211053849 · Cited by 143 · see citing works
Credibility Beyond Replicability: Improving the Four Validities in Psychological Science
Vazire, S., Schiavone, S. R., & Bottesini, J. G. (2022) · Current Directions in Psychological Science · doi:10.1177/09637214211067779 · Cited by 102 · see citing works
Cultural evolution of genetic heritability
Uchiyama, R., Spicer, R., & Muthukrishna, M. (2021) · Behavioral and Brain Sciences · doi:10.1017/s0140525x21000893 · Cited by 97 · see citing works
Scholtz, S. E. (2021) · SA Journal of Industrial Psychology · doi:10.4102/sajip.v47i0.1837 · Cited by 88 · see citing works
Deciding what to observe: Thoughts for a post-WEIRD generation
Barrett, H. C. (2020) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2020.05.006 · Cited by 88 · see citing works
Evolutionary Mismatch in Mating
Goetz, C. D., Pillsworth, E. G., Buss, D. M., & Conroy‐Beam, D. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02709 · Cited by 84 · see citing works
Sample representation in the social sciences
Zhao, K. (2020) · Synthese · doi:10.1007/s11229-020-02621-3 · Cited by 70 · see citing works
Dealing With Scam in Online Qualitative Research: Strategies and Ethical Considerations
Sansfaçon, A. P., Gravel, É., & Gelly, M. A. (2024) · International Journal of Qualitative Methods · doi:10.1177/16094069231224610 · Cited by 56 · see citing works
A PRISMA review of research on music practice
How, E. R., Tan, L., & Miksza, P. J. (2021) · Musicae Scientiae · doi:10.1177/10298649211005531 · Cited by 40 · see citing works
Guidelines to improve internationalization in the psychological sciences
Puthillam, A., Doble, L. J. M., Santos, J. J. I. D., Elsherif, M. M., Steltenpohl, C. N., Moreau, D., Pownall, M., Silverstein, P., Anand-Vembar, S., & Kapoor, H. (2023) · Social and Personality Psychology Compass · doi:10.1111/spc3.12847 · Cited by 37 · see citing works
Defining bilingualism in infancy and toddlerhood: A scoping review
Rocha‐Hidalgo, J., & Barr, R. (2022) · International Journal of Bilingualism · doi:10.1177/13670069211069067 · Cited by 35 · see citing works
Eerola, T., Armitage, J. O., Lavan, N., & Knight, S. (2021) · Auditory Perception & Cognition · doi:10.1080/25742442.2021.2007718 · Cited by 34 · see citing works
Validation of a Short and Generic Qualitative Job Insecurity Scale (QUAL-JIS)
Fischmann, G., Witte, H. D., Șulea, C., Elst, T. V., Cuyper, N. D., & Iliescu, D. (2021) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000674 · Cited by 33 · see citing works
Kowal, M. (2024) · Anthropological Review · doi:10.18778/1898-6773.87.3.02 · Cited by 30 · see citing works
Waymer, D., Brown, K. A., & Jackson, J. R. (2023) · Journal of Public Relations Research · doi:10.1080/1062726x.2023.2195185 · Cited by 29 · see citing works
What limitations are reported in short articles in social and personality psychology?
Clarke, B., Schiavone, S. R., & Vazire, S. (2023) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000458 · Cited by 27 · see citing works
Socioeconomic status and students' science self‐efficacy
Tan, C.-Y., Gao, L., Hong, X., & Song, Q.-J. (2023) · British Educational Research Journal · doi:10.1002/berj.3869 · Cited by 23 · see citing works
Addressing the sins of consumer psychology via the evolutionary lens
Saad, G. (2021) · Psychology and Marketing · doi:10.1002/mar.21446 · Cited by 27 · see citing works
Sarial‐Abi, G., & Ulqinaku, A. (2020) · Journal of Advertising · doi:10.1080/00913367.2020.1768970 · Cited by 24 · see citing works
Otterbring, T., & Folwarczny, M. (2024) · Food Quality and Preference · doi:10.1016/j.foodqual.2024.105175 · Cited by 24 · see citing works
Singh, L., & Rajendra, S. J. (2024) · Developmental Science · doi:10.1111/desc.13521 · Cited by 23 · see citing works
Understanding Consumer Enchantment via Paranormal Tourism: Part II—Preliminary Rasch Validation
Houran, J., Lange, R., & Laythe, B. R. (2020) · Cornell Hospitality Quarterly · doi:10.1177/1938965520971276 · Cited by 18 · see citing works
Men say “I love you” before women do: Robust across several countries
Watkins, C. D., Bovet, J., Fernández, A. M., Leongómez, J. D., Żelaźniewicz, A., Varella, M. A. C., & Wagstaff, D. (2022) · Journal of Social and Personal Relationships · doi:10.1177/02654075221075264 · Cited by 19 · see citing works
Pollet, T. V., & Saxton, T. K. (2020) · Personality and Social Psychology Bulletin · doi:10.1177/0146167220904512 · Cited by 18 · see citing works
Self-citationBrown, R. M., Roberts, S. G. B., & Pollet, T. V. (2021) · Cyberpsychology Journal of Psychosocial Research on Cyberspace · doi:10.5817/cp2021-2-6 · Cited by 17 · see citing works
Self-citationChemnad, K., Aziz, M., Al-Harahsheh, S. T., Abdelmoneium, A., Baghdady, A., & Ali, R. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2396434 · Cited by 18 · see citing works
AI Surrogates and illusions of generalizability in cognitive science
Crockett, M. J., & Messeri, L. R. (2025) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2025.09.012 · Cited by 15 · see citing works
User Behavior on Online Social Networks: Relationships among Social Activities and Satisfaction
Mican, D., Sitar‐Tăut, D., & Mihuţ, I.-S. (2020) · Symmetry · doi:10.3390/sym12101656 · Cited by 15 · see citing works
Toward a dialogical sociology: Presidential address – XX ISA World Congress of Sociology 2023
Ḥanafī, S. (2023) · International Sociology · doi:10.1177/02685809231199678 · Cited by 14 · see citing works
Takayanagi, J. F. G. B., Siqueira, J. D. O., Silveira, P. S. P., & Valentová, J. V. (2024) · Archives of Sexual Behavior · doi:10.1007/s10508-023-02767-4 · Cited by 13 · see citing works
Galvagno, L. G. G., Miller, S. E., Grandis, C. D., Elgier, Á. M., Mustaca, A. E., & Azzollini, S. (2022) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2021.105357 · Cited by 10 · see citing works
Adult Attachment and Long-term Mate Preferences in Iran
Afhami, R., & Rafiee, P. (2019) · Evolutionary Psychological Science · doi:10.1007/s40806-019-00221-0 · Cited by 9 · see citing works
Martins, L. B., Marengo, L. A. S., Casalecchi, J. G. S., Figueiredo, M. J., & Júnior, M. D. S. (2023) · Trends in Psychology · doi:10.1007/s43076-023-00325-4 · Cited by 8 · see citing works
Garza, R., & Pazhoohi, F. (2023) · Sexes · doi:10.3390/sexes4010008 · Cited by 8 · see citing works
Ma, M. Z., & Ye, S. S. (2022) · Social Psychological and Personality Science · doi:10.1177/19485506221106012 · Cited by 8 · see citing works
Why women cheat: testing evolutionary hypotheses for female infidelity in a multinational sample
Murphy, M., Phillips, C. A., & Blake, K. R. (2024) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2024.106595 · Cited by 7 · see citing works
Measurement Issues in Tests of the Socioecological Complexity Hypothesis
Lasker, J., Haltigan, J. D., & Richardson, G. B. (2021) · Evolutionary Psychological Science · doi:10.1007/s40806-021-00301-0 · Cited by 7 · see citing works
Kowal, M., Sorokowski, P., Gjoneska, B., Pisanski, K., Pfuhl, G., Durán, L. A. A., Janssen, S. M. J., Gelbart, B., Arriaga, P., Antfolk, J., et al. (2025) · Scientific Data · doi:10.1038/s41597-025-05365-2 · Cited by 7 · see citing works
Scelza, B. A. (2024) · Evolutionary Anthropology Issues News and Reviews · doi:10.1002/evan.22023 · Cited by 6 · see citing works
A meta-analysis of the reliability of the Sexual Self-Esteem Inventory in Women (SSEI-W) measure
Lloyd, A., Brown, G., & Pollet, T. V. (2021) · Psychology and Sexuality · doi:10.1080/19419899.2021.1984982 · Cited by 6 · see citing works
Self-citationSample characteristics for quantitative analyses in Body Image: Issues of generalisability.
Pollet, T. V., Bovet, J., Buhaenko, R., Cornelissen, P., & Tovée, M. (2024) · Body image · doi:10.1016/j.bodyim.2024.101714 · Cited by 5 · see citing works
Self-citationPorfírio, J. C. C., & Varella, M. A. C. (2022) · Current Psychology · doi:10.1007/s12144-022-04111-w · Cited by 5 · see citing works
Iha, R. (2023) · Evolutionary Psychological Science · doi:10.1007/s40806-023-00381-0 · Cited by 5 · see citing works
Walker, R. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-020-00232-2 · Cited by 5 · see citing works
Too WEIRD, Too Fast? Preprints About COVID-19 in the Psychological Sciences
Puthillam, A. (2023) · Collabra Psychology · doi:10.1525/collabra.74331 · Cited by 5 · see citing works
Tilley, B. P. (2021) · The Social Science Journal · doi:10.1080/03623319.2021.1949546 · Cited by 4 · see citing works
Testing the validity of online psychophysical measurement of body image perception
Gumančík, J., Cornelissen, P. L., Brokjøb, L. G., Ridley, B. J., McCarty, K., Tovée, M. J., & Cornelissen, K. K. (2024) · PLoS ONE · doi:10.1371/journal.pone.0302747 · Cited by 4 · see citing works
No evidence that middleborns feel less close to family and closer to friends than other birth orders
Simanko, V., Rimmer, B., & Pollet, T. V. (2020) · Heliyon · doi:10.1016/j.heliyon.2020.e03825 · Cited by 3 · see citing works
Self-citationPuplampu, B. B., & Lewis, C. (2021) · Journal of the British Academy · doi:10.5871/jba/009s1.257 · Cited by 3 · see citing works
Fwu, B.-J., Yang, T.-R., Chen, Y., & Chen, R. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1046806 · Cited by 3 · see citing works
Floyd, K., Hesse, C., Ray, C. D., & Mikkelson, A. C. (2024) · The Journal of Psychology · doi:10.1080/00223980.2024.2378418 · Cited by 3 · see citing works
Diversity in the International Journal of Forensic Mental Health
Nijdam‐Jones, A., Cortvriendt, J., & Daffern, M. (2023) · International Journal of Forensic Mental Health · doi:10.1080/14999013.2023.2243853 · Cited by 3 · see citing works
Pollet, T. V., & Saxton, T. K. (2019) · doi:10.31234/osf.io/28yvp · Cited by 3 · see citing works
Self-citationAttwood, A. I. (2024) · IntechOpen eBooks · doi:10.5772/intechopen.1005818 · Cited by 2 · see citing works
Organizational Strategy and IT Workforce During Times of Environmental Turbulence
Serenko, A., Ghosh, J., Palvia, P., & Jacks, T. (2025) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2025.3543143 · Cited by 2 · see citing works
The development of an online intellectual humility intervention for religious or spiritual conflict
Lee, A. K., Wong, B. C., & Krumrei-Mancuso, E. J. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100871 · Cited by 3 · see citing works
Applicability and validity of the reaction time‐based concealed information test in a prison sample
Haberler, J., Suchotzki, K., Meinhardt, M., & Gamer, M. (2024) · Legal and Criminological Psychology · doi:10.1111/lcrp.12277 · Cited by 2 · see citing works
Richardson, G. B., Bates, D., McLaughlin, L. L., Mcgee, N. D., Tse, W. W.-Y., & Lai, M. H. C. (2025) · Human Nature · doi:10.1007/s12110-025-09497-7 · Cited by 2 · see citing works
Beran, M. J. (2022) · Animal Cognition · doi:10.1007/s10071-022-01706-5 · Cited by 2 · see citing works
Sample representativeness in psychological and brain science research
Liu, W., Chen, Z., & Hu, C.-P. (2024) · Chinese Science Bulletin (Chinese Version) · doi:10.1360/tb-2024-0322 · Cited by 2 · see citing works
Costello, W., & Thomas, A. G. (2024) · Adaptive Human Behavior and Physiology · doi:10.1007/s40750-024-00240-7 · Cited by 1 · see citing works
Larsen, M., Fisher, M. L., Komatsu, H., & Kennair, L. E. O. (2026) · Evolutionary Psychological Science · doi:10.1007/s40806-026-00478-2 · Cited by 1 · see citing works
Costa, J. V. R., Moraes, Y. L., & Varella, M. A. C. (2026) · Personality and Individual Differences · doi:10.1016/j.paid.2026.113946 · Cited by 1 · see citing works
Sample characteristics for quantitative analyses in Body Image: Issues of generalisabilityPreprint
Pollet, T. V., Bovet, J., Buhaenko, R., Cornelissen, P. L., & Tovée, M. J. (2023) · doi:10.31234/osf.io/2qfdb · Cited by 1 · see citing works
Self-citationLukaszewski, A. W., & Pillsworth, E. G. (2023) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2023.09.001 · Cited by 1 · see citing works
Benefits of Life Skill Based Education for Neurodiverse Adults: An Integrative Review and Analysis
Ravichandren, N., & O'Connor, A. N. (2021) · World Journal of Educational Research · doi:10.22158/wjer.v8n4p21
A meta-analysis of the reliability of the Sexual Self-Esteem Inventory for Women (SSEI-W) measurePreprint
Lloyd, A., Brown, G., & Pollet, T. V. (2020) · doi:10.31234/osf.io/swzm6
Self-citationSimanko, V., Rimmer, B., & Pollet, T. V. (2019) · doi:10.31234/osf.io/h2b3w
Self-citationPorfírio, J. C. C. (2022) · doi:10.31234/osf.io/yvwcm
Bonin, P., Thiebaut, G., Didierjean, A., Fančovičová, J., Kubjatková, N., Prokop, P., & Méot, A. (2023) · Evolutionary Psychological Science · doi:10.1007/s40806-023-00377-w
Clark, D. P. A., & Donnelly, N. (2024) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218241238737 · Cited by 1 · see citing works
We are not WEIRD: Chinese Culture and Psychology
(2024) · Frontiers research topics · doi:10.3389/978-2-8325-4650-5
Garza, R., Elizondo, R. G., & Pazhoohi, F. (2024) · Evolutionary Psychological Science · doi:10.1007/s40806-024-00394-3
Researchers’ Perceptions of the State of Social and Personality PsychologyPreprint
Schiavone, S. R., Vazire, S., & Rhemtulla, M. (2024) · doi:10.31234/osf.io/ja4u2
Vers une sociologie dialogique
Ḥanafī, S. (2024) · Revue du MAUSS · doi:10.3917/rdm1.063.0294
Andraszewicz, S., Roberts, A. C., Wettstein, L., Popelka, D., & Hölscher, C. (2024) · doi:10.31219/osf.io/z8csh
Júnior, M. D. S., Barbosa, L., & de Souza, M. L. R. S. (2024) · Psicologia USP · doi:10.1590/0103-6564e230050 · Cited by 2 · see citing works
Improving Test Reviews With Systematic Reviews and Meta-Analyses
Elosua, P., Hernández, A., & Abad, F. J. (2024) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000880
Garza, R., Arsuaga, J. D., & Pazhoohi, F. (2025) · Archives of Sexual Behavior · doi:10.1007/s10508-025-03284-2
Pollet, T. V., Fitzpatrick, B., Meziani, S., Pashley, E. M., & Sefcikova, E. (2026) · Personality and Individual Differences · doi:10.1016/j.paid.2026.113638
Self-citationKasana, P., Sehgal, V., & Garg, N. (2026) · International journal of organizational analysis · doi:10.1108/ijoa-10-2025-6121
da Silva, K. P., Amaral, B. H., Varella, M. A. C., & Valentova, J. V. (2026) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2026.106889
How Does the Lack of Diversity in Psychological Science Research Affect Undergraduate Students?
Thomas, C. R., Figueroa, J., Lugo-Martinez, V., Cantu, D. E., Branch, J., & Williamson, H. C. (2026) · Teaching of Psychology · doi:10.1177/00986283261456691
David, L., Pellerin, N., & Dambrun, M. (2026) · PLoS ONE · doi:10.1371/journal.pone.0351154
The dimensionality and somatisation correlates of ICD-11 prolonged grief disorder
McCusker, P., Killikelly, C., O'Connor, M., McBride, O., Cunningham, J., Murphy, J., Duffy, M., & Shevlin, M. E. (2026) · European Journal of Psychotraumatology · doi:10.1080/20008066.2026.2702687
“WEIRDly Exceptional”: Has Cultural Psychology Reproduced What It Sought to Critique?
Bettache, K. (2026) · Perspectives on Psychological Science · doi:10.1177/17456916261474830
- Authors
- Pollet, T. V., & Saxton, T. K.
- Affiliations
- Northumbria University (GB)
- Corresponding author
- Pollet, Thomas V.
- Venue
- Evolutionary Psychological Science
- Published
- 2019-03-12
- Volume
- 5
- Issue
- 3
- Pages
- 357-368
- ISSN
- 2198-9885 (ISSN-L)
- OpenAlex
- W2912330488
- Cited by
- 89
- References
- 112
- Citations by year
- 2026: 9 · 2025: 6 · 2024: 24 · 2023: 13 · 2022: 9 · 2021: 14 · 2020: 10 · 2019: 4
- FWCI
- 10.90
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Evolutionary Psychological Science (publishedVersion, cc-by)
- Northumbria Research Link (Northumbria University) (acceptedVersion, cc-by)
- Funders
- Northumbria University
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Evolutionary Psychology and Human Behavior
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- sample diversity, WEIRD samples, evolutionary psychology, generalizability, online sampling, student samples, sample size, participant recruitment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
