Recommendations for sex/gender neuroimaging research: key principles and implications for research design, analysis, and interpretation
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
For over a decade, neuroimaging (NI) technologies have had an increasing impact in the study of complex cognitive and social processes. In this emerging field of social cognitive neuroscience, a central goal should be to increase the understanding of the interaction between the neurobiology of the individual and the environment in which s/he develops and functions. The study of the relationship between sex and gender could offer a valuable example of such research. We identify here four main principles that should inform NI research. First, the principle of overlap, arising from evidence of significant overlap of female/male distributions on measures of many gendered behaviours. Second, the principle of mosaicism, arising from evidence that for both behaviour and brain, each individual manifests a complex and idiosyncratic combination of feminine and masculine characteristics. Third, the principle of contingency, arising from evidence that female/male behavioural differences are contingent on time, place, social group and context. Fourth, the principle of entanglement, arising from an awareness that the neural phenotypes that NI techniques measure are a function of the interactive and reciprocal influence of biology and environment. These important principles have emerged and become well-established over the past few decades, but their implications are often not reflected in the design and interpretation of NI sex/gender research. We therefore offer a set of guidelines for researchers to ensure that NI sex/gender research is appropriately designed and interpreted. We hope this ‘toolkit’ will also be of use to editorial boards and journal reviewers, as well as those who view, communicate and interpret such research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mapping the Margins: Intersectionality, Identity Politics, and Violence against Women of Color
Crenshaw, K. (1991) · Stanford Law Review · doi:10.2307/1229039 · Cited by 32,792
The measurement of psychological androgyny
Bem, S. L. (1974) · Journal of Consulting and Clinical Psychology · doi:10.1037/h0036215 · Cited by 8,522 · cited 2×
“…so on, associated with femininity and masculinity) have challenged the earlier assumption that the sexes cluster distinctively and consistently at opposite ends of a single gender continuum (Terman and Miles, 1936) or can be located on two discrete “feminine” and “masculine” dimensions (Bem, 1974).”
BackgroundPower failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“Small sample size and associated reduced statistical power has been identified as a central problem in NI research (Carp, 2012; Button et al., 2013), as well Frontiers in Human Neuroscience www.frontiersin.org August 2014 | Volume 8 | Article 650 | 5 FIGURE 2 | Comparison of “typical” vs.…”
BackgroundSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
The Ambivalent Sexism Inventory: Differentiating hostile and benevolent sexism.
Glick, P., & Fiske, S. T. (1996) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.70.3.491 · Cited by 5,202
Permutation inference for the general linear model
Winkler, A. M., Ridgway, G. R., Webster, M. A., Smith, S. M., & Nichols, T. E. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.01.060 · Cited by 3,563
Navigation-related structural change in the hippocampi of taxi drivers
Maguire, E. A., Gadian, D. G., Johnsrude, I. S., Good, C. D., Ashburner, J., Frackowiak, R. S. J., & Frith, C. D. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.070039597 · Cited by 3,225
Sexing the body: gender politics and the construction of sexuality
(2000) · Choice Reviews Online · doi:10.5860/choice.38-0919 · Cited by 3,071
Changes in grey matter induced by training
Draganski, B., Gaser, C., Busch, V., Schuierer, G., Bogdahn, U., & May, A. (2004) · Nature · doi:10.1038/427311a · Cited by 2,373 · cited 2×
“Such changes could be brought about by, for example, normal learning experiences such as learning a language (Stein et al., 2012) or specific training activities such as taxi-driving or juggling (Maguire et al., 2000; Draganski et al., 2004; Chang, 2014).”
BackgroundCan cognitive processes be inferred from neuroimaging data?
POLDRACK, R. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.12.004 · Cited by 2,249
PHOENIX, C. H., GOY, R. W., GERALL, A. A., & YOUNG, W. C. (1959) · Endocrinology · doi:10.1210/endo-65-3-369 · Cited by 1,934 · cited 1×
“These were based on a fairly simple, almost unidirectional concept of “hard-wiring”, in which brain characteristics were conceived as being predetermined by the organizational effects of geneticallyprogrammed prenatal hormonal influences (Phoenix et al., 1959).”
BackgroundCross-national patterns of gender differences in mathematics: A meta-analysis.
Else-Quest, N. M., Hyde, J. S., & Linn, M. C. (2010) · Psychological Bulletin · doi:10.1037/a0018053 · Cited by 1,630 · cited 2×
“A review of differences in math achievement in 69 nations by Else-Quest et al. (2010) revealed that gender differences were not only very small, but highly variable, with effect sizes ranging from −0.42 (a moderate difference favoring females) to 0.40 (a moderate difference favoring males);…”
BackgroundInfluentialWhy sex matters for neuroscience
Cahill, L. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1909 · Cited by 1,540
Gender: An Intersectionality Perspective
Shields, S. A. (2008) · Sex Roles · doi:10.1007/s11199-008-9501-8 · Cited by 1,509 · cited 2×
“…and “male” here do not indicate an “innate” or “natural” neural maleness or femaleness, but are rather place-holders for a statistical approach that involves calculating the effect size of sex for a particular brainrelated data set. individuals mostly have a unitary “male” or “female” phenotype.”
BackgroundDevelopment of the Conformity to Masculine Norms Inventory.
Mahalik, J. R., Locke, B. D., Ludlow, L. H., Diemer, M. A., Scott, R. P. J., Gottfried, M., & Freitas, G. (2003) · Psychology of Men & Masculinity · doi:10.1037/1524-9220.4.1.3 · Cited by 1,295 · cited 3×
“To give some examples, relevant and multiple information about sex/gender can be assessed through the utilization of questionnaires assessing gendered personality dimensions (Personal Attributes Questionnaire, PAQ; Spence and Helmreich, 1978), gender attitudes (Ambivalent Sexism Inventory, ASI; Glick and Fiske, 1996),…”
BackgroundGender Similarities and Differences
Hyde, J. S. (2014) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115057 · Cited by 1,262
Negative results are disappearing from most disciplines and countries
Fanelli, D. (2012) · Scientometrics · doi:10.1007/s11192-011-0494-7 · Cited by 1,248 · cited 2×
“One consequence of this is that the domain-general publication bias towards positive findings in behavioral science (Simmons et al., 2011; Fanelli, 2012; Yong, 2012) is greatly exacerbated in sex/gender research (e.g., Maccoby and Jacklin, 1974).”
BackgroundSex differences in the structural connectome of the human brain
Ingalhalikar, M., Smith, A., Parker, D., Satterthwaite, T. D., Elliott, M. A., Ruparel, K., Hakonarson, H., Gur, R. E., Gur, R. C., & Verma, R. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1316909110 · Cited by 1,223
A meta-analysis of sex differences in human brain structure
Ruigrok, A. N. V., Salimi-Khorshidi, G., Lai, M.-C., Baron-Cohen, S., Lombardo, M. V., Tait, R. J., & Suckling, J. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.12.004 · Cited by 1,192
Beyond significance testing: Reforming data analysis methods in behavioral research.
Kline, R. B. (2004) · doi:10.1037/10693-000 · Cited by 1,034
Evolving Knowledge of Sex Differences in Brain Structure, Function, and Chemistry
Cosgrove, K. P., Mazure, C. M., & Staley, J. K. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.03.001 · Cited by 996 · cited 2×
“…by several meta-analyses and reviews, is that absolute brain volume is greater in men than in women (Lenroot and Giedd, 2010; Sacher et al., 2013) even when body size is controlled for (Cosgrove et al., 2007), although, as with psychological characteristics, the distributions overlap considerably.”
BackgroundNguyen, H.-H. D., & Ryan, A. M. (2008) · Journal of Applied Psychology · doi:10.1037/a0012702 · Cited by 913
Erroneous analyses of interactions in neuroscience: A problem of significance
Nieuwenhuis, S., Forstmann, B. U., & Wagenmakers, E.-J. (2011) · Nature Neuroscience · doi:10.1038/nn.2886 · Cited by 864 · cited 2×
“A second statistical issue relating to the presentation of findings is the problematic statistical practice observed in neuroscience generally (Nieuwenhuis et al., 2011), as well as in NI sex/gender research (Kaiser et al., 2009; Bluhm, 2013a), of analyzing group data separately and then doing a…”
BackgroundReframing sexual differentiation of the brain
McCarthy, M. M., & Arnold, A. P. (2011) · Nature Neuroscience · doi:10.1038/nn.2834 · Cited by 728 · cited 3×
“…neurodevelopment and widespread consensus of on-going interactive and reciprocal influences of biology and environment in brain structure and function (Li, 2003; Lickliter and Honeycutt, 2003; van Anders and Watson, 2006; Hausmann et al., 2009; McCarthy and Arnold, 2011; Miller and Halpern, 2013).”
BackgroundThe new science of cognitive sex differences
Miller, D. I., & Halpern, D. F. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.10.011 · Cited by 610
Guidelines for reporting an fMRI study
Poldrack, R. A., Fletcher, P. C., Henson, R. N., Worsley, K. J., Brett, M., & Nichols, T. E. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.11.048 · Cited by 550 · cited 1×
“Where an ROI approach is chosen for either structure or function measures, the regions need to be clearly specified in advance (Poldrack et al., 2008) which may be difficult in the absence of a well-specified neurocognitive model (see Bluhm, 2013a).”
MethodNeural correlates of socioeconomic status in the developing human brain
Noble, K. G., Houston, S. M., Kan, E., & Sowell, E. R. (2012) · Developmental Science · doi:10.1111/j.1467-7687.2012.01147.x · Cited by 542
Experience-dependent structural plasticity in the adult human brain
May, A. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.08.002 · Cited by 512 · cited 1×
“A recent review by May (2011) summarizes the evidence that new events, environmental changes and skill learning can alter brain function and the underlying neuroanatomic circuitry throughout our lives.”
BackgroundGur, R. C., Richard, J., Calkins, M. E., Chiavacci, R., Hansen, J. A., Bilker, W. B., Loughead, J., Connolly, J. J., Qiu, H., Mentch, F. D., et al. (2012) · Neuropsychology · doi:10.1037/a0026712 · Cited by 507 · cited 2×
“…sizes for brain differences were unreported, while behavioral differences in the larger population from which the sample were drawn were very modest (Joel and Tarrasch, 2014), being between 0 and 0.33 for behavioral differences, with 11 of 26 effect sizes being null/d 0.1 (Gur et al., 2012).”
BackgroundInfluentialMinireview: sex differences in adult and developing brains: compensation, compensation, compensation
De Vries, G. J. (2004) · Endocrinology · doi:10.1210/en.2003-1504 · Cited by 486 · cited 2×
“Indeed, it has been noted in non-human animals that one average difference between the sexes in a brain characteristic may compensate for another, giving rise to behavioral similarity (De Vries, 2004).”
Development of the conformity to feminine norms inventory
Mahalik, J. R., Morray, E. B., Coonerty-Femiano, A., Ludlow, L. H., Slattery, S. M., & Smiler, A. (2005) · Sex Roles · doi:10.1007/s11199-005-3709-7 · Cited by 416 · cited 2×
“…1996), self-attributed gender norms (Conformity To Masculine Norms Inventory, Mahalik et al., 2003, Conformity To Feminine Norms Inventory, CMFI; Mahalik et al., 2005), specific aspects of gender socialization (The Child Gender Socialization Scale, Blakemore and Hill, 2008), gender identity…”
BackgroundWalton, G. M., & Spencer, S. J. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02417.x · Cited by 366 · cited 1×
“…is diminished when tests are presented in a way that makes salient the stereotype that females are poor at mathematics (Nguyen and Ryan, 2008; Walton and Spencer, 2009), although we acknowledge the more sceptical conclusion regarding the size, robustness, and generality of the stereotype…”
BackgroundLi, S.-C. (2003) · Psychological Bulletin · doi:10.1037/0033-2909.129.2.171 · Cited by 287 · cited 2×
“…neurodevelopment and widespread consensus of on-going interactive and reciprocal influences of biology and environment in brain structure and function (Li, 2003; Lickliter and Honeycutt, 2003; van Anders and Watson, 2006; Hausmann et al., 2009; McCarthy and Arnold, 2011; Miller and Halpern, 2013).”
BackgroundThe Distance Between Mars and Venus: Measuring Global Sex Differences in Personality
Del Giudice, M., Booth, T., & Irwing, P. (2012) · PLoS ONE · doi:10.1371/journal.pone.0029265 · Cited by 256 · cited 2×
“Indeed, sex/gender NI2 research currently often appears to proceed as if a simple essentialist view of the sexes were correct: that is, as if sexes clustered distinctively and consistently at opposite ends of a single gender continuum, due to distinctive female vs. male brain circuitry, largely…”
BackgroundSexual dimorphism in the human brain: evidence from neuroimaging
Sacher, J., Neumann, J., Okon-Singer, H., Gotowiec, S., & Villringer, A. (2013) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2012.06.007 · Cited by 221 · cited 2×
“…difference, supported by several meta-analyses and reviews, is that absolute brain volume is greater in men than in women (Lenroot and Giedd, 2010; Sacher et al., 2013) even when body size is controlled for (Cosgrove et al., 2007), although, as with psychological characteristics, the…”
MethodResultPerigenual anterior cingulate morphology covaries with perceived social standing
Gianaros, P. J., Horenstein, J. A., Cohen, S., Matthews, K. A., Brown, S. M., Flory, J. D., Critchley, H. D., Manuck, S. B., & Hariri, A. R. (2007) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsm013 · Cited by 214 · cited 2×
“Other research demonstrates brain characteristics that vary as a function of socio-economic status (Hackman and Farah, 2009; Noble et al., 2012) or even subjective or perceived socio-economic status (Gianaros et al., 2007).”
BackgroundHuman Natures: Psychological Essentialism in Thinking about Differences between People
Haslam, N., & Whelan, J. (2008) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2008.00112.x · Cited by 122 · cited 2×
“Over the past few decades, psychologists have documented a tendency for lay-people to hold “essentialist” beliefs about social categories, including gender (for summary, see Haslam and Whelan, 2008).”
BackgroundPlasticity, plasticity, plasticity…and the rigid problem of sex
Fine, C., Jordan-Young, R., Kaiser, A., & Rippon, G. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.08.010 · Cited by 73
Self-citationFrom Scanner to Sound Bite: Issues in Interpreting and Reporting Sex Differences in the Brain
Fine, C. (2010) · Current Directions in Psychological Science · doi:10.1177/0963721410383248 · Cited by 45
Self-citationBluhm, R. (2013) · Hypatia · doi:10.1111/j.1527-2001.2012.01311.x · Cited by 27
Cited by
Why is depression more common among women than among men?
Kuehner, C. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)30263-2 · Cited by 1,752
Sex Differences in the Adult Human Brain: Evidence from 5216 UK Biobank Participants
Ritchie, S. J., Cox, S. R., Shen, X., Lombardo, M. V., Reus, L. M., Alloza, C., Harris, M. A., Alderson, H. L., Hunter, S., Neilson, E., et al. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhy109 · Cited by 855
“The issue of adjusting for overall brain size in analyses of sex differences (Rippon et al. 2014) was addressed in each of our macrostructural analyses.”
BackgroundJoel, D., & McCarthy, M. M. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2016.79 · Cited by 158
Heym, N., Firth, J., Kibowski, F., Sumich, A., Egan, V., & Bloxsom, C. A. J. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00095 · Cited by 93
Does Gender Leave an Epigenetic Imprint on the Brain?
Cortes, L. R., Cisternas, C. D., & Forger, N. G. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00173 · Cited by 52
Metadata
- Authors
- Rippon, G., Jordan-Young, R., Kaiser, A., & Fine, C.
- Venue
- Frontiers in Human Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2014-08-28
- Volume
- 8
- Pages
- 650-650
- ISSN
- 1662-5161 (ISSN-L)
- OpenAlex
- W2128033585
- Cited by
- 249
- References
- 40
- FWCI
- 12.56
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.