Damned if you do, damned if you don't: subgroup analysis and equity
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
The final report from the WHO Commission on the social determinants of health recently noted: ‘For policy, however important an ethical imperative, values alone are insufficient. There needs to be evidence on what can be done and what is likely to work in practice to improve health and reduce health inequities.’ This is challenging, because understanding how to reduce health inequities between the poorest and better-off members of society may require a greater use of subgroup analysis to explore the differential effects of public health interventions. However, while this may produce evidence that is more policy relevant, the requisite subgroup analyses are often seen as tantamount to statistical malpractice. This paper considers some of the methodological problems with subgroup analysis, and its applicability to considerations of equity, using both clinical and public health examples. Finally, it suggests how policy needs for information on subgroups can be met while maintaining rigour.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Practical Statistics for Medical Research
Altman, D. G. (1990) · doi:10.1201/9780429258589 · Cited by 10,668
Yusuf, S. (1991) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1991.03470010097038 · Cited by 1,014 · cited 1×
“Quantitative interaction exists when the size of the effect varies but not the direction, that is if an intervention is beneficial to different degrees in different subgroups’.(6) Put baldly, we need to know more about the potential for interventions to reduce health inequity, but what we do know often derives from an…”
BackgroundSubgroup analysis in randomised controlled trials: importance, indications, and interpretation
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17709-5 · Cited by 942
A consumer's guide to subgroup analyses
Oxman, A. D., & Guyatt, G. H. (1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-1-78 · Cited by 914 · cited 1×
“This is consistent with Oxman and Guyatt’s ‘safety rules’ (updated in 2010)(19) for subgroup analyses, which among other things suggest that a subgroup difference is real if there is indirect evidence that supports the hypothesised difference.(23) In the case of equity-focused reviews, prespecifying the subgroup analy…”
ResultIs a subgroup effect believable? Updating criteria to evaluate the credibility of subgroup analyses
Sun, X., Briel, M., Walter, S. D., & Guyatt, G. H. (2010) · BMJ · doi:10.1136/bmj.c117 · Cited by 808 · cited 1×
“< Good practice in subgroup analysis would lead to more robust, policy-relevant evidence.(19) Overall, assessing the effects of interventions on health equity requires an interaction between theory and methods.”
BackgroundBrookes, S. T., Whitley, E., Peters, T. J., Mulheran, P. A., Egger, M., & Davey Smith, G. (2001) · Health Technology Assessment · doi:10.3310/hta5330 · Cited by 580
Integrating qualitative research with trials in systematic reviews
Thomas, J., Harden, A., Oakley, A., Oliver, S., Sutcliffe, K., Rees, R., Brunton, G., & Kavanagh, J. (2004) · BMJ · doi:10.1136/bmj.328.7446.1010 · Cited by 515
Self-citationYoung people and healthy eating: a systematic review of research on barriers and facilitators
Shepherd, J. (2005) · Health Education Research · doi:10.1093/her/cyh060 · Cited by 484
Meta-analysis. Beyond the grand mean?
Smith, G. D., Egger, M., & Phillips, A. N. (1997) · BMJ · doi:10.1136/bmj.315.7122.1610 · Cited by 174
Can meta-analysis help target interventions at individuals most likely to benefit?
Thompson, S. G., & Higgins, J. P. (2005) · The Lancet · doi:10.1016/s0140-6736(05)70200-2 · Cited by 174
Cited by
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
O'Neill, J., Tabish, H., Welch, V., Petticrew, M., Pottie, K., Clarke, M., Evans, T., Pardo Pardo, J., Waters, E., White, H., et al. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.08.005 · Cited by 1,657
Self-citationPsychosocial interventions for supporting women to stop smoking in pregnancy
Chamberlain, C., O'Mara-Eves, A., Porter, J., Coleman, T., Perlen, S. M., Thomas, J., & McKenzie, J. E. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001055.pub5 · Cited by 650
Adapting interventions to new contexts—The ADAPT guidance
Moore, G., Campbell, M., Copeland, L., Craig, P., Movsisyan, A., Hoddinott, P., Littlecott, H., O’Cathain, A., Pfadenhauer, L., Rehfuess, E., et al. (2021) · BMJ · doi:10.1136/bmj.n1679 · Cited by 511
Fletcher, A., Jamal, F., Moore, G., Evans, R. E., Murphy, S., & Bonell, C. (2016) · Evaluation · doi:10.1177/1356389016652743 · Cited by 294
Metadata
- Authors
- Petticrew, M., Tugwell, P., Kristjansson, E., Oliver, S., Ueffing, E., & Welch, V.
- Venue
- Journal of Epidemiology and Community Health
- Publisher
- BMJ
- Published
- 2011-06-06
- Volume
- 66
- Issue
- 1
- Pages
- 95-98
- ISSN
- 0141-7681 (ISSN-L)
- 0143-005X
- 1470-2738
- OpenAlex
- W2171164851
- Cited by
- 150
- References
- 12
- FWCI
- 8.07
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Damned if you do, damned if you don't: subgroup analysis and equity. https://app.cochat.ai/papers/10.1136/jech.2010.121095
- The paper
- Petticrew, M., Tugwell, P., Kristjansson, E., Oliver, S., Ueffing, E., & Welch, V. (2012). Damned if you do, damned if you don't: subgroup analysis and equity. Journal of Epidemiology and Community Health. https://doi.org/10.1136/jech.2010.121095
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.