Damned if you do, damned if you don't: subgroup analysis and equity
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
The final report from the WHO Commission on the social determinants of health recently noted: ‘For policy, however important an ethical imperative, values alone are insufficient. There needs to be evidence on what can be done and what is likely to work in practice to improve health and reduce health inequities.’ This is challenging, because understanding how to reduce health inequities between the poorest and better-off members of society may require a greater use of subgroup analysis to explore the differential effects of public health interventions. However, while this may produce evidence that is more policy relevant, the requisite subgroup analyses are often seen as tantamount to statistical malpractice. This paper considers some of the methodological problems with subgroup analysis, and its applicability to considerations of equity, using both clinical and public health examples. Finally, it suggests how policy needs for information on subgroups can be met while maintaining rigour.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Practical Statistics for Medical Research
Altman, D. G. (1990) · doi:10.1201/9780429258589 · Cited by 10,668
Yusuf, S. (1991) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1991.03470010097038 · Cited by 1,014 · cited 1×
“Quantitative interaction exists when the size of the effect varies but not the direction, that is if an intervention is beneficial to different degrees in different subgroups’.(6) Put baldly, we need to know more about the potential for interventions to reduce health inequity, but what we do know often derives from an…”
BackgroundSubgroup analysis in randomised controlled trials: importance, indications, and interpretation
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17709-5 · Cited by 942
A consumer's guide to subgroup analyses
Oxman, A. D., & Guyatt, G. H. (1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-1-78 · Cited by 914 · cited 1×
“This is consistent with Oxman and Guyatt’s ‘safety rules’ (updated in 2010)(19) for subgroup analyses, which among other things suggest that a subgroup difference is real if there is indirect evidence that supports the hypothesised difference.(23) In the case of equity-focused reviews, prespecifying the subgroup analy…”
ResultIs a subgroup effect believable? Updating criteria to evaluate the credibility of subgroup analyses
Sun, X., Briel, M., Walter, S. D., & Guyatt, G. H. (2010) · BMJ · doi:10.1136/bmj.c117 · Cited by 808 · cited 1×
“< Good practice in subgroup analysis would lead to more robust, policy-relevant evidence.(19) Overall, assessing the effects of interventions on health equity requires an interaction between theory and methods.”
BackgroundBrookes, S. T., Whitley, E., Peters, T. J., Mulheran, P. A., Egger, M., & Davey Smith, G. (2001) · Health Technology Assessment · doi:10.3310/hta5330 · Cited by 580
Integrating qualitative research with trials in systematic reviews
Thomas, J., Harden, A., Oakley, A., Oliver, S., Sutcliffe, K., Rees, R., Brunton, G., & Kavanagh, J. (2004) · BMJ · doi:10.1136/bmj.328.7446.1010 · Cited by 515
Self-citationYoung people and healthy eating: a systematic review of research on barriers and facilitators
Shepherd, J. (2005) · Health Education Research · doi:10.1093/her/cyh060 · Cited by 484
Meta-analysis. Beyond the grand mean?
Smith, G. D., Egger, M., & Phillips, A. N. (1997) · BMJ · doi:10.1136/bmj.315.7122.1610 · Cited by 174
Can meta-analysis help target interventions at individuals most likely to benefit?
Thompson, S. G., & Higgins, J. P. (2005) · The Lancet · doi:10.1016/s0140-6736(05)70200-2 · Cited by 174
Cited by
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
O'Neill, J., Tabish, H., Welch, V., Petticrew, M., Pottie, K., Clarke, M., Evans, T., Pardo Pardo, J., Waters, E., White, H., et al. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.08.005 · Cited by 1,657
Self-citationPsychosocial interventions for supporting women to stop smoking in pregnancy
Chamberlain, C., O'Mara-Eves, A., Porter, J., Coleman, T., Perlen, S. M., Thomas, J., & McKenzie, J. E. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001055.pub5 · Cited by 650
Adapting interventions to new contexts—The ADAPT guidance
Moore, G., Campbell, M., Copeland, L., Craig, P., Movsisyan, A., Hoddinott, P., Littlecott, H., O’Cathain, A., Pfadenhauer, L., Rehfuess, E., et al. (2021) · BMJ · doi:10.1136/bmj.n1679 · Cited by 511
Fletcher, A., Jamal, F., Moore, G., Evans, R. E., Murphy, S., & Bonell, C. (2016) · Evaluation · doi:10.1177/1356389016652743 · Cited by 294
Psychosocial interventions for supporting women to stop smoking in pregnancy
Chamberlain, C., O'Mara-Eves, A., Oliver, S., Caird, J. R., Perlen, S. M., Eades, S. J., & Thomas, J. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001055.pub4 · Cited by 251
Self-citationHuman well-being impacts of terrestrial protected areas
Pullin, A. S., Bangpan, M., Dalrymple, S., Dickson, K., Haddaway, N. R., Healey, J. R., Hauari, H., Hockley, N., Jones, J. P. G., Knight, T., et al. (2013) · Environmental Evidence · doi:10.1186/2047-2382-2-19 · Cited by 228
“Assessing the impact of PAs on health or social inequalities would require either individual sound studies with justifiable subgroup analyses, or a set of comparable studies which describe in detail the socioeconomic position of the populations studied [103,104].”
BackgroundSelf-citationA framework for identifying and mitigating the equity harms of COVID-19 policy interventions
Glover, R. E., van Schalkwyk, M. C. I., Akl, E. A., Kristjannson, E., Lotfi, T., Petkovic, J., Petticrew, M. P., Pottie, K., Tugwell, P., & Welch, V. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.06.004 · Cited by 185
“[46] Petticrew M, Tugwell P, Kristjansson E, Oliver S, Ueffing E, Welch V.”
BackgroundSelf-citationEvaluating the Impact of Physical Activity Apps and Wearables: Interdisciplinary Review
McCallum, C., Rooksby, J., & Gray, C. M. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.9054 · Cited by 126
“These preliminary, small-N studies are typical of iterative HCI research focused on developing novel technologies [185], and are unlikely to be sufficiently powered to test important hypotheses on mediators of effectiveness [17,186].”
BackgroundResearch strategies to discern active psychological therapy components: A scoping review
Leijten, P., Weisz, J. R., & Gardner, F. (2021) · Clinical Psychological Science · doi:10.1177/2167702620978615 · Cited by 55
Spence, S., Sawyer, M., Sheffield, J., Patton, G., Bond, L., Graetz, B., & Kay, D. (2014) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph110505113 · Cited by 60
“Petticrew et al. [13] make a strong case for sub-group analyses when there is a theoretical rationale behind the hypotheses, and where specific directional effects can be predicted.”
Nittas, V., Ameli, V., Little, M., & Humphreys, D. K. (2020) · DIGITAL HEALTH · doi:10.1177/2055207620942360 · Cited by 15
Metadata
- Authors
- Petticrew, M., Tugwell, P., Kristjansson, E., Oliver, S., Ueffing, E., & Welch, V.
- Venue
- Journal of Epidemiology and Community Health
- Publisher
- BMJ
- Published
- 2011-06-06
- Volume
- 66
- Issue
- 1
- Pages
- 95-98
- ISSN
- 0141-7681 (ISSN-L)
- 0143-005X
- 1470-2738
- OpenAlex
- W2171164851
- Cited by
- 150
- References
- 12
- FWCI
- 8.07
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.