Just how plain are plain tobacco packs: re-analysis of a systematic review using multilevel meta-analysis suggests lessons about the comparative benefits of synthesis methods
Open accessThe DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Abstract
Comparisons between narrative synthesis and meta-analysis as synthesis methods in systematic reviews are uncommon within the same systematic review. We re-analysed a systematic review on the effects of plain packaging of tobacco on attractiveness. We sought to compare different synthesis approaches within the same systematic review and shed light on the comparative benefits of each approach. In our re-analysis, we included results relating to attractiveness in included reports. We extracted findings from studies and converted all estimates of differences in attractiveness to Cohen’s d . We used multilevel meta-analysis to account for clustering of effect sizes within studies. Of the 19 studies reporting results on attractiveness, seven studies that included between-subjects analyses could be included in the meta-analysis. Plain packs were less attractive than branded packs ( d = − 0.59, 95% CI [− 0.71, − 0.47]), with negligible but uncertain between-studies heterogeneity ( I 2 = 0%, 95% CI [0.00, 70.81]) and high within-study heterogeneity ( I 2 = 92.6%, 95% CI [91.04, 93.90]). The meta-analysis found, similar to the narrative synthesis, that respondents typically rated plain packaging as less attractive than alternative (e.g. branded) tobacco packs. However, there were several trade-offs between analysis methods in the types and bodies of evidence each one contained and in the difference between partial precision and breadth of conclusions. Analysis methods were different in respect of the role of judgement and contextual variation and in terms of estimation and unexpected effect modification. In addition, we noted that analysis methods were different in how they accounted for heterogeneity and consistency.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The use of narrative is ubiquitous across all research and can serve a valuable purpose in the development of a coherent story from diverse data.33 34”
From Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline (2020) · cites this paper as [34]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Systematic Reviews in the Social Sciences: A Practical Guide
Petticrew, M., & Roberts, H. (2006) · doi:10.1002/9780470754887 · Cited by 3,586
Self-citationMorris, S. B., & DeShon, R. P. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.105 · Cited by 2,502
Popay, J., Roberts, H., Sowden, A., Petticrew, M., Arai, L., Rodgers, M., Britten, N., Roen, K., & Duffy, S. (2006) · Lancaster University · doi:10.13140/2.1.1018.4643 · Cited by 2,070
Self-citationO'Neill, J., Tabish, H., Welch, V., Petticrew, M., Pottie, K., Clarke, M., Evans, T., Pardo Pardo, J., Waters, E., White, H., et al. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.08.005 · Cited by 1,657
Self-citationShibuya, K., Ciecierski, C., Guindon, E., Bettcher, D. W., Evans, D. B., & Murray, C. J. L. (2003) · BMJ · doi:10.1136/bmj.327.7407.154 · Cited by 1,239
Vote-counting methods in research synthesis.
Hedges, L. V., & Olkin, I. (1980) · Psychological Bulletin · doi:10.1037//0033-2909.88.2.359 · Cited by 495
Reasons or excuses for avoiding meta-analysis in forest plots
Ioannidis, J. P. A., Patsopoulos, N. A., & Rothstein, H. R. (2008) · BMJ · doi:10.1136/bmj.a117 · Cited by 457
Research works printed but not linked: 1
- Japan Tobacco International. Response to the Department of Health’s consultation on the standardised packaging of tobacco products. UK: Weybridge; 2012.
Cited by
Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline
Campbell, M., McKenzie, J. E., Sowden, A., Katikireddi, S. V., Brennan, S. E., Ellis, S., Hartmann-Boyce, J., Ryan, R., Shepperd, S., Thomas, J., et al. (2020) · BMJ · doi:10.1136/bmj.l6890 · Cited by 4,628
Self-citationAn overview of methodological approaches in systematic reviews
Veginadu, P., Calache, H., Gussy, M. G., Pandian, A., & Masood, M. (2022) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12468 · Cited by 72
Policy view: worldwide patterns of tobacco use with recommendations for tobacco control
McHardy, J., Marquizo, A. B., Bettcher, D. W., & Gakidou, E. E. (2025) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(25)00172-9 · Cited by 29
“One more time”: why replicating some syntheses of evidence relevant to COVID-19 makes sense
Page, M. J., Welch, V. A., Haddaway, N., Karunananthan, S., Maxwell, L. J., & Tugwell, P. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.05.024 · Cited by 18
The Perceptions of Nicotine Pouches Among Adolescents in Pakistan: a Qualitative Study
Khan, S. A., Zahra, F. T., Farzeen, M., Khan, A., Siddiqi, K., Bauld, L., & Moodie, C. S. (2025) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntaf223 · Cited by 6
Metadata
- Authors
- Melendez-Torres, G. J., Thomas, J., Lorenc, T., O’Mara-Eves, A., & Petticrew, M.
- Affiliations
- University College London (GB)
- University of York (GB)
- London School of Hygiene & Tropical Medicine (GB)
- Venue
- Systematic Reviews
- Published
- 2018-10-05
- Volume
- 7
- Issue
- 1
- Pages
- 153-153
- ISSN
- 2046-4053 (ISSN-L)
- PMC
- PMC6173910
- OpenAlex
- W2895689886
- Cited by
- 12
- References
- 31
- Citations by year
- 2025: 2 · 2022: 2 · 2020: 7 · 2019: 1
- FWCI
- 0.39
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (tdm)
- Locations
- Systematic Reviews (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- Medical Research Council (Meta-Analysis, Complexity and Heterogeneity Project)
- United Kingdom Clinical Research Collaboration (MR/KO232331/1)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Smoking Behavior and Cessation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- plain packaging, tobacco packaging, narrative synthesis, synthesis method comparison, heterogeneity, study heterogeneity, effect modification
- MeSH terms
- Drug Packaging, Humans, Smoking, Marketing, Tobacco Products
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Just how plain are plain tobacco packs: re-analysis of a systematic review using multilevel meta-analysis suggests lessons about the comparative benefits of synthesis methods. https://app.cochat.ai/papers/10.1186/s13643-018-0821-7
- The paper
- Melendez-Torres, G. J., Thomas, J., Lorenc, T., O’Mara-Eves, A., & Petticrew, M. (2018). Just how plain are plain tobacco packs: re-analysis of a systematic review using multilevel meta-analysis suggests lessons about the comparative benefits of synthesis methods. Systematic Reviews. https://doi.org/10.1186/s13643-018-0821-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

