Expanding the CONSORT Figure: Increasing Transparency in Reporting on External Validity
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
INTRODUCTION There are major problems with failure to replicate research findings. Contributing to this problem is a failure to report on factors related to external validity. Frequently, researchers have little knowledge whether findings apply more generally, especially to low-resource settings and underserved populations. The CONSORT flow diagram has improved reporting on variables related to internal validity, but it has very limited detail on issues related to external validity. A recent CONSORT update and other publications have called for more transparent reporting on external validity and context, and information regarding the sustainability of interventions. All of these elements influence the generalizability of findings from outcomes research. METHODS Drawing on theory, a prior meeting, and recent recommendations for reporting factors related to external validity, the authors propose an expansion of the basic CONSORT flow diagram for clinical trials to concisely summarize these data that recent CONSORT statements and other guidelines have recommended. RESULTS The authors propose the use of an expanded CONSORT figure and illustrate its utility with an example. The expanded CONSORT figure adds data about participation and representativeness at the levels of settings and staff, and about intervention sustainability after project support ends. The authors provide an expanded CONSORT figure reporting template, and demonstrate its use. CONCLUSIONS Improving transparent reporting on external validity by using the proposed expanded CONSORT figure would help to address both the scientific replication crisis and health equity concerns. This figure provides a method to efficiently address the representativeness, generalizability, and sustainability of outcomes research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
The PRECIS-2 tool: designing trials that are fit for purpose
Loudon, K., Treweek, S., Sullivan, F., Donnan, P., Thorpe, K. E., & Zwarenstein, M. (2015) · BMJ · doi:10.1136/bmj.h2147 · Cited by 1,846
The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724
Self-citationBoutron, I., Altman, D. G., Moher, D., Schulz, K. F., Ravaud, P., & for the CONSORT NPT Group* (2017) · Annals of Internal Medicine · doi:10.7326/m17-0046 · Cited by 1,538
Standards for Reporting Implementation Studies (StaRI) Statement
Pinnock, H., Barwick, M., Carpenter, C. R., Eldridge, S., Grandes, G., Griffiths, C. J., Rycroft-Malone, J., Meissner, P., Murray, E., Patel, A., et al. (2017) · BMJ · doi:10.1136/bmj.i6795 · Cited by 1,446
Dissemination and Implementation Research in HealthTranslating Science to Practice
Brownson, R. C., Colditz, G. A., & Proctor, E. K. (2012) · doi:10.1093/acprof:oso/9780199751877.001.0001 · Cited by 1,355
Self-citationThe RE-AIM framework: a systematic review of use over time
Gaglio, B., Shoup, J. A., & Glasgow, R. E. (2013) · American Journal of Public Health · doi:10.2105/ajph.2013.301299 · Cited by 1,029
Self-citationFeldstein, A. C., & Glasgow, R. E. (2008) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(08)34030-6 · Cited by 987
Self-citationGreen, L. W., & Glasgow, R. E. (2006) · Evaluation & the Health Professions · doi:10.1177/0163278705284445 · Cited by 922
Self-citationCalvert, M., Kyte, D., Mercieca-Bebber, R., Slade, A., Chan, A.-W., King, M. T., and the SPIRIT-PRO Group, Hunn, A., Bottomley, A., Regnault, A., et al. (2018) · JAMA · doi:10.1001/jama.2017.21903 · Cited by 814
How to Make More Published Research True
Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760
Turner, L., Shamseer, L., Altman, D. G., Schulz, K. F., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-60 · Cited by 628
Bayliss, E. A., Bonds, D. E., Boyd, C. M., Davis, M. M., Finke, B., Fox, M. H., Glasgow, R. E., Goodman, R. A., Heurtin-Roberts, S., Lachenmayr, S., et al. (2014) · The Annals of Family Medicine · doi:10.1370/afm.1643 · Cited by 225
Self-citationCosting behavioral interventions: a practical guide to enhance translation
Ritzwoller, D. P., Sukhanova, A., Gaglio, B., & Glasgow, R. E. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9088-5 · Cited by 130
Self-citation
Cited by
RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review
Glasgow, R. E., Harden, S. M., Gaglio, B., Rabin, B., Smith, M. L., Porter, G. C., Ory, M. G., & Estabrooks, P. A. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00064 · Cited by 2,528
Self-citationImplementation science should give higher priority to health equity
Brownson, R. C., Kumanyika, S. K., Kreuter, M. W., & Haire-Joshu, D. (2021) · Implementation Science · doi:10.1186/s13012-021-01097-0 · Cited by 551
Self-citationReflections on 10 years of effectiveness-implementation hybrid studies
Curran, G. M., Landes, S. J., McBain, S. A., Pyne, J. M., Smith, J. D., Fernandez, M. E., Chambers, D. A., & Mittman, B. S. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.1053496 · Cited by 299
“These include the expanded CONSORT figure (34) that helps researchers summarize program participation and representativeness across different settings, staffing structures, and patients/community members.”
BackgroundRudd, B. N., Davis, M., & Beidas, R. S. (2020) · Implementation Science · doi:10.1186/s13012-020-01060-5 · Cited by 157
Barnes, C., McCrabb, S., Stacey, F., Nathan, N., Yoong, S. L., Grady, A., Sutherland, R., Hodder, R., Innes-Hughes, C., Davies, M., et al. (2021) · Translational Behavioral Medicine · doi:10.1093/tbm/ibab037 · Cited by 84
Metadata
- Authors
- Glasgow, R. E., Huebschmann, A. G., & Brownson, R. C.
- Venue
- American Journal of Preventive Medicine
- Publisher
- Elsevier BV
- Published
- 2018-09
- Volume
- 55
- Issue
- 3
- Pages
- 422-430
- ISSN
- 0749-3797 (ISSN-L)
- OpenAlex
- W2883119662
- Cited by
- 76
- References
- 15
- FWCI
- 6.84
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.