The DOI matches its Crossref record; 10 of the 11 references it cites were found in a registry or an index.
Development of a checklist to assess the quality of reporting of knowledge translation interventions using the Workgroup for Intervention Development and Evaluation Research (WIDER) recommendations
Open accessAbstract
Background: Influenced by an important paper by Michie et al., outlining the rationale and requirements for detailed reporting of behavior change interventions now required by Implementation Science, we created and refined a checklist to operationalize the Workgroup for Intervention Development and Evaluation Research (WIDER) recommendations in systematic reviews. The WIDER recommendations provide a framework to identify and provide detailed reporting of the essential components of behavior change interventions in order to facilitate replication, further development, and scale-up of the interventions. Findings: The checklist was developed, applied, and improved over the course of four systematic reviews of knowledge translation (KT) strategies in a variety of healthcare settings conducted by Scott and associates. The checklist was created as one method of operationalizing the work of the WIDER in order to facilitate comparison across heterogeneous studies included in these systematic reviews. Numerous challenges were encountered in the process of creating and applying the checklist across four stages of development. The resulting improvements have produced a ‘user-friendly’ and replicable checklist to assess the quality of reporting of KT interventions in systematic reviews using the WIDER recommendations. Conclusions: With journals, such as Implementation Science, using the WIDER recommendations as publication requirements for evaluation reports of behavior change intervention studies, it is crucial to find methods of examining, measuring, and reporting the quality of reporting. This checklist is one approach to operationalize the WIDER recommendations in systematic review methodology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A number of reporting guidelines could be leveraged to improve descriptions of strategies (4, 96–100).”
From Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda (2019) · cites this paper as [100]
In the citing paper
“The importance of scientific journals ensuring that intervention content is well specified for replication and implementation has been recognised across the research community.15”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A taxonomy of behavior change techniques used in interventions
Abraham, C., & Michie, S. (2008) · Health Psychology · doi:10.1037/0278-6133.27.3.379 · Cited by 2,525
Dane, A. V., & Schneider, B. H. (1998) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00043-3 · Cited by 1,557 · cited 1×
“; licensee BioMed Centra Commons Attribution License (http://creativec reproduction in any medium, provided the or suggests that interventions are only described in detail 5% to 30% of the time [2-5].”
BackgroundSpecifying and reporting complex behaviour change interventions: the need for a scientific method
Michie, S., Fixsen, D., Grimshaw, J. M., & Eccles, M. P. (2009) · Implementation Science · doi:10.1186/1748-5908-4-40 · Cited by 976
Treatment fidelity in outcome studies
Moncher, F. J., & Prinz, R. J. (1991) · Clinical Psychology Review · doi:10.1016/0272-7358(91)90103-2 · Cited by 797 · cited 1×
“; licensee BioMed Centra Commons Attribution License (http://creativec reproduction in any medium, provided the or suggests that interventions are only described in detail 5% to 30% of the time [2-5].”
BackgroundKontos, P. C., & Poland, B. D. (2009) · Implementation Science · doi:10.1186/1748-5908-4-1 · Cited by 760
Evidence-based behavioral medicine: What is it and how do we achieve it?
Davidson, K. W., Goldstein, M. G., Kaplan, R. M., Kaufmann, P. G., Knatterud, G. L., Orleans, C. T., Spring, B. J., Trudeau, K. J., & Whitlock, E. P. (2003) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2603_01 · Cited by 420
Systematic review of knowledge translation strategies in the allied health professions
Scott, S. D., Albrecht, L., O’Leary, K., Ball, G. D., Hartling, L., Hofmeyer, A., Jones, C. A., Klassen, T. P., Burns, K. K., Newton, A. S., et al. (2012) · Implementation Science · doi:10.1186/1748-5908-7-70 · Cited by 331
Self-citationTREATMENT INTEGRITY IN APPLIED BEHAVIOR ANALYSIS WITH CHILDREN
Gresham, F. M., Gansle, K. A., & Noell, G. H. (1993) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1993.26-257 · Cited by 299 · cited 1×
“; licensee BioMed Centra Commons Attribution License (http://creativec reproduction in any medium, provided the or suggests that interventions are only described in detail 5% to 30% of the time [2-5].”
BackgroundOdom, S. L., Brown, W. H., Frey, T., Karasu, N., Lee Smith-Canter, L., & Strain, P. S. (2003) · Focus on Autism and Other Developmental Disabilities · doi:10.1177/10883576030180030401 · Cited by 288
Advancing the science of behaviour change: a plea for scientific reporting
MICHIE, S., & ABRAHAM, C. (2008) · Addiction · doi:10.1111/j.1360-0443.2008.02291.x · Cited by 99
Research works printed but not linked: 2
- Abraham C: Designing and evaluating interventions to change health-related behaviour patterns. Randomized Clinical Trials of Nonpharmacologic Treatments. Edited by: Boutron I, Ravaud P, Moher D. 2012, London: Chapman & Hall, 357-368.
- Cochrane Effective Practice and Organisation of Care Review Group: Data collection checklist.http://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/datacollectionchecklist.pdf,
Cited by
Sorted by citations
Items 201–251 of 251
Letts, A., Knight, K., Halliday, D., & Singleton, J. (2024) · Research Square · doi:10.21203/rs.3.rs-4392610/v1 · Cited by 1
Evidence implementation: doing it and reporting it right
McArthur, A. (2015) · The JBI Database of Systematic Reviews and Implementation Reports · doi:10.11124/01938924-201513050-00001
Sykes, P. (2015) · UTAS Research Repository · doi:10.25959/23238803
Myers, E. F. (2016) · Nutrition Today · doi:10.1097/nt.0000000000000136
Pojam i ključna obilježja kompleksnih intervencija za populacije u riziku
Žižak, A., Vukadin, I. K., Nišević, A. J., Kranželić, V., & Novak, M. (2016) · Kriminologija & socijalna integracija : časopis za kriminologiju, penologiju i poremećaje u ponašanju · doi:10.31299/ksi.24.1.5
Reporting Behaviour Change Interventions and Techniques
Michie, S., & Wood, C. E. (2016) · UCL Discovery (University College London)
Barnett, K. N., Bennie, M., Treweek, S. P., Petrie, D., & Robertson, C. T. (2016)
Clinician’s Commentary on Richards et al.
Salbach, N. M. (2019) · Physiotherapy Canada · doi:10.3138/ptc.2017-41-cc
Kien, C., Reichenpfader, U., Nußbaumer-Streit, B., Rohleder, S., Punz, P., Christof, C., & Gartlehner, G. (2014) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2014.11.001
Sasaki, K., Takahashi, Y., & Nakayama, T. (2020) · International Journal of Cardiology · doi:10.1016/j.ijcard.2020.05.069
Berzins, K. M., Canvin, K., Kendal, S., Benson, I., Kellar, I., Wright, J. M., López, R. R., Duxbury, J. A., Stewart, D., & Baker, J. A. (2020) · doi:10.21203/rs.3.rs-99034/v1
Steed, L., Heslop-Marshall, K., Sohanpal, R., Saqi-Waseem, S., Kelly, M. J., Pinnock, H., & Taylor, S. J. (2020) · doi:10.21203/rs.3.rs-29318/v1
Investigate the relationship between men's health and medical publication
Ran, N. (2021) · Journal of Men s Health · doi:10.31083/jomh.2021.024
Albrecht, L. (2020) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3-xeyn-2f38
Self-citationOcasio, K., Rolock, N., Greenfield, B., Gallese, R., Webb, J., Havighurst, S. S., Fong, R., & MacKenzie, M. J. (2021) · Journal of Evidence-Based Social Work · doi:10.1080/26408066.2021.1924912
Development, characteristics and impact of quality improvement casebooks: a scoping review
Anderson, N. N., & Gagliardi, A. R. (2021) · Health Research Policy and Systems · doi:10.1186/s12961-021-00777-z
Simunovic, M. R. I., Fahim, C., Coates, A. J., Urbach, D. R., Earle, C. C., Grubac, V., Brouwers, M. C., O’Brien, M. A., & Baxter, N. N. (2019) · Research Square · doi:10.21203/rs.2.15264/v1
Knowledge Translation of Scholarly Publishing Impacts on Public HealthPreprint
Ran, N. (2020) · doi:10.21203/rs.3.rs-87543/v1
BN, M. M. B. H., & Graham, F. I. D. (2021) · Wiley eBooks · doi:10.1002/9781119123316.ch10
Yost, J., Ganann, R., Thompson, D., Aloweni, F. B. A. B., Newman, K., Hazzan, A. A., McKibbon, A., Dobbins, M., & Ciliska, D. K. (2021) · doi:10.32920/14636286.v1
Self-Managing Symptoms of Long COVID: an Education and Strategies Research ProtocolPreprint
Green, R., Rybkina, J., Jacob, N., Colella, B., Gold, D. A., Stewart, D. E., Ruttan, L., Meusel, L.-A., McAndrews, M. P., & Abbey, S. E. (2022) · Research Square · doi:10.21203/rs.3.rs-1894964/v1
Wong, S. K. W. (2022) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/163576 · Cited by 1
Developing, Implementing and Evaluating Complex Services/Interventions, and Generating the Evidence
Cadogan, C. A. (2022) · Springer eBooks · doi:10.1007/978-3-030-50247-8_54-1
Developing, Implementing and Evaluating Complex Services/Interventions, and Generating the Evidence
Cadogan, C. A. (2023) · Springer eBooks · doi:10.1007/978-3-030-64477-2_54
Evidence to Practice: Implementing Evidence-Based Prevention Programs
Fuhr, D. C., & Wensing, M. (2024) · Springer eBooks · doi:10.1007/978-1-4614-6625-3_93-1
Cyclic evaluation of web-based public health interventions
Metz, G. (2024) · doi:10.26481/dis.20240531gm · Cited by 3
Preuhs, K., van Keulen, H. M., Pronk, J., Rijnders, M. E. B., Wils, A., Nieuwenhuijze, M. J., Abouri, N., & van Empelen, P. (2025) · JMIR Formative Research · doi:10.2196/75391
Steed, L., Heslop-Marshall, K., Sohanpal, R., Saqi-Waseem, S., Kelly, M., Pinnock, H., & Taylor, S. J. (2021) · Figshare · doi:10.6084/m9.figshare.14379552
Additional file 1 of Six practical recommendations for improved implementation outcomes reporting
Lengnick‐Hall, R., Gerke, D. R., Proctor, E. K., Bunger, A. C., Phillips, R. J., Martin, J. K., & Swanson, J. C. (2022) · Figshare · doi:10.6084/m9.figshare.19144714
Cassidy, C. E., Shin, H. D., Ramage, E. R., Conway, A., Mrklas, K., Laur, C. V., Beck, A., Varin, M. D., Steinwender, S., Nguyen, T., et al. (2021) · Figshare · doi:10.6084/m9.figshare.16921649
Steed, L., Heslop-Marshall, K., Sohanpal, R., Saqi-Waseem, S., Kelly, M., Pinnock, H., & Taylor, S. (2021) · Figshare · doi:10.6084/m9.figshare.14379549
Anderson, N. N., & Gagliardi, A. R. (2021) · Figshare · doi:10.6084/m9.figshare.16590849
Klamert, L., Craike, M. J., Bedi, G., Kidd, S., Pascoe, M. C., & Parker, A. G. (2024) · Figshare · doi:10.6084/m9.figshare.25670247
Anderson, N. N., & Gagliardi, A. R. (2021) · Figshare · doi:10.6084/m9.figshare.16590855
Marulappa, N., Anderson, N. N., Bethell, J., Bourbonnais, A., Kelly, F., McMurray, J., Rogers, H. L., Vedel, I., & Gagliardi, A. R. (2022) · Figshare · doi:10.6084/m9.figshare.19641866
Simunovic, M., Fahim, C., Coates, A. J., Urbach, D., Earle, C., Grubac, V., Brouwers, M., O’Brien, M. A., & Baxter, N. (2020) · Figshare · doi:10.6084/m9.figshare.12441395
Worum, H., Lillekroken, D., Ahlsen, B., Roaldsen, K. S., & Bergland, A. (2020) · Figshare · doi:10.6084/m9.figshare.13151719
Marulappa, N., Anderson, N. N., Bethell, J., Bourbonnais, A., Kelly, F., McMurray, J., Rogers, H. L., Vedel, I., & Gagliardi, A. R. (2022) · Figshare · doi:10.6084/m9.figshare.19641869
Cassidy, C. E., Shin, H. D., Ramage, E. R., Conway, A., Mrklas, K., Laur, C. V., Beck, A., Varin, M. D., Steinwender, S., Nguyen, T., et al. (2021) · Figshare · doi:10.6084/m9.figshare.16921646
Steed, L., Heslop-Marshall, K., Sohanpal, R., Saqi-Waseem, S., Kelly, M., Pinnock, H., & Taylor, S. (2021) · Figshare · doi:10.6084/m9.figshare.14379543
Marulappa, N., Anderson, N. N., Bethell, J., Bourbonnais, A., Kelly, F., McMurray, J., Rogers, H. L., Vedel, I., & Gagliardi, A. R. (2022) · Figshare · doi:10.6084/m9.figshare.19641863
Additional file 2 of Six practical recommendations for improved implementation outcomes reporting
Lengnick‐Hall, R., Gerke, D. R., Proctor, E. K., Bunger, A. C., Phillips, R. J., Martin, J. K., & Swanson, J. C. (2022) · Figshare · doi:10.6084/m9.figshare.19144717
Barnden, R., Snowdon, D. A., Lannin, N. A., Lynch, E., Srikanth, V. K., & Andrew, N. E. (2023) · Figshare · doi:10.6084/m9.figshare.23488883
Satyanarayana, V. A., Jackson, C., Siddiqi, K., Chandra, P. S., Huque, R., Dherani, M., Nasreen, S., Murthy, P., & Rahman, A. (2021) · Figshare · doi:10.6084/m9.figshare.14252043
de Lima, F. F., Santos, J. M. B., de Oliveira, Y. A. P., Cervera, V. Z., Agondi, R. C., Carvalho‐Pinto, R. M., Pinheiro, D. H. A., & Carvalho, C. L. (2026) · ERJ Open Research · doi:10.1183/23120541.01115-2025
Physical Therapist Involved Physical Activity Interventions: A Systematic Review and Meta-Analysis
King, B. F., Capo‐Lugo, C. E., Strehlow, E., Walaszek, M. C., Gray, E., Pierobon, E. R., Heinemann, A., & Rafferty, M. R. (2026) · Neurology Report · doi:10.1097/npt.0000000000000546
Gomes, L. A. B., Verhagen, E. A. L. M., & Hespanhol, L. (2026) · Sports Medicine - Open · doi:10.1186/s40798-026-00985-3
Evaluating an integrated quality improvement and research approach: the Just Cos Initiative
Bishop, J. L., Ottrey, E., Fitzgerald, A., Romein, J., & Conlin, M. (2026) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzag041
Designing complex health system interventions: an integrated theory-informed approach
Nagraj, S., & Maraschin, F. (2026) · Frontiers in Health Services · doi:10.3389/frhs.2026.1820296
Aviles, R. G., García-Lirola, M. Á., Gonzalez-Lopez, M. C., Cantalejo, R. S. B., Velázquez, C. B., Isabel‐Gómez, R., Gutierrez-Gil, J. F., Guerrero, M. C. P., & Molina-López, T. (2026) · Frontiers in Health Services · doi:10.3389/frhs.2026.1907196
Making Brain Health Actionable for Older Persons in Primary Care: The Proposed SHAPES Framework
Bhidayasiri, R. (2026) · Journal of Primary Care & Community Health · doi:10.1177/21501319261502244
Metadata
- Authors
- Albrecht, L., Archibald, M., Arseneau, D., & Scott, S. D.
- Affiliations
- University of Alberta (CA)
- Corresponding author
- Scott, Shannon D
- Venue
- Implementation Science
- Published
- 2013-05-16
- Volume
- 8
- Issue
- 1
- Pages
- 52-52
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC3661354
- OpenAlex
- W2168880871
- Cited by
- 252
- References
- 10
- Citations by year
- 2026: 9 · 2025: 9 · 2024: 21 · 2023: 16 · 2022: 27 · 2021: 32 · 2020: 27 · 2019: 20 · 2018: 14 · 2017: 19 · 2016: 17 · 2015: 22 · 2014: 12 · 2013: 4
- FWCI
- 19.96
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion, cc-by)
- Funders
- University of Alberta
- Canadian Institutes of Health Research (102071_1)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- knowledge translation intervention, behaviour change interventions, systematic review methodology, intervention development and evaluation
- MeSH terms
- Forecasting, Humans, Quality Assurance, Health Care, Research Design, Randomized Controlled Trials as Topic, Program Development, Translational Research, Biomedical, Checklist
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review