The Oxford Implementation Index: a new tool for incorporating implementation data into systematic reviews and meta-analyses
Open accessAbstract
Objective This article presents a new tool that helps systematic reviewers extract and compare implementation data across primary trials. Currently, systematic review guidance does not provide guidelines for the identification and extraction of data related to the implementation of underlying interventions. Study Design and Setting A team of systematic reviewers used a multi-staged consensus development approach to develop this tool. First, a systematic literature search on the implementation and synthesis of clinical trial evidence was performed. The team then met in a series of subcommittees to develop an initial draft index. Drafts were presented at several research conferences and circulated to methodological experts in various health-related disciplines for feedback. The team systematically recorded, discussed, and incorporated all feedback into further revisions. A penultimate draft was discussed at the 2010 Cochrane-Campbell Collaboration Colloquium to finalise its content. Results The Oxford Implementation Index provides a checklist of implementation data to extract from primary trials. Checklist items are organised into four domains: intervention design, actual delivery by trial practitioners, uptake of the intervention by participants, and contextual factors. Systematic reviewers piloting the index at the Cochrane-Campbell Colloquium reported that the index was helpful for the identification of implementation data. Conclusion The Oxford Implementation Index provides a framework to help reviewers assess implementation data across trials. Reviewers can use this tool to identify implementation data, extract relevant information, and compare features of implementation across primary trials in a systematic review. The index is a work in progress, and future efforts will focus on refining the index, improving usability, and integrating the index with other guidance on systematic reviewing.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
An intervention summary table shows which studies did not specify certain characteristics as part of the intervention.
“shows which studies did not specify certain characteristics as part of the intervention;”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [75]
The Results section (“Domains of the Oxford Implementation Index,” page not available) says reviewers should check whether intervention components are clearly specified in trial reports. The Discussion adds that the Index can identify missing implementation data. Neither passage says that an intervention summary table shows which studies omitted particular characteristics. (LLM, conf=0.82)
Experimental — accuracy not yet measuredAn intervention summary table highlights missing or unavailable details.
“highlights missing or unavailable details;”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [75]
The Discussion says the Oxford Implementation Index helps identify absent implementation data, and Results (‘Using the Oxford Implementation Index’) describes a data-extraction format shown in Table 1. The paper supports highlighting missing intervention details, but does not specifically establish that an intervention summary table does so. (LLM, conf=0.83)
Experimental — accuracy not yet measuredAn intervention summary table helps readers compare the characteristics of the interventions and consider those that may be feasible for implementation in their setting.
“An intervention summary table helps readers compare the characteristics of the interventions and consider those that may be feasible for implementation in their setting;”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [75]
An intervention summary table highlights characteristics that have not been investigated in existing studies.
“and highlights characteristics that have not been investigated in existing studies.73 75”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [75]
The Results section describes using the Oxford Implementation Index to record intervention characteristics and differences across trials, but does not say that an intervention summary table highlights characteristics not investigated in existing studies. Searches for “summary table” and research gaps found no passage making that point; the copy’s discussion of underreporting is not the same as a characteristic being uninvestigated. (LLM, conf=0.72)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · see citing works
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623 · see citing works
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578 · see citing works
(2000) · Cited by 9,198 · see citing works
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883 · see citing works
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · see citing works
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373 · see citing works
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826 · see citing works
(2005) · Cited by 3,748 · see citing works
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,657 · see citing works
Consort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510 · see citing works
Des Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817 · see citing works
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755 · see citing works
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620 · see citing works
Mediators and Moderators of Treatment Effects in Randomized Clinical Trials
Kraemer, H. C., Wilson, G. T., Fairburn, C. G., & Agras, W. S. (2002) · Archives of General Psychiatry · doi:10.1001/archpsyc.59.10.877 · Cited by 2,562 · see citing works
A conceptual framework for implementation fidelity
Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007) · Implementation Science · doi:10.1186/1748-5908-2-40 · Cited by 2,559 · see citing works
CONSORT statement: extension to cluster randomised trials
Campbell, M. K., Elbourne, D. R., & Altman, D. G. (2004) · BMJ · doi:10.1136/bmj.328.7441.702 · Cited by 2,557 · see citing works
Piaggio, G., Elbourne, D. R., Pocock, S. J., Evans, S. J. W., Altman, D. G., & CONSORT Group, F. T. (2012) · JAMA · doi:10.1001/jama.2012.87802 · Cited by 2,428 · see citing works
Boutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008 · Cited by 2,292 · see citing works
Popay, J., Roberts, H., Sowden, A., Petticrew, M., Arai, L., Rodgers, M., Britten, N., Roen, K., & Duffy, S. (2006) · Lancaster University · doi:10.13140/2.1.1018.4643 · Cited by 2,070 · see citing works
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.004 · Cited by 1,858 · see citing works
GRADE guidelines: 8. Rating the quality of evidence—indirectness
Guyatt, G. H., Oxman, A. D., Kunz, R., Woodcock, J., Brozek, J., Helfand, M., Alonso-Coello, P., Falck-Ytter, Y., Jaeschke, R., Vist, G., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.04.014 · Cited by 1,843 · see citing works
Glasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.8.1261 · Cited by 1,836 · see citing works
Improving the reporting of pragmatic trials: An extension of the CONSORT statement
Zwarenstein, M., Treweek, S., Gagnier, J. J., Altman, D. G., Tunis, S., Haynes, B., Oxman, A. D., Moher, D., & groups, F. T. C. A. P. T. I. H. (. (2008) · BMJ · doi:10.1136/bmj.a2390 · Cited by 1,813 · see citing works
Dusenbury, L. (2003) · Health Education Research · doi:10.1093/her/18.2.237 · Cited by 1,671 · see citing works
Better Reporting of Harms in Randomized Trials: An Extension of the CONSORT Statement
Ioannidis, J. P. A., Evans, S. J. W., Gøtzsche, P. C., O'Neill, R. T., Altman, D. G., Schulz, K., Moher, D., & for the CONSORT Group* (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-141-10-200411160-00009 · Cited by 1,593 · see citing works
Dane, A. V., & Schneider, B. H. (1998) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00043-3 · Cited by 1,557 · see citing works
Higashida, R. T., & Furlan, A. J. (2003) · Stroke · doi:10.1161/01.str.0000082721.62796.09 · Cited by 1,556 · see citing works
Reporting of Noninferiority and Equivalence Randomized Trials: An Extension of the CONSORT Statement
Piaggio, G., Elbourne, D. R., Altman, D. G., Pocock, S. J., Evans, S. J. W., & CONSORT Group, F. T. (2006) · JAMA · doi:10.1001/jama.295.10.1152 · Cited by 1,153 · see citing works
CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials.
Schulz, K. F., Altman, D. G., & Moher, D. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.02.005 · Cited by 1,022 · see citing works
Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated
Thompson, S. G. (1994) · BMJ · doi:10.1136/bmj.309.6965.1351 · Cited by 1,017 · see citing works
Green, L. W., & Glasgow, R. E. (2006) · Evaluation & the Health Professions · doi:10.1177/0163278705284445 · Cited by 922 · see citing works
A consumer's guide to subgroup analyses
Oxman, A. D., & Guyatt, G. H. (1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-1-78 · Cited by 914 · see citing works
Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.620 · Cited by 873 · see citing works
Borrelli, B., Sepinwall, D., Ernst, D., Bellg, A. J., Czajkowski, S., Breger, R., DeFrancesco, C., Levesque, C., Sharp, D. L., Ogedegbe, G., et al. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.5.852 · Cited by 803 · see citing works
Treatment fidelity in outcome studies
Moncher, F. J., & Prinz, R. J. (1991) · Clinical Psychology Review · doi:10.1016/0272-7358(91)90103-2 · Cited by 797 · see citing works
Assessing the Risk of Bias of Individual Studies in Systematic Reviews of Health Care Interventions
Viswanathan, M., Ansari, M., Berkman, N., Chang, S. M., Hartling, L., McPheeters, M., Santaguida, P., Shamliyan, T., Singh, K., Tsertsvadze, A., et al. (2012) · doi:10.23970/ahrqepcmethguide2 · Cited by 731 · see citing works
Hopewell, S., Clarke, M., Moher, D., Wager, E., Middleton, P., Altman, D. G., Schulz, K. F., & and the CONSORT Group (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050020 · Cited by 674 · see citing works
Summing up evidence: one answer is not always enough
Lau, J., Ioannidis, J. P. A., & Schmid, C. H. (1998) · The Lancet · doi:10.1016/s0140-6736(97)08468-7 · Cited by 646 · see citing works
Treatment integrity and therapeutic change: issues and research recommendations
Perepletchikova, F., & Kazdin, A. E. (2005) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpi045 · Cited by 638 · see citing works
Glasgow, R. E., Klesges, L. M., Dzewaltowski, D. A., Bull, S. S., & Estabrooks, P. (2004) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2701_2 · Cited by 635 · see citing works
Reporting Randomized, Controlled Trials of Herbal Interventions: An Elaborated CONSORT Statement
Gagnier, J. J., Boon, H., Rochon, P., Moher, D., Barnes, J., Bombardier, C., & for the CONSORT Group* (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-5-200603070-00013 · Cited by 608 · see citing works
Blueprints for Violence Prevention
Mihalic, S. W., Irwin, K., Elliott, D. S., Fagan, A. A., & Hansen, D. C. (2001) · PsycEXTRA Dataset · doi:10.1037/e304162003-001 · Cited by 498 · see citing works
The integrity of independent variables in behavior analysis
Peterson, L., Homer, A. L., & Wonderlich, S. A. (1982) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1982.15-477 · Cited by 461 · see citing works
Moher, D., Hopewell, S., Schulz, K. F., Montori, V. M., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D. R., Egger, M., & Altman, D. G. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.10.006 · Cited by 414 · see citing works
Evidence-based behavioral medicine: What is it and how do we achieve it?
Davidson, K. W., Goldstein, M. G., Kaplan, R. M., Kaufmann, P. G., Knatterud, G. L., Orleans, C. T., Spring, B. J., Trudeau, K. J., & Whitlock, E. P. (2003) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2603_01 · Cited by 407 · see citing works
Quality of reporting of observational longitudinal research.
Tooth, L. (2005) · American Journal of Epidemiology · doi:10.1093/aje/kwi042 · Cited by 363 · see citing works
MacPherson, H., White, A. R., Cummings, M., Jobst, K. A., Rose, K., & Niemtzow, R. C. (2002) · The Journal of Alternative and Complementary Medicine · doi:10.1089/107555302753507212 · Cited by 349 · see citing works
Forgatch, M. S., Patterson, G. R., & DeGarmo, D. S. (2005) · Behavior Therapy · doi:10.1016/s0005-7894(05)80049-8 · Cited by 320 · see citing works
Waterhouse, D. M., Calzone, K. A., Mele, C., & Brenner, D. E. (1993) · Journal of Clinical Oncology · doi:10.1200/jco.1993.11.6.1189 · Cited by 313 · see citing works
TREATMENT INTEGRITY IN APPLIED BEHAVIOR ANALYSIS WITH CHILDREN
Gresham, F. M., Gansle, K. A., & Noell, G. H. (1993) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1993.26-257 · Cited by 299 · see citing works
Systematic Reviews: Meta-analysis and its problems
Eysenck, H. J. (1994) · BMJ · doi:10.1136/bmj.309.6957.789 · Cited by 295 · see citing works
Systematic reviews of trials and other studies.
Sutton, A. J., Abrams, K. R., Jones, D. R., Sheldon, T., & Сонг (1998) · Health Technology Assessment · doi:10.3310/hta2190 · Cited by 268 · see citing works
Huppert, J. D., Bufka, L. F., Barlow, D. H., Gorman, J. M., Shear, M. K., & Woods, S. W. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.69.5.747 · Cited by 249 · see citing works
Fair tests of clinical trials: A treatment implementation model
Lichstein, K. L., Riedel, B. W., & Grieve, R. (1994) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(94)90001-9 · Cited by 244 · see citing works
Treatment Integrity of School-Based Behavioral Intervention Studies: 1980–1990
Gresham, F. M., Gansle, K. A., Noell, G. H., Cohen, S., & Rosenblum, S. (1993) · School Psychology Review · doi:10.1080/02796015.1993.12085651 · Cited by 241 · see citing works
Chalmers, I. (2003) · The Annals of the American Academy of Political and Social Science · doi:10.1177/0002716203254762 · Cited by 230 · see citing works
Higashida, R. T., Furlan, A. J., Roberts, H. C., Tomsick, T. A., Connors, B., Barr, J. D., Dillon, W. P., Warach, S. J., Broderick, J. P., Tilley, B. C., et al. (2003) · Journal of Vascular and Interventional Radiology · doi:10.1016/s1051-0443(07)60431-x · Cited by 224 · see citing works
Resnick, B. M., Bellg, A. J., Borrelli, B., Francesco, C. D., Breger, R. K. R., Hecht, J., Sharp, D. L., Levesque, C. S., Orwig, D., Ernst, D., et al. (2005) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2902s_8 · Cited by 215 · see citing works
Provider Assessment of Adherence to HIV Antiretroviral Therapy
Bangsberg, D. R., Hecht, F. M., Clague, H., Charlebois, E. D., Ciccarone, D., Chesney, M. A., & Moss, A. R. (2001) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/00126334-200104150-00005 · Cited by 203 · see citing works
Andrews, D. A., & Dowden, C. (2005) · Legal and Criminological Psychology · doi:10.1348/135532505x36723 · Cited by 183 · see citing works
Lee, J. Y. (1996) · American Journal of Hypertension · doi:10.1016/0895-7061(96)00056-8 · Cited by 176 · see citing works
Multisystemic Therapy: Monitoring Treatment Fidelity*
Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000) · Family Process · doi:10.1111/j.1545-5300.2000.39109.x · Cited by 172 · see citing works
Guidelines for systematic reviews of health promotion and public health interventions.
Jackson, N., Waters, E., & Petticrew, M. P. (2005) · LSHTM Research Online (London School of Hygiene and Tropical Medicine) · Cited by 145 · see citing works
Predicting compliance with a regimen of digoxin therapy in family practice.
Gilbert, J. R., Evans, C. E., Haynes, R. B., & Tugwell, P. (1980) · Europe PMC (PubMed Central) · Cited by 120 · see citing works
Qualitative research articles: information for authors and peer reviewers.
Rowan, M. S., & Huston, P. (1997) · Europe PMC (PubMed Central) · Cited by 117 · see citing works
Inter‐study differences: How should they influence the interpretation and analysis of results?
Bailey, K. R. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060327 · Cited by 108 · see citing works
Matsui, D. M., Hermann, C., Klein, J., Berkovitch, M., Olivieri, N. F., & Koren, G. (1994) · The Journal of Clinical Pharmacology · doi:10.1002/j.1552-4604.1994.tb04009.x · Cited by 99 · see citing works
Provider Assessment of Adherence to HIV Antiretroviral Therapy
Bangsberg, D. R., Hecht, F. M., Clague, H., Charlebois, E. D., Ciccarone, D., Chesney, M. A., & Moss, A. R. (2001) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/00042560-200104150-00005 · Cited by 97 · see citing works
Higashida, R. T., & Furlan, A. J. (2003) · Stroke · doi:10.1161/01.str.0000082720.85129.0a · Cited by 93 · see citing works
Successful Program Implementation: Lessons from Blueprints
Milhalic, S., Irwin, K., Fagan, A. A., Ballard, D., & Elliott, D. S. (2004) · PsycEXTRA Dataset · doi:10.1037/e300782005-001 · Cited by 81 · see citing works
Systematic reviews of trials and other studies.
Sutton, A. J., Abrams, K. R., Jones, D. R. H., Sheldon, T., & Song, F. (1998) · PubMed · Cited by 79 · see citing works
Beletsky, L. A., Grau, L. E., White, E., et al. (2010) · Addiction · doi:10.1111/j.1360-0443.2010.03149.x · Cited by 75 · see citing works
Measurement of patient compliance.
Paes, A. H. P., Bakker, A., & Soe-Agnie, C. J. (1998) · Pharmacy World & Science · doi:10.1023/a:1008663215166 · Cited by 74 · see citing works
The Evidence for Policy and Practice Information and Coordinating Centre
Gough, D. (2007) · Cited by 69 · see citing works
Treatment Fidelity in Social Work Intervention Research: A Review of Published Studies
Naleppa, M. J., & Cagle, J. G. (2010) · Research on Social Work Practice · doi:10.1177/1049731509352088 · Cited by 65 · see citing works
Clinical Trials in the Journal of Pediatric Psychology: Applying the CONSORT Statement
Stinson, J. (2003) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsg001 · Cited by 64 · see citing works
The challenges of systematically reviewing public health interventions
Jackson, N., Waters, E., & Taskforce, T. G. F. S. R. O. H. P. A. P. H. I. (2004) · Journal of Public Health · doi:10.1093/pubmed/fdh164 · Cited by 64 · see citing works
The impact of the CONSORT statement on reporting of randomized clinical trials in psychiatry
Han, C., Kwak, K. P., Marks, D. M., Pae, C.-U., Wu, L.-T. T., Bhatia, K. S., Masand, P. S., & Patkar, A. A. (2008) · Contemporary Clinical Trials · doi:10.1016/j.cct.2008.11.004 · Cited by 62 · see citing works
Arai, L., Roen, K., Roberts, H., & Popay, J. (2005) · Injury Prevention · doi:10.1136/ip.2004.007336 · Cited by 60 · see citing works
Lessons from overviews of cardiovascular trials
Furberg, C. D., & Morgan, T. M. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060316 · Cited by 51 · see citing works
Definitional and Practical Issues in the Assessment of Treatment Integrity
Dobson, K. S., & Singer, A. R. (2005) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.bpi046 · Cited by 50 · see citing works
Perry, A., Weisburd, D. L., & Hewitt, C. E. (2010) · Journal of Experimental Criminology · doi:10.1007/s11292-010-9099-z · Cited by 45 · see citing works
Accuracy of indirect measures of medication compliance in hypertension
Craig, H. M. (1985) · Research in Nursing & Health · doi:10.1002/nur.4770080112 · Cited by 44 · see citing works
Moberg-Mogren, E., & Nelson, D. L. (2006) · American Journal of Occupational Therapy · doi:10.5014/ajot.60.2.226 · Cited by 33 · see citing works
Improving the quality of reporting alcohol outcome studies: Effects of the CONSORT statement
Ladd, B. O., McCrady, B. S., Manuel, J. K., & Campbell, W. P. (2010) · Addictive Behaviors · doi:10.1016/j.addbeh.2010.02.009 · Cited by 32 · see citing works
The Evidence for Policy and Practice Information and Co-ordinating (EPPI) Centre, United Kingdom
Gough, D. (2007) · OECD eBooks · doi:10.1787/9789264033672-5-en · Cited by 26 · see citing works
Commentary: Strengthening the reporting of observational epidemiology the STROBE statement
Egger, M., Altman, D. G., Vandenbroucke, J. P., & of the STROBE group (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym199 · Cited by 20 · see citing works
Ward, T., Bernier, R., Mukerji, C., et al. (2012) · Springer eBooks · doi:10.1007/978-1-4419-1698-3_100603 · Cited by 19 · see citing works
Compliance assessment in drug trials: has there been improvement in two decades?
Jayaraman, S., Rieder, M. J., & Matsui, D. M. (2005) · PubMed · Cited by 18 · see citing works
TREND: AN IMPORTANT STEP, BUT NOT ENOUGH
Dzewaltowski, D. A., Estabrooks, P. A., Klesges, L. M., & Glasgow, R. E. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.9.1474 · Cited by 15 · see citing works
Treatment Integrity: Implications for Training
Flannery-Schroeder, E. C. (2005) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.bpi047 · Cited by 12 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- [27]Tamayo S Orange data: Implications of treatment fidelity for systematic reviewing [M.Sc. Thesis in Evidence-Based Social Work] 2004 University of Oxford
- [50]Higgins J Green S Cochrane handbook for systematic reviews of interventions 5.1.0 2011 Chichester, UK Wiley-Blackwell [updated March 2011]
- [52]Campbell Collaboration Guidelines for the preparation of review protocols 2001 cited 2006 7 February (Version 1.0). [updated 2001;]; Available from: http://www.campbellcollaboration.org/Fraguidelines.html
Cited by
Sorted by citations
Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 11,883 · see citing works
Self-citationProcess evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204 · see citing works
Appelbaum, M., Cooper, H., Kline, R. B., Mayo-Wilson, E., Nezu, A. M., & Rao, S. M. (2018) · American Psychologist · doi:10.1037/amp0000191 · Cited by 1,449 · see citing works
Self-citationPage, M. J., Moher, D., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/gwdhk · Cited by 916 · see citing works
Self-citationMayo-Wilson, E., Dias, S., Mavranezouli, I., Kew, K., Clark, D. M., Ades, A. E., & Pilling, S. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70329-3 · Cited by 680 · see citing works
Self-citationGottfredson, D. C., Cook, T. D., Gardner, F. E. M., Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015) · Prevention Science · doi:10.1007/s11121-015-0555-x · Cited by 627 · see citing works
Self-citationCraig, P., Di Ruggiero, E., Frohlich, K. L., Mykhalovskiy, E., White, M., on behalf of the Canadian Institutes of Health Research (CIHR)–National Institute for Health Research (NIHR) Context Guidance Authors Group (listed alphabetically), Campbell, R., Cummins, S., Edwards, N., Hunt, K., et al. (2018) · doi:10.3310/cihr-nihr-01 · Cited by 370 · see citing works
O. B. O. T. C.-S. G., Grant, S., Mayo-Wilson, E., Montgomery, P., Macdonald, G., Michie, S., Hopewell, S., & Moher, D. (2018) · Trials · doi:10.1186/s13063-018-2735-z · Cited by 348 · see citing works
Self-citationPage, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T., Mulrow, C. D., Shamseer, L., & Moher, D. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.11.010 · Cited by 211 · see citing works
Sundell, K., Beelmann, A., Hasson, H., & von Thiele Schwarz, U. (2016) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2015.1020540 · Cited by 179 · see citing works
Multiple risk behavior interventions: Meta-analyses of RCTs
Meader, N., King, K., Wright, K., Graham, H. M., Petticrew, M., Power, C., White, M., & Sowden, A. J. (2017) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2017.01.032 · Cited by 120 · see citing works
Hodkinson, A., Kontopantelis, E., Adeniji, C., van Marwijk, H., McMillan, B., Bower, P., & Panagioti, M. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.12895 · Cited by 55 · see citing works
RetractedMovsisyan, A., Melendez-Torres, G. J., & Montgomery, P. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.03.014 · Cited by 50 · see citing works
Self-citation
- Authors
- Montgomery, P., Underhill, K., Gardner, F., Operario, D., & Mayo-Wilson, E.
- Affiliations
- University of Oxford (GB)
- Yale University (US)
- Brown University (US)
- Corresponding author
- Montgomery, Paul
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2013-08
- Volume
- 66
- Issue
- 8
- Pages
- 874-882
- ISSN
- 0895-4356 (ISSN-L)
- PMC
- PMC3746185
- OpenAlex
- W2125696596
- Semantic Scholar
- f2fb5b15fd5d3f97da8b34eb2d719ea240611908
- Cited by
- 92
- References
- 94
- Citations by year
- 2025: 8 · 2024: 5 · 2023: 4 · 2022: 7 · 2021: 11 · 2020: 8 · 2019: 8 · 2018: 11 · 2017: 9 · 2016: 3 · 2015: 9 · 2014: 6 · 2013: 1 · 2012: 1
- FWCI
- 1.28
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Clinical Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- UCL Discovery (University College London) (submittedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Funders
- National Institute of Mental Health (R34MH093232)
- National Institute of Allergy and Infectious Diseases (P30AI042853)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- implementation research, systematic review methodology, intervention delivery, intervention uptake, contextual factors, consensus development
- MeSH terms
- Humans, Review Literature as Topic, Meta-Analysis as Topic, Randomized Controlled Trials as Topic, Guidelines as Topic, Consensus, Evidence-Based Practice, Checklist
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
