The DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index.
Challenges, solutions and future directions in the evaluation of service innovations in health care and public health
Open accessAbstract
Headline: Evaluating service innovations in health care and public health requires flexibility, collaboration and pragmatism; this collection identifies robust, innovative and mixed methods to inform such evaluations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Self-citationMostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2009) · doi:10.1515/9781400829828 · Cited by 9,467
The Effect of Spironolactone on Morbidity and Mortality in Patients with Severe Heart Failure
Pitt, B., Zannad, F., Remme, W. J., Cody, R., Castaigne, A., Perez, A., Palensky, J., & Wittes, J. (1999) · New England Journal of Medicine · doi:10.1056/nejm199909023411001 · Cited by 9,214
Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., et al. (2011) · BMJ · doi:10.1136/bmj.d4002 · Cited by 7,709
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217
Barnett, K., Mercer, S. W., Norbury, M., Watt, G., Wyke, S., & Guthrie, B. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60240-2 · Cited by 6,972
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
Self-citationKluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Self-citationMostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2008) · doi:10.2307/j.ctvcm4j72 · Cited by 5,051
Pitt, B., Remme, W., Zannad, F., Neaton, J., Martinez, F., Roniker, B., Bittman, R., Hurley, S., Kleiman, J., & Gatlin, M. (2003) · New England Journal of Medicine · doi:10.1056/nejmoa030207 · Cited by 4,941
Making sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447
An Intervention to Decrease Catheter-Related Bloodstream Infections in the ICU
Pronovost, P., Needham, D., Berenholtz, S., Sinopoli, D., Chu, H., Cosgrove, S., Sexton, B., Hyzy, R., Welsh, R., Roth, G., et al. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa061115 · Cited by 4,387
Consort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510
Self-citationFramework for design and evaluation of complex interventions to improve health
Campbell, M. (2000) · BMJ · doi:10.1136/bmj.321.7262.694 · Cited by 3,474
Self-citationMaking psychological theory useful for implementing evidence based practice: a consensus approach
Michie, S. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.011155 · Cited by 3,440
Tudor Hart, J. (1971) · The Lancet · doi:10.1016/s0140-6736(71)92410-x · Cited by 3,253
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190
Eplerenone in patients with systolic heart failure and mild symptoms
Zannad, F., McMurray, J. J. V., Krum, H., van Veldhuisen, D. J., Swedberg, K., Shi, H., Vincent, J., Pocock, S. J., & Pitt, B. (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1009492 · Cited by 3,111 · cited 2×
“There are examples of successful cRCTs of complex policy interventions, which have successfully negotiated issues around randomisation and implementation, such as a cRCT of a scheme to provide free healthy breakfasts in Welsh primary schools.(22) Of the 608 schools invited to participate, 111 agreed to be randomised a…”
BackgroundResultData Resource Profile: Clinical Practice Research Datalink (CPRD)
Herrett, E., Gallagher, A. M., Bhaskaran, K., Forbes, H., Mathur, R., van Staa, T., & Smeeth, L. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv098 · Cited by 2,667
A conceptual framework for implementation fidelity
Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007) · Implementation Science · doi:10.1186/1748-5908-2-40 · Cited by 2,559
A comparison of observational studies and randomized, controlled trials.
Benson, K., & Hartz, A. J. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422506 · Cited by 2,347
Terwee, C. B., Mokkink, L. B., Knol, D. L., Ostelo, R. W. J. G., Bouter, L. M., & de Vet, H. C. W. (2012) · Quality of Life Research · doi:10.1007/s11136-011-9960-1 · Cited by 1,978
The PRECIS-2 tool: designing trials that are fit for purpose
Loudon, K., Treweek, S., Sullivan, F., Donnan, P., Thorpe, K. E., & Zwarenstein, M. (2015) · BMJ · doi:10.1136/bmj.h2147 · Cited by 1,846
Self-citationGlasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.8.1261 · Cited by 1,836
Michie, S., Johnston, M., Francis, J., Hardeman, W., & Eccles, M. (2008) · Applied Psychology · doi:10.1111/j.1464-0597.2008.00341.x · Cited by 1,789
Evaluating patient-based outcome measures for use in clinical trials.
Fitzpatrick, Davey, Buxton, & Jones (1998) · Health Technology Assessment · doi:10.3310/hta2140 · Cited by 1,715
Murray, E., Treweek, S., Pope, C., MacFarlane, A., Ballini, L., Dowrick, C., Finch, T., Kennedy, A., Mair, F., O'Donnell, C., et al. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-63 · Cited by 1,478
The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting
Hemming, K., Haines, T. P., Chilton, P. J., Girling, A. J., & Lilford, R. J. (2015) · BMJ · doi:10.1136/bmj.h391 · Cited by 1,410
Self-citationDevelopment of a theory of implementation and integration: Normalization Process Theory
May, C. R., Mair, F., Finch, T., MacFarlane, A., Dowrick, C., Treweek, S., Rapley, T., Ballini, L., Ong, B. N., Rogers, A., et al. (2009) · Implementation Science · doi:10.1186/1748-5908-4-29 · Cited by 1,409
Bridging Research and Practice
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.05.024 · Cited by 1,386
Latent Class Analysis: An Alternative Perspective on Subgroup Analysis in Prevention and Treatment
Lanza, S. T., & Rhoades, B. L. (2013) · Prevention Science · doi:10.1007/s11121-011-0201-1 · Cited by 1,255
An introduction to instrumental variables for epidemiologists
Greenland, S. (2000) · International Journal of Epidemiology · doi:10.1093/ije/29.4.722 · Cited by 1,156
Revisiting the Quantitative-Qualitative Debate: Implications for Mixed-Methods Research
Sale, J. E. M., Lohfeld, L. H., & Brazil, K. (2002) · Quality and Quantity · doi:10.1023/a:1014301607592 · Cited by 1,082
Specifying and reporting complex behaviour change interventions: the need for a scientific method
Michie, S., Fixsen, D., Grimshaw, J. M., & Eccles, M. P. (2009) · Implementation Science · doi:10.1186/1748-5908-4-40 · Cited by 976
Self-citationPreventing Child Abuse and Neglect: A Randomized Trial of Nurse Home Visitation
Olds, D. L., Henderson, C. R., Chamberlin, R., & Tatelbaum, R. (1986) · Pediatrics · doi:10.1542/peds.78.1.65 · Cited by 947
Comparison of Evidence of Treatment Effects in Randomized and Nonrandomized Studies
Ioannidis, J. P. A. (2001) · JAMA · doi:10.1001/jama.286.7.821 · Cited by 919
Eccles, M., Grimshaw, J., Walker, A., Johnston, M., & Pitts, N. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.09.002 · Cited by 917
Self-citationThe stepped wedge trial design: a systematic review
Brown, C. A., & Lilford, R. J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-54 · Cited by 907
Self-citationAlbarracín, D., Gillette, J. C., Earl, A. N., Glasman, L. R., Durantini, M. R., & Ho, M.-H. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.6.856 · Cited by 792
Demystifying theory and its use in improvement
Davidoff, F., Dixon-Woods, M., Leviton, L., & Michie, S. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2014-003627 · Cited by 714
Self-citationSocio-economic status of the patient and doctor–patient communication: does it make a difference?
Willems, S., De Maesschalck, S., Deveugele, M., Derese, A., & De Maeseneer, J. (2005) · Patient Education and Counseling · doi:10.1016/j.pec.2004.02.011 · Cited by 698
Lewin, S., Glenton, C., & Oxman, A. D. (2009) · BMJ · doi:10.1136/bmj.b3496 · Cited by 678
Towards a general theory of implementation
May, C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-18 · Cited by 656
What is missing from descriptions of treatment in trials and reviews?
Glasziou, P., Meats, E., Heneghan, C., & Shepperd, S. (2008) · BMJ · doi:10.1136/bmj.39590.732037.47 · Cited by 614
Impact of patient‐reported outcome measures on routine practice: a structured review
Marshall, S., Haywood, K., & Fitzpatrick, R. (2006) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2006.00650.x · Cited by 602
Self-citationKrumholz, H. M. (2014) · Health Affairs · doi:10.1377/hlthaff.2014.0053 · Cited by 589
Campbell, R., Starkey, F., Holliday, J., Audrey, S., Bloor, M., Parry-Langdon, N., Hughes, R., & Moore, L. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60692-3 · Cited by 583
Self-citationBonell, C., Fletcher, A., Morton, M., Lorenc, T., & Moore, L. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.08.032 · Cited by 582
Self-citationGrant, A., Treweek, S., Dreischulte, T., Foy, R., & Guthrie, B. (2013) · Trials · doi:10.1186/1745-6215-14-15 · Cited by 541
Self-citationAnglemyer, A., Horvath, H. T., & Bero, L. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000034.pub2 · Cited by 534
Di Maio, M., Gallo, C., Leighl, N. B., Piccirillo, M. C., Daniele, G., Nuzzo, F., Gridelli, C., Gebbia, V., Ciardiello, F., De Placido, S., et al. (2015) · Journal of Clinical Oncology · doi:10.1200/jco.2014.57.9334 · Cited by 497
Prenatal and infancy home visiting by nurses: From randomized trials to community replication
Olds, D. L. (2002) · Prevention Science · doi:10.1023/a:1019990432161 · Cited by 490
An implementation research agenda
Eccles, M. P., Armstrong, D., Baker, R., Cleary, K., Davies, H., Davies, S., Glasziou, P., Ilott, I., Kinmonth, A.-L., Leng, G., et al. (2009) · Implementation Science · doi:10.1186/1748-5908-4-18 · Cited by 481
Self-citationMarchal, B., van Belle, S., van Olmen, J., Hoerée, T., & Kegels, G. (2012) · Evaluation · doi:10.1177/1356389012442444 · Cited by 476
Systematic review automation technologies
Tsafnat, G., Glasziou, P., Choong, M. K., Dunn, A., Galgani, F., & Coiera, E. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-74 · Cited by 472
Mdege, N. D., Man, M.-S., Taylor (nee Brown), C. A., & Torgerson, D. J. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.12.003 · Cited by 425
Lyratzopoulos, G., Neal, R. D., Barbiere, J. M., Rubin, G. P., & Abel, G. A. (2012) · The Lancet Oncology · doi:10.1016/s1470-2045(12)70041-4 · Cited by 425
Sully, B. G. O., Julious, S. A., & Nicholl, J. (2013) · Trials · doi:10.1186/1745-6215-14-166 · Cited by 410
Ivers, N. M., Sales, A., Colquhoun, H., Michie, S., Foy, R., Francis, J. J., & Grimshaw, J. M. (2014) · Implementation Science · doi:10.1186/1748-5908-9-14 · Cited by 400
Self-citationMoullin, J. C., Sabater-Hernández, D., Fernandez-Llimos, F., & Benrimoj, S. I. (2015) · Health Research Policy and Systems · doi:10.1186/s12961-015-0005-z · Cited by 392
Designing theoretically-informed implementation interventions
The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG) (2006) · Implementation Science · doi:10.1186/1748-5908-1-4 · Cited by 380
How Do You Modernize a Health Service? A Realist Evaluation of Whole‐Scale Transformation in London
GREENHALGH, T., HUMPHREY, C., HUGHES, J., MACFARLANE, F., BUTLER, C., & PAWSON, R. (2009) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2009.00562.x · Cited by 380
Hoffmann, T. C., Erueti, C., & Glasziou, P. P. (2013) · BMJ · doi:10.1136/bmj.f3755 · Cited by 375
Emsley, R., Dunn, G., & White, I. R. (2010) · Statistical Methods in Medical Research · doi:10.1177/0962280209105014 · Cited by 356
Nuckols, T. K., Smith-Spangler, C., Morton, S. C., Asch, S. M., Patel, V. M., Anderson, L. J., Deichsel, E. L., & Shekelle, P. G. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-56 · Cited by 340
Meta-Analysis: Audit and Feedback Features Impact Effectiveness on Care Quality
Hysong, S. J. (2009) · Medical Care · doi:10.1097/mlr.0b013e3181893f6b · Cited by 306
Wells, M., Williams, B., Treweek, S., Coyle, J., & Taylor, J. (2012) · Trials · doi:10.1186/1745-6215-13-95 · Cited by 297
Explaining Matching Michigan: an ethnographic study of a patient safety program
Dixon-Woods, M., Leslie, M., Tarrant, C., & Bion, J. (2013) · Implementation Science · doi:10.1186/1748-5908-8-70 · Cited by 291
Self-citationCreating the Evidence Base for Quality Improvement Collaboratives
Mittman, B. S. (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-140-11-200406010-00011 · Cited by 279
Campbell, M. K., Fayers, P. M., & Grimshaw, J. M. (2005) · Clinical Trials · doi:10.1191/1740774505cn071oa · Cited by 275
Self-citationDonovan, J. L., Paramasivan, S., de Salis, I., & Toerien, M. (2014) · Trials · doi:10.1186/1745-6215-15-5 · Cited by 262
Strategies to improve retention in randomised trials: a Cochrane systematic review and meta-analysis
Brueton, V. C., Tierney, J. F., Stenning, S., Meredith, S., Harding, S., Nazareth, I., & Rait, G. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-003821 · Cited by 253
Cartwright, M., Hirani, S. P., Rixon, L., Beynon, M., Doll, H., Bower, P., Bardsley, M., Steventon, A., Knapp, M., Henderson, C., et al. (2013) · BMJ · doi:10.1136/bmj.f653 · Cited by 240
Self-citationClinical trials and rare diseases: A way out of a conundrum
Lilford, R. J., Thornton, J. G., & Braunholtz, D. (1995) · BMJ · doi:10.1136/bmj.311.7020.1621 · Cited by 237
Self-citationScott, S. D., Plotnikoff, R. C., Karunamuni, N., Bize, R., & Rodgers, W. (2008) · Implementation Science · doi:10.1186/1748-5908-3-41 · Cited by 217
Freemantle, N., Marston, L., Walters, K., Wood, J., Reynolds, M. R., & Petersen, I. (2013) · BMJ · doi:10.1136/bmj.f6409 · Cited by 211
Self-citationO’Cathain, A., Thomas, K. J., Drabble, S. J., Rudolph, A., Goode, J., & Hewison, J. (2014) · Health Technology Assessment · doi:10.3310/hta18380 · Cited by 159
Self-citationLilford, R. J., Chilton, P. J., Hemming, K., Girling, A. J., Taylor, C. A., & Barach, P. (2010) · BMJ · doi:10.1136/bmj.c4413 · Cited by 146
Self-citationPolisena, J., Garritty, C., Kamel, C., Stevens, A., & Abou-Setta, A. M. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0022-6 · Cited by 133
Vera-Badillo, F. E., Shapiro, R., Ocana, A., Amir, E., & Tannock, I. F. (2013) · Annals of Oncology · doi:10.1093/annonc/mds636 · Cited by 117
Takian, A., Petrakaki, D., Cornford, T., Sheikh, A., & Barber, N. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-105 · Cited by 51
Redfern, J., Rudd, A. D., Wolfe, C. D. A., & McKevitt, C. (2008) · Patient Education and Counseling · doi:10.1016/j.pec.2008.03.006 · Cited by 34
Cited by
Tuckson, R. V., Edmunds, M., & Hodgkins, M. L. (2017) · New England Journal of Medicine · doi:10.1056/nejmsr1503323 · Cited by 907
Cervical cancer in low and middle‑income countries (Review)
Hull, R., Mbele, M., Makhafola, T., Hicks, C., Wang, S., Reis, R., Mehrotra, R., Mkhize‑Kwitshana, Z., Kibiki, G., Bates, D., et al. (2020) · Oncology Letters · doi:10.3892/ol.2020.11754 · Cited by 544
Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K. A., Craig, N., French, D. P., McIntosh, E., et al. (2021) · Health Technology Assessment · doi:10.3310/hta25570 · Cited by 522
Self-citationNoyes, J., Booth, A., Moore, G., Flemming, K., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000893 · Cited by 497
Self-citationSynthesising quantitative evidence in systematic reviews of complex health interventions
Higgins, J. P. T., López-López, J. A., Becker, B. J., Davies, S. R., Dawson, S., Grimshaw, J. M., McGuinness, L. A., Moore, T. H. M., Rehfuess, E. A., Thomas, J., et al. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000858 · Cited by 322
Self-citation
Metadata
- Authors
- Raine, R., Fitzpatrick, R., Barratt, H., Bevan, G., Black, N., Boaden, R., Bower, P., Campbell, M., Denis, J.-L., Devers, K., Dixon-Woods, M., Fallowfield, L., Forder, J., Foy, R., Freemantle, N., Fulop, N. J., Gibbons, E., Gillies, C., Goulding, L., Grieve, R., Grimshaw, J., Howarth, E., Lilford, R. J., McDonald, R., Moore, G., Moore, L., Newhouse, R., O’Cathain, A., Or, Z., Papoutsi, C., Prady, S., Rycroft-Malone, J., Sekhon, J., Turner, S., Watson, S. I., & Zwarenstein, M.
- Venue
- Health Services and Delivery Research
- Published
- 2016-05
- Volume
- 4
- Issue
- 16
- Pages
- 1-136
- ISSN
- 2050-4349 (ISSN-L)
- 2050-4357
- OpenAlex
- W2405537375
- Cited by
- 186
- References
- 87
- FWCI
- 23.36
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.