Improving the normalization of complex interventions: measure development based on normalization process theory (NoMAD): study protocol
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Understanding implementation processes is key to ensuring that complex interventions in healthcare are taken up in practice and thus maximize intended benefits for service provision and (ultimately) care to patients. Normalization Process Theory (NPT) provides a framework for understanding how a new intervention becomes part of normal practice. This study aims to develop and validate simple generic tools derived from NPT, to be used to improve the implementation of complex healthcare interventions. OBJECTIVES: The objectives of this study are to: develop a set of NPT-based measures and formatively evaluate their use for identifying implementation problems and monitoring progress; conduct preliminary evaluation of these measures across a range of interventions and contexts, and identify factors that affect this process; explore the utility of these measures for predicting outcomes; and develop an online users' manual for the measures. METHODS: A combination of qualitative (workshops, item development, user feedback, cognitive interviews) and quantitative (survey) methods will be used to develop NPT measures, and test the utility of the measures in six healthcare intervention settings. DISCUSSION: The measures developed in the study will be available for use by those involved in planning, implementing, and evaluating complex interventions in healthcare and have the potential to enhance the chances of their implementation, leading to sustained changes in working practices.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“From this, tools were developed to assist implementation practitioners and researchers [13–16] in thinking through and measuring important elements of implementation processes.”
From Using Normalization Process Theory in feasibility studies and process evaluations of complex healthcare interventions: a systematic review (2018) · cites this paper as [14]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
Implementing, Embedding, and Integrating Practices: An Outline of Normalization Process Theory
May, C., & Finch, T. (2009) · Sociology · doi:10.1177/0038038509103208 · Cited by 2,115
Self-citationCognitive Interviewing: A Tool for Improving Questionnaire Design
Willis, G. (2004) · Cited by 1,934
The Meaning of Translational Research and Why It Matters
Woolf, S. H. (2008) · JAMA · doi:10.1001/jama.2007.26 · Cited by 1,910 · cited 1×
“The gap between research evidence and practice remains wide, and concerns about the large numbers of ‘pilot’ studies of new interventions—particularly those involving new technology—that never lead to sustainable services are repeatedly expressed [4].”
BackgroundWillis, G. (2005) · doi:10.4135/9781412983655 · Cited by 1,778
Murray, E., Treweek, S., Pope, C., MacFarlane, A., Ballini, L., Dowrick, C., Finch, T., Kennedy, A., Mair, F., O'Donnell, C., et al. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-63 · Cited by 1,478
Self-citationDevelopment of a theory of implementation and integration: Normalization Process Theory
May, C. R., Mair, F., Finch, T., MacFarlane, A., Dowrick, C., Treweek, S., Rapley, T., Ballini, L., Ong, B. N., Rogers, A., et al. (2009) · Implementation Science · doi:10.1186/1748-5908-4-29 · Cited by 1,409 · cited 1×
“NPT [10-14] is concerned with the generative processes that underpin three core problems: implementation (bringing a practice or practices into action); embedding, (when a practice or practices may be routinely incorporated in everyday work of individuals and groups); and integration (when a practice or practices are…”
BackgroundSelf-citation(2004) · City Research Online (City University London) · Cited by 1,385
Methods to increase response to postal and electronic questionnaires
Edwards, P. J., Roberts, I., Clarke, M. J., DiGuiseppi, C., Wentz, R., Kwan, I., Cooper, R., Felix, L. M., & Pratap, S. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000008.pub4 · Cited by 1,379 · cited 1×
“At each site, surveys will be conducted using a variety of approaches (including electronic and paper-based) that are chosen to allow the best chance of maximizing response rates [32].”
BackgroundPlanning and Studying Improvement in Patient Care: The Use of Theoretical Perspectives
GROL, R. P. T. M., BOSCH, M. C., HULSCHER, M. E. J. L., ECCLES, M. P., & WENSING, M. (2007) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2007.00478.x · Cited by 943 · cited 1×
“This problem has been explored from a number of theoretical perspectives, including those that emphasize attitudes and behaviours [5]; or diffusion and adoption of innovations through social networks [6] as well as approaches from Science and Technology Studies (STS) [7] that emphasize technology design and its relati…”
BackgroundA Prospective and Retrospective Look at the Diffusion Model
ROGERS, E. M. (2004) · Journal of Health Communication · doi:10.1080/10810730490271449 · Cited by 769 · cited 1×
“These perspectives have offered important insights but have been difficult to apply prospectively and quantitatively [8].”
BackgroundMay, C., Finch, T., Mair, F., Ballini, L., Dowrick, C., Eccles, M., Gask, L., MacFarlane, A., Murray, E., Rapley, T., et al. (2007) · BMC Health Services Research · doi:10.1186/1472-6963-7-148 · Cited by 768 · cited 1×
“NPT [10-14] is concerned with the generative processes that underpin three core problems: implementation (bringing a practice or practices into action); embedding, (when a practice or practices may be routinely incorporated in everyday work of individuals and groups); and integration (when a practice or practices are…”
Self-citationStewart, D. W., Schwarz, N., & Sudman, S. (1996) · Journal of Marketing Research · doi:10.2307/3152152 · Cited by 691
Mair, F. S., May, C., O’Donnell, C., Finch, T., Sullivan, F., & Murray, E. (2012) · Bulletin of the World Health Organization · doi:10.2471/blt.11.099424 · Cited by 553 · cited 1×
“These have included, inter alia, the implementation of ehealth systems in the UK [15-17], the redesign of primary care mental health services in Victoria, Australia [18], the development and application of decision-support tools in the Mayo Clinic Health care system [19], and evidence about their utilization in the wi…”
BackgroundSelf-citationA rational model for assessing and evaluating complex interventions in health care
May, C. (2006) · BMC Health Services Research · doi:10.1186/1472-6963-6-86 · Cited by 447 · cited 1×
“NPT [10-14] is concerned with the generative processes that underpin three core problems: implementation (bringing a practice or practices into action); embedding, (when a practice or practices may be routinely incorporated in everyday work of individuals and groups); and integration (when a practice or practices are…”
BackgroundSelf-citationGallacher, K., May, C. R., Montori, V. M., & Mair, F. S. (2011) · The Annals of Family Medicine · doi:10.1370/afm.1249 · Cited by 356 · cited 1×
“The potential for NPT to have far-reaching impact on academic and applied activity to improve the development of complex interventions that are well-placed to become effectively normalized in practice is evident, as demonstrated by the increasing volume of published research that has utilized NPT as a framework for ev…”
BackgroundSelf-citationThe challenges faced in the design, conduct and analysis of surgical randomised controlled trials
Cook, J. A. (2009) · Trials · doi:10.1186/1745-6215-10-9 · Cited by 351
The analysis and interpretation of cognitive interviews for instrument development
Knafl, K., Deatrick, J., Gallo, A., Holcombe, G., Bakitas, M., Dixon, J., & Grey, M. (2007) · Research in Nursing & Health · doi:10.1002/nur.20195 · Cited by 341 · cited 1×
“Qualitative analysis [31] of participants’ responses will enable us to add new items, revise existing ones, and drop those that they consider redundant or lacking face validity.”
BackgroundWhy is it difficult to implement e-health initiatives? A qualitative study
Murray, E., Burns, J., May, C., Finch, T., O'Donnell, C., Wallace, P., & Mair, F. (2011) · Implementation Science · doi:10.1186/1748-5908-6-6 · Cited by 270 · cited 1×
“The potential for NPT to have far-reaching impact on academic and applied activity to improve the development of complex interventions that are well-placed to become effectively normalized in practice is evident, as demonstrated by the increasing volume of published research that has utilized NPT as a framework for ev…”
BackgroundSelf-citationMay, C. R., Finch, T. L., Ballini, L., MacFarlane, A. E., Mair, F. S., Murray, E. M., Treweek, S., & Rapley, T. (2011) · Arrow@dit (Dublin Institute of Technology) · doi:10.34961/10032 · Cited by 235
Self-citationUsing a Theory-Driven Conceptual Framework in Qualitative Health Research
MacFarlane, A., & O’Reilly-de Brún, M. (2012) · Qualitative Health Research · doi:10.1177/1049732311431898 · Cited by 227
Resisting Evidence: The Study of Evidence-Based Medicine as a Contemporary Social Movement
Pope, C. (2003) · Health: An Interdisciplinary Journal for the Social Study of Health, Illness and Medicine · doi:10.1177/1363459303007003002 · Cited by 220
Integrating telecare for chronic disease management in the community: What needs to be done?
May, C. R., Finch, T. L., Cornford, J., Exley, C., Gately, C., Kirk, S., Jenkings, K. N., Osbourne, J., Robinson, A. L., Rogers, A., et al. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-131 · Cited by 220 · cited 1×
“These have included, inter alia, the implementation of ehealth systems in the UK [15-17], the redesign of primary care mental health services in Victoria, Australia [18], the development and application of decision-support tools in the Mayo Clinic Health care system [19], and evidence about their utilization in the wi…”
BackgroundSelf-citationMay, C. R., Mair, F. S., Dowrick, C. F., & Finch, T. L. (2007) · BMC Family Practice · doi:10.1186/1471-2296-8-42 · Cited by 183 · cited 1×
“NPT [10-14] is concerned with the generative processes that underpin three core problems: implementation (bringing a practice or practices into action); embedding, (when a practice or practices may be routinely incorporated in everyday work of individuals and groups); and integration (when a practice or practices are…”
Self-citationElwyn, G., Légaré, F., Weijden, T. V. D., Edwards, A., & May, C. (2008) · Implementation Science · doi:10.1186/1748-5908-3-57 · Cited by 159 · cited 1×
“The potential for NPT to have far-reaching impact on academic and applied activity to improve the development of complex interventions that are well-placed to become effectively normalized in practice is evident, as demonstrated by the increasing volume of published research that has utilized NPT as a framework for ev…”
BackgroundSelf-citationFoy, R., Ovretveit, J., Shekelle, P. G., Pronovost, P. J., Taylor, S. L., Dy, S., Hempel, S., McDonald, K. M., Rubenstein, L. V., & Wachter, R. M. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.047993 · Cited by 148 · cited 1×
“The potential for NPT to have far-reaching impact on academic and applied activity to improve the development of complex interventions that are well-placed to become effectively normalized in practice is evident, as demonstrated by the increasing volume of published research that has utilized NPT as a framework for ev…”
BackgroundTaylor, E. L. (2013) · Research World · doi:10.1002/rwm3.20033 · Cited by 144
Rogers, A., Vassilev, I., Sanders, C., Kirk, S., Chew-Graham, C., Kennedy, A., Protheroe, J., Bower, P., Blickem, C., Reeves, D., et al. (2011) · Implementation Science · doi:10.1186/1748-5908-6-56 · Cited by 129
Finch, T. L., Mair, F. S., O’Donnell, C., Murray, E., & May, C. R. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-69 · Cited by 127 · cited 2×
“This highlighted important issues concerning the framing of questions and response scales, and the challenges of multiple stakeholder assessments (and requirements for specification and tailoring as appropriate to stakeholder groups) [21].”
BackgroundSelf-citationUnderstanding factors that inhibit or promote the utilization of telecare in chronic lung disease
Mair, F. S., Hiscock, J., & Beaton, S. C. (2008) · Chronic Illness · doi:10.1177/1742395308092482 · Cited by 115 · cited 1×
“The potential for NPT to have far-reaching impact on academic and applied activity to improve the development of complex interventions that are well-placed to become effectively normalized in practice is evident, as demonstrated by the increasing volume of published research that has utilized NPT as a framework for ev…”
BackgroundSelf-citationImplementing a stepped-care approach in primary care: results of a qualitative study
Franx, G., Oud, M., de Lange, J., Wensing, M., & Grol, R. (2012) · Implementation Science · doi:10.1186/1748-5908-7-8 · Cited by 106 · cited 1×
“The potential for NPT to have far-reaching impact on academic and applied activity to improve the development of complex interventions that are well-placed to become effectively normalized in practice is evident, as demonstrated by the increasing volume of published research that has utilized NPT as a framework for ev…”
BackgroundDevelopment and formative evaluation of the e-Health Implementation Toolkit (e-HIT)
Murray, E., May, C., & Mair, F. (2010) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-10-61 · Cited by 96 · cited 1×
“constructs into structured instruments has already been conducted [16,21,22].”
BackgroundSelf-citationBlakeman, T., Protheroe, J., Chew-Graham, C., Rogers, A., & Kennedy, A. (2012) · British Journal of General Practice · doi:10.3399/bjgp12x636056 · Cited by 96 · cited 1×
“The potential for NPT to have far-reaching impact on academic and applied activity to improve the development of complex interventions that are well-placed to become effectively normalized in practice is evident, as demonstrated by the increasing volume of published research that has utilized NPT as a framework for ev…”
BackgroundSanders, T., Foster, N. E., & Ong, B. N. (2011) · BMC Medicine · doi:10.1186/1741-7015-9-49 · Cited by 84 · cited 1×
“The potential for NPT to have far-reaching impact on academic and applied activity to improve the development of complex interventions that are well-placed to become effectively normalized in practice is evident, as demonstrated by the increasing volume of published research that has utilized NPT as a framework for ev…”
BackgroundUnderstanding the implementation and integration of e-health services
Mair, F. S., May, C., Finch, T., Murray, E., Anderson, G., Sullivan, F., O'donnell, C., Wallace, P., & Epstein, O. (2007) · Journal of Telemedicine and Telecare · doi:10.1258/135763307781645112 · Cited by 82
Self-citationPresseau, J., Sniehotta, F. F., Francis, J. J., & Campbell, N. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-77 · Cited by 77
Embedding effective depression care: using theory for primary care organisational and systems change
Gunn, J. M., Palmer, V. J., Dowrick, C. F., Herrman, H. E., Griffiths, F. E., Kokanovic, R., Blashki, G. A., Hegarty, K. L., Johnson, C. L., Potiriadis, M., et al. (2010) · Implementation Science · doi:10.1186/1748-5908-5-62 · Cited by 76
Self-citationExploring implementation and sustainability of models of care: can theory help?
Forster, D. A., Newton, M., McLachlan, H. L., & Willis, K. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-s5-s8 · Cited by 75
Gask, L., Bower, P., Lovell, K., Escott, D., Archer, J., Gilbody, S., Lankshear, A. J., Simpson, A. E., & Richards, D. A. (2010) · Implementation Science · doi:10.1186/1748-5908-5-15 · Cited by 75 · cited 1×
“The potential for NPT to have far-reaching impact on academic and applied activity to improve the development of complex interventions that are well-placed to become effectively normalized in practice is evident, as demonstrated by the increasing volume of published research that has utilized NPT as a framework for ev…”
BackgroundA coding system for appraising questionnaires.
Lessler, J. T., & Forsyth, B. (1996) · Cited by 68
Kennedy, A., Chew-Graham, C., Blakeman, T., Bowen, A., Gardner, C., Protheroe, J., Rogers, A., & Gask, L. (2010) · Implementation Science · doi:10.1186/1748-5908-5-7 · Cited by 66 · cited 1×
“The potential for NPT to have far-reaching impact on academic and applied activity to improve the development of complex interventions that are well-placed to become effectively normalized in practice is evident, as demonstrated by the increasing volume of published research that has utilized NPT as a framework for ev…”
BackgroundThe Diffusion of Telemedicine: Communicating an Innovation
WHITTEN, P., & COLLINS, B. (1997) · Science Communication · doi:10.1177/1075547097019001002 · Cited by 61
Health, Technology and Society
Webster, A. (2007) · doi:10.1007/978-1-137-09593-0 · Cited by 61
QUAID: A questionnaire evaluation aid for survey methodologists
Graesser, A. C., Wiemer-Hastings, K., Kreuz, R. J., Hastings, P., & Marquis, K. H. (2000) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03207792 · Cited by 55 · cited 1×
“This will include a process of developing a group of items that represent and build upon the original four constructs, vigorously testing them through ongoing feedback and refinement within the core research group, and systematically evaluating items utilizing, for example, the Questionnaire Appraisal System (QAS-99)…”
MethodBeyond the limits of clinical governance? The case of mental health in English primary care
Gask, L., Rogers, A., Campbell, S., & Sheaff, R. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-63 · Cited by 55 · cited 1×
“The potential for NPT to have far-reaching impact on academic and applied activity to improve the development of complex interventions that are well-placed to become effectively normalized in practice is evident, as demonstrated by the increasing volume of published research that has utilized NPT as a framework for ev…”
BackgroundSnyder, R. A., & Fields, W. L. (2006) · Journal of Nursing Measurement · doi:10.1891/jnum.14.1.45 · Cited by 47 · cited 1×
“Although a small number of instruments to assess ‘readiness’ for technology-based interventions in healthcare already exists [26], they are limited in scope, and do not explicitly focus on assessing processes relevant to interventions becoming embedded in routine practice.”
BackgroundMacFarlane, A., O’Donnell, C., Mair, F., O’Reilly-de Brún, M., de Brún, T., Spiegel, W., van den Muijsenbergh, M., van Weel-Baumgarten, E., Lionis, C., Burns, N., et al. (2012) · Implementation Science · doi:10.1186/1748-5908-7-111 · Cited by 47 · cited 1×
“An important source of the evident international interest in NPT has been its potential to be used prospectively and quantitatively rather than being confined to descriptive post hoc analysis of specific case studies [25].”
BackgroundSelf-citationPencille, L. J., Campbell, M. E., Houten, H. K. V., Shah, N. D., Mullan, R. J., Swiglo, B. A., Breslin, M., Kesman, R. L., Tulledge‐Scheitel, S. M., Jaeger, T. M., et al. (2009) · Trials · doi:10.1186/1745-6215-10-113 · Cited by 43 · cited 1×
“These have included, inter alia, the implementation of ehealth systems in the UK [15-17], the redesign of primary care mental health services in Victoria, Australia [18], the development and application of decision-support tools in the Mayo Clinic Health care system [19], and evidence about their utilization in the wi…”
BackgroundHealth, technology and society : a sociological critique
Webster, A. (2007) · Palgrave Macmillan eBooks · Cited by 42
Atkins, S., Lewin, S., Ringsberg, K. C., & Thorson, A. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-275 · Cited by 42 · cited 1×
“The potential for NPT to have far-reaching impact on academic and applied activity to improve the development of complex interventions that are well-placed to become effectively normalized in practice is evident, as demonstrated by the increasing volume of published research that has utilized NPT as a framework for ev…”
BackgroundTHE ‘HEALTHCARE STATE’ IN TRANSITION
Kuhlmann, E., & Burau, V. (2008) · European Societies · doi:10.1080/14616690701871886 · Cited by 42
James, D. M. (2011) · Implementation Science · doi:10.1186/1748-5908-6-95 · Cited by 22 · cited 1×
“The potential for NPT to have far-reaching impact on academic and applied activity to improve the development of complex interventions that are well-placed to become effectively normalized in practice is evident, as demonstrated by the increasing volume of published research that has utilized NPT as a framework for ev…”
BackgroundInformation systems development: a normalisation process theory perspective
Sooklal, R., Papadopoulos, T., & Ojiako, U. (2011) · Industrial Management & Data Systems · doi:10.1108/02635571111170794 · Cited by 17 · cited 1×
“The potential for NPT to have far-reaching impact on academic and applied activity to improve the development of complex interventions that are well-placed to become effectively normalized in practice is evident, as demonstrated by the increasing volume of published research that has utilized NPT as a framework for ev…”
BackgroundProcess evaluation of infertility management in primary care: has open access HSG been normalized?
Wilkes, S., & Rubin, G. (2009) · Primary Health Care Research & Development · doi:10.1017/s1463423609990168 · Cited by 10
Gunn, J. M., Kokanović, R., Palmer, V. J., Potiriadis, M., Johnson, C., Johnston‐Ataata, K., Dowrick, C. F., Griffiths, F. E., Hegarty, K. L., Herrman, H., et al. (2008) · ANU Open Research (Australian National University) · doi:10.82444/warw.33612523 · Cited by 7
Self-citationMay, C. R., Finch, T., Ballini, L., MacFarlane, A., Mair, F., Murray, E., Treweek, S., & Rapley, T. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-245 · Cited by 3 · cited 3×
“In a previous project [23], we have undertaken work that has given us the basis for a set of generic statements for each of the constructs of NPT.”
BackgroundMethodInfluentialSelf-citation
Research works printed but not linked: 3
- Willis GB Lessler JT Guidelines for designing and evaluating questionnaires 1999 Rockville, MD: Research Triangle Institute
- Nunnally JC Pyschometric Theory. 2nd Edition ed 1978 New York: McGraw-Hill
- Elwyn G Légaré F Weijden T Arduous implementation: does the normalisation process model explain why it’s so difficult to embed decision support technologies for patients in routine clinical practice Implement Sci 2008 3 1 57 10.1186/1748-5908-3-57 19117509 PMC2631595 · DOI · Paper page
Cited by
Making sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447
“The model was subsequently expanded upon and developed into a theory as change mechanisms and interrelations between various constructs were delineated [122].”
May, C. R., Cummings, A., Girling, M., Bracher, M., Mair, F. S., May, C. M., Murray, E., Myall, M., Rapley, T., & Finch, T. (2018) · Implementation Science · doi:10.1186/s13012-018-0758-1 · Cited by 683
Self-citationFinch, T. L., Girling, M., May, C. R., Mair, F. S., Murray, E., Treweek, S., McColl, E., Steen, I. N., Cook, C., Vernazza, C. R., et al. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0591-x · Cited by 337
Self-citationMaking Sense of Implementation Theories, Models, and Frameworks
Nilsen, P. (2020) · Implementation Science 3.0 · doi:10.1007/978-3-030-03874-8_3 · Cited by 322
May, C. R., Albers, B., Bracher, M., Finch, T. L., Gilbert, A., Girling, M., Greenwood, K., MacFarlane, A., Mair, F. S., May, C. M., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01191-x · Cited by 234
Self-citation
Metadata
- Authors
- Finch, T. L., Rapley, T., Girling, M., Mair, F. S., Murray, E., Treweek, S., McColl, E., Steen, I. N., & May, C. R.
- Affiliations
- Newcastle University (GB)
- University of Glasgow (GB)
- The Royal Free Hospital (GB)
- University of Aberdeen (GB)
- University of Southampton (GB)
- Corresponding author
- Finch, Tracy L
- ORCID
- Venue
- Implementation Science
- Published
- 2013-04-11
- Volume
- 8
- Issue
- 1
- Pages
- 43-43
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC3637119
- OpenAlex
- W2167454129
- Cited by
- 177
- References
- 56
- Citations by year
- 2026: 8 · 2025: 12 · 2024: 15 · 2023: 17 · 2022: 26 · 2021: 15 · 2020: 25 · 2019: 15 · 2018: 20 · 2017: 10 · 2016: 10 · 2015: 4
- FWCI
- 8.45
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion)
- Northumbria Research Link (Northumbria University) (acceptedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
- ePrints Soton (University of Southampton) (submittedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity) (cc-by)
- Funders
- Economic and Social Research Council (RES-062-23-, ES/I037342/1, RES‐062‐23‐3274)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- complex interventions, Normalization Process Theory, implementation measures, measurement development, implementation problems, implementation monitoring, healthcare implementation, implementation outcomes, user feedback, cognitive interviewing
- MeSH terms
- Data Collection, Delivery of Health Care, Diffusion of Innovation, Health Services Research, Humans, Psychometrics, Program Evaluation, Program Development, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.