From theory to 'measurement' in complex interventions: Methodological lessons from the development of an e-health normalisation instrument
Open accessThe DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Although empirical and theoretical understanding of processes of implementation in health care is advancing, translation of theory into structured measures that capture the complex interplay between interventions, individuals and context remain limited. This paper aimed to (1) describe the process and outcome of a project to develop a theory-based instrument for measuring implementation processes relating to e-health interventions; and (2) identify key issues and methodological challenges for advancing work in this field. METHODS: A 30-item instrument (Technology Adoption Readiness Scale (TARS)) for measuring normalisation processes in the context of e-health service interventions was developed on the basis on Normalization Process Theory (NPT). NPT focuses on how new practices become routinely embedded within social contexts. The instrument was pre-tested in two health care settings in which e-health (electronic facilitation of healthcare decision-making and practice) was used by health care professionals. RESULTS: The developed instrument was pre-tested in two professional samples (N=46; N=231). Ratings of items representing normalisation 'processes' were significantly related to staff members' perceptions of whether or not e-health had become 'routine'. Key methodological challenges are discussed in relation to: translating multi-component theoretical constructs into simple questions; developing and choosing appropriate outcome measures; conducting multiple-stakeholder assessments; instrument and question framing; and more general issues for instrument development in practice contexts. CONCLUSIONS: To develop theory-derived measures of implementation process for progressing research in this field, four key recommendations are made relating to (1) greater attention to underlying theoretical assumptions and extent of translation work required; (2) the need for appropriate but flexible approaches to outcomes measurement; (3) representation of multiple perspectives and collaborative nature of work; and (4) emphasis on generic measurement approaches that can be flexibly tailored to particular contexts of study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“From this, tools were developed to assist implementation practitioners and researchers [13–16] in thinking through and measuring important elements of implementation processes.”
From Using Normalization Process Theory in feasibility studies and process evaluations of complex healthcare interventions: a systematic review (2018) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · cited 2×
“There is a vast literature on implementation in service organisations [2], however efforts at implementing new technologies and practices remain problematic.”
BackgroundFrom best evidence to best practice: effective implementation of change in patients' care
Grol, R., & Grimshaw, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14546-1 · Cited by 4,531
Why do people use information technology? A critical review of the technology acceptance model
Legris, P., Ingham, J., & Collerette, P. (2003) · Information & Management · doi:10.1016/s0378-7206(01)00143-4 · Cited by 4,250
Making psychological theory useful for implementing evidence based practice: a consensus approach
Michie, S. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.011155 · Cited by 3,440 · cited 2×
“Drawing on psychological theories of behaviour, Michie and colleagues [17] explicitly set out to develop theory-based explanations of factors that affect professional practice in a format that would be accessible to non-academic users, and associated work has included guidance for designing questionnaires based on the…”
BackgroundEffectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044
Implementing, Embedding, and Integrating Practices: An Outline of Normalization Process Theory
May, C., & Finch, T. (2009) · Sociology · doi:10.1177/0038038509103208 · Cited by 2,115
Self-citationMurray, E., Treweek, S., Pope, C., MacFarlane, A., Ballini, L., Dowrick, C., Finch, T., Kennedy, A., Mair, F., O'Donnell, C., et al. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-63 · Cited by 1,478
Self-citationDevelopment of a theory of implementation and integration: Normalization Process Theory
May, C. R., Mair, F., Finch, T., MacFarlane, A., Dowrick, C., Treweek, S., Rapley, T., Ballini, L., Ong, B. N., Rogers, A., et al. (2009) · Implementation Science · doi:10.1186/1748-5908-4-29 · Cited by 1,409 · cited 1×
“The development of NPT [37] focused on addressing two key criteria for theory to be ‘useful’: that it must be both adequately described and fit for purpose.”
Self-citation(2004) · City Research Online (City University London) · Cited by 1,385
Planning and Studying Improvement in Patient Care: The Use of Theoretical Perspectives
GROL, R. P. T. M., BOSCH, M. C., HULSCHER, M. E. J. L., ECCLES, M. P., & WENSING, M. (2007) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2007.00478.x · Cited by 943 · cited 4×
“In attempting to address such problems of implementation, the application of theory to designing health care interventions [7], planning and evaluating them [8] [9,10], and developing effective strategies for their implementation [11] offers much potential.”
BackgroundResultInfluential
Research works printed but not linked: 4
- May C, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, Rapley T, Ballini L, Ong BN, Rogers A, Murray E, Elwyn G, Légaré F, Gunn J, Montori V: Development of a theory of implementation and integration: Normalization Process Theory. Implement Sci. 2009, 4:
- Hechter M, Horne C: Theory is explanation. In Theories of Social Order. Edited by: Hechter M, Horne C. 2003, Stanford, CA: Stanford University Press, 3-8.
- Turner J: Analytical Theorizing. In Social Theory Today. Edited by: Giddens A, Turner J. 1987, Cambridge: Polity Press, 156-194.
- Mair F, May C, Murray E, Finch T, Anderson G, O’Donnell C, Wallace P, Sullivan F: Understanding the Implementation and Integration of E-Health Services. 2009, London: National Co-ordinating Centre for the National Institute for Health Research Service Delivery and Organisation Programme (NCCSDO)
Cited by
May, C. R., Cummings, A., Girling, M., Bracher, M., Mair, F. S., May, C. M., Murray, E., Myall, M., Rapley, T., & Finch, T. (2018) · Implementation Science · doi:10.1186/s13012-018-0758-1 · Cited by 683
Self-citationTowards a general theory of implementation
May, C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-18 · Cited by 656
“that are multidimensional and multifactorial, but which are amena bl to empirical investigation and measurement [90].”
BackgroundSelf-citationLennox, L., Maher, L., & Reed, J. (2018) · Implementation Science · doi:10.1186/s13012-017-0707-4 · Cited by 421
“[84] 2012 Technology Adoption Readiness Scale (TARS) To contribute to the successful normalisation of e-health, either as a ‘diagnostic’ tool or for evaluation purposes”
MethodMcEvoy, R., Ballini, L., Maltoni, S., O’Donnell, C. A., Mair, F. S., & MacFarlane, A. (2014) · Implementation Science · doi:10.1186/1748-5908-9-2 · Cited by 413
“[15], the theory has been developed to offer transparent and transferable explanations for”
InfluentialSelf-citationFinch, T. L., Girling, M., May, C. R., Mair, F. S., Murray, E., Treweek, S., McColl, E., Steen, I. N., Cook, C., Vernazza, C. R., et al. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0591-x · Cited by 337
Self-citation
Metadata
- Authors
- Finch, T. L., Mair, F. S., O’Donnell, C., Murray, E., & May, C. R.
- Affiliations
- Newcastle University (GB)
- University of Glasgow (GB)
- The Royal Free Hospital (GB)
- University of Southampton (GB)
- Corresponding author
- Finch, Tracy L
- Venue
- BMC Medical Research Methodology
- Published
- 2012-05-17
- Volume
- 12
- Issue
- 1
- Pages
- 69-69
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC3473304
- OpenAlex
- W2126407252
- Cited by
- 127
- References
- 48
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 12 · 2023: 8 · 2022: 21 · 2021: 9 · 2020: 11 · 2019: 7 · 2018: 13 · 2017: 11 · 2016: 5 · 2015: 5 · 2014: 8 · 2013: 7 · 2012: 2
- FWCI
- 12.49
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/2.0 (tdm)
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Northumbria Research Link (Northumbria University) (acceptedVersion, other-oa)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity) (cc-by)
- Funders
- National Institute for Health and Care Research
- NIHR Evaluation Trials and Studies Coordinating Centre
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- digital health interventions, implementation process, Normalization Process Theory, instrument development, healthcare workers, question framing, complex interventions
- MeSH terms
- Delivery of Health Care, Diffusion of Innovation, Health Services Research, Humans, Models, Theoretical, Outcome and Process Assessment, Health Care, Technology Assessment, Biomedical, User-Computer Interface, Telemedicine, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: From theory to 'measurement' in complex interventions: Methodological lessons from the development of an e-health normalisation instrument. https://app.cochat.ai/papers/10.1186/1471-2288-12-69
- The paper
- Finch, T. L., Mair, F. S., O’Donnell, C., Murray, E., & May, C. R. (2012). From theory to 'measurement' in complex interventions: Methodological lessons from the development of an e-health normalisation instrument. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-12-69
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.