CoChat

The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.

Evaluating complex interventions and health technologies using normalization process theory: development of a simplified approach and web-enabled toolkit

Open access

Abstract

Background: Normalization Process Theory (NPT) can be used to explain implementation processes in health care relating to new technologies and complex interventions. This paper describes the processes by which we developed a simplified version of NPT for use by clinicians, managers, and policy makers, and which could be embedded in a web-enabled toolkit and on-line users manual. Methods: Between 2006 and 2010 we undertook four tasks. (i) We presented NPT to potential and actual users in multiple workshops, seminars, and presentations. (ii) Using what we discovered from these meetings, we decided to create a simplified set of statements and explanations expressing core constructs of the theory (iii) We circulated these statements to a criterion sample of 60 researchers, clinicians and others, using SurveyMonkey to collect qualitative textual data about their criticisms of the statements. (iv) We then reconstructed the statements and explanations to meet users' criticisms, embedded them in a web-enabled toolkit, and beta tested this 'in the wild'. Results: On-line data collection was effective: over a four week period 50/60 participants responded using SurveyMonkey (40/60) or direct phone and email contact (10/60). An additional nine responses were received from people who had been sent the SurveyMonkey form by other respondents. Beta testing of the web enabled toolkit produced 13 responses, from 327 visits to http://www.normalizationprocess.org. Qualitative analysis of both sets of responses showed a high level of support for the statements but also showed that some statements poorly expressed their underlying constructs or overlapped with others. These were rewritten to take account of users' criticisms and then embedded in a web-enabled toolkit. As a result we were able translate the core constructs into a simplified set of statements that could be utilized by non-experts. Conclusion: Normalization Process Theory has been developed through transparent procedures at each stage of its life. The theory has been shown to be sufficiently robust to merit formal testing. This project has provided a user friendly version of NPT that can be embedded in a web-enabled toolkit and used as a heuristic device to think through implementation and integration problems.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/1472-6963-11-245

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 NPT Toolkit - Web-interface - Sliding Toolbar.
Figure 1 NPT Toolkit - Web-interface - Sliding Toolbar.CC BY · PubMed Central
Figure 2 NPT Toolkit - Reporting page - Individual Radar Plots for each Construct.
Figure 2 NPT Toolkit - Reporting page - Individual Radar Plots for each Construct.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 35 references

Research works printed but not linked: 10

  1. Angus D, Brouwers M, Driedger M, Eccles M, Francis J, Godin G, Graham I, Grimshaw J, Hanna S, Harrison MB, et al: Designing theoretically-informed implementation interventions The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG). Implement Sci. 2006, 1.
  2. Goldthorpe JH: On Sociology: Critique and Program. 2006, Stanford: Stanford University Press
  3. Hechter M, Horne C: Theory is explanation. Theories of social order. Edited by: Hechter M, Horne C. 2003, Stanford CA, Stanford University Press
  4. Rogers EM: The Diffusion of Innovations. 1995, New York: Free Press, 4
  5. Gagnon MP, Legare F, Fortin JP, Lamothe L, Labrecque M, Duplantie J: An integrated strategy of knowledge application for optimal e-health implementation: A multi-method study protocol. BMC Med Inform Decis Mak. 2008, 8.
  6. King G, Richards H, Godden D: Adoption of telemedicine in Scottish remote and rural general practices: a qualitative study. J Telemed Telecare. 2007, 13 (8): 382-386. 10.1258/135763307783064430. · DOI
  7. Boddy D, King G, Clark J, Heaney D, Mair F: The influence of context and process when implementing e-health. Bmc Med Inform Decis. 2009, 9 (1): 9-10.1186/1472-6947-9-9. · DOI
  8. Stinchcombe A: Constructing social theories. 1968, New York: Harcourt, Brace and World
  9. Mair F, May C, Murray E, Finch T, Anderson G, O'Donnell C, Wallace P, Sullivan F: Understanding the Implementation and Integration of E-Health Services London: National Co-ordinating. 2009, Centre for the National Institute for Health Research Service Delivery and Organisation Programme (NCCSDO)
  10. Banister P, Burman E, Parker I, Taylor M, Tindall C: Qualitative methods in psychology. 1994, Buckingham: Open University Press

Cited by

See all 244

Metadata

Authors
May, C. R., Finch, T., Ballini, L., MacFarlane, A., Mair, F., Murray, E., Treweek, S., & Rapley, T.
Affiliations
  • University of Southampton (GB)
  • Newcastle University (GB)
  • Agenzia Sanitaria e Sociale Regionale (IT)
  • Ollscoil na Gaillimhe – University of Galway (IE)
  • University of Glasgow (GB)
  • University College London (GB)
  • University of Dundee (GB)
Corresponding author
Rapley, Tim
Venue
BMC Health Services Research
Published
2011-09-30
Volume
11
Issue
1
Pages
245-245
ISSN
1472-6963 (ISSN-L)
OpenAlex
W6884888902
Cited by
3
References
28
Citations by year
2026: 2 · 2013: 1
FWCI
0.59
Type
journal article
Language
en
Open access
Locations
  • BMC Health Services Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • ARAN (University of Galway Research Repository) (Ollscoil na Gaillimhe – University of Galway) (acceptedVersion, cc-by-nc-nd)
  • Northumbria Research Link (Northumbria University) (acceptedVersion)
  • ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion)
  • ePrints Soton (University of Southampton) (acceptedVersion)
  • LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
  • Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
  • Arrow@dit (Dublin Institute of Technology) (submittedVersion)
  • ARAN (University of Galway Research Repository) (Ollscoil na Gaillimhe – University of Galway) (submittedVersion, cc-by-nc-nd)
  • Discovery Research Portal (University of Dundee) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • UCL Discovery (University College London) (submittedVersion)
  • University of Galway Research Repository (submittedVersion, cc-by-nc)
  • Lenus, The Irish Health Repository (Dr Steevens Hospital Library) (submittedVersion)
  • Research Repository UCD (University College Dublin) (cc-by-nc)
  • Newcastle University ePrints (Newcastle Univesity) (cc-by)
Funders
Economic and Social Research Council
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Social Sciences › Sociology and Political Science › Delphi Technique in Research
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
Keywords
Normalization Process Theory, complex interventions, health technology implementation, user feedback, theory development
MeSH terms
Delivery of Health Care, Health Services Research, Humans, Outcome and Process Assessment, Health Care, Technology Assessment, Biomedical, User-Computer Interface, Models, Organizational, Internet, Qualitative Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Evaluating complex interventions and health technologies using normalization process theory: development of a simplified approach and web-enabled toolkit. https://app.cochat.ai/papers/10.1186/1472-6963-11-245
The paper
May, C. R., Finch, T., Ballini, L., MacFarlane, A., Mair, F., Murray, E., Treweek, S., & Rapley, T. (2011). Evaluating complex interventions and health technologies using normalization process theory: development of a simplified approach and web-enabled toolkit. BMC Health Services Research. https://doi.org/10.1186/1472-6963-11-245

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.