Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 99 of the 100 references it cites were found in a registry or an index; 47 of the 56 sources its claims cite were checked for support.

The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review

Open access

Published version of a preprint

Abstract

The Non-adoption, Abandonment, Scale-up, Spread, Sustainability (NASSS) framework (2017) was established as an evidence-based, theory-informed tool to predict and evaluate the success of implementing health and care technologies. While the NASSS is gaining popularity, its use has not been systematically described. Literature reviews on the applications of popular implementation frameworks, such as the RE-AIM and the CFIR, have enabled their advancement in implementation science. Similarly, we sought to advance the science of implementation and application of theories, models, and frameworks (TMFs) in research by exploring the application of the NASSS in the five years since its inception. We aim to understand the characteristics of studies that used the NASSS, how it was used, and the lessons learned from its application. We conducted a scoping review following the JBI methodology. On December 20, 2022, we searched the following databases: Ovid MEDLINE, EMBASE, PsychINFO, CINAHL, Scopus, Web of Science, and LISTA. We used typologies and frameworks to characterize evidence to address our aim. This review included 57 studies that were qualitative (n=28), mixed/multi-methods (n=13), case studies (n=6), observational (n=3), experimental (n=3), and other designs (e.g., quality improvement) (n=4). The four most common types of digital applications being implemented were telemedicine/virtual care (n=24), personal health devices (n=10), digital interventions such as internet Cognitive Behavioural Therapies (n=10), and knowledge generation applications (n=9). Studies used the NASSS to inform study design (n=9), data collection (n=35), analysis (n=41), data presentation (n=33), and interpretation (n=39). Most studies applied the NASSS retrospectively to implementation (n=33). The remainder applied the NASSS prospectively (n=15) or concurrently (n=8) with implementation. We also collated reported barriers and enablers to implementation. We found the most reported barriers fell within the Organization and Adopter System domains, and the most frequently reported enablers fell within the Value Proposition domain. Eighteen studies highlighted the NASSS as a valuable and practical resource, particularly for unravelling complexities, comprehending implementation context, understanding contextual relevance in implementing health technology, and recognizing its adaptable nature to cater to researchers’ requirements. Most studies used the NASSS retrospectively, which may be attributed to the framework’s novelty. However, this finding highlights the need for prospective and concurrent application of the NASSS within the implementation process. In addition, almost all included studies reported multiple domains as barriers and enablers to implementation, indicating that implementation is a highly complex process that requires careful preparation to ensure implementation success. Finally, we identified a need for better reporting when using the NASSS in implementation research to contribute to the collective knowledge in the field.

Overview

CoChat Summary

TL;DR

This scoping review maps 57 empirical studies that used the NASSS framework from its 2017 publication through a December 2022 search. It finds NASSS was used most often retrospectively and for data analysis/interpretation, with barriers most reported in Organization and Adopter System domains and enablers in Value Proposition, and it calls for better reporting and more prospective/concurrent use.

Key findings

  • Across 57 included studies, designs were qualitative (n=28), mixed/multi-methods (n=13), case studies (n=6), observational (n=3), experimental (n=3), and other (n=4); most originated in the United Kingdom (n=15), Australia (n=13), and the United States (n=9).
  • The most common digital applications were telemedicine/virtual care (n=24), personal health devices (n=10), digital interventions such as iCBT (n=10), and knowledge generation applications (n=9).
  • NASSS informed study design (n=9), data collection (n=35), analysis (n=41), presentation (n=33), and interpretation (n=39); most studies applied it retrospectively (n=33), with fewer prospective (n=15) or concurrent (n=8) applications.
  • Most reported barriers fell within the Organization and Adopter System domains, while the most frequently reported enablers fell within the Value Proposition domain; 18 studies highlighted NASSS as a valuable and practical resource, particularly for unravelling complexities and understanding implementation context.

Methods

  • Scoping review following JBI methodology and PRISMA-ScR, with an a priori protocol registered on the Open Science Framework.
  • Searched Ovid MEDLINE, EMBASE, PsychINFO, CINAHL, Scopus, Web of Science, and LISTA on December 20, 2022, plus forward citation searching; included empirical studies published since 2017 that used NASSS and/or NASSS-CAT to inform design, data collection, analysis, presentation, or interpretation.
  • From 1,705 citations, 823 underwent title/abstract screening and 355 full-text evaluation, yielding 57 studies; analysis used descriptive summary statistics and content analysis, including categorization of digital applications, health conditions, timing of NASSS use, and barriers/enablers by NASSS domains.

Limitations

  • The authors state that quality appraisal was not used to exclude studies, consistent with scoping review methodology, and that the rapidly evolving mHealth field may require re-evaluation of findings.
  • The authors also state that non-empirical papers were excluded, which may have omitted authors’ insights, and that only English-language publications were included, limiting representation across regions.
  • The text makes evident that the search ended in December 2022, so later NASSS applications are not captured; the authors further note poor or inconsistent reporting in included studies made it difficult to determine how NASSS was used for presenting results and interpreting findings.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1371/journal.pdig.0000418

Cites

99 of 100 references verified0 citation errors · 1 not checkable

Statistics

Nothing to recompute.

Figures

Fig 1 PRISMA flow diagram.
Fig 1 PRISMA flow diagram.CC BY · PubMed Central
Fig 2 Barriers and Enablers identified in included studies, organized according to NASSS domains.
Fig 2 Barriers and Enablers identified in included studies, organized according to NASSS domains.CC BY · PubMed Central

Verification

Claims the paper makes

37 Valid · 2 Not valid · 6 Not checked · 84 Own results and interpretations

55 more claims · 2 with their cited sources checked

Create a free account to see all 129 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 61
  • It may state two separate claims as one. 16

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

5 of 5

Citations

Cites

Show all 93 references

Research works printed but not linked: 4

  1. M Peters, 2017, Chapter 11: Scoping Reviews. In: Aromataris E, Munn Z, editors. Joanna Briggs Institute Reviewer’s Manual. The Joanna Briggs Institute
  2. Covidence systematic review software. Melbourne, Australia.; 2019
  3. C Miller, 2021, Healthcare professionals perceptions of the stroke-specific education framework; what are the factors influencing effective implementation and adoption in the national stroke workforce?, Int J Stroke, 16, 35
  4. Y Duan, 2022, Conceptual and relational advances of the PARIHS and i-PARIHS frameworks over the last decade: a critical interpretive synthesis, Implement Sci, 17, 78, 10.1186/s13012-022-01254-z · DOI · Paper page

Cited by

See all 40

Metadata

Authors
Shin, H. D., Hamovitch, E., Gatov, E., MacKinnon, M., Samawi, L., Boateng, R., Thorpe, K. E., & Barwick, M.
Affiliations
  • Centre for Addiction and Mental Health (CA)
  • University of Toronto (CA)
Corresponding author
Shin, Hwayeon Danielle
Venue
PLOS Digital Health
Published
2025-03-17
Volume
4
Issue
3
Pages
e0000418
ISSN
2767-3170 (ISSN-L)
OpenAlex
W4408520232
Cited by
40
References
93
Citations by year
2026: 22 · 2025: 15
FWCI
46.68
Type
journal article
Language
en
Open access
Locations
  • PLOS Digital Health (publishedVersion, cc-by)
  • medRxiv (acceptedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
  • Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
Keywords
NASSS framework, implementation framework, health technology implementation, technology adoption, barriers and facilitators, telemedicine, personal health devices, digital interventions, implementation evaluation, implementation context, implementation barriers

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review. https://app.cochat.ai/papers/10.1371/journal.pdig.0000418
The paper
Shin, H. D., Hamovitch, E., Gatov, E., MacKinnon, M., Samawi, L., Boateng, R., Thorpe, K. E., & Barwick, M. (2025). The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review. PLOS Digital Health. https://doi.org/10.1371/journal.pdig.0000418

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.