PreprintCited by 40Health Policy Implementation ScienceTelemedicine and Telehealth ImplementationHealth Sciences Research and Education

The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review

Open access
Shin, Hwayeon Danielle, Hamovitch, Emily, Gatov, Evgenia, MacKinnon, Madison, Samawi, Luma, Boateng, Rhonda, Thorpe, Kevin, Barwick, Melanie·2023·PLOS Digital Health

Preprint — published as 10.1371/journal.pdig.0000418 · Paper page

Abstract

The Non-adoption, Abandonment, Scale-up, Spread, Sustainability (NASSS) framework (2017) was established as an evidence-based, theory-informed tool to predict and evaluate the success of implementing health and care technologies. While the NASSS is gaining popularity, its use has not been systematically described. Literature reviews on the applications of popular implementation frameworks, such as the RE-AIM and the CFIR, have enabled their advancement in implementation science. Similarly, we sought to advance the science of implementation and application of theories, models, and frameworks (TMFs) in research by exploring the application of the NASSS in the five years since its inception. We aim to understand the characteristics of studies that used the NASSS, how it was used, and the lessons learned from its application. We conducted a scoping review following the JBI methodology. On December 20, 2022, we searched the following databases: Ovid MEDLINE, EMBASE, PsychINFO, CINAHL, Scopus, Web of Science, and LISTA. We used typologies and frameworks to characterize evidence to address our aim. This review included 57 studies that were qualitative (n=28), mixed/multi-methods (n=13), case studies (n=6), observational (n=3), experimental (n=3), and other designs (e.g., quality improvement) (n=4). The four most common types of digital applications being implemented were telemedicine/virtual care (n=24), personal health devices (n=10), digital interventions such as internet Cognitive Behavioural Therapies (n=10), and knowledge generation applications (n=9). Studies used the NASSS to inform study design (n=9), data collection (n=35), analysis (n=41), data presentation (n=33), and interpretation (n=39). Most studies applied the NASSS retrospectively to implementation (n=33). The remainder applied the NASSS prospectively (n=15) or concurrently (n=8) with implementation. We also collated reported barriers and enablers to implementation. We found the most reported barriers fell within the Organization and Adopter System domains, and the most frequently reported enablers fell within the Value Proposition domain. Eighteen studies highlighted the NASSS as a valuable and practical resource, particularly for unravelling complexities, comprehending implementation context, understanding contextual relevance in implementing health technology, and recognizing its adaptable nature to cater to researchers' requirements. Most studies used the NASSS retrospectively, which may be attributed to the framework's novelty. However, this finding highlights the need for prospective and concurrent application of the NASSS within the implementation process. In addition, almost all included studies reported multiple domains as barriers and enablers to implementation, indicating that implementation is a highly complex process that requires careful preparation to ensure implementation success. Finally, we identified a need for better reporting when using the NASSS in implementation research to contribute to the collective knowledge in the field.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2023.11.22.23298897

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 6

  1. [1]1. Ayyoubzadeh SM, Niakan Kalhori S R, Shirkhoda M, Mohammadzadeh N, Esmaeili M. Supporting colorectal cancer survivors using eHealth: a systematic review and framework suggestion. Support Care Cancer Support Care Cancer. 2020;28: 3543-3555. doi:10.1007/s00520-020-05372-6 · DOI · Paper page
  2. [2]2. Bégin M, Eggertson L, Macdonald N. A country of perpetual pilot projects. Can Med Assoc J CMAJ CMAJ. 2009;180: 1185, E88-1185. doi:10.1503/cmaj.090808 · DOI · Paper page
  3. [3]3. Christ C, Schouten MJE, Blankers M, van Schaik DJF, Beekman ATF, Wisman MA, et al. Internet and computer-based cognitive behavioral therapy for anxiety and depression in adolescents and young adults: Systematic review and meta-analysis. J Med Internet Res J Med Internet Res. 2020;22: e17831. doi:10.2196/17831 · DOI · Paper page
  4. [4]4. Lv M, Wu T, Jiang S, Chen W, Zhang J. Effects of Telemedicine and mHealth on Systolic Blood Pressure Management in Stroke Patients: Systematic Review and Meta-Analysis of Randomized Controlled Trials. JMIR MHealth UHealth. 2021;9: e24116. doi:10.2196/24116 · DOI · Paper page
  5. [5]5. Pouls BPH, Vriezekolk JE, Bekker CL, Linn AJ, Onzenoort HAW, Vervloet M, et al. Effect of Interactive eHealth Interventions on Improving Medication Adherence in Adults With Long-Term Medication: Systematic Review. J Med Internet Res. 2021;23.
  6. [6]6. Schreiweis B, Pobiruchin M, Strotbaum V, Suleder J, Wiesner M, Bergh B. Barriers and Facilitators to the Implementation of eHealth Services: Systematic Literature [It is made available under a CC-BY 4.0 International license .](http://creativecommons.org/licenses/by/4.0/) [It is made available under a CC-BY 4.0 International license .](http://creativecommons.org/licenses/by/4.0/) [It is made available under a CC-BY 4.0 International license .](http://creativecommons.org/licenses/by/4.0/) [It is made available under a CC-BY 4.0 International license .](http://creativecommons.org/licenses/by/4.0/) [It is made available under a CC-BY 4.0 International license .](http://creativecommons.org/licenses/by/4.0/) [It is made available under a CC-BY 4.0 International license .](http://creativecommons.org/licenses/by/4.0/) [It is made available under a CC-BY 4.0 International license .](http://creativecommons.org/licenses/by/4.0/) [It is made available under a CC-BY 4.0 International license .](http://creativecommons.org/licenses/by/4.0/) [It is made available under a CC-BY 4.0 International license .](http://creativecommons.org/licenses/by/4.0/) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint medRxiv preprint doi: https://doi.org/10.1101/2023.11.22.23298897; this version posted November 23, 2023. The copyright holder for this [It is made available under a CC-BY 4.0 International license .](http://creativecommons.org/licenses/by/4.0/) Supporting Information 1. Search Strategy (Search Ran 20 December 2022) Medline (Ovid) Database Ovid MEDLINE: Epub Ahead of Print, In-Process & Other Non-Indexed Citations, Ovid MEDLINE® Daily and Ovid MEDLINE® <1946-Present> Search strategy: --------------------------------------------------------------------------------1 NASSS.ti,ab,kf. (51) 2 ((non-adoption or nonadoption) adj2 abandonment adj5 (scale-up or scaleup) adj2 spread adj2 sustainability).ti,ab,kf. (53) 3 NASSS-CAT.ti,ab,kf. (2) 4 (greenhalgh* adj5 (framework* or model*)).ti,ab,kf. (26) 5 1 or 2 or 3 or 4 (88) EMBASE (Ovid) Database: Embase Classic+Embase 1947 to 2022 December 19 Search strategy: --------------------------------------------------------------------------------1 NASSS.ti,ab,kf. (54) 2 ((non-adoption or nonadoption) adj2 abandonment adj5 (scale-up or scaleup) adj2 spread adj2 sustainability).ti,ab,kf. (51) 3 NASSS-CAT.ti,ab,kf. (2) 4 (greenhalgh* adj5 (framework* or model*)).ti,ab,kf. (35) 5 1 or 2 or 3 or 4 (97) APA PsychInfo (Ovid) Database: APA PsycInfo 1806 to December Week 2 2022 Search strategy: --------------------------------------------------------------------------------1 NASSS.ti,ab,id. (12) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint medRxiv preprint doi: https://doi.org/10.1101/2023.11.22.23298897; this version posted November 23, 2023. The copyright holder for this [It is made available under a CC-BY 4.0 International license .](http://creativecommons.org/licenses/by/4.0/) - 2 ((non-adoption or nonadoption) adj2 abandonment adj5 (scale-up or scaleup) adj2 spread adj2 sustainability).ti,ab,id. (6) - 3 - 4 - 5 ``` NASSS-CAT.ti,ab,id. (0) (greenhalgh* adj5 (framework* or model*)).ti,ab,id. (8) 1 or 2 or 3 or 4 (22) ```

Cited by

Sorted by citations

Authors
Shin, H. D., Hamovitch, E., Gatov, E., MacKinnon, M., Samawi, L., Boateng, R., Thorpe, K., & Barwick, M.
Affiliations
  • Centre for Addiction and Mental Health (CA)
  • University of Toronto (CA)
Corresponding author
Shin, Hwayeon Danielle
Venue
PLOS Digital Health
Publisher
openRxiv
Published
2023-11-23
Volume
4
Issue
3
Pages
e0000418-e0000418
ISSN
2767-3170 (ISSN-L)
OpenAlex
W4408520232
Cited by
40
References
5
Citations by year
2026: 22 · 2025: 15 · 2024: 3
FWCI
46.68
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • PLOS Digital Health (publishedVersion, cc-by)
  • medRxiv (acceptedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
  • Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
Keywords
NASSS framework, implementation framework, health technology implementation, technology adoption, barriers and facilitators, telemedicine, personal health devices, digital interventions, implementation evaluation, implementation context, implementation barriers

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review