The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 100 of the 101 references it cites were found in a registry or an index; 47 of the 56 sources its claims cite were checked for support.
Abstract
The Non-adoption, Abandonment, Scale-up, Spread, Sustainability (NASSS) framework (2017) was established as an evidence-based, theory-informed tool to predict and evaluate the success of implementing health and care technologies. While the NASSS is gaining popularity, its use has not been systematically described. Literature reviews on the applications of popular implementation frameworks, such as the RE-AIM and the CFIR, have enabled their advancement in implementation science. Similarly, we sought to advance the science of implementation and application of theories, models, and frameworks (TMFs) in research by exploring the application of the NASSS in the five years since its inception. We aim to understand the characteristics of studies that used the NASSS, how it was used, and the lessons learned from its application. We conducted a scoping review following the JBI methodology. On December 20, 2022, we searched the following databases: Ovid MEDLINE, EMBASE, PsychINFO, CINAHL, Scopus, Web of Science, and LISTA. We used typologies and frameworks to characterize evidence to address our aim. This review included 57 studies that were qualitative (n=28), mixed/multi-methods (n=13), case studies (n=6), observational (n=3), experimental (n=3), and other designs (e.g., quality improvement) (n=4). The four most common types of digital applications being implemented were telemedicine/virtual care (n=24), personal health devices (n=10), digital interventions such as internet Cognitive Behavioural Therapies (n=10), and knowledge generation applications (n=9). Studies used the NASSS to inform study design (n=9), data collection (n=35), analysis (n=41), data presentation (n=33), and interpretation (n=39). Most studies applied the NASSS retrospectively to implementation (n=33). The remainder applied the NASSS prospectively (n=15) or concurrently (n=8) with implementation. We also collated reported barriers and enablers to implementation. We found the most reported barriers fell within the Organization and Adopter System domains, and the most frequently reported enablers fell within the Value Proposition domain. Eighteen studies highlighted the NASSS as a valuable and practical resource, particularly for unravelling complexities, comprehending implementation context, understanding contextual relevance in implementing health technology, and recognizing its adaptable nature to cater to researchers’ requirements. Most studies used the NASSS retrospectively, which may be attributed to the framework’s novelty. However, this finding highlights the need for prospective and concurrent application of the NASSS within the implementation process. In addition, almost all included studies reported multiple domains as barriers and enablers to implementation, indicating that implementation is a highly complex process that requires careful preparation to ensure implementation success. Finally, we identified a need for better reporting when using the NASSS in implementation research to contribute to the collective knowledge in the field.
Overview
CoChat Summary
TL;DR
This scoping review maps 57 empirical studies that used the NASSS framework from its 2017 publication through a December 2022 search. It finds NASSS was used most often retrospectively and for data analysis/interpretation, with barriers most reported in Organization and Adopter System domains and enablers in Value Proposition, and it calls for better reporting and more prospective/concurrent use.
Key findings
- Across 57 included studies, designs were qualitative (n=28), mixed/multi-methods (n=13), case studies (n=6), observational (n=3), experimental (n=3), and other (n=4); most originated in the United Kingdom (n=15), Australia (n=13), and the United States (n=9).
- The most common digital applications were telemedicine/virtual care (n=24), personal health devices (n=10), digital interventions such as iCBT (n=10), and knowledge generation applications (n=9).
- NASSS informed study design (n=9), data collection (n=35), analysis (n=41), presentation (n=33), and interpretation (n=39); most studies applied it retrospectively (n=33), with fewer prospective (n=15) or concurrent (n=8) applications.
- Most reported barriers fell within the Organization and Adopter System domains, while the most frequently reported enablers fell within the Value Proposition domain; 18 studies highlighted NASSS as a valuable and practical resource, particularly for unravelling complexities and understanding implementation context.
Methods
- Scoping review following JBI methodology and PRISMA-ScR, with an a priori protocol registered on the Open Science Framework.
- Searched Ovid MEDLINE, EMBASE, PsychINFO, CINAHL, Scopus, Web of Science, and LISTA on December 20, 2022, plus forward citation searching; included empirical studies published since 2017 that used NASSS and/or NASSS-CAT to inform design, data collection, analysis, presentation, or interpretation.
- From 1,705 citations, 823 underwent title/abstract screening and 355 full-text evaluation, yielding 57 studies; analysis used descriptive summary statistics and content analysis, including categorization of digital applications, health conditions, timing of NASSS use, and barriers/enablers by NASSS domains.
Limitations
- The authors state that quality appraisal was not used to exclude studies, consistent with scoping review methodology, and that the rapidly evolving mHealth field may require re-evaluation of findings.
- The authors also state that non-empirical papers were excluded, which may have omitted authors’ insights, and that only English-language publications were included, limiting representation across regions.
- The text makes evident that the search ended in December 2022, so later NASSS applications are not captured; the authors further note poor or inconsistent reporting in included studies made it difficult to determine how NASSS was used for presenting results and interpreting findings.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
37 Valid · 2 Not valid · 6 Not checked · 84 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Poor reporting makes it difficult to synthesize evidence from relevant studies [90].”
§ The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review > Discussion
What the sources say
- Supportedcites [90] H Pinnock, 2015, Implementing supported self-management for asthma: a systematic review and suggested hierarchy of evidence of implementation studies, BMC Med source
In Discussion > Strengths and limitations (page not specified), the authors say missing key information may have caused them to reject relevant papers. That reporting problem limited which studies could contribute to their synthesis, supporting the citing sentence's broad paraphrase. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Two studies in this review mentioned the shortcomings of the NASSS framework [62,67], including ethical principles, which were addressed in the Planning and Evaluating Remote Consultation Services framework in 2021 [94].”
§ The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review > Discussion
What the sources say
- Supportedcites [94] T Greenhalgh, 2021, Planning and Evaluating Remote Consultation Services: A New Conceptual Framework Incorporating Complexity and Practical Ethics, Front Digit Health source
The 'Findings on Practical Ethics of Remote Consultations' section says that ethical and quality frameworks were added as underpinning pillars to the PERCS diagram. The 'Developing the Guiding Principles' section also describes how the authors developed principles from ethical tensions in remote care. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The surge in interest reflects the widespread adoption of the NASSS, which has been utilized prospectively and retrospectively to assess patient-oriented technologies and tools for decision-making purposes [12,13].”
§ The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review > Introduction
What the sources say
- Partly supportedcites [12] A Gremyr, 2020, Using Complexity Assessment to Inform the Development and Deployment of a Digital Dashboard for Schizophrenia Care: Case Study, J Med Internet Res sourceExperimental — accuracy not yet measured
The Methods (Overall Design; page unavailable) describe using NASSS-CAT to inform the development and deployment of a patient-facing schizophrenia-care dashboard. The Methods (NASSS Framework; page unavailable) also describe the framework as guiding and evaluating technology deployment. This supports prospective assessment for project decisions, but the paper does not establish retrospective use or widespread adoption. (LLM, conf=0.84)
- Partly supportedcites [13] C Papoutsi, 2020, Explaining the mixed findings of a randomised controlled trial of telehealth with centralised remote support for heart failure: multi-site qualitative study using the NASSS framework, Trials sourceExperimental — accuracy not yet measured
The Methods (Theoretical framework; page unavailable) and Results (page unavailable) describe using NASSS to analyse a patient-facing heart-failure telehealth intervention across trial sites. The paper does not establish that NASSS was used both prospectively and retrospectively, or as a decision-making tool; it describes its use as an analytical framework for this study. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The Non-adoption, Abandonment, Scale-up, Spread, Sustainability (NASSS) framework (2017) was established as an evidence-based, theory-informed tool to predict and evaluate the success of implementing health and care technologies.”
§ The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review > Abstract
What the sources say
- Supportedcites [10] T Greenhalgh, 2017, Beyond Adoption: A New Framework for Theorizing and Evaluating Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies, J Med Internet Res source
The Abstract’s Objective states that the authors sought to produce an evidence-based, theory-informed framework to help predict and evaluate the success of technology-supported health or social care programs. The Results section reports prospective use to predict implementation challenges and retrospective use to explain outcomes. The paper cautions that the framework cannot make firm, deterministic predictions, but the claim does not assert that it can. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Healthcare technology innovations hold considerable promise for enhancing patient outcomes and service efficiency, but they frequently remain confined to small-scale demonstration initiatives [1–5].”
§ The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review > Introduction
What the sources say
- Not checked — no full text of the sourcecites [1] SM Ayyoubzadeh, 2020, Supporting colorectal cancer survivors using eHealth: a systematic review and framework suggestion, Support Care Cancer Support Care Cancer source
- Partly supportedcites [2] HonM Begin, 2009, A country of perpetual pilot projects, Canadian Medical Association Journal sourceExperimental — accuracy not yet measured
The Abstract says Canada seldom moves proven health-care pilot projects into stable, funded programs and that projects often end when initial funding runs out. This supports the point about initiatives remaining at the pilot stage, but the paper discusses health-care practices and programs generally, not technology innovations specifically, and its account is limited to Canada. (LLM, conf=0.84)
- Could not verifycites [3] C Christ, 2020, Internet and Computer-Based Cognitive Behavioral Therapy for Anxiety and Depression in Adolescents and Young Adults: Systematic Review and Meta-Analysis, J Med Internet Res sourceExperimental — accuracy not yet measured
The Discussion’s Future Directions section says the evidence base for computerized CBT in young people is limited and calls for larger, higher-quality trials. It does not say that healthcare technology innovations frequently remain confined to small-scale demonstrations. Searches for pilot initiatives, scale-up, deployment, and routine-care implementation found no passage addressing that claim. (LLM, conf=0.76)
- Could not verifycites [4] M Lv, 2021, Effects of Telemedicine and mHealth on Systolic Blood Pressure Management in Stroke Patients: Systematic Review and Meta-Analysis of Randomized Controlled Trials, JMIR Mhealth Uhealth sourceExperimental — accuracy not yet measured
The Results describe nine trials involving 1,583 stroke survivors, and the Discussion notes that the interventions studied were relatively short. Neither section says healthcare technology innovations frequently remain confined to small-scale demonstration initiatives. Searches for that phrase and for pilot projects or barriers to wider adoption found no supporting passage. (LLM, conf=0.73)
- Could not verifycites [5] BPH Pouls, 2021, Effect of Interactive eHealth Interventions on Improving Medication Adherence in Adults With Long-Term Medication: Systematic Review, J Med Internet Res sourceExperimental — accuracy not yet measured
The Introduction describes eHealth as promising, and the Results summarize evaluated medication-adherence interventions, but neither addresses whether healthcare technologies frequently remain confined to small-scale demonstrations. Searches for pilot initiatives, scale-up, and routine implementation found no passage establishing that claim in our copy. (LLM, conf=0.73)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
55 more claims · 2 with their cited sources checked
Create a free account to see all 129 claims and to verify the 1 reference still open.
- Probably not a substantial claim. 61
- It may state two separate claims as one. 16
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Many factors identified in our analysis—including context (at system, organization, and service levels), leadership and engagement approaches, technological considerations, use of data, and local capacity and resourcing (e.g., finance, people)–reflect established findings on implementation of other innovations, digital or otherwise,21,27, 28, 29, 30 and NASSS framework constructs.20”
From Procurement and early deployment of artificial intelligence tools for chest diagnostics in NHS services in England: a rapid, mixed method evaluation (2025) · cites this paper as [21]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“and 21% reported barriers and enablers related to 6 domains.”
§ The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review > Results > RQ2. Application of the NASSS framework
Reported 21 · recomputed 22.807018
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review > Abstract
“Studies used the NASSS to inform study design (n=9), data collection (n=35), analysis (n=41), data presentation (n=33), and interpretation (n=39).”
§ The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review > Results > RQ2. Application of the NASSS framework
“| Data Analysis | 42 | 26.1 | [12,13,25–29,32–40,42,43,47,48,50,52–58,60,62,63,66–68,71–73,75–79] | | Presentation of results | 34 | 21.0 | [12,13,25–29,33–38,42,43,50,53,54,56,57,60,62,63,66–68,71–73,75–79] |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review > Abstract
“The remainder applied the NASSS prospectively (n=15) or concurrently (n=8) with implementation.”
§ The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review > Results > RQ2. Application of the NASSS framework
“| Multiple Time Points | 1 | 1.8 | [50] |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review > Results > RQ2. Application of the NASSS framework
“while 12% reported three or fewer domains.”
§ The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review > Results > RQ2. Application of the NASSS framework
“| 1 domain | 1 | 1.75 | [59] | | 2 domains | 1 | 1.75 | [77] | | 3 domains | 3 | 5.26 | [43,69,70] |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review > Results > RQ1. Characteristics of included studies
“| Thomas 2022 [72] | Australia | Other: Multi-Method | Metropolitan health service network |”
§ The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review > Results > RQ1. Characteristics of included studies
“| Other | 4 | 7.0 | [63,68,75,79] |”
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 1×
“The CFIR, a popular determinant framework in implementation science, primarily identifies factors influencing implementation outcomes across the domains of Intervention Characteristics, Outer Setting, Inner Setting, Individual Characteristics, and Implementation Process [85].”
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
Updated methodological guidance for the conduct of scoping reviews
Peters, M. D. J., Marnie, C., Tricco, A. C., Pollock, D., Munn, Z., Alexander, L., McInerney, P., Godfrey, C. M., & Khalil, H. (2020) · JBI Evidence Synthesis · doi:10.11124/jbies-20-00167 · Cited by 9,046 · cited 1×
“Scoping reviews typically do not necessitate methodological evaluation [18]; therefore, critical appraisal was omitted.”
PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement
McGowan, J., Sampson, M., Salzwedel, D. M., Cogo, E., Foerster, V., & Lefebvre, C. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.01.021 · Cited by 5,700 · cited 1×
“In collaboration with a health sciences librarian and following the Peer Review of Electronic Search Strategies (PRESS) guideline [21], a comprehensive search strategy was developed to locate relevant scholarly literature using multiple bibliographic databases.”
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 1×
“The Exploration, Preparation, Implementation, Sustainment (EPIS) [83] is a commonly used framework that highlights key phases guiding implementation as well as factors related to the outer (system) context, inner (organizational) context and the innovation itself.”
Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887 · cited 7×
“As reported in the Journal of Medical Internet Research [10] , the seminal paper has had nearly 1060 citations at the time of writing.”
InfluentialRE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review
Glasgow, R. E., Harden, S. M., Gaglio, B., Rabin, B., Smith, M. L., Porter, G. C., Ory, M. G., & Estabrooks, P. A. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00064 · Cited by 2,528 · cited 2×
“For example, several literature reviews have been written on the RE-AIM since its inception in 1999 [14,15].”
CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000251 · Cited by 2,296
A systematic review of the use of the Consolidated Framework for Implementation Research
Kirk, M. A., Kelley, C., Yankey, N., Birken, S. A., Abadie, B., & Damschroder, L. (2015) · Implementation Science · doi:10.1186/s13012-016-0437-z · Cited by 1,496 · cited 1×
“A recent literature review of the CFIR indicated that the most commonly used constructs in studies were “Knowledge and Beliefs about the Intervention,” followed by “Self-Efficacy,” both of which fall within the CFIR domain of Individual Characteristics [86].”
Standards for Reporting Implementation Studies (StaRI) Statement
Pinnock, H., Barwick, M., Carpenter, C. R., Eldridge, S., Grandes, G., Griffiths, C. J., Rycroft-Malone, J., Meissner, P., Murray, E., Patel, A., et al. (2017) · BMJ · doi:10.1136/bmj.i6795 · Cited by 1,446 · cited 4×
“Some implementation reporting standards are available; one example is the Standards for Reporting Implementation Studies (StaRI) Statement and Checklist [91].”
InfluentialSelf-citationHarvey, G., & Kitson, A. (2015) · Implementation Science · doi:10.1186/s13012-016-0398-2 · Cited by 1,271 · cited 1×
“Review of the NASSS framework use over time The I-PARiHS is another implementation determinant framework with four interacting core constructs: Evidence, Context, Recipients, and Facilitation [87,88].”
Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Rabin, B., & Aarons, G. A. (2019) · Implementation Science · doi:10.1186/s13012-018-0842-6 · Cited by 1,223 · cited 1×
“In this phase, organizational and individual adopter characteristics were the most frequently mentioned factors [84], similar to what we observed in the current NASSS framework review.”
The RE-AIM framework: a systematic review of use over time
Gaglio, B., Shoup, J. A., & Glasgow, R. E. (2013) · American Journal of Public Health · doi:10.2105/ajph.2013.301299 · Cited by 1,029 · cited 2×
“For example, several literature reviews have been written on the RE-AIM since its inception in 1999 [14,15].”
Studying complexity in health services research: desperately seeking an overdue paradigm shift
Greenhalgh, T., & Papoutsi, C. (2018) · BMC Medicine · doi:10.1186/s12916-018-1089-4 · Cited by 962 · cited 1×
“Healthcare is described as a complex adaptive system, discouraging simplistic linear cause-and-effect reasoning [8,9].”
The PARIHS Framework—A Framework for Guiding the Implementation of Evidence-based Practice
Rycroft-Malone, J. (2004) · Journal of Nursing Care Quality · doi:10.1097/00001786-200410000-00002 · Cited by 923 · cited 1×
“Review of the NASSS framework use over time The I-PARiHS is another implementation determinant framework with four interacting core constructs: Evidence, Context, Recipients, and Facilitation [87,88].”
Cresswell, K., & Sheikh, A. (2013) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.10.007 · Cited by 690 · cited 1×
“This challenge is especially evident in complex healthcare settings, where the multifaceted nature of the innovations and the environment can create barriers to successful implementation [7].”
Ten recommendations for using implementation frameworks in research and practice
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Albers, B., Nilsen, P., Broder-Fingert, S., Mukasa, B., & Aarons, G. A. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00023-7 · Cited by 488 · cited 1×
“There is a need for prospective and concurrent applications of implementation TMFs to identify potential hurdles and areas of complexity ahead of implementation so that mitigation strategies can be applied [81,82].”
The Promise of Digital Health: Then, Now, and the Future
Verily, Abernethy, A., Adams, L., National Academy of Medicine, Barrett, M., ResMed, Bechtel, C., Health, X., Brennan, P., Medicine, N. L. O., et al. (2022) · NAM Perspectives · doi:10.31478/202206e · Cited by 477 · cited 2×
“First, the digital applications implemented in the included studies were categorized by two reviewers (MM, HDS) by adapting the framework, ‘Evolving Applications of Digital Technology in Health and Health Care’ [24].”
Greenhalgh, T., Shaw, S., Wherton, J., Vijayaraghavan, S., Morris, J., Bhattacharya, S., Hanson, P., Campbell-Richards, D., Ramoutar, S., Collard, A., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9897 · Cited by 371
Greenhalgh, T., Shaw, S., Wherton, J., Vijayaraghavan, S., Morris, J., Bhattacharya, S., Hanson, P., Campbell-Richards, D., Ramoutar, S., Collard, A., et al. (2018) · doi:10.2196/preprints.9897 · Cited by 371
Barriers and facilitators to the implementation of eHealth services: systematic literature analysis
Schreiweis, B., Pobiruchin, M., Strotbaum, V., Suleder, J., Wiesner, M., & Bergh, B. (2019) · Journal of Medical Internet Research · doi:10.2196/14197 · Cited by 354 · cited 1×
“Moreover, current evidence indicates a prevalent pattern of non-adoption and abandonment of healthcare technology innovations by their intended users, with limited success in integrating these innovations into regular practice or expanding their implementation to different contexts [6].”
Strohm, L., Hehakaya, C., Ranschaert, E. R., Boon, W. P. C., & Moors, E. H. M. (2020) · European Radiology · doi:10.1007/s00330-020-06946-y · Cited by 329
Schulz, K. (2010) · Journal of Chinese Integrative Medicine · doi:10.3736/jcim20100702 · Cited by 248
Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A’Court, C., Hinder, S., Procter, R., & Shaw, S. (2018) · BMC Medicine · doi:10.1186/s12916-018-1050-6 · Cited by 232 · cited 3×
“This observation may indicate the intricate nature of the implementation under examination in the included studies, which could be explained by the framework’s underlying assumption that, in complex situations, the NASSS domains interact with one another and are interdependent [25].”
InfluentialStrifler, L., Cardoso, R., McGowan, J., Cogo, E., Nincic, V., Khan, P. A., Scott, A., Ghassemi, M., MacDonald, H., Lai, Y., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.04.008 · Cited by 227 · cited 3×
“Despite the substantial number of TMFs, there is limited evidence to describe their use [92].”
InfluentialGreenhalgh, T., Rosen, R., Shaw, S. E., Byng, R., Faulkner, S., Finlay, T., Grundy, E., Husain, L., Hughes, G., Leone, C., et al. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.726095 · Cited by 173 · cited 1×
“Two studies in this review mentioned the shortcomings of the NASSS framework [62,67], including ethical principles, which were addressed in the Planning and Evaluating Remote Consultation Services framework in 2021 [94].”
Greenhalgh, T., Maylor, H., Shaw, S., Wherton, J., Papoutsi, C., Betton, V., Nelissen, N., Gremyr, A., Rushforth, A., Koshkouei, M., et al. (2020) · JMIR Research Protocols · doi:10.2196/16861 · Cited by 152 · cited 2×
“Related complexity assessment tools (i.e., NASSS-CAT) were developed in 2020 to enhance understanding, guide monitoring, and facilitate research on technology projects in healthcare or social care settings through collaborations [11].”
Christ, C., Schouten, M. J., Blankers, M., van Schaik, D. J., Beekman, A. T., Wisman, M. A., Stikkelbroek, Y. A., & Dekker, J. J. (2020) · Journal of Medical Internet Research · doi:10.2196/17831 · Cited by 148
Pinnock, H., Epiphaniou, E., Pearce, G., Parke, H., Greenhalgh, T., Sheikh, A., Griffiths, C. J., & Taylor, S. J. C. (2015) · BMC Medicine · doi:10.1186/s12916-015-0361-0 · Cited by 132
Pouls, B. P. H., Vriezekolk, J. E., Bekker, C. L., Linn, A. J., van Onzenoort, H. A. W., Vervloet, M., van Dulmen, S., & van den Bemt, B. J. F. (2021) · Journal of Medical Internet Research · doi:10.2196/18901 · Cited by 123 · cited 1×
“Healthcare technology innovations hold considerable promise for enhancing patient outcomes and service efficiency, but they frequently remain confined to small-scale demonstration initiatives [1–5].”
Citation searching: a systematic review case study of multiple risk behaviour interventions
Wright, K., Golder, S., & Rodriguez-Lopez, R. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-73 · Cited by 103 · cited 1×
“In addition to a scholarly database search, a forward citation search [22] was used in Scopus and Web of Science on October 13 and 17, 2022, to complement our database searches.”
A country of perpetual pilot projects
Begin, H. M., Eggertson, L., & Macdonald, N. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.090808 · Cited by 102
Abimbola, S., Patel, B., Peiris, D., Patel, A., Harris, M., Usherwood, T., & Greenhalgh, T. (2019) · BMC Medicine · doi:10.1186/s12916-019-1463-x · Cited by 102 · cited 3×
“Eighteen studies [12,26,28,33,35,39,41,50,52,55–57, 62, 63, 68, 73,75, 78] recognized the NASSS framework as a”
Alley, Z. M., Chapman, J. E., Schaper, H., & Saldana, L. (2023) · Implementation Science · doi:10.1186/s13012-023-01285-0 · Cited by 86
Beyond forced telehealth adoption: A framework to sustain telehealth among allied health services
Thomas, E. E., Taylor, M. L., Ward, E. C., Hwang, R., Cook, R., Ross, J.-A., Webb, C., Harris, M., Hartley, C., Carswell, P., et al. (2024) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x221074499 · Cited by 68
Dyb, K., Berntsen, G. R., & Kvam, L. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-06262-1 · Cited by 67
Ahmed, S., Zidarov, D., Eilayyan, O., & Visca, R. (2020) · Quality of Life Research · doi:10.1007/s11136-020-02600-8 · Cited by 66 · cited 1×
“There is a need for prospective and concurrent applications of implementation TMFs to identify potential hurdles and areas of complexity ahead of implementation so that mitigation strategies can be applied [81,82].”
Franck, L. S., Kriz, R. M., Rego, S., Garman, K., Hobbs, C., & Dimmock, D. (2021) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2021.05.045 · Cited by 59 · cited 2×
“The Embedding and Adaptation Over Time domain was often omitted, but studies incorporated this concept into other domains (e.g., whether the technology will require future iterations [27], whether the regulatory context is expected to change [41]).”
Adoption of Machine Learning Systems for Medical Diagnostics in Clinics: Qualitative Interview Study
Pumplun, L., Fecho, M., Wahl, N., Peters, F., & Buxmann, P. (2021) · Journal of Medical Internet Research · doi:10.2196/29301 · Cited by 57 · cited 1×
“Two studies in this review mentioned the shortcomings of the NASSS framework [62,67], including ethical principles, which were addressed in the Planning and Evaluating Remote Consultation Services framework in 2021 [94].”
Examining innovation in hospital units: a complex adaptive systems approach
Glover, W. J., Nissinboim, N., & Naveh, E. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05403-2 · Cited by 57 · cited 1×
“Healthcare is described as a complex adaptive system, discouraging simplistic linear cause-and-effect reasoning [8,9].”
Taking knowledge users’ knowledge needs into account in health: an evidence synthesis framework
Wickremasinghe, D., Kuruvilla, S., Mays, N., & Avan, B. I. (2015) · Health Policy and Planning · doi:10.1093/heapol/czv079 · Cited by 55 · cited 1×
“A scoping review methodology was deemed most appropriate because our primary objective was to provide a breadth of literature currently available on the NASSS application [16].”
Bezuidenhout, L., Joseph, C., Thurston, C., Rhoda, A. J., English, C., & Conradsson, D. M. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-07968-6 · Cited by 55
Cartledge, S. H., Rawstorn, J. C., Tran, M. W., Ryan, P., Howden, E. J., & Jackson, A. C. (2021) · European Journal of Cardiovascular Nursing · doi:10.1093/eurjcn/zvab118 · Cited by 50 · cited 1×
“Eighteen studies [12,26,28,33,35,39,41,50,52,55–57, 62, 63, 68, 73,75, 78] recognized the NASSS framework as a”
Duan, Y., Iaconi, A., Wang, J., Perez, J. S., Song, Y., Chamberlain, S. A., Shrestha, S., Choroschun, K., Hoben, M., Beeber, A., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01254-z · Cited by 46 · cited 3×
“Furthermore, leadership was suggested as another key sub-construct within the Context of the i-PARiHS [89], which corresponds to the 5A Capacity subdomain within the Organization domain of the NASSS framework.”
InfluentialLiverani, M., Ir, P., Perel, P., Khan, M. S., Balabanova, D., & Wiseman, V. L. (2022) · Health Policy and Planning · doi:10.1093/heapol/czac019 · Cited by 45
Rudin, R. S., Perez, S. S., Rodriguez, J. A., Sousa, J., Plombon, S., Arcia, A., Foer, D., Bates, D. W., & Dalal, A. K. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab157 · Cited by 44 · cited 1×
“Eighteen studies [12,26,28,33,35,39,41,50,52,55–57, 62, 63, 68, 73,75, 78] recognized the NASSS framework as a”
(2020) · doi:10.2196/16906 · Cited by 41
(2019) · doi:10.2196/preprints.16906 · Cited by 41
Shin, H. D., Hamovitch, E., Gatov, E., MacKinnon, M., Samawi, L., Boateng, R., Thorpe, K., & Barwick, M. (2023) · doi:10.1101/2023.11.22.23298897 · Cited by 40
Self-citationImplementation of a virtual ward as a response to the COVID-19 pandemic
Schultz, K., Vickery, H., Campbell, K., Wheeldon, M., Barrett-Beck, L., & Rushbrook, E. (2021) · Australian Health Review · doi:10.1071/ah20240 · Cited by 39 · cited 1×
“A companion document (i.e., NASSS-CAT) [11] explicitly recommends the next steps for each domain where complexity is identified; however, only four included studies had used any part of the NASSS-CAT tool [12,52,70,78].”
Lv, M., Wu, T., Jiang, S., Chen, W., & Zhang, J. (2021) · JMIR mHealth and uHealth · doi:10.2196/24116 · Cited by 37
Kadesjö Banck, J., & Bernhardsson, S. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05596-6 · Cited by 35 · cited 2×
“” [28] “Lastly, providers described feelings of `Zoom fatigue’ and burnout and mentioned that video visits required more concentration, energy, and adaptations to interpret visual cues in comparison to in-person visits.”
Brown, P., Waite, F., Lambe, S., Jones, J., Jenner, L., Diamond, R., & Freeman, D. H. (2022) · JMIR Formative Research · doi:10.2196/34225 · Cited by 34
Jacobs, J., Ferguson, J. M., Campen, J. V., Yefimova, M., Greene, L., Heyworth, L. K., & Zulman, D. M. (2021) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2020.0530 · Cited by 33
Hehakaya, C., van Zyp, J. R. N. V. D. V., Lagendijk, J. J. W., Grobbee, D. E., Verkooijen, H. M., & Moors, E. H. M. (2020) · Frontiers in Oncology · doi:10.3389/fonc.2020.01741 · Cited by 32
Budhwani, S., Fujioka, J. K., Chu, C., Baranek, H., Pus, L., Wasserman, L., Vigod, S. N., Martin, D., Agarwal, P., & Mukerji, G. (2021) · JMIR Formative Research · doi:10.2196/30280 · Cited by 31 · cited 1×
“” [32] “Most patient participants were interested to see their readings and described the technology as well-designed.”
Gremyr, A., Andersson Gäre, B., Greenhalgh, T., Malm, U., Thor, J., & Andersson, A.-C. (2020) · Journal of Medical Internet Research · doi:10.2196/15521 · Cited by 31 · cited 6×
“For example, Gremyr et al. [12] applied the NASSS and identified various implementation complexities across several domains for their point-of-care dashboard supporting schizophrenia care.”
InfluentialIs it time for standards for reporting on research about implementation?
Rycroft‐Malone, J., & Burton, C. R. (2011) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2011.00232.x · Cited by 30 · cited 2×
“Review of the NASSS framework use over time other contexts, thereby contributing to the implementation science [93].”
Tolf, S., Mesterton, J., Söderberg, D., Amer‐Wåhlin, I., & Mazzocato, P. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05622-7 · Cited by 29 · cited 2×
“Eighteen studies [12,26,28,33,35,39,41,50,52,55–57, 62, 63, 68, 73,75, 78] recognized the NASSS framework as a”
Hammerton, M., Benson, T., & Sibley, A. (2022) · BMJ Open Quality · doi:10.1136/bmjoq-2022-001865 · Cited by 29
Schougaard, L. M. V., Mejdahl, C. T., Christensen, J., Lomborg, K. E., Maindal, H. T., de Thurah, A. L., & Hjøllund, N. H. (2019) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-019-0151-0 · Cited by 28
Dijkstra, A., Heida, A., & van Rheenen, P. F. (2019) · Journal of Medical Internet Research · doi:10.2196/11761 · Cited by 27
Technology-supported models of nutrition care: Perspectives of health service providers
Barnett, A., Kelly, J. T., Wright, C., & Campbell, K. L. (2022) · Digital Health · doi:10.1177/20552076221104670 · Cited by 26 · cited 1×
“” [29] The most reported enablers were within the Value Proposition domain.”
Papoutsi, C., A’Court, C., Wherton, J., Shaw, S., & Greenhalgh, T. (2020) · Trials · doi:10.1186/s13063-020-04817-x · Cited by 26 · cited 2×
“The surge in interest reflects the widespread adoption of the NASSS, which has been utilized prospectively and retrospectively to assess patient-oriented technologies and tools for decision-making purposes [12,13].”
Fox, D. J., Coddington, R., Scarf, V. L., Bisits, A., Lainchbury, A., Woodworth, R., Maude, R., Foureur, M. J., & Sandall, J. (2021) · Pilot and Feasibility Studies · doi:10.1186/s40814-021-00953-6 · Cited by 24
Supporting colorectal cancer survivors using eHealth: a systematic review and framework suggestion
Ayyoubzadeh, S. M., R. Niakan Kalhori, S., Shirkhoda, M., Mohammadzadeh, N., & Esmaeili, M. (2020) · Supportive Care in Cancer · doi:10.1007/s00520-020-05372-6 · Cited by 21
Neher, M., Nygårdh, A., Broström, A., Lundgren, J., & Johansson, P. (2022) · Journal of Medical Internet Research · doi:10.2196/28870 · Cited by 21 · cited 1×
“Finally, studies used the NASSS framework to interpret results (n=39), for example, by dedicating one paragraph of the discussion to each NASSS domain (e.g., [61]).”
Hehakaya, C., Sharma, A. M., van Zyp, J. R. N. V. D. V., Grobbee, D. E., Verkooijen, H. M., Izaguirre, E. W., & Moors, E. H. M. (2022) · Advances in Radiation Oncology · doi:10.1016/j.adro.2022.100953 · Cited by 21
Thomas, E. E., Chambers, R., Phillips, S., Rawstorn, J. C., & Cartledge, S. (2023) · European Journal of Cardiovascular Nursing · doi:10.1093/eurjcn/zvac111 · Cited by 20
Martindale, A.-M., Pilbeam, C., Mableson, H., Tonkin-Crine, S., Atkinson, P., Borek, A., Lant, S., Gobat, N., Solomon, T., & Sheard, S. (2021) · BMC Public Health · doi:10.1186/s12889-021-11285-8 · Cited by 20 · cited 1×
“As such, we found four studies in this review that used the NASSS framework for non-digital innovations [45,58,63,76], demonstrating the framework’s adaptability and utility.”
Nguyen, H. Q., McMullen, C., Haupt, E. C., Wang, S. E., Werch, H., Edwards, P. E., Andres, G. M., Reinke, L., Mittman, B. S., Shen, E., et al. (2022) · BMJ Supportive & Palliative Care · doi:10.1136/bmjspcare-2020-002553 · Cited by 20 · cited 2×
“Eighteen studies [12,26,28,33,35,39,41,50,52,55–57, 62, 63, 68, 73,75, 78] recognized the NASSS framework as a”
Kozica-Olenski, S. L., Soldatos, G., Marlow, L., Cooray, S. D., & Boyle, J. A. (2022) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-022-05175-z · Cited by 19 · cited 1×
“=33) such as utilizing a table to organize barriers and enablers by NASSS domains (e.g., [54]).”
Catapan, S. D. C., Taylor, A., & Calvo, M. C. M. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104867 · Cited by 18
Using the Stay Strong App for the Well-being of Indigenous Australian Prisoners: Feasibility Study
Perdacher, E., Kavanagh, D. J., Sheffield, J. K., Healy, K. L., Dale, P., & Heffernan, E. (2022) · JMIR Formative Research · doi:10.2196/32157 · Cited by 17
Mixed-methods feasibility study of blood pressure self-screening for hypertension detection
Tompson, A., Fleming, S., Lee, M., Monahan, M., Jowett, S. M., McCartney, D., Greenfield, S., Heneghan, C. J., Ward, A. M., Hobbs, R. F., et al. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-027986 · Cited by 16
Hall, A., Ewing, G., Rowland, C., & Grande, G. (2020) · Palliative Medicine · doi:10.1177/0269216320930935 · Cited by 15 · cited 1×
“As such, we found four studies in this review that used the NASSS framework for non-digital innovations [45,58,63,76], demonstrating the framework’s adaptability and utility.”
Developing an Integrated Caregiver Patient-Portal System
Longacre, M. L., Keleher, C., Chwistek, M., Odelberg, M. R., Siemon, M., Collins, M. E., & Fang, C. Y. (2021) · Healthcare · doi:10.3390/healthcare9020193 · Cited by 15 · cited 1×
“Eighteen studies [12,26,28,33,35,39,41,50,52,55–57, 62, 63, 68, 73,75, 78] recognized the NASSS framework as a”
Hollick, R. J., Black, A. J., Reid, D. M., & McKee, L. (2019) · Journal of Health Organization and Management · doi:10.1108/jhom-10-2018-0315 · Cited by 14 · cited 1×
“Eighteen studies [12,26,28,33,35,39,41,50,52,55–57, 62, 63, 68, 73,75, 78] recognized the NASSS framework as a”
Yakovchenko, V., McInnes, D. K., Petrakis, B. A., Gillespie, C., Lipschitz, J. M., McCullough, M. B., Richardson, L. M., Vetter, B., & Hogan, T. P. (2021) · JMIR mhealth and uhealth · doi:10.2196/31037 · Cited by 14 · cited 2×
“A companion document (i.e., NASSS-CAT) [11] explicitly recommends the next steps for each domain where complexity is identified; however, only four included studies had used any part of the NASSS-CAT tool [12,52,70,78].”
Davies, S. M., Jardine, J., Gutridge, K., Bernard, Z., Park, S., Dawson, T., Abel, K. M., & Whelan, P. (2021) · JMIR Formative Research · doi:10.2196/30668 · Cited by 14
Edridge, C., Deighton, J., Wolpert, M., & Edbrooke-Childs, J. H. (2019) · JMIR Formative Research · doi:10.2196/11958 · Cited by 13 · cited 1×
“Eighteen studies [12,26,28,33,35,39,41,50,52,55–57, 62, 63, 68, 73,75, 78] recognized the NASSS framework as a”
Machine Learning Systems in Clinics – How Mature Is the Adoption Process in Medical Diagnostics?
Pumplun, L., Fecho, M., Islam, N., & Buxmann, P. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2021.762 · Cited by 13 · cited 1×
“Studies also used the NASSS framework to inform data analysis (n=41), for example, using the NASSS framework for directed content analysis (e.g., [66]).”
Grady, A., Barnes, C., Wolfenden, L., Lecathelinais, C., & Yoong, S. L. (2020) · Journal of Medical Internet Research · doi:10.2196/22036 · Cited by 12 · cited 1×
“The latter relied on advisory committees to identify domains relevant to the study [43].”
Clarkson, P., Vassilev, I., Rogers, A. E., Brooks, C., Wilson, N., Lawson, J., & Adams, J. (2020) · JMIR Formative Research · doi:10.2196/18565 · Cited by 11 · cited 1×
“Eighteen studies [12,26,28,33,35,39,41,50,52,55–57, 62, 63, 68, 73,75, 78] recognized the NASSS framework as a”
Kozica, S. L., Garth, B., Boyle, J. A., & Vincent, A. J. (2022) · Climacteric · doi:10.1080/13697137.2022.2127351 · Cited by 11
Uribe Guajardo, M. G., Baillie, A., Louie, E., Giannopoulos, V., Wood, K., Riordan, B., Haber, P., & Morley, K. (2022) · Journal of Multimorbidity and Comorbidity · doi:10.1177/26335565221096977 · Cited by 10 · cited 1×
“Eighteen studies [12,26,28,33,35,39,41,50,52,55–57, 62, 63, 68, 73,75, 78] recognized the NASSS framework as a”
Wilkinson, G., Benfield, J. K., & Bath, P. M. (2021) · International Journal of Stroke · doi:10.1177/17474930211059996 · Cited by 10
Jones, N. L., Read, J., Field, B., Fegan, C., Simpson, E., Revitt, C., Lanfranchi, V., & Ciranvenga, F. (2022) · British Journal of Occupational Therapy · doi:10.1177/03080226211000265 · Cited by 9 · cited 2×
“A companion document (i.e., NASSS-CAT) [11] explicitly recommends the next steps for each domain where complexity is identified; however, only four included studies had used any part of the NASSS-CAT tool [12,52,70,78].”
Twitter, Telepractice, and the COVID-19 Pandemic: A Social Media Content Analysis
Weidner, K., Lowman, J., Fleischer, A. B., Kosik, K. B., Goodbread, P., Chen, B., & Kavuluru, R. (2021) · American Journal of Speech-Language Pathology · doi:10.1044/2021_ajslp-21-00034 · Cited by 9
Vali, Y., Eijk, R., Hicks, T., Jones, W. S., Suklan, J., Holleboom, A. G., Ratziu, V., Langendam, M. W., Anstee, Q. M., & Bossuyt, P. M. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11102707 · Cited by 8 · cited 1×
“As such, we found four studies in this review that used the NASSS framework for non-digital innovations [45,58,63,76], demonstrating the framework’s adaptability and utility.”
Brusatori, S., Krbec, M., Zadek, F., Zanella, A., Grasselli, G., Duska, F., & Langer, T. (2022) · Intensive Care Medicine Experimental · doi:10.1186/s40635-022-00469-0 · Cited by 8
User-Centered Value Specifications for Technologies Supporting Chronic Low-Back Pain Management
Merolli, M., Marshall, C. J., Pranata, A., Paay, J., & STERLING, L. S. (2019) · Studies in health technology and informatics · doi:10.3233/shti190434 · Cited by 7
Gorbenko, K. O., Mohammed, A. E., Ezenwafor, E. I. I., Phlegar, S. E., Healy, P. J., Solly, T., Nembhard, I. M., Xenophon, L., Smith, C. B., Freeman, R., et al. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac081 · Cited by 5
Przysucha, M., Peters, L., Büscher, A., Schnellhammer, M., & Hübner, U. (2022) · Studies in health technology and informatics · doi:10.3233/shti220807 · Cited by 2
Nimsakul, K., Suwannaprom, P., & Suttajit, S. (2022) · The Thai Journal of Pharmaceutical Sciences · doi:10.56808/3027-7922.2577 · Cited by 1
Hehakaya, C., Van der Voort van Zyp, J., Lagendijk, J., Grobbee, D., Verkooijen, H., & Ellen, M. (2020) · Radiotherapy and Oncology · doi:10.1016/s0167-8140(21)01293-7 · Cited by 1 · cited 1×
“Studies used the NASSS framework to inform data collection methods (n=35) by adapting interview guides according to the NASSS domains (e.g., [47,72]).”
Alhmoud, B., Bonnici, T., Patel, R. S., et al. (2023) · BMJ Open Quality · doi:10.1136/bmjoq-2022-001986 · Cited by 1
(2022) · Advances in Radiation Oncology · doi:10.1016/j.adro.2022.101049 · Cited by 1
Shin, H. D., Samawi, L., Gatov, J., Hamovitch, E., MacKinnon, M., Boateng, R., Thorpe, K., & Barwick, M. A. (n.d.) · OSF Preprints (OSF Preprints) · Cited by 1
Self-citationNimsakul, K., Suwannaprom, P., & Suttajit, S. (2022) · The Thai Journal of Pharmaceutical Sciences · doi:10.56808/3027-7922.2631 · cited 2×
“Eighteen studies [12,26,28,33,35,39,41,50,52,55–57, 62, 63, 68, 73,75, 78] recognized the NASSS framework as a”
Research works printed but not linked: 4
- M Peters, 2017, Chapter 11: Scoping Reviews. In: Aromataris E, Munn Z, editors. Joanna Briggs Institute Reviewer’s Manual. The Joanna Briggs Institute
- Covidence systematic review software. Melbourne, Australia.; 2019
- C Miller, 2021, Healthcare professionals perceptions of the stroke-specific education framework; what are the factors influencing effective implementation and adoption in the national stroke workforce?, Int J Stroke, 16, 35
- Y Duan, 2022, Conceptual and relational advances of the PARIHS and i-PARIHS frameworks over the last decade: a critical interpretive synthesis, Implement Sci, 17, 78, 10.1186/s13012-022-01254-z · DOI · Paper page
Cited by
Shin, H. D., Hamovitch, E., Gatov, E., MacKinnon, M., Samawi, L., Boateng, R., Thorpe, K., & Barwick, M. (2023) · doi:10.1101/2023.11.22.23298897 · Cited by 40
Self-citationFontaine, G., Mooney, M., Porat‐Dahlerbruch, J., Cahir, K., Ellen, M., Spinewine, A., Taylor, N., Laritz, R., Bourbeau-Allard, È., & Grimshaw, J. (2025) · Implementation Science · doi:10.1186/s13012-025-01436-5 · Cited by 55
Strudwick, G., Kassam, I., Torous, J. B., & Patenaude, S. (2025) · JMIR Mental Health · doi:10.2196/78791 · Cited by 17
Ramsay, A. I. G., Crellin, N., Lawrence, R., Walton, H., Bagri, S., Dodsworth, E., Elphinstone, H., Gleeson, F., Halliday, A., Herbert, K., et al. (2025) · eClinicalMedicine · doi:10.1016/j.eclinm.2025.103481 · Cited by 13
“…and service levels), leadership and engagement approaches, technological considerations, use of data, and local capacity and resourcing (e.g., finance, people)–reflect established findings on implementation of other innovations, digital or otherwise, 21,27–30 and NASSS framework constructs.”
Xames, M. D., Topcu, T. G., Parker, S. H., Zagarese, V., & Epling, J. W. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1611225 · Cited by 9
Metadata
- Authors
- Shin, H. D., Hamovitch, E., Gatov, E., MacKinnon, M., Samawi, L., Boateng, R., Thorpe, K. E., & Barwick, M.
- Affiliations
- Centre for Addiction and Mental Health (CA)
- University of Toronto (CA)
- Corresponding author
- Shin, Hwayeon Danielle
- ORCID
- Venue
- PLOS Digital Health
- Publisher
- Public Library of Science (PLoS)
- Published
- 2025-03-17
- Volume
- 4
- Issue
- 3
- Pages
- e0000418
- ISSN
- 2767-3170 (ISSN-L)
- PMC
- PMC11913280
- OpenAlex
- W4408520232
- Cited by
- 40
- References
- 93
- Citations by year
- 2026: 22 · 2025: 15
- FWCI
- 46.68
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLOS Digital Health (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- NASSS framework, implementation framework, health technology implementation, technology adoption, barriers and facilitators, telemedicine, personal health devices, digital interventions, implementation evaluation, implementation context, implementation barriers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

