The role of evidence, context, and facilitation in an implementation trial: implications for the development of the PARIHS framework
Open accessAbstract
BACKGROUND: The case has been made for more and better theory-informed process evaluations within trials in an effort to facilitate insightful understandings of how interventions work. In this paper, we provide an explanation of implementation processes from one of the first national implementation research randomized controlled trials with embedded process evaluation conducted within acute care, and a proposed extension to the Promoting Action on Research Implementation in Health Services (PARIHS) framework. METHODS: The PARIHS framework was prospectively applied to guide decisions about intervention design, data collection, and analysis processes in a trial focussed on reducing peri-operative fasting times. In order to capture a holistic picture of implementation processes, the same data were collected across 19 participating hospitals irrespective of allocation to intervention. This paper reports on findings from data collected from a purposive sample of 151 staff and patients pre- and post-intervention. Data were analysed using content analysis within, and then across data sets. RESULTS: A robust and uncontested evidence base was a necessary, but not sufficient condition for practice change, in that individual staff and patient responses such as caution influenced decision making. The implementation context was challenging, in which individuals and teams were bounded by professional issues, communication challenges, power and a lack of clarity for the authority and responsibility for practice change. Progress was made in sites where processes were aligned with existing initiatives. Additionally, facilitators reported engaging in many intervention implementation activities, some of which result in practice changes, but not significant improvements to outcomes. CONCLUSIONS: This study provided an opportunity for reflection on the comprehensiveness of the PARIHS framework. Consistent with the underlying tenant of PARIHS, a multi-faceted and dynamic story of implementation was evident. However, the prominent role that individuals played as part of the interaction between evidence and context is not currently explicit within the framework. We propose that successful implementation of evidence into practice is a planned facilitated process involving an interplay between individuals, evidence, and context to promote evidence-informed practice. This proposal will enhance the potential of the PARIHS framework for explanation, and ensure theoretical development both informs and responds to the evidence base for implementation.
AI snapshot
Written from the paper’s full text.
TL;DR
This embedded process evaluation of a national implementation RCT found that robust evidence was necessary but not sufficient for practice change, with context, inter-professional issues, and individual caution mediating implementation. The authors propose extending PARIHS by making individuals an explicit element alongside evidence, context, and facilitation.
Key findings
- The trial showed no significant effect of the interventions on the primary outcome of fluid fasting time; the process evaluation drew on 151 staff and patients across 19 participating hospitals.
- The evidence base for shortening fasting times was robust and relatively uncontested, but it was mediated by practitioner and patient caution, perceived risk, and staff fear of adverse consequences; in most sites it was unclear whether the evidence reached potential users.
- Implementation context was challenging across micro, meso, and macro levels, including emotional responses, inter-professional issues, unclear ownership and decision-making authority, communication problems, variable organizational buy-in, and different starting points; average fluid fasting times ranged from 12.9 hours to 5.8 hours, one standard dissemination site decreased from 12.5 to 7.7 hours, and another site started at 5.8 hours and continued lower at 4.2 hours but not statistically significantly lower.
- Facilitators reported many activities, but their relative and direct impact on policy and practice changes was difficult to judge, and there appeared to be no distinguishing features between the activities, skills, and attributes of an opinion leader and a PDSA facilitator despite the interventions being conceptually different.
Methods
- Design: PARIHS was prospectively applied to guide intervention design, data collection, and analysis within a process evaluation embedded in a pragmatic randomized controlled trial; three interventions were randomly allocated across 19 hospitals in England, Scotland, Wales, and Northern Ireland: standard dissemination, a web-based resource championed by opinion leader(s), and a Plan-Do-Study-Act (PDSA) intervention, each over six months.
- Data: pre- and post-intervention data were collected between November 2006 and February 2009 from a purposive sample of 151 staff and patients, including key contact interviews (28 total), change agent interviews (21 total), patient interviews (70 total), and five focus groups with 32 participants.
- Analysis: qualitative data were transcribed and managed in N*DIST 5 and NVIVO 7; inductive and deductive content analysis was undertaken informed by Ritchie and Spencer’s approach, first within data sets and then mapped across the core PARIHS elements of evidence, context, and facilitation, with cross-checking by three researchers.
Limitations
- The paper states that the process evaluation was designed to capture data across intervention sites rather than conduct in-depth case studies or ethnographies in a few sites, and that in-depth data collection in purposively sampled sites may have provided more illuminating evidence about intervention implementation, particularly fidelity.
- The paper states that the study had no capacity for observational work and therefore relied on self-reported data, that some voices were missing (surgeons who did not consent and senior operational managers not included in sampling), and that although the study design and interventions were prospectively designed based on PARIHS, the evaluation of the framework was retrospective; the addition of the concept of the individual needs further consideration, elaboration, and clarification.
- Evident from the text: because there was no significant effect on the primary outcome, the relative and direct impact of facilitator activities on policy and practice changes was difficult to judge, and no distinguishing features were found between opinion leader and PDSA facilitator activities, skills, and attributes despite the interventions being conceptually different.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 43 cited sources checked · 0 supported · 0 flagged
- Findingnone given
Progress was made in sites where implementation processes were aligned with existing initiatives.
“Progress was made in sites where processes were aligned with existing initiatives.”
Quote in the paperNot a substantial claim - Findingown data
The implementation context was challenging, with individuals and teams bounded by professional issues, communication challenges, power, and a lack of clarity about authority and responsibility for practice change.
“The implementation context was challenging, in which individuals and teams were bounded by professional issues, communication challenges, power and a lack of clarity for the authority and responsibility for practice change.”
Quote in the paperSubstantial claim - Findingown data
There were reports of ward-based team communication problems that had led to prolonged delays or fasting times for patients.
“There were also reports of ward-based team communication problems, which had led to prolonged delays or fasting times for patients.”
Quote in the paperNot a substantial claim - Findingown data
Opinion leaders and PDSA facilitators reported engaging in many activities including amendment of information, dissemination of information, awareness raising, individual review of patient fast, educational meetings, policy development, promotion of guidance, teaching/training, and using role models of good practice.
“In interviews, opinion leaders and PDSA facilitators reported engaging in many activities including: amendment of information; dissemination of information; awareness raising; individual review of patient fast; educational meetings; policy development; promotion of guidance; teaching/training (formal and informal); and using role models of good practice.”
Quote in the paperNot a substantial claim- Rests on an assumption: The process evaluation's self-reported data (interviews) provide a sufficient and accurate account of the implementation activities and their impact.
- Findingown data
Within two of the interventions there was the potential to work with individuals and teams to overcome some challenges, but this was not translated to reductions in fasting times in most sites.
“Within two of the interventions there was the potential to work with individuals and teams to attempt to overcome some of the challenges, but this was not translated to reductions in fasting times in most sites.”
Quote in the paperSubstantial claim
- Findingown data
The guideline recommendations were mainly localized through local policies rather than consensus processes.
“The guideline recommendations were mainly localized through local policies rather than, for example, consensus processes.”
Quote in the paperNot a substantial claim - Findingown data
Data shows examples of communication challenges that meant individualising patients' fasting times in line with recommendations would be difficult, if not impossible, to achieve.
“Data shows examples of some challenges with communication, which meant that individualising patients’ fasting times in line with recommendations would be difficult, if not impossible to achieve:”
Quote in the paperNot a substantial claim - Findingown data
In the site using a web resource and opinion leader, learning and awareness from a patient safety initiative were used to implement individual review of fasting practice.
“In another site (web resource and opinion leader), they used learning and awareness from a patient safety initiative to implement individual review of fasting practice.”
Quote in the paperNot a substantial claim - Findingown data
The evidence base was relatively uncontested by those involved in the study, apart from some wanting clarity about how to interpret recommendations.
“Apart from some wanting clarity about how to interpret recommendations, for example, how much water patients could drink pre-operatively; the evidence base was relatively uncontested by those involved in the study.”
Quote in the paperNot a substantial claim - Findingown data
Participants' perceptions of their colleagues' views of the evidence base were on the whole positive.
“Participants’ perceptions of their colleagues’ views of the evidence base were also, on the whole, positive.”
Quote in the paperNot a substantial claim - Findingown data
Aligning implementation with existing relevant activities enhanced the chances of more successful implementation.
“There was some evidence that aligning implementation with existing relevant activities enhanced the chances of more successful implementation.”
Quote in the paperSubstantial claim - Findingown data
Inter-professional issues were a significant issue across all data, including different professional approaches, leadership, power and hierarchical structures, and professional cultures.
“This finding was a significant issue across all data and includes different professional approaches, leadership, power and hierarchical structures, and professional cultures.”
Quote in the paperNot a substantial claim - Findingown data
The trial showed no significant effect of the interventions on the primary outcome of fluid fasting time.
“The results from the trial showed no significant effect of the interventions on the primary outcome of fluid fasting time.”
Quote in the paperSubstantial claim - Findingown data
Change agents and key contacts reported that a number of activities had taken place to embed recommendations into local practice, including changing patient information letters and leaflets and information for staff.
“Change agents and key contacts reported that a number of activities had taken place to embed recommendations into local practice including changing patient information letters and leaflets, and information for staff.”
Quote in the paperNot a substantial claim - Findingown data
One site randomized to the PDSA intervention was unable to participate in the allocated intervention because they could not identify a replacement facilitator after the proposed facilitator went on sick leave.
“In other sites there were issues that limited preparedness, for example one site that had been randomized to the PDSA intervention were unable to participate in the allocated intervention because they were unable to identify a replacement facilitator after the proposed facilitator went on sick leave.”
Quote in the paperNot a substantial claim - Findingown data
Fasting practice was influenced by how the disciplines functioned together, sometimes bringing them into conflict because they had different objectives, ways of working, and power bases.
“Fasting practice was influenced by how the disciplines functioned together, sometimes bringing them into conflict because they had different objectives, ways of working and power bases.”
Quote in the paperNot a substantial claim - Findingown data
Sites started from different bases with their actual fasting times, ranging from an average fluid fasting time of 12.9 hours to 5.8 hours.
“Additionally sites started from a different base with their actual fasting times, ranging from one extreme of an average fluid fasting time of 12.9 hours to 5.8 hours at the other extreme (where recommendations state it is safe for patients to have clear fluids up to two hours before induction of anaesthesia).”
Quote in the paperSubstantial claim - Findingown data
The delivery of interventions and practice change was mediated by many factors, including individuals' behaviors, attitudes, emotional responses, communication by and across individuals and teams, and challenging implementation contexts, including inter-professional functioning and an organization's existing surgical systems and processes.
“the delivery of interventions and the practice change was mediated by many factors, including individuals' behaviors, attitudes, emotional responses, communication by and across individuals and teams, and by challenging implementation contexts, including inter-professional functioning and an organization's existing surgical systems and processes.”
Quote in the paperSubstantial claim - Findingown data
Across the 19 trusts, cross-cutting themes emerged about the influence of contextual factors at micro, meso, and macro levels on implementation processes.
“Across the 19 trusts in the study, some cross-cutting themes emerged from the data about the influence that contextual factors at micro (individual), meso (team within the elective surgery department) and macro (hospital) levels had on implementation processes.”
Quote in the paperSubstantial claim - Findingown data
One of the critical issues that limited the potential to make significant changes to fasting times within the intervention period was that hospitals were at different starting points with respect to fasting practice and preparedness.
“One of the critical issues that limited the potential to make significant changes to fasting times within the intervention period was that hospitals were at different starting points with respect to fasting practice and preparedness.”
Quote in the paperSubstantial claim - Findingown data
There appeared to be no distinguishing features between the activities, skills, and attributes of an opinion leader and those of a PDSA facilitator in this study, despite the interventions being conceptually different and packaged distinctively.
“There appeared to be no distinguishing features between the activities, skills, and attributes of an opinion leader and those of a PDSA facilitator in this study, despite the interventions being conceptually different, and packaged distinctively.”
Quote in the paperSubstantial claim- Rests on an assumption: The process evaluation's self-reported data (interviews) provide a sufficient and accurate account of the implementation activities and their impact.
- Findingown data
Particular themes about implementation facilitators and barriers were not specific to interventions; rather patterns were observed across sites.
“Particular themes about implementation facilitators and barriers were not specific to interventions; rather we observed patterns across sites.”
Quote in the paperSubstantial claim - Findingreasoning
The implementation context was challenging and resistant to the implementation interventions evaluated in this study.
“In summary, the implementation context was challenging, proving resistant to the implementation interventions evaluated in this study.”
Quote in the paperSubstantial claim - Findingown data
Practitioners were anxious about changing traditional practice.
“In addition to cautionary practice, there was also evidence that practitioners were anxious about changing traditional practice; these people were described by one anaesthetist participant as ‘dinosaurs.’”
Quote in the paperNot a substantial claim - Findingown data
In the hospital using standard dissemination that had the largest decrease in fluid fast times (from 12.5 to 7.7 hours), the project was added to an existing initiative implemented in a different department.
“For example, in the hospital (standard dissemination) that had the largest decrease in fluid fast times (from 12.5 to 7.7 hours), they added this project to an existing initiative that had been implemented in a different department.”
Quote in the paperNot a substantial claim - Findingnone given
Many activities were recorded for those in facilitator roles, but their relative and direct impact on policy and practice changes were difficult to judge.
“In summary, many activities were recorded for those in facilitator roles, but their relative and direct impact on policy and practice changes were difficult to judge.”
Quote in the paperSubstantial claim- Rests on an assumption: The process evaluation's self-reported data (interviews) provide a sufficient and accurate account of the implementation activities and their impact.
- Findingnone given
In sites where processes were aligned with existing initiatives, some progress was made.
“However, in sites where processes were aligned with existing initiatives some progress was made.”
Quote in the paperNot a substantial claim - Findingown data
The activities rated higher for usefulness in prompting changes included revised patient and staff information, feedback of audit data, working through pivotal individuals, informal teaching, and using pre-surgery safety briefings.
“When questioned about the relative usefulness of these activities in prompting changes, the activities that were rated higher included revised patient and staff information, feedback of audit data, working through pivotal individuals, informal teaching, and using pre-surgery safety briefings.”
Quote in the paperSubstantial claim- Rests on an assumption: The process evaluation's self-reported data (interviews) provide a sufficient and accurate account of the implementation activities and their impact.
- Findingown data
Apart from one site where the nursing director was supportive and prioritized the issue, generally at hospital level the buy-in to evidence-based peri-operative fasting was not evident.
“Apart from at one site in which the nursing director was supportive and prioritized the issue (a site that was allocated to standard dissemination and did make improvements) generally at hospital level, the buy-in to evidence-based peri-operative fasting was not evident.”
Quote in the paperSubstantial claim - Findingown data
The positive attitude to the research base was mediated by practitioner and patient judgements about the need for caution and perceived attitudes to risk taking.
“This positive attitude to the research base was mediated by practitioner and patient judgements about the need for caution, and perceived attitudes to risk taking.”
Quote in the paperSubstantial claim - Findingown data
The success of the project locally was vested in individuals' enthusiasm and commitment.
“The success of the project locally was vested in individual’s enthusiasm and commitment:”
Quote in the paperNot a substantial claim - Findingown data
These perceptions did not change pre- and post-intervention.
“These perceptions did not change pre- and post-intervention.”
Quote in the paperNot a substantial claim - Findingcitation
Findings from this study and evidence from others' research and conceptualisations show the crucial role that individuals play in the relative success of evidence-based change.
“Findings from this study and evidence from others' research and conceptualisations of evidence-based change and theory show the crucial role that individuals plays in the relative success of evidence-based change [6,7,27,37-39].”
Quote in the paperSubstantial claim0 of 6 sources checked- cites [6] Damschroder LJ, Aaron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009, 4: 50-10.1186/1748-5908-4-50. source
Not checked in the free run.
- cites [7] Michie S, van Stralen MV, West R: The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implement Sci. 2011, 6: 42-10.1186/1748-5908-6-42. source
Not checked in the free run.
- cites [27] Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x. source
Not checked in the free run.
- cites [37] Wenger E: Communities of Practice. 1998, Cambridge: Cambridge University Press source
Not checked in the free run.
- cites [38] Gabbay J, le May A: Evidence based guidelines or collectively constructed ‘mindlines?’ ethnographic study of knowledge management in primary care. BMJ. 2004, 329 (7473): 1013-1018. 10.1136/bmj.329.7473.1013. source
Not checked in the free run.
- cites [39] Estabrooks CA, Rutakumwa W, O’Leary KA, Profetto-McGrath J, Milner M, Levers MJ, Scott-Findlay S: Sources of practice knowledge among nurses. Qual Health Res. 2005, 15 (4): 460-476. 10.1177/1049732304273702. source
Not checked in the free run.
- Findingown data
The observable pattern of interaction between evidence, context, and facilitation was influenced by individual (patients and practitioners) and collective behavior such as over-estimating risk, caution, and team functioning.
“Our findings do not suggest that evidential factors be displaced by individual factors; rather, the observable pattern of interaction between evidence, context, and facilitation was influenced by individual (patients and practitioners) and collective behavior such as over-estimating risk, caution, and team functioning.”
Quote in the paperSubstantial claim- Rests on an assumption: The process evaluation's self-reported data (interviews) provide a sufficient and accurate account of the implementation activities and their impact.
- Interpretationown data
It is difficult to judge the relative impact of the activities of opinion leaders and PDSA facilitators given the lack of effect on duration of fasting as a primary outcome.
“Given the lack of effect on duration of fasting as a primary outcome, it is difficult to judge the relative impact of the activities of opinion leaders and PDSA facilitators.”
Quote in the paperSubstantial claim- Rests on an assumption: The lack of effect on duration of fasting in the PoISE trial is a valid indicator of implementation failure rather than of the ineffectiveness of the evidence or of the outcome measure.
- Premisenone given
Successful implementation is a function of evidence, context, and facilitation.
“Reflecting on the proposition that successful implementation is a function of evidence, context, and facilitation, the element of evidence requires further scrutiny.”
Quote in the paperSubstantial claim - Interpretationreasoning
There was a difference between agreeing with evidence and using it to make decisions and/or change services.
“There was a difference between agreeing with evidence, and using it to make decisions and/or change services.”
Quote in the paperSubstantial claim - Interpretationreasoning
Anxiety and caution seemed to lead to an emotional response, with some staff becoming confrontational with those trying to instigate changes.
“Such anxiety and caution seemed to lead to an emotional response, with some staff becoming ‘confrontational’ with those that were trying to instigate changes.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The behavior and choices of teams and individuals, including patients, bounded by professional issues, power and a lack of clarity for the authority and responsibility of fasting practice, operated within a wider organizational system that mediated the implementation of new practices.
“The behavior and choices of teams and individuals, including patients, bounded by professional issues, power and a lack of clarity for the authority and responsibility of fasting practice operated within a wider organizational system that mediated the implementation of new practices.”
Quote in the paperSubstantial claim - Premisecitation
Previous research indicates that where there is strong research with clinical consensus it is more likely to be used in practice.
“Previous research indicates that where there is strong research with clinical consensus it is more likely to be used in practice [31].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [31] Dopson S, Fitzgerald L: Knowledge into Action. 2005, Oxford: Oxford University Press source
Not checked in the free run.
- Premisecitation
Evidence suggests that many individual level factors including beliefs, attitudes, motivations, values, skills, competence, behavior, and characteristics may be influential.
“Evidence suggests that many individual level factors including beliefs, attitudes, motivations, values, skills, competence, behavior, and characteristics may be influential [40,41].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [40] Squires JE, Estabrooks CA, Gustavsson P, Wallin L: Individual determinants of research utilization by nurses: a systematic review update. Implement Sci. 2011, 6: 1-10.1186/1748-5908-6-1. source
Not checked in the free run.
- cites [41] Meijers JMM, Janssen MAP, Cummings G, Wallin L, Estabrooks CA, Halfens R: Assessing the relationships between contextual factors and research utilization in nursing: systematic literature review. J Adv Nurs. 2006, 55 (5): 622-635. 10.1111/j.1365-2648.2006.03954.x. source
Not checked in the free run.
- Interpretationown data
The ideal position of the elements may vary from project to project, such that it is not always necessary to have 'high' evidence and 'high' context alongside 'high' facilitation.
“First, that the ideal position of the elements may vary from project to project, such that in some initiatives for example, it is not always necessary to have 'high' evidence and 'high' context alongside 'high' (appropriate) facilitation, which is the current theory of PARIHS.”
Quote in the paperSubstantial claim - Interpretationreasoning
The main interactions in this study were between individuals and teams and context.
“Therefore the main interactions in this study were between individuals and teams and context.”
Quote in the paperSubstantial claim - Interpretationown data
Changing an organization's systems and processes to enable individualized fasting times requires more than robust and believable evidence.
“Changing an organization's systems and processes to enable individualized fasting times requires more than robust and believable evidence.”
Quote in the paperSubstantial claim - Interpretationreasoning
Because each implementation project has a particular dynamic and multiple interconnections that may vary throughout its lifetime, it is not possible to plot this on a high-low continuum.
“Second, because each implementation project will have a particular dynamic and multiple interconnections that may vary throughout its lifetime, it is not possible to plot this on a high-low continuum.”
Quote in the paperNot a substantial claim
- May combine two claims. 39
- Classified as probably not a substantial claim. 59
- The quote only partly states this claim. 1
May combine two claims.
Findingown dataFacilitators reported engaging in many intervention implementation activities, some of which resulted in practice changes, but not significant improvements to outcomes.
“Additionally, facilitators reported engaging in many intervention implementation activities, some of which result in practice changes, but not significant improvements to outcomes.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataOne of the challenges encountered concerned the ownership of fasting practice.
“One of the challenges encountered concerned the ‘ownership’ of fasting practice.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataSome hospitals did not have a written fasting policy and had to develop one during the intervention phase, which left limited time to implement it.
“Some hospitals did not have a written fasting policy and had to develop one during the intervention phase, which left limited time to implement it.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataSome patients expressed a cautious attitude towards the advice they had been given because they did not want to jeopardize their treatment.
“Some patients also expressed a cautious attitude towards the advice they had been given because they did not want to jeopardize their treatment:”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataManagerial support for the project was variable, and consequently commitment and resources dedicated to it were variable.
“While hospitals had signed up to being involved in the project, the managerial support for it was variable, and consequently so were the commitment and resources dedicated to it.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataSome nurses expressed concern about getting into trouble if patients were not fasted long enough, with which some anaesthetists sympathized.
“This was tempered by a concern expressed by some nurses about getting into trouble if patients were not fasted long enough, with which some anaesthetists sympathized:”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAt some sites existing policy was in line with the guideline evidence, and in others it was similar (e.g., three hours fluid fast).
“At some sites existing policy was in line with the guideline evidence, and in others it was similar (e.g., three hours fluid fast).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingnone givenThe enactment of facilitator roles varied and was linked to activities rather than the prescribed intervention strategy.
“The enactment of these roles varied and was linked to activities rather than the prescribed intervention strategy.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataMost respondents believed the evidence base for shortening fasting times to be robust.
“Data from interviews with change agents and key contacts who were either senior nursing or anaesthetic staff showed that most respondents believed the evidence base for shortening fasting times to be robust:”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe hospital that started with the lowest pre-intervention fluid fast time (5.8 hours) continued to get lower (4.2 hours), but not statistically significantly lower.
“This hospital started with the lowest pre-intervention fluid fast time (5.8 hours), which continued to get lower (4.2), but not statistically significantly lower.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataStaff reported feeling overwhelmed by competing priorities, and that this project came at a bad time.
“Staff reported feeling overwhelmed by competing priorities, and that this project came ‘at a bad time.’”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataChanges to policy and practice were recorded, but they did not translate into changes to patient outcomes.
“However, we did record changes to policy and practice, which did not translate into changes to patient outcomes.”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
Findingown dataOpinion leaders and PDSA facilitators reported operationalising activities by using existing structures, real-time practice opportunities, evidence of patient discomfort, key roles, team agendas, starting small in targeted wards, and posters.
“Opinion leaders and PDSA facilitators reported operationalising these activities in the following ways:”
Quote in the paperNot a substantial claim- Rests on an assumption: The process evaluation's self-reported data (interviews) provide a sufficient and accurate account of the implementation activities and their impact.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe need for managing operating lists meant that individual staff reportedly took a cautionary approach to fasting practice.
“The need for managing operating lists meant that individual staff reportedly took a cautionary approach to fasting practice:”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataA need was expressed for establishing clarity about roles and responsibilities and for all team members to take ownership.
“A need was expressed for establishing clarity about roles and responsibilities and for all team members to take ownership:”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataA number of resource issues hindered implementation effort, including time for opinion leaders and PDSA facilitators, staff turnover, and lack of permanent staff.
“A number of resource issues hindered implementation effort such as time (specifically for opinion leaders and PDSA facilitators to enact their roles, and for education sessions and team meetings), turnover of staff, and lack of permanent staff.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataFor some, the fasting policy needed updating and two sites did not have a policy.
“For some, the fasting policy needed updating and two sites did not have a policy.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationWhile the evidence was used locally, it did not impact on practice.
“While this showed the evidence was used locally, it did not impact on practice [12].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [12] Rycroft-Malone J, Seers K, Crichton N, Chandler J, Hawkes C, Allen C, Bullock I, Strunin L: A pragmatic randomised controlled trial evaluating three implementation interventions. Implement Sci. 2012, 7: 80-10.1186/1748-5908-7-80. source
Not checked in the free run.
May combine two claims.
Findingown dataIn the current study, individual's risk taking behavior, emotional response, skills and experience, enthusiasm, commitment, and decision-making authority were important factors in the intervention's implementation and impact.
“These are consistent with findings in the current study where individual's risk taking behavior, emotional response, skills and experience, enthusiasm, commitment, and decision-making authority were important factors in the intervention's implementation and impact.”
Quote in the paperSubstantial claim- Rests on an assumption: The process evaluation's self-reported data (interviews) provide a sufficient and accurate account of the implementation activities and their impact.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
Findingnone givenThe findings from this study re-emphasize the multiple and complex deliberative processes involved in implementation work.
“The findings from this study re-emphasize the multiple and complex deliberative processes involved in implementation work.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingreasoningIn this study, the presence of good quality evidence was a constant and proved to be a necessary but not a sufficient condition for changing current practice and routines.
“In this study, the presence of good quality evidence was a constant, however it proved to be a necessary (for example, to guide the development of new local policy/guidance), but not a sufficient condition for changing current practice and routines.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Findingown dataIn this study, we had difficulty mapping the findings onto the high-low continua.
“In this study, we had difficulty mapping the findings onto the high-low continua, which could be illustrative of two things.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningThe interventions, including facilitation components, did not overcome the challenges presented by these factors to a sufficient level to affect fasting outcomes, even though facilitators reported working with individuals and teams on a variety of activities.
“The interventions, including facilitation components, did not overcome the challenges presented by these factors to a sufficient level to affect fasting outcomes even though facilitators reported working with individuals and teams on a variety of activities.”
Quote in the paperSubstantial claim- Rests on an assumption: The lack of effect on duration of fasting in the PoISE trial is a valid indicator of implementation failure rather than of the ineffectiveness of the evidence or of the outcome measure.
May combine two claims.
Findingown dataSome factors were more important than others in providing the conditions for, and influencing the effect of, implementation interventions, including inter-professional team working (including communication), decision-making authority (mediated by inter-professional tensions), and organizational buy-in.
“Findings from this study show that some factors were more important than others in providing the conditions for, and influencing the effect of implementation interventions, which included inter-professional team working (including communication), decision-making authority (mediated by inter-professional tensions), and organizational buy-in, issues evident in others' work [e.g., [34,35].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [34] Brown D, McCormack B: Developing the practice context to enable more effective pain management with older people: an action research study. Implement Sci. 2011, 6: 9-10.1186/1748-5908-6-9. source
Not checked in the free run.
- cites [35] Kavanagh T, Stevens B, Seers K, Sidani S, Watt-Watson J: Process evaluation of appreciate inquiry to translate pain management evidence into pediatric nursing practice. Implement Sci. 2010, 5: 90-10.1186/1748-5908-5-90. source
Not checked in the free run.
May combine two claims.
FindingreasoningIn this study, the evidence for shortening fasting times is scientifically robust and was generally acceptable, but these qualities were not sufficient to outweigh other factors.
“In this study, the evidence for shortening fasting times is scientifically robust and was generally acceptable, but these qualities were not sufficient to outweigh other factors.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataA robust and uncontested evidence base was a necessary but not sufficient condition for practice change, because individual staff and patient responses such as caution influenced decision making.
“A robust and uncontested evidence base was a necessary, but not sufficient condition for practice change, in that individual staff and patient responses such as caution influenced decision making.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationFacilitation is concerned with enabling and making things easier.
“Facilitation is concerned with enabling and making things easier [30].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [30] Harvey G, Loftus-Hills A, Rycroft-Malone J, Titchen A, Kitson A, McCormack B, Seers K: Getting evidence into practice: the role and function of facilitation. J Adv Nurs. 2002, 37 (6): 577-588. 10.1046/j.1365-2648.2002.02126.x. source
Not checked in the free run.
May combine two claims.
Interpretationown dataThese contextual themes interact with each other, such that emotional reactions may be a function of inter-professional issues and a product of individual, team, and organizational communication.
“These themes interact with each other such that, for example, emotional reactions may be a function of inter-professional issues, and a product of individual, team and organizational communication.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe process evaluation data provides a rich picture of implementation processes that offers an explanation for the trial findings and how implementation played out within the practice context.
“The process evaluation data provides a rich picture of implementation processes that offers an explanation for the trial findings, and about how the implementation of interventions played out within the practice context.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningDifferent starting points present challenges to implementation researchers, particularly within the relative confines of a trial design and the implementation of complex interventions.
“Different starting points present challenges to implementation researchers, particularly within the relative confines of a trial design and the implementation of complex interventions.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisecitationPARIHS represents the complexity of implementation by considering the three core elements and their sub-elements to be dynamic and interrelated.
“PARIHS represents the complexity of implementation by considering the three core elements and their sub-elements to be dynamic and interrelated.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [13] Rycroft-Malone J, Kitson A, Harvey G, McCormack B, Seers K, Titchen A, Estabrooks CA: Ingredients for change: Revisiting a conceptual framework. Qual Saf Health Care. 2002, 11: 174-180. 10.1136/qhc.11.2.174. source
Not checked in the free run.
- cites [14] Rycroft-Malone J, Harvey G, Seers K, Kitson A, McCormack B, Titchen A: An exploration of the factors that influence the implementation of evidence into practice. J Clin Nurs. 2004, 13: 913-924. 10.1111/j.1365-2702.2004.01007.x. source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
PremisecitationThe ability to learn from implementation studies would be improved by greater attention on theoretically driven formative and/or process evaluations to help determine how interventions work in different contexts, and to promote the transferability of findings to other settings.
“The ability to learn from implementation studies would be improved by greater attention on theoretically driven formative and/or process evaluations to help determine how interventions work in different contexts, and to promote the transferability of findings to other settings [10,26].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [10] Stetler CB, Legro MW, Wallace CM, Bowman C, Guihan M, Hagedorn H, Kimmel B, Sharp ND, Smith JL: The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. 2006, 21 (Suppl 2): S1-S8. source
Not checked in the free run.
- cites [26] Lewin S, Glenton C, Oxman A: Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009, 339: b3496-10.1136/bmj.b3496. http://www.bmj.com/content/339/bmj.b3496 , source
Not checked in the free run.
May combine two claims.
Interpretationown dataPotentially successful strategies included using existing structures or initiatives already in place to review fasting times and practice, aligning with organizational strategies, working with those in pivotal roles, and initiating awareness raising activities.
“Potentially successful strategies included using existing structures or initiatives already in place to review fasting times and practice, aligning with organizational strategies, working with those in pivotal roles, and the initiation of awareness raising activities.”
Quote in the paperSubstantial claimMay combine two claims.
PremisereasoningBecause there has been a lack of attention to implementation processes within studies, it is difficult to determine why and how interventions may have worked or not, or how to tailor interventions.
“However, because there has been a lack of attention to implementation processes within studies such as those included in these reviews, it is difficult to determine why and how interventions may have worked or not, or how to tailor interventions.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisecitationPARIHS is an example of a middle range explanation or theory about implementation.
“PARIHS is an example of the development of a middle range explanation or theory about implementation [16].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [16] Merton R: On Theoretical Sociology: Five essays old and new. 1967, New York: Free Press
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationThe most successful implementation will occur when evidence is robust and practitioners agree with it, the context is receptive, and implementation processes are appropriately facilitated by internal and/or external facilitators.
“Specifically, the working proposition is that the most successful implementation will occur when evidence is robust and practitioners ‘agree’ with it, the context is receptive, and where implementation processes are appropriately facilitated by internal and/or external facilitators [13,14].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [13] Rycroft-Malone J, Kitson A, Harvey G, McCormack B, Seers K, Titchen A, Estabrooks CA: Ingredients for change: Revisiting a conceptual framework. Qual Saf Health Care. 2002, 11: 174-180. 10.1136/qhc.11.2.174. source
Not checked in the free run.
- cites [14] Rycroft-Malone J, Harvey G, Seers K, Kitson A, McCormack B, Titchen A: An exploration of the factors that influence the implementation of evidence into practice. J Clin Nurs. 2004, 13: 913-924. 10.1111/j.1365-2702.2004.01007.x. source
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationThere may be more promise in the use of interventions that are theoretically based, interactive, and tailored to barriers.
“Generally, this evidence base indicates that there may be more promise in the use of interventions that are theoretically based, interactive, and tailored to barriers [25].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [25] Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, Robertson N: Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010, 10.1002/14651858.CD005470.pub2/abstract;jsessionid=86C5FC23066D86044C938F0C6B589926.d03t03. http://onlinelibrary.wiley.com/ [Art. No.: CD005470.], Issue 3
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningSuccessful implementation of evidence into practice is a planned facilitated process involving an interplay between individuals, evidence, and context to promote evidence-informed practice.
“We propose that successful implementation of evidence into practice is a planned facilitated process involving an interplay between individuals, evidence, and context to promote evidence-informed practice.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
Interpretationown dataA multi-faceted and dynamic story of implementation was evident, consistent with the underlying tenet of PARIHS.
“Consistent with the underlying tenant of PARIHS, a multi-faceted and dynamic story of implementation was evident.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisecitationIn their review of the use of PARIHS, Helfrich et al. found that others had tended to use the framework retrospectively.
“However, in their review of the use of PARIHS, Helfrich et al. [17] found that others had tended to use the framework retrospectively.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [17] Helfrich C, Damschroder L, Hagedorn H, Daggett G, Sahay A, Ritchie M, Damush T, Guihan M, Ullrich P, Stetler C: A critical synthesis of literature on the promoting action on research implementation in health services (PARIHS) framework. Implement Sci. 2010, 5: 82-10.1186/1748-5908-5-82. source
Not checked in the free run.
May combine two claims.
InterpretationreasoningThe PDSA intervention had the potential to work with these complexities, but its delivery was compromised by the challenging environment, including lack of time and opportunity to bring people together to problem solve.
“In theory, the PDSA intervention had the potential to work with these complexities, however, the delivery of this strategy was itself compromised by the challenging environment, including lack of time and opportunity to bring people together to problem solve.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
PremisecitationHelfrich et al. identify three opportunities to refine the PARIHS framework: clarifying the interrelationships and dynamics between elements/sub-elements, providing a more explicit definition of successful implementation, and drawing on other conceptual frameworks and models to elaborate core PARIHS elements.
“the three opportunities to refine the PARIHS framework they identify: being clearer about the interrelationships and dynamics between elements/sub elements would eventually help to identify more generalisable patterns; the need for a more explicit definition for successful implementation; and drawing on other conceptual frameworks and models to further elaborate on core PARIHS elements.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [17] Helfrich C, Damschroder L, Hagedorn H, Daggett G, Sahay A, Ritchie M, Damush T, Guihan M, Ullrich P, Stetler C: A critical synthesis of literature on the promoting action on research implementation in health services (PARIHS) framework. Implement Sci. 2010, 5: 82-10.1186/1748-5908-5-82. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationPatients could have water up to two hours and food up to six hours before induction of anaesthesia, with resumption of fluids when fully awake.
“The recommendations include that patients could have water up to two hours and food up to six hours before induction of anaesthesia, with resumption of fluids when fully awake [28].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [28] RCN/RCoA: Perioperative fasting in adults and children. Clinical Practice guidelines. 2005, London: Royal College of Nursing
Not checked in the free run.
Classified as probably not a substantial claim. May combine two claims.
Interpretationown dataBringing fasting practice more in line with guideline recommendations requires a multi-disciplinary team approach and communication within and across teams and departments.
“Bringing fasting practice more in line with the guideline recommendations requires a multi-disciplinary team approach and communication within and across teams and departments.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenThe analysis process was carried out by three members of the research team, which included cross-checking coding and themes, and emerging themes were shared periodically with the whole research team as an additional check on credibility.
“The analysis process was carried out by three members of the research team, which included cross-checking coding and themes. Emerging themes were also shared periodically with the whole research team as an additional check on credibility.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
PremisereasoningPARIHS appears to have good face validity because it has often been used in implementation activity and is widely cited in the international literature.
“PARIHS appears to have good face validity in that it has been often used in implementation activity and is widely cited in the international literature.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.
InterpretationreasoningThis finding is likely to be fairly typical of many clinical issues underpinned by national guidelines and a function of how organizations set their priorities.
“This finding is likely to be fairly typical of many clinical issues underpinned by national guidelines and a function of how organizations set their priorities.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningApart from revision of information, the higher-rated activities are more active than passive.
“Apart from revision of information, these activities are more active than passive.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe prominent role that individuals played as part of the interaction between evidence and context is not currently explicit within the PARIHS framework.
“However, the prominent role that individuals played as part of the interaction between evidence and context is not currently explicit within the framework.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThe findings present a multi-faceted and dynamic story of implementation, consistent with the underlying tenant of PARIHS.
“Consistent with the underlying tenant of PARIHS, the findings present a multi-faceted and dynamic story of implementation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningSome sites had been championing evidence-based fasting practice for some years, which could explain lower baseline times.
“Some sites had been championing evidence-based fasting practice for some years which could explain lower baseline times.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Premisenone givenTo date, the role, behavior and attributes of individuals have been implicit within the PARIHS framework.
“To date, the role, behavior and attributes of individuals have been implicit within the PARIHS framework.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
Interpretationnone givenThe strength of the framework is in representing the elements' interconnectivity, which should be preserved in this new representation.
“The strength of the framework is in representing the elements' interconnectivity, which should be preserved in this new representation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationcitationThe additional element has the potential to strengthen the framework's usefulness for planning and evaluating implementation efforts and is a reflection of current evidence and theory, particularly discussions about the social processes involved in knowledge mobilisation work.
“The additional element has the potential to strengthen the framework's usefulness for planning and evaluating implementation efforts and is a reflection of current evidence and theory, particularly discussions about the social processes involved in knowledge mobilisation work [43].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [43] Crilly T, Jashapara A, Ferlie E: Research utilisation and knowledge mobilisation: a scoping review of the literature. 2010, NETSCC, [ http://www.netscc.ac.uk/hsdr/files/project/SDO_ES_08-1801-220_V01.pdf ]
Not checked in the free run.
May combine two claims.
Study design and conductreasoningThe study did not have the capacity to undertake observational work and was therefore reliant on self-reported data to reach the conclusions reported in this paper.
“We also did not have the capacity to undertake any observational work, and therefore have been reliant on self-reported data to reach the conclusions reported in this paper.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisecitationIn other theories and frameworks, the individual is acknowledged as a core component.
“In other theories (e.g., Rogers Diffusions) and frameworks (e.g., [6,8,27], the individual is acknowledged as a core component.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [6] Damschroder LJ, Aaron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009, 4: 50-10.1186/1748-5908-4-50. source
Not checked in the free run.
- cites [8] Aarons GA, Hurlburt M, McCue Horwitz S: Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011, 38: 4-23. 10.1007/s10488-010-0327-7. source
Not checked in the free run.
- cites [27] Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationHelfrich et al. encourage better elaboration of PARIHS' core elements.
“Helfrich et al. encourage better elaboration of PARIHS' core elements.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [17] Helfrich C, Damschroder L, Hagedorn H, Daggett G, Sahay A, Ritchie M, Damush T, Guihan M, Ullrich P, Stetler C: A critical synthesis of literature on the promoting action on research implementation in health services (PARIHS) framework. Implement Sci. 2010, 5: 82-10.1186/1748-5908-5-82. source
Not checked in the free run.
May combine two claims.
Study design and conductown dataSome voices are missing from this account, including those of surgeons (who could have participated but did not consent) and senior operational managers (who were not included in the sampling strategy).
“Additionally, there are some voices missing from this account, including those of surgeons (who could have participated, but did not consent to) and senior operational managers (who were not included in our sampling strategy).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationNilson et al. suggest that breaking 'bad' habits could be achieved by changing something in the context or by removing a person from that context.
“These authors suggest that breaking 'bad' habits could be achieved by changing something in the context or by removing a person from that context.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [32] Nilsen P, Roback K, Broström A, Ellström P-E: Creatures of habit: accounting for the role of habit in implementation research on clinical behaviour change. Implement Sci. 2012, 7: 53-10.1186/1748-5908-7-53. source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThe successful implementation of evidence into practice is a planned facilitated process involving an interplay between individuals, evidence, and context to promote evidence-informed practice.
“The successful implementation of evidence into practice is a planned facilitated process involving an interplay between individuals, evidence, and context to promote evidence-informed practice.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningIn-depth data collection within purposively sampled sites may have provided more illuminating evidence about intervention implementation, particularly fidelity.
“In-depth data collection within purposively sampled sites may have provided more illuminating evidence about intervention implementation, particularly fidelity.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThe findings from this evaluation lead to proposing an extension to the PARIHS framework to enhance its usefulness as a conceptual framework that can be applied in practice.
“The findings from this evaluation lead us to proposing an extension to the PARIHS framework to enhance its usefulness as a conceptual framework that can be applied in practice.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningMaking individuals more explicit within the PARIHS framework does not mean they should be separated from the other elements, particularly context.
“It is important to state that making individuals more explicit within the PARIHS framework does not mean they should be separated from the other elements, particularly context.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationcitationThe concept of the individual might incorporate capability, capacity, motivation (including recognising a need for change), resilience, acceptability, feelings, knowledge and beliefs (including self efficacy) about the intervention/evidence, position and fit within the organization/social system, and approach to decision-making.
“we propose that the concept of the individual might incorporate: capability, capacity, motivation (including recognising a need for change), resilience, acceptability, feelings, knowledge and beliefs (including self efficacy) about the intervention/evidence, position and fit within the organization/social system, and approach to decision-making (e.g., experimentation, use of information).”
Quote in the paperNot a substantial claim0 of 8 sources checked- cites [6] Damschroder LJ, Aaron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009, 4: 50-10.1186/1748-5908-4-50. source
Not checked in the free run.
- cites [7] Michie S, van Stralen MV, West R: The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implement Sci. 2011, 6: 42-10.1186/1748-5908-6-42. source
Not checked in the free run.
- cites [8] Aarons GA, Hurlburt M, McCue Horwitz S: Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011, 38: 4-23. 10.1007/s10488-010-0327-7. source
Not checked in the free run.
- cites [27] Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x. source
Not checked in the free run.
- cites [37] Wenger E: Communities of Practice. 1998, Cambridge: Cambridge University Press source
Not checked in the free run.
- cites [40] Squires JE, Estabrooks CA, Gustavsson P, Wallin L: Individual determinants of research utilization by nurses: a systematic review update. Implement Sci. 2011, 6: 1-10.1186/1748-5908-6-1. source
Not checked in the free run.
- cites [41] Meijers JMM, Janssen MAP, Cummings G, Wallin L, Estabrooks CA, Halfens R: Assessing the relationships between contextual factors and research utilization in nursing: systematic literature review. J Adv Nurs. 2006, 55 (5): 622-635. 10.1111/j.1365-2648.2006.03954.x. source
Not checked in the free run.
- cites [42] Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A: Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005, 14 (1): 26-33. 10.1136/qshc.2004.011155. source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThe PARIHS framework should be enhanced to ensure theoretical development keeps pace with the current evidence base for implementation.
“In this paper, we propose that the PARIHS framework should be enhanced to ensure theoretical development keeps a pace with the current evidence base for implementation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationHelfrich et al. suggest that successful implementation should take a logic model approach to linking the implementation strategy to outcomes, including the realization of an implementation plan, the achievement and maintenance of the targeted evidence-based practice, and the achievement and maintenance of patient or organizational outcomes.
“Helfrich et al. [17] suggest that successful implementation should take a logic model approach to linking the implementation strategy to outcomes, including the realization of an implementation plan, the achievement and maintenance of the targeted evidence-based practice, and the achievement and maintenance of patient or organizational outcomes.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [17] Helfrich C, Damschroder L, Hagedorn H, Daggett G, Sahay A, Ritchie M, Damush T, Guihan M, Ullrich P, Stetler C: A critical synthesis of literature on the promoting action on research implementation in health services (PARIHS) framework. Implement Sci. 2010, 5: 82-10.1186/1748-5908-5-82. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenAlthough the study design and interventions were prospectively designed based on the core elements of PARIHS, the evaluation of the framework has been retrospective.
“Although the study design and interventions were prospectively designed based on the core elements of PARIHS, our evaluation of the framework has been retrospective.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
InterpretationreasoningThe link between behavior and context is made explicit by habit theory, and fits well with the relationship between evidence and context in PARIHS.
“The link between behavior and context is made explicit by habit theory, and fits well with the relationship between evidence and context in PARIHS.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningIn this study, one explanation for the lack of change is that practitioners' practices were habituated towards maintaining traditional (non evidence-informed) ways of working, which then becomes their stable (and familiar) context.
“In this study, the information in recommendations would not have been new to most practitioners; however, one explanation is that their practices were habituated towards maintaining traditional (non evidence-informed) ways of working, which then becomes their stable (and familiar) context.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe idea of creating a dissonance or awakening that current practice is not necessarily appropriate practice is a feature of other literatures including practice development.
“This is similar to the idea of creating a dissonance or awakening that current practice is not necessarily appropriate practice, which is a feature of other literatures including practice development [33].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [33] McCormack B, Dewing J, McCance T: Developing person-centred care: addressing contextual challenges through practice development. Online J Issues Nursing. 2011, 16: 3-
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationNilson et al. suggest that those who develop habitual behaviors are less likely to act on, or may avoid, new information that challenges current practice, particularly in contexts that remain stable.
“They suggest that those who develop habitual behaviors are less likely to act on, or may avoid new information that challenges current practice—particularly in contexts that remain stable.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [32] Nilsen P, Roback K, Broström A, Ellström P-E: Creatures of habit: accounting for the role of habit in implementation research on clinical behaviour change. Implement Sci. 2012, 7: 53-10.1186/1748-5908-7-53. source
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationHelfrich et al. suggest that the high-low continua within PARIHS could encourage a tendency towards linear relationships between elements.
“Helrich et al. [17] suggest that the high-low continua within PARIHS could encourage a tendency towards linear relationships between elements.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [17] Helfrich C, Damschroder L, Hagedorn H, Daggett G, Sahay A, Ritchie M, Damush T, Guihan M, Ullrich P, Stetler C: A critical synthesis of literature on the promoting action on research implementation in health services (PARIHS) framework. Implement Sci. 2010, 5: 82-10.1186/1748-5908-5-82. source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningIt could be suggested that organizations and systems become habituated, such that 12-hour fasts become so embedded and institutionalized that this standard becomes the acceptable norm.
“Equally, it could be suggested that organizations and systems become habituated, such that in the case of fasting for example, 12-hour fasts become so embedded and institutionalized that this standard becomes the acceptable norm.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisereasoningIndividuals are not explicitly part of the PARIHS framework but are embedded implicitly within evidence, context, and facilitation.
“Currently individuals are not explicitly part of the PARIHS framework but are embedded implicitly within evidence (individuals interact with evidence), context (individuals are part of context), and facilitation (facilitators work with individuals and teams).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenOver the last decade or so there has been a shift away from a focus on individuals to one that recognizes the role that context plays in implementation.
“Over the last decade or so there has been a shift away from a focus on individuals (in the context of the evidence-based practice movements) to one that recognizes the role that context plays in implementation.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningUsing the high-low continuum may be more helpful for a visual representation at diagnosis but less useful in evaluating the process of implementation because it does not capture dynamism and patterns of interactions over time.
“Using the high-low continuum may be more helpful in providing a visual representation at diagnosis (i.e., a snapshot), but less useful in evaluating the process of implementation because this does not capture dynamism and patterns of interactions over time.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Premisenone givenSuccessful Implementation has not been explicitly defined in previous PARIHS publications.
“Successful Implementation (SI) has not been explicitly defined in previous PARIHS publications.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationcitationA logic model can encourage a linear and deductive approach to the identification of inputs, processes and outcomes, which does not fit well with the underlying premise of PARIHS, which acknowledges dynamism and the potential for inductive explanation.
“A logic model can (although does not have to) encourage a linear and deductive approach to the identification of inputs, processes and outcomes, which does not fit well with the underlying premise of PARIHS, which acknowledges dynamism and the potential for inductive explanation [36].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [36] Kitson A, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A: Evaluating the successful implementation of evidence into practice using the PARIHS framework: theoretical and practical challenges. Implement Sci. 2008, 3 (1): 1-10.1186/1748-5908-3-1. source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningIndividuals are currently implicitly embedded within PARIHS, but the significance of individuals within implementation is perhaps currently under-represented.
“Individuals are currently implicitly embedded within PARIHS in that facilitators work with individuals, contexts include individuals, and individuals interact with evidence, however, the significance of individuals within implementation is perhaps currently under-represented.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThis definition includes the need to pay attention to planning, the process, and evaluation of implementation activity in an iterative rather than staged approach.
“This definition includes the need to pay attention to planning, the process, and evaluation of implementation activity in an iterative rather than staged approach.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThe addition of 'individuals' to the conceptualisation of successful implementation is timely, particularly in the context of a growing emphasis in the empirical and theoretical literature on behavior and social processes.
“The framework has been developed and refined over time, therefore the addition of 'individuals' to the conceptualisation of successful implementation is timely, particularly in the context of a growing emphasis in the empirical and theoretical literature on behavior and social processes.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningThis shift has arguably resulted in an inattention to the study of individual factors, specifically the interplay between actors and the contexts in which they work and how that interplay influences change processes and impacts.
“Arguably this shift has resulted in an inattention to the study of individual factors, specifically the interplay between actors and the contexts in which they work and how that interplay influences change processes and impacts.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
Interpretationown dataIt could be argued that individual's behavior, intentions and actions should be part of a framework that seeks to explain successful implementation.
“Therefore, it could be argued that individual's behavior, intentions and actions should be part of a framework that seeks to explain successful implementation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningA more helpful definition of successful implementation is an orchestrated (active, planned) effort to make evidence-based changes by organizations, teams, and individuals that result in sustained improvements to care, patient outcomes, and service delivery, driven by and embedded in organizational strategy.
“A more helpful definition, which acknowledges implementation as a process might be: an orchestrated (active, planned) effort to make evidence-based changes by organizations, teams, and individuals that result in sustained improvements to care, patient outcomes, and service delivery, which are driven by and embedded in organizational strategy.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
The study was conducted during a period of major NHS changes that impacted staff turnover, workforce reviews, and reorganizations.
“This study was conducted at a time of major NHS changes, including reconfigurations, changes to junior medical staff training grades, and a re-focus on financial deficits impacting on staff turnover, workforce reviews, and reorganizations.”
The paper relies on this without support.
The PARIHS framework is a useful heuristic for guiding the development and evaluation of implementation processes.
“PARIHS was embedded within our evaluation framework because it provided a potentially useful heuristic to guide the development of the study and evaluate the process of implementation.”
The paper relies on this without support.
The process evaluation's self-reported data (interviews) provide a sufficient and accurate account of the implementation activities and their impact.
“We also did not have the capacity to undertake any observational work, and therefore have been reliant on self-reported data to reach the conclusions reported in this paper.”
The paper relies on this without support.
The lack of effect on duration of fasting in the PoISE trial is a valid indicator of implementation failure rather than of the ineffectiveness of the evidence or of the outcome measure.
“Given the lack of effect on duration of fasting as a primary outcome, it is difficult to judge the relative impact of the activities of opinion leaders and PDSA facilitators.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Individuals and teams have an impact in supporting or resisting an innovation.
“This extension enables the i-PARIHS framework to consider the impact individuals and teams have in supporting or resisting an innovation.”
From PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice (2015) · cites this paper as [12]
Growing evidence indicates that individuals play a key role in the implementation process.
“Growing evidence on the key role individuals play in the implementation process [12]”
From PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice (2015) · cites this paper as [12]
Context often plays a subordinate role; where it is considered explicitly, it is usually restricted to an organisational context.
“Context often plays a subordinate role; where it is considered explicitly, it is usually restricted to an organisational context [27, 44, 91].”
From Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework (2017) · cites this paper as [91]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Change-agent interview total does not add up
MinorTable 2 lists 12 pre-intervention and 12 post-intervention change-agent interviews, which sum to 24, not the reported total of 21.
Reported 21 · recomputed 24
“| Change Agent Interviews | 12 | 12 | 21 |”
Pre-intervention key-contact counts differ between tables
MinorTable 2 reports 16 pre-intervention key-contact interviews, while Table 3 reports 19 pre-intervention key contacts.
“| Key Contact Interviews | 16 | 12 | 28 |”
“| 19 Key contacts | 6 PDSA facilitators | 12** interviews from a possible 19 |”
Cites
Communities of Practice: Learning, Meaning, and Identity
Wenger, E. (1998) · doi:10.1017/cbo9780511803932 · Cited by 23,500 · see citing works
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 3× · see citing works
“Additionally, the study’s framework incorporates the idea that there are influential factors at micro, meso, and macro organizational layers of context [6,27].”
BackgroundMethodMichie, S., van Stralen, M. M., & West, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-42 · Cited by 13,697 · cited 3× · see citing works
“Theory is relevant and applicable to implementation research in a number of ways [3,7,9-11], including in the choice and development of interventions, for identifying appropriate outcomes, measures, and variables of interest, and in guiding the evaluation of implementation processes and outcomes.”
BackgroundMethodQualitative research in health care: Analysing qualitative data
Pope, C. (2000) · BMJ · doi:10.1136/bmj.320.7227.114 · Cited by 8,131 · see citing works
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · cited 2× · see citing works
“Additionally, the study’s framework incorporates the idea that there are influential factors at micro, meso, and macro organizational layers of context [6,27].”
BackgroundMethodQualitative data analysis for applied policy research
(2002) · Analyzing Qualitative Data · doi:10.4324/9780203413081-14 · Cited by 4,964 · cited 1× · see citing works
“A process of inductive and deductive analysis was undertaken informed by Ritchie and Spencer’s [29] approach to analysis, specifically, their approach to concept identification and thematic framework development.”
MethodMaking psychological theory useful for implementing evidence based practice: a consensus approach
Michie, S. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.011155 · Cited by 3,440 · see citing works
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 1× · see citing works
“Historically, there had been a lack of attention to theory in implementation research, however in recent years there has been a growing interest in its development and use [2-8].”
BackgroundEffectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044 · cited 2× · see citing works
“Drawing on a variable evidence base about the relative effectiveness of implementation interventions [18-24], three trial interventions were developed and randomly allocated to 19 participating hospitals in England, Scotland, Wales, and Northern Ireland: standard dissemination, a web-based resource championed by an op…”
BackgroundMethodBero, L. A., Grilli, R., Grimshaw, J. M., Harvey, E., Oxman, A. D., & Thomson, M. A. (1998) · BMJ · doi:10.1136/bmj.317.7156.465 · Cited by 2,396 · see citing works
A theory of organizational readiness for change
Weiner, B. J. (2009) · Implementation Science · doi:10.1186/1748-5908-4-67 · Cited by 2,268 · see citing works
Kitson, A. L., Rycroft-Malone, J., Harvey, G., McCormack, B., Seers, K., & Titchen, A. (2008) · Implementation Science · doi:10.1186/1748-5908-3-1 · Cited by 1,314 · cited 1× · see citing works
“A logic model can (although does not have to) encourage a linear and deductive approach to the identification of inputs, processes and outcomes, which does not fit well with the underlying premise of PARIHS, which acknowledges dynamism and the potential for inductive explanation [36].”
BackgroundSelf-citationBaker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., & Robertson, N. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub2 · Cited by 1,003 · see citing works
Gabbay, J., & May, A. L. (2004) · BMJ · doi:10.1136/bmj.329.7473.1013 · Cited by 986 · cited 1× · see citing works
“Findings from this study and evidence from others’ research and conceptualisations of evidencebased change and theory show the crucial role that individuals plays in the relative success of evidence-based change [6,7,27,37-39].”
MethodEccles, M., Grimshaw, J., Walker, A., Johnston, M., & Pitts, N. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.09.002 · Cited by 917 · cited 1× · see citing works
“Theory is relevant and applicable to implementation research in a number of ways [3,7,9-11], including in the choice and development of interventions, for identifying appropriate outcomes, measures, and variables of interest, and in guiding the evaluation of implementation processes and outcomes.”
BackgroundEffectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J. M., Thomas, R. E., MacLennan, G., Fraser, C., Ramsay, C. R., Vale, L., Whitty, P., Eccles, M. P., Matowe, L., Shirran, L., et al. (2005) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462305290190 · Cited by 864 · see citing works
Individual determinants of research utilization by nurses: a systematic review update
Squires, J. E., Estabrooks, C. A., Gustavsson, P., & Wallin, L. (2011) · Implementation Science · doi:10.1186/1748-5908-6-1 · Cited by 798 · see citing works
Getting evidence into practice: the role and function of facilitation
Harvey, G., Loftus‐Hills, A., Rycroft‐Malone, J., Titchen, A., Kitson, A., McCormack, B., & Seers, K. (2002) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2002.02126.x · Cited by 730 · cited 1× · see citing works
“Facilitation is concerned with enabling and making things easier [30].”
BackgroundSelf-citationIngredients for change: revisiting a conceptual framework
Rycroft-Malone, J. (2002) · Quality and Safety in Health Care · doi:10.1136/qhc.11.2.174 · Cited by 701 · cited 2× · see citing works
“The aim is to provide an explanation of implementation processes, and how this contributes to theory building through the development of the Promoting Action on Research Implementation in Health Services (PARIHS) framework [13-15].”
BackgroundSelf-citationEvidence for the impact of quality improvement collaboratives: systematic review
Schouten, L. M. T., Hulscher, M., van Everdingen, J. J. E., Huijsman, R., & Grol, R. P. T. M. (2008) · BMJ · doi:10.1136/bmj.39570.749884.be · Cited by 683 · cited 2× · see citing works
“Drawing on a variable evidence base about the relative effectiveness of implementation interventions [18-24], three trial interventions were developed and randomly allocated to 19 participating hospitals in England, Scotland, Wales, and Northern Ireland: standard dissemination, a web-based resource championed by an op…”
BackgroundMethodLewin, S., Glenton, C., & Oxman, A. D. (2009) · BMJ · doi:10.1136/bmj.b3496 · Cited by 678 · cited 1× · see citing works
“The ability to learn from implementation studies would be improved by greater attention on theoretically driven formative and/or process evaluations to help determine how interventions work in different contexts, and to promote the transferability of findings to other settings [10,26].”
BackgroundThe role of formative evaluation in implementation research and the QUERI experience
Stetler, C. B., Legro, M. W., Wallace, C. M., Bowman, C., Guihan, M., Hagedorn, H., Kimmel, B., Sharp, N. D., & Smith, J. L. (2006) · Journal of General Internal Medicine · doi:10.1007/s11606-006-0267-9 · Cited by 642 · cited 2× · see citing works
“The ability to learn from implementation studies would be improved by greater attention on theoretically driven formative and/or process evaluations to help determine how interventions work in different contexts, and to promote the transferability of findings to other settings [10,26].”
BackgroundAn exploration of the factors that influence the implementation of evidence into practice
Rycroft‐Malone, J., Harvey, G., Seers, K., Kitson, A., McCormack, B., & Titchen, A. (2004) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2004.01007.x · Cited by 623 · cited 2× · see citing works
“The aim is to provide an explanation of implementation processes, and how this contributes to theory building through the development of the Promoting Action on Research Implementation in Health Services (PARIHS) framework [13-15].”
BackgroundSelf-citationAn implementation research agenda
Eccles, M. P., Armstrong, D., Baker, R., Cleary, K., Davies, H., Davies, S., Glasziou, P., Ilott, I., Kinmonth, A.-L., Leng, G., et al. (2009) · Implementation Science · doi:10.1186/1748-5908-4-18 · Cited by 481 · see citing works
Self-citationA Guide for applying a revised version of the PARIHS framework for implementation
Stetler, C. B., Damschroder, L. J., Helfrich, C. D., & Hagedorn, H. J. (2011) · Implementation Science · doi:10.1186/1748-5908-6-99 · Cited by 402 · cited 1× · see citing works
“The aim is to provide an explanation of implementation processes, and how this contributes to theory building through the development of the Promoting Action on Research Implementation in Health Services (PARIHS) framework [13-15].”
BackgroundDesigning theoretically-informed implementation interventions
The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG) (2006) · Implementation Science · doi:10.1186/1748-5908-1-4 · Cited by 380 · see citing works
Models and Frameworks for Implementing Evidence-Based Practice: Linking Evidence to Action
Rycroft‐Malone, J., & Bucknall, T. K. (2010) · Cited by 360 · see citing works
Self-citationOn Theoretical Sociology: Five Essays, Old and New
Merton, R. Κ. (1967) · Cited by 348 · see citing works
Helfrich, C. D., Damschroder, L. J., Hagedorn, H. J., Daggett, G. S., Sahay, A., Ritchie, M., Damush, T., Guihan, M., Ullrich, P. M., & Stetler, C. B. (2010) · Implementation Science · doi:10.1186/1748-5908-5-82 · Cited by 306 · cited 4× · see citing works
“[17] found that others had tended to use the framework retrospectively.”
BackgroundMethodInfluentialNilsen, P., Roback, K., Broström, A., & Ellström, P.-E. (2012) · Implementation Science · doi:10.1186/1748-5908-7-53 · Cited by 284 · cited 1× · see citing works
“[32] discuss the potential role of habit theory in changing healthcare practitioners’ daily practice.”
BackgroundGuideline implementation in allied health professions: a systematic review of the literature
Hakkennes, S., & Dodd, K. (2008) · Quality and Safety in Health Care · doi:10.1136/qshc.2007.023804 · Cited by 218 · cited 2× · see citing works
“Drawing on a variable evidence base about the relative effectiveness of implementation interventions [18-24], three trial interventions were developed and randomly allocated to 19 participating hospitals in England, Scotland, Wales, and Northern Ireland: standard dissemination, a web-based resource championed by an op…”
BackgroundMethodMeijers, J. M. M., Janssen, M. A. P., Cummings, G. G., Wallin, L., Estabrooks, C. A., & Y.G. Halfens, R. (2006) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2006.03954.x · Cited by 214 · cited 1× · see citing works
“Evidence suggests that many individual level factors including beliefs, attitudes, motivations, values, skills, competence, behavior, and characteristics may be influential [40,41].”
BackgroundDeveloping Person-Centred Care: Addressing Contextual Challenges Through Practice Development
McCormack, B. G., Dewing, J., & McCance, T. (2011) · OJIN The Online Journal of Issues in Nursing · doi:10.3912/ojin.vol16no02man03 · Cited by 212 · cited 1× · see citing works
“This is similar to the idea of creating a dissonance or awakening that current practice is not necessarily appropriate practice, which is a feature of other literatures including practice development [33].”
BackgroundSources of Practice Knowledge Among Nurses
Estabrooks, C. A., Rutakumwa, W., O’Leary, K. A., Profetto-McGrath, J., Milner, M., Levers, M. J., & Scott-Findlay, S. (2005) · Qualitative Health Research · doi:10.1177/1049732304273702 · Cited by 208 · see citing works
Interventions aimed at increasing research use in nursing: a systematic review
Thompson, D. S., Estabrooks, C. A., Scott-Findlay, S., Moore, K., & Wallin, L. (2007) · Implementation Science · doi:10.1186/1748-5908-2-15 · Cited by 205 · see citing works
Dopson, S., & Fitzgerald, L. (2005) · doi:10.1093/acprof:oso/9780199259014.001.0001 · Cited by 161 · see citing works
Theory and Knowledge Translation: Setting Some Coordinates
Rycroft-Malone, J. (2007) · Nursing Research · doi:10.1097/01.nnr.0000280631.48407.9b · Cited by 131 · cited 1× · see citing works
“Historically, there had been a lack of attention to theory in implementation research, however in recent years there has been a growing interest in its development and use [2-8].”
BackgroundSelf-citationCheater, F., Baker, R., Hearnshaw, H., Robertson, N., Hicks, N., Oxman, A., & Flottorp, S. A. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001483.pub2 · Cited by 89 · see citing works
Clinical guidelines in nursing, midwifery and the therapies: a systematic review
Thomas, McColl, Cullum, N. A., Rousseau, N. S., & Soutter (1999) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.1999.01047.x · Cited by 89 · cited 2× · see citing works
“Drawing on a variable evidence base about the relative effectiveness of implementation interventions [18-24], three trial interventions were developed and randomly allocated to 19 participating hospitals in England, Scotland, Wales, and Northern Ireland: standard dissemination, a web-based resource championed by an op…”
BackgroundMethodFrench, B., Thomas, L. H., Baker, P., Burton, C. R., Pennington, L., & Roddam, H. (2009) · Implementation Science · doi:10.1186/1748-5908-4-28 · Cited by 86 · see citing works
Willson, R. (2019) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3295750.3298964 · Cited by 85 · see citing works
A pragmatic cluster randomised trial evaluating three implementation interventions
Rycroft-Malone, J., Seers, K., Crichton, N., Chandler, J., Hawkes, C. A., Allen, C., Bullock, I., & Strunin, L. (2012) · Implementation Science · doi:10.1186/1748-5908-7-80 · Cited by 71 · see citing works
Self-citationCollins, P., Abelson, J., & Eyles, J. D. (2006) · Health Policy · doi:10.1016/j.healthpol.2006.02.014 · Cited by 63 · see citing works
Evaluating the impact of implementing evidence-based practice
Bick, D., & Graham, D. I. (2010) · Cited by 61 · see citing works
Brown, D., & McCormack, B. G. (2011) · Implementation Science · doi:10.1186/1748-5908-6-9 · Cited by 47 · see citing works
Purdy, S., & Griffin, T. P. (2008) · BMJ · doi:10.1136/bmj.39394.402465.be · Cited by 45 · see citing works
Research Utilisation & Knowledge Mobilisation: A Scoping Review of the Literature
Crilly, T., Consulting, C. B., & Jashapara, A. (2010) · Cited by 38 · see citing works
Kavanagh, T., Stevens, B., Seers, K., Sidani, S., & Watt-Watson, J. (2010) · Implementation Science · doi:10.1186/1748-5908-5-90 · Cited by 35 · see citing works
Self-citation
Flagged first, then by citations
1 of the 49 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Rycroft-Malone J, Bucknall T: Theory, models and frameworks. Models and Frameworks for Implementing Evidence-Based Practice. Edited by: Rycroft-Malone J, Bucknall T. 2010, Oxford: Wiley-Blackwell, 23-47.
- RCN/RCoA: Perioperative fasting in adults and children. Clinical Practice guidelines. 2005, London: Royal College of Nursing
Cited by
Sorted by citations
Standards for Reporting Implementation Studies (StaRI) Statement
Pinnock, H., Barwick, M., Carpenter, C. R., Eldridge, S., Grandes, G., Griffiths, C. J., Rycroft-Malone, J., Meissner, P., Murray, E., Patel, A., et al. (2017) · BMJ · doi:10.1136/bmj.i6795 · Cited by 1,446 · see citing works
Self-citationHarvey, G., & Kitson, A. (2015) · Implementation Science · doi:10.1186/s13012-016-0398-2 · Cited by 1,271 · see citing works
Pfadenhauer, L. M., Gerhardus, A., Mozygemba, K., Lysdahl, K. B., Booth, A., Hofmann, B., Wahlster, P., Polus, S., Burns, J., Brereton, L., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0552-5 · Cited by 1,016 · see citing works
“ordinate role; where it is considered explicitly, it is usually restricted to an organisational context [27, 44, 91].”
BackgroundThe dark side of coproduction: do the costs outweigh the benefits for health research?
Oliver, K., Kothari, A., & Mays, N. (2019) · Health Research Policy and Systems · doi:10.1186/s12961-019-0432-3 · Cited by 754 · see citing works
Moullin, J. C., Sabater-Hernández, D., Fernandez-Llimos, F., & Benrimoj, S. I. (2015) · Health Research Policy and Systems · doi:10.1186/s12961-015-0005-z · Cited by 392 · see citing works
“Innovations were classified into groups: interventions (including those termed interventions, programs, innovations, complex interventions/innovations, shared-decision making, technologies, evidence-based practices, and telehealth; n = 22) [13,15,16,29,33-37,39-56], guidelines (including clinical-practice, best-practi…”
BackgroundStandards for Reporting Implementation Studies (StaRI): explanation and elaboration document
Pinnock, H., Barwick, M. A., Carpenter, C. R., Eldridge, S. M., Grandes, G., Griffiths, C., Rycroft‐Malone, J., Meißner, P., Murray, E., Patel, A. K., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013318 · Cited by 342 · see citing works
“Explanation Successful implementation of evidence into practice is a planned facilitated process involving the interplay between individuals, evidence and context to promote evidence-informed practice.(37) A rich description of the context is critical to enable readers to assess the external validity of the study,(38)…”
BackgroundSelf-citationGoodman, D., Ogrinc, G. S., Davies, L., Baker, G. R., Barnsteiner, J., Foster, T. C., Gali, K., Hilden, J. M., Horwitz, L. I., Kaplan, H. C., et al. (2016) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004480 · Cited by 386 · see citing works
The influence of contextual factors on healthcare quality improvement initiatives: a realist review
Coles, E., Anderson, J., Maxwell, M., Harris, F. M., Gray, N. M., Milner, G., & MacGillivray, S. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01344-3 · Cited by 246 · see citing works
“Many studies considered and compared pre- and post-implementation contexts [38, 41, 46, 48, 67].”
BackgroundMethodImplementing research results in clinical practice- the experiences of healthcare professionals
Kristensen, N., Nymann, C., & Konradsen, H. (2015) · BMC Health Services Research · doi:10.1186/s12913-016-1292-y · Cited by 228 · see citing works
Context and implementation: A concept analysis towards conceptual maturity
Pfadenhauer, L. M., Mozygemba, K., Gerhardus, A., Hofmann, B., Booth, A., Lysdahl, K. B., Tummers, M., Burns, J., & Rehfuess, E. A. (2015) · Zeitschrift für Evidenz, Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2015.01.004 · Cited by 189 · see citing works
Advancing complexity science in healthcare research: the logic of logic models
Mills, T., Lawton, R., & Sheard, L. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0701-4 · Cited by 190 · see citing works
Cranley, L. A., Cummings, G. G., Profetto‐McGrath, J., Tóth, F., & Estabrooks, C. A. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-014384 · Cited by 196 · see citing works
“Supports the development of new knowledge and skills • Support the development of new knowledge and/ or skills.[47, 70, 80, 81, 96, 101, 110, 116, 128, 130, 152, 158, 167, 172, 173, 183, 192, 197, 209] • Helps staff to learn to access and/or appraise evidence to answer clinical questions and apply it to their practice.”
BackgroundGifford, W., Squires, J. E., Angus, D. E., Ashley, L. A., Brosseau, L., Craik, J. M., Domecq, M., Egan, M. Y., Holyoke, P., Juergensen, L., et al. (2018) · Implementation Science · doi:10.1186/s13012-018-0817-7 · Cited by 156 · see citing works
Melnyk, B. M., Gallagher‐Ford, L., Thomas, B. K., Troseth, M. R., Wyngarden, K., & Szalacha, L. A. (2016) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12133 · Cited by 161 · see citing works
“…interprofessional healthcare executives to build a culture and environment that supports the implementation and sustainability of evidence-based care in order to achieve best outcomes, which includes the provision of necessary EBP resources and tools (Melnyk, 2014a; Rycroft-Malone et al., 2013).”
BackgroundBergström, A., Ehrenberg, A., Eldh, A. C., Graham, I. D., Gustafsson, K., Harvey, G., Hunter, S. C., Kitson, A. A., Rycroft‐Malone, J., & Wallin, L. (2020) · Implementation Science · doi:10.1186/s13012-020-01003-0 · Cited by 149 · see citing works
Self-citationDavies, H. T. O., Powell, A. E., & Nutley, S. (2015) · Health Services and Delivery Research · doi:10.3310/hsdr03270 · Cited by 157 · see citing works
10 years of mindlines: a systematic review and commentary
Wieringa, S., & Greenhalgh, T. (2015) · Implementation Science · doi:10.1186/s13012-015-0229-x · Cited by 150 · see citing works
“Two studies describe efforts to set up (and influence the behaviour of ) communities of practice among researchers [41] and doctors [42] by employing a facilitator and co-ordinator respectively, though each of these studies mentions mindlines only in passing.”
BackgroundMcCormack, B. G., Rycroft‐Malone, J., DeCorby, K., Hutchinson, A. M., Bucknall, T. K., Kent, B., Schultz, A. A., Snelgrove‐Clarke, E., Stetler, C., Titler, M. G., et al. (2013) · Implementation Science · doi:10.1186/1748-5908-8-107 · Cited by 150 · see citing works
“Evidenceinformed decision making models advocate for research evidence to be considered in conjunction with clinical expertise, patient preferences and values, and available resources [8].”
BackgroundInfluentialSelf-citationTools to support evidence-informed public health decision making
Yost, J., Dobbins, M., Traynor, R., DeCorby, K., Workentine, S., & Greco, L. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-728 · Cited by 116 · see citing works
“Careful consideration of context is required in developing strategies for implementing knowledge translation strategies [85-87].”
BackgroundTurner, S., D’Lima, D., Hudson, E., Stephen Morris, A., Sheringham, J., Swart, N., & Fulop, N. (2017) · Implementation Science · doi:10.1186/s13012-017-0669-6 · Cited by 88 · see citing works
“practitioner and patient judgements about how such evidence should be used to make decisions and/or change services [57].”
BackgroundInfluentialThe MOVE ON Team, Moore, J. E., Johnson, A. M., Marquez, C., Almaawiy, U., Chan, W.-H., D’Souza, J., Liu, B., & Straus, S. E. (2014) · Implementation Science · doi:10.1186/s13012-014-0160-6 · Cited by 106 · see citing works
“In particular, context has a key role in the success or failure of implementation interventions [1-6].”
BackgroundPannick, S., Sevdalis, N., & Athanasiou, T. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004453 · Cited by 114 · see citing works
Moullin, J. C., Sabater-Hernández, D., & Benrimoj, S. I. (2016) · BMC Health Services Research · doi:10.1186/s12913-016-1689-7 · Cited by 108 · see citing works
“These changes were based on implementation literature [49, 50] assessments of CFIR [51], and pharmacy practice literature [48].”
Burnout and Leadership Style in Behavioral Health Care: a Literature Review
Kelly, R. J., & Hearld, L. R. (2020) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-019-09679-z · Cited by 118 · see citing works
Bidassie, B., Williams, L. S., Woodward-Hagg, H., Matthias, M. S., & Damush, T. M. (2015) · Implementation Science · doi:10.1186/s13012-015-0252-y · Cited by 86 · see citing works
“Gozdzik A. Applying the PARiHS framework in a knowledge dissemination initiative.”
BackgroundInfluentialImplementation of evidence-based practice: The experience of nurses and midwives
Dagne, A. H., & Beshah, M. H. (2021) · PLoS ONE · doi:10.1371/journal.pone.0256600 · Cited by 108 · see citing works
“Studies suggested that IEBP is intervened by an interplay between the individuals, the new knowledge, and the actual context in which the sources of evidence are to be organized and utilized in daily practice [13, 14].”
BackgroundGifford, W., Graham, I. D., Ehrhart, M. G., Davies, B., & Aarons, G. A. (2017) · Journal of Healthcare Leadership · doi:10.2147/jhl.s125558 · Cited by 84 · see citing works
“18 Theories of implementation are essentially theories of planned change, providing an understanding of how and why implementation works.”
Ahlqvist‐Björkroth, S., Boukydis, Z., Axelin, A., & Lehtonen, L. (2016) · Behavioural Brain Research · doi:10.1016/j.bbr.2016.10.020 · Cited by 82 · see citing works
What patients do and their impact on implementation
Boaz, A., Robert, G., Locock, L., Sturmey, G., Gager, M., Vougioukalou, S. A., Ziébland, S., & Fielden, J. (2016) · Journal of Health Organization and Management · doi:10.1108/jhom-02-2015-0027 · Cited by 82 · see citing works
Gagliardi, A. R., Webster, F., Brouwers, M. C., Baxter, N. N., Finelli, A., & Gallinger, S. (2014) · BMC Health Services Research · doi:10.1186/s12913-014-0545-x · Cited by 72 · see citing works
“Rycroft-Malone J, Seers K, Chandler J, Hawkes CA, Crichton N, Allen C, Bullock I, Strunin L: The role of evidence, context and facilitation in an implementation trial: implications for the development of the PARIHS framework.”
BackgroundMethodInfluentialHow Practice Facilitation Strategies Differ by Practice Context
Nguyen, A. M., Cuthel, A. M., Padgett, D. K., Niles, P. M., Rogers, E., Pham-Singer, H., Ferran, D., Kaplan, S. A., Berry, C. A., & Shelley, D. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-05350-7 · Cited by 66 · see citing works
Häggman‐Laitila, A., Mattila, L., & Melender, H. (2016) · Nurse Education Today · doi:10.1016/j.nedt.2016.04.023 · Cited by 67 · see citing works
The interplay of contextual elements in implementation: an ethnographic case study
McCullough, M. B., Chou, A. F., Solomon, J., Petrakis, B. A., Kim, B., Park, A. M., Benedict, A. J., Hamilton, A. B., & Rose, A. J. (2015) · BMC Health Services Research · doi:10.1186/s12913-015-0713-7 · Cited by 60 · see citing works
“Therefore, the present study thus has the potential to extend and deepen PARIHS as an implementation framework [1,2,9,11,12].”
BackgroundPrihodová, L., Guérin, S., Tunney, C., & Kernohan, G. W. (2018) · Journal of Advanced Nursing · doi:10.1111/jan.13836 · Cited by 66 · see citing works
Chandler, J., Rycroft‐Malone, J., Hawkes, C., & Noyes, J. (2016) · Journal of Advanced Nursing · doi:10.1111/jan.12815 · Cited by 70 · see citing works
Self-citationLindsay, J. A., Kauth, M. R., Hudson, S., Martin, L. A., Ramsey, D. J., Daily, L., & Rader, J. (2015) · Telemedicine and e-Health · doi:10.1089/tmj.2014.0114 · Cited by 66 · see citing works
“The PARIHS model hypothesizes that three interacting components predict the success of implementation of evidence-based practice: the quality of the evidence base; the context in which implementation efforts occur; and facilitation, described as provision of support by agents for adoption of the change.(24) Facilitati…”
MethodGifford, W., Zhang, Q., Chen, S., Davies, B., Xie, R., Wen, S. W., & Harvey, G. (2018) · BMC Nursing · doi:10.1186/s12912-018-0295-x · Cited by 60 · see citing works
“Education and training were described as necessary to facilitate EBP in our study; however, research has shown that implementation is complex and education alone will not ensure research findings are used in practice [61, 62], particularly where respect for social order is a strong influence on how people act.”
BackgroundMetz, A. J. R., Jensen, T. M., Farley, A. B., & Boaz, A. (2022) · Implementation Research and Practice · doi:10.1177/26334895221105585 · Cited by 58 · see citing works
Duan, Y., Iaconi, A., Wang, J., Perez, J. S., Song, Y., Chamberlain, S. A., Shrestha, S., Choroschun, K., Hoben, M., Beeber, A., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01254-z · Cited by 46 · see citing works
“Rycroft-Malone et al. (2013) [35] Leadership is necessary and sufficient to positively imple‑ mentation outcomes Leadership exerts the greatest influence on implementation processes in which favorable culture and evaluation influence facilitation only when the clinical leaders take an active role.”
BackgroundMethodInfluentialTsang, J. Y., Blakeman, T., Hegarty, J., Humphreys, J., & Harvey, G. (2015) · Implementation Science · doi:10.1186/s13012-016-0413-7 · Cited by 55 · see citing works
“This is consistent with previous research examining implementation, which all report discrepancies on how ‘context’ was defined [55–57].”
ResultUnpacking action research and implementation science: Implications for nursing
Casey, M., O’Leary, D., & Coghlan, D. (2017) · Journal of Advanced Nursing · doi:10.1111/jan.13494 · Cited by 55 · see citing works
“Implementation science is a practical approach to understanding, reflecting on and evaluating project planning and implementation (Babbie, 2013; Rycroft-Malone et al., 2013).”
BackgroundMethodToivonen, M., Lehtonen, L., Ahlqvist‐Björkroth, S., & Axelin, A. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4256-1 · Cited by 50 · see citing works
“According the i-PARIHS framework, the attitudes, motivation, and thoughts of the recipients influence the way new knowledge will be adopted at both the individual and collective team levels [27, 28].”
BackgroundGurung, R., Jha, A. K., Pyakurel, S., Gurung, A., Litorp, H., Wrammert, J., Jha, B. K., Paudel, P., Rahman, S. M., Malla, H., et al. (2019) · Implementation Science · doi:10.1186/s13012-019-0917-z · Cited by 56 · see citing works
Blanco‐Mavillard, I., de Pedro‐Gómez, J. E., Rodríguez-Calero, M. Á., Bennasar‐Veny, M., Parra-García, G., Fernández‐Fernández, I., Hoyos, J. B., Moya‐Suárez, A. B., Sánchez, J. L. C., Ferrer-Cruz, F., et al. (2021) · The Lancet Haematology · doi:10.1016/s2352-3026(21)00206-4 · Cited by 56 · see citing works
Neonatal Intensive Care Nurses' Perceptions of Parental Participation in Infant Pain Management
Axelin, A., Anderzén‐Carlsson, A., Eriksson, M. H., et al. (2015) · The Journal of Perinatal & Neonatal Nursing · doi:10.1097/jpn.0000000000000136 · Cited by 56 · see citing works
Use of the PARIHS Framework for Retrospective and Prospective Implementation Evaluations
Hill, J. N., Guihan, M., Hogan, T. P., et al. (2017) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12211 · Cited by 45 · see citing works
Marshall, M., Eyre, L., Lalani, M., Khan, S. A., Mann, S., de Silva, D., & Shapiro, J. (2016) · Journal of the Royal Society of Medicine · doi:10.1177/0141076816634318 · Cited by 53 · see citing works
Development of a qualitative data analysis codebook informed by the i-PARIHS framework
Ritchie, M. J., Drummond, K. L., Smith, B. N., Sullivan, J. L., & Landes, S. J. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00344-9 · Cited by 51 · see citing works
Sandström, B., Willman, A., Svensson, B., & Borglin, G. (2015) · Implementation Science · doi:10.1186/s13012-015-0234-0 · Cited by 54 · see citing works
“The key element evidence is, in the PARIHS framework, regarded in a broad sense in order to include the subelements of research, clinical experience, patients experience and local information [21,36,37,44].”
InfluentialPerspectives About Emergency Department Care Encounters Among Adults With Opioid Use Disorder
Hawk, K. F., McCormack, R. P., Edelman, E. J., Coupet, E., Toledo, N., Gauthier, P. R., Rotrosen, J., Chawarski, M. C., Martel, S. H., Owens, P. H., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.44955 · Cited by 58 · see citing works
Barriers and Facilitators to Workforce Changes in Integrated Care
Busetto, L., Luijkx, K. G., Calciolari, S., Ortiz, L. G. G., & Vrijhoef, H. J. (2018) · International Journal of Integrated Care · doi:10.5334/ijic.3587 · Cited by 51 · see citing works
“A useful framework for these types of analyses is the PARIHS framework for promoting action on research implementation in health services [71, 72].”
MethodCrespo-González, C., Benrimoj, S. I., Scerri, M., & García‐Cárdenas, V. (2020) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2020.01.015 · Cited by 51 · see citing works
McIntyre, S. A., Francis, J., Gould, N. J., & Lorencatto, F. (2018) · Translational Behavioral Medicine · doi:10.1093/tbm/iby110 · Cited by 45 · see citing works
Roe, B. H., Flanagan, L., & Maden, M. (2015) · Journal of Advanced Nursing · doi:10.1111/jan.12613 · Cited by 46 · see citing works
“Trials that incorporate the role of evidence, context and facilitation are now emerging (Rycroft-Malone et al. 2013), specifically for the management of UI in care home populations (Seers et al.”
Backgroundon behalf of the PACE trial group, Oosterveld‐Vlug, M., Onwuteaka-Philipsen, B. D., ten Koppel, M., van Hout, H. P. J., Smets, T., Pivodic, L., Tanghe, M., Noortgate, N. J. V. D., Hockley, J., et al. (2019) · Implementation Science · doi:10.1186/s13012-019-0953-8 · Cited by 42 · see citing works
Mekki, T. E., Øye, C., Kristensen, B., Dahl, H., Haaland, A., Nordin, K. A., Strandos, M., Terum, T. M., Ydstebø, A. E., & McCormack, B. G. (2017) · Journal of Advanced Nursing · doi:10.1111/jan.13340 · Cited by 42 · see citing works
Implementation Teams: A Stakeholder View of Leading and Sustaining Change
Metz, A. J. R., & Bartley, L. (2020) · Springer eBooks · doi:10.1007/978-3-030-03874-8_8 · Cited by 39 · see citing works
Thunberg, G., Johnson, E., Bornman, J., Öhlén, J., & Nilsson, S. (2021) · Nursing Inquiry · doi:10.1111/nin.12426 · Cited by 44 · see citing works
The Experiences of Professionals Regarding Involvement of Parents in Neonatal Pain Management
Marfurt-Russenberger, K., Axelin, A., Kesselring, A., Franck, L. S., & Cignacco, E. (2016) · Journal of Obstetric, Gynecologic & Neonatal Nursing · doi:10.1016/j.jogn.2016.04.011 · Cited by 42 · see citing works
“Health care professionals’ attitudes and beliefs play an important role in the successful implementation of parent involvement in infant pain care (Axelin et al., 2015; Meijers et al., 2006; Rycroft-Malone et al., 2013).”
BackgroundInfluentialThe next phase in professional services research: From implementation to sustainability
Crespo-Gonzalez, C., Garcia-Cardenas, V., & Benrimoj, S. I. (2017) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2017.05.020 · Cited by 45 · see citing works
Naef, R., Kläusler-Troxler, M., Ernst, J., Huber, S., Dinten-Schmid, B., Karen, T., & Petry, H. (2019) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2019.103448 · Cited by 46 · see citing works
Andersson, A. E., Frödin, M., Dellenborg, L., Wallin, L., Hök, J., Gillespie, B. M., & Wikström, E. (2018) · BMC Health Services Research · doi:10.1186/s12913-017-2783-1 · Cited by 41 · see citing works
“Lack of role models and opinion leaders Using facilitators [27] with social impact [28] Role modeling from credible and trusted sources Strive to create honest relationships between facilitators and participants Lab participant as change agents”
BackgroundEldh, A. C., Rycroft‐Malone, J., van der Zijpp, T. J., McMullan, C., & Hawkes, C. (2020) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12449 · Cited by 37 · see citing works
“However, it is fraught with challenges and inherent complexities (Eccles et al., 2009) in which the context of practice plays an important role, for example, by influencing healthcare staff behaviour (Rycroft-Malone et al., 2013).”
BackgroundSelf-citationBrown, D., & McCormack, B. G. (2016) · Journal of Clinical Nursing · doi:10.1111/jocn.13348 · Cited by 41 · see citing works
“Internationally researchers have explored the use of the PARIHS framework as a practical and theoretical model to guide their research (e.g., Stetler et al. 2011, Rycroft-Malone et al. 2013, Botti et al. 2014).”
Melnyk, B. M. (2016) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12161 · Cited by 39 · see citing works
Zardo, P., & Collie, A. (2014) · Implementation Science · doi:10.1186/s13012-014-0142-8 · Cited by 39 · see citing works
“A recent study [13] demonstrated that individual factors can significantly affect contextual factors operating at the organisational level.”
BackgroundStandardizing an approach to the evaluation of implementation science proposals
Crable, E. L., Biancarelli, D. L., Walkey, A. J., Allen, C. G., Proctor, E. K., & Drainoni, M. (2018) · Implementation Science · doi:10.1186/s13012-018-0770-5 · Cited by 36 · see citing works
Self-citationMetz, A. J. R., Kainz, K., & Boaz, A. (2023) · Frontiers in Health Services · doi:10.3389/frhs.2022.959386 · Cited by 36 · see citing works
“Successful implementation is a collaborative act relying on multiple actors in iterative and unpredictable ways (65).”
BackgroundEldh, A. C., Fredriksson, M., Halford, C., Wallin, L., Dahlström, T., Vengberg, S., & Winblad, U. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-354 · Cited by 37 · see citing works
“Bridging the know-do gap is essential yet still a challenge for modern health care [7] and is vital for quality improvement programmes aiming to engage in evidence based practice (EBP) [8].”
BackgroundInfluentialBlanco‐Mavillard, I., Rodríguez-Calero, M. Á., Castro‐Sánchez, E., Bennasar‐Veny, M., & de Pedro‐Gómez, J. E. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-021040 · Cited by 31 · see citing works
Balbale, S. N., Hill, J. N., Guihan, M., Hogan, T. P., Cameron, K. A., Goldstein, B., & Evans, C. T. (2015) · Implementation Science · doi:10.1186/s13012-015-0318-x · Cited by 37 · see citing works
“Our results illustrate the ways in which implementation in the SCI/D setting is shaped by a combination of contextual, evidence, and facilitation elements and sub-elements; this aligns with recent literature demonstrating that implementation is a facilitated process that rests upon interactions between individuals, ev…”
ResultInfluence of leadership on implementing Dementia Care Mapping: A multiple case study
Quasdorf, T., & Bartholomeyczik, S. (2017) · Dementia · doi:10.1177/1471301217734477 · Cited by 33 · see citing works
on behalf of, P. A. C. E., Hockley, J., Froggatt, K. A., den Block, L. V., Onwuteaka-Philipsen, B. D., Kylänen, M., Szczerbińska, K. E., Gambassi, G., Pautex, S., & Payne, S. A. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4587-y · Cited by 27 · see citing works
“Previous work in the UK on complex palliative care interventions in nursing homes had found the PARiHS framework useful to guide the implementation process [11, 20].”
BackgroundClinical Hypnosis for Procedural Pain and Distress in Children: A Scoping Review
Geagea, D., Tyack, Z., Kimble, R., Polito, V., Ayoub, B., Terhune, D. B., & Griffin, B. (2023) · Pain Medicine · doi:10.1093/pm/pnac186 · Cited by 35 · see citing works
“Barriers and facilitators to implementing hypnosis and study procedures were mapped to the integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework [70].”
MethodWalsh, K. D., Ford, K., Morley, C., McLeod, E., McKenzie, D., Chalmers, L., Gordon-Croal, S., & Peterson, G. M. (2016) · Collegian Journal of the Royal College of Nursing Australia · doi:10.1016/j.colegn.2016.06.003 · Cited by 33 · see citing works
Mosch, L. K., Poncette, A.-S., Spies, C., Weber‐Carstens, S., Schieler, M., Krampe, H., & Balzer, F. (2021) · JMIR Formative Research · doi:10.2196/22866 · Cited by 36 · see citing works
“Nonetheless, numerous implementation frameworks, either for specific health care settings or for general guidelines, have been published during this period [26,64,86-88].”
BackgroundMelnyk, B. M. (2014) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12032 · Cited by 32 · see citing works
Blanco‐Mavillard, I., Bennasar‐Veny, M., de Pedro‐Gómez, J. E., Moya‐Suárez, A. B., Parra-García, G., Rodríguez-Calero, M. Á., & Castro‐Sánchez, E. (2018) · Implementation Science · doi:10.1186/s13012-018-0792-z · Cited by 29 · see citing works
Bjurling‐Sjöberg, P., Wadensten, B., Pöder, U., Jansson, I., & Nordgren, L. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3629-1 · Cited by 29 · see citing works
“A traditional hierarchical structure, as in the present setting, could compromise interprofessional collaborations [38, 39].”
Förberg, U., Unbeck, M., Wallin, L., Johansson, E., Petzold, M., Ygge, B., & Ehrenberg, A. (2015) · Implementation Science · doi:10.1186/s13012-016-0375-9 · Cited by 30 · see citing works
“However, PARIHS has also been criticised, for example, it is not clear what role individuals play as part of the interaction between evidence and context [11] and that the influence of staff turnover is not considered [12].”
BackgroundBostan, S., Johnson, O. A., Jaspersen, L. J., & Randell, R. (2024) · Journal of Medical Internet Research · doi:10.2196/45242 · Cited by 44 · see citing works
A practice development initiative supporting care home staff deliver high quality end-of-life care
Hockley, J., & Kinley, J. (2016) · International Journal of Palliative Nursing · doi:10.12968/ijpn.2016.22.10.474 · Cited by 30 · see citing works
Tilson, J. K., & Mickan, S. M. (2014) · BMC Medical Education · doi:10.1186/1472-6920-14-125 · Cited by 29 · see citing works
“Additionally, careful planning of the facilitation process is required for participants to integrate the evidence in their local context [30].”
BackgroundDahl, H., Dewing, J., Mekki, T. E., Håland, A., & Øye, C. (2018) · International Practice Development Journal · doi:10.19043/ipdj.82.004 · Cited by 27 · see citing works
Context as a Facilitator of the Implementation of Evidence-based Nursing: A Meta-synthesis
Clavijo-Chamorro, M. Z., Sanz-Martos, S., Gómez-Luque, A., Zarallo, G. R., & López‐Medina, I. M. (2020) · Western Journal of Nursing Research · doi:10.1177/0193945920914397 · Cited by 29 · see citing works
Travers, C., Henderson, A. J., Graham, F. A., & Beattie, E. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3286-4 · Cited by 23 · see citing works
Wodchis, W. P., Ashton, T., Baker, G. R., et al. (2018) · International Journal of Integrated Care · doi:10.5334/ijic.4160 · Cited by 28 · see citing works
Zych, M. M., Berta, W. B., & Gagliardi, A. R. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4573-4 · Cited by 25 · see citing works
Øye, C., Mekki, T. E., Jacobsen, F. F., et al. (2016) · Journal of Nursing Management · doi:10.1111/jonm.12378 · Cited by 27 · see citing works
Skoog, G., Struwe, J., Cars, O., et al. (2016) · Eurosurveillance · doi:10.2807/1560-7917.es.2016.21.25.30264 · Cited by 27 · see citing works
“In modern interventions the role of evidence, context and facilitation is emphasised within the framework Promoting Action on Research Implementation in Health Services (PARIHS), and should be considered for future interventions [23].”
BackgroundManagement Involvement-A Decisive Condition When Implementing Evidence-Based Practice
Aasekjær, K., Wæhle, H. V., Ciliska, D. K., Nortvedt, M. W., & Hjälmhult, E. (2016) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12141 · Cited by 23 · see citing works
Hansen, S. T., Kjerholt, M., Christensen, S. F., Brodersen, J., & Hølge‐Hazelton, B. (2020) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-020-00256-z · Cited by 25 · see citing works
“Implementation is part of a diffusion-disseminationimplementation continuum: diffusion is the passive, untargeted and unplanned spread of new practices; dissemination is the active spread of new practices to the target audience using planned strategies; and implementation is the process of putting to use or integratin…”
BackgroundCardiovascular Disease Guideline Adherence: An RCT Using Practice Facilitation
Shelley, D., Gepts, T., Siman, N., Nguyen, A. M., Cleland, C. M., Cuthel, A. M., Rogers, E., Ogedegbe, O., Pham-Singer, H., Wu, W. Y., et al. (2020) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2019.12.013 · Cited by 22 · see citing works
Vogel, C., Dijkstra, S. C., Huitink, M., Dhuria, P., Poelman, M. P., Mackenbach, J. D., Crozier, S., Seidell, J. C., Baird, J., & Ball, K. (2023) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-023-01448-8 · Cited by 26 · see citing works
“It is well recognised in the field of translational research that the individuals involved play an important role in level of success [34, 35].”
BackgroundEvaluating the impact of a simulation study in emergency stroke care
Monks, T., Pearson, M., Pitt, M., Stein, K., & James, M. A. (2015) · Operations Research for Health Care · doi:10.1016/j.orhc.2015.09.002 · Cited by 24 · see citing works
“…extracting group decision development process data [51], frameworks for investigating implementation processes such as the Promoting Action on Research Implementation in Health Services (PARIHS) framework [52] and sampling of process measures informed by the principles of Improvement Science [53].”
Implementation of a behavioral medicine approach in physiotherapy: impact and sustainability
Fritz, J., Wallin, L., Söderlund, A., Almqvist, L., & Sandborgh, M. (2019) · Disability and Rehabilitation · doi:10.1080/09638288.2019.1596170 · Cited by 25 · see citing works
“The Promoting Action on Research Implementation in Health Services (PARIHS) framework proposes facilitation as a useful method to support the implementation of evidence-based guidelines [16] and has also been confirmed in the primary health care context [17–19].”
MethodSchmied, V. A., Thomson, G., Byrom, A., Burns, E., Sheehan, A., & Dykes, F. (2014) · Women and Birth · doi:10.1016/j.wombi.2014.05.005 · Cited by 23 · see citing works
“Rycroft-Malone et al.(8,9) identified culture, leadership and evaluation as core contextual elements that both influence and reflect the capacity of an organisation for change.”
BackgroundUngar, M., & Jefferies, P. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.745283 · Cited by 27 · see citing works
Bosch, M., Tavender, E. J., Brennan, S., Knott, J. C., Gruen, R. L., & Green, S. (2016) · PLoS ONE · doi:10.1371/journal.pone.0148091 · Cited by 20 · see citing works
Improving nutritional care: innovation and good practice
Chapman, C., Barker, M. E., & Lawrence, W. T. (2014) · Journal of Advanced Nursing · doi:10.1111/jan.12571 · Cited by 23 · see citing works
- Authors
- Rycroft-Malone, J., Seers, K., Chandler, J., Hawkes, C. A., Crichton, N., Allen, C., Bullock, I., & Strunin, L.
- Affiliations
- University of Warwick (GB)
- Cochrane (GB)
- Bangor University (GB)
- London South Bank University (GB)
- Royal College of Physicians (GB)
- Royal College of Anaesthetists (GB)
- Venue
- Implementation Science
- Published
- 2013-03-09
- Volume
- 8
- Issue
- 1
- Pages
- 28-28
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC3636004
- OpenAlex
- W2141566744
- Semantic Scholar
- 1cb0304c547f34bf0151e51718de128e00ab9f4a
- Cited by
- 303
- References
- 49
- Citations by year
- 2026: 3 · 2025: 10 · 2024: 13 · 2023: 18 · 2022: 25 · 2021: 35 · 2020: 26 · 2019: 27 · 2018: 30 · 2017: 29 · 2016: 31 · 2015: 31 · 2014: 20 · 2013: 5
- FWCI
- 52.53
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Lancaster EPrints (Lancaster University) (submittedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- PARIHS framework, implementation research, implementation process evaluation, evidence-informed practice, implementation context, facilitators, evidence base, practice change, acute care
- MeSH terms
- Attitude of Health Personnel, Data Collection, Decision Making, Diffusion of Innovation, Fasting, Health Services Research, Humans, Interprofessional Relations, Intraoperative Care, Professional Practice, Program Development, Focus Groups, Evidence-Based Practice, Translational Research, Biomedical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review