PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice
Open accessAbstract
BACKGROUND: The Promoting Action on Research Implementation in Health Services, or PARIHS framework, was first published in 1998. Since this time, work has been ongoing to further develop, refine and test it. Widely used as an organising or conceptual framework to help both explain and predict why the implementation of evidence into practice is or is not successful, PARIHS was one of the first frameworks to make explicit the multi-dimensional and complex nature of implementation as well as highlighting the central importance of context. Several critiques of the framework have also pointed out its limitations and suggested areas for improvement. DISCUSSION: Building on the published critiques and a number of empirical studies, this paper introduces a revised version of the framework, called the integrated or i-PARIHS framework. The theoretical antecedents of the framework are described as well as outlining the revised and new elements, notably, the revision of how evidence is described; how the individual and teams are incorporated; and how context is further delineated. We describe how the framework can be operationalised and draw on case study data to demonstrate the preliminary testing of the face and content validity of the revised framework. This paper is presented for deliberation and discussion within the implementation science community. Responding to a series of critiques and helpful feedback on the utility of the original PARIHS framework, we seek feedback on the proposed improvements to the framework. We believe that the i-PARIHS framework creates a more integrated approach to understand the theoretical complexity from which implementation science draws its propositions and working hypotheses; that the new framework is more coherent and comprehensive and at the same time maintains it intuitive appeal; and that the models of facilitation described enable its more effective operationalisation.
AI snapshot
Written from the paper’s full text.
TL;DR
This paper revises the PARIHS framework into the integrated i-PARIHS framework, positioning facilitation as the active ingredient that aligns innovation, recipients, and inner/outer context. It draws on critiques, theoretical antecedents, and three implementation case studies to describe and preliminarily test the revised framework’s face and content validity.
Key findings
- The revised i-PARIHS framework replaces the original equation SI = ƒ(E,C,F) with SI = Facn(I + R + C), where successful implementation is specified as achievement of agreed implementation/project goals, uptake and embedding of the innovation, engagement and ownership by individuals/teams/stakeholders, and minimised context-related variation across settings.
- The CKD case reported recorded prevalence increased by 1.2% in 30 participating practices (n = 1,863 additional patients with CKD) compared with a national increase of 0.2%; blood pressure management improved from 34 to 74% (cohort 1) and 58 to 83% (cohort 2).
- The continence case’s cluster RCT showed no difference between control and intervention wards on overall compliance to continence recommendations, but significant improvements on several secondary outcomes and 1 of the 4 specific recommendations; the nutrition stepped wedge RCT showed no difference in weight loss after 1 week, though key audit measures improved.
- A cited systematic review found practices supported by a facilitator were 2.76 times more likely to adopt evidence-based clinical guidelines; within 23 studies, audit and feedback was used in 100% and interactive consensus building/goal setting in 91%; the NeoKIP trial reported reduced neonatal mortality of 49% in the third year.
Methods
- Design: conceptual and theoretical revision paper introducing the i-PARIHS framework, building on published critiques and empirical studies of the original PARIHS framework.
- Data/sample: three implementation case studies summarised in Table 1—CKD in primary care, continence care in nursing homes, and nutritional care of older adults in acute care—plus literature on PARIHS applications, critiques, and theoretical antecedents.
- Analysis: narrative synthesis and framework development, with case study data used to demonstrate preliminary testing of the face and content validity of the revised framework.
Limitations
- Stated: the authors note that ongoing development and evaluation of i-PARIHS are needed; prospective implementation studies remain limited; construct boundaries may overlap and attempts to distinguish them may be imperfect; the label “recipients” may imply a passive role; and future work is needed to test utility, applicability, and content and construct validity.
- Stated: evidence from effectiveness studies of facilitation is mixed, likely because facilitation itself is a complex intervention involving one or more facilitators applying combined improvement and team-focused strategies.
- Evident: validation reported here is preliminary face and content validity using illustrative case studies, not full psychometric or prospective outcome validation; two of the cited case study RCTs had null primary outcomes.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 45 cited sources checked · 0 supported · 0 flagged
- Findingcitation
In the CKD case, the presence of CKD indicators in the pay-for-performance system in primary care created an incentive for improvement.
“Similarly in the case study of CKD, the presence of CKD indicators in the pay-for-performance system in primary care created an incentive for improvement [21].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [21] Harvey G, Oliver K, Humphreys J, Rothwell K, Hegarty J. Improving the identification and management of chronic kidney disease in primary care: lessons from a staged improvement collaborative. Int J Qual Health Care. 2015;27(1):10–6. source
Not checked in the free run.
- Findingcitation
In the continence case, in some countries, a focus on continence formed part of the external accreditation system for nursing homes, creating a driver for introducing changes to improve the management of continence at a local level.
“For example, in the case study on promoting continence, in some of the countries studied, a focus on continence formed part of the external accreditation system for nursing homes. This created a driver for introducing changes to improve the management of continence at a local level [45].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [45] Harvey G, Kitson A, Munn Z. Promoting continence in nursing homes in four European countries: the use of PACES as a mechanism for improving the uptake of evidence-based recommendations. Int J Evid Based Healthc. 2012;10(4):388–96. source
Not checked in the free run.
- Findingnone given
In all three case studies, the methods employed by facilitators typically involved improvement approaches such as Plan-Do-Study-Act cycles and audit and feedback, underpinned by project management.
“In all three cases, the methods employed by facilitators typically involved improvement approaches such as Plan-Do-Study-Act cycles and audit and feedback, underpinned by project management.”
Quote in the paperNot a substantial claim - Premisecitation
There is increased interest and awareness of relevant theories that can and should inform implementation strategies.
“Increased interest and awareness of relevant theories that can and should inform implementation strategies [23–25]”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [23] Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N. Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005;58(2):107–12. source
Not checked in the free run.
- cites [24] Estabrooks CA, Thompson DS, Lovely JJ, Hofmeyer A. A guide to knowledge translation theory. J Contin Educ Health Prof. 2006;26(1):25–36. source
Not checked in the free run.
- cites [25] Rycroft-Malone J. Theory and knowledge translation: setting some coordinates. Nurs Res. 2007;56(4):S78–85. source
Not checked in the free run.
- Interpretationcitation
Individuals and teams have an impact in supporting or resisting an innovation.
“This extension enables the i-PARIHS framework to consider the impact individuals and teams have in supporting or resisting an innovation.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [12] Rycroft-Malone J, Seers K, Chandler J, Hawkes C, Crichton N, Allen C, et al. The role of evidence, context, and facilitation in an implementation trial: implications for the development of the PARIHS framework. Implement Sci. 2013;8(1):28. source
Not checked in the free run.
- cites [37] Flodgren G, Parmelli E, Doumit G, Gattellari M, O’Brien MA, Grimshaw J et al. Local opinion leaders: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2011 Aug 10;(8):CD000125. source
Not checked in the free run.
- Premisecitation
People were applying PARIHS in diverse ways, not simply to guide the implementation of conventional research evidence but to inform and evaluate developments in practice more generally.
“Recognition of the diverse ways in which people were applying PARIHS, not simply to guide the implementation of more conventional research evidence in the form of clinical guidelines or evidence summaries, but to inform and evaluate developments in practice more generally [26]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [26] McCormack B, Manley K, Titchen A. Practice development in nursing and healthcare. Chichester, UK: John Wiley & Sons; 2013.
Not checked in the free run.
- Interpretationreasoning
The people involved in implementation, including their views, beliefs and established ways of practice, can significantly affect the ease of introducing an innovation or change.
“As these examples illustrate, the people involved in implementation, including their views, beliefs and established ways of practice, can significantly affect the ease of introducing an innovation or change.”
Quote in the paperSubstantial claim - Interpretationcitation
The characteristics of knowledge create a set of conditions that make it more or less likely to be recognised and applied.
“The characteristic of the knowledge creates a set of conditions that make it more or less likely to be recognised and applied.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [33] Rogers EM. Diffusion of innovations. 4th ed. New York: The Free Press; 1995.
Not checked in the free run.
- cites [34] Rogers EM. Diffusion of innovations. 5th ed. New York: Free Press; 2003.
Not checked in the free run.
- Premisecitation
Growing evidence indicates that individuals play a key role in the implementation process.
“Growing evidence on the key role individuals play in the implementation process [12]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [12] Rycroft-Malone J, Seers K, Chandler J, Hawkes C, Crichton N, Allen C, et al. The role of evidence, context, and facilitation in an implementation trial: implications for the development of the PARIHS framework. Implement Sci. 2013;8(1):28. source
Not checked in the free run.
- Premisecitation
Groups or teams of individuals have an important role in determining the uptake of new knowledge in practice.
“there is good evidence to suggest that groups or teams of individuals have an important role in determining the uptake of new knowledge in practice.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [38] Kislov R, Harvey G, Walshe K. Collaborations for leadership in applied health research and care: lessons from the theory of communities of practice. Implement Sci. 2011;6:64. source
Not checked in the free run.
- cites [39] Gabbay J, May A. Evidence based guidelines or collectively constructed “mindlines?” Ethnographic study of knowledge management in primary care. BMJ. 2004;329:1013. source
Not checked in the free run.
- cites [40] Wieringa S, Greenhalgh T. 10 years of mindlines: a systematic review and commentary. Implement Sci. 2015;10:45. source
Not checked in the free run.
- Premisenone given
The original PARIHS framework did not explicitly consider the impact that the wider health system-the external context-could have on implementation processes and outcomes.
“Furthermore, we did not explicitly consider the impact that the wider health system—the external context—could have on implementation processes and outcomes.”
Quote in the paperSubstantial claim - Interpretationcitation
Aligning external explicit evidence with local priorities and practice is an important way of enhancing the compatibility of a proposed change.
“This process of aligning external explicit evidence with local priorities and practice is an important way of enhancing the compatibility of a proposed change, as recognised in the innovation literature [33–35].”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [33] Rogers EM. Diffusion of innovations. 4th ed. New York: The Free Press; 1995.
Not checked in the free run.
- cites [34] Rogers EM. Diffusion of innovations. 5th ed. New York: Free Press; 2003.
Not checked in the free run.
- cites [35] Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. source
Not checked in the free run.
- Premisecitation
Studies that report process evaluation alongside effectiveness data demonstrate the importance of having the right individuals in the role with the right level of skills, knowledge, support and mentoring.
“Studies that report process evaluation alongside effectiveness data demonstrate the importance of having the right individuals in the role with the right level of skills, knowledge, support and mentoring [59, 60].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [59] Eriksson L, Huy TQ, Duc DM, Selling KE, Hoa DP, Thuy NT, Nga NT, Persson L-A, Wallin L. Process evaluation of a knowledge translation intervention using facilitation of local stakeholder groups to improve neonatal survival in the Quang Ninh province, Vietnam. Trials. 2016;17(1):1–12. source
Not checked in the free run.
- cites [60] Ritchie MJ, Kirchner JE, Parker LE, Curran GM, Fortney JC, Pitcock JA, Bonner LM, Kilbourne AM. Evaluation of an implementation facilitation strategy for settings that experience significant implementation barriers. Implement Sci. 2015;10 Suppl 1:A46. source
Not checked in the free run.
- Premisecitation
Theories that inform the i-PARIHS framework's views about context include complexity, absorptive capacity, learning organisations, leadership and organisational culture.
“Included in this mix are theories related to complexity [72, 73], absorptive capacity [74] and learning organisations [75] as well as theories related to leadership and organisational culture [76].”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [72] Plsek PE, Greenhalgh T. The challenge of complexity in health care. BMJ. 2001;323:625–8. source
Not checked in the free run.
- cites [73] Downe S. Beyond evidence-based medicine: complexity and stories of maternity care. J Eval Clin Pract. 2010;16(1):232–7. source
Not checked in the free run.
- cites [74] Harvey G, Jas P, Walshe K. Analysing organisational context: case studies on the contribution of absorptive capacity theory to understanding inter-organisational variation in performance improvement. BMJ Qual Saf. 2015;24(1):48–55. source
Not checked in the free run.
- cites [75] Senge PM. The fifth discipline: the art and practice of the learning organization. New York: Doubleday; 1990.
Not checked in the free run.
- Premisecitation
The theories that have particularly influenced the i-PARIHS approach to facilitation include those of humanist authors Carl Rogers and John Heron.
“The theories that have particularly influenced our approach to facilitation include those of humanist authors such as Carl Rogers [82] and John Heron [83].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [82] Rogers CR. Freedom to learn—a view of What Education Might Become. Charles Merrill: Columbus, Ohio; 1969.
Not checked in the free run.
- cites [83] Heron J. The facilitator’s handbook. London: Kogan Page; 1989.
Not checked in the free run.
- Interpretationreasoning
There is a relationship between aspects of the innovation, the recipients and the context.
“What is also apparent is the relationship between aspects of the innovation, the recipients and the context.”
Quote in the paperSubstantial claim - Premisecitation
A 2012 systematic review of practice facilitation in primary care concluded that practices supported by a facilitator were 2.76 times more likely to adopt evidence-based clinical guidelines.
“A 2012 systematic review of practice facilitation in primary care concluded that practices supported by a facilitator were 2.76 times more likely to adopt evidence-based clinical guidelines [52].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [52] Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10:63–74. source
Not checked in the free run.
- Interpretationreasoning
Evidence from effectiveness studies of facilitation is mixed.
“However, as the case studies in Table 1 illustrate, evidence from effectiveness studies of facilitation is mixed.”
Quote in the paperSubstantial claim - Premisecitation
The NeoKIP trial demonstrated a reduced neonatal mortality of 49% in the third year of the intervention.
“Using lay members of the community who received training in facilitation techniques such as PDSA and group consensus building, the study demonstrated a reduced neonatal mortality of 49 % in the third year of the intervention [56].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [56] Persson LA, Nga NT, Malqvist M, Thi Phuong Hoa D, Eriksson L, Wallin L, et al. Effect of facilitation of local maternal-and-newborn stakeholder groups on neonatal mortality: cluster-randomized controlled trial. PLoS Med. 2013;10(5):e1001445. source
Not checked in the free run.
- Interpretationown data
The analysis of theoretical, empirical and experiential evidence gives initial confidence in the revisions proposed in the i-PARIHS framework.
“Our analysis of a range of theoretical, empirical and experiential evidence gives us initial confidence in the revisions proposed in the i-PARIHS framework.”
Quote in the paperNot a substantial claim - Premisecitation
The i-PARIHS framework draws on improvement theories that promote local engagement and ownership of the process of implementing improvement, most notably Deming's system of profound knowledge for improvement.
“We also draw on improvement theories that promote local engagement and ownership of the process of implementing improvement, particularly in thinking about how facilitators enact their role in practice.”
- Also stated in: § The underpinning theoretical antecedents of the i-PARIHS framework · plain
“Most notable amongst these improvement theories is Deming’s system of profound knowledge for improvement, with its focus on understanding systems, processes, experiential learning and human interaction [84].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [84] Deming WE. Out of the crisis. Cambridge, Massachusetts: MIT Press; 2000.
Not checked in the free run.
- Also stated in: § The underpinning theoretical antecedents of the i-PARIHS framework · plain
- Classified as probably not a substantial claim. 33
- May combine two claims. 16
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
FindingcitationIn the CKD case, some GPs and practice nurses viewed declining renal function as a natural part of ageing and believed that disclosing a diagnosis of CKD could cause unnecessary anxiety in patients, potentially missing opportunities to improve self-management and overall management of cardiovascular disease and to address increased susceptibility to acute kidney injury.
“This was particularly the case for older patients as some General Practitioners (GPs) and practice nurses viewed declining renal function as a natural part of ageing and believed that disclosing a diagnosis of CKD could cause unnecessary anxiety in patients. By adopting this approach, opportunities to improve self-management and overall management of cardiovascular disease and to address the issue”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [41] Blakeman T, Protheroe J, Chew-Graham C, Rogers A, Kennedy A. Understanding the management of early-stage chronic kidney disease in primary care: a qualitative study. J Roy Coll Gen Pract. 2012;62:e233–42. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
FindingcitationIn the continence case, collecting stories from residents about their experience of living with incontinence provided a powerful motivational tool to convince colleagues of the need to change.
“In one nursing home, the staff responsible for facilitating implementation collected stories from residents about their experience of living with incontinence, which provided a very powerful motivational tool to convince their colleagues of the need to change.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
FindingcitationIn the continence case, care staff held strong views about whether continence goals were achievable, particularly where residents had been managed as incontinent over prolonged periods, and changing this mindset required significant effort.
“Focusing on goals to improve the assessment and attainment of continence amongst residents, a key area was addressing care staffs’ strongly held views as to whether such goals were achievable, particularly where residents had been managed as ‘incontinent’ over prolonged periods of time. This required a significant amount of effort to change the mindset amongst nursing home staff about achieving”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataIn the weight loss case, making oral nutritional supplements available at the point of care required agreement of financial support and fridges to store them, and negotiations with the stocks department to address stock supply and management.
“However, the reality of making these supplements available at the point of care delivery required the agreement of financial support to make the supplements, and the fridges to store them in, available in the ward setting. Furthermore, negotiations with the stocks department were needed to address the issue of stock supply and management.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe relationship between the innovation and the recipients is in many ways an inter-dependent one.
“It is also apparent that the relationship between the innovation and the recipients is in many ways an inter-dependent one.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
PremisereasoningEvidence is one type of knowledge and (new) knowledge is the substance that needs to be introduced in order to generate change and improvement.
“We argue that evidence is one type of knowledge and (new) knowledge is the substance that needs to be introduced in order to generate change and improvement.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Premisenone givenIn the original PARIHS framework, context was defined in terms of resources, culture, leadership and orientation to evaluation and learning, but the framework did not delineate between the immediate local context and the wider organisational context.
“In the PARIHS framework, we defined context in terms of resources, culture, leadership and orientation to evaluation and learning; however, we did not delineate between the immediate local context and the wider organisational context.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningIn the i-PARIHS framework, successful implementation is primarily specified in terms of the achievement of implementation/project goals and results from the facilitation of an innovation with the recipients in their context.
“In our revised, i-PARIHS framework, successful implementation is primarily specified in terms of the achievement of implementation/project goals and results from the facilitation of an innovation with the recipients in their (local, organisational and health system) context (Table 2).”
Quote in the paperSubstantial claim- The authors state this as an assumption: Successful implementation can be primarily specified as the achievement of implementation/project goals.
May combine two claims.
InterpretationcitationPeople rarely take evidence in the original form of a systematic review or clinical guideline and directly apply it within an implementation project; rather they incorporate evidence in different ways, typically adapting the original evidence to suit their particular situation, blending explicit knowledge with tacit, practice-based knowledge.
“people rarely take evidence in the original form of a systematic review or clinical guideline and directly apply it within an implementation project rather they incorporate evidence in a number of different ways, which typically involves adapting the original evidence in some way to suit their particular situation”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [30] Hargreaves D. Creative professionalism: the role of teachers in the knowledge society. London: Demos; 1998.
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
InterpretationreasoningThere is not a single right way to apply facilitator roles; however, there are clear benefits in mechanisms that provide support and mentoring to new or less experienced facilitators.
“This reinforces that there is not a single right way to apply facilitator roles; however, there are clear benefits in mechanisms that provide support and mentoring to new or less experienced facilitators.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationWhen facilitation is part of another role, the facilitator may feel like a lone agent, and this can result in individual feelings of isolation and being overwhelmed.
“In some cases—and particularly where facilitation is part of another role—the facilitator may feel like a lone agent. However, given the scope and complexity of the role, this is not a desirable situation and can result in individual feelings of isolation and being overwhelmed [62].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [62] Kitson A, Harvey G. Getting started with facilitation: the facilitator’s role. In: Harvey G, Kitson A, editors. Implementing evidence-based practice in healthcare: a facilitation guide. Abingdon, Oxon: Routledge; 2015. p. 70–84. source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThe inter-play between constructs that influence implementation is generally poorly understood, not least due to problems of boundary delineation.
“The inter-play between constructs that influence implementation is generally poorly understood, not least due to the problems of boundary delineation mentioned above; as such, there is a need for more in-depth longitudinal studies which examine the dynamics of the innovation, the actors involved, the context and the proposed model of facilitation.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe revised i-PARIHS framework explicitly integrates the conceptual framework with supporting theories and an operational model of facilitation.
“This reflects the work that has been undertaken to explicitly integrate the conceptual framework with supporting theories and an operational model of facilitation.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationPARIHS claimed an eclectic provenance of relevant theories and philosophical perspectives.
“PARIHS claimed an eclectic provenance of relevant theories and philosophical perspectives [1].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [1] Kitson A, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARIHS framework: theoretical and practical challenges. Implement Sci. 2008;3:1. source
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationAnother criticism of PARIHS was the lack of detail around its theoretical foundations.
“Another criticism of PARIHS was the lack of detail around its theoretical foundations.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [1] Kitson A, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARIHS framework: theoretical and practical challenges. Implement Sci. 2008;3:1. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningExperienced facilitators learn how to manage the uncertainty of implementation and keep individuals and teams on track.
“Experienced facilitators learn how to manage this uncertainty and keep individuals and teams on track.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe i-PARIHS framework locates the success or otherwise of implementation upon the ability of the facilitator and the facilitation process to enable recipients within their particular context to adopt and apply the innovation by tailoring their intervention appropriately.
“The i-PARIHS framework therefore locates the success or otherwise of implementation upon the ability of the facilitator and the facilitation process to enable recipients within their particular context to adopt and apply the innovation by tailoring their intervention appropriately.”
Quote in the paperSubstantial claim- Rests on an assumption: Implementation of evidence into practice is a complex, multi-dimensional process.
Classified as probably not a substantial claim. May combine two claims.
PremisecitationNormalisation process theory acknowledges the interaction of actors (recipients) within their context and proposes four constructs-coherence, cognitive participation, collective action and reflexive monitoring-as the generative mechanisms required to routinely embed innovations.
“One that has been applied in healthcare is normalisation process theory [77, 78], which acknowledges the interaction of actors (recipients) within their context and proposes four constructs titled coherence, cognitive participation, collective action and reflexive monitoring as the generative mechanisms required to routinely embed innovations.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [77] May C, Finch T. Implementation, embedding, and integration: an outline of Normalization Process Theory. Sociology. 2009;43(3):535–54. source
Not checked in the free run.
- cites [78] May C, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, et al. Development of a theory of implementation and integration: normalization Process Theory. Implement Sci. 2009;4(1):29. source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
InterpretationreasoningThere may be overlap between the constructs of innovation, recipients and context, so any attempt to distinguish them may be imperfect and open for debate.
“From the discussion in the paper, we have tried to delineate the boundaries between the constructs of innovation, recipients and context; yet we know that, depending on the situation, there may be overlap between them thus any attempt to distinguish them may be imperfect and open for debate.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Interpretationnone givenThe interrelationship between the innovation, the recipients and the multiple layers of contexts is often unpredictable, fluid and iterative.
“The reality, however, is very different; the interrelationship between the innovation, the recipients and the multiple layers of contexts is often unpredictable, fluid and iterative.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationRogers highlighted the importance of understanding different groups within the intended audience for innovation and how they are likely to react, as well as making use of peer-to-peer conversations and credible, trusted teachers and leaders to bring people on board with the change.
“For example, Rogers highlighted the importance of understanding different groups within the intended audience for innovation and how they are likely to react, as well as making use of peer-to-peer conversations and credible, trusted teachers and leaders to bring people on board with the change [33, 34].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [33] Rogers EM. Diffusion of innovations. 4th ed. New York: The Free Press; 1995.
Not checked in the free run.
- cites [34] Rogers EM. Diffusion of innovations. 5th ed. New York: Free Press; 2003.
Not checked in the free run.
Classified as probably not a substantial claim.
InterpretationcitationThe i-PARIHS framework continues the theoretical eclecticism of PARIHS but presents it in a more coherent way.
“In our deliberations with i-PARIHS, we have continued with the theoretical eclecticism but have tried to present it in a more coherent way [16].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [16] Harvey G, Kitson A. PARIHS re-visited: introducing i-PARIHS. In: Harvey G, Kitson A, editors. Implementing evidence-based practice in health care: a facilitation guide. Abingdon, Oxon: Routledge; 2015. p. 25–46. source
Not checked in the free run.
Classified as probably not a substantial claim. May combine two claims.
InterpretationreasoningCommon themes from the theoretical overview reinforce the complex, dynamic and non-linear nature of implementation and emphasise the importance of experiential learning at the level of individuals, teams and organisations.
“From this brief overview of theories, a number of common themes are apparent which reinforce the complex, dynamic and non-linear nature of implementation and emphasise the importance of experiential learning at the level of individuals, teams and organisations.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe humanist theoretical perspective on facilitation emphasises the importance of enabling others, as opposed to telling, teaching, persuading or coercing them to act.
“Fundamentally, this theoretical perspective on facilitation emphasises the importance of enabling others, as opposed to telling, teaching, persuading or coercing them to act.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [82] Rogers CR. Freedom to learn—a view of What Education Might Become. Charles Merrill: Columbus, Ohio; 1969.
Not checked in the free run.
- cites [83] Heron J. The facilitator’s handbook. London: Kogan Page; 1989.
Not checked in the free run.
May combine two claims.
PremisecitationWithin the 23 studies reviewed, facilitators employed a number of different facilitation strategies, in particular audit and feedback (used in 100 per cent of studies) and interactive consensus building and goal setting (91 per cent use), alongside reminders, tailoring to context and quality improvement tools such as Plan-Do-Study-Act (PDSA) cycles.
“Within the 23 studies reviewed, facilitators employed a number of different facilitation strategies, in particular audit and feedback (used in 100 per cent of studies) and interactive consensus building and goal setting (91 per cent use), alongside reminders, tailoring to context and quality improvement tools such as Plan-Do-Study-Act (PDSA) cycles.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [52] Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10:63–74. source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
Interpretationnone givenThe labelling of the construct 'recipients' may present a rather passive role for the actors involved in implementation.
“Likewise, we recognise that the labelling of the construct ‘recipients’ may present a rather passive role for the actors involved in implementation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Interpretationnone givenFacilitation is operationalised through a network of novice, experienced and expert facilitators applying a range of enabling skills and improvement strategies to structure the implementation process, engage and manage relationships between key stakeholders and identify and negotiate barriers to implementation within the contextual setting.
“Facilitation is operationalised through a network of novice, experienced and expert facilitators applying a range of enabling skills and improvement strategies to structure the implementation process, engage and manage relationships between key stakeholders and identify and negotiate barriers to implementation within the contextual setting.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe PARIHS conceptual framework was developed in an attempt to represent the dynamic and multi-faceted nature of implementation in healthcare.
“The PARIHS conceptual framework was developed in an attempt to represent the dynamic and multi-faceted nature of implementation in healthcare.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [1] Kitson A, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARIHS framework: theoretical and practical challenges. Implement Sci. 2008;3:1. source
Not checked in the free run.
Classified as probably not a substantial claim. May combine two claims.
InterpretationreasoningThe revised i-PARIHS framework positions facilitation as the active ingredient of implementation, assessing and aligning the innovation to be implemented with the intended recipients in their local, organisational and wider system context.
“The revised i-PARIHS framework positions facilitation as the active ingredient of implementation, assessing and aligning the innovation to be implemented with the intended recipients in their local, organisational and wider system context.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningFacilitation is the construct that activates implementation through assessing and responding to characteristics of the innovation and the recipients (both as individuals and in teams) within their contextual setting.
“We propose that facilitation is the construct that activates implementation through assessing and responding to characteristics of the innovation and the recipients (both as individuals and in teams) within their contextual setting.”
Quote in the paperNot a substantial claim- Rests on an assumption: Implementation of evidence into practice is a complex, multi-dimensional process.
Probably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing), S4 (based).
Interpretationnone givenThe further out into the spiral the facilitator moves, the greater the level of experience and skill they will need.
“Our hypothesis is that the further out into the spiral the facilitator moves, the greater the level of experience and skill they will need.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationWeiner's theory of organisational readiness to change proposes that readiness depends on collective behaviour change linked to two key factors: change commitment (wanting to change) and change efficacy (able to change).
“Weiner’s theory of organisational readiness to change [71] proposes that readiness depends on collective behaviour change linked to two key factors, described as change commitment (wanting to change) and change efficacy (able to change).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [71] Weiner B. A theory of organizational readiness for change. Implement Sci. 2009;4(1):67. source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningFacilitation itself is a complex intervention, involving one or more individuals in the role of facilitator, applying a combination of improvement and team-focused strategies to enable and support change.
“This likely reflects the fact that facilitation itself is a complex intervention, involving one or more individuals in the role of facilitator, applying a combination of improvement and team-focused strategies to enable and support change.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
InterpretationreasoningNovice facilitators may be able to support locally focused implementation projects but are likely to need the support of a more experienced facilitator to assess and negotiate some of the more challenging barriers or contextual factors they may encounter.
“This in turn suggests that whilst novice facilitators may be able to support locally focused implementation projects (in terms of working with a local team to plan and undertake the project), they are likely to need the support of a more experienced facilitator to assess and negotiate some of the more challenging barriers or contextual factors they may encounter.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
PremisecitationThere is still more work to do on clarifying the concept of facilitation.
“As others have noted, there is still more work to do on clarifying the concept of facilitation [80, 81].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [80] Dogherty EJ, Harrison MB, Graham ID. Facilitation as a role and process in achieving evidence-based practice in nursing: a focused review of concept and meaning. Worldviews Evid Based Nurs. 2010;7(2):76–89.
Not checked in the free run.
- cites [81] Berta W, Cranley L, Dearing JW, Dogherty EJ, Squires JE, Estabrooks CA. Why (we think) facilitation works: insights from organizational learning theory. Implement Sci. 2015;10(1):1–13. source
Not checked in the free run.
Probably not a substantial claim: may not pass S4 (based).
Premisenone givenThe PARIHS framework has been widely applied, tested, reviewed and refined.
“The framework has been widely applied, tested, reviewed and refined.”
Quote in the paperNot a substantial claim
The authors state this as an assumption.
Successful implementation can be primarily specified as the achievement of implementation/project goals.
“In our revised, i-PARIHS framework, successful implementation is primarily specified in terms of the achievement of implementation/project goals and results from the facilitation of an innovation with the recipients in their (local, organisational and health system) context (Table 2).”
The paper relies on this without support.
Implementation of evidence into practice is a complex, multi-dimensional process.
“PARIHS was one of the first frameworks to make explicit the multi-dimensional and complex nature of implementation as well as highlighting the central importance of context.”
Cites
Situated Learning: Legitimate Peripheral Participation.
Bloch, M. E. F., Lave, J., & Wenger, É. (1994) · Man · doi:10.2307/2804509 · Cited by 39,323 · see citing works
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,557 · see citing works
Lave, J., & Wenger, E. (1991) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815355 · Cited by 33,219 · see citing works
(1983) · Cited by 33,192 · see citing works
(1999) · Cited by 28,356 · see citing works
Communities of Practice: Learning, Meaning, and Identity
Wenger, E. (1998) · doi:10.1017/cbo9780511803932 · Cited by 23,500 · see citing works
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,555 · see citing works
The fifth discipline, the art and practice of the learning organization
Senge, P. M. (1991) · Performance + Instruction · doi:10.1002/pfi.4170300510 · Cited by 20,060 · see citing works
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · see citing works
Organizational Culture and Leadership
Tierney, W. G., & Schein, E. H. (1986) · Academy of Management Review · doi:10.2307/258322 · Cited by 9,614 · see citing works
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · see citing works
Deming, W. E. (1982) · Medical Entomology and Zoology · Cited by 7,297 · see citing works
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485 · see citing works
Cane, J., O’Connor, D., & Michie, S. (2012) · Implementation Science · doi:10.1186/1748-5908-7-37 · Cited by 4,888 · see citing works
Organizational culture and leadership
Tohidi, H., & Jabbari, M. M. (2012) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2011.12.156 · Cited by 4,328 · see citing works
Making psychological theory useful for implementing evidence based practice: a consensus approach
Michie, S. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.011155 · Cited by 3,440 · see citing works
Gluesing, J. C. (2012) · Sage eBooks · doi:10.4135/9781412994231.n14 · Cited by 3,259 · see citing works
Carlile, P. R. (2004) · Organization Science · doi:10.1287/orsc.1040.0094 · Cited by 3,101 · see citing works
The challenge of complexity in health care
Plsek, P. E., & Greenhalgh, T. (2001) · BMJ · doi:10.1136/bmj.323.7313.625 · Cited by 2,578 · see citing works
Organizational learning II: Theory, method and practice
Marraffa, M. (1998) · Iris (Roma Tre University) · Cited by 2,309 · see citing works
A theory of organizational readiness for change
Weiner, B. J. (2009) · Implementation Science · doi:10.1186/1748-5908-4-67 · Cited by 2,268 · see citing works
Implementing, Embedding, and Integrating Practices: An Outline of Normalization Process Theory
May, C., & Finch, T. (2009) · Sociology · doi:10.1177/0038038509103208 · Cited by 2,115 · see citing works
Enabling the implementation of evidence based practice: a conceptual framework.
Kitson, A., Harvey, G., & McCormack, B. (1998) · Quality in Health Care · doi:10.1136/qshc.7.3.149 · Cited by 1,985 · see citing works
Self-citationde Ven, A. H. V. (2007) · doi:10.1093/oso/9780199226290.001.0001 · Cited by 1,861 · see citing works
Evidence based medicine: a movement in crisis?
Greenhalgh, T., Howick, J., Maskrey, N., & for the Evidence Based Medicine Renaissance Group (2014) · BMJ · doi:10.1136/bmj.g3725 · Cited by 1,787 · see citing works
van de Ven, & Haines, A. (1999) · Medical Entomology and Zoology · Cited by 1,421 · see citing works
Development of a theory of implementation and integration: Normalization Process Theory
May, C. R., Mair, F., Finch, T., MacFarlane, A., Dowrick, C., Treweek, S., Rapley, T., Ballini, L., Ong, B. N., Rogers, A., et al. (2009) · Implementation Science · doi:10.1186/1748-5908-4-29 · Cited by 1,409 · see citing works
Bridging Research and Practice
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.05.024 · Cited by 1,386 · see citing works
Kitson, A. L., Rycroft-Malone, J., Harvey, G., McCormack, B., Seers, K., & Titchen, A. (2008) · Implementation Science · doi:10.1186/1748-5908-3-1 · Cited by 1,314 · see citing works
Self-citationFlottorp, S. A., Oxman, A. D., Krause, J., Musila, N. R., Wensing, M., Godycki-Cwirko, M., Baker, R., & Eccles, M. P. (2013) · Implementation Science · doi:10.1186/1748-5908-8-35 · Cited by 1,138 · see citing works
Local opinion leaders: effects on professional practice and health care outcomes
Flodgren, G., Parmelli, E., Doumit, G., Gattellari, M., O'Brien, M. A., Grimshaw, J., & Eccles, M. P. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000125.pub4 · Cited by 1,070 · see citing works
Gabbay, J., & May, A. L. (2004) · BMJ · doi:10.1136/bmj.329.7473.1013 · Cited by 986 · see citing works
What counts as evidence in evidence‐based practice?
Rycroft‐Malone, J., Seers, K., Titchen, A., Harvey, G., Kitson, A. A., & McCormack, B. G. (2004) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2004.03068.x · Cited by 960 · see citing works
Self-citationPlanning and Studying Improvement in Patient Care: The Use of Theoretical Perspectives
GROL, R. P. T. M., BOSCH, M. C., HULSCHER, M. E. J. L., ECCLES, M. P., & WENSING, M. (2007) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2007.00478.x · Cited by 943 · see citing works
Eccles, M., Grimshaw, J., Walker, A., Johnston, M., & Pitts, N. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.09.002 · Cited by 917 · see citing works
Getting evidence into practice: the meaning of `context'
McCormack, B., Kitson, A., Harvey, G., Rycroft‐Malone, J., Titchen, A., & Seers, K. (2002) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2002.02150.x · Cited by 765 · see citing works
Self-citationGetting evidence into practice: the role and function of facilitation
Harvey, G., Loftus‐Hills, A., Rycroft‐Malone, J., Titchen, A., Kitson, A., McCormack, B., & Seers, K. (2002) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2002.02126.x · Cited by 730 · see citing works
Self-citationIngredients for change: revisiting a conceptual framework
Rycroft-Malone, J. (2002) · Quality and Safety in Health Care · doi:10.1136/qhc.11.2.174 · Cited by 701 · see citing works
An exploration of the factors that influence the implementation of evidence into practice
Rycroft‐Malone, J., Harvey, G., Seers, K., Kitson, A., McCormack, B., & Titchen, A. (2004) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2004.01007.x · Cited by 623 · see citing works
Self-citationSystematic Review and Meta-Analysis of Practice Facilitation Within Primary Care Settings
Baskerville, N. B., Liddy, C., & Hogg, W. (2012) · The Annals of Family Medicine · doi:10.1370/afm.1312 · Cited by 571 · see citing works
Helfrich, C. D., Li, Y.-F., Sharp, N. D., & Sales, A. E. (2009) · Implementation Science · doi:10.1186/1748-5908-4-38 · Cited by 564 · see citing works
Freedom to learn: A view of what education might become
Peters, R. S. (1970) · Interchange · doi:10.1007/bf02214887 · Cited by 522 · see citing works
Freedom to learn :a view of what education might become
Rogers, C. R. (1969) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 484 · see citing works
A guide to knowledge translation theory
Estabrooks, C. A., Thompson, D. S., Lovely, J. J. E., & Hofmeyer, A. (2006) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.48 · Cited by 435 · see citing works
A Guide for applying a revised version of the PARIHS framework for implementation
Stetler, C. B., Damschroder, L. J., Helfrich, C. D., & Hagedorn, H. J. (2011) · Implementation Science · doi:10.1186/1748-5908-6-99 · Cited by 402 · see citing works
Stetler, C., Legro, M., Rycroft-Malone, J., Bowman, C., Curran, G., Guihan, M., Hagedorn, H., Piñeros, S. L., & Wallace, C. (2006) · Implementation science : IS · doi:10.1186/1748-5908-1-23 · Cited by 392 · see citing works
Models and Frameworks for Implementing Evidence-Based Practice: Linking Evidence to Action
Rycroft‐Malone, J., & Bucknall, T. K. (2010) · Cited by 360 · see citing works
Development and assessment of the Alberta Context Tool
Estabrooks, C. A., Squires, J. E., Cummings, G. G., Birdsell, J. M., & Norton, P. G. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-234 · Cited by 317 · see citing works
Helfrich, C. D., Damschroder, L. J., Hagedorn, H. J., Daggett, G. S., Sahay, A., Ritchie, M., Damush, T., Guihan, M., Ullrich, P. M., & Stetler, C. B. (2010) · Implementation Science · doi:10.1186/1748-5908-5-82 · Cited by 306 · see citing works
Rycroft-Malone, J., Seers, K., Chandler, J., Hawkes, C. A., Crichton, N., Allen, C., Bullock, I., & Strunin, L. (2013) · Implementation Science · doi:10.1186/1748-5908-8-28 · Cited by 303 · see citing works
Why (we think) facilitation works: insights from organizational learning theory
Berta, W., Cranley, L., Dearing, J. W., Dogherty, E. J., Squires, J. E., & Estabrooks, C. A. (2015) · Implementation Science · doi:10.1186/s13012-015-0323-0 · Cited by 286 · see citing works
Heron, J. (1990) · Medical Entomology and Zoology · Cited by 226 · see citing works
Dogherty, E. J., Harrison, M. B., & Graham, I. D. (2010) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2010.00186.x · Cited by 215 · see citing works
Nutting, P. A., Crabtree, B. F., Stewart, E. E., Miller, W. L., Palmer, R. F., Stange, K. C., & Jaén, C. R. (2010) · The Annals of Family Medicine · doi:10.1370/afm.1119 · Cited by 201 · see citing works
From research to practice: one organizational model for promoting research‐based practice
Kitson, A. A., Ahmed, L., Harvey, G., Seers, K., & Thompson, D. R. (1996) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.1996.tb00003.x · Cited by 192 · see citing works
Self-citationRao, M. K. (2009) · Kidney International · doi:10.1038/ki.2009.19 · Cited by 172 · see citing works
Towards practice development — a vision in reality or a reality without vision?
Mccormack, Manley, Kitson, A. A., Titchen, & Harvey, G. (1999) · Journal of Nursing Management · doi:10.1046/j.1365-2834.1999.00133.x · Cited by 162 · see citing works
Self-citation10 years of mindlines: a systematic review and commentary
Wieringa, S., & Greenhalgh, T. (2015) · Implementation Science · doi:10.1186/s13012-015-0229-x · Cited by 150 · see citing works
Cook, L., & Watkins, E. R. (2016) · Trials · doi:10.1186/s13063-015-1128-9 · Cited by 146 · see citing works
Theory and Knowledge Translation: Setting Some Coordinates
Rycroft-Malone, J. (2007) · Nursing Research · doi:10.1097/01.nnr.0000280631.48407.9b · Cited by 131 · see citing works
Development and Testing of the Context Assessment Index (CAI)
McCormack, B., McCarthy, G., Wright, J., & Coffey, A. (2009) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2008.00130.x · Cited by 126 · see citing works
Gabbay, J., le May, A., Jefferson, H., Webb, D., Lovelock, R., Powell, J., & Lathlean, J. (2003) · Health An Interdisciplinary Journal for the Social Study of Health Illness and Medicine · doi:10.1177/1363459303007003003 · Cited by 120 · see citing works
Practice Development in Nursing and Healthcare
McCormack, B. G., Manley, K., & Titchen, A. (2013) · Cited by 117 · see citing works
Facilitating prevention in primary care.
Fowler, G., Fullard, E., & Gray, M. (1992) · BMJ · doi:10.1136/bmj.304.6835.1177-a · Cited by 105 · see citing works
Harvey, G., & Kitson, A. (2015) · International Journal of Health Policy and Management · doi:10.15171/ijhpm.2015.54 · Cited by 103 · see citing works
Self-citationKislov, R., Harvey, G., & Walshe, K. (2011) · Implementation Science · doi:10.1186/1748-5908-6-64 · Cited by 102 · see citing works
Self-citationHarvey, G., Fitzgerald, L., Fielden, S. L., McBride, A., Waterman, H. A., Bamford, D., Kislov, R., & Boaden, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-96 · Cited by 100 · see citing works
Self-citationBlakeman, T., Protheroe, J., Chew-Graham, C., Rogers, A., & Kennedy, A. (2012) · British Journal of General Practice · doi:10.3399/bjgp12x636056 · Cited by 96 · see citing works
Parchman, M. L., Noël, P. H., Culler, S. D., Lanham, H. J., Leykum, L. K., Romero, R. L., & Palmer, R. F. (2013) · Implementation Science · doi:10.1186/1748-5908-8-93 · Cited by 96 · see citing works
FIRE (facilitating implementation of research evidence): a study protocol
Seers, K., Cox, K., Crichton, N. J., Edwards, R. T., Eldh, A. C., Estabrooks, C. A., Harvey, G., Hawkes, C., Kitson, A. A., Linck, P., et al. (2012) · Implementation Science · doi:10.1186/1748-5908-7-25 · Cited by 90 · see citing works
Self-citationBidassie, B., Williams, L. S., Woodward-Hagg, H., Matthias, M. S., & Damush, T. M. (2015) · Implementation Science · doi:10.1186/s13012-015-0252-y · Cited by 86 · see citing works
Persson, L. Å., Nga, N. T., Målqvist, M., Thi Phuong Hoa, D., Eriksson, L., Wallin, L., Selling, K., Huy, T. Q., Duc, D. M., Tiep, T. V., et al. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001445 · Cited by 83 · see citing works
Facilitating prevention in primary care.
Fullard, E., Fowler, G. H., & Gray, M. (1984) · BMJ · doi:10.1136/bmj.289.6458.1585 · Cited by 79 · see citing works
Harvey, G., Jas, P., & Walshe, K. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2014-002928 · Cited by 73 · see citing works
Self-citationA pragmatic cluster randomised trial evaluating three implementation interventions
Rycroft-Malone, J., Seers, K., Crichton, N., Chandler, J., Hawkes, C. A., Allen, C., Bullock, I., & Strunin, L. (2012) · Implementation Science · doi:10.1186/1748-5908-7-80 · Cited by 71 · see citing works
Ritchie, M. J., Kirchner, J. E., Parker, L. E., Curran, G. M., Fortney, J. C., Pitcock, J. A., Bonner, L. M., & Kilbourne, A. M. (2015) · Implementation Science · doi:10.1186/1748-5908-10-s1-a46 · Cited by 60 · see citing works
McKee, L., Charles, K., Dixon‐Woods, M., et al. (2013) · Journal of Health Services Research & Policy · doi:10.1177/1355819613484460 · Cited by 52 · see citing works
Wallin, L., Målqvist, M., Nga, N. T., Eriksson, L., Persson, L. Å., Hoa, D. T. P., Huy, T. Q., Đức, D. M., & Ewald, U. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-239 · Cited by 43 · see citing works
Engels, Y., van den Hombergh, P., Mokkink, H. G. A., van den Hoogen, H., van den Bosch, W., & Grol, R. P. T. M. (2006) · PubMed Central · Cited by 40 · see citing works
Eriksson, L., Huy, T. Q., Duc, D. M., Ekholm Selling, K., Hoa, D. P., Thuy, N. T., Nga, N. T., Persson, L.-Å., & Wallin, L. (2016) · Trials · doi:10.1186/s13063-015-1141-z · Cited by 38 · see citing works
The Clinical Audit Handbook: improving the quality of health care
Harvey, G., & Morrell, C. (1999) · Research Explorer (The University of Manchester) · Cited by 37 · see citing works
Self-citationAn Overview of Practice Facilitation Programs in Canada: Current Perspectives and Future Directions
Liddy, C. E., Laferriere, D., Baskerville, B., et al. (2013) · Healthcare policy · doi:10.12927/hcpol.2013.23177 · Cited by 36 · see citing works
Wiechula, R., Kitson, A. A., Marcoionni, D., Page, T., Zeitz, K., & Silverston, H. (2009) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1744-1609.2009.00145.x · Cited by 35 · see citing works
Self-citationHarvey, G., Kitson, A., & Munn, Z. (2012) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1744-1609.2012.00296.x · Cited by 30 · see citing works
Self-citationHumphreys, J., Harvey, G., Coleiro, M., Butler, B., Barclay, A., Gwozdziewicz, M., O'Donoghue, D. J., & Hegarty, J. (2012) · BMJ Quality & Safety · doi:10.1136/bmjqs-2011-000664 · Cited by 29 · see citing works
Self-citationBeyond evidence‐based medicine: complexity and stories of maternity care
Downe, S. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2009.01357.x · Cited by 24 · see citing works
Harvey, G., & Kitson, A. (2015) · Implementing Evidence-Based Practice In Healthcare · doi:10.4324/9780203557334-3 · Cited by 22 · see citing works
Self-citationHarvey, G., Oliver, K., Humphreys, J., Rothwell, K., & Hegarty, J. (2015) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzu097 · Cited by 21 · see citing works
Self-citationSchultz, T., Kitson, A. A., Soenen, S., Long, L., Shanks, A., Wiechula, R., Chapman, I., & Lange, K. M. (2014) · e-SPEN Journal · doi:10.1016/j.clnme.2014.01.002 · Cited by 19 · see citing works
Self-citationGibb, H. (2012) · Journal of Nursing Management · doi:10.1111/j.1365-2834.2012.01407.x · Cited by 18 · see citing works
Estabrooks, C. A., Squires, J. E., Hayduk, L. A., et al. (2015) · Implementation Science · doi:10.1186/1748-5908-10-s1-a64 · Cited by 13 · see citing works
Reproductive and sexual health in the Maldives: analysis of data from two cross-sectional surveys
Cockcroft, A., Pearson, L., Hamel, C., & Andersson, N. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-s2-s6 · Cited by 9 · see citing works
Facilitating an Evidence-Based Innovation into Practice
Kitson, A. A., & Harvey, G. (2015) · Routledge eBooks · doi:10.4324/9780203557334-6 · Cited by 9 · see citing works
Self-citationWiechula, R., Shanks, A., Schultz, T., et al. (2015) · Routledge eBooks · doi:10.4324/9780203557334-11 · Cited by 8 · see citing works
Self-citationPARIHS re-visited: introducing i-PARIHS
Harvey, G., & Kitson, A. A. (2015) · Cited by 6 · see citing works
Self-citationGetting Started With Facilitation
Kitson, A., & Harvey, G. (2015) · Implementing Evidence-Based Practice In Healthcare · doi:10.4324/9780203557334-5 · Cited by 4 · see citing works
Self-citationFinal Report Summary - FIRE (Facilitating Implementation of Research Evidence)
Seers, K. (2013) · Warwick Research Archive Portal (University of Warwick) · Cited by 4 · see citing works
Kitson, A. A., Marcoionni, D., Page, T., Wiechula, R., & Zeitz, C. (2010) · Adelaide Research & Scholarship (AR&S) (University of Adelaide) · Cited by 3 · see citing works
Self-citationKitson, A. A., Wiechula, R., Zeitz, C., Marcoionni, D., Page, T., & Silverston, H. (2011) · Adelaide Research & Scholarship (AR&S) (University of Adelaide) · Cited by 3 · see citing works
Self-citationA Facilitation Project to Improve the Management Of Continence In European Nursing Homes
Harvey, G., & Kitson, A. A. (2015) · Routledge eBooks · doi:10.4324/9780203557334-9 · Cited by 1 · see citing works
Self-citation
Flagged first, then by citations
3 of the 103 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- Hargreaves D. Creative professionalism: the role of teachers in the knowledge society. London: Demos; 1998.
- Royal College of Nursing. Quality patient care: the dynamic standard setting system. Scutari: Harrow; 1990.
- Heron J. The facilitator’s handbook. London: Kogan Page; 1989.
Cited by
Sorted by citations
Implementation science: What is it and why should I care?
Bauer, M. S., & Kirchner, J. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.04.025 · Cited by 1,167 · see citing works
Nilsen, P., & Bernhardsson, S. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4015-3 · Cited by 1,014 · see citing works
Understanding and applying the RE-AIM framework: Clarifications and resources
Holtrop, J. S., Estabrooks, P. A., Gaglio, B., Harden, S. M., Kessler, R. S., King, D. K., Kwan, B. M., Ory, M. G., Rabin, B. A., Shelton, R. C., et al. (2021) · Journal of Clinical and Translational Science · doi:10.1017/cts.2021.789 · Cited by 549 · see citing works
Woodward, E. N., Matthieu, M. M., Uchendu, U. S., Rogal, S. S., & Kirchner, J. E. (2019) · Implementation Science · doi:10.1186/s13012-019-0861-y · Cited by 477 · see citing works
“Therefore, using two widely accepted conceptual frameworks—one from implementation science [18] and one from healthcare disparities [35]—we propose and apply the Health Equity Implementation Framework to assess its feasibility.”
Li, S.-A., Jeffs, L., Barwick, M., & Stevens, B. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0734-5 · Cited by 433 · see citing works
“The relationship between implementation outcomes and context have been described in implementation theories, models, and frameworks including Rogers’ diffusion of innovations theory [17]; the Consolidated Framework for Implementation Research framework (CFIR) [18]; the Exploration, Preparation, Implementation, and Sus…”
MethodPerry, C. K., Damschroder, L. J., Hemler, J. R., Woodson, T. T., Ono, S. S., & Cohen, D. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0876-4 · Cited by 288 · see citing works
Stover, A. M., Haverman, L., van Oers, H. A., Greenhalgh, J., Potter, C., Ahmed, S., Greenhalgh, J., Gibbons, E. J., Haverman, L., Manalili, K., et al. (2020) · Quality of Life Research · doi:10.1007/s11136-020-02564-9 · Cited by 313 · see citing works
“In its most recent development [40], i-PARIHS’ three multilevel predictors include: (1) the innovation (ways stakeholders perceive and adapt innovations like PROMs/ PREMs to align with local priorities); (2) recipients (how individuals and communities of practice influence uptake of new knowledge in clinics); and (3)…”
BackgroundDelivering transformative action in paediatric pain: a Lancet Child & Adolescent Health Commission
Eccleston, C., Fisher, E., Howard, R. F., Slater, R., Forgeron, P. A., Palermo, T. M., Birnie, K. A., Anderson, B. J., Chambers, C. T., Crombez, G., et al. (2020) · The Lancet Child & Adolescent Health · doi:10.1016/s2352-4642(20)30277-7 · Cited by 338 · see citing works
Harnessing the power of theorising in implementation science
Kislov, R., Pope, C., Martin, G. P., & Wilson, P. M. (2019) · Implementation Science · doi:10.1186/s13012-019-0957-4 · Cited by 289 · see citing works
“Interestingly, this dynamic approach is apparent in the development of NPT and PARIHS, both of which have evolved significantly in response to empirical verification and conceptual critique [15, 30].”
Getting a clinical innovation into practice: An introduction to implementation strategies
Kirchner, J. E., Smith, J. L., Powell, B. J., Waltz, T. J., & Proctor, E. K. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.06.042 · Cited by 263 · see citing works
“The study was guided by the ‘Promoting Action on Research Implementation in Health Services’ (PARIHS) framework (an earlier version of the iPARIHS framework described above) (Harvey and Kitson, 2016).”
BackgroundMethodWoodward, E. N., Singh, R. S., Ndebele‐Ngwenya, P., Castillo, A. M., Dickson, K. S., & Kirchner, J. E. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00146-5 · Cited by 274 · see citing works
“(healthcare system) [26]: • Policy drivers and priorities • Incentives and mandates • Regulatory frameworks or external accreditation systems • Inter-organizational networks and relationships terms of resources, culture, leadership, and orientation to evaluation and learning.”
BackgroundMethodInfluentialLynch, E. A., Mudge, A., Knowles, S. E., Kitson, A. A., Hunter, S. C., & Harvey, G. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3671-z · Cited by 220 · see citing works
“Revised to integrated or i-PARIHS framework in 2015 [10]”
BackgroundMethodInfluentialSelf-citationUsing Complexity and Network Concepts to Inform Healthcare Knowledge Translation
Kitson, A. A., Brook, A. H., Harvey, G., Jordan, Z., Marshall, R. J., O’Shea, R., & Wilson, D. (2017) · International Journal of Health Policy and Management · doi:10.15171/ijhpm.2017.79 · Cited by 203 · see citing works
“33 This preliminary mapping work, along with previous experience in the KT space 8,24,33-36 encouraged us to conceptualize KT as a multidimensional, dynamic, complex, integrated process.”
Self-citationThe effectiveness of champions in implementing innovations in health care: a systematic review
Santos, W. J., Graham, I. D., Lalonde, M., Demery Varin, M., & Squires, J. E. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00315-0 · Cited by 205 · see citing works
“Best practice and technology can be defined as an innovation [3, 4].”
BackgroundDopp, A. R., Parisi, K. E., Munson, S. A., & Lyon, A. R. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00020-w · Cited by 171 · see citing works
“In keeping with key implementation frameworks [10, 36], the expert panel identified clusters of implementation strategies that addressed intra- and inter-organizational contexts (“access resources,” “incentivize the innovation”), EBP providers (“support providers”), or the implementation process itself (“monitor chang…”
BackgroundMethodResultInfluentialJames, H. M., Papoutsi, C., Wherton, J., Greenhalgh, T., & Shaw, S. E. (2021) · Journal of Medical Internet Research · doi:10.2196/23775 · Cited by 164 · see citing works
Greenhalgh, T., Rosen, R., Shaw, S. E., Byng, R., Faulkner, S., Finlay, T., Grundy, E., Husain, L., Hughes, G., Leone, C., et al. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.726095 · Cited by 173 · see citing works
“There are theoretical parallels with other complexity-informed implementation and evaluation frameworks including i-PARIHS (22), normalization process theory (23), and the consolidated framework for implementation research (24).”
BackgroundConnolly, S. L., Stolzmann, K. L., Heyworth, L. K., Weaver, K. R., Bauer, M. S., & Miller, C. J. (2020) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2020.0233 · Cited by 171 · see citing works
Hawk, K. F., D’Onofrio, G., Chawarski, M. C., O’Connor, P. G., Cowan, E. A., Lyons, M. S., Richardson, L. D., Rothman, R. E., Whiteside, L., Owens, P. H., et al. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.4561 · Cited by 182 · see citing works
Bullock, H. L., Lavis, J. N., Wilson, M. G., Mulvale, G. M., & Miatello, A. (2021) · Implementation Science · doi:10.1186/s13012-021-01082-7 · Cited by 191 · see citing works
Shelton, R. C., Lee, M., Brotzman, L., Wolfenden, L., Nathan, N., & Wainberg, M. L. (2020) · International Journal of Behavioral Medicine · doi:10.1007/s12529-020-09848-x · Cited by 143 · see citing works
“, providers, clinics, organizations), often with a focus on real-world generalizability [11, 42, 46, 47].”
BackgroundBergström, A., Ehrenberg, A., Eldh, A. C., Graham, I. D., Gustafsson, K., Harvey, G., Hunter, S. C., Kitson, A. A., Rycroft‐Malone, J., & Wallin, L. (2020) · Implementation Science · doi:10.1186/s13012-020-01003-0 · Cited by 149 · see citing works
“, [318, 359, 367, 374, 382]), and informing education and learning and teaching initiatives [144, 372].”
BackgroundSelf-citationCore knowledge translation competencies: a scoping review
Mallidou, A. A., Atherton, P., Chan, L., Frisch, N. C., Glegg, S., & Scarrow, G. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3314-4 · Cited by 135 · see citing works
“Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice.”
BackgroundInfluentialDryden‐Palmer, K., Parshuram, C. S., & Berta, W. B. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-4935-y · Cited by 133 · see citing works
“the main constructs of evidence, context, facilitation and recipients [3].”
BackgroundMethodPorritt, K. A., McArthur, A., Lockwood, C. S., & Munn, Z. (2022) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000361 · Cited by 153 · see citing works
The R2C2 Model in Residency Education: How Does It Foster Coaching and Promote Feedback Use?
Sargeant, J., Lockyer, J. M., Mann, K., Armson, H., Warren, A., Zetkulic, M., Soklaridis, S., Könings, K. D., Ross, K., Silver, I., et al. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002131 · Cited by 148 · see citing works
Melnyk, B. M., Tan, A., Hsieh, A. P., & Gallagher‐Ford, L. (2021) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12524 · Cited by 146 · see citing works
Crable, E. L., Lengnick‐Hall, R., Stadnick, N. A., Moullin, J. C., & Aarons, G. A. (2022) · Implementation Science · doi:10.1186/s13012-022-01256-x · Cited by 124 · see citing works
“In other TMFs, researchers can specify policy within the innovation [49, 58], evidence [59], or intervention”
BackgroundMethodDopp, A. R., Parisi, K. E., Munson, S. A., & Lyon, A. R. (2019) · Health Research Policy and Systems · doi:10.1186/s12961-018-0403-0 · Cited by 121 · see citing works
Davis, M. M., Freeman, M., Shannon, J., Coronado, G. D., Stange, K. C., Guise, J., Wheeler, S. B., & Buckley, D. (2018) · BMC Cancer · doi:10.1186/s12885-017-3813-4 · Cited by 126 · see citing works
“The authors appreciate the input of our Technical Expert Panel Members (which includes national experts and regional primary care and health system stakeholders): Jonathan Tobin, PhD – President/CEO of Clinical Directors Network, Inc. (CDN) and Co-Director, Community Engaged Research Core, The Rockefeller University C…”
BackgroundWang, D. Y., Wong, E. L., Nilsén, P., Chung, V. C., Tian, Y., & Yeoh, E. (2023) · Implementation Science · doi:10.1186/s13012-023-01296-x · Cited by 138 · see citing works
CPD of the future: a partnership between quality improvement and competency‐based education
Sargeant, J. M., Wong, B. M., & Campbell, C. M. (2017) · Medical Education · doi:10.1111/medu.13407 · Cited by 124 · see citing works
Waldén, M., Mountjoy, M. L., McCall, A., Serner, A., Massey, A., Tol, J. L., Bahr, R., D’Hooghe, M., Bittencourt, N. F. N., Villa, F. D., et al. (2023) · British Journal of Sports Medicine · doi:10.1136/bjsports-2022-106405 · Cited by 129 · see citing works
“40 In addition, the identification of implementation principles and having a communication strategy for the preimplementation, implementation and postimplementation phases are recommended.”
Digital Clinics and Mobile Technology Implementation for Mental Health Care
Connolly, S. L., Kuhn, E. R., Possemato, K., & Torous, J. B. (2021) · Current Psychiatry Reports · doi:10.1007/s11920-021-01254-8 · Cited by 106 · see citing works
Nilsén, P., Ingvarsson, S., Hasson, H., Schwarz, U. V. T., & Augustsson, H. (2020) · Implementation Research and Practice · doi:10.1177/2633489520953762 · Cited by 100 · see citing works
“…success have been described in numerous so-called determinant frameworks, for example, Consolidated Framework for Implementation Research (CFIR) (Damschroder et al., 2009) and the integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) (Harvey & Kitson, 2016).”
MethodFrom novice to expert: a qualitative study of implementation facilitation skills
Ritchie, M. J., Parker, L. E., & Kirchner, J. E. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00006-8 · Cited by 94 · see citing works
“framework developers suggest a model for transferring skills that involves a network of facilitators so that novices can be mentored and supported by peers and more experienced facilitators [61], they do not provide infor-”
BackgroundDefining the external implementation context: an integrative systematic literature review
Watson, D. P., Adams, E. L., Shue, S. A., Coates, H., McGuire, A. B., Chesher, J., Jackson, J. R., & Omenka, O. I. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3046-5 · Cited by 96 · see citing works
“Furthermore, the revised i-PARiHS (for which the original version did not consider the external context [26]) is focused explicitly on the health system (as opposed to the broader community) as its external context [6].”
BackgroundInfluentialAshish, K. C., Ewald, U., Basnet, O., Gurung, A., Pyakuryal, S. N., Jha, B. K., Bergström, A., Eriksson, L., Paudel, P., Karki, S., et al. (2019) · PLoS Medicine · doi:10.1371/journal.pmed.1002900 · Cited by 88 · see citing works
“Secondly, in-hospital facilitators were appointed by the management and trained to lead the QI process and facilitate delivery staff (meso- and microlevel) [30].”
Moore, D. C., Payne, S. A., den Block, L. V., Ling, J., Froggatt, K. A., Gatsolaeva, Y., Honinx, E., Pivodic, L., Miranda, R., Onwuteaka-Philipsen, B. D., et al. (2020) · Palliative Medicine · doi:10.1177/0269216319893635 · Cited by 97 · see citing works
Implementation Science: Application of Evidence‐Based Practice Models to Improve Healthcare Quality
Tucker, S., McNett, M., Melnyk, B. M., Hanrahan, K., Hunter, S. C., Kim, B., Cullen, L., & Kitson, A. A. (2021) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12495 · Cited by 97 · see citing works
Self-citationBartlett, J. D., & Drust, B. (2020) · European Journal of Sport Science · doi:10.1080/17461391.2020.1842511 · Cited by 91 · see citing works
“…complex, diverse and challenging as professional sport, a number of frameworks and guidelines exist to support KT from bench side to bed side to community (Harvey & Kitson, 2015; Rycroft-Malone, 2004), thus posing the question of why there are no KT frameworks specific to professional sport.”
BackgroundMethodInfluentialWherton, J. P., Greenhalgh, T., & Shaw, S. E. (2021) · Journal of Medical Internet Research · doi:10.2196/31374 · Cited by 76 · see citing works
“Other system-focused frameworks such as i-PARIHS (integrated Promoting Action on Research Implementation in Health Services) take a similar though not identical approach [66].”
Hunter, S. C., Kim, B., Mudge, A., Hall, L., Young, A., McRae, P., & Kitson, A. A. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05354-8 · Cited by 85 · see citing works
Self-citationConnolly, S. L., Hogan, T. P., Shimada, S. L., & Miller, C. J. (2020) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-020-00165-4 · Cited by 78 · see citing works
Barriers and drivers to stakeholder engagement in global mental health projects
Murphy, J., Qureshi, O., Endale, T., Esponda, G. M., Pathare, S., Eaton, J., Silva, M. J. D., & Ryan, G. K. (2021) · International Journal of Mental Health Systems · doi:10.1186/s13033-021-00458-y · Cited by 81 · see citing works
“The integrated-Promoting Action on Research Implementation in Health Services (i-PARIHS) framework [37], for example, identifies facilitation as the central mechanism for promoting implementation, including via the engagement and ongoing support of external (e.”
Mudge, A., McRae, P., Banks, M., Blackberry, I., Barrimore, S. E., Endacott, J., Graves, N., Green, T., Harvey, G., Hubbard, R. E., et al. (2022) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2021.7556 · Cited by 82 · see citing works
Self-citationKilbourne, A. M., Geng, E., Eshun-Wilson, I., Sweeney, S., Shelley, D., Cohen, D. J., Kirchner, J. E., Fernandez, M. E., & Parchman, M. L. (2023) · Implementation Science Communications · doi:10.1186/s43058-023-00435-1 · Cited by 75 · see citing works
Norris, J. M., White, D. E., Nowell, L., Mrklas, K., & Stelfox, H. (2017) · Implementation Science · doi:10.1186/s13012-017-0625-5 · Cited by 82 · see citing works
“Output i-PARIHS [80] Outcome: successful implementation “Individuals, teams and stakeholders are engaged, motivated and ‘own’ the innovation” (p.”
BackgroundGifford, W., Graham, I. D., Ehrhart, M. G., Davies, B., & Aarons, G. A. (2017) · Journal of Healthcare Leadership · doi:10.2147/jhl.s125558 · Cited by 84 · see citing works
“Recent work on the Promoting Action on Research Implementation in Health Services (PARIHS) theoretical framework identifies leadership and management support as key factors of the inner organizational context for influencing the implementation of EBP in health care.(23) Although research has identified many leadership…”
von Vogelsang, A., Swenne, C. L., Gustafsson, B. Å., & Falk‐Brynhildsen, K. (2019) · Nursing Open · doi:10.1002/nop2.424 · Cited by 83 · see citing works
Nooraie, R. Y., Kwan, B. M., Cohn, E. G., AuYoung, M., Roberts, M. C., Adsul, P., & Shelton, R. C. (2020) · Journal of Clinical and Translational Science · doi:10.1017/cts.2020.10 · Cited by 71 · see citing works
“” While the complex and embedded nature of context is reflected in the implementation frameworks like The Consolidated Framework for Implementation Research (CFIR [6]), integrated-Promoting Action on Research Implementation in Health Services (i-PARIHS [7]), Exploration, Preparation, Implementation, Sustainment (EPIS…”
BackgroundBoyle, L. D., Husebo, B. S., & Vislapuu, M. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08968-2 · Cited by 81 · see citing works
“Harvey and Kitson describe the evolution of the PARIHS framework to the now revised I-PARIHS framework and state that it “was developed in an attempt to represent the dynamic and multi-faceted nature of implementation in healthcare” [82].”
Evidence-based nursing implementation in Mainland China: A scoping review
Cheng, L., Feng, S., & Hu, Y. (2016) · Nursing Outlook · doi:10.1016/j.outlook.2016.07.016 · Cited by 77 · see citing works
Implementation frameworks in child, youth and family services – Results from a scoping review
Albers, B., Mildon, R. L., Lyon, A. R., & Shlonsky, A. (2017) · Children and Youth Services Review · doi:10.1016/j.childyouth.2017.07.003 · Cited by 79 · see citing works
“…Promoting Action on Research Implementation in Health Services (PARiHS) framework has gained considerable attention and use in the health sector (Harvey & Kitson, 2016; Helfrich et al., 2010; Kitson et al., 2008; Rycroft-Malone, 2004; Stetler, Damschroder, Helfrich, & Hagedorn, 2011) but is not…”
BackgroundA Systematic Review of Clinical Practice Guidelines for Acute Procedural Pain on Neonates
Balice‐Bourgois, C., Shaha, M., Vanoni, F., Jaques, C., Newman, C. J., & Simonetti, G. D. (2020) · Clinical Journal of Pain · doi:10.1097/ajp.0000000000000808 · Cited by 76 · see citing works
Advancing the evaluation of integrated knowledge translation
Kreindler, S. A. (2018) · Health Research Policy and Systems · doi:10.1186/s12961-018-0383-0 · Cited by 65 · see citing works
Grounding implementation science in health equity for cancer prevention and control
Adsul, P., Chambers, D., Brandt, H. M., Fernández, M. E., Ramanadhan, S., Torres, E., Leeman, J., Baquero, B. I., Fleisher, L. G., Escoffery, C., et al. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00311-4 · Cited by 66 · see citing works
“, Consolidated Framework for Implementation Research [51], Theoretical Domain Framework [55], and the integrated Promoting Action on Research Implementation in Health Services framework [56]) provide a specific definition of context [57], but without an explicit consideration for social and structural determinants of…”
Prihodová, L., Guérin, S., Tunney, C., & Kernohan, G. W. (2018) · Journal of Advanced Nursing · doi:10.1111/jan.13836 · Cited by 66 · see citing works
“While in‐depth analysis of the search terms is beyond the scope of this review, many of the recent studies were based on refining of existing models and clarifying the ways of using them in the process of implementation, e.g., Harvey & Kitson, 2016.”
MethodCooke, L., Duncan, D., Rivera, L., Dowling, S. K., Symonds, C. J., & Armson, H. (2018) · Implementation Science · doi:10.1186/s13012-018-0829-3 · Cited by 63 · see citing works
Harvey, G., Gifford, W., Cummings, G. G., Kelly, J., Kislov, R., Kitson, A. A., Pettersson, L., Wallin, L., Wilson, P. M., & Ehrenberg, A. (2018) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2018.09.017 · Cited by 61 · see citing works
“This highlights the need to take account of wider policy 525 influences, beyond the immediate clinical and organisational setting, when considering 526 barriers and enablers of EBP (15,41).”
BackgroundSelf-citationEnabling Continuous Quality Improvement in Practice: The Role and Contribution of Facilitation
Harvey, G., & Lynch, E. A. (2017) · Frontiers in Public Health · doi:10.3389/fpubh.2017.00027 · Cited by 66 · see citing works
“In the widely used Promoting Action on Research Implementation in Health Services framework, facilitation has been defined as the active ingredient that aligns the proposed innovation or improvement to the individuals and teams involved and the context in which they work, thereby enabling successful implementation (25…”
BackgroundMethodSelf-citationGoedken, C. C., Livorsi, D. J., Sauder, M., Weg, M. W. V., Chasco, E. E., Chang, N.-C. N., Perencevich, E. N., & Reisinger, H. S. (2019) · Implementation Science · doi:10.1186/s13012-019-0943-x · Cited by 59 · see citing works
“However, the barriers we found associated with using champions as an implementation strategy are similar to those found in recent work in the area of facilitation as an implementation strategy [36, 37].”
ResultAdvancing digital health equity: Directions for behavioral and social science research
Jaworski, B. K., Hooper, M. W., Aklin, W. M., Jean‐Francois, B., Elwood, W. N., Belis, D., Riley, W. T., & Hunter, C. M. (2022) · Translational Behavioral Medicine · doi:10.1093/tbm/ibac088 · Cited by 61 · see citing works
The complexity of implementation factors in professional pharmacy services
García‐Cárdenas, V., Pérez-Escamilla, B., Fernández-Llimós, F., & Benrimoj, S. I. (2017) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2017.05.016 · Cited by 65 · see citing works
Cooke, L., Duncan, D., Rivera, L., Dowling, S. K., Symonds, C. J., & Armson, H. (2018) · Implementation Science · doi:10.1186/s13012-018-0796-8 · Cited by 61 · see citing works
Leonard, E., Kock, I. D., & Bam, W. G. (2020) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2020.101832 · Cited by 62 · see citing works
Roberts, N. A., Janda, M., Stover, A. M., Alexander, K. E., Wyld, D., & Mudge, A. (2020) · Quality of Life Research · doi:10.1007/s11136-020-02669-1 · Cited by 56 · see citing works
“Consistent with the concept of the Facilitator’s journey [30], the novice Facilitator engaged with a expert Facilitator (AM) and a local multidisciplinary peer group of clinician–implementers for reflection (and peer learning) every 1–2 months during the implementation.”
BackgroundMethodByhoff, E., Garg, A., Pellicer, M., Diaz, Y., Yoon, G. H., Charns, M. P., & Drainoni, M. (2019) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2019.03.180276 · Cited by 61 · see citing works
“PARIHS is a conceptual framework that helps explain why implementing evidence into practice may or may not be successful by including the relationship between the evidence, the implementation context (in this case our clinic) and facilitation.(29,30) The semistructured interview guide focused on understanding particip…”
MethodKitson, A. A., Harvey, G., Gifford, W., Hunter, S. C., Kelly, J., Cummings, G. G., Ehrenberg, A., Kislov, R., Pettersson, L., Wallin, L., et al. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.14773 · Cited by 65 · see citing works
Self-citationEisman, A. B., Hutton, D. W., Prosser, L. A., Smith, S. N., & Kilbourne, A. M. (2020) · Implementation Science · doi:10.1186/s13012-020-01069-w · Cited by 50 · see citing works
“Facilitation) is a promising implementation strategy from the integrating Promoting Action on Research Implementation in Health Services (iPARIHS) framework that provides ongoing, individualized assistance for program delivery that can help enhance uptake of EBPs such as Life Goals in community clinics(14,15).”
MethodIverson, K., Adjognon, O. L., Grillo, A. R., Dichter, M., Gutner, C., Hamilton, A. B., Stirman, S., & Gerber, M. (2019) · Journal of general internal medicine · doi:10.1007/s11606-019-05240-y · Cited by 51 · see citing works
“, recipients in line to adopt the innovation and patients who receive the innovation), and inner and outter contextual factors that inhibit or enable implementation.(21) Sample questions included “What is the process of IPV screening and response in your clinic?” and “What have been challenges to integrating IPV scree…”
BackgroundDuan, Y., Iaconi, A., Wang, J., Perez, J. S., Song, Y., Chamberlain, S. A., Shrestha, S., Choroschun, K., Hoben, M., Beeber, A., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01254-z · Cited by 46 · see citing works
“Some conceptual limitations noted for the original PARIHS framework were resolved with the revised i-PARIHS framework [11, 12], but we highlight persisting concerns about conceptualization of some concepts that need to be further developed.”
BackgroundMethodUnni, E., Coles, T., Lavallee, D. C., Freel, J. A., Roberts, N. A., & Absolom, K. L. (2023) · Quality of Life Research · doi:10.1007/s11136-023-03505-y · Cited by 62 · see citing works
“Based on the integrated Promoting Action on Research Implementation in Health Services (iPARHIS) framework [17], participant engagement was initiated by asking all the key stakeholders (e.g., clinical teams, patients, consumer representatives, and other non-clinical teams) the question: What should…”
MethodGurung, R., Jha, A. K., Pyakurel, S., Gurung, A., Litorp, H., Wrammert, J., Jha, B. K., Paudel, P., Rahman, S. M., Malla, H., et al. (2019) · Implementation Science · doi:10.1186/s13012-019-0917-z · Cited by 56 · see citing works
Toivonen, M., Lehtonen, L., Ahlqvist‐Björkroth, S., & Axelin, A. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4256-1 · Cited by 50 · see citing works
“The process includes both how and by whom the process is facilitated [27].”
BackgroundInfluentialConnolly, S. L., Sullivan, J. L., Ritchie, M. J., Kim, B., Miller, C. J., & Bauer, M. S. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-5011-3 · Cited by 53 · see citing works
Leveraging implementation science to advance antibiotic stewardship practice and research
Livorsi, D. J., Drainoni, M., Reisinger, H. S., Nanda, N., McGregor, J. C., Barlam, T. F., Morris, A. M., & Szymczak, J. E. (2021) · Infection Control and Hospital Epidemiology · doi:10.1017/ice.2021.480 · Cited by 50 · see citing works
Hofmeyer, A. T., Kennedy, K. J., & Taylor, R. (2019) · Collegian Journal of the Royal College of Nursing Australia · doi:10.1016/j.colegn.2019.07.001 · Cited by 58 · see citing works
Maben, J., Aunger, J. A., Abrams, R., Wright, J. M., Pearson, M., Westbrook, J. I., Jones, A., & Mannion, R. (2023) · BMC Medicine · doi:10.1186/s12916-023-03102-3 · Cited by 49 · see citing works
“…for changing Behaviour (COM-B) approach [184], implementation science frameworks and theories (e.g. Consolidated Framework for Implementation Research (CFIR), Integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) [185, 186], or Normalisation Process Theory (NPT).”
BackgroundZamantakis, A., Li, D. H., Benbow, N., Smith, J. D., & Mustanski, B. S. (2022) · AIDS and Behavior · doi:10.1007/s10461-022-03943-8 · Cited by 50 · see citing works
“’s (2019) development of a health equity implementation framework, which was constructed from integration and adaptation of the integrated-promoting action on research implementation in health services (i-PARIHS) framework (Harvey and Kitson, 2016) and the health care disparities framework (Kilbourne et al.”
BackgroundBlanco‐Mavillard, I., de Pedro‐Gómez, J. E., Rodríguez-Calero, M. Á., Bennasar‐Veny, M., Parra-García, G., Fernández‐Fernández, I., Hoyos, J. B., Moya‐Suárez, A. B., Sánchez, J. L. C., Ferrer-Cruz, F., et al. (2021) · The Lancet Haematology · doi:10.1016/s2352-3026(21)00206-4 · Cited by 56 · see citing works
Use of the PARIHS Framework for Retrospective and Prospective Implementation Evaluations
Hill, J. N., Guihan, M., Hogan, T. P., et al. (2017) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12211 · Cited by 45 · see citing works
Development of a qualitative data analysis codebook informed by the i-PARIHS framework
Ritchie, M. J., Drummond, K. L., Smith, B. N., Sullivan, J. L., & Landes, S. J. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00344-9 · Cited by 51 · see citing works
“, the activities that support and enable implementation) [7, 19].”
BackgroundHagedorn, H., Kenny, M. E., Gordon, A. J., Ackland, P. E., Noorbaloochi, S., Yu, W., & Harris, A. H. S. (2018) · Addiction Science & Clinical Practice · doi:10.1186/s13722-018-0127-z · Cited by 54 · see citing works
Carter, H. E., Lee, X. J., Dwyer, T., et al. (2020) · BMC Geriatrics · doi:10.1186/s12877-020-01904-1 · Cited by 55 · see citing works
“Specialist clinical support and collaboration, grounded in the principles of implementation science through the adoption of the i-PARiHS implementation framework [33].”
BackgroundMelder, A., Robinson, T., McLoughlin, I. P., Iedema, R. A. M., & Teede, H. J. (2020) · Internal Medicine Journal · doi:10.1111/imj.14876 · Cited by 49 · see citing works
Mielke, J., Leppla, L., Valenta, S., Zullig, L. L., Zúñiga, F., Staudacher, S., Teynor, A., & Geest, S. D. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00354-7 · Cited by 48 · see citing works
“Commonly applied TMFs that incorporate context include the Consolidated Framework for Implementation Research (CFIR) [20], the Integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework [21], or the Theoretical Domains Framework (TDF) [22].”
MethodLinkage and retention in HCV care for HIV ‐infected populations: early data from the DAA era
Sacks‐Davis, R., Doyle, J., Rauch, A., Béguelin, C., Pedrana, A. E., Matthews, G. V., Prins, M., van der Valk, M., Klein, M. B., Saeed, S., et al. (2018) · Journal of the International AIDS Society · doi:10.1002/jia2.25051 · Cited by 53 · see citing works
“Data collection tools were informed by relevant constructs from the consolidated framework for implementation research (CFIR) [17] and the integrated Promoting Action on Research Implementation in Health Services framework (i-PARIHS; Figure 1) [18].”
BackgroundMethodAlignment in implementation of evidence-based interventions: a scoping review
Lundmark, R., Hasson, H., Richter, A., Khachatryan, E., Åkesson, A., & Eriksson, L. (2021) · Implementation Science · doi:10.1186/s13012-021-01160-w · Cited by 54 · see citing works
“The consolidated framework for implementation research (CFIR) [7] was used in two articles [37, 38], and the integrated-promoting action on research implementation in health services (iPARIHS) [39] in another [40].”
MethodNilsén, P., Svedberg, P., Nygren, J., Frideros, M., Johansson, J., & Schueller, S. M. (2022) · Implementation Research and Practice · doi:10.1177/26334895221112033 · Cited by 56 · see citing works
“…Framework of Implementation Research (Damschroder et al., 2009), Promoting Action on Research in Health Services (PARIHS) and integrated-PARIHS (Harvey & Kitson, 2016), Exploration Preparation Implementation Sustainability (Aarons et al., 2011), Theoretical Domains Framework (Michie et al.,…”
MethodKim, B., Sullivan, J. L., Ritchie, M. J., Connolly, S. L., Drummond, K. L., Miller, C. J., Greenan, M. A., & Bauer, M. S. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112520 · Cited by 50 · see citing works
Wilson, P. M., & Kislov, R. (2022) · Cambridge University Press eBooks · doi:10.1017/9781009237055 · Cited by 52 · see citing works
Mudge, A., Banks, M., Barnett, A. G., Blackberry, I., Graves, N., Green, T., Harvey, G., Hubbard, R. E., Inouye, S. K., Kurrle, S., et al. (2017) · BMC Geriatrics · doi:10.1186/s12877-016-0399-7 · Cited by 52 · see citing works
“Context and recipients will be evaluated by the local facilitator using the i-PARIHS framework [26], assigning scores from −2 (barrier to program goals) to +2 (enabler) for individual domains (e.”
BackgroundMethodInfluentialSelf-citationImproving serious illness communication: a qualitative study of clinical culture
Paladino, J., Sanders, J. J., Fromme, E. K., Block, S. D., Jacobsen, J. C., Jackson, V. A., Ritchie, C. S., & Mitchell, S. E. (2023) · BMC Palliative Care · doi:10.1186/s12904-023-01229-x · Cited by 52 · see citing works
“To produce a finalized codebook, the codes emerging from this process were consolidated and organized deductively using the PARIHS framework [18, 23], dividing the coded data into organizational contextual factors (e.”
MethodFavier, M., Greenberg, J. M. S., & Stevens, M. (2018) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.12676 · Cited by 52 · see citing works
Determinants of an evidence-based practice environment: an interpretive description
Duff, J. S., Cullen, L., Hanrahan, K., & Steelman, V. M. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00070-0 · Cited by 59 · see citing works
Portnoy, G. A., Haskell, S. G., King, M. W., Maskin, R. M., Gerber, M. R., & Iverson, K. M. (2018) · Women s Health Issues · doi:10.1016/j.whi.2018.04.003 · Cited by 49 · see citing works
D’Onofrio, G., Edelman, E. J., Hawk, K. F., Chawarski, M. C., Pantalon, M. V., Owens, P. H., Martel, S. H., Rothman, R. E., Saheed, M. O., Schwartz, R. P., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.5439 · Cited by 50 · see citing works
Pimentel, C. B., Mills, W. L., Palmer, J. A., Dillon, K., Sullivan, J. L., Wewiorski, N. J., Snow, A. L., Allen, R. S., Hopkins, S. D., & Hartmann, C. W. (2018) · Journal of Nursing Care Quality · doi:10.1097/ncq.0000000000000376 · Cited by 47 · see citing works
“These include the VHA’s implementation facilitation training manual,(19) recent studies(18,29) and foundational papers on facilitation,(15,27) and a relevant implementation framework.(30)”
BackgroundGordon, E. J., Lee, J. J., Kang, R. H., Caicedo, J. C., Holl, J. L., Ladner, D. P., & Shumate, M. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3151-5 · Cited by 48 · see citing works
- Authors
- Harvey, G., & Kitson, A.
- Affiliations
- University of Manchester (GB)
- University of Oxford (GB)
- Corresponding author
- Harvey, Gill
- Venue
- Implementation Science
- Published
- 2015-12
- Volume
- 11
- Issue
- 1
- Pages
- 33-33
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC4807546
- OpenAlex
- W2306592406
- Cited by
- 1,271
- References
- 103
- Citations by year
- 2026: 115 · 2025: 130 · 2024: 203 · 2023: 166 · 2022: 187 · 2021: 170 · 2020: 115 · 2019: 86 · 2018: 61 · 2017: 33 · 2016: 3
- FWCI
- 59.12
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Flinders Academic Commons (Flinders University) (publishedVersion)
- Research Explorer (The University of Manchester) (submittedVersion, cc-by)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion, cc-by)
- Flinders Academic Commons (Flinders University) (submittedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- PARIHS framework, i-PARIHS framework, implementation research, implementation context, implementation facilitation, implementation teams, face and content validity
- MeSH terms
- Delivery of Health Care, Diffusion of Innovation, Translational Research, Biomedical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review