The DOI matches its Crossref record; 48 of the 50 references it cites were found in a registry or an index; 8 of the 82 sources its claims cite were checked for support.
Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review
Open accessAbstract
BACKGROUND: Systematic reviews consistently indicate that interventions to change healthcare professional (HCP) behaviour are haphazardly designed and poorly specified. Clarity about methods for designing and specifying interventions is needed. The objective of this review was to identify published methods for designing interventions to change HCP behaviour. METHODS: A search of MEDLINE, Embase, and PsycINFO was conducted from 1996 to April 2015. Using inclusion/exclusion criteria, a broad screen of abstracts by one rater was followed by a strict screen of full text for all potentially relevant papers by three raters. An inductive approach was first applied to the included studies to identify commonalities and differences between the descriptions of methods across the papers. Based on this process and knowledge of related literatures, we developed a data extraction framework that included, e.g. level of change (e.g. individual versus organization); context of development; a brief description of the method; tasks included in the method (e.g. barrier identification, component selection, use of theory). RESULTS: 3966 titles and abstracts and 64 full-text papers were screened to yield 15 papers included in the review, each outlining one design method. All of the papers reported methods developed within a specific context. Thirteen papers included barrier identification and 13 included linking barriers to intervention components; although not the same 13 papers. Thirteen papers targeted individual HCPs with only one paper targeting change across individual, organization, and system levels. The use of theory and user engagement were included in 13/15 and 13/15 papers, respectively. CONCLUSIONS: There is an agreement across methods of four tasks that need to be completed when designing individual-level interventions: identifying barriers, selecting intervention components, using theory, and engaging end-users. Methods also consist of further additional tasks. Examples of methods for designing the organisation and system-level interventions were limited. Further analysis of design tasks could facilitate the development of detailed guidelines for designing interventions.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This systematic review identified 15 published methods for designing interventions to change healthcare professionals’ behaviour. Across these methods, four design tasks were commonly included: barrier identification, linking barriers to intervention components, using theory, and engaging end-users.
Key findings
- From 3966 screened citations and 64 full-text papers, 15 papers were included, each outlining one design method; methods were published between 2001 and 2014.
- 13/15 papers included barrier identification and 13/15 linked barriers to intervention components, though these were not the same 13 papers; 13/15 used theory and 13/15 included user engagement.
- 13/15 methods targeted individual healthcare professionals, while only one method targeted change across individual, organization, and system levels.
- Design tasks ranged from 2 to 7 steps, with a median of 5 tasks; 11/15 methods incorporated other published approaches, tools, or resources.
Methods
- Systematic review searching MEDLINE, Embase, and PsycINFO from 1996 to April 2015, with no published protocol; inclusion required a paper to describe a method for designing interventions to change healthcare professionals’ behaviour and focus primarily on the intervention design process.
- Title/abstract screening was done by one rater, followed by full-text screening by three raters independently; mean Kappa across all pairs was .43, indicating moderate agreement.
- Data extraction used a two-stage process: an inductive framework was developed by three reviewers, then data were extracted by two individuals independently followed by consensus discussion for discrepancies.
Limitations
- The paper states that only one rater screened titles and abstracts, which may have increased the possibility of omitting relevant studies; it also did not include books or book chapters, excluded studies that reported intervention testing alongside development, did not search grey literature, and used only three databases, making the review susceptible to publication bias.
- The paper states that all included methods were developed specifically for healthcare environments, and methods from other disciplines or before 1996 may have been missed.
- The paper notes that it did not measure the degree to which the identified methods are used; the text also makes evident that the search ended in April 2015 and excluded non-English articles.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
31 Not checked yet · 24 Own result · 13 Own method · 7 Own interpretation · 4 No basis given · 1 Partly supported · 1 Mixed support · accuracy not yet measured
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“Six papers used the structured interview processes outlined in the TDF [19, 21, 25] or in Intervention Mapping [20, 26, 27].”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > Design tasks in the methods
What the sources say
- Partly supportedcites [19] Taylor N, Lawton R, Slater B, Foy R. The demonstration of a theory-based approach to the design of localized patient safety interventions. Implement Sci. 2013;8(1):123. sourceExperimental — accuracy not yet measured
The Methods sections on the TDFI approach and focus group schedule describe TDF-guided focus groups with prompts to discuss barriers and generate intervention ideas. The paper also reports exit interviews, but describes those as assessing the implementation process, not as TDF-structured interviews. Thus it supports a structured TDF-guided discussion process, but not the more specific characterization of TDF-structured interviews. (LLM, conf=0.78)
- Supportedcites [21] French SD, Green SE, O’Connor DA, McKenzie JE, Francis JJ, Michie S, Buchbinder R, Schattner P, Spike N, Grimshaw JM. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci. 2012;7(1):38. source
The Results section describes focus-group interviews with questions designed to explore TDF domains, supporting this paper as an example of a TDF-guided interview process. The count of six papers is the citing authors’ summary, not a finding attributed specifically to this source. (LLM, conf=0.90)
- Disputedcites [25] Porcheret M, Main C, Croft P, McKinley R, Hassell A, Dziedzic K. Development of a behaviour change intervention: a case study on the practical application of theory. Implement Sci. 2014;9(1):42. sourceExperimental — accuracy not yet measured
The Methods (‘Applying the models,’ Step 2) say the researchers asked GP advisory groups about their practice and mapped their responses to TDF domains. The Discussion (‘Strengths and possible limitations’) explicitly says the meetings’ topic guide was developed before the decision to use TDF and was not developed from it. This paper therefore does not exemplify use of a TDF-structured interview process. (LLM, conf=0.87)
Checked by a reasoning model — may be wrong.
- Not checked yetcites [20] Van Bokhoven M, Kok G, Van der Weijden T. Designing a quality improvement intervention: a systematic approach. Qual Saf Health Care. 2003;12(3):215–20. source
- Supportedcites [26] Sassen B, Kok G, Mesters I, Crutzen R, Cremers A, Vanhees L. A web-based intervention for health professionals and patients to decrease cardiovascular risk attributable to physical inactivity: development process. JMIR Res Protocols. 2012;1(2):e21. source
The Introduction describes Intervention Mapping as the framework used to develop the intervention. In Results, Step 1: Needs Assessment, the authors report focus group interviews with health professionals and small group interviews with patients. This supports identifying this paper as one that used interviews within an Intervention Mapping process; the count of six papers belongs to the citing document, not this source alone. (LLM, conf=0.90)
- Supportedcites [27] Schmid AA, Andersen J, Kent T, Williams LS, Damush TM. Using intervention mapping to develop and adapt a secondary stroke prevention program in Veterans Health Administration medical centers. Implement Sci. 2010;5(1):11. source
The Methods section (Intervention Mapping, Step 0: Needs assessment; page unavailable) says the authors used semi-structured interviews to guide their Intervention Mapping process. The Interview section describes the structured guides and probes. This supports citing the paper as an example of interviews used within Intervention Mapping; the count of six papers is the citing authors’ review finding, not a finding attributed to this individual paper. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Four of these [20, 23, 26, 27] incorporated Intervention Mapping [29]”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > Contexts, target levels, and incorporating other processes/steps/tools/resources
What the sources say
- Not checked yetcites [20] Van Bokhoven M, Kok G, Van der Weijden T. Designing a quality improvement intervention: a systematic approach. Qual Saf Health Care. 2003;12(3):215–20. source
- Supportedcites [23] Cabassa LJ, Druss B, Wang Y, Lewis-Fernández R. Collaborative planning approach to inform the implementation of a healthcare manager intervention for Hispanics with serious mental illness: a study protocol. Implement Sci. 2011;6:80. source
The Introduction says the study combined community-based participatory research with Intervention Mapping. The Methods (‘Study design overview’) also says the project applies Intervention Mapping steps. This supports citing the paper as one that incorporated Intervention Mapping; the count of four papers is the citing authors’ synthesis, not a finding attributed to this source. (LLM, conf=0.92)
- Partly supportedcites [26] Sassen B, Kok G, Mesters I, Crutzen R, Cremers A, Vanhees L. A web-based intervention for health professionals and patients to decrease cardiovascular risk attributable to physical inactivity: development process. JMIR Res Protocols. 2012;1(2):e21. sourceExperimental — accuracy not yet measured
The Methods and Results sections show that this paper used Intervention Mapping to develop its intervention. They do not establish that four of the citing document’s 15 included papers used it; that count concerns the citing document’s own set of papers. (LLM, conf=0.83)
- Supportedcites [27] Schmid AA, Andersen J, Kent T, Williams LS, Damush TM. Using intervention mapping to develop and adapt a secondary stroke prevention program in Veterans Health Administration medical centers. Implement Sci. 2010;5(1):11. source
The citation [29] follows “Intervention Mapping,” while the four included papers are identified by separate citations. The Methods > Intervention Mapping passage states that Schmid and colleagues used the five steps of Intervention Mapping to develop their program. The count of four is the citing authors’ characterization of their included papers, not a finding attributed to this source. (LLM, conf=0.88)
- Not checked yetcites [29] Bartholomew LK, Parcel GS, Kok G, Gottlieb NH. Planning health promotion programs: an intervention mapping approach. San Francisco: John Wiley & Sons; 2011.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thirteen papers targeted individual HCPs with only one paper targeting change across individual, organization, and system levels.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Abstract > Results
plainn = 15- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Thirteen papers included barrier identification and 13 included linking barriers to intervention components; although not the same 13 papers.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Abstract > Results
plainn = 13- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The use of theory and user engagement were included in 13/15 and 13/15 papers, respectively.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Abstract > Results
plainn = 13- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thirteen papers included barrier identification and 13 included linking barriers to intervention components; although not the same 13 papers.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Abstract > Results
plainn = 13- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All of the papers reported methods developed within a specific context.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thirteen papers targeted individual HCPs with only one paper targeting change across individual, organization, and system levels.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Abstract > Results
plainn = 13- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Eleven of the 15 papers incorporated other approaches, tools, or resources as a component of the intervention design process [14, 19–28].”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > Contexts, target levels, and incorporating other processes/steps/tools/resources
What the sources say
- Not checked yetcites [14] Curran GM, Mukherjee S, Allee E, Owen RR. A process for developing an implementation intervention: QUERI Series. Implement Sci. 2008;3(1):17. source
- Not checked yetcites [19] Taylor N, Lawton R, Slater B, Foy R. The demonstration of a theory-based approach to the design of localized patient safety interventions. Implement Sci. 2013;8(1):123. source
- Not checked yetcites [20] Van Bokhoven M, Kok G, Van der Weijden T. Designing a quality improvement intervention: a systematic approach. Qual Saf Health Care. 2003;12(3):215–20. source
- Not checked yetcites [21] French SD, Green SE, O’Connor DA, McKenzie JE, Francis JJ, Michie S, Buchbinder R, Schattner P, Spike N, Grimshaw JM. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci. 2012;7(1):38. source
- Not checked yetcites [22] Kolehmainen N, Francis JJ. Specifying content and mechanisms of change in interventions to change professionals’ practice: an illustration from the Good Goals study in occupational therapy. Implement Sci. 2012;7(1):100. source
- Not checked yetcites [23] Cabassa LJ, Druss B, Wang Y, Lewis-Fernández R. Collaborative planning approach to inform the implementation of a healthcare manager intervention for Hispanics with serious mental illness: a study protocol. Implement Sci. 2011;6:80. source
- Not checked yetcites [24] Clyne B, Bradley MC, Hughes CM, Clear D, McDonnell R, Williams D, Fahey T, Smith SM. Addressing potentially inappropriate prescribing in older patients: development and pilot study of an intervention in primary care (the OPTI-SCRIPT study). BMC Health Serv Res. 2013;13(1):307. source
- Not checked yetcites [25] Porcheret M, Main C, Croft P, McKinley R, Hassell A, Dziedzic K. Development of a behaviour change intervention: a case study on the practical application of theory. Implement Sci. 2014;9(1):42. source
- Not checked yetcites [26] Sassen B, Kok G, Mesters I, Crutzen R, Cremers A, Vanhees L. A web-based intervention for health professionals and patients to decrease cardiovascular risk attributable to physical inactivity: development process. JMIR Res Protocols. 2012;1(2):e21. source
- Not checked yetcites [27] Schmid AA, Andersen J, Kent T, Williams LS, Damush TM. Using intervention mapping to develop and adapt a secondary stroke prevention program in Veterans Health Administration medical centers. Implement Sci. 2010;5(1):11. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Examples of methods for designing the organisation and system-level interventions were limited.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Abstract > Conclusions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The search strategy and databases used were sufficient to identify all relevant published methods for designing interventions to change healthcare professionals' behaviour.
- Probably not a substantial claim. 25
- It may state two separate claims as one. 18
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thirteen papers included barrier identification and 13 included linking barriers to intervention components; although not the same 13 papers.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Abstract > Results
plaincorrelationaln = 13- Asserted: fails — The authors may not put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The authors may not put it forward as true. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3966 titles and abstracts and 64 full-text papers were screened to yield 15 papers included in the review, each outlining one design method.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The search strategy and databases used were sufficient to identify all relevant published methods for designing interventions to change healthcare professionals' behaviour.
None of the sources cited for this claim have been checked yet.
In the paper
“In the papers where barrier identification was covered, the methods included observations, interviews and/or focus groups [14, 18, 30–32], surveys [32], literature reviews [24], structured reflection by the researchers [32], job analysis and expert consensus [18], and undertaking a predictive study to identify factors influencing the behaviour [28].”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > Design tasks in the methods
What the sources say
- Not checked yetcites [14] Curran GM, Mukherjee S, Allee E, Owen RR. A process for developing an implementation intervention: QUERI Series. Implement Sci. 2008;3(1):17. source
- Not checked yetcites [18] Battles J. Improving patient safety by instructional systems design. Qual Saf Health Care. 2006;15 suppl 1:i25–9. source
- Not checked yetcites [30] Chandler C, Meta J, Ponzo C, Nasuwa F, Kessy J, Mbakilwa H, Haaland A, Reyburn H. The development of effective behaviour change interventions to support the use of malaria rapid diagnostic tests by Tanzanian clinicians. Implement Sci. 2014;9:83. source
- Not checked yetcites [31] McDermott L, Yardley L, Little P, Ashworth M, Gulliford M. Developing a computer delivered, theory based intervention for guideline implementation in general practice. BMC Fam Pract. 2010;11(1):90. source
- Not checked yetcites [32] Fretheim A, Oxman AD, Flottorp S. Improving prescribing of antihypertensive and cholesterol-lowering drugs: a method for identifying and addressing barriers to change. BMC Health Serv Res. 2004;4(1):23. source
- Not checked yetcites [24] Clyne B, Bradley MC, Hughes CM, Clear D, McDonnell R, Williams D, Fahey T, Smith SM. Addressing potentially inappropriate prescribing in older patients: development and pilot study of an intervention in primary care (the OPTI-SCRIPT study). BMC Health Serv Res. 2013;13(1):307. source
- Not checked yetcites [28] Foy R, Francis JJ, Johnston M, Eccles M, Lecouturier J, Bamford C, Grimshaw J. The development of a theory-based intervention to promote appropriate disclosure of a diagnosis of dementia. BMC Health Serv Res. 2007;7:207. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“One of these papers [22] reported an assumption that barriers had already been identified in previous work and provided a method for linking barriers to intervention components.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > Design tasks in the methods
What the sources say
- Not checked yetcites [22] Kolehmainen N, Francis JJ. Specifying content and mechanisms of change in interventions to change professionals’ practice: an illustration from the Good Goals study in occupational therapy. Implement Sci. 2012;7(1):100. source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Five of 15 incorporated just one other published tool [20, 24, 26–28]”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > Contexts, target levels, and incorporating other processes/steps/tools/resources
What the sources say
- Not checked yetcites [20] Van Bokhoven M, Kok G, Van der Weijden T. Designing a quality improvement intervention: a systematic approach. Qual Saf Health Care. 2003;12(3):215–20. source
- Not checked yetcites [24] Clyne B, Bradley MC, Hughes CM, Clear D, McDonnell R, Williams D, Fahey T, Smith SM. Addressing potentially inappropriate prescribing in older patients: development and pilot study of an intervention in primary care (the OPTI-SCRIPT study). BMC Health Serv Res. 2013;13(1):307. source
- Not checked yetcites [26] Sassen B, Kok G, Mesters I, Crutzen R, Cremers A, Vanhees L. A web-based intervention for health professionals and patients to decrease cardiovascular risk attributable to physical inactivity: development process. JMIR Res Protocols. 2012;1(2):e21. source
- Not checked yetcites [27] Schmid AA, Andersen J, Kent T, Williams LS, Damush TM. Using intervention mapping to develop and adapt a secondary stroke prevention program in Veterans Health Administration medical centers. Implement Sci. 2010;5(1):11. source
- Not checked yetcites [28] Foy R, Francis JJ, Johnston M, Eccles M, Lecouturier J, Bamford C, Grimshaw J. The development of a theory-based intervention to promote appropriate disclosure of a diagnosis of dementia. BMC Health Serv Res. 2007;7:207. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“and one incorporated three published tools [25].”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > Contexts, target levels, and incorporating other processes/steps/tools/resources
What the sources say
- Not checked yetcites [25] Porcheret M, Main C, Croft P, McKinley R, Hassell A, Dziedzic K. Development of a behaviour change intervention: a case study on the practical application of theory. Implement Sci. 2014;9(1):42. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“and two incorporated the Medical Research Council (MRC) framework [22, 24].”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > Contexts, target levels, and incorporating other processes/steps/tools/resources
What the sources say
- Not checked yetcites [22] Kolehmainen N, Francis JJ. Specifying content and mechanisms of change in interventions to change professionals’ practice: an illustration from the Good Goals study in occupational therapy. Implement Sci. 2012;7(1):100. source
- Not checked yetcites [24] Clyne B, Bradley MC, Hughes CM, Clear D, McDonnell R, Williams D, Fahey T, Smith SM. Addressing potentially inappropriate prescribing in older patients: development and pilot study of an intervention in primary care (the OPTI-SCRIPT study). BMC Health Serv Res. 2013;13(1):307. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The other paper [23] focused on adapting an intervention using stakeholder engagement and did not address barrier identification specifically.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > Design tasks in the methods
What the sources say
- Not checked yetcites [23] Cabassa LJ, Druss B, Wang Y, Lewis-Fernández R. Collaborative planning approach to inform the implementation of a healthcare manager intervention for Hispanics with serious mental illness: a study protocol. Implement Sci. 2011;6:80. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“One of these was Eccles et al. [38] which includes a description of using a theory to design a KT intervention.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
What the sources say
- Not checked yetcites [38] Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N. Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005;58(2):107–12. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Methods to link barriers to intervention components included mapping TDF-barriers to the BCT taxonomy [19, 21, 25], as well as using the structured approaches described in Intervention Mapping [20, 26, 27].”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > Design tasks in the methods
What the sources say
- Not checked yetcites [19] Taylor N, Lawton R, Slater B, Foy R. The demonstration of a theory-based approach to the design of localized patient safety interventions. Implement Sci. 2013;8(1):123. source
- Not checked yetcites [21] French SD, Green SE, O’Connor DA, McKenzie JE, Francis JJ, Michie S, Buchbinder R, Schattner P, Spike N, Grimshaw JM. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci. 2012;7(1):38. source
- Not checked yetcites [25] Porcheret M, Main C, Croft P, McKinley R, Hassell A, Dziedzic K. Development of a behaviour change intervention: a case study on the practical application of theory. Implement Sci. 2014;9(1):42. source
- Not checked yetcites [20] Van Bokhoven M, Kok G, Van der Weijden T. Designing a quality improvement intervention: a systematic approach. Qual Saf Health Care. 2003;12(3):215–20. source
- Not checked yetcites [26] Sassen B, Kok G, Mesters I, Crutzen R, Cremers A, Vanhees L. A web-based intervention for health professionals and patients to decrease cardiovascular risk attributable to physical inactivity: development process. JMIR Res Protocols. 2012;1(2):e21. source
- Not checked yetcites [27] Schmid AA, Andersen J, Kent T, Williams LS, Damush TM. Using intervention mapping to develop and adapt a secondary stroke prevention program in Veterans Health Administration medical centers. Implement Sci. 2010;5(1):11. source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“In two cases, this included formal cognitive interviews [28, 31].”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > Design tasks in the methods
What the sources say
- Not checked yetcites [28] Foy R, Francis JJ, Johnston M, Eccles M, Lecouturier J, Bamford C, Grimshaw J. The development of a theory-based intervention to promote appropriate disclosure of a diagnosis of dementia. BMC Health Serv Res. 2007;7:207. source
- Not checked yetcites [31] McDermott L, Yardley L, Little P, Ashworth M, Gulliford M. Developing a computer delivered, theory based intervention for guideline implementation in general practice. BMC Fam Pract. 2010;11(1):90. source
plainn = 2- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“This paper outlined a method for intervention design for health behaviours, not for HCPs’ behaviours, and was therefore excluded.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
What the sources say
- Not checked yetcites [29] Bartholomew LK, Parcel GS, Kok G, Gottlieb NH. Planning health promotion programs: an intervention mapping approach. San Francisco: John Wiley & Sons; 2011.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“All of the included methods were developed specifically for healthcare environments.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found limited methods to specifically take the organisation and system level contexts into consideration, as well as methods that consider all levels.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“First, limited methods target change in organisations or systems, or at least were developed with a focus on the organization or system.”
- Also stated in: § Conclusions · plain
“Methods for designing organisation and system-level interventions were limited.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Also stated in: § Conclusions · plain
In the paper
“As mentioned, one of these papers [23] focused on adapting an intervention using stakeholder engagement and did not address linking to intervention components specifically.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > Design tasks in the methods
What the sources say
- Not checked yetcites [23] Cabassa LJ, Druss B, Wang Y, Lewis-Fernández R. Collaborative planning approach to inform the implementation of a healthcare manager intervention for Hispanics with serious mental illness: a study protocol. Implement Sci. 2011;6:80. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Examples included using Social Cognitive Theory [33] to design a computer-delivered intervention to enhance the use of practice guidelines in general practices [31], and using theories of risk perception to improve physical activity in cardiovascular patients as part of the Intervention Mapping process [26].”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > Design tasks in the methods
What the sources say
- Not checked yetcites [33] Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev. 1977;84(2):191. source
- Not checked yetcites [31] McDermott L, Yardley L, Little P, Ashworth M, Gulliford M. Developing a computer delivered, theory based intervention for guideline implementation in general practice. BMC Fam Pract. 2010;11(1):90. source
- Not checked yetcites [26] Sassen B, Kok G, Mesters I, Crutzen R, Cremers A, Vanhees L. A web-based intervention for health professionals and patients to decrease cardiovascular risk attributable to physical inactivity: development process. JMIR Res Protocols. 2012;1(2):e21. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“We felt this paper provided a rationale and description of conceptual issues related to using theory to develop an intervention; however, the degree of detail on how to design an intervention in this paper is limited.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
What the sources say
- Not checked yetcites [38] Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N. Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005;58(2):107–12. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“An interrater reliability analysis using the Kappa statistic was performed to determine consistency among raters for the full-text review.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Methods
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We did not publish a protocol.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Methods
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Due to resource limitations, we also excluded articles that were not in English.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Methods
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“A screen of titles and abstracts was conducted by one rater independently (shared by HLC, JES, NK) and was followed by a review of full papers by three raters independently (HLC, JES, NK).”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Methods
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Papers were included if two criteria were met: (1) the paper described a method (process, tasks, approach) for designing interventions to change HCPs’ behaviour or practice, and (2) the primary focus of the paper was on the intervention design process (as opposed to, e.g. on intervention evaluation).”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Methods
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Data extraction was conducted by two individuals (HLC, JES) independently first followed by consensus discussions for discrepancies (Stage 2).”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Methods
plainn = 2- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“The mean Kappa statistic across all pairs was .43 indicated moderate agreement [16].”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results
What the sources say
- Not checked yetcites [16] Landis JR, Koch GG The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. source
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Three reviewers (HLC, JES, NK) progressed in iterative cycles of reading and discussing the included papers to identify similarities and differences between them and used these discussions to develop a list of items to be extracted. The iterative cycles were continued until an agreement between the three authors was reached.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Methods
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“we excluded papers that lacked enough detail for replication.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Methods
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“While it is true that many of the methods’ approaches to barrier identification could result in a focus on the organisation or system should barriers at these levels be identified (for example, see French et al. [21]), the implicit focus of these papers targeted individual behaviour change.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
What the sources say
- Not checked yetcites [21] French SD, Green SE, O’Connor DA, McKenzie JE, Francis JJ, Michie S, Buchbinder R, Schattner P, Spike N, Grimshaw JM. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci. 2012;7(1):38. source
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Almost all of the methods found (13/15) used theory at some point in the tasks for intervention design, yet evidence indicates theory is rarely used in the design of interventions, or at least rarely reported [39, 40].”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
What the sources say
- Not checked yetcites [39] Colquhoun HL, Brehaut JC, Sales A, Ivers N, Grimshaw J, Michie S, Carroll K, Chalifoux M, Eva KW. A systematic review of the use of theory in randomized controlled trials of audit and feedback. Implement Sci. 2013;8:66. source
- Not checked yetcites [40] Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010;5(14):5908–5.
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Due to the challenges in adequately searching books, we did not include books or book chapters in our search.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is likely that other methods to design interventions to change health behaviours could similarly be adopted to design interventions to change HCPs’ practice.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
In the paper
“Lastly, we did not search grey literature, making the review susceptible to publication bias [42], and we only chose to use three databases.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
What the sources say
- Not checked yetcites [42] Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9. source
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While we do not necessarily understand the best order for these tasks nor do we know what additional tasks are required, it does represent a simple structure of potential prototypical steps for the design of a KT intervention.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We used only one rater for the title and abstract review.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The process of undertaking this review highlights a second gap: the need for a better understanding of what activities constitute intervention design.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Our review did not measure the degree to which these methods are used but this would be a useful future area of research.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Lastly, we did not search grey literature, making the review susceptible to publication bias [42], and we only chose to use three databases.”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper relies on this without support.
The search strategy and databases used were sufficient to identify all relevant published methods for designing interventions to change healthcare professionals' behaviour.
“A sensitive search strategy was designed in consultation with an information science specialist (CF) using both subject headings and text terms and comprised a combination of three facets: professional behaviour change; theory, framework or technique; and interventions.”
The paper relies on this without support.
The included papers' descriptions of methods were sufficiently detailed and representative to allow extraction of the common design tasks.
“we excluded papers that lacked enough detail for replication.”
The paper relies on this without support.
The descriptive variables selected for extraction were the most critical for understanding intervention design tasks.
“The resulting descriptive variables to be extracted were believed to be the most critical, and it included a brief description of the design tasks.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Colquhoun and colleagues (56) found 15 articles with replicable methods for designing strategies to change healthcare professionals' behavior, and Powell et al. (55) proposed Intervention Mapping (58), concept mapping (59), conjoint analysis (60), and system dynamics modeling (61) as methods to aid the design, selection, and tailoring of strategies.”
From Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda (2019) · cites this paper as [56]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > General descriptive information about the papers
“15. van Bokhoven 2004 [20]”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > References
“20. Van Bokhoven M Kok G Van der Weijden T Designing a quality improvement intervention: a systematic approach Qual Saf Health Care 2003 12 3 215 20”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > General descriptive information about the papers
“Three of the 12 papers reported a formal name or label for the method”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > General descriptive information about the papers
“Table 1 provides a summary of the included 15 papers that were published between 2001and 2014.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > Results > General descriptive information about the papers
“2. Cabassa, 2001[23]”
§ Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review > References
“23. Cabassa LJ Druss B Wang Y Lewis-Fernández R Collaborative planning approach to inform the implementation of a healthcare manager intervention for Hispanics with serious mental illness: a study protocol Implement Sci 2011 6 80”
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.191 · Cited by 43,925
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1978) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(78)90002-4 · Cited by 10,586
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., Eccles, M. P., Cane, J., & Wood, C. E. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9486-6 · Cited by 7,629
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217
Cited by
Sorted by citations
Items 101–200 of 287
Allison, M. K., Waliski, A., Haynes, T. F., & Marshall, S. A. (2022) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2022.102050 · Cited by 12
Brown, L. E., Street, T., Adonis, A., Johnston, T. E., Ferrante, S., Burridge, J. H., & Bulley, C. (2023) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2023.1062356 · Cited by 12
Strid, E. N., Wallin, L., & Nilsagård, Y. E. (2023) · BMC Family Practice · doi:10.1186/s12875-023-02079-5 · Cited by 12
de Lijster, G. P. A., Kok, G., & Kocken, P. (2019) · BMC Public Health · doi:10.1186/s12889-019-7808-8 · Cited by 12
Eekholm, S., Samuelson, K. A. M., Ahlström, G., & Lindhardt, T. (2021) · Healthcare · doi:10.3390/healthcare9111524 · Cited by 12
Mergelsberg, E. L. P., de Ruijter, D., Crone, M. R., Smit, E. S., & Hoving, C. (2022) · Evaluation & the Health Professions · doi:10.1177/01632787221099941 · Cited by 11
Kumar, P., Umakanth, S., Marzetti, E., Kalra, S., & Girish, N. (2024) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s452269 · Cited by 12
Ansmann, L., Albert, U., Auer, R., Baumann, W., Bitzer, E. M., Bögel, M., Ernstmann, N., Gostomzyk, J. G., Goetz, K., Hahn, U., et al. (2019) · Das Gesundheitswesen · doi:10.1055/a-0862-0407 · Cited by 12
Implementation science approaches to enhance uptake of complex interventions in surgical settings
Byrnes, A., Mudge, A., & Clark, D. A. (2019) · Australian Health Review · doi:10.1071/ah18193 · Cited by 11
Mena, S., Moullin, J. C., Schneider, M. P., & Niquille, A. (2023) · BMC Geriatrics · doi:10.1186/s12877-023-04335-w · Cited by 10
Chu, S. Y., Hara, Y., Wong, C. H., Higashikawa, M., McConnell, G. E., & Lim, A. (2021) · International Journal of Speech-Language Pathology · doi:10.1080/17549507.2021.1877816 · Cited by 10
Strid, E. N., Wallin, L., & Nilsagård, Y. E. (2022) · JMIR Research Protocols · doi:10.2196/37634 · Cited by 10
Leenen, J., Hoebe, C. J. P. A., Bos, A. E. R., Wolffs, P. F. G., van Loo, I. H. M., de Wit, J. B. F., Jonas, K. J., & Dukers–Muijrers, N. H. T. M. (2021) · Frontiers in Reproductive Health · doi:10.3389/frph.2021.634032 · Cited by 9
Porat‐Dahlerbruch, J., Fontaine, G., Bourbeau-Allard, È., Spinewine, A., Grimshaw, J., & Ellen, M. (2022) · F1000Research · doi:10.12688/f1000research.124821.1 · Cited by 9
Self-citationHubeishy, M. H., Rossen, C. B., Dannapfel, P., Thomas, K., Jensen, T. S., Maribo, T., & Rolving, N. (2024) · Implementation Science Communications · doi:10.1186/s43058-024-00568-x · Cited by 9
Satisfação e sobrecarga de trabalho em profissionais da saúde mental
Treichel, C. A. D. S., Saidel, M. G. B., de Lucca, S. R., Pereira, M. B., Silva, A. A., Luiz, C. C. A., Pereira, M. A., & Campos, R. T. O. (2024) · Trabalho Educação e Saúde · doi:10.1590/1981-7746-ojs2579 · Cited by 9
Kwak, L., Toropova, A. A., Powell, B. J., Lengnick‐Hall, R., Jensen, I. B., Bergström, G., Elinder, L. S., Stigmar, K. G. E., Wåhlin, C., & Björklund, C. (2022) · Implementation Science · doi:10.1186/s13012-022-01230-7 · Cited by 9
Sands, M., & Aunger, R. V. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00124-x · Cited by 9
When co-design works (sort of): the case of the Australian elder abuse screening instrument
Brijnath, B., Gahan, L. B., Dow, B., Hickey, L., Braddy, L., Collins, M., & Antoniades, J. (2022) · Journal of Elder Abuse & Neglect · doi:10.1080/08946566.2022.2098218 · Cited by 9
Chays‐Amania, A., Schwingrouber, J., Melnyk, B. M., Haller, P. H., Soler, J., & Colson, S. (2025) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.70050 · Cited by 9
Abdu-Aguye, S. N., Mohammed, S., DANJUMA, N. M., & Labaran, K. S. (2021) · Pharmacy Practice · doi:10.18549/pharmpract.2021.2.2271 · Cited by 8
Qureshi, A. H., Alaloul, W. S., Wing, W. K., Saad, S., Alzubi, K. M., & Musarat, M. A. (2022) · Construction Innovation · doi:10.1108/ci-04-2022-0076 · Cited by 8
Larson, M. F., & Cook, C. R. (2023) · Issues in clinical child psychology · doi:10.1007/978-3-031-20006-9_28 · Cited by 9
Mendieta, C. V., de Vries, E., Calvache, J. A., Ahmedzai, S. H., Prue, G., McConnell, T., & Reid, J. (2023) · Healthcare · doi:10.3390/healthcare11222917 · Cited by 8
Matsuo, M. (2024) · The Learning Organization · doi:10.1108/tlo-04-2023-0066 · Cited by 9
Hussein, R. N., Lin, E. C. J., & Grindrod, K. (2021) · Journal of the American Pharmacists Association · doi:10.1016/j.japh.2021.01.036 · Cited by 8
Jones, T. M., & Brody, A. A. (2020) · American Journal of Hospice and Palliative Medicine® · doi:10.1177/1049909120962459 · Cited by 7
Changing Health-Related Behaviours 5: On Interventions to Change Physician Behaviours
Etchegary, C. M., Taylor, L., Mahoney, K., Parfrey, O., & Hall, A. M. (2021) · Methods in molecular biology · doi:10.1007/978-1-0716-1138-8_33 · Cited by 7
Establishing a primary care audit and feedback implementation laboratory: a consensus study
Alderson, S. L., Bald, A., Carder, P., Farrin, A. J., & Foy, R. (2021) · Implementation Science Communications · doi:10.1186/s43058-020-00103-8 · Cited by 7
Translating Evidence Into Practice Through Knowledge Implementation
Campione, E., Wampler-Kuhn, M., & Fisher, M. I. (2021) · Rehabilitation Oncology · doi:10.1097/01.reo.0000000000000242 · Cited by 7
Strid, E. N., Wallin, L., & Nilsagård, Y. E. (2024) · Scandinavian Journal of Primary Health Care · doi:10.1080/02813432.2023.2301556 · Cited by 9
Implementation of Evidence-Based Practice in Long-Term Care: A Scoping Review
McGough, E. L., & Thompson, H. J. (2024) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2024.105026 · Cited by 6
Minhat, H. S., & Zakaria, L. N. (2022) · Zoonoses and Public Health · doi:10.1111/zph.12910 · Cited by 6
Scrimshire, A., Booth, A., Fairhurst, C. M., Coleman, E., Malviya, A., Kotzé, A., Tiplady, C., Tate, D., Laverty, A., Davis, G., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01193-9 · Cited by 6
A Library of Logic Models to Explain How Interventions to Reduce Diagnostic Errors Work
Kletter, M., Meléndez‐Torres, G. J., Lilford, R. J., & Taylor, C. (2018) · Journal of Patient Safety · doi:10.1097/pts.0000000000000459 · Cited by 6
Lamontagne-Godwin, F., Henderson, C., Lafarge, C., Stock, R., & Barley, E. A. (2020) · Journal of Mental Health · doi:10.1080/09638237.2020.1803232 · Cited by 6
Professional self-efficacy for responding to child abuse presentations
Fraser, J., Flemington, T., Doan, D. T. N., Hoang, V. M. T., Doan, B. T. L., & Tuấn, H. M. (2018) · Journal of Children s Services · doi:10.1108/jcs-09-2017-0044 · Cited by 6
Romney, W. M., Wormley, M. E., Veneri, D., Oberlander, A., Catizone, V., & Grevelding, P. (2023) · Quality of Life Research · doi:10.1007/s11136-023-03550-7 · Cited by 5
Eekholm, S., Samuelson, K. A. M., Ahlström, G., & Lindhardt, T. (2024) · Nursing Reports · doi:10.3390/nursrep14040297 · Cited by 5
Thal, S. B., Bright, S. J., Ntoumanis, N., MYERS, B. J., Jones, J., & Quested, E. (2025) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2025.102829 · Cited by 5
Wirtz, M. A., & Schulz, A. A. (2020) · Die Rehabilitation · doi:10.1055/a-1064-6587 · Cited by 7
Koripalli, M., Giruparajah, M., Laur, C. V., & Shulman, R. M. (2022) · Pediatric Diabetes · doi:10.1111/pedi.13314 · Cited by 5
Boutillier, C. L., Ahmed, H., Patel, V., McPhail, M. J. W., Carter, B., Ward, C., & Lawrence, V. C. (2022) · PLoS ONE · doi:10.1371/journal.pone.0275668 · Cited by 5
Brookman-Frazee, L. I., Turner, S., GORDON, J. N., Myers, R., Gist, K., Dickson, K. S., & Meza, M. (2018) · Children and Youth Services Review · doi:10.1016/j.childyouth.2018.03.037 · Cited by 5
Determinants of adherence to wrap-around care in child and family services
Pannebakker, N. M., Fleuren, M. A. H., Vlasblom, E., Numans, M. E., Reijneveld, S. A., & Kocken, P. (2019) · BMC Health Services Research · doi:10.1186/s12913-018-3774-6 · Cited by 5
Implementation of the Wolverine Mental Health Program, Part 1: Adoption Phase
Scott, K., Lewis, C. C., Rodríguez‐Quintana, N., Marriott, B. R., & Hindman, R. K. (2021) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2021.06.005 · Cited by 5
Vargas, Í., Mogollón‐Pérez, A., Eguiguren, P., Samico, I., Bertolotto, F., López-Vázquez, J., Amarilla, D. I., Paepe, P. D., Vázquez, M. L., Equity-LA, F., II, et al. (2023) · Health Research Policy and Systems · doi:10.1186/s12961-023-00985-9 · Cited by 5
Wang, D. Y., Wong, E. L., Cheung, A. W.-L., Tam, Z. P., Tang, K., & Yeoh, E. (2025) · Implementation Science Communications · doi:10.1186/s43058-025-00739-4 · Cited by 4
Enhancing the appropriateness of eyecare delivery: the iCaretrack approach
Gyawali, R., Toomey, M., Stapleton, F. J., Keay, L. J., & Jalbert, I. (2023) · Clinical and Experimental Optometry · doi:10.1080/08164622.2023.2178286 · Cited by 4
Bracher, M., Pilkington, G. J., Hanemann, C. O., & Pilkington, K. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.00936 · Cited by 4
Leiva-Fernández, F., González-Hevilla, A., Prados-Torres, J. D., Casas-Galán, F., García-Domingo, E., Ortiz-Suárez, P., López-Rodríguez, J. A., Pico-Soler, V., & MULTIPAP Group (2021) · Journal of Multimorbidity and Comorbidity · doi:10.1177/26335565211024791 · Cited by 4
Addressing quality and safety in anatomic pathology in low- and middle-income countries
Smith, S. J., Eadara, A., & Parkash, V. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.1060179 · Cited by 4
Sheridan, S., Donahue, K. E., & Brenner, A. T. (2018) · Patient Education and Counseling · doi:10.1016/j.pec.2018.05.014 · Cited by 5
Eekholm, S., Samuelson, K. A. M., Ahlström, G., & Lindhardt, T. (2023) · Healthcare · doi:10.3390/healthcare12010032 · Cited by 4
A single-centre hospital-wide handoff standardisation report: what is so special about that?
Coffey, M., & Huang, L. (2017) · BMJ Quality & Safety · doi:10.1136/bmjqs-2016-006382 · Cited by 4
Wróbel, A. E., Cash, P. J., Maier, A. M., & Hansen, J. P. (2025) · Interactive Journal of Medical Research · doi:10.2196/59172 · Cited by 3
Schiele, J. K., Schröter, M., Berschick, J., Steinmetz, M., Bogdanski, M., Jankow, S., Stritter, W., Keßler, C. S., Seifert, G., & Koch, A. K. (2025) · BMC Medical Education · doi:10.1186/s12909-025-07943-9 · Cited by 3
Vis, C., van Bodegom‐Vos, L., Walters, B. H., Powell, B. J., Ista, E., & van Nassau, F. (2025) · Implementation Science · doi:10.1186/s13012-025-01477-w · Cited by 3
Hybrid type 1 effectiveness-implementation studies: why and how to do them
Baloh, J., Landes, S. J., Smith, J. L., & Curran, G. M. (2026) · Frontiers in Health Services · doi:10.3389/frhs.2026.1678257 · Cited by 3
The Effects of an Educational Intervention on Exercise Advice Behaviors of Thai Oncology Nurses
Witwaranukool, P., Chan, R. J., & Yates, P. M. (2023) · Seminars in Oncology Nursing · doi:10.1016/j.soncn.2023.151453 · Cited by 3
van Gils, R. H. J., Kornelisse, R. F., Dankelman, J., & Helder, O. K. (2024) · Journal of Hospital Infection · doi:10.1016/j.jhin.2024.01.007 · Cited by 3
Nichols, J., Mamdani, M., Gomes, T., Shah, B. R., Casey, C. G., & Yu, C. H. Y. (2020) · Canadian Journal of Diabetes · doi:10.1016/j.jcjd.2020.11.008 · Cited by 3
Solomon, D., Grierson, J., Godier-McBard, L. R., & Guirguis, A. (2023) · Human Psychopharmacology Clinical and Experimental · doi:10.1002/hup.2883 · Cited by 3
Carl, J., Grüne, E., Popp, J., Hartung, V., & Pfeifer, K. (2024) · Trials · doi:10.1186/s13063-024-08153-2 · Cited by 3
Reducing low‐value imaging—A qualitative evaluation of a pilot intervention in Norway
Andersen, E. R., Hofmann, B., Brandsæter, I. Ø., & Kjelle, E. (2024) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.14058 · Cited by 3
Learmonth, Y. C., Mavropalias, G., & Wansbrough, K. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14186625 · Cited by 3
Alberto, L., Marshall, A. P., Walker, R., Pálizas, F., & Aitken, L. M. (2021) · Nursing and Health Sciences · doi:10.1111/nhs.12884 · Cited by 3
Barriers to accessing pain management services among veterans with bipolar disorder
Travaglini, L. E., Bennett, M. E., Kacmarek, C. N., Kuykendall, L., Coakley, G. N., & Lucksted, A. A. (2023) · Health Services Research · doi:10.1111/1475-6773.14221 · Cited by 3
Implementing Practice Standards for Inpatient Electrocardiographic Monitoring
Sendelbach, S. E., Sandau, K. E., Smith, L., Kreiger, R. A., Hanovich, S., & Funk, M. (2019) · American Journal of Critical Care · doi:10.4037/ajcc2019699 · Cited by 3
Highly Reliable Case Management
White, C. W., & Alejandro, J. (2020) · Professional Case Management · doi:10.1097/ncm.0000000000000431 · Cited by 3
Villa‐Roel, C., Ospina, M. B., Majumdar, S. R., Couperthwaite, S., Rawe, E., Nikel, T., & Rowe, B. H. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3587-7 · Cited by 3
Kane‐Gill, S. L. (2021) · Current Opinion in Critical Care · doi:10.1097/mcc.0000000000000878 · Cited by 3
Selection of Strategies for Improving Patient Care
Grol, R. P. T. M., & Wensing, M. (2020) · Wiley eBooks · doi:10.1002/9781119488620.ch10 · Cited by 3
Design and evaluation of a visual genomic explainer: a mixed-methods study
Butler, G. H., Andersen, C. B., Buttery, J. P., Gupta, A., Martyn, M. M., Stark, Z., Wilkins, E. J., Jayasinghe, K., & Quinlan, C. (2024) · Archives of Disease in Childhood · doi:10.1136/archdischild-2024-327650 · Cited by 2
Use of Implementation Science Concepts in the Study of Misinformation: A Scoping Review
Bang, C., Carroll, K. A., Mistry, N. B., Presseau, J., Hudek, N., Yanikomeroglu, S., & Brehaut, J. (2024) · Health Education & Behavior · doi:10.1177/10901981241303871 · Cited by 2
Krishna, M. T., Jani, Y. H., Williams, I., Mújica-Mota, R., Bestwick, R., Siciliano, M., West, R. M., Bhogal, R., Ng, B. Y., Kildonaviciute, K., et al. (2025) · Health and Social Care Delivery Research · doi:10.3310/mtyw6557 · Cited by 2
An Educational Video Game in Trauma Triage at Nontrauma Centers
Mohan, D., Fischhoff, B., Talisa, V. B., Elmer, J., White, D. B., Angus, D. C., Peitzman, A. B., Bendesky, B., Cook, A. C., Forsythe, R. M., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.13375 · Cited by 2
Tailored interventions to address determinants of practice
McHugh, S., Riordan, F., O'Mahony, A., McCarthy, L.-J., Navarro, A. C., Kerins, C., Murphy, J., Morrissey, E. C., O’Reilly, É. J., O'Connor, S., et al. (2026) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub4 · Cited by 2
Jamaluddin, T. I. B. T., Rashid, S. M. M., Broome, E., & Hassan, N. M. (2022) · Environment-Behaviour Proceedings Journal · doi:10.21834/ebpj.v7i19.3273 · Cited by 2
Reducing low-value imaging - stakeholders’ assessment of an intervention to improve imaging services
Kjelle, E., Brandsæter, I. Ø., Andersen, E. R., & Hofmann, B. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-11648-y · Cited by 2
Tong, W. T., Lee, Y. K., Ng, C. J., & Lee, P. Y. (2024) · PLoS ONE · doi:10.1371/journal.pone.0310654 · Cited by 2
Matsuo, M. (2021) · International Journal of Training and Development · doi:10.1111/ijtd.12207 · Cited by 3
Interprofessional Collaboration
Forman, S. G., Chaudhuri, A. S., & Barone, C. (2018) · Springer eBooks · doi:10.1007/978-3-030-00791-1_3 · Cited by 2
Ray, D., Sniehotta, F. F., McColl, E., Ells, L. J., O’Neill, G., & McCabe, K. E. (2022) · BMC Public Health · doi:10.1186/s12889-022-14092-x · Cited by 2
Oesch, S., Schwalbach, T., Verweij, L., Köhler, M., Sutter, S., Riguzzi, M., & Naef, R. (2024) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2024.09.003 · Cited by 2
Köhler, M., Thaqi, Q., Kuske, S., Schwalbach, T., Riguzzi, M., & Naef, R. (2025) · International Journal of Nursing Studies Advances · doi:10.1016/j.ijnsa.2025.100305 · Cited by 3
Action research improved general prerequisites for evidence-based practice
Bjurling‐Sjöberg, P., Pöder, U., Jansson, I., Wadensten, B., & Nordgren, L. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e06814 · Cited by 2
Lo, L., Hébert, D., & Colquhoun, H. L. (2019) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2019.1672814 · Cited by 2
Self-citationKunz, R., Verbel, A., Weida-Cuignet, R., Hoving, J. L., Weinbrenner, S., Friberg, E., Klipstein, A., Haecht, C. V., Autti‐Rämö, I., Agosti, N., et al. (2021) · Journal of Rehabilitation Medicine · doi:10.2340/16501977-2821 · Cited by 2
Mohan, D., MacMartin, M. A., Chelen, J. S. C., Maezes, C. B., & Barnato, A. E. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00216-8 · Cited by 3
From Centuries to Hours: The Journey of Research into Practice
Bragge, P. (2022) · Digital Government Research and Practice · doi:10.1145/3529166 · Cited by 2
The Implementation of Integrated Behavioral Health Models
Zerden, L. D. S., Cruden, G., Lombardi, B. M., Grove, L. R., Patel, S. V., & Powell, B. J. (2019) · Wiley eBooks · doi:10.1002/9781119420743.ch9 · Cited by 2
Do not do: from recommendations to action
Bermúdez‐Tamayo, C., Lima, A. O. D. L., & Mochón, L. G. (2018) · Anales del Sistema Sanitario de Navarra · doi:10.23938/assn.0380 · Cited by 2
Method-in-Use: Conceptualising Methods of Practice in Management, Entrepreneurship, and DesignPreprint
Mansoori, Y., Cash, P. J., & Daalhuizen, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4424582 · Cited by 2
Ökonomische Aspekte der Evaluation in der Organisationsbezogenen Versorgungsforschung
Wirtz, M. A. (2024) · Springer Reference Pflege, Therapie, Gesundheit · doi:10.1007/978-3-662-66798-9_47-1 · Cited by 1
Noh, H., Chelva, M. P., Afungchwi, G. M., Pondy, A., Githanga, J. N., Landis, F., King’e, M., Martiniuk, A. L. C., Ward, N., Barwick, M. A., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-094502 · Cited by 1
Agulnik, A., Graetz, D. E., Carothers, B. J., Rivera, J., Blakeney, E. A., Hayes, S., Chaitan, V. L., Cabassa, L. J., Goss, C. W., Luke, D. A., et al. (2025) · Implementation Science Communications · doi:10.1186/s43058-025-00811-z · Cited by 1
Scandiffio, J., Sureshkumar, A., Feng, G., Gaid, D., Wasilewski, M. B., Woods, N., Donkers, S., Simpson, R., & Munce, S. (2026) · PLoS ONE · doi:10.1371/journal.pone.0349867 · Cited by 1
Snoeck-Krygsman, S. P., Donker‐Cools, B. H. P. M., Jansen, L. P., Hoving, J. L., & Schaafsma, F. G. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1112683 · Cited by 1
Landazábal, D. C., Vargas, Í., Sánchez, E., Cots, F., Plaja, P., Garrote, J. M. P.-C., Hidalgo, A. S., & Vázquez, M. L. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-11445-7 · Cited by 1
Metadata
- Authors
- Colquhoun, H. L., Squires, J. E., Kolehmainen, N., Fraser, C., & Grimshaw, J. M.
- Affiliations
- University of Toronto (CA)
- University of Ottawa (CA)
- Newcastle University (GB)
- University of Aberdeen (GB)
- Corresponding author
- Colquhoun, Heather L.
- Venue
- Implementation Science
- Published
- 2017-03-04
- Volume
- 12
- Issue
- 1
- Pages
- 30-30
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC5336662
- OpenAlex
- W2591591866
- Semantic Scholar
- 0c16198cd28cc786c55f201be8eefdb07af75558
- Cited by
- 283
- References
- 50
- Citations by year
- 2026: 11 · 2025: 25 · 2024: 40 · 2023: 35 · 2022: 41 · 2021: 40 · 2020: 27 · 2019: 28 · 2018: 25 · 2017: 10
- FWCI
- 4.34
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- TSpace (University of Toronto) (submittedVersion, cc-by)
- uO Research (University of Ottawa) (submittedVersion, public-domain)
- Newcastle University ePrints (Newcastle Univesity) (cc-by)
- Funders
- Canadian Institutes of Health Research
- Medical Research Council
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Applied Psychology › Behavioral Health and Interventions
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- intervention design, behaviour change interventions, barriers to change, theory-based intervention design, user engagement, organizational change, system-level interventions, design guidelines
- MeSH terms
- Health Personnel, Humans, Inservice Training, Health Knowledge, Attitudes, Practice, Professional Practice, Translational Research, Biomedical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
