From lists of behaviour change techniques ( BCT s) to structured hierarchies: Comparison of two methods of developing a hierarchy of BCT s
Open accessAbstract
Objectives: Behaviour change technique ( BCT ) T axonomy v1 is a hierarchically grouped, consensus‐based taxonomy of 93 BCT s for reporting intervention content. To enhance the use and understanding of BCT s, the aims of the present study were to (1) quantitatively examine the ‘bottom‐up’ hierarchical structure of Taxonomy v1, (2) identify whether BCT s can be reliably mapped to theoretical domains using a ‘top‐down’ theoretically driven approach, and (3) identify any overlap between the ‘bottom‐up’ and ‘top‐down’ groupings. Methods and design: The ‘bottom‐up’ structure was examined for higher‐order groupings using a dendrogram derived from hierarchical cluster analysis. For the theory‐based ‘top‐down’ structure, 18 experts sorted BCT s into 14 theoretical domains. Discriminant Content Validity was used to identify groupings, and chi‐square tests and Pearson's residuals were used to examine the overlap between groupings. Results: Behaviour change techniques relating to ‘Reward and Punishment’ and ‘Cues and Cue Responses’ were perceived as markedly different to other BCT s. Fifty‐nine of the BCT s were reliably allocated to 12 of the 14 theoretical domains; 47 were significant and 12 were of borderline significance. Thirty‐four of 208 ‘bottom‐up’ × ‘top‐down’ pairings showed greater overlap than expected by chance. However, only six combinations achieved satisfactory evidence of similarity. Conclusions: The moderate overlap between the groupings indicates some tendency to implicitly conceptualize BCT s in terms of the same theoretical domains. Understanding the nature of the overlap will aid the conceptualization of BCT s in terms of theory and application. Further research into different methods of developing a hierarchical taxonomic structure of BCT s for international, interdisciplinary work is now required. Statement of contribution: What is already known on this subject? Behaviour change interventions are effective in improving health care and health outcomes. The ‘active’ components of these interventions are behaviour change techniques and over 93 have been identified. Taxonomies of behaviour change techniques require structure to enable potential applications. What does this study add? This study identifies groups of BCT s to aid the recall of BCT s for intervention coding and design. It compares two methods of grouping – ‘bottom‐up’ and theory‐based ‘top‐down’ – and finds a moderate overlap. Building on identified BCT groups, it examines relationships between theoretical domains and BCT s.
AI snapshot
Written from the paper’s full text.
TL;DR
This study compared an inductive “bottom-up” hierarchical clustering of Behaviour Change Technique Taxonomy v1 with a deductive “top-down” mapping of BCTs to the 14 Theoretical Domains Framework domains. It found moderate overlap between the two grouping methods, with only six of 208 bottom-up/top-down pairings showing comparatively high similarity.
Key findings
- The bottom-up 16-group solution contained six splits, creating seven higher-order strategy groupings; the first split (height = 31.78) separated BCTs relating to “Scheduled consequences” and “Reward and Threat,” while later splits had heights <10, indicating less distinct groupings.
- In the top-down closed-sort task, 59 of 87 BCTs (68%) were reliably allocated to 12 of 14 TDF domains, with a further 12 BCTs (14%) of borderline significance; two domains, “Social/Professional Role and Identity” and “Memory, Attention and Decision Processes,” had no BCTs significantly assigned. The domains with the most reliably allocated BCTs were Reinforcement (17), Beliefs about Consequences (10), and Social Influences (10).
- Comparing groupings, 34 of 208 bottom-up × top-down pairings showed greater overlap than expected by chance; only six achieved Pearson’s residual values >5: Repetition and Substitution–Skills (6.66), Goals and Planning–Goals (6.41), Covert Learning–Beliefs about Consequences (5.76), Self-Belief–Beliefs about Capabilities (5.70), Scheduled Consequences–Reinforcement (5.22), and Antecedents–Environmental Context and Resources (5.20).
- Of the 24 most commonly occurring BCTs, 18 (75%) were reliably mapped to seven theory domains, with two further BCTs (8%) of borderline significance; six commonly identified BCTs were not mapped to any theoretical domain.
Methods
- The bottom-up structure was examined using the dendrogram derived from hierarchical cluster analysis of an open-sort task completed by 18 behaviour change experts who grouped BCTs by similar active ingredients.
- For the top-down structure, 18 eligible experts (72% of 25 invited) completed a closed-sort task, allocating 87 BCTs to one or more of the 14 refined TDF domains and giving confidence ratings; there was no participant overlap between the two sort tasks.
- Analysis used Discriminant Content Validity with one-sample t-tests and Hochberg correction, intraclass correlation coefficients, and chi-square tests with Monte Carlo simulation and Pearson’s residuals to compare bottom-up and top-down groupings.
Limitations
- The paper states that experts’ judgements may be influenced by specific theoretical approaches or cues from particular words, especially theories with a longer history; it notes this was mitigated by avoiding the word “theory” in the open-sort instructions and by aggregating responses across participants.
- The paper states that further work is needed to evaluate the replicability and utility of the groupings, and that different groupings may be useful for different tasks and users.
- Evident from the text: the closed-sort task used an earlier 87-item taxonomy and the open-sort task an even earlier 85-item version, whereas published BCT Taxonomy v1 contains 93 BCTs; the two expert samples differed significantly by gender and country of residence, and chi-square comparisons excluded two TDF domains that had no BCTs assigned.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 28 cited sources checked · 0 supported · 0 flagged
- Findingown data
The final split occurs at split 6 (height = 4.18), where Self-Belief, Comparison of Outcome, and Identity are separated from Shaping Knowledge and Regulation.
“The final split occurs at split 6 (height = 4.18), where the groupings 'Self-Belief', 'Comparison of Outcome', and 'Identity' (BCTs relating to the self and identity) are separated from the groupings of 'Shaping Knowledge' and 'Regulation' (BCTs relating to knowledge and regulation).”
Quote in the paperNot a substantial claim - Findingown data
The first split at height 31.78 divided the body of BCTs into two groups: Scheduled consequences and Reward and Threat.
“The first split is at 'split 1' (height = 31.78),where the body of BCTs split into two groups, the grouping to the left containing the groupings of 'Scheduled consequences' and 'Reward and Threat' that involve BCTs relating to the anticipation of a direct reward or punishment (e.g., social reward, negative reinforcement, extinction).”
Quote in the paperNot a substantial claim - Findingown data
At split 3 (height = 9.56), BCTs from Covert Learning and Natural Consequences are separated off from the remaining groupings.
“At split 3 (height = 9.56), BCTs from the groupings 'Covert Learning' and 'Natural Consequences' are separated off from the remaining groupings.”
Quote in the paperNot a substantial claim - Findingown data
Within the reported 16-group open-sort solution, there are six points at which groups of BCTs split into groups containing similar BCTs, creating seven higher-order strategy groupings.
“Within the reported 16-group open-sort solution of the taxonomy, there are six points at which groups of BCTs split into groups containing similar BCTs (creating seven split groups, that is, higher-order strategy groupings; see Figure 1 and Table S1).”
Quote in the paperNot a substantial claim - Findingown data
From split 3 onwards, the distance between the groupings is markedly smaller (height <10).
“From split 3 onwards, the distance between the groupings is markedly smaller (height <10), indicating that the groupings formed are less distinct from each other.”
Quote in the paperNot a substantial claim
- Findingown data
The second split at height 14.16 revealed three groupings: Repetition and Substitution, Antecedents, and Associations.
“The next split, 'split 2' (height = 14.16), reveals three groupings to the left of the remaining BCTs: 'Repetition and Substitution', 'Antecedents', and 'Associations' comprising BCTs relating to cues and cue responses.”
Quote in the paperNot a substantial claim - Findingown data
The following commonly identified BCTs were not mapped to any of the theoretical domains: Problem solving, Persuasive argument, Discrepancy between current behaviour, Self-monitoring of outcome of behaviour, Monitoring of outcome behaviour by others without feedback, and Pharmacological support.
“The following commonly identified BCTs were not mapped to any of the theoretical domains: Problem solving, Persuasive argument, Discrepancy between current behaviour, Self-monitoring of outcome of behaviour, Monitoring of outcome behaviour by others without feedback, and Pharmacological support.”
Quote in the paperNot a substantial claim - Findingown data
Thirty-four of the 208 combinations showed greater than expected overlap, achieving positive Pearson's residual values.
“Thirty-four of the 208 combinations showed greater than expected overlap, achieving positive Pearson's residual values (see Table 5).”
Quote in the paperNot a substantial claim - Findingown data
'Goals' had five BCTs assigned with good agreement.
“whilst 'Goals' had five BCTs assigned with good agreement.”
Quote in the paperNot a substantial claim - Findingown data
Twenty-one of the 91 bottom-up and top-down TDF Domain combinations showed a greater than expected overlap with positive Pearson's residual values.
“Twenty-one of the 91 'bottom-up' and 'top-down' TDF Domain combinations showed a greater than expected overlap with positive Pearson's residual values (see Table 4).”
Quote in the paperNot a substantial claim - Findingown data
Two further groups of BCTs comprising Covert Learning and Natural Consequences, and Feedback and Monitoring and Goals and Planning, respectively, lay between the most distinct and least distinct groups.
“Two further groups of BCTs comprising the BCT Taxonomy v1 groupings of 'Covert Learning' and 'Natural Consequences', and 'Feedback and Monitoring' and 'Goals and Planning', respectively, lay between these most distinct and least distinct groups.”
Quote in the paperNot a substantial claim - Findingown data
There was a statistically significant association between the 16 bottom-up groupings and the 13 top-down groupings (χ2 = 437.80, p < .001).
“There was also a statistically significant association between the 16 'bottom-up' groupings and the 13 'top-down' groupings (v 2 = 437.80,p < .001).”
Quote in the paperSubstantial claim - Findingown data
The level of expertise reported by closed-sort participants was not significantly different from that reported by open-sort participants.
“This is not significantly different from the level of expertise reported by participants in the open-sort task from the taxonomy (behaviour change theory, M = 3.00, SD = 0.88, t(34) = 0.64, p > .1;behaviour change interven-tions, M = 2.42, SD = 0.96, t(34) = 0.63, p > .1).”
Quote in the paperNot a substantial claim - Findingown data
Only two combinations achieved Pearson's residual values >5: Group 1 with Reinforcement (Pearson's residual = 6.61) and Group 5 with Social Influences (Pearson's residual = 5.04).
“Only two combinations achieved Pearson's residual values >5: 'Group 1' with 'Reinforcement' (Pearson's residual = 6.61) and 'Group 5' with 'Social Influences' (Pearson's residual = 5.04).”
Quote in the paperNot a substantial claim - Findingown data
Six BCTs were allocated to multiple domains.
“Within these domains, 59 (68%) of the BCTs were considered to be reliably allocated, with a further 12 (14%) BCTs having borderline statistical significance (p > .05but p < .1)and six being allocated to multiple domains (see Table 3).”
Quote in the paperNot a substantial claim - Findingown data
Six of the open-sort task groupings ('Repetition and Substitution', 'Goals and Planning', 'Covert Learning', 'Self-Belief', 'Scheduled Consequences', and 'Antecedents') showed a high level of overlap with six of the TDF groupings.
“Six of the open-sort tasks groupings -'Repetition and Substitution, 'Goals and Planning', 'Covert Learning', 'Self-Belief', 'Scheduled Consequences', and 'Antecedents'showed a high level of overlap with the six of the TDF groupings”
Quote in the paperSubstantial claim - Findingown data
BCTs relating to Reward and Punishment and Cues and Cue Responses were perceived as markedly different to other BCTs.
“Behaviour change techniques relating to 'Reward and Punishment' and 'Cues and Cue Responses' were perceived as markedly different to other BCTs.”
- Also stated in: § Discussion · plain
“Examination of this hierarchical structure revealed that BCTs related to reward and threat and those related to cues and cue responses were conceptualized quite distinctly from the other BCTs.”
Quote in the paperSubstantial claim - Also stated in: § Discussion · plain
- Findingown data
Of the 24 most frequently identified BCTs in Michie et al. (2013), 17 were clearly grouped into one of the 14 domains.
“Of the 24 most frequently identified BCTs in Michie et al. (2013), 17 were clearly grouped into one of the 14 domains”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Michie et al. (2013)
Not checked in the free run.
- Findingown data
A further 12 BCTs had borderline statistical significance in allocation to TDF domains.
“with a further 12 BCTs having borderline statistical significance.”
Quote in the paperNot a substantial claim - Findingown data
The least distinct groups comprised BCTs relating to social support and social comparisons, and the self and identity.
“The least distinct groups comprised BCTs relating to social support and social comparisons, and the self and identity, suggesting that there is less clarity about the BCTs within these domains.”
Quote in the paperSubstantial claim - Findingnone given
Both groups reported high levels of expertise in relation to behaviour change theory.
“This is supported by the fact that both groups reported high levels of expertise in relation to behaviour change theory.”
Quote in the paperNot a substantial claim - Findingown data
In the 'top-down' task, 69/87 BCTs were reliably allocated to one or more of the TDF domains.
“In this 'top-down' task, 69/87 BCTs were reliably allocated to one or more of the TDF domains”
Quote in the paperSubstantial claim - Findingown data
The majority of BCTs (37) were allocated to three domains: 'Beliefs about Consequences', 'Reinforcement', and 'Social Influences'.
“The majority of BCTs (37) were allocated to three domains which also had high confidence ratings and ICCs: 'Beliefs about Consequences', 'Reinforcement', and 'Social Influences'.”
Quote in the paperSubstantial claim - Findingown data
A further 12 (14%) BCTs had borderline statistical significance.
“Within these domains, 59 (68%) of the BCTs were considered to be reliably allocated, with a further 12 (14%) BCTs having borderline statistical significance (p > .05but p < .1)and six being allocated to multiple domains (see Table 3).”
Quote in the paperNot a substantial claim - Findingown data
Allocation was reliable for 12 of the 14 domains.
“This allocation was reliable for 12 of the 14 domains, that is, BCTs were allocated consistently with high confidence across experts leading to p < .05(see Table 2 for frequencies and Table 3 for confidence ratings, ICC values and related p-values).”
Quote in the paperSubstantial claim - Findingown data
There were only two similarly strong overlaps between the higher-order groupings and the TDF groups.
“By contrast, there were only two similarly strong overlaps between the higher-order groupings and the TDF groups”
Quote in the paperSubstantial claim - Findingown data
The domains, in order of number of BCT allocations obtaining statistical or marginal statistical significance, were Reinforcement (17), Beliefs about Consequences (10), Social Influences (10), Goals (6), Environmental Context and Resources (6), Skills (5), Emotion (5), Knowledge (4), Beliefs about Capabilities (2), Intentions (2), Optimism (1), and Behavioural Regulation (1).
“The domains, in order of number of BCT allocations obtaining statistical or marginal statistical significance, were (numbers of BCTs in brackets) Reinforcement (17), Beliefs about Consequences (10), Social Influences (10), Goals (6), Environmental Context and Resources (6), Skills (5), Emotion (5), Knowledge (4), Beliefs about Capabilities (2), Intentions (2), Optimism (1), and Behavioural”
Quote in the paperNot a substantial claim - Findingown data
Within the reliably allocated domains, 59 (68%) of the BCTs were considered to be reliably allocated.
“Within these domains, 59 (68%) of the BCTs were considered to be reliably allocated, with a further 12 (14%) BCTs having borderline statistical significance (p > .05but p < .1)and six being allocated to multiple domains (see Table 3).”
Quote in the paperNot a substantial claim - Findingown data
Most of the commonly used BCTs were associated with a theoretical domain.
“Most of the commonly used BCTs were associated with a theoretical domain.”
Quote in the paperSubstantial claim - Findingown data
The remaining seven of the 24 most frequently identified BCTs were not reliably allocated to any domain even though they could be identified reliably in the intervention descriptions.
“the remaining seven BCTs were not reliably allocated to any domain even though they could be identified reliably in the intervention descriptions.”
Quote in the paperSubstantial claim - Findingown data
Comparison of the higher-order bottom-up sorting strategy groups and the top-down TDF-derived groups revealed a significant association (χ2 = 236.13, p < .001).
“Comparison of the BCT groups derived from the higher-order 'bottom-up' sorting strategies, shown in the dendrogram (see Figure 1 and Table S1), and the 'top-down' TDF-derived groups (Table 3) revealed a significant association (v 2 = 236.13,p < .001).”
Quote in the paperSubstantial claim - Findingown data
Of the 24 most commonly occurring BCTs, 18 (75%) were reliably mapped to seven of the theory domains, with a further two (8%) obtaining borderline statistical significance.
“Of the 24 most commonly occurring BCTs (see Michie et al., 2013; emboldened in Table 3), 18 (75%) were reliably mapped to seven of the theory domains, with further two (8%) obtaining borderline statistical significance.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Michie et al., 2013
Not checked in the free run.
- Premisecitation
A previous attempt to map 35 BCTs to 11 theoretical domains from the original TDF showed good reliability across four researchers, with 71% agreement over the 385 possible mappings.
“A previous attempt to map 35 BCTs to 11 theoretical domains from the original TDF showed good reliability across four researchers, with 71% agreement over the 385 possible mappings (Michie, Johnston, Francis, Hardeman, & Eccles, 2008).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Michie, Johnston, Francis, Hardeman, & Eccles, 2008
Not checked in the free run.
- Premisecitation
Having a theoretical basis to an intervention enhances its effectiveness.
“The importance of understanding the theoretical underpinnings of BCTs has been highlighted in previous research suggesting that having a theoretical basis to an intervention enhances its effectiveness (Dombrowski et al., 2012;Michie et al., 2009;Taylor, Conner, & Lawton, 2012;Webb, Joseph, Yardley, & Michie, 2010).”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Dombrowski et al., 2012
Not checked in the free run.
- cites Michie et al., 2009
Not checked in the free run.
- cites Taylor, Conner, & Lawton, 2012
Not checked in the free run.
- Interpretationown data
The groupings formed from split 3 onwards are less distinct from each other.
“From split 3 onwards, the distance between the groupings is markedly smaller (height <10), indicating that the groupings formed are less distinct from each other.”
Quote in the paperNot a substantial claim - Premisecitation
BCT Taxonomy v1 was developed through consensus exercises involving over 50 behaviour change experts from various disciplines and countries.
“This BCT taxonomy was developed through a series of consensus exercises (including a Delphi exercise, feedback from an international advisory board and coding exercises) involving over 50 behaviour change experts from a variety of disciplines and countries.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Michie et al., 2013
Not checked in the free run.
- cites Michie, Johnston, et al., 2012
Not checked in the free run.
- Premisecitation
Of 235 implementation studies, only 22.5% were judged to have used theories of behaviour change.
“of 235 implementation studies, only 22.5% were judged to have used theories of behaviour change (Davies, Walker, & Grimshaw, 2010)”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Davies, Walker, & Grimshaw, 2010
Not checked in the free run.
- Premisecitation
BCT Taxonomy v1 was organized hierarchically using an open-sort task and hierarchical cluster analysis.
“To increase the usability and speed of recall of BCTs, BCT Taxonomy v1 was organized hierarchically using an open-sort task and hierarchical cluster analysis (HCA).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Michie et al., 2013
Not checked in the free run.
- Interpretationcitation
Grouping by individual theories or theoretical constructs is impractical given the number of BCTs and behaviour change theories.
“In the light of the number of BCTs reported in the taxonomy and the large number of behaviour change theories (see Hobbs, Campbell, Hildon, & Michie, 2011), grouping by individual theories or theoretical constructs is impractical.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Hobbs, Campbell, Hildon, & Michie, 2011
Not checked in the free run.
- Premisecitation
The majority of these implementation studies gave no clear explanation for why the selected theories had been used.
“and the majority of these gave no clear explanation for why the selected theories had been used.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Davies, Walker, & Grimshaw, 2010
Not checked in the free run.
- Interpretationreasoning
For the two theoretical domains where no BCTs were reliably assigned, there would appear to be no shared, or recognized, way of changing them.
“For the two theoretical domains where no BCTs were reliably assigned, there would appear to be no shared, or recognized, way of changing them.”
Quote in the paperSubstantial claim - Interpretationreasoning
The higher level of sorting shared by respondents does not align as well with the theoretical domains.
“suggesting that the higher level of sorting shared by respondents does not align as well with the theoretical domains.”
Quote in the paperSubstantial claim - Interpretationcitation
Variability in the distinctiveness of BCT groupings may impact the ability to recall BCTs, especially where quick reference to BCTs is necessary.
“and so this variability in distinctiveness may impact on the ability to recall BCTs.”
- Also stated in: § Discussion · plain
“This is especially the case where quick reference to BCTs is necessary, for instance when decoding descriptions of interventions or in choosing BCTs to construct a behaviour change intervention.”
Quote in the paperSubstantial claim - Also stated in: § Discussion · plain
- Interpretationown data
The relationship between higher-order sorting strategies and theoretically derived groups is not strong.
“indicating that the relationship between higher-order sorting strategies and theoretically derived groups is not strong.”
Quote in the paperSubstantial claim - Interpretationown data
These three domains are the theoretical domains where there is the greatest number of agreed methods for bringing about change.
“This suggests that these are the theoretical domains where there is the greatest number of agreed methods for bringing about change.”
Quote in the paperSubstantial claim - Interpretationreasoning
The difference in distinctiveness has implications for understanding how BCTs are conceptualized by behaviour change experts.
“The difference in distinctiveness not only has implications for understanding how BCTs are conceptualized by behaviour”
Quote in the paperSubstantial claim - Premisecitation
Distinct sets of individual items are more easily remembered than less distinct sets.
“Distinct sets of individual items have been shown to be more easily remembered than less distinct sets (see Baddley, 1966;Polyn, Erlikhman, & Kahana, 2011;Tulving & Pearlsto, 1966)”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Baddley, 1966
Not checked in the free run.
- cites Polyn, Erlikhman, & Kahana, 2011
Not checked in the free run.
- cites Tulving & Pearlsto, 1966
Not checked in the free run.
- Interpretationown data
The moderate overlap between the groupings indicates some tendency to implicitly conceptualize BCTs in terms of the same theoretical domains.
“The moderate overlap between the groupings indicates some tendency to implicitly conceptualize BCTs in terms of the same theoretical domains.”
- Also stated in: § Discussion · hedged
“Another key finding was the moderate overlap between the original 16 BCT groupings derived from the 'bottom-up' inductive approach and the 12 groupings from the 'top-down' theoretically driven approach, indicating some common conceptualization of BCTs across these two approaches.”
Quote in the paperSubstantial claim - Also stated in: § Discussion · hedged
- Study design and conductreasoning
The clustering and Discriminant Content Validity techniques used allowed for the aggregation of sort task responses across participants, diluting any individual viewpoint.
“Second, the clustering and Discriminant Content Validity techniques used allowed for the aggregation of sort task responses across participants diluting any individual viewpoint.”
Quote in the paperSubstantial claim- Rests on an assumption: Experts' judgements are likely influenced by specific theoretical approaches or cues from particular words, especially those associated with theories that have a longer history.
- Interpretationown data
The 'top-down' mapping of BCTs to theoretical domains advances the limited consensus methods used by Michie et al. (2008) by using an improved BCT taxonomy, an empirically validated theory domains framework and a larger number of respondents.
“The 'top-down' mapping of BCTs to theoretical domains advances the limited consensus methods used by Michie et al. (2008) by using an improved BCT taxonomy, an empirically validated theory domains framework and a larger number of respondents.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Michie et al. (2008)
Not checked in the free run.
- Interpretationown data
Experts may have sorted BCTs by theoretical constructs or domains, implicitly or explicitly, across both tasks.
“suggesting that experts may have sorted BCTs by theoretical constructs or domains (implicitly or explicitly) across both tasks.”
Quote in the paperSubstantial claim - Interpretationreasoning
The groupings reported here are potentially more robust than those derived using consensus methods.
“As a result, the groupings reported here are potentially more robust than those derived using consensus methods.”
Quote in the paperSubstantial claim - Study design and conductreasoning
The approaches taken in the grouping methodology helped to overcome the potential bias from experts' theoretical approaches or cues from particular words in two ways.
“However, the approaches taken in the grouping methodology helped to overcome this potential bias in two ways.”
Quote in the paperNot a substantial claim- Rests on an assumption: Experts' judgements are likely influenced by specific theoretical approaches or cues from particular words, especially those associated with theories that have a longer history.
- Interpretationown data
The lower level groupings are more in line with the theoretical frameworks than the empirically higher-order groupings.
“It would appear that the lower level groupings are more in line with the theoretical frameworks than the empirically higher-order groupings”
Quote in the paperSubstantial claim - Interpretationown data
The grouping methods employed in the bottom-up and top-down sort tasks improve on previous attempts to group BCTs.
“The grouping methods employed in the 'bottom-up' and 'top-down' sort tasks improve on previous attempts to group BCTs in a number of important ways.”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 21
- May combine two claims. 13
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataAt split 4 (height = 7.69), the split includes Feedback and Monitoring, and Goals and Planning and BCTs relating to goals, planning and feedback.
“At split 4 (height = 7.69), the split includes the groupings 'Feedback and Monitoring', and 'Goals and Planning' and BCTs relating to goals, planning and feedback.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataAt split 5 (height = 5.55), the split includes Social Support and Comparison of Behaviour and BCTs related to social factors.
“At split 5 (height = 5.55), the split includes the groupings 'Social Support' and 'Comparison of Behaviour' and BCTs related to social factors.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data'Behavioural regulation' had only one assigned BCT but achieved good agreement.
“'Behavioural regulation' had only one assigned BCT but achieved good agreement”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe number of female and male participants differed significantly between the two sort tasks.
“the number of female and male participants did, vfoot_2 (1) = 4.33, p < .05”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe first cluster mainly reflects BCTs associated with learning theory, as do those in the third cluster.
“For instance, the first cluster mainly reflects BCTs associated with learning theory, as do those in the third cluster.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataSix combinations achieved Pearson's residual values >5: Repetition and Substitution and Skills (6.66), Goals and Planning and Goals (6.41), Covert Learning and Beliefs about Consequences (5.76), Self-Belief and Beliefs about Capabilities (5.70), Scheduled Consequences and Reinforcement (5.22), and Antecedents and Environmental Context and Resources (5.20).
“Six combinations achieved Pearson's residual values >5, indicating a comparatively high level of overlap; these combinations were 'Repetition and Substitution' and 'Skills' (Pearson's residual = 6.66), 'Goals and Planning' and 'Goals' (Pearson's residual = 6.41), 'Covert Learning' and 'Beliefs about 'Consequences' (Pearson's residual = 5.76), 'Self-Belief' and 'Beliefs about Capabilities' (Pearson”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataParticipants for the closed-sort task reported moderately high levels of expertise in behaviour change theory (M = 3.17, SD = 0.71) and in delivering behaviour change interventions (M = 2.17, SD = 1.38).
“Participants for the closed-sort task reported moderately high levels of expertise in behaviour change theory (M = 3.17, SD = 0.71) and in delivering behaviour change interventions (M = 2.17, SD = 1.38) as measured on 5-point scales (scores are reversed so higher score indicates more experience).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe age of participants did not differ significantly between the two sort tasks.
“Whilst the age of participants did not differ significantly between the two sort tasks, t(34) = 0.77, p > .1”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataTwo domains, Social/Professional Role and Identity and Memory, Attention and Decision Processes, had no BCTs significantly assigned to them.
“Two domains, 'Social/Professional Role and Identity' and 'Memory, Attention and Decision Processes' had no BCTs significantly assigned to them.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe country of residence of participants differed significantly between the two sort tasks.
“as did the country of residence (v 2 = 20.76 p < .001) 2 .”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAll TDF domains had BCTs allocated to them in the closed-sort task, with the number of BCTs allocated ranging from 15 for Social/Professional Role and Identity to 68 for Behavioural Regulation.
“All TDF domains had BCTs allocated to them in the closed-sort task, with the number of BCTs allocated ranging from 15 for Social/Professional Role and Identity to 68 for Behavioural Regulation (see Table 2).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe three domains 'Beliefs about Consequences', 'Reinforcement', and 'Social Influences' had high confidence ratings and ICCs.
“which also had high confidence ratings and ICCs”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationBCT Taxonomy v1 comprises 93 BCTs that were evaluated for conformity to a BCT definition, clarity as individual BCTs, and distinctiveness.
“It comprises 93 BCTs (see Appendix S1 for the version used in the present study) which have been evaluated on (1) whether they conformed to a definition of a BCT, (2) their clarity as an individual BCT, and (3) their distinctiveness (i.e., whether there was any overlap and redundancy with other BCTs).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Michie et al., 2013
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationThe TDF is an integrative framework of theories of behaviour change.
“The TDF is an integrative framework of theories of behaviour change that was originally developed by 18 psychological theorists in collaboration with 16 health service researchers and 30 health psychologists (Michie et al., 2005).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Michie et al., 2005
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationBCT Taxonomy v1 is a hierarchically grouped, consensus-based taxonomy of 93 BCTs for reporting intervention content.
“Behaviour change technique (BCT) Taxonomy v1 is a hierarchically grouped, consensus-based taxonomy of 93 BCTs for reporting intervention content.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Michie et al., 2013
Not checked in the free run.
- cites Michie, Johnston, et al., 2012
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe TDF has been used by research teams across several countries and health care systems to investigate implementation problems and inform interventions to change professional practice.
“The TDF has been used by research teams across several countries and health care systems to investigate implementation problems and inform interventions to change professional practice (see Amemori, Korhonen, Kinnunen, Michie, & Murtomaa, 2011;Beenstock et al., 2012;Bussi eres, Patey, Francis, Sales, & Grimshaw, 2012;Dyson, Lawton, Jackson, & Cheater, 2011;Francis, Stockton, et al., 2009;Francis,”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites Amemori et al., 2011
Not checked in the free run.
- cites Beenstock et al., 2012
Not checked in the free run.
- cites Bussi eres et al., 2012
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationcitationThere is a clear need for improving methods for applying theory to intervention design and understanding how BCTs exert their influences.
“There is therefore a clear need for improving methods for applying theory to intervention design and our understanding of how BCTs exert their influences.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThese seven BCTs may have evolved from several different theoretical approaches and therefore may be less associated with a particular theoretical domain.
“This finding suggests that these BCTs may have evolved from several different theoretical approaches and therefore may be less associated with a particular theoretical domain.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe third cluster, labelled 'Repetition and Substitution', deals with the maintenance of behaviour change including maintenance in the face of competing behaviours.
“whilst the third cluster (labelled as 'Repetition and Substitution') deals with the maintenance of behaviour change including maintenance in the face of competing behaviours.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductreasoningThe use of the word 'theory' was avoided in the open-sort task instructions to prevent priming the use of theory to sort BCTs.
“First, the use of the word 'theory' was avoided in the open-sort task instructions to prevent priming the use of theory to sort BCTs.”
Quote in the paperSubstantial claim- Rests on an assumption: Experts' judgements are likely influenced by specific theoretical approaches or cues from particular words, especially those associated with theories that have a longer history.
May combine two claims.
Study design and conductnone givenIndividual groupings of BCTs defined by each expert held equal weight within the final solution and were aggregated using empirical techniques (HCA in the bottom-up sort task and Discriminant Content Validity methods in the top-down sort task).
“First, individual groupings of BCTs defined by each expert held equal weight within the final solution and were aggregated using empirical techniques (HCA in the 'bottom-up' sort task and Discriminant Content Validity methods in the 'top-down' sort task).”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductreasoningThe approach is less prone to bias from individual responses and therefore provides a more balanced view of how experts, as a whole, conceptualize BCTs.
“Such an approach is less prone to bias from individual responses and therefore provides a more balanced view of how experts, as a whole, conceptualize BCTs.”
Quote in the paperSubstantial claim- Rests on an assumption: Experts' judgements are likely influenced by specific theoretical approaches or cues from particular words, especially those associated with theories that have a longer history.
Classified as probably not a substantial claim.
Study design and conductreasoningHochberg's correction was used to control for the family-wise error rate given the large number of tests used.
“This was used to control for the family-wise error rate given the large number of tests used and provided a suitable criterion for inclusion and exclusion of BCTs to a particular domain, over and above the use of a subjective cut-off value.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Hochberg, 1988
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe first cluster reflects BCTs that initiate behaviour change by 'scheduling consequences'.
“with the first cluster reflecting BCTs that initiate behaviour change by 'scheduling consequences'”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductcitationBCTs were considered to be reliably allocated to a domain if their mean confidence ratings were significantly greater than zero (p < .05) after Hochberg's correction.
“Behaviour change techniques were considered to be reliably allocated to a domain if their mean confidence ratings were significantly greater than zero (p < .05)after Hochberg's correction (Hochberg, 1988; applied using the p.adjust function in R [R Development Core Team, 2008]).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Hochberg, 1988
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThe clustering may not only reflect current explicit theorizing but also indicate where developments are being made.
“Thus, the clustering may not only reflect current explicit theorizing but also indicate where developments are being made.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductown dataMonte Carlo simulation (using 2000 replications) was used to adjust for potential inaccuracy of the p-value estimation resulting from the number of cells that had expected frequencies <1.
“To adjust for potential inaccuracy of the p-value estimation (resulting from the number of cells that had expected frequencies <1), Monte Carlo simulation (using 2000 replications) was used.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe clusters developed through the 'bottom-up' sort task suggest theoretical thinking.
“The clusters developed through the 'bottom-up' sort task suggest theoretical thinking.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThere was no overlap in participants between the bottom-up and top-down sort tasks.
“There was no overlap in participants between the 'bottom-up' and 'top-down' sort tasks.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductcitationThe sample size for the closed-sort task was based on estimates given for content-validation exercises, with two to 24 participants being shown to be sufficient and more than five participants reducing the influence of rater outliers.
“The sample size for the closed-sort task was based on estimates given for content-validation exercises, with two to 24 participants being shown to be sufficient (see Dixon, Johnston, McQueen, & Court-Brown, 2008;Dixon, Pollard, & Johnston, 2007;Lynn, 1986;Waltz, Strickland, & Lenz, 1991) and more than five participants reducing the influence of rater outliers (Carmines & Zeller, 1979).”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites Dixon et al., 2008
Not checked in the free run.
- cites Lynn, 1986
Not checked in the free run.
- cites Carmines & Zeller, 1979
Not checked in the free run.
Classified as probably not a substantial claim.
Study design and conductnone givenThe agreement of BCT allocation across participants was analysed using a two-way intraclass correlation coefficient within each domain.
“The agreement of BCT allocation across participants was analysed using a two-way intraclass correlation coefficient (ICC) within each domain.”
Quote in the paperSubstantial claim
The paper relies on this without support.
The 18 experts in the closed-sort task are sufficiently representative of behaviour change experts for their allocations to reflect the broader expert community.
“Eighteen people (72%) met the eligibility criteria and all who were eligible consented to complete the task (see Table 1 for demographic information).”
“Participants were eligible to take part if they had (1) experience in designing interventions that specifically used BCTs, (2) experience in writing manuals or protocols of behaviour change interventions, or (3) undertaken a narrative or systematic review of behaviour change literature.”
The paper relies on this without support.
The experts' groupings and confidence ratings reflect the underlying conceptual structure of BCTs and theoretical domains rather than idiosyncratic preferences.
“Participants were asked to sort the list of BCTs into groups (up to a maximum of 24) of their choice and label the groups.”
“Participants were asked to allocate each of the 87 BCTs to one or more of the 14 theoretical domain(s), giving a confidence rating for each allocation (from 1 = not at all confident to 10 = extremely confident).”
The paper relies on this without support.
Experts' judgements are likely influenced by specific theoretical approaches or cues from particular words, especially those associated with theories that have a longer history.
“One potential limitation of the present study is that it is likely that experts' judgements are influenced by specific theoretical approachesor cues from particular wordsespecially those associated with theories that have a longer history.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The authors improved the quality of BCTTv1 labels and definitions and developed a hierarchical structure of BCTTv1.
“In order to enhance understanding and use of BCTs in BCIs, we have improved the quality of their labels and definitions, and developed a hierarchical structure of BCTTv1.73”
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentt(34) = 0.64reported p > .1 · recomputed p = .526
“t(34) = 0.64, p > .1”
- Consistentt(34) = 0.63reported p > .1 · recomputed p = .533
“t(34) = 0.63, p > .1”
- Consistentt(34) = 0.77reported p > .1 · recomputed p = .447
“t(34) = 0.77, p > .1”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Discussion changes the number of reliably allocated BCTs
MajorThe discussion reports 69 reliably allocated BCTs, whereas the abstract reports 59, including 12 of borderline significance. This changes the reported extent of successful mapping.
“In this 'top-down' task, 69/87 BCTs were reliably allocated to one or more of the TDF domains with a further 12 BCTs having borderline statistical significance.”
“Fifty-nine of the BCTs were reliably allocated to 12 of the 14 theoretical domains; 47 were significant and 12 were of borderline significance.”
Results add 12 borderline BCTs to a total that already includes them
MajorThe results describe 59 reliably allocated BCTs plus a further 12 borderline BCTs. The abstract instead identifies 59 as the total comprising 47 significant and 12 borderline BCTs.
“Within these domains, 59 (68%) of the BCTs were considered to be reliably allocated, with a further 12 (14%) BCTs having borderline statistical significance (p > .05but p < .1)”
“Fifty-nine of the BCTs were reliably allocated to 12 of the 14 theoretical domains; 47 were significant and 12 were of borderline significance.”
Three domain counts disagree with Table 2
MinorThe results give six qualifying BCTs for Goals and Environmental Context and Resources and five for Emotion. Table 2 gives five, five, and four, respectively.
“Goals (6), Environmental Context and Resources (6), Skills (5), Emotion (5)”
“| Goals | 29 | 5 | | Memory, attention and decision | 49 | 0 | | Environmental context and resources | 42 | 5 | | Social influences | 42 | 10 | | Emotion | 44 | 4 |”
Number of frequently used BCTs reliably mapped changes
MinorThe results state that 18 of the 24 most common BCTs were reliably mapped, but the discussion says 17 were clearly grouped.
“Of the 24 most commonly occurring BCTs (see Michie et al., 2013; emboldened in Table 3), 18 (75%) were reliably mapped to seven of the theory domains”
“Of the 24 most frequently identified BCTs in Michie et al. (2013), 17 were clearly grouped into one of the 14 domains”
Habit formation confidence interval is not centered on its mean
MinorThe reported confidence interval has a midpoint of 3.725, not the reported mean of 4.33. A two-sided confidence interval from the stated one-sample t-test would be centered on the mean.
Reported 4.33 · recomputed 3.725
“| Habit formation | 4.33 a | .091 | 1.57 | 5.88 | |”
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,706 · see citing works
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995 · see citing works
Self-citationMichie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., Eccles, M. P., Cane, J., & Wood, C. E. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9486-6 · Cited by 7,629 · see citing works
Self-citationDetermination and Quantification Of Content Validity
LYNN, M. R. (1986) · Nursing Research · doi:10.1097/00006199-198611000-00017 · Cited by 6,775 · see citing works
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884 · see citing works
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485 · cited 1× · see citing works
“…use, condom use, and changing professional behaviour) and for use across behavioural domains (Abraham, Good, Warren, Huedo-Medina, & Johnson, 2011; Ivers et al., 2012; Lorencatto, West, & Michie, 2012; Michie, Hyder, Walia, & West, 2011; Michie, Whittington, et al., 2012; Michie,…”
Actual causes of death in the United States
McGinnis, J. M. (1993) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1993.03510180077038 · Cited by 5,480 · see citing works
Actual Causes of Death in the United States, 2000
Mokdad, A. H. (2004) · JAMA · doi:10.1001/jama.291.10.1238 · Cited by 5,211 · see citing works
Reliability and Validity Assessment
Kurian, G. T. (2011) · The Encyclopedia of Political Science · doi:10.4135/9781608712434.n1341 · Cited by 5,045 · see citing works
Cane, J., O’Connor, D., & Michie, S. (2012) · Implementation Science · doi:10.1186/1748-5908-7-37 · Cited by 4,888 · cited 3× · see citing works
“Materials Participants sorted BCTs into the 14 domains specified in the revised version of the TDF (Cane et al., 2012): Knowledge, Skills, Social/Professional Role and Identity, Beliefs about Capabilities, Optimism, Beliefs about Consequences, Reinforcement, Intentions, Goals, Table 1.”
BackgroundMethodInfluentialSelf-citationA sharper Bonferroni procedure for multiple tests of significance
HOCHBERG, Y. (1988) · Biometrika · doi:10.1093/biomet/75.4.800 · Cited by 4,829 · see citing works
Making psychological theory useful for implementing evidence based practice: a consensus approach
Michie, S. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.011155 · Cited by 3,440 · see citing works
Self-citationA taxonomy of behavior change techniques used in interventions
Abraham, C., & Michie, S. (2008) · Health Psychology · doi:10.1037/0278-6133.27.3.379 · Cited by 2,525 · see citing works
Self-citationWebb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517 · see citing works
Self-citationBoutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008 · Cited by 2,292 · see citing works
Effective techniques in healthy eating and physical activity interventions: A meta-regression.
Michie, S., Abraham, C., Whittington, C., McAteer, J., & Gupta, S. (2009) · Health Psychology · doi:10.1037/a0016136 · Cited by 2,229 · see citing works
Self-citationMichie, S., Johnston, M., Francis, J., Hardeman, W., & Eccles, M. (2008) · Applied Psychology · doi:10.1111/j.1464-0597.2008.00341.x · Cited by 1,789 · see citing works
Self-citationAvailability versus accessibility of information in memory for words
Tulving, E., & Pearlstone, Z. (1966) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(66)80048-8 · Cited by 1,512 · see citing works
French, S. D., Green, S. E., O’Connor, D. A., McKenzie, J. E., Francis, J. J., Michie, S., Buchbinder, R., Schattner, P., Spike, N., & Grimshaw, J. M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-38 · Cited by 1,338 · see citing works
Self-citationFree, C., Phillips, G., Watson, L., Galli, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001363 · Cited by 1,187 · see citing works
Short-term Memory for Word Sequences as a Function of Acoustic, Semantic and Formal Similarity
Baddeley, A. D. (1966) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640746608400055 · Cited by 922 · see citing works
16. The fraction of cancer attributable to lifestyle and environmental factors in the UK in 2010
Parkin, D. M., Boyd, L., & Walker, L. C. (2011) · British Journal of Cancer · doi:10.1038/bjc.2011.489 · Cited by 816 · see citing works
Vollmar, H. C., Mayer, H., Ostermann, T., Butzlaff, M. E., Sandars, J. E., Wilm, S., & Rieger, M. A. (2010) · Implementation Science · doi:10.1186/1748-5908-5-1 · Cited by 693 · see citing works
Davies, P., Walker, A. E., & Grimshaw, J. M. (2010) · Implementation Science · doi:10.1186/1748-5908-5-14 · Cited by 619 · see citing works
Theories and techniques of behaviour change: Developing a cumulative science of behaviour change
Michie, S., & Johnston, M. (2012) · Health Psychology Review · doi:10.1080/17437199.2012.654964 · Cited by 522 · see citing works
Self-citationDombrowski, S. U., Sniehotta, F. F., Avenell, A., Johnston, M., MacLennan, G., & Araújo-Soares, V. (2012) · Health Psychology Review · doi:10.1080/17437199.2010.513298 · Cited by 504 · see citing works
Self-citationMichie, S., Hyder, N., Walia, A., & West, R. (2011) · Addictive Behaviors · doi:10.1016/j.addbeh.2010.11.016 · Cited by 459 · see citing works
Self-citationImplementation of the CALM intervention for anxiety disorders: a qualitative study
Curran, G. M., Sullivan, G., Mendel, P. J., Craske, M. G., Sherbourne, C. D., Stein, M. B., McDaniel, A., & Roy‐Byrne, P. (2012) · Implementation Science · doi:10.1186/1748-5908-7-14 · Cited by 349 · see citing works
Michie, S., Abraham, C., Eccles, M. P., Francis, J. J., Hardeman, W., & Johnston, M. (2011) · Implementation Science · doi:10.1186/1748-5908-6-10 · Cited by 301 · see citing works
Self-citationIdentification of behaviour change techniques to reduce excessive alcohol consumption
Michie, S., Whittington, C., Hamoudi, Z., Zarnani, F., Tober, G., & West, R. (2012) · Addiction · doi:10.1111/j.1360-0443.2012.03845.x · Cited by 288 · see citing works
Self-citationHardeman, W., Griffin, S., Johnston, M., Kinmonth, A., & Wareham, N. (2000) · International Journal of Obesity · doi:10.1038/sj.ijo.0801100 · Cited by 283 · see citing works
Self-citationthe Canada PRIME Plus Team, Patey, A. M., Islam, R., Francis, J. J., Bryson, G. L., & Grimshaw, J. M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-52 · Cited by 237 · see citing works
Francis, J. J., Stockton, C., Eccles, M. P., Johnston, M., Cuthbertson, B. H., Grimshaw, J. M., Hyde, C., Tinmouth, A., & Stanworth, S. J. (2009) · British Journal of Health Psychology · doi:10.1348/135910708x397025 · Cited by 230 · see citing works
Self-citationTaylor, N., Conner, M., & Lawton, R. (2012) · Health Psychology Review · doi:10.1080/17437199.2010.533441 · Cited by 223 · see citing works
West, R., Walia, A., Hyder, N., Shahab, L., & Michie, S. (2010) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntq074 · Cited by 165 · see citing works
Self-citationthe Canada PRIme Plus Team, Bussières, A., Patey, A. M., Francis, J., Sales, A. E., & Grimshaw, J. (2012) · Implementation Science · doi:10.1186/1748-5908-7-82 · Cited by 143 · see citing works
Dyson, J., Lawton, R., Jackson, C., & Cheater, F. (2011) · Journal of Infection Prevention · doi:10.1177/1757177410384300 · Cited by 142 · see citing works
Beenstock, J., Sniehotta, F. F., White, M., Bell, R., Milne, E. M., & Araujo-Soares, V. (2012) · Implementation Science · doi:10.1186/1748-5908-7-36 · Cited by 138 · see citing works
Dixon, D., Johnston, M., McQueen, M., & Court-Brown, C. (2008) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-9-114 · Cited by 135 · see citing works
Self-citationIdentifying Evidence-Based Competences Required to Deliver Behavioural Support for Smoking Cessation
Michie, S., Churchill, S., & West, R. (2011) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9235-z · Cited by 126 · see citing works
Self-citationGeller, E. S., Berry, T. D., Ludwig, T. D., Evans, R. E., Gilmore, M. R., & Clarke, S. W. (1990) · Health Education Research · doi:10.1093/her/5.2.125 · Cited by 110 · see citing works
Specifying Evidence-Based Behavior Change Techniques to Aid Smoking Cessation in Pregnancy
Lorencatto, F., West, R., & Michie, S. (2012) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntr324 · Cited by 85 · see citing works
Self-citationWhat does the chronic pain grade questionnaire measure?
Dixon, D., Pollard, B., & Johnston, M. (2007) · Pain · doi:10.1016/j.pain.2006.12.004 · Cited by 82 · see citing works
Self-citationMcKenzie, J. E., French, S. D., O'Connor, D. A., Grimshaw, J. M., Mortimer, D., Michie, S., Francis, J., Spike, N., Schattner, P., Kent, P. M., et al. (2008) · Implementation Science · doi:10.1186/1748-5908-3-11 · Cited by 77 · see citing works
Self-citationAraújo-Soares, V., McIntyre, T., MacLennan, G., & Sniehotta, F. F. (2009) · Psychology & Health · doi:10.1080/08870440802040707 · Cited by 71 · see citing works
Francis, J. J., Tinmouth, A., Stanworth, S. J., Grimshaw, J. M., Johnston, M., Hyde, C., Stockton, C., Brehaut, J. C., Fergusson, D., & Eccles, M. P. (2009) · Implementation Science · doi:10.1186/1748-5908-4-70 · Cited by 60 · see citing works
Self-citationSemantic cuing and the scale insensitivity of recency and contiguity.
Polyn, S. M., Erlikhman, G., & Kahana, M. J. (2011) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0022475 · Cited by 51 · see citing works
Michie, S., Johnston, M., & Carey, R. (2016) · Encyclopedia of Behavioral Medicine · doi:10.1007/978-1-4614-6439-6_1661-2 · Cited by 50 · see citing works
Self-citationMcKenzie, J. E., O'Connor, D. A., Page, M. J., Mortimer, D. S., French, S. D., Walker, B. F., Keating, J. L., Grimshaw, J. M., Michie, S., Francis, J. J., et al. (2010) · Implementation Science · doi:10.1186/1748-5908-5-86 · Cited by 42 · see citing works
Self-citationAmemori, M., Korhonen, T., Kinnunen, T., Michie, S., & Murtomaa, H. (2011) · Implementation Science · doi:10.1186/1748-5908-6-13 · Cited by 34 · see citing works
Self-citationMichie, S., Free, C., & West, R. (2012) · The Journal of Smoking Cessation · doi:10.1017/jsc.2012.12 · Cited by 31 · see citing works
Self-citationHobbs, L., Campbell, R. J., Hildon, Z. J., & Michie, S. (2011) · UCL Discovery (University College London) · Cited by 12 · see citing works
Self-citationChadwick, P., & Benelam, B. (2013) · Nutrition Bulletin · doi:10.1111/nbu.12013 · Cited by 6 · see citing works
Hansen, B. C. (1985) · Research in Nursing & Health · doi:10.1002/nur.4770080120 · Cited by 5 · see citing works
Johnston, M., Michie, S. G., Abraham, C., et al. (2022) · Figshare · Cited by 2 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 2
- 10.1080/17437199.2012.654964 · DOI · Paper page
- Michie S., 2013, Encyclopaedia of behavioral medicine, 182
Cited by
Sorted by citations
Atkins, L., Francis, J., Islam, R., O’Connor, D., Patey, A., Ivers, N., Foy, R., Duncan, E. M., Colquhoun, H., Grimshaw, J. M., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0605-9 · Cited by 3,819 · see citing works
“Guidance on identifying behaviour change techniques [7, 42] and designing broader intervention strategies [43].”
BackgroundSelf-citationMichie, S., Wood, C. E., Johnston, M., Abraham, C., Francis, J. J., & Hardeman, W. (2015) · Health Technology Assessment · doi:10.3310/hta19990 · Cited by 680 · see citing works
Self-citationTeixeira, P. J., Marques, M. M., Silva, M. N., Brunet, J., Duda, J. L., Haerens, L., La Guardia, J., Lindwall, M., Lonsdale, C., Markland, D., et al. (2020) · Motivation Science · doi:10.1037/mot0000172 · Cited by 528 · see citing works
Self-citationMichie, S., Carey, R. N., Johnston, M., Rothman, A. J., de Bruin, M., Kelly, M. P., & Connell, L. E. (2018) · Annals of Behavioral Medicine · doi:10.1007/s12160-016-9816-6 · Cited by 475 · see citing works
Self-citationSagar-Ouriaghli, I., Godfrey, E., Bridge, L., Meade, L., & Brown, J. S. L. (2019) · American Journal of Men’s Health · doi:10.1177/1557988319857009 · Cited by 274 · see citing works
Smartphone Apps to Support Self-Management of Hypertension: Review and Content Analysis
Alessa, T., Hawley, M. S., Hock, E. S., & de Witte, L. (2019) · JMIR mHealth and uHealth · doi:10.2196/13645 · Cited by 170 · see citing works
Steinmo, S., Fuller, C., Stone, S. P., & Michie, S. (2015) · Implementation Science · doi:10.1186/s13012-015-0300-7 · Cited by 119 · see citing works
Self-citationVézina-Im, L.-A., Beaulieu, D., Bélanger-Gravel, A., Boucher, D., Sirois, C., Dugas, M., & Provencher, V. (2017) · Public Health Nutrition · doi:10.1017/s1368980017000076 · Cited by 106 · see citing works
Craig, L. E., McInnes, E., Taylor, N., Grimley, R., Cadilhac, D. A., Considine, J., & Middleton, S. (2016) · Implementation Science · doi:10.1186/s13012-016-0524-1 · Cited by 87 · see citing works
Cahir, C., Guinan, E., Dombrowski, S. U., Sharp, L., & Bennett, K. (2015) · Patient Education and Counseling · doi:10.1016/j.pec.2015.05.013 · Cited by 84 · see citing works
Issues for eHealth in Psychiatry: Results of an Expert Survey
Nicholas, J., Huckvale, K., Larsen, M. E., Basu, A., Batterham, P. J., Shaw, F., & Sendi, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6957 · Cited by 34 · see citing works
Li, M., Liu, S., Yu, B., Li, N., Lyu, A., Yang, H., He, H., Zhang, N., Ma, J., Sun, M., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/63209 · Cited by 12 · see citing works
“We used the framework of potential strategies (Multimedia Appendix 3) based on behavior change techniques [39] and behavior strategies [30].”
Rosário, F., Vasiljevic, M., Pas, L., Fitzgerald, N., & Ribeiro, C. (2019) · Family Practice · doi:10.1093/fampra/cmy062 · Cited by 11 · see citing works
Chen, Y.-T., Lehman, M., Van Denend, T., Kish, J., Wu, Y., Preissner, K., Plow, M., & Packer, T. L. (2025) · Journal of Medical Internet Research · doi:10.2196/58543 · Cited by 3 · see citing works
“In this review, we used the 16-cluster definition developed by the BCT Taxonomy v1 authors to code the strategies used to facilitate clients’ behavior change [35].”
- Authors
- Cane, J., Richardson, M., Johnston, M., Ladha, R., & Michie, S.
- Affiliations
- University of Kent (GB)
- King's College London (GB)
- University of Aberdeen (GB)
- University College London (GB)
- Corresponding author
- Cane, James
- Venue
- British Journal of Health Psychology
- Publisher
- Wiley
- Published
- 2014-05-12
- Volume
- 20
- Issue
- 1
- Pages
- 130-150
- ISSN
- 1359-107X (ISSN-L)
- 2044-8287
- OpenAlex
- W1973291291
- Semantic Scholar
- 2073cbc177dda37162e6a9e5d82ddda9903ceca1
- Cited by
- 376
- References
- 55
- Citations by year
- 2026: 18 · 2025: 21 · 2024: 35 · 2023: 26 · 2022: 44 · 2021: 64 · 2020: 60 · 2019: 31 · 2018: 17 · 2017: 25 · 2016: 19 · 2015: 13 · 2014: 3
- FWCI
- 30.96
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- British Journal of Health Psychology (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Create (Canterbury Christ Church University) (acceptedVersion)
- Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
- Funders
- Medical Research Council Health Service Research Collaboration (G0901474)
- Topics
- Social Sciences › Psychology › Applied Psychology › Behavioral Health and Interventions
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Keywords
- behaviour change techniques, Behaviour Change Technique Taxonomy, Theoretical Domains Framework, reward and punishment
- MeSH terms
- Adult, Aged, Australia, Behavior Therapy, Cues, Female, United Kingdom, Humans, Italy, Male, Middle Aged, Netherlands, New Zealand, Reward, United States, Health Behavior, Cluster Analysis, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review