A taxonomy of behaviour change methods: an Intervention Mapping approach

Probably not a substantial claim: may not pass S4 (based).

Theory-based methods tend to disappear when translated into actual materials and messages.

“The situation commonly encountered in the ‘real world’ of intervention development (possibly as compared to a tightly controlled research development situation) is that theory-based methods tend to disappear in translation.”

May combine two claims.

Coding taxonomies contain effective, ineffective, and possibly counter-effective behaviour change methods.

“This means that although these taxonomies contain effective behaviour change methods (techniques), they also contain ineffective methods, and may even contain counter-effective methods.”

• cites Michie, Johnson, & Johnston, 2015Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Goal setting is very effective only when the goal is challenging and acceptable to the actor.

“As a second example, goal setting can be a very effective method, but only when the goal is challenging as well as acceptable for the actor.”

Probably not a substantial claim: may not pass S2 (checkable).

Without hypothesised determinants, a reader cannot judge whether chosen theory-based change methods are correct.

“With no determinants hypothesised, it is impossible for a reader to judge whether the theory-based change methods chosen to influence behaviour are the correct ones.”

• AssumptionRests on an assumption: Scientific literature commonly includes no or only cursory descriptions of the determinants targeted by behaviour change interventions.

Probably not a substantial claim: may not pass S2 (checkable).

Taxonomies of behaviour change methods must distinguish targeted determinants, practical applications, and the theory-based methods they embody.

“Thus, taxonomies of methods of behaviour change must distinguish the specific determinants that are targeted, practical, specific applications, and the theory-based methods they embody.”

May combine two claims.

Implementation intentions are very effective when properly applied, but violating the pre-existing intention parameter greatly reduces or eliminates effectiveness.

“A third classic example is provided by the method implementation intentions. While very effective when properly applied, violation of its parameter for effectiveness (a pre-existing intention to perform the behaviour) greatly reduces or eliminates this effectiveness.”

May combine two claims.

Environmental conditions are usually not under the direct control of at-risk individuals; they are controlled by decision-makers and external agents.

“Environmental conditions are not likely to be under the direct control of the individuals at risk for the health problem. They are controlled by decision-makers, external agents such as peers, teachers, managers, and other gatekeepers.”

• cites Kok et al., 2008Not checked yet

  Not checked in the free run.

May combine two claims.

In a development taxonomy, methods may vary in specificity and may encompass each other.

“A consequence is that in a development taxonomy, methods may vary in their level of specificity, and may even encompass each other.”

Classified as probably not a substantial claim. The quote only partly states this claim.

Using TIDieR may often still produce descriptions that do not make clear which methods were selected to target determinants and beliefs.

“which methods were chosen to target these determinants and beliefs”

May combine two claims.

Fear appeals are effective only when the at-risk population has high self-efficacy and may be counter-effective when efficacy is low.

“Finally, fear appeals are only effective when the at-risk population has high (self-)efficacy and they may be counter effective when efficacy is low (Peters, Ruiter, & Kok, 2013).”

• cites Peters, Ruiter, & Kok, 2013Not checked yet

  Not checked in the free run.

Classified as probably not a substantial claim.

The examples and level of detail in TIDieR indicate that its authors do not intend the second, third, and fourth checklist items to cover targeted beliefs, determinants, methods, applications, and parameters.

“However, the nature and level of detail of the information in the examples provided implies that this is not how the authors envision these checklist items (Hoffmann et al., 2014).”

• cites Hoffmann et al., 2014Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

TIDieR is a recently proposed CONSORT extension that extends item five of the CONSORT statement.

“Very recently, a new CONSORT extension was proposed: this checklist and guidance, the Template for Intervention Description and Replication (TIDieR), extends item five of the CONSORT statement (Hoffmann et al., 2014).”

• cites Hoffmann et al., 2014Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Parameters for effectiveness can change as new literature is published.

“It is important to note that these parameters for effectiveness are subject to change as new literature is published.”

May combine two claims.

The CONSORT family has nine official extensions and provides health promotion researchers only with a non-pharmacologic interventions extension, whose checklist covers treatment details, tailoring, standardisation, and protocol adherence.

“The CONSORT family now numbering nine official extensions (http://consort-statement.org/extensions) only offers ‘non-pharmacologic interventions’ to health promotion researchers, with checklist items regarding ‘details of the treatment’, tailoring, standardisation, and adherence to the protocol (Boutron, Moher, Altman, Schulz, & Ravaud, 2008).”

• cites Boutron, Moher, Altman, Schulz, & Ravaud, 2008Not checked yet

  Not checked in the free run.

Classified as probably not a substantial claim. May combine two claims.

Such a coding procedure would yield a list of methods used, targeted determinants, methods matched to determinants, effectiveness parameters, and applications.

“Such a coding procedure would yield not only a list of behaviour change methods used in an intervention, but a description of targeted determinants (and preferably beliefs or change objectives), behaviour change methods matched to those determinants, parameters for effectiveness for those methods, and the applications that together make up the intervention.”

Probably not a substantial claim: may not pass S2 (checkable).

A shared vocabulary would greatly enhance reporting of intervention descriptions and evaluations in the literature according to reporting guidelines.

“A shared vocabulary would also greatly enhance reporting of intervention descriptions and evaluations in the literature conform reporting guidelines.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

These methods come from psychological theory, and theories codify accumulated empirical evidence.

“Notwithstanding this urgent need for more research, note that these methods are derived from psychological theory, and theories in themselves are a codification of an accumulation of empirical evidence.”

Probably not a substantial claim: may not pass S2 (checkable).

The more extensive vocabulary of the IM taxonomy is valuable for describing intervention developers' reasoning and choices in detail.

“In such coding efforts, the more extensive vocabulary afforded by the IM taxonomy is valuable in describing intervention developers' reasoning and choices in sufficient detail.”

The quote only partly states this claim.

Using TIDieR may often still produce descriptions that do not make clear which practical applications the methods were translated into.

“to which practical applications these methods were translated”

Classified as probably not a substantial claim.

A behaviour change method must be capable of changing the determinant it targets in order to be effective.

“(2) it must be able to change that determinant”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Risk perception is a specific part of attitude.

“Risk perception in turn is a specific part of attitude.”

Probably not a substantial claim: may not pass S4 (based).

A behaviour change method must target a determinant that predicts behaviour in order to be effective.

“For a behaviour change method to be effective: (1) it must target a determinant that predicts behaviour”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

Both types of taxonomies can be developed further to meet both goals.

“Nonetheless, both types of taxonomies deal with behaviour change, and so both types can be developed further to meet both goals.”

May combine two claims.

The theoretical process behind a method is the same across ecological levels, but its application often differs by target.

“The theoretical process behind the method is the same for all levels (see Figure 1 in the supplementary materials or at http://osf.io/sqtuz); however, often the application of the method is somewhat different, depending on the target.”

• cites Figure 1Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

In the recommended table, the last column matches the third TIDieR item, while the first three columns cover the second and possibly the fourth TIDieR items.

“Note that the last column of this table corresponds to the third item in the TIDieR checklist, while the first three cover the second and possibly fourth items.”

Classified as probably not a substantial claim.

Theory-based methods and practical applications are distinct constructs.

“explicated the related distinction between theory-based methods and practical applications”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Distinguishing different aspects of an intervention makes coding easier and more accurate, and the resulting coding is more sensitive and specific, creating more powerful predictors or outcomes.

“This distinction of the different aspects of a behaviour change intervention makes coding easier and more accurate: furthermore, the resulting coding is more sensitive and specific, creating more powerful predictors, or study outcomes.”

Probably not a substantial claim: may not pass S2 (checkable).

There is still room to improve reporting for behaviour change interventions.

“At the same time, there appears to remain room for improvement when it comes to behaviour change interventions.”

• AssumptionRests on an assumption: Intervention descriptions have lagged behind other aspects of trial reporting.

Probably not a substantial claim: may not pass S3 (load-bearing).

Methods described for one determinant may sometimes be used for other determinants.

“Methods described for one determinant may sometimes be used for other determinants as well (e.g., Elaboration).”

Probably not a substantial claim: may not pass S2 (checkable).

Coding with a taxonomy that acknowledges behaviour change dynamics and provides mutually exclusive, reliably applicable categories has clear advantages.

“Coding with a taxonomy that both acknowledges the dynamics of behaviour change and provides mutually exclusive, reliably applicable categories has clear advantages.”

Probably not a substantial claim: may not pass S2 (checkable).

Working towards integration of coding and development taxonomies seems beneficial.

“At the same time, working towards such integration seems beneficial.”

May combine two claims.

Determinants are not independent; knowledge is the basis for many other determinants such as risk perception, attitudes, and skills.

“The various determinants are not independent of each other; we will start with knowledge as the basis for many other determinants, such as risk perception, attitudes, and skills.”

• cites Bartholomew et al., 2011Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S2 (checkable).

Using one system for intervention development, description, and coding for meta-analyses will provide a shared vocabulary that facilitates scientific communication.

“Finally, using one system for both intervention development and description on the one hand and coding for meta-analyses on the other hand will provide a shared vocabulary that facilitates scientific communications.”

May combine two claims.

Coding taxonomies are unfit for intervention development, and the IM taxonomy is unfit for coding in its current form.

“In the same way that coding taxonomies are unfit for intervention development, the taxonomy we just described is unfit for coding in its current form.”

Probably not a substantial claim: may not pass S2 (checkable).

Taxonomies of behaviour change methods must distinguish the specific determinants targeted, the practical applications, and the theory-based methods those applications embody.

“Thus, taxonomies of methods of behaviour change must distinguish the specific determinants that are targeted, practical, specific applications, and the theory-based methods they embody.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

Work remains to integrate coding and development approaches.

“These differences mean that there is still work to be done to integrate these two approaches.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Before recent guidelines, reviewers accepted a minimal set of intervention details covering who delivered it, its format, setting, recipients, intensity, duration, and fidelity, and this set was endorsed by Society for Behavioral Medicine members the following year.

“Previously, frustrated reviewers had a very low bar – provider, format, setting, recipient, intensity, duration, and fidelity (Whitlock, Orleans, Pender, & Allan, 2002) – which was endorsed by Society for Behavioral Medicine members the next year (Davidson et al., 2003).”

• cites Whitlock, Orleans, Pender, & Allan, 2002Not checked yet

  Not checked in the free run.

• cites Davidson et al., 2003Not checked yet

  Not checked in the free run.

Classified as probably not a substantial claim. The quote only partly states this claim.

Using TIDieR may often still produce descriptions that do not make clear how parameters for effectiveness, population characteristics, and context were respected during translation.

“how the parameters for effectiveness, population characteristics, and context were respected in this translation.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Three of the twelve TIDieR checklist items can be interpreted as addressing aspects of behaviour change.

“Of the 12 items in the TIDieR checklist, 3 can be taken to deal with the aspects of behaviour change as just described.”

• cites Hoffmann et al., 2014Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

The strength of evidence for each method varies, new methods can emerge, and evidence can accumulate that some methods are better avoided.

“Also, the strength of the evidence for each method varies, new methods can emerge, and evidence can accumulate that certain methods are better avoided (e.g., threatening communication in populations low in self-efficacy).”

Classified as probably not a substantial claim. May combine two claims.

Coding terse intervention descriptions can indicate which methods were used, whether they matched determinants, and whether parameters were preserved, but much information is lost.

“To code the terse intervention descriptions that are currently frequently encountered can provide some indication as to which behaviour change methods were used, whether these matched the targeted determinants, and whether the parameters for effectiveness were preserved during the translation to applications; but much information will have been lost.”

Probably not a substantial claim: may not pass S3 (load-bearing).

CONSORT reporting guidelines have substantially improved the completeness with which randomized controlled trials are reported.

“have had substantial impact on the completeness of reporting of study reports, that is, randomised controlled trials (Turner, Shamseer, Altman, Schulz, & Moher, 2012; Turner, Shamseer, Altman, Weeks, et al., 2012).”

• cites Turner, Shamseer, Altman, Schulz, & Moher, 2012Not checked yet

  Not checked in the free run.

• cites Turner, Shamseer, Altman, Weeks, et al., 2012Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Individual behaviour change is almost always embedded in environmental levels, so individual-level methods need to be complemented with environmental-level methods.

“It is important for health promotion planners to realise that individual behaviour change is almost always embedded in one or more environmental levels and that methods for individual change (Tables 1–8) need to be complemented with methods for change at those environmental levels (Tables 9–14).”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Reporting a minimal set of intervention characteristics can substantially improve the quality of meta-analyses and other literature syntheses.

“Specifying these characteristics can greatly enhance the quality of our meta-analyses and other literature syntheses.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Environmental-level methods are often bundles of other methods, and many methods are tailored.

“as explained before, methods on the environmental level are often bundles of other methods; and many methods are tailored (see e.g., Mullen, Green, & Persinger, 1985).”

• cites Mullen, Green, & Persinger, 1985Not checked yet

  Not checked in the free run.

Classified as probably not a substantial claim.

A behaviour change method must be translated into a practical application that preserves effectiveness parameters and fits the target population, culture, and context in order to be effective.

“(3) it must be translated into a practical application in a way that preserves the parameters for effectiveness and fits with the target population, culture, and context.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

Providing arguments always entails persuasive communication.

“For example, providing arguments always entails persuasive communication;”

Probably not a substantial claim: may not pass S3 (load-bearing).

A recent knowledge translation initiative illustrates the need for a unified vocabulary.

“A recent initiative to establish such a vocabulary for knowledge translation illustrates the need for such a unified vocabulary (Colquhoun et al., 2014).”

• cites Colquhoun et al., 2014Not checked yet

  Not checked in the free run.

May combine two claims.

The IM taxonomy of behaviour change methods is not new; IM was originally created for intervention development, and its potential as a coding taxonomy was not immediately recognized.

“although IM and its taxonomy of behaviour change methods are not in fact new (Bartholomew et al., 1998), because IM was originally developed as a tool for intervention development, this potential was not immediately apparent (Schaalma & Kok, 2009).”

• cites Bartholomew et al., 1998Not checked yet

  Not checked in the free run.

• cites Schaalma & Kok, 2009Not checked yet

  Not checked in the free run.