The DOI matches its Crossref record; 83 of the 84 references it cites were found in a registry or an index; none of the 34 sources its claims cite is checked for support yet.
Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence
Open accessAbstract
BACKGROUND: In electronic health (eHealth) evaluations, there is increasing attention for studying the actual usage of a technology in relation to the outcomes found, often by studying the adherence to the technology. On the basis of the definition of adherence, we suggest that the following three elements are necessary to determine adherence to eHealth technology: (1) the ability to measure the usage behavior of individuals; (2) an operationalization of intended use; and (3) an empirical, theoretical, or rational justification of the intended use. However, to date, little is known on how to operationalize the intended usage of and the adherence to different types of eHealth technology. OBJECTIVE: The study aimed to improve eHealth evaluations by gaining insight into when, how, and by whom the concept of adherence has been used in previous eHealth evaluations and finding a concise way to operationalize adherence to and intended use of different eHealth technologies. METHODS: A systematic review of eHealth evaluations was conducted to gain insight into how the use of the technology was measured, how adherence to different types of technologies was operationalized, and if and how the intended use of the technology was justified. Differences in variables between the use of the technology and the operationalization of adherence were calculated using a chi-square test of independence. RESULTS: In total, 62 studies were included in this review. In 34 studies, adherence was operationalized as "the more use, the better," whereas 28 studies described a threshold for intended use of the technology as well. Out of these 28, only 6 reported a justification for the intended use. The proportion of evaluations of mental health technologies reporting a justified operationalization of intended use is lagging behind compared with evaluations of lifestyle and chronic care technologies. The results indicated that a justification of intended use does not require extra measurements to determine adherence to the technology. CONCLUSIONS: The results of this review showed that to date, justifications for intended use are often missing in evaluations of adherence. Evidently, it is not always possible to estimate the intended use of a technology. However, such measures do not meet the definition of adherence and should therefore be referred to as the actual usage of the technology. Therefore, it can be concluded that adherence to eHealth technology is an underdeveloped and often improperly used concept in the existing body of literature. When defining the intended use of a technology and selecting valid measures for adherence, the goal or the assumed working mechanisms should be leading. Adherence can then be standardized, which will improve the comparison of adherence rates to different technologies with the same goal and will provide insight into how adherence to different elements contributed to the outcomes.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This systematic review of 62 eHealth evaluations finds that adherence is often operationalized as “the more use, the better” without an intended-use threshold, and even when a threshold is given, justification is usually missing. The authors argue adherence should be defined against a justified intended use tied to the technology’s goal or assumed working mechanisms.
Key findings
- Of 62 included studies, 34 used Category A (“more use, the better”), 23 provided an intended-use threshold without justification (Category B), and 5 provided a justified threshold (Category C); the abstract reports 6 justified among 28 threshold studies.
- Mental health technologies lagged: 20/31 had Category A operationalizations, while Category C was more equally distributed across mental health, lifestyle, and chronic care.
- Most operationalizations used ≤2 measures (49/62); 10/13 with ≥3 measures were Category A. Adherence to unstructured technologies more often used logins/sessions (P=.03), features accessed/used (P<.001), and time spent (P<.001); structured technologies used modules/lessons completed (P<.001).
- Technologies were mostly Web-based (51/62); 29 were structured, 18 unstructured, and 15 hybrid, with half targeting mental health.
Methods
- Systematic review; searched Scopus, Web of Science, ScienceDirect, and PsycINFO; 7005 records identified, 62 full texts included after title, abstract, and full-text screening.
- Included health-related technologies intended for repeated use, with objective quantifiable usage measures and an adherence operationalization; excluded offline treatment adherence, protocol adherence, simple information-exchange tools, conference abstracts, and unavailable full texts.
- Data were extracted and adherence operationalizations categorized as A/B/C; differences were tested with chi-square test of independence, using Monte Carlo correction when expected counts were low, at alpha .05.
Limitations
- Stated: only studies using adherence as an outcome or explicitly stating a proxy were included, so studies using related terms (nonusage attrition, engagement, drop-out, [non]usage) may have been missed.
- Stated: adherence operationalizations were categorized per study, not per technology, though the same technology could have different operationalizations across studies.
- Evident from the text: the abstract and results differ on the number of justified operationalizations (6 vs 5), and the review is descriptive/categorical without meta-analytic synthesis.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 34 cited sources checked · 0 supported · 0 flagged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Most Category A operationalizations contain a measure for the number of modules that the users accessed or completed (19/34)”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Category C definitions are mostly based on the number of accessed or completed modules (3/5 operationalizations).”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In contrast, the results indicated that justifications of intended use are often based on the goal of the technology and/or the assumed working mechanisms, leading to more focused operationalizations that do not require additional measurements to evaluate adherence to the technology.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Principal Findings
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In 34 studies, adherence was operationalized as “the more use, the better,””
- Also stated in: § Operationalization of the Adherence Definition · plain
“Out of the 62 included articles, 34 reported adherence only in terms of how often the technology was used (Category A operationalization)”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Abstract > Results
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Also stated in: § Operationalization of the Adherence Definition · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Out of these 28, only 6 reported a justification for the intended use.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Abstract > Results
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and the number of logins or sessions (4/23).”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“However, to date, little is known on how to operationalize the intended usage of and the adherence to different types of eHealth technology.”
- Also stated in: § Determining Adherence · plain
“However, to date, little is known about how to operationalize the intended usage of and thus the adherence to different types of eHealth technology.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Abstract > Background
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Also stated in: § Determining Adherence · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Most Category B operationalizations contain the number of days, weeks, or months that people used the technology (11/23)”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The number of logins and the number of days, weeks, or months that people used the technology were used in 2 out of 5 operationalizations.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“whereas most Category C operationalizations consist of one or two measures.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Principal Findings
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes
- Probably not a substantial claim. 28
- It may state two separate claims as one. 20
- The quote only partly states this claim. 2
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Almost half of the technologies (29/62) were structured technologies, 18 were unstructured technologies, and 15 had a hybrid nature.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Technology Characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Most of the structured technologies (17/29) and almost all hybrid technologies (12/15) were aimed at improving mental health (P<.001).”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Technology Characteristics
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The technologies described in most of the articles are Web-based (51/62).”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Technology Characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Adherence to unstructured technologies was mostly operationalized using the number of logins or sessions (P=.03), the number of features accessed or used (P<.001), and the time spent using the technology (P<.001).”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Technology Characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the number of accessed or completed modules (8/23)”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In total, 62 studies were included in this review.”
- Also stated in: § Study Selection · plain
“After screening of the titles, abstracts, and full texts, 62 full texts were included in this review.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Abstract > Results
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Also stated in: § Study Selection · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Half of all included articles reported adherence to mental health technologies.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Technology Characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Carolan et al describe a protocol for a study to be conducted to understand the optimum adherence to the technology in relation to the outcomes [78].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
What the sources say
- Not checked yetcites [78] source
Strength:plain· not yet calibratedTests✗ Asserted: fails✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The authors may not put it forward as true. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The included Category C operationalizations provided justification in various ways.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Beatty et al considered a user to be highly adherent when a therapeutic dose of 66% of the intervention was received [76]. This threshold for a therapeutic dose was obtained from previous studies.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
What the sources say
- Not checked yetcites [76] source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“In the study by Mertens et al, technology use was represented in relation to medication use, and users were therefore seen as adherent when the technology was used in accordance with the recommendations for medication use [77].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
What the sources say
- Not checked yetcites [77] Mertens, A, 2017, Advances in Human Factors and Ergonomics in Healthcare source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“In the study by Zeng et al, the technology consisted of different elements that were all evaluated as effective in other studies [75]. Users were considered adherent if they used all elements.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
What the sources say
- Not checked yetcites [75] source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The majority of the technologies described in these studies were structured or hybrid Web-based interventions targeting mental health (mostly cognitive behavioral therapy [CBT] interventions) or unstructured technologies for lifestyle support.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Principal Findings
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“half of all operationalizations are based on the assumption of “the more use, the better” and do not include a threshold for intended use.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Principal Findings
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“eHealth evaluations often fail to demonstrate the dose-response relationship (the usage that is minimally needed to experience certain effects) or simply define it as “the more use, the better.””
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the results of this review show that the operationalization of intended use is mostly based on the assumption of “the more use, the better” and that when a threshold of intended use is provided, justification is often missing.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Conclusions
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and that there should be a threshold for intended use.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Principal Findings
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Therefore, it can be concluded that adherence to eHealth technology is an underdeveloped and often improperly used concept in the existing body of literature.”
- Also stated in: § Conclusions · plain
“it can be concluded that adherence to eHealth technology is an underdeveloped and often improperly used concept in the existing body of literature.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Abstract > Conclusions
Load-bearingStrength:boosted· not yet calibratedTests✓ Asserted: passes? Checkable: unclear✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Also stated in: § Conclusions · plain
In the paper
“This is unexpected because the majority of mental health technologies is based on (principles of) CBT, which is the most studied treatment for depression and has proven effective in many studies [79].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Principal Findings
What the sources say
- Not checked yetcites [79] Cuijpers, P, 2013, Can J Psychiatry source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, such measures do not meet the definition of adherence and should therefore be referred to as the actual usage of the technology.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Abstract > Conclusions
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
In the paper
“On the basis of the definition of adherence, we suggest that the following three elements are necessary to determine adherence to eHealth technology: (1) the ability to measure the usage behavior of individuals; (2) an operationalization of intended use; and (3) an empirical, theoretical, or rational justification of the intended use.”
- Also stated in: § Determining Adherence · hedged
“To summarize, based on the definition of adherence, we suggest that the following three elements are necessary to determine adherence to eHealth technology: (1) the ability to measure the usage behavior of individuals; (2) an operationalization of intended use; and (3) an empirical, theoretical, or rational justification of the intended use.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Abstract > Background
What the sources say
- Not checked yetcites [10] Sabaté, E, 2003, Adherence to long-term therapies: evidence for action
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
- Also stated in: § Determining Adherence · hedged
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“According to these definitions, the intended use is thus the minimum use to establish adherence.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Introduction > Adherence to eHealth Technologies
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“An important reason for the lack of justifications for the intended use of eHealth technologies might be that there is a lack of knowledge regarding the working mechanisms of technology-based applications [8].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
What the sources say
- Not checked yetcites [8] source
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Moreover, definitions of engagement usually incorporate the more subjective attributes of challenge, positive affect, endurability, and aesthetic and sensory appeals [12], whereas adherence is mostly based on measures for usage behavior.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Introduction > Adherence to eHealth Technologies
What the sources say
- Not checked yetcites [12] SmithWPlodererBWadleyGWebberSBorlandRTrajectories of Engagement and Disengagement with a Story-Based Smoking Cessation App20172017 CHI Conference on Human Factors in Computing SystemsMay 6-11, 2017Denver, ColoradoACM304556
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This implies that users do not always have to experience all of the available elements of a technology or have to use the same elements because usage goals may differ across users as well.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Introduction > Determining Adherence
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“However, a technology can be designed for multiple target groups and, depending on the individual user goals and the desired outcomes, technology can be used in many different ways in terms of the features that are used, as well as the frequency, time, and place of use [13,14].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Introduction > Determining Adherence
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“Kaushal and Rhodes found that exercising for at least four times per week for 6 weeks is a minimal requirement for establishing exercise habits [81].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
What the sources say
- Not checked yetcites [81] source
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“the intended use or the “therapeutic dose” can be justified just as well using existing guidelines for healthy living and medication use [74,77] or using previous research regarding other technologies [75,76].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
What the sources say
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A justified threshold for intended use in accordance with the goal of the technology provides information for a concise evaluation of adherence and the working mechanisms of a technology.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Conclusions
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Subsequently, justified operationalization (comprising multidimensional measures or not) can be used to standardize adherence to different eHealth technologies, making it easier to compare the adherence rates of different technologies.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Conclusions
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Previous research has shown that users do not always have to experience all of the elements of a technology and that effective usage patterns might differ across users.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Conclusions
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This approach simplifies the comparison of adherence across technologies with the same goal (eg, improving physical activity) but different technology characteristics (eg, features of the technology, persuasiveness, and user-friendliness) and a different operationalization of intended use.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“this statement is based on Category A operationalizations of adherence where more use is better.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“following this lesson can also be seen as an important precondition for gaining effects from using the intervention.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“adherence and intended use can be defined in many different ways, and it is very possible for different operationalizations to be used for different studies regarding the same technology.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Limitations
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“At the same time, this approach also simplifies the comparison of adherence of different users of a specific technology.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
In the paper
“In turn, the percentage of people who adhered to the intervention can be calculated, making adherence a more objective and standardized concept [1].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
What the sources say
- Not checked yetcites [1] source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“we only included studies that used adherence as an outcome measure or studies that explicitly stated how other outcome measures are used as a proxy for adherence.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Limitations
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“we may have missed relevant studies that formulated the intended use of a technology, but used other related terms for adherence (eg, nonusage attrition, engagement, drop-out, or [non]usage).”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Limitations
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“we defined the categories of adherence operationalizations for every study, instead of every type of technology.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Limitations
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Adherence is a common challenge in web-based interventions (Sieverink et al., 2017), particularly in self-guided interventions (Karyotaki et al., 2015).”
From Efficacy of a web-based psychoeducational intervention, Fex-can sex, for young adult childhood cancer survivors with sexual dysfunction: A randomized controlled trial (2024) · cites this paper as Sieverink et al., 2017
The cited source says what the claim attributes to it.
In the citing paper
“Adherence to internet‐based treatments is measured through various methods, including the number of logins (Sieverink et al. 2017).”
From Internet‐Based Acceptance and Commitment Therapy With Interoceptive Exposure for Panic Disorder: A Randomized Controlled Trial and Working Alliance Analysis. (2026) · cites this paper as Sieverink et al. 2017
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“In addition, even though the completion rate in this study may appear relatively low, 50% seems to be an average adherence rate for eHealth interventions [69], and program completion rates at 20% to 40% are not uncommon [70].”
From Short-Term Findings From Testing EPIO, a Digital Self-Management Program for People Living With Chronic Pain: Randomized Controlled Trial (2023) · cites this paper as [70]
Experimental — accuracy not yet measuredIn the citing paper
“The systematic review on usage-based adherence to eHealth interventions conducted by Sieverink et al reviewed 62 papers, of which 7 were on smartphone-based interventions [17]. Of those 7 papers, 5 were published after 2016, and the other 2 were both published in 2013.”
From A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review (2019) · cites this paper as [17]
In the citing paper
“The authors conclude that a limited but deliberate set of only one of 2 different indicators in accordance with the goal of the technology is sufficient to operationalize adherence.”
From A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review (2019) · cites this paper as [17]
In the citing paper
“In their systematic review, Sieverink et al found that over half of all reviewed studies measured adherence to eHealth interventions using a single analytic indicator, and a quarter used 2 indicators [17].”
From A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review (2019) · cites this paper as [17]
In the citing paper
“On reviewing how researchers were operationalizing adherence, they found that the majority reported adherence only in terms of how an intervention was used.”
From A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review (2019) · cites this paper as [17]
In the citing paper
“Our identification of the number of measures recorded on an app as an analytic indicator of engagement deviates from previous research by Sieverink et al on usage and adherence to eHealth interventions [17], which found no evidence that researchers were operationalizing constructs in this way.”
From A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review (2019) · cites this paper as [17]
In the citing paper
“The outcomes of eHealth self-management interventions seem to depend on patients’ motivation and adherence [7,25,64,67].”
From Digital Self-Management in Support of Patients Living With Chronic Pain: Feasibility Pilot Study (2020) · cites this paper as [67]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Abstract reports six justified studies, but results report five
MinorThe abstract says 6 studies justified their intended-use threshold, whereas the results identify 5 Category C studies. This changes the reported number meeting the paper's justification criterion.
“Out of these 28, only 6 reported a justification for the intended use.”
“and 5 studies reported the intended usage with a justification for this threshold (Category C operationalization) [74-78].”
Category A and B denominator is one too low
MinorThere are 34 Category A and 23 Category B operationalizations, totaling 57 rather than the stated 56.
Reported 56 · recomputed 57
“Furthermore, 48 out of 56 Category A and Category B operationalizations are for Web-based technologies (whether or not in combination with other devices)”
Chronic-care percentage in Category C is incorrect
MinorTable 4 gives one chronic-care study among five Category C studies, which is 20%, not 40%.
Reported 40 · recomputed 20
“| | Chronic care (n=6) | 1 (3) | 4 (17) | 1 (40) |”
Claim of no measure differences conflicts with Table 4
MinorThe discussion says no significant differences were found between the kinds of measures used across the three categories, but Table 4 marks the days/weeks/months measure as significant (aP<.05).
“No significant differences could be found between the kinds of measures that are used for all three levels of operationalizations.”
“| | Number of days/weeks/months (n=19)a | 6 (18) | 11 (48) | 2 (40) |”
Time-spent percentage in Category C is incorrect
MinorTable 4 gives one study using time spent among five Category C studies, which is 20%, not 17%.
Reported 17 · recomputed 20
“| | Time spent (n=14) | 11 (32) | 2 (9) | 1 (17) |”
Smartphone-app count differs between prose and Table 3
MinorThe prose reports five smartphone apps, but Table 3 reports six, distributed as 3 structured, 2 unstructured, and 1 hybrid.
“Furthermore, five are smartphone apps and five are Web-based or smartphone technologies combined with other devices such as wearables.”
“| | Smartphone app (n=6) | 3 (10) | 2 (11) | 1 (7) |”
Citations
Cites
Adherence to Long‐Term Therapies: Evidence for Action
Burkhart, P. V., & Sabaté, E. (2003) · Journal of Nursing Scholarship · doi:10.1111/j.1547-5069.2003.tb00001.x · Cited by 2,526
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308
Self-citationAdherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133
Cuijpers, P., Berking, M., Andersson, G., Quigley, L., Kleiboer, A., & Dobson, K. S. (2013) · The Canadian Journal of Psychiatry · doi:10.1177/070674371305800702 · Cited by 1,066
A Systematic Review of the Impact of Adherence on the Effectiveness of e-Therapies
Donkin, L., Christensen, H., Naismith, S. L., Neal, B., Hickie, I. B., & Glozier, N. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1772 · Cited by 876
Michie, S., Yardley, L., West, R., Patrick, K., & Greaves, F. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7126 · Cited by 865 · cited 3×
“For every technology, a proportion of the users will not use the intervention at all, will stop using the technology after a period, or will not use the available elements of the technology as intended [1,6-8].”
BackgroundZachariae, R., Lyby, M. S., Ritterband, L. M., & O'Toole, M. S. (2016) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2015.10.004 · Cited by 704 · cited 1×
“Although a longer treatment duration is associated with better effects [80], this still implies that users do not necessarily need to finish the complete program to experience reduction of their complaints, and that there should be a threshold for intended use.”
BackgroundCarter, M. C., Burley, V. J., Nykjaer, C., & Cade, J. E. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2283 · Cited by 666
van Ballegooijen, W., Cuijpers, P., van Straten, A., Karyotaki, E., Andersson, G., Smit, J. H., & Riper, H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100674 · Cited by 409
Elbert, N. J., van Os‐Medendorp, H., van Renselaar, W., Ekeland, A. G., Roijen, L. H., Raat, H., Nijsten, T. E. C., & Pasmans, S. G. M. A. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2790 · Cited by 377
Titov, N., Dear, B. F., Johnston, L., Lorian, C., Zou, J., Wootton, B., Spence, J., McEvoy, P. M., & Rapee, R. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062873 · Cited by 364
Beatty, L., & Binnion, C. (2016) · International Journal of Behavioral Medicine · doi:10.1007/s12529-016-9556-9 · Cited by 347
Exercise habit formation in new gym members: a longitudinal study
Kaushal, N., & Rhodes, R. E. (2015) · Journal of Behavioral Medicine · doi:10.1007/s10865-015-9640-7 · Cited by 285
Richardson, C. R., Buis, L. R., Janney, A. W., Goodrich, D. E., Sen, A., Hess, M. L., Mehari, K. S., Fortlage, L. A., Resnick, P. J., Zikmund-Fisher, B. J., et al. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1338 · Cited by 239
Adherence in Internet-based interventions.
(2008) · PubMed Central · Cited by 215
Agile science: creating useful products for behavior change in the real world
Hekler, E. B., Klasnja, P., Riley, W. T., Buman, M. P., Huberty, J., Rivera, D. E., & Martin, C. A. (2016) · Translational Behavioral Medicine · doi:10.1007/s13142-016-0395-7 · Cited by 208
Christensen, H., Griffiths, K., Groves, C., & Korten, A. (2006) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/j.1440-1614.2006.01743.x · Cited by 201
Nijland, N., van Gemert-Pijnen, J. E., Kelders, S. M., Brandenburg, B. J., & Seydel, E. R. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1603 · Cited by 175
Self-citationThe Law of Attrition Revisited
Christensen, H., & Mackinnon, A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.3.e20 · Cited by 161
Mohr, D. C., Duffecy, J., Ho, J., Kwasny, M., Cai, X., Burns, M. N., & Begale, M. J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0070086 · Cited by 158
Neil, A. L., Batterham, P., Christensen, H., Bennett, K., & Griffiths, K. M. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1050 · Cited by 152 · cited 1×
“Out of the 62 included articles, 34 reported adherence only in terms of how often the technology was used (Category A operationalization) [7,18-50].”
BackgroundMoller, A. C., Merchant, G., Conroy, D. E., West, R., Hekler, E., Kugler, K. C., & Michie, S. (2017) · Journal of Behavioral Medicine · doi:10.1007/s10865-016-9818-7 · Cited by 151
Lillevoll, K. R., Vangberg, H. C. B., Griffiths, K. M., Waterloo, K., & Eisemann, M. R. (2014) · BMC Psychiatry · doi:10.1186/1471-244x-14-14 · Cited by 150 · cited 1×
“Out of the 62 included articles, 34 reported adherence only in terms of how often the technology was used (Category A operationalization) [7,18-50].”
BackgroundPredictors of adherence among community users of a cognitive behavior therapy website.
(2008) · PubMed Central · Cited by 142
Neve, M. J., Collins, C. E., & Morgan, P. J. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1640 · Cited by 137 · cited 1×
“Out of the 62 included articles, 34 reported adherence only in terms of how often the technology was used (Category A operationalization) [7,18-50].”
BackgroundAttrition Revisited: Adherence and Retention in a Web-Based Alcohol Trial
Murray, E., White, I. R., Varagunam, M., Godfrey, C., Khadjesari, Z., & McCambridge, J. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2336 · Cited by 134
Beishuizen, C. R., Stephan, B. C., van Gool, W. A., Brayne, C., Peters, R. J., Andrieu, S., Kivipelto, M., Soininen, H., Busschers, W. B., Moll van Charante, E. P., et al. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5218 · Cited by 128
Alfonsson, S., Olsson, E., & Hursti, T. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5352 · Cited by 118
Get with the program: Adherence to a smartphone app for smoking cessation
Zeng, E. Y., Heffner, J. L., Copeland, W. K., Mull, K. E., & Bricker, J. B. (2016) · Addictive Behaviors · doi:10.1016/j.addbeh.2016.07.007 · Cited by 117
Zarski, A.-C., Lehr, D., Berking, M., Riper, H., Cuijpers, P., & Ebert, D. D. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4493 · Cited by 114 · cited 1×
“In 23 studies, the intended usage was described as well (Category B operationalization) [51-73], and 5 studies reported the intended usage with a justification for this threshold (Category C operationalization) [74-78].”
BackgroundExperiences of non-adherence to Internet-delivered cognitive behavior therapy: a qualitative study
Johansson, O., Michel, T., Andersson, G., & Paxling, B. (2015) · Internet Interventions · doi:10.1016/j.invent.2015.02.006 · Cited by 99 · cited 1×
“Out of the 62 included articles, 34 reported adherence only in terms of how often the technology was used (Category A operationalization) [7,18-50].”
BackgroundEl Alaoui, S., Ljótsson, B., Hedman, E., Kaldo, V., Andersson, E., Rück, C., Andersson, G., & Lindefors, N. (2015) · PLOS ONE · doi:10.1371/journal.pone.0124258 · Cited by 98
The Ins and Outs of an Online Bipolar Education Program: A Study of Program Attrition
Nicholas, J., Proudfoot, J., Parker, G., Gillis, I., Burckhardt, R., Manicavasagar, V., & Smith, M. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1450 · Cited by 97
Wanner, M., Martin‐Diener, E., Bauer, G. F., Braun‐Fahrländer, C., & Martin, B. W. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1361 · Cited by 95
Mattila, E., Orsama, A.-L., Ahtinen, A., Hopsu, L., Leino, T., & Korhonen, I. (2013) · JMIR mhealth and uhealth · doi:10.2196/mhealth.2557 · Cited by 93
Kooistra, L. C., Ruwaard, J., Wiersma, J. E., van Oppen, P., van der Vaart, R., van Gemert-Pijnen, J. E. W. C., & Riper, H. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.01.003 · Cited by 92
Kelders, S. M., Bohlmeijer, E. T., & Van Gemert-Pijnen, J. E. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2258 · Cited by 88
Self-citationOpening the Black Box of Electronic Health: Collecting, Analyzing, and Interpreting Log Data
Sieverink, F., Kelders, S., Poel, M., & van Gemert-Pijnen, L. (2017) · JMIR Research Protocols · doi:10.2196/resprot.6452 · Cited by 88
Self-citationAttrition in web-based treatment for problem drinkers
Postel, M. G., de Haan, H. A., ter Huurne, E. D., van der Palen, J., Becker, E. S., & de Jong, C. A. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1811 · Cited by 87
Ho, F. Y., Chung, K., Yeung, W., Ng, T. H., & Cheng, S. K.-W. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.10.002 · Cited by 86
Noone, C., & Hogan, M. (2016) · BMC Psychology · doi:10.1186/s40359-016-0122-7 · Cited by 86
Theoretical Perspectives of Adherence to Web-Based Interventions: a Scoping Review
Ryan, C., Bergin, M., & Wells, J. S. (2018) · International Journal of Behavioral Medicine · doi:10.1007/s12529-017-9678-8 · Cited by 86
Van Gemert-Pijnen, J. E., Kelders, S. M., & Bohlmeijer, E. T. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2991 · Cited by 84 · cited 1×
“It is thus very possible that dose-response relationships might become more apparent when the measures used to operationalize adherence match the goal of the technology [82,83].”
BackgroundSelf-citationJander, A., Crutzen, R., Mercken, L. A. G., Candel, M. J. J. M., & de Vries, H. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4708 · Cited by 75
Do adherence variables predict outcome in an online program for the prevention of eating disorders?
Manwaring, J. L., Bryson, S. W., Goldschmidt, A. B., Winzelberg, A. J., Luce, K. H., Cunning, D., Wilfley, D. E., & Taylor, C. B. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.2.341 · Cited by 73
Alley, S., Jennings, C. A., Plotnikoff, R. C., & Vandelanotte, C. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5664 · Cited by 69
Ware, L. J., Hurling, R., Bataveljic, O., Fairley, B. W., HURST, T. L., Murray, P., Rennie, K. L., Tomkins, C. E., Finn, A., Cobain, M. R., et al. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1108 · Cited by 65
Hadjiconstantinou, M., Byrne, J. L., Bodicoat, D. H., Robertson, N., Eborall, H., Khunti, K., & Davies, M. J. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5991 · Cited by 64
Self-managed eHealth Disease Monitoring in Children and Adolescents with Inflammatory Bowel Disease
Carlsen, K., Jakobsen, C., Houen, G., Kallemose, T., Pærregaard, A., Riis, L. B., Munkholm, P., & Wewer, V. (2017) · Inflammatory Bowel Diseases · doi:10.1097/mib.0000000000001026 · Cited by 63
Reinwand, D. A., Schulz, D. N., Crutzen, R., Kremers, S. P., & de Vries, H. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3932 · Cited by 62
Schulz, A., Stolz, T., Vincent, A., Krieger, T., Andersson, G., & Berger, T. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.07.001 · Cited by 62
Web-based depression treatment: Associations of clients׳ word use with adherence and outcome
van der Zanden, R. A., Curie, K., van Londen, M., Kramer, J., Steen, G. J., & Cuijpers, P. J. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.01.005 · Cited by 61
Kooij, L., Groen, W. G., & van Harten, W. H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7405 · Cited by 59
Strategies for increasing adherence to an online smoking cessation intervention for college students
An, L. C., Perry, C. L., Lein, E., Klatt, C. M., Farley, D. M., Bliss, R., Hennrikus, D. J., Pallonen, U. E., Lando, H. A., Ahluwalia, J. S., et al. (2006) · Nicotine & Tobacco Research · doi:10.1080/14622200601039881 · Cited by 58
van den Berg, S. W., Peters, E. J., Kraaijeveld, J. F., Gielissen, M. F., & Prins, J. B. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2566 · Cited by 53
Graham, A. L., Papandonatos, G. D., Cha, S., Erar, B., Amato, M. S., Cobb, N. K., NIAURA, R. S., & Abrams, D. B. (2016) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntw282 · Cited by 52
Price, M., Gros, D. F., McCauley, J. L., Gros, K. S., & Ruggiero, K. J. (2012) · Psychiatry: Interpersonal and Biological Processes · doi:10.1521/psyc.2012.75.3.267 · Cited by 49
Farrer, L. M., Griffiths, K. M., Christensen, H., Mackinnon, A. J., & Batterham, P. J. (2014) · Cognitive Therapy and Research · doi:10.1007/s10608-013-9589-1 · Cited by 47 · cited 1×
“In 23 studies, the intended usage was described as well (Category B operationalization) [51-73], and 5 studies reported the intended usage with a justification for this threshold (Category C operationalization) [74-78].”
BackgroundBeatty, L., Kemp, E., Binnion, C., Turner, J., Milne, D., Butow, P., Lambert, S., Yates, P., Yip, D., & Koczwara, B. (2017) · Supportive Care in Cancer · doi:10.1007/s00520-017-3591-1 · Cited by 46
Cruz, V. T., Pais, J. L., Alves, I., Ruano, L., Mateus, C., Barreto, R. D., Bento, V., Colunas, M., Rocha, N. P., & Coutinho, P. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3377 · Cited by 43
Hayman, M., Reaburn, P. R. J., Browne, M., Vandelanotte, C., Alley, S., & Short, C. E. (2017) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-017-1277-9 · Cited by 43
Schuster, R., Leitner, I., Carlbring, P., & Laireiter, A.-R. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.04.001 · Cited by 42
Improving adherence to web-based cessation programs: a randomized controlled trial study protocol
Graham, A. L., Cha, S., Papandonatos, G. D., Cobb, N. K., Mushro, A., Fang, Y., NIAURA, R. S., & Abrams, D. B. (2013) · Trials · doi:10.1186/1745-6215-14-48 · Cited by 39
Nordin, C. A., Michaelson, P., Gard, G., & Eriksson, M. K. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5634 · Cited by 38
Individual and Household Predictors of Adolescents’ Adherence to a Web-Based Intervention
Mâsse, L. C., Watts, A. W., Barr, S. I., Tu, A. W., Panagiotopoulos, C., Geller, J., & Chanoine, J. (2014) · Annals of Behavioral Medicine · doi:10.1007/s12160-014-9658-z · Cited by 34
Program Use and Outcome Change in a Web-Based Trauma Intervention: Individual and Social Factors
Wang, Z., Wang, J., & Maercker, A. R. A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5839 · Cited by 32
A comparison of MOVE! versus TeleMOVE programs for weight loss in Veterans with obesity
Rutledge, T. R., Skoyen, J. A., Wiese, J. A., Ober, K. M., & Woods, G. N. (2016) · Obesity Research & Clinical Practice · doi:10.1016/j.orcp.2016.11.005 · Cited by 32
Tu, A. W., Watts, A. W., Chanoine, J., Panagiotopoulos, C., Geller, J., Brant, R., Barr, S. I., & Mâsse, L. C. (2017) · BMC Public Health · doi:10.1186/s12889-017-4220-0 · Cited by 30
Price, M., Davidson, T. M., Andrews, J. O., & Ruggiero, K. J. (2013) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x13476230 · Cited by 28
Alfonsson, S., Olsson, E. M. G., Linderman, S., Winnerhed, S., & Hursti, T. J. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.01.035 · Cited by 27
Joseph, R. P., Dutton, G. R., Cherrington, A., Fontaine, K. R., Baskin, M. L., Casazza, K., Lorch, D., Allison, J. J., & Durant, N. H. (2015) · BMC Research Notes · doi:10.1186/s13104-015-1159-z · Cited by 26
Graham, A. L., Jacobs, M. A., Cohn, A. M., Cha, S., Abroms, L. C., Papandonatos, G. D., & Whittaker, R. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010687 · Cited by 26
Grossert, A., Urech, C., Alder, J., Gaab, J., Berger, T., & Hess, V. (2016) · BMC Cancer · doi:10.1186/s12885-016-2866-0 · Cited by 26
Fernandes‐Taylor, S., Gunter, R. L., Bennett, K. M., Awoyinka, I., Rahman, S., Greenberg, C. C., & Kent, K. C. (2017) · JMIR Research Protocols · doi:10.2196/resprot.6819 · Cited by 26
Mañanes, G., & Vallejo, M. Á. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3091 · Cited by 23
McCabe, M. P., & Price, E. (2009) · Journal of Sex & Marital Therapy · doi:10.1080/00926230903065963 · Cited by 20
Beintner, I., Jacobi, C., & Taylor, C. B. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.03.001 · Cited by 19
Graham, A. L., Cha, S., Cobb, N. K., Ye, F., NIAURA, R. S., & Mushro, A. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2880 · Cited by 18
Rodgers, R. F., Franko, D. L., Shiyko, M. P., Intille, S. S., Wilson, K., O’Carroll, D., Lovering, M. E., Matsumoto, A., Iannuccilli, A., Luk, S., et al. (2015) · Health Informatics Journal · doi:10.1177/1460458214565950 · Cited by 15
Blake, H., Quirk, H., Leighton, P. A., Randell, T. L., Greening, J. E., Guo, B., & Glazebrook, C. (2016) · Trials · doi:10.1186/s13063-016-1719-0 · Cited by 15
Carolan, S., Harris, P. R., Greenwood, K., & Cavanagh, K. (2016) · Trials · doi:10.1186/s13063-016-1733-2 · Cited by 9 · cited 3×
“In 23 studies, the intended usage was described as well (Category B operationalization) [51-73], and 5 studies reported the intended usage with a justification for this threshold (Category C operationalization) [74-78].”
BackgroundMertens, A., Becker, S., Theis, S., Rasche, P., Wille, M., Bröhl, C., Finken, L., & Schlick, C. (2017) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-319-41652-6_28 · Cited by 5
Flagged first, then by citations
1 of the 84 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- SmithWPlodererBWadleyGWebberSBorlandRTrajectories of Engagement and Disengagement with a Story-Based Smoking Cessation App20172017 CHI Conference on Human Factors in Computing SystemsMay 6-11, 2017Denver, ColoradoACM304556
- Batterham, PJ, 2008, Patient Prefer Adherence, 2, 97
- An, LC, 2006, Nicotine Tob Res, 8, S7
- Wangberg, SC, 2008, Patient Prefer Adherence, 2, 57
Cited by
Sorted by citations
Jakob, R., Harperink, S., Rudolf, A. M., Fleisch, E., Haug, S., Mair, J. L., Salamanca-Sanabria, A., & Kowatsch, T. (2022) · Journal of Medical Internet Research · doi:10.2196/35371 · Cited by 446
Short, C. E., DeSmet, A., Woods, C., Williams, S. L., Maher, C., Middelweerd, A., Müller, A. M., Wark, P. A., Vandelanotte, C., Poppe, L., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9397 · Cited by 400
Digital interventions for the treatment of depression: a meta-analytic review
Moshe, I., Terhorst, Y., Philippi, P., Domhardt, M., Cuijpers, P., Cristea, I., Pulkki-Råback, L., Baumeister, H., & Sander, L. B. (2021) · Psychological Bulletin · doi:10.1037/bul0000334 · Cited by 390
Simblett, S., Greer, B., Matcham, F., Curtis, H., Polhemus, A., Ferrão, J., Gamble, P., & Wykes, T. (2018) · Journal of Medical Internet Research · doi:10.2196/10480 · Cited by 270
Hauser-Ulrich, S., Künzli, H., Meier-Peterhans, D., & Kowatsch, T. (2020) · JMIR mHealth and uHealth · doi:10.2196/15806 · Cited by 210
Metadata
- Authors
- Sieverink, F., Kelders, S. M., & van Gemert-Pijnen, J. E.
- Affiliations
- University of Twente (NL)
- North-West University (ZA)
- Corresponding author
- Sieverink, Floor
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2017-12-06
- Volume
- 19
- Issue
- 12
- Pages
- e402
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC5738543
- OpenAlex
- W2774320409
- Semantic Scholar
- a1db2bb515ffdc128b4290c1c2d3f04a5b280310
- Cited by
- 331
- References
- 84
- Citations by year
- 2026: 28 · 2025: 33 · 2024: 35 · 2023: 38 · 2022: 45 · 2021: 51 · 2020: 48 · 2019: 31 · 2018: 21 · 2017: 1
- FWCI
- 4.86
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Twente Research Information (publishedVersion, cc-by)
- University of Twente Research Information (submittedVersion, cc-by)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- eHealth technologies, technology adherence, intended use, mental health technology, eHealth evaluation, operating mechanism
- MeSH terms
- Humans, Patient Compliance, Telemedicine, Biomedical Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review