The DOI matches its Crossref record; 83 of the 84 references it cites were found in a registry or an index; none of the 34 sources its claims cite is checked for support yet.
Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence
Open accessAbstract
BACKGROUND: In electronic health (eHealth) evaluations, there is increasing attention for studying the actual usage of a technology in relation to the outcomes found, often by studying the adherence to the technology. On the basis of the definition of adherence, we suggest that the following three elements are necessary to determine adherence to eHealth technology: (1) the ability to measure the usage behavior of individuals; (2) an operationalization of intended use; and (3) an empirical, theoretical, or rational justification of the intended use. However, to date, little is known on how to operationalize the intended usage of and the adherence to different types of eHealth technology. OBJECTIVE: The study aimed to improve eHealth evaluations by gaining insight into when, how, and by whom the concept of adherence has been used in previous eHealth evaluations and finding a concise way to operationalize adherence to and intended use of different eHealth technologies. METHODS: A systematic review of eHealth evaluations was conducted to gain insight into how the use of the technology was measured, how adherence to different types of technologies was operationalized, and if and how the intended use of the technology was justified. Differences in variables between the use of the technology and the operationalization of adherence were calculated using a chi-square test of independence. RESULTS: In total, 62 studies were included in this review. In 34 studies, adherence was operationalized as "the more use, the better," whereas 28 studies described a threshold for intended use of the technology as well. Out of these 28, only 6 reported a justification for the intended use. The proportion of evaluations of mental health technologies reporting a justified operationalization of intended use is lagging behind compared with evaluations of lifestyle and chronic care technologies. The results indicated that a justification of intended use does not require extra measurements to determine adherence to the technology. CONCLUSIONS: The results of this review showed that to date, justifications for intended use are often missing in evaluations of adherence. Evidently, it is not always possible to estimate the intended use of a technology. However, such measures do not meet the definition of adherence and should therefore be referred to as the actual usage of the technology. Therefore, it can be concluded that adherence to eHealth technology is an underdeveloped and often improperly used concept in the existing body of literature. When defining the intended use of a technology and selecting valid measures for adherence, the goal or the assumed working mechanisms should be leading. Adherence can then be standardized, which will improve the comparison of adherence rates to different technologies with the same goal and will provide insight into how adherence to different elements contributed to the outcomes.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This systematic review of 62 eHealth evaluations finds that adherence is often operationalized as “the more use, the better” without an intended-use threshold, and even when a threshold is given, justification is usually missing. The authors argue adherence should be defined against a justified intended use tied to the technology’s goal or assumed working mechanisms.
Key findings
- Of 62 included studies, 34 used Category A (“more use, the better”), 23 provided an intended-use threshold without justification (Category B), and 5 provided a justified threshold (Category C); the abstract reports 6 justified among 28 threshold studies.
- Mental health technologies lagged: 20/31 had Category A operationalizations, while Category C was more equally distributed across mental health, lifestyle, and chronic care.
- Most operationalizations used ≤2 measures (49/62); 10/13 with ≥3 measures were Category A. Adherence to unstructured technologies more often used logins/sessions (P=.03), features accessed/used (P<.001), and time spent (P<.001); structured technologies used modules/lessons completed (P<.001).
- Technologies were mostly Web-based (51/62); 29 were structured, 18 unstructured, and 15 hybrid, with half targeting mental health.
Methods
- Systematic review; searched Scopus, Web of Science, ScienceDirect, and PsycINFO; 7005 records identified, 62 full texts included after title, abstract, and full-text screening.
- Included health-related technologies intended for repeated use, with objective quantifiable usage measures and an adherence operationalization; excluded offline treatment adherence, protocol adherence, simple information-exchange tools, conference abstracts, and unavailable full texts.
- Data were extracted and adherence operationalizations categorized as A/B/C; differences were tested with chi-square test of independence, using Monte Carlo correction when expected counts were low, at alpha .05.
Limitations
- Stated: only studies using adherence as an outcome or explicitly stating a proxy were included, so studies using related terms (nonusage attrition, engagement, drop-out, [non]usage) may have been missed.
- Stated: adherence operationalizations were categorized per study, not per technology, though the same technology could have different operationalizations across studies.
- Evident from the text: the abstract and results differ on the number of justified operationalizations (6 vs 5), and the review is descriptive/categorical without meta-analytic synthesis.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 34 cited sources checked · 0 supported · 0 flagged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Most Category A operationalizations contain a measure for the number of modules that the users accessed or completed (19/34)”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Category C definitions are mostly based on the number of accessed or completed modules (3/5 operationalizations).”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In contrast, the results indicated that justifications of intended use are often based on the goal of the technology and/or the assumed working mechanisms, leading to more focused operationalizations that do not require additional measurements to evaluate adherence to the technology.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Principal Findings
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In 34 studies, adherence was operationalized as “the more use, the better,””
- Also stated in: § Operationalization of the Adherence Definition · plain
“Out of the 62 included articles, 34 reported adherence only in terms of how often the technology was used (Category A operationalization)”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Abstract > Results
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Also stated in: § Operationalization of the Adherence Definition · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Out of these 28, only 6 reported a justification for the intended use.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Abstract > Results
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and the number of logins or sessions (4/23).”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“However, to date, little is known on how to operationalize the intended usage of and the adherence to different types of eHealth technology.”
- Also stated in: § Determining Adherence · plain
“However, to date, little is known about how to operationalize the intended usage of and thus the adherence to different types of eHealth technology.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Abstract > Background
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Also stated in: § Determining Adherence · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Most Category B operationalizations contain the number of days, weeks, or months that people used the technology (11/23)”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The number of logins and the number of days, weeks, or months that people used the technology were used in 2 out of 5 operationalizations.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“whereas most Category C operationalizations consist of one or two measures.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Principal Findings
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes
- Probably not a substantial claim. 28
- It may state two separate claims as one. 20
- The quote only partly states this claim. 2
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Almost half of the technologies (29/62) were structured technologies, 18 were unstructured technologies, and 15 had a hybrid nature.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Technology Characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Most of the structured technologies (17/29) and almost all hybrid technologies (12/15) were aimed at improving mental health (P<.001).”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Technology Characteristics
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The technologies described in most of the articles are Web-based (51/62).”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Technology Characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Adherence to unstructured technologies was mostly operationalized using the number of logins or sessions (P=.03), the number of features accessed or used (P<.001), and the time spent using the technology (P<.001).”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Technology Characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the number of accessed or completed modules (8/23)”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In total, 62 studies were included in this review.”
- Also stated in: § Study Selection · plain
“After screening of the titles, abstracts, and full texts, 62 full texts were included in this review.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Abstract > Results
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Also stated in: § Study Selection · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Half of all included articles reported adherence to mental health technologies.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Technology Characteristics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Carolan et al describe a protocol for a study to be conducted to understand the optimum adherence to the technology in relation to the outcomes [78].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
What the sources say
- Not checked yetcites [78] source
Strength:plain· not yet calibratedTests✗ Asserted: fails✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The authors may not put it forward as true. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The included Category C operationalizations provided justification in various ways.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Beatty et al considered a user to be highly adherent when a therapeutic dose of 66% of the intervention was received [76]. This threshold for a therapeutic dose was obtained from previous studies.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
What the sources say
- Not checked yetcites [76] source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“In the study by Mertens et al, technology use was represented in relation to medication use, and users were therefore seen as adherent when the technology was used in accordance with the recommendations for medication use [77].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
What the sources say
- Not checked yetcites [77] Mertens, A, 2017, Advances in Human Factors and Ergonomics in Healthcare source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“In the study by Zeng et al, the technology consisted of different elements that were all evaluated as effective in other studies [75]. Users were considered adherent if they used all elements.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Results > Operationalization of the Adherence Definition
What the sources say
- Not checked yetcites [75] source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The majority of the technologies described in these studies were structured or hybrid Web-based interventions targeting mental health (mostly cognitive behavioral therapy [CBT] interventions) or unstructured technologies for lifestyle support.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Principal Findings
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“half of all operationalizations are based on the assumption of “the more use, the better” and do not include a threshold for intended use.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Principal Findings
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“eHealth evaluations often fail to demonstrate the dose-response relationship (the usage that is minimally needed to experience certain effects) or simply define it as “the more use, the better.””
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the results of this review show that the operationalization of intended use is mostly based on the assumption of “the more use, the better” and that when a threshold of intended use is provided, justification is often missing.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Conclusions
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and that there should be a threshold for intended use.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Principal Findings
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Therefore, it can be concluded that adherence to eHealth technology is an underdeveloped and often improperly used concept in the existing body of literature.”
- Also stated in: § Conclusions · plain
“it can be concluded that adherence to eHealth technology is an underdeveloped and often improperly used concept in the existing body of literature.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Abstract > Conclusions
Load-bearingStrength:boosted· not yet calibratedTests✓ Asserted: passes? Checkable: unclear✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Also stated in: § Conclusions · plain
In the paper
“This is unexpected because the majority of mental health technologies is based on (principles of) CBT, which is the most studied treatment for depression and has proven effective in many studies [79].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Principal Findings
What the sources say
- Not checked yetcites [79] Cuijpers, P, 2013, Can J Psychiatry source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, such measures do not meet the definition of adherence and should therefore be referred to as the actual usage of the technology.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Abstract > Conclusions
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
In the paper
“On the basis of the definition of adherence, we suggest that the following three elements are necessary to determine adherence to eHealth technology: (1) the ability to measure the usage behavior of individuals; (2) an operationalization of intended use; and (3) an empirical, theoretical, or rational justification of the intended use.”
- Also stated in: § Determining Adherence · hedged
“To summarize, based on the definition of adherence, we suggest that the following three elements are necessary to determine adherence to eHealth technology: (1) the ability to measure the usage behavior of individuals; (2) an operationalization of intended use; and (3) an empirical, theoretical, or rational justification of the intended use.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Abstract > Background
What the sources say
- Not checked yetcites [10] Sabaté, E, 2003, Adherence to long-term therapies: evidence for action
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
- Also stated in: § Determining Adherence · hedged
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“According to these definitions, the intended use is thus the minimum use to establish adherence.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Introduction > Adherence to eHealth Technologies
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“An important reason for the lack of justifications for the intended use of eHealth technologies might be that there is a lack of knowledge regarding the working mechanisms of technology-based applications [8].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
What the sources say
- Not checked yetcites [8] source
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Moreover, definitions of engagement usually incorporate the more subjective attributes of challenge, positive affect, endurability, and aesthetic and sensory appeals [12], whereas adherence is mostly based on measures for usage behavior.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Introduction > Adherence to eHealth Technologies
What the sources say
- Not checked yetcites [12] SmithWPlodererBWadleyGWebberSBorlandRTrajectories of Engagement and Disengagement with a Story-Based Smoking Cessation App20172017 CHI Conference on Human Factors in Computing SystemsMay 6-11, 2017Denver, ColoradoACM304556
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This implies that users do not always have to experience all of the available elements of a technology or have to use the same elements because usage goals may differ across users as well.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Introduction > Determining Adherence
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“However, a technology can be designed for multiple target groups and, depending on the individual user goals and the desired outcomes, technology can be used in many different ways in terms of the features that are used, as well as the frequency, time, and place of use [13,14].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Introduction > Determining Adherence
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“Kaushal and Rhodes found that exercising for at least four times per week for 6 weeks is a minimal requirement for establishing exercise habits [81].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
What the sources say
- Not checked yetcites [81] source
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“the intended use or the “therapeutic dose” can be justified just as well using existing guidelines for healthy living and medication use [74,77] or using previous research regarding other technologies [75,76].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
What the sources say
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A justified threshold for intended use in accordance with the goal of the technology provides information for a concise evaluation of adherence and the working mechanisms of a technology.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Conclusions
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Subsequently, justified operationalization (comprising multidimensional measures or not) can be used to standardize adherence to different eHealth technologies, making it easier to compare the adherence rates of different technologies.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Conclusions
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Previous research has shown that users do not always have to experience all of the elements of a technology and that effective usage patterns might differ across users.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Conclusions
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This approach simplifies the comparison of adherence across technologies with the same goal (eg, improving physical activity) but different technology characteristics (eg, features of the technology, persuasiveness, and user-friendliness) and a different operationalization of intended use.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“this statement is based on Category A operationalizations of adherence where more use is better.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“following this lesson can also be seen as an important precondition for gaining effects from using the intervention.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“adherence and intended use can be defined in many different ways, and it is very possible for different operationalizations to be used for different studies regarding the same technology.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Limitations
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“At the same time, this approach also simplifies the comparison of adherence of different users of a specific technology.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
In the paper
“In turn, the percentage of people who adhered to the intervention can be calculated, making adherence a more objective and standardized concept [1].”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Implications and Recommendations
What the sources say
- Not checked yetcites [1] source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“we only included studies that used adherence as an outcome measure or studies that explicitly stated how other outcome measures are used as a proxy for adherence.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Limitations
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“we may have missed relevant studies that formulated the intended use of a technology, but used other related terms for adherence (eg, nonusage attrition, engagement, drop-out, or [non]usage).”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Limitations
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“we defined the categories of adherence operationalizations for every study, instead of every type of technology.”
§ Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence > Discussion > Limitations
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Adherence is a common challenge in web-based interventions (Sieverink et al., 2017), particularly in self-guided interventions (Karyotaki et al., 2015).”
From Efficacy of a web-based psychoeducational intervention, Fex-can sex, for young adult childhood cancer survivors with sexual dysfunction: A randomized controlled trial (2024) · cites this paper as Sieverink et al., 2017
The cited source says what the claim attributes to it.
In the citing paper
“Adherence to internet‐based treatments is measured through various methods, including the number of logins (Sieverink et al. 2017).”
From Internet‐Based Acceptance and Commitment Therapy With Interoceptive Exposure for Panic Disorder: A Randomized Controlled Trial and Working Alliance Analysis. (2026) · cites this paper as Sieverink et al. 2017
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“In addition, even though the completion rate in this study may appear relatively low, 50% seems to be an average adherence rate for eHealth interventions [69], and program completion rates at 20% to 40% are not uncommon [70].”
From Short-Term Findings From Testing EPIO, a Digital Self-Management Program for People Living With Chronic Pain: Randomized Controlled Trial (2023) · cites this paper as [70]
Experimental — accuracy not yet measuredIn the citing paper
“The systematic review on usage-based adherence to eHealth interventions conducted by Sieverink et al reviewed 62 papers, of which 7 were on smartphone-based interventions [17]. Of those 7 papers, 5 were published after 2016, and the other 2 were both published in 2013.”
From A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review (2019) · cites this paper as [17]
In the citing paper
“The authors conclude that a limited but deliberate set of only one of 2 different indicators in accordance with the goal of the technology is sufficient to operationalize adherence.”
From A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review (2019) · cites this paper as [17]
In the citing paper
“In their systematic review, Sieverink et al found that over half of all reviewed studies measured adherence to eHealth interventions using a single analytic indicator, and a quarter used 2 indicators [17].”
From A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review (2019) · cites this paper as [17]
In the citing paper
“On reviewing how researchers were operationalizing adherence, they found that the majority reported adherence only in terms of how an intervention was used.”
From A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review (2019) · cites this paper as [17]
In the citing paper
“Our identification of the number of measures recorded on an app as an analytic indicator of engagement deviates from previous research by Sieverink et al on usage and adherence to eHealth interventions [17], which found no evidence that researchers were operationalizing constructs in this way.”
From A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review (2019) · cites this paper as [17]
In the citing paper
“The outcomes of eHealth self-management interventions seem to depend on patients’ motivation and adherence [7,25,64,67].”
From Digital Self-Management in Support of Patients Living With Chronic Pain: Feasibility Pilot Study (2020) · cites this paper as [67]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Abstract reports six justified studies, but results report five
MinorThe abstract says 6 studies justified their intended-use threshold, whereas the results identify 5 Category C studies. This changes the reported number meeting the paper's justification criterion.
“Out of these 28, only 6 reported a justification for the intended use.”
“and 5 studies reported the intended usage with a justification for this threshold (Category C operationalization) [74-78].”
Category A and B denominator is one too low
MinorThere are 34 Category A and 23 Category B operationalizations, totaling 57 rather than the stated 56.
Reported 56 · recomputed 57
“Furthermore, 48 out of 56 Category A and Category B operationalizations are for Web-based technologies (whether or not in combination with other devices)”
Chronic-care percentage in Category C is incorrect
MinorTable 4 gives one chronic-care study among five Category C studies, which is 20%, not 40%.
Reported 40 · recomputed 20
“| | Chronic care (n=6) | 1 (3) | 4 (17) | 1 (40) |”
Claim of no measure differences conflicts with Table 4
MinorThe discussion says no significant differences were found between the kinds of measures used across the three categories, but Table 4 marks the days/weeks/months measure as significant (aP<.05).
“No significant differences could be found between the kinds of measures that are used for all three levels of operationalizations.”
“| | Number of days/weeks/months (n=19)a | 6 (18) | 11 (48) | 2 (40) |”
Time-spent percentage in Category C is incorrect
MinorTable 4 gives one study using time spent among five Category C studies, which is 20%, not 17%.
Reported 17 · recomputed 20
“| | Time spent (n=14) | 11 (32) | 2 (9) | 1 (17) |”
Smartphone-app count differs between prose and Table 3
MinorThe prose reports five smartphone apps, but Table 3 reports six, distributed as 3 structured, 2 unstructured, and 1 hybrid.
“Furthermore, five are smartphone apps and five are Web-based or smartphone technologies combined with other devices such as wearables.”
“| | Smartphone app (n=6) | 3 (10) | 2 (11) | 1 (7) |”
Citations
Cites
Adherence to Long‐Term Therapies: Evidence for Action
Burkhart, P. V., & Sabaté, E. (2003) · Journal of Nursing Scholarship · doi:10.1111/j.1547-5069.2003.tb00001.x · Cited by 2,526
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308
Self-citationAdherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133
Cuijpers, P., Berking, M., Andersson, G., Quigley, L., Kleiboer, A., & Dobson, K. S. (2013) · The Canadian Journal of Psychiatry · doi:10.1177/070674371305800702 · Cited by 1,066
A Systematic Review of the Impact of Adherence on the Effectiveness of e-Therapies
Donkin, L., Christensen, H., Naismith, S. L., Neal, B., Hickie, I. B., & Glozier, N. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1772 · Cited by 876
Michie, S., Yardley, L., West, R., Patrick, K., & Greaves, F. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7126 · Cited by 865 · cited 3×
“For every technology, a proportion of the users will not use the intervention at all, will stop using the technology after a period, or will not use the available elements of the technology as intended [1,6-8].”
BackgroundZachariae, R., Lyby, M. S., Ritterband, L. M., & O'Toole, M. S. (2016) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2015.10.004 · Cited by 704 · cited 1×
“Although a longer treatment duration is associated with better effects [80], this still implies that users do not necessarily need to finish the complete program to experience reduction of their complaints, and that there should be a threshold for intended use.”
BackgroundCarter, M. C., Burley, V. J., Nykjaer, C., & Cade, J. E. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2283 · Cited by 666
van Ballegooijen, W., Cuijpers, P., van Straten, A., Karyotaki, E., Andersson, G., Smit, J. H., & Riper, H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100674 · Cited by 409
Flagged first, then by citations
1 of the 84 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- SmithWPlodererBWadleyGWebberSBorlandRTrajectories of Engagement and Disengagement with a Story-Based Smoking Cessation App20172017 CHI Conference on Human Factors in Computing SystemsMay 6-11, 2017Denver, ColoradoACM304556
- Batterham, PJ, 2008, Patient Prefer Adherence, 2, 97
- An, LC, 2006, Nicotine Tob Res, 8, S7
- Wangberg, SC, 2008, Patient Prefer Adherence, 2, 57
Cited by
Sorted by citations
Items 201–300 of 330
Fuente-Vidal, A., Guerra-Balic, M., Noguera, O. R., Jerez‐Roig, J., & Montané, J. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191610214 · Cited by 5
Wenger, F., Allenhof, C., Schreynemackers, S., Hegerl, U., & Reich, H. (2024) · JMIR Formative Research · doi:10.2196/53768 · Cited by 6
Silverman, A. L., Ferguson, I., Bullis, J. R., Bajwa, H., Mei, S., & Beard, C. (2025) · Journal of Mood and Anxiety Disorders · doi:10.1016/j.xjmad.2025.100106 · Cited by 5
Akers, L. G., Andrews, J. A., Lichtenstein, E. H., Severson, H. H., & Gordon, J. S. (2019) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntz074 · Cited by 5
Sanatkar, S., Heinsch, M., Baldwin, P. A., Rubin, M., Geddes, J., Hunt, S., Baker, A., Woodcock, K., Lewin, T. J., Brady, K. T., et al. (2021) · JMIR Mental Health · doi:10.2196/23986 · Cited by 5
Hämäläinen, T., Kaipainen, K., Keinonen, K., Lappalainen, P., Puolakanaho, A., Lappalainen, R., & Kiuru, N. H. (2022) · Journal of Cognitive Psychotherapy · doi:10.1891/jcp-2021-0038 · Cited by 5
Braga, B. C., Arrieta, A., Bannerman, B., Doyle, F., Folson, G. K., Gangupantulu, R., Hoang, N. T., Huỳnh, P., Koch, B., McCloskey, P., et al. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.961604 · Cited by 6
Sieverink, F. (2017) · doi:10.3990/1.9789036544177 · Cited by 5
Self-citationKizilkilic, S. E., Xu, L., Akıncı, B., Brørs, G., Bäck, M., Baritello, O., Falter, M., Halvorsen, S., Kaihara, T., Kemps, H., et al. (2025) · European Journal of Preventive Cardiology · doi:10.1093/eurjpc/zwaf354 · Cited by 8
Poot, C. C., de Boer, J., Goto, L., van de Hei, S. J., Chavannes, N. H., Visch, V., & Meijer, E. (2023) · Patient Preference and Adherence · doi:10.2147/ppa.s423161 · Cited by 4
Grove, B. E., de Thurah, A. L., Ivarsen, P., Kvisgaard, A. K., Hjøllund, N. H., Grytnes, R., & Schougaard, L. M. V. (2024) · JMIR Formative Research · doi:10.2196/48173 · Cited by 4
Firet, L., Teunissen, T. A. M., Kool, R. B., Akkermans, R. P., Lagro‐Janssen, A. L. M., van der Vaart, C. H., & Assendelft, W. J. (2024) · BMC Family Practice · doi:10.1186/s12875-024-02325-4 · Cited by 4
Efficacy of Cognitive Behavioral Therapy for Habit Modification and Drug Adherence in Obesity
Aguilera-Sosa, V. R. (2020) · Acta de Investigación Psicológica · doi:10.22201/fpsi.20074719e.2020.1.332 · Cited by 4
Lebel, J., Flores-Tremblay, T., Binet, É., Ouellet, M., & Belleville, G. (2021) · Santé mentale au Québec · doi:10.7202/1081516ar · Cited by 6
Brog, N. A., Hegy, J. K., Berger, T., & Znoj, H. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.835356 · Cited by 3
White, K. M., Williamson, C., Bergou, N., Oetzmann, C., de Angel, V., Matcham, F., Henderson, C., & Hotopf, M. H. (2022) · Research Square · doi:10.21203/rs.3.rs-1625589/v1 · Cited by 4
Adherence to eHealth Interventions Among Patients With Heart Failure: Scoping Review
Gingele, A. J., Steiner, B., Zippel‐Schultz, B., & Rocca, H. B. (2025) · JMIR mhealth and uhealth · doi:10.2196/63409 · Cited by 3
Arnold, S., Vogt, M., Boettcher, J., Fenski, F., Šipka, D., Elson, M., & Berger, T. (2025) · JMIR Research Protocols · doi:10.2196/77573 · Cited by 3
Hurley, L., Gottfredson, N. C., Power, J. M., Sciamanna, C., & Tate, D. F. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000766 · Cited by 3
Morsa, M., Perrin, A., David, V., Rault, G., Roux, É. L., Alberti, C., Gagnayre, R., & Bertrand, D. P. (2021) · JMIR Research Protocols · doi:10.2196/14552 · Cited by 4
Miller, S., Yardley, L., Smith, P. W. F., Weal, M. J., Anderson, A., Stuart, B. L., Little, P. S., & Morrison, L. G. (2021) · JMIR Formative Research · doi:10.2196/24239 · Cited by 4
Kiburi, S. K., Kwobah, E., Paruk, S., & Chiliza, B. (2023) · BMC Digital Health · doi:10.1186/s44247-023-00014-3 · Cited by 5
Exploring Evaluation of eHealth Lifestyle Interventions for Preschool Children: A Scoping Review
Kooij, M., Smit, A. J. P., Breeman, L. D., Schiphof‐Godart, L., Al-Dhahir, I., Evers, A. W. M., & Joosten, K. F. M. (2025) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2025.100223 · Cited by 3
Davis, A., Wilson, G. M., Erwin, J. P., Michel, J. B., Banchs, J. E., Saeed, A., & Widmer, R. J. (2021) · Ochsner Journal · doi:10.31486/toj.19.0124 · Cited by 3
Dekkers, T., Heirbaut, T., Schouten, S. E., Kelders, S. M., Jong, N. B.-D., Ludden, G., Deenik, J., Bouman, Y. H. A., & Kip, H. (2023) · JMIR Research Protocols · doi:10.2196/37727 · Cited by 3
Self-citationBäckman, L., Weineland, S., Vernmark, K., Radvogin, E., Bjälkebring, P., Enbuske, E., Hermansson, I., Johansson, N., Petersen, N., & Hursti, T. (2026) · Scandinavian Journal of Psychology · doi:10.1111/sjop.70045 · Cited by 2
“Adherence to internet-based treatments is measured through various meth-ods, including the number of logins (Sieverink et al. 2017).”
Lappalainen, A.-L., Keinonen, K., Lappalainen, P., Lappalainen, R., Kaipainen, K., Puolakanaho, A., & Kiuru, N. (2025) · Child & Family Behavior Therapy · doi:10.1080/07317107.2024.2437637 · Cited by 3
A systematic review of eHealth and mHealth interventions for lymphedema patients
Mangion, A., Ivasic, B., & Piller, N. (2024) · Clinical eHealth · doi:10.1016/j.ceh.2024.08.002 · Cited by 3
Stocker, A., Navarro, N., Schmitt, L., Delagnes, M., Doualle, A., Mallard, V., Entajan, F., Guivarc’h, K., Masse, P., Chaigneau, L., et al. (2024) · Addiction Science & Clinical Practice · doi:10.1186/s13722-024-00500-7 · Cited by 2
van de Graaf, D. L., van der Lee, M. L., Smeets, T., Trompetter, H. R., & Mols, F. (2025) · JMIR Cancer · doi:10.2196/64983 · Cited by 2
Lee, C., Joung, E., Koh, Y., Kim, E., Son, S., Kwon, S., & Lee, U. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757533 · Cited by 2
Analysis of Training Behavior in Users of a Fitness App: Cross-Sectional Study
Fuente-Vidal, A., Prat, R., Marín, J. M. A., Jossa-Bastidas, O., Guerra-Balic, M., García-Zapirain, B., Montané, J., & Jerez‐Roig, J. (2025) · JMIR mhealth and uhealth · doi:10.2196/72201 · Cited by 3
Weirauch, V., Mainz, A., Nitsche, J., Busse, T. S., & Meister, S. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02355-5 · Cited by 2
RELATIONSHIP BETWEEN ANXIETY LEVEL IN PANDEMIC AND MEDICAL ADHERENCE IN HYPERTENSIVE ELDERLY
Affandy, H. Y. (2022) · Diponegoro International Medical Journal · doi:10.14710/dimj.v3i2.14587 · Cited by 2
Dzubur, E., Yu, J., Hoffman, J. E., Painter, S. L., James, R. A., & Shah, B. R. (2023) · JMIR Formative Research · doi:10.2196/36596 · Cited by 2
Wright, H., Walker-Clarke, A., Drummond, A. E., Kidd, L., Yeates, G., Williams, D., McWilliams, D. J., Clyne, W., Clark, C. C. T., Kimani, P., et al. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01421-z · Cited by 2
Fenski, F., Heinrich, M., Schaeuffele, C., Zagorscak, P., Knaevelsrud, C., & Boettcher, J. (2025) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2025.2565674 · Cited by 2
Reporting von Studien zu digitalen Interventionen im Gesundheitswesen
Kernebeck, S., Busse, T. S., & Vollmar, H. C. (2022) · Springer eBooks · doi:10.1007/978-3-658-35691-0_4 · Cited by 2
Mason, H. T., O’Connor, S., Wong, D., & Stanmore, E. (2024) · medRxiv · doi:10.1101/2024.02.23.24303246 · Cited by 2
Smits, M., Back, N., & Ebbers, W. E. (2023) · Public Health · doi:10.1016/j.puhe.2023.06.027 · Cited by 1
Puolakanaho, A., Kaipainen, K., Keinonen, K., Lappalainen, P., Lappalainen, R. I., & Kiuru, N. H. (2023) · Child & Family Behavior Therapy · doi:10.1080/07317107.2023.2270544 · Cited by 1
Kip, H., Haneveld, L. K., & Kelders, S. M. (2024) · Digital Health · doi:10.1177/20552076241303835 · Cited by 1
Self-citationSenyard, E., Rowe, A., Krishnamoorthy, G., Spence, S. H., Donovan, C. L., & March, S. (2025) · JMIR Pediatrics and Parenting · doi:10.2196/60523 · Cited by 1
Khaldoun, L., Bellemare, F., Genest, C., Bergeron, N., & Geoffrion, S. (2025) · JMIR mhealth and uhealth · doi:10.2196/70412 · Cited by 1
Bastien, L., Cho, S., Petrovic, J., Khoury, B., Bloom, E. L., & Heath, N. L. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100868 · Cited by 1
Hondmann, S. M., Schrauwen, L., Reijnders, T., Stoop, E., Evers, A. W. M., Visch, V., Atsma, D. E., & Janssen, V. R. (2025) · JMIR Cardio · doi:10.2196/56236 · Cited by 1
Li, J., Liu, X., Du, X., Mi, T., & Ren, Z. (2025) · Journal of Medical Internet Research · doi:10.2196/77853 · Cited by 1
Ekpezu, A. O., Wiafe, I., Atsakpo, E. D., & B, H. O.-K. A. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2580537 · Cited by 1
Lysk, S., Pach, D., Tissen‐Diabaté, T., Scholler, S., & Witt, C. M. (2025) · Headache The Journal of Head and Face Pain · doi:10.1111/head.70009 · Cited by 1
Kip, H., Haneveld, L. K., ten Klooster, I., & Kelders, S. M. (2026) · Digital Health · doi:10.1177/20552076261415917 · Cited by 1
Self-citationNeubert, M., Sünkel, E. T., Planert, J., Hildebrand, A. S., & Klucken, T. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.100915 · Cited by 1
Eicher, S., Fenski, F., Behr, S., Hammelrath, L., Boettcher, J., Schaeuffele, C., & Knaevelsrud, C. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02546-0 · Cited by 1
Luo, Y., Inoue, K., Tajika, A., Toyomoto, R., Sakata, M., Akechi, T., Horikoshi, M., Noma, H., & Furukawa, T. A. (2026) · Psychological Medicine · doi:10.1017/s0033291726104279 · Cited by 1
Kinouchi, K., & Ohashi, K. (2022) · JMIR Formative Research · doi:10.2196/35471 · Cited by 1
Combined Model of Technology Use and Medical Adherence in eHealth Technology Implementation
Devkota, B., Montalvo, F. L., McConnell, D. S., & Smither, J. A.-A. (2021) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181321651295 · Cited by 1
van Schalkwyk, A., Grobbelaar, P. S., Herselman, M. E., & Vermeulen, E. (2022) · IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC) · doi:10.1109/ice/itmc-iamot55089.2022.10033267 · Cited by 1
Theilig, M.-M., Knapp, A. A., Nicholas, J., Zarnekow, R., & Mohr, D. C. (2020) · Research Square · doi:10.21203/rs.3.rs-68076/v1 · Cited by 1
Engaging with EPIO, a digital pain self-management program: A qualitative studyPreprint
Bostrøm, K., Varsi, C., Eide, H., Børøsund, E., Kristjánsdóttir, Ó. B., Schreurs, K. M. G., Waxenberg, L. B., Weiss, K. E., Morrison, E. J. P., Nordang, E. F., et al. (2021) · Research Square · doi:10.21203/rs.3.rs-952389/v1 · Cited by 1
Beintner, I., Vollert, B., Zarski, A., Bolinski, F., Musiat, P., Görlich, D., Ebert, D. D., & Jacobi, C. (2019) · doi:10.2196/preprints.14181 · Cited by 1
Baxter, M. S., Schwarze, J., Bush, A., & Sheikh, A. (2021) · Research Square · doi:10.21203/rs.3.rs-277478/v1 · Cited by 1
Theilig, M.-M., Knapp, A. A., Nicholas, J., Zarnekow, R., & Mohr, D. C. (2020) · Research Square · doi:10.21203/rs.3.rs-68076/v2 · Cited by 1
Simblett, S. K., Greer, B., Matcham, F., Curtis, H., Polhemus, A. M., Ferrão, J. C., Gamble, P., & Wykes, T. (2018) · doi:10.2196/preprints.10480 · Cited by 2
eHealth in pediatric asthma care : From smart home-monitoring to implementing a new care standard
van der Kamp, M. R. (2023) · doi:10.3990/1.9789036555654 · Cited by 1
Evia, Á. F. V. D. L. G., Eberle, J. W., Baee, S., Wolfe, E. C., Boukhechba, M., Funk, D., Teachman, B. A., & Barnes, L. E. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/yucqf
BrainTracker: mHealth app for Remote Assessment of Pediatric Epilepsy and Comorbidities
Gary, K. A., Cole, M., Purbey, D., Lin, M.-J., Berl, M. M., Jarawala, C., & Sohoni, S. (2020) · SeGAH ... IEEE ... International Conference on Serious Games and Applications for Health/IEEE International Conference on Serious Games and Applications for Health · doi:10.1109/segah49190.2020.9201850
Morgiève, M., Genty, C., Dubois, J., Leboyer, M., Vaïva, G., Berrouiguet, S., & Courtet, P. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/egm96
Graffigna, G., Bosio, C., Pagnini, F., Volpato, E., Previtali, E., Leone, S., D’Amico, F., Armuzzi, A., & Danese, S. (2021) · Research Square · doi:10.21203/rs.3.rs-587615/v1
Behandlungsschwierigkeiten bei geleiteter Online-Therapie
Bär, J., Ziehn, P., Ewert-Altenhain, D., Seidl, L., Schaeuffele, C., & Boettcher, J. (2021) · Psychotherapeut · doi:10.1007/s00278-021-00522-5
Käll, A. (2021) · Linköping studies in behavioural science · doi:10.3384/9789179290580
Madujibeya, I., Lennie, T. A., Aroh, A. C., Chung, M. L., & Moser, D. K. (2021) · doi:10.2196/preprints.35657
On maintaining successful treatment outcomes in interdisciplinary multimodal pain treatment
Elbers, S. (2021) · Research Publications (Maastricht University) · doi:10.26481/dis.20211117se
Ali, K., Fassnacht, D. B., Farrer, L. M., Rieger, E., Moessner, M., Bauer, S., & Griffiths, K. M. (2021) · Research Square · doi:10.21203/rs.3.rs-691333/v1
Li, S. H., Achilles, M. R., Werner‐Seidler, A., Beames, J. R., Subotic-Kerry, M., & O’Dea, B. (2022) · doi:10.2196/preprints.37640
Users evaluation of a Spanish eHealth pediatric website. Survey Study. (Preprint)Preprint
Soriano, B. J. N., Duarte, S. G., Fernández‐Alonso, A. M., Perales, A. B., & Carreño, T. P. (2020) · doi:10.2196/preprints.20366
Akers, L. G., Andrews, J. A., Lichtenstein, E., Severson, H. H., & Gordon, J. S. (2018) · doi:10.31234/osf.io/u9bfm
Zhao, J., Chen, P., & Wan, G. (2020) · doi:10.2196/preprints.17966
Danaher, B. G., Crowley, R. N., Brendryen, H., Seeley, J. R., Tyler, M. S., & Severson, H. H. (2018) · doi:10.2196/preprints.10882
Theilig, M.-M., Knapp, A. A., Nicholas, J., Zarnekow, R., & Mohr, D. C. (2021) · doi:10.2196/preprints.28014
Brons, M., ten Klooster, I., van Gemert‐Pijnen, J. E. W. C., Jaarsma, T., Asselbergs, F. W., Oerlemans, M. I. F. J., Koudstaal, S., & Rutten, F. H. (2022) · doi:10.2196/preprints.41248
Delestre, F., Debailly, R., Kerever, S., & Hansel, B. (2022) · Nutrition Clinique et Métabolisme · doi:10.1016/j.nupar.2022.07.002 · Cited by 1
Campbell, A. N. C., Brezing, C., & Shulman, M. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-90045-4.00004-6
Disease management of chronic heart failure
Brons, M. (2022) · doi:10.33540/1554
Derksen, M. E., Jaspers, M., Kunst, A. E., & Fransen, M. P. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104981
Levy, L. S., & Lowe, K. B. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-91497-0.00155-7
Building Digital Health Systems to Support Treatment Administration: A Preliminary Case Study
Bermúdez, A. G., & Bernardos, A. M. (2023) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-32029-3_20
Seewer, N., Skoko, A., Käll, A., Andersson, G., Luhmann, M., Berger, T., & Krieger, T. (2023) · Research Square · doi:10.21203/rs.3.rs-3005279/v1
Fernández, O., Pérez, J. C., Fernández, S., Krause, M., Cáceres, C., & Espinosa-Duque, D. (2023) · Digital Health · doi:10.1177/20552076231203920
Alushaj, X. (2023) · MEDIS – International Journal of Medical Sciences and Research · doi:10.35120/medisij020445a
Senyard, E., Rowe, A., Krishnamoorthy, G., Spence, S. H., Donovan, C. L., & March, S. (2024) · doi:10.2196/preprints.60523
Eimontas, J., Gegieckaitė, G., Arcimavičiūtė, L., Lapė, D., Amaliūtė, G., Andersson, G., & Lesinskas, E. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.10.368
Côté, J., Chicoine, G., Auger, P., Vinette, B., Rouleau, G., Maheu‐Cadotte, M., Pagé, M. G., Lapierre, J., Lal, S., Genest, C., et al. (2026) · JMIR mhealth and uhealth · doi:10.2196/71957
Jung, G., Lim, H., Han, K., Kim, H., & Lee, U. (2025) · JMIR Human Factors · doi:10.2196/64967 · Cited by 1
Sjöblom, L., Stenbeck, F., Lagerros, Y. T., Hantikainen, E. M., & Bonn, S. E. (2025) · JMIR Formative Research · doi:10.2196/71408 · Cited by 2
Evia, Á. F. V. D. L. G., Eberle, J. W., Baee, S., Wolfe, E. C., Boukhechba, M., Funk, D. H., Teachman, B. A., & Barnes, L. E. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000945
Ju, F., Xu, H., Zhao, M., & Wang, S. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1659600
Metadata
- Authors
- Sieverink, F., Kelders, S. M., & van Gemert-Pijnen, J. E.
- Affiliations
- University of Twente (NL)
- North-West University (ZA)
- Corresponding author
- Sieverink, Floor
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2017-12-06
- Volume
- 19
- Issue
- 12
- Pages
- e402
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC5738543
- OpenAlex
- W2774320409
- Semantic Scholar
- a1db2bb515ffdc128b4290c1c2d3f04a5b280310
- Cited by
- 331
- References
- 84
- Citations by year
- 2026: 28 · 2025: 33 · 2024: 35 · 2023: 38 · 2022: 45 · 2021: 51 · 2020: 48 · 2019: 31 · 2018: 21 · 2017: 1
- FWCI
- 4.86
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Twente Research Information (publishedVersion, cc-by)
- University of Twente Research Information (submittedVersion, cc-by)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- eHealth technologies, technology adherence, intended use, mental health technology, eHealth evaluation, operating mechanism
- MeSH terms
- Humans, Patient Compliance, Telemedicine, Biomedical Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review