The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index; 22 of the 112 sources its claims cite were checked for support.
A User-Centered Approach to an Evidence-Based Electronic Health Pain Management Intervention for People With Chronic Pain: Design and Development of EPIO
Open accessAbstract
Background: Chronic pain conditions are complicated and challenging to live with. Electronic health (eHealth) interventions show promise in helping people cope with chronic illness, including pain. The success of these interventions depends not only on the technology and intervention content but also on the users’ acceptance and adherence. Involving all stakeholders (eg, patients, spouses, health care providers, designers, software developers, and researchers) and exploring their input and preferences in the design and development process is an important step toward developing meaningful interventions and possibly strengthening treatment outcomes. Objective: The aim of this study was to design and develop a user-centered, evidence-based eHealth self-management intervention for people with chronic pain. Methods: The study employed a multidisciplinary and user-centered design approach. Overall, 20 stakeholders from the project team (ie, 7 researchers, 5 editors, 7 software developers, and 1 user representative), together with 33 external stakeholders (ie, 12 health care providers, 1 health care manger, 1 eHealth research psychologist, and 17 patients with chronic pain and 2 of their spouses) participated in a user-centered development process that included workshops, intervention content development, and usability testing. Intervention content was developed and finalized based on existing evidence, stakeholder input, and user testing. Stakeholder input was examined through qualitative analyses with rapid and in-depth analysis approaches. Results: Analyses from stakeholder input identified themes including a need for reliable, trustworthy, and evidence-based content, personalization, options for feedback, behavioral tracking, and self-assessment/registration as factors to include in the intervention. Evidence-based intervention content development resulted in one face-to-face introduction session and 9 app-based educational and exercise-based modules. Usability testing provided further insight into how to optimize the design of the intervention to the user group, identifying accessibility and a simple design to be essential. Conclusions: The design and development process of eHealth interventions should strive to combine well-known evidence-based concepts with stakeholder input. This study, designing and developing the pain management intervention EPIO, illustrates how a stakeholder-centered design approach can provide essential input in the development of an eHealth self-management intervention for people with chronic pain. Trial Registration: ClinicalTrials.gov NCT03705104; https://clinicaltrials.gov/ct2/show/NCT03705104
Overview
CoChat Summary
## TL;DR
EPIO was designed as a user-centered, evidence-based eHealth self-management intervention for adults with chronic pain, combining stakeholder input with CBT/ACT-based content and iterative software development. The paper describes the development process and resulting app structure, and reports that usability testing yielded an average SUS score of 81.25.
## Key findings
- Stakeholder input highlighted a need for reliable, trustworthy, evidence-based content, plus personalization, feedback, behavioral tracking, and self-assessment/registration.
- The final intervention included 1 face-to-face introduction session and 9 app-based educational and exercise-based modules; the app-based program ultimately contained 9 modules.
- Usability testing across 5 iterative rounds produced an overall average System Usability Scale (SUS) score of 81.25, which the paper describes as grade A / excellent system usability.
- Participants emphasized accessibility and simple design; the paper reports that users found the intervention easy to use, without need for assistance, and that most expected to use it frequently (mean 3.8, median 4).
## Methods
- Multidisciplinary, user-centered design process combining contextual inquiry, co-design workshops, intervention content development, software prototyping, and usability testing.
- Participants included 33 external stakeholders: 12 health care providers, 1 health care manager, 1 eHealth research psychologist, 17 patients with chronic pain, and 2 spouses, alongside 20 project-team stakeholders.
- Analysis used a two-stage approach: rapid analysis for ongoing development input, followed by directed content analysis to code material into predefined categories for content, design, functionality, usability/flow, customization, and barriers.
## Limitations
- The paper states that the patient sample had a limited number of male and younger patients and a mean age of 51 years, which may limit representativeness; it also notes the sample may be a sample of convenience.
- The paper states that some patients and spouses had already participated in an earlier interview study, which could have limited the diversity of perspectives by introducing prior familiarity with the intervention.
- The paper states that not every intervention step/module was tested and that usability testing occurred in a limited setting and time frame, which may mean it captured only some barriers to continued use; additionally, this is evident from the text as a practical limitation of the formative testing setup.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
12 Valid · 0 Not valid · 29 Not checked · 89 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Electronic health (eHealth) interventions, referring to health-related interventions distributed through technology, have shown promising results in helping people cope with health-related issues and chronic illness, including pain [19-25].”
§ A User-Centered Approach to an Evidence-Based Electronic Health Pain Management Intervention for People With Chronic Pain: Design and Development of EPIO > Introduction > Background
What the sources say
- Not checked yetcites [19] source
- Not checked yetcites [20] source
- Partly supportedcites [21] sourceExperimental — accuracy not yet measured
The Discussion (strengths paragraph) states that for internet-delivered pain treatment 'there are many controlled trials and at the very least the findings are promising', and the Abstract reports that CBT-based internet treatments are efficacious for interference/disability, pain intensity, catastrophizing and mood — so the 'promising results ... including pain' part is squarely supported, and the Introduction/Results treat internet-, smartphone- and app-delivered programmes as the technology-distributed modality the citing sentence describes. However, this review is confined to chronic pain including headache; our copy contains no evidence about eHealth interventions for health-related issues or chronic illness more broadly (the wider chronic-illness scope in the citing sentence is carried by the other citations in [19-25], not by this one). The supported part is the pain-specific claim; the generalisation to chronic illness/health-related issues in general is not stated in this source. (LLM, conf=0.72)
- Not checked yetcites [22] source
- Supportedcites [23] source
The Abstract states that pooled analysis of 25 RCTs of internet-delivered CBT across chronic health conditions showed small-to-moderate improvements in anxiety and depression and that 'ICBT shows promise as an alternative to traditional face-to-face interventions among persons with chronic health conditions'; the Discussion (Clinical implications) repeats that ICBT 'is an effective approach for managing anxiety, depression, and secondary condition specific outcomes.' The Pain sub-analysis (n = 950) reports moderate effects on anxiety (SDM = 0.64, p = .01), depression (SDM = 0.64, p = .001) and pain severity (SDM = 0.41, p = .003), covering the 'including pain' element. The only difference in level is that this source evaluates the internet-delivered CBT subset of 'eHealth interventions', but it is one of several citations [19-25] backing a broad background statement, and our copy treats technology-delivered psychological intervention for chronic illness in exactly those promising terms. (LLM, conf=0.82)
- Supportedcites [24] source
The cited review treats technology-delivered health interventions (smartphone/tablet apps, telehealth) as beneficial across health-related issues and chronic illness: the Introduction (p. 1) states that chronic illnesses are a particular target for such apps, with improvements in asthma control/lung function and glucose management, and the Abstract Results report that 'the majority of the original studies reported beneficial effects of the use of a pain app' with decreased pain severity and improved worst pain and quality of life. The Discussion's 'Comparison With Existing Literature' extends this to reductions in anxiety and depressive symptoms, medication adherence and symptom monitoring in other fields, and to remote/tablet-based pain coping interventions (Somers, Kristjánsdóttir, Basch). The source uses 'mobile app/mHealth/telehealth' rather than the broader term 'eHealth', and notes some null findings (eg, no pain decrease in 1 study, no blood-pressure improvement with an app), but the hedged 'promising results' characterization matches how our copy frames the evidence. (LLM, conf=0.82)
- Not checked yetcites [25] source
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Despite these recommendations, end users and other stakeholders are still rarely involved in the early development process of eHealth interventions [32,39].”
§ A User-Centered Approach to an Evidence-Based Electronic Health Pain Management Intervention for People With Chronic Pain: Design and Development of EPIO > Introduction > Background
What the sources say
- Not checked yetcites [32] source
- Partly supportedcites [39] sourceExperimental — accuracy not yet measured
The Introduction says eHealth technologies are often developed with only marginal engagement from end users. The Results, under “Potentials and Limitations of the Reviewed Frameworks,” says reviewed frameworks tend to place stakeholder involvement in evaluation rather than throughout development. That supports the concern about early involvement, but does not establish that other stakeholders are rarely involved in early development in practice. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Patients and spouses in the initial study reported a broad spectrum of everyday challenges, including physical, psychological, and social challenges, such as fatigue, grief, guilt, and social- and work isolation, and participants anticipated that eHealth technology would be a positive and accessible option for pain management support [50].”
§ A User-Centered Approach to an Evidence-Based Electronic Health Pain Management Intervention for People With Chronic Pain: Design and Development of EPIO > Introduction > Background
What the sources say
- Partly supportedcites [50] sourceExperimental — accuracy not yet measured
The Results (Supporting Self-Management With the Use of eHealth Technology; page unavailable) report that patients and spouses described physical, psychological, and social challenges, including fatigue, isolation, sorrow, and guilt. The Results (Patients’ Experiences with Information and Communication Technology; page unavailable) also say participants welcomed an accessible eHealth tool for pain-management support. The copy describes social isolation but does not establish the more specific claim of work isolation. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Several studies have pointed to great potential for the use of eHealth in chronic pain management [21,23,24,27,30,31].”
§ A User-Centered Approach to an Evidence-Based Electronic Health Pain Management Intervention for People With Chronic Pain: Design and Development of EPIO > Introduction > Background
What the sources say
- Supportedcites [21] source
The Discussion (page not provided) describes advantages of internet-delivered pain treatment and says findings from controlled trials are promising. This supports the broad claim that eHealth has potential in chronic pain management. (LLM, conf=0.91)
- Supportedcites [23] source
The Pain section (page not provided) reports that pooled studies of internet-delivered CBT for people with chronic pain found improvements in pain severity, anxiety, and depression. This supports the broad claim that eHealth has potential in chronic pain management, although the review specifically evaluates internet-delivered CBT. (LLM, conf=0.91)
- Supportedcites [24] source
The Results (Study Overview; no page given) say that 12 of the reviewed apps were used for chronic pain. The Results (Effects of Apps on Pain; no page given) report significant pain improvement in four studies using apps, and the Discussion (Implications; no page given) describes ways apps could help patients manage pain. This supports the broad claim of potential, while the review also calls for more high-quality studies. (LLM, conf=0.88)
- Not checked yetcites [27] source
- Not checked yetcites [30] source
- Supportedcites [31] source
The Introduction says computer-based interventions could give patients with chronic pain independent access to treatment and complement existing care. The Results (Meta-analyses) report small-to-medium improvements over passive controls. These passages support the broad claim of potential, without establishing that the interventions are superior to active treatments. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“(3) social support, including peer support forums and advice on how to communicate with others, such as family, friends, and health care providers [50].”
§ A User-Centered Approach to an Evidence-Based Electronic Health Pain Management Intervention for People With Chronic Pain: Design and Development of EPIO > Introduction > Background
What the sources say
- Partly supportedcites [50] sourceExperimental — accuracy not yet measured
The Results section (Supporting Self-Management With the Use of eHealth Technology; page unavailable) reports interest in peer forums and a need for advice to help conversations at home. It also identifies information about communicating pain with others, but does not specifically report a need for advice on communicating with friends or health care providers. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
57 more claims · 4 with their cited sources checked
Create a free account to see all 130 claims and to verify the 90 references still open.
- Probably not a substantial claim. 44
- It may state two separate claims as one. 37
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Moreover, three papers stated that Personas can bring the user voice to the forefront and highlight areas of tension (Elbers et al., 2021; Ledel Solem et al., 2020; Liu et al., 2020).”
From Using Personas in the development of eHealth interventions for chronic pain: A scoping review and narrative synthesis (2023) · cites this paper as Ledel Solem et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“even though some web-based CBT or ACT-based interventions have been tested in support of people living with chronic pain, findings are still inconclusive and interventions need further testing, also in app format [13,22,26-28].”
From Digital Self-Management in Support of Patients Living With Chronic Pain: Feasibility Pilot Study (2020) · cites this paper as [26]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Two studies elaborated on, or mentioned, the Persona's use of technology (Ledel Solem et al., 2020; Liu et al., 2020).”
From Using Personas in the development of eHealth interventions for chronic pain: A scoping review and narrative synthesis (2023) · cites this paper as Ledel Solem et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“Personas also helped to reflect on concepts by taking the patient perspective (Elbers et al., 2021), discuss potential possibilities or barriers of the intervention (Ledel Solem et al., 2020), or consider what the intervention might involve for the specific Personas (Rimmer et al., 2020).”
From Using Personas in the development of eHealth interventions for chronic pain: A scoping review and narrative synthesis (2023) · cites this paper as Ledel Solem et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“The EPIO intervention was designed and developed in close collaboration with researchers, eHealth experts, end users, and health care providers [29-31].”
From Short-Term Findings From Testing EPIO, a Digital Self-Management Program for People Living With Chronic Pain: Randomized Controlled Trial (2023) · cites this paper as [30]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
(1999) · Cited by 5,934
How we design feasibility studies
Bowen, D. J., Kreuter, M., Spring, B., Cofta-Woerpel, L., Linnan, L., Weiner, D., Bakken, S., Kaplan, C. P., Squiers, L., Fabrizio, C., et al. (2009) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.02.002 · Cited by 4,021 · cited 1×
“The ultimate goal was to develop an evidence-based intervention that was acceptable to users (ie, well received, suitable, user friendly, attractive, and meeting needs) [51] and had the potential to produce changes in quality of life for people with chronic pain.”
BackgroundDeveloping and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2013) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.09.010 · Cited by 1,658
Routledge International Handbook of Participatory Design
(2012) · doi:10.4324/9780203108543 · Cited by 1,606
Morley, S., Eccleston, C., & Williams, A. (1999) · Pain · doi:10.1016/s0304-3959(98)00255-3 · Cited by 1,597
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308
From the gate to the neuromatrix
Melzack, R. (1999) · Pain · doi:10.1016/s0304-3959(99)00145-1 · Cited by 1,170
Tsang, A., Von Korff, M., Lee, S., Alonso, J., Karam, E., Angermeyer, M. C., Borges, G. L. G., Bromet, E. J., de Girolamo, G., de Graaf, R., et al. (2008) · The Journal of Pain · doi:10.1016/j.jpain.2008.05.005 · Cited by 1,157
Research works printed but not linked: 6
- Beck, JS, 2011, Cognitive Behavior Therapy, Second Edition: Basics And Beyond
- Moen, A, 2013, Yearb Med Inform, 8, 59
- 2014, Mayo Clinic Guide to Pain Relief. Second Edition
- Waxenberg, LB, 2008, Pain Management Manual & Workbook: A guide for Behavioral Pain Management Techniques
- Sauro, J, 2011, A Practical Guide to the System Usability Scale: Background, Benchmarks & Best Practices
- Lincoln, YS, 1985, Naturalistic Inquiry
Cited by
Use Cases for Design Personas: A Systematic Review and New Frontiers
Salminen, J., Wenyun Guan, K., Jung, S.-G., & Jansen, B. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517589 · Cited by 140
Asbjørnsen, R. A., Wentzel, J., Smedsrød, M. L., Hjelmesæth, J., Clark, M. M., Solberg Nes, L., & Van Gemert-Pijnen, J. E. W. C. (2020) · Journal of Medical Internet Research · doi:10.2196/22598 · Cited by 84
Advancements in Wearable and Implantable BioMEMS Devices: Transforming Healthcare Through Technology
Abhinav, V., Basu, P., Verma, S. S., Verma, J., Das, A., Kumari, S., Yadav, P. R., & Kumar, V. (2025) · Micromachines · doi:10.3390/mi16050522 · Cited by 119
Methods for Human-Centered eHealth Development: Narrative Scoping Review
Kip, H., Keizer, J., da Silva, M. C., Beerlage-de Jong, N., Köhle, N., & Kelders, S. M. (2022) · Journal of Medical Internet Research · doi:10.2196/31858 · Cited by 67
Ethical issues related to eHealth: An integrative review
Jokinen, A., Stolt, M., & Suhonen, R. (2020) · Nursing Ethics · doi:10.1177/0969733020945765 · Cited by 82
Metadata
- Authors
- Ledel Solem, I. K., Varsi, C., Eide, H., Kristjansdottir, O. B., Børøsund, E., Schreurs, K. M. G., Waxenberg, L. B., Weiss, K. E., Morrison, E. J., Haaland-Øverby, M., Bevan, K., Zangi, H. A., Stubhaug, A., & Solberg Nes, L.
- Affiliations
- Oslo University Hospital (NO)
- University of Twente (NL)
- University of Florida (US)
- University of Washington (US)
- Mayo Clinic (US)
- Vestre Viken Hospital Trust (NO)
- VID Specialized University (NO)
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-01-21
- Volume
- 22
- Issue
- 1
- Pages
- e15889
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7001051
- OpenAlex
- W3003132437
- Semantic Scholar
- ee470b20ebc40024abd4f95d0819220fd4e27929
- Cited by
- 80
- References
- 74
- Citations by year
- 2026: 11 · 2025: 12 · 2024: 8 · 2023: 13 · 2022: 13 · 2021: 18 · 2020: 5
- FWCI
- 12.79
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Twente Research Information (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- Funders
- Norges Forskningsråd (256574)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › Physical Therapy, Sports Therapy and Rehabilitation › Musculoskeletal pain and rehabilitation
- Keywords
- chronic pain, digital health interventions, pain management, self-management, user-centered design, stakeholder engagement, mobile health apps, usability testing, personalization, behavioral tracking, patient acceptance
- MeSH terms
- Chronic Disease, Humans, Program Evaluation, Treatment Outcome, Telemedicine, Chronic Pain, Pain Management, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A User-Centered Approach to an Evidence-Based Electronic Health Pain Management Intervention for People With Chronic Pain: Design and Development of EPIO. https://app.cochat.ai/papers/10.2196/15889
- The paper
- Ledel Solem, I. K., Varsi, C., Eide, H., Kristjansdottir, O. B., Børøsund, E., Schreurs, K. M. G., Waxenberg, L. B., Weiss, K. E., Morrison, E. J., Haaland-Øverby, M., Bevan, K., Zangi, H. A., Stubhaug, A., & Solberg Nes, L. (2020). A User-Centered Approach to an Evidence-Based Electronic Health Pain Management Intervention for People With Chronic Pain: Design and Development of EPIO. Journal of Medical Internet Research. https://doi.org/10.2196/15889
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.