Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index; 22 of the 112 sources its claims cite were checked for support.

A User-Centered Approach to an Evidence-Based Electronic Health Pain Management Intervention for People With Chronic Pain: Design and Development of EPIO

Open access
Ledel Solem, Ingrid Konstanse, Varsi, Cecilie, Eide, Hilde, Kristjansdottir, Olöf Birna, Børøsund, Elin, Schreurs, Karlein M G, Waxenberg, Lori B, Weiss, Karen E, Morrison, Eleshia J, Haaland-Øverby, Mette, Bevan, Katherine, Zangi, Heidi Andersen, Stubhaug, Audun, Solberg Nes, Lise · 2020 · Journal of Medical Internet Research

Abstract

Background: Chronic pain conditions are complicated and challenging to live with. Electronic health (eHealth) interventions show promise in helping people cope with chronic illness, including pain. The success of these interventions depends not only on the technology and intervention content but also on the users’ acceptance and adherence. Involving all stakeholders (eg, patients, spouses, health care providers, designers, software developers, and researchers) and exploring their input and preferences in the design and development process is an important step toward developing meaningful interventions and possibly strengthening treatment outcomes. Objective: The aim of this study was to design and develop a user-centered, evidence-based eHealth self-management intervention for people with chronic pain. Methods: The study employed a multidisciplinary and user-centered design approach. Overall, 20 stakeholders from the project team (ie, 7 researchers, 5 editors, 7 software developers, and 1 user representative), together with 33 external stakeholders (ie, 12 health care providers, 1 health care manger, 1 eHealth research psychologist, and 17 patients with chronic pain and 2 of their spouses) participated in a user-centered development process that included workshops, intervention content development, and usability testing. Intervention content was developed and finalized based on existing evidence, stakeholder input, and user testing. Stakeholder input was examined through qualitative analyses with rapid and in-depth analysis approaches. Results: Analyses from stakeholder input identified themes including a need for reliable, trustworthy, and evidence-based content, personalization, options for feedback, behavioral tracking, and self-assessment/registration as factors to include in the intervention. Evidence-based intervention content development resulted in one face-to-face introduction session and 9 app-based educational and exercise-based modules. Usability testing provided further insight into how to optimize the design of the intervention to the user group, identifying accessibility and a simple design to be essential. Conclusions: The design and development process of eHealth interventions should strive to combine well-known evidence-based concepts with stakeholder input. This study, designing and developing the pain management intervention EPIO, illustrates how a stakeholder-centered design approach can provide essential input in the development of an eHealth self-management intervention for people with chronic pain. Trial Registration: ClinicalTrials.gov NCT03705104; https://clinicaltrials.gov/ct2/show/NCT03705104

Overview

CoChat Summary

## TL;DR

EPIO was designed as a user-centered, evidence-based eHealth self-management intervention for adults with chronic pain, combining stakeholder input with CBT/ACT-based content and iterative software development. The paper describes the development process and resulting app structure, and reports that usability testing yielded an average SUS score of 81.25.

## Key findings

  • Stakeholder input highlighted a need for reliable, trustworthy, evidence-based content, plus personalization, feedback, behavioral tracking, and self-assessment/registration.
  • The final intervention included 1 face-to-face introduction session and 9 app-based educational and exercise-based modules; the app-based program ultimately contained 9 modules.
  • Usability testing across 5 iterative rounds produced an overall average System Usability Scale (SUS) score of 81.25, which the paper describes as grade A / excellent system usability.
  • Participants emphasized accessibility and simple design; the paper reports that users found the intervention easy to use, without need for assistance, and that most expected to use it frequently (mean 3.8, median 4).

## Methods

  • Multidisciplinary, user-centered design process combining contextual inquiry, co-design workshops, intervention content development, software prototyping, and usability testing.
  • Participants included 33 external stakeholders: 12 health care providers, 1 health care manager, 1 eHealth research psychologist, 17 patients with chronic pain, and 2 spouses, alongside 20 project-team stakeholders.
  • Analysis used a two-stage approach: rapid analysis for ongoing development input, followed by directed content analysis to code material into predefined categories for content, design, functionality, usability/flow, customization, and barriers.

## Limitations

  • The paper states that the patient sample had a limited number of male and younger patients and a mean age of 51 years, which may limit representativeness; it also notes the sample may be a sample of convenience.
  • The paper states that some patients and spouses had already participated in an earlier interview study, which could have limited the diversity of perspectives by introducing prior familiarity with the intervention.
  • The paper states that not every intervention step/module was tested and that usability testing occurred in a limited setting and time frame, which may mean it captured only some barriers to continued use; additionally, this is evident from the text as a practical limitation of the formative testing setup.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/15889

Cites

74 of 74 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Study overview and development timeline.
Figure 1 Study overview and development timeline.CC BY · PubMed Central
Figure 2 Illustration of a study persona.
Figure 2 Illustration of a study persona.CC BY · PubMed Central
Figure 3 Illustration of a patient journey map during a typical day with pain.
Figure 3 Illustration of a patient journey map during a typical day with pain.CC BY · PubMed Central
Figure 4 Overview of study timeline, intervention development process, activities, and participation. Partner WS: collaborating partners; Partners: collaborating partners; IT: person(s) from software team (ie, developers and designer); User rep: user representative; Stakeholder WS: stakeholder workshop. The test facilitator and observers are not counted as participants and included in the n for software development and formative evaluation.
Figure 4 Overview of study timeline, intervention development process, activities, and participation. Partner WS: collaborating partners; Partners: collaborating partners; IT: person(s) from software team (ie, developers and designer); User rep: user representative; Stakeholder WS: stakeholder workshop. The test facilitator and observers are not counted as participants and included in the n for software development and formative evaluation.CC BY · PubMed Central
Figure 5 Example screenshots from the EPIO intervention. From left: (1) start page, (2) selective registrations, (3) module about pain, and (4) exercise example.
Figure 5 Example screenshots from the EPIO intervention. From left: (1) start page, (2) selective registrations, (3) module about pain, and (4) exercise example.CC BY · PubMed Central

Verification

Claims the paper makes

12 Valid · 0 Not valid · 29 Not checked · 89 Own results and interpretations

57 more claims · 4 with their cited sources checked

Create a free account to see all 130 claims and to verify the 90 references still open.

See all claims — free account
  • Probably not a substantial claim. 44
  • It may state two separate claims as one. 37

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

5 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 74 references

Research works printed but not linked: 6

  1. Beck, JS, 2011, Cognitive Behavior Therapy, Second Edition: Basics And Beyond
  2. Moen, A, 2013, Yearb Med Inform, 8, 59
  3. 2014, Mayo Clinic Guide to Pain Relief. Second Edition
  4. Waxenberg, LB, 2008, Pain Management Manual & Workbook: A guide for Behavioral Pain Management Techniques
  5. Sauro, J, 2011, A Practical Guide to the System Usability Scale: Background, Benchmarks & Best Practices
  6. Lincoln, YS, 1985, Naturalistic Inquiry

Cited by

See all 80

Metadata

Authors
Ledel Solem, I. K., Varsi, C., Eide, H., Kristjansdottir, O. B., Børøsund, E., Schreurs, K. M. G., Waxenberg, L. B., Weiss, K. E., Morrison, E. J., Haaland-Øverby, M., Bevan, K., Zangi, H. A., Stubhaug, A., & Solberg Nes, L.
Affiliations
  • Oslo University Hospital (NO)
  • University of Twente (NL)
  • University of Florida (US)
  • University of Washington (US)
  • Mayo Clinic (US)
  • Vestre Viken Hospital Trust (NO)
  • VID Specialized University (NO)
Venue
Journal of Medical Internet Research
Published
2020-01-21
Volume
22
Issue
1
Pages
e15889
ISSN
1438-8871 (ISSN-L)
OpenAlex
W3003132437
Cited by
80
References
74
Citations by year
2026: 11 · 2025: 12 · 2024: 8 · 2023: 13 · 2022: 13 · 2021: 18 · 2020: 5
FWCI
12.79
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • University of Twente Research Information (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
  • NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
Funders
Norges Forskningsråd (256574)
Topics
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Health Professions › Physical Therapy, Sports Therapy and Rehabilitation › Musculoskeletal pain and rehabilitation
Keywords
chronic pain, digital health interventions, pain management, self-management, user-centered design, stakeholder engagement, mobile health apps, usability testing, personalization, behavioral tracking, patient acceptance
MeSH terms
Chronic Disease, Humans, Program Evaluation, Treatment Outcome, Telemedicine, Chronic Pain, Pain Management, Mobile Applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A User-Centered Approach to an Evidence-Based Electronic Health Pain Management Intervention for People With Chronic Pain: Design and Development of EPIO. https://app.cochat.ai/papers/10.2196/15889
The paper
Ledel Solem, I. K., Varsi, C., Eide, H., Kristjansdottir, O. B., Børøsund, E., Schreurs, K. M. G., Waxenberg, L. B., Weiss, K. E., Morrison, E. J., Haaland-Øverby, M., Bevan, K., Zangi, H. A., Stubhaug, A., & Solberg Nes, L. (2020). A User-Centered Approach to an Evidence-Based Electronic Health Pain Management Intervention for People With Chronic Pain: Design and Development of EPIO. Journal of Medical Internet Research. https://doi.org/10.2196/15889

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.