The DOI matches its Crossref record; 116 of the 116 references it cites were found in a registry or an index; 37 of the 74 sources its claims cite were checked for support.
Development and usability testing of a web-based and therapist-assisted coping skills program for managing psychosocial problems in individuals with hand and upper limb injuries: Mixed methods study
Open accessPublished version of a preprint
Abstract
Background: Ineffective coping has been linked to prolonged pain, distress, anxiety, and depression after a hand and upper limb injury. Evidence shows that interventions based on cognitive behavioral therapy (CBT) may be effective in improving treatment outcomes, but traditional psychological interventions are resource intensive and unrealistic in busy hand therapy practices. Developing web-based, evidence-based psychological interventions specifically for hand therapy may be feasible in clinical practice and at home with reduced training and travel costs. Hand Therapy Online Coping Skills (HOCOS) is a program developed to supplement traditional hand therapy with therapist-assisted coping skills training based on principles from CBT and the Technology Acceptance Model. Objective: This study aimed to describe the development and assess the usability of HOCOS to support hand therapists in the management of psychosocial problems. Methods: The ADDIE model (Analysis, Design, Development, Implementation, and Evaluation) of system design was applied to create HOCOS. The usability testing of HOCOS involved a 2-stage process. In the first step, heuristic testing with information and communications technology (ICT) experts was completed using two sets of heuristics: Monkman heuristics and the Health Literacy Online (HLO) checklist. The second step involved user testing with hand therapists performing a series of online and face-to-face activities, completing 12 tasks on the website using the think-aloud protocol, completing the system usability scale (SUS) questionnaire, and a semistructured feedback interview in 2 iterative cycles. Descriptive statistics and content analyses were used to organize the data. Results: In total, 4 ICT experts and 12 therapists completed usability testing. The heuristic evaluation revealed 15 of 35 violations on the HLO checklist and 5 of 11 violations on the Monkman heuristics. Initially, hand therapists found 5 tasks to be difficult but were able to complete all 12 tasks after the second cycle of testing. The cognitive interview findings were organized into 6 themes: Task performance, navigation, design esthetics, content, functionality and features, and desire for future use. Usability issues identified were addressed in two iterative cycles. There was good agreement on all items of the SUS. Overall, therapists found that HOCOS was a detailed and helpful learning resource for therapists and patients. Conclusions: We describe the development and usability testing of HOCOS; a new web-based psychosocial intervention for individuals with a hand and upper limb injuries. HOCOS targets psychosocial problems linked to prolonged pain and disability by increasing access to therapist-guided coping skills training. We actively involved target users in the development and usability evaluation of the website. The final website was modified to meet the needs and preferences of the participants. © 2020 Folarin Omoniyi Babatunde, Joy MacDermid, Ruby Grewal, Luciana Macedo, Mike Szekeres.
Overview
CoChat Summary
## TL;DR
The paper describes the development and mixed-methods usability testing of HOCOS, a web-based, therapist-assisted coping skills program for people with hand and upper limb injuries. Usability testing with 4 ICT experts and 12 therapists led to iterative revisions, and the mean SUS score improved from 62.5 to 84.
## Key findings
- Heuristic testing with 4 ICT experts found 15/35 violations on the Health Literacy Online checklist and 5/11 violations on the Monkman heuristics.
- In user testing, therapists initially found 5 tasks difficult, but after the second testing cycle they were able to complete all 12 tasks.
- The mean System Usability Scale (SUS) score improved from 62.5 (SD 8.5) to 84 (SD 8.2), which the authors interpret as moving from good to excellent usability.
- Cognitive interview findings were organized into 6 themes: task performance, navigation, design aesthetics, content, functionality and features, and desire for future use.
## Methods
- Mixed-methods usability study using the ADDIE model; this paper reports on step 3 of ADDIE (development/usability evaluation of the prototype).
- Phase 1: heuristic evaluation by 4 ICT experts using the Monkman heuristics and Health Literacy Online (HLO) checklist.
- Phase 2: user testing with 12 hand therapists in Ontario, Canada, using 12 tasks, the think-aloud protocol, SUS, and semistructured interviews; data were analyzed with descriptive statistics and content analysis.
## Limitations
- The authors state the study was conducted among hand therapists in Ontario, and most participants were already comfortable using computers and the internet, which limits generalizability and may not represent patient end users.
- They also state that snowball sampling was used, increasing the risk of a nonrepresentative sample.
- The paper explicitly notes they could not test HOCOS with patients because of financial and time constraints; this is a stated limitation and also evident from the sample being clinicians rather than end users.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
22 Valid · 6 Not valid · 18 Not checked · 67 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“CBT has also been shown to be effective in improving adherence to exercise [36].”
§ Development and Usability Testing of a Web-Based and Therapist-Assisted Coping Skills Program for Managing Psychosocial Problems in Individuals With Hand and Upper Limb Injuries: Mixed Methods Study > Introduction > Background
What the sources say
- Disputedcites [36] sourceExperimental — accuracy not yet measured
The Identity section (page unavailable) reports that the CBT study found no significant difference in time spent exercising between groups at 3, 6, 9 or 12 months. The behavioural theories section (page unavailable) says the only theory-based intervention with a significant adherence improvement was a different intervention, based on social learning theory. It does mention evidence from another review for improved attendance at exercise-based clinic sessions, but not improved exercise adherence from CBT in this review. (LLM, conf=0.89)
Checked by a reasoning model — may be wrong.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Most studies conducted in hand therapy have focused on maximizing physical recovery and adjustments with regard to medical or occupational therapy procedures [12-15].”
§ Development and Usability Testing of a Web-Based and Therapist-Assisted Coping Skills Program for Managing Psychosocial Problems in Individuals With Hand and Upper Limb Injuries: Mixed Methods Study > Introduction > Background
What the sources say
- Not checked — no full text of the sourcecites [12] source
- Could not verifycites [13] sourceExperimental — accuracy not yet measured
The Introduction says return to work is not determined solely by physical readiness, and the Studies identified section describes research on prognostic factors after work-related hand injury. The Treatment related variables section discusses two studies of treatment and return to work, but no passage establishes that most hand-therapy studies focus on maximizing physical recovery or on medical or occupational therapy procedures. Searches for those claimed research priorities found no supporting passage; page numbers were unavailable in our copy. (LLM, conf=0.75)
- Not checked — no full text of the sourcecites [14] source
- Not checked — no full text of the sourcecites [15] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Several studies have established the mediating effect of psychological distress on hand and upper limb pain and disability [21-24]”
§ Development and Usability Testing of a Web-Based and Therapist-Assisted Coping Skills Program for Managing Psychosocial Problems in Individuals With Hand and Upper Limb Injuries: Mixed Methods Study > Introduction > Background
What the sources say
- Not checked — no full text of the sourcecites [21] source
- Partly supportedcites [22] sourceExperimental — accuracy not yet measured
The Results report an association between depressive symptoms and pain intensity after hand injury. The Discussion describes psychological factors as relevant to pain and disability, but the study does not establish that psychological distress mediates either outcome; it found that depression severity did not predict disability. Page numbers were not available in our copy. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [23] source
- Partly supportedcites [24] sourceExperimental — accuracy not yet measured
The Results report that pain catastrophizing and anxiety were associated with disability three months after hand-fracture surgery, but not at six months. The paper supports a relationship between psychological factors and hand disability; it does not establish that psychological distress mediates the relationship between pain and disability across hand and upper-limb conditions. Page numbers are unavailable in our copy. (LLM, conf=0.87)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“CBT techniques such as graded activity can be integrated into traditional physiotherapy [37,38].”
§ Development and Usability Testing of a Web-Based and Therapist-Assisted Coping Skills Program for Managing Psychosocial Problems in Individuals With Hand and Upper Limb Injuries: Mixed Methods Study > Introduction > Background
What the sources say
- Supportedcites [37] source
The Conclusion states that physiotherapists can integrate graded activity, a CBT-based approach, into standard pain management for acute or sub-acute non-specific low back pain. The treatment-strategies section also says graded activity is simpler to integrate into physiotherapy practice. (LLM, conf=0.92)
- Not checked — no full text of the sourcecites [38] source
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In hand therapy, CBT may be efficient treatment to improve pain and distress by increasing adjustment to hand injury in relation to illness perception and coping strategies [2,39-41].”
§ Development and Usability Testing of a Web-Based and Therapist-Assisted Coping Skills Program for Managing Psychosocial Problems in Individuals With Hand and Upper Limb Injuries: Mixed Methods Study > Introduction > Background
What the sources say
- Partly supportedcites [2] sourceExperimental — accuracy not yet measured
Section 4.1, “Clinical Implications and future research” (page unavailable), suggests that addressing illness beliefs and coping strategies may improve adjustment to hand injury. It does not establish that CBT improves pain or distress: the intervention discussion instead proposes ACT and says research on psychological interventions for hand injuries is very limited. (LLM, conf=0.88)
- Partly supportedcites [39] sourceExperimental — accuracy not yet measured
The Introduction links pain intensity with psychological distress, illness concern, and ineffective coping, and the Discussion suggests coaching and cognitive behavioral therapy techniques to improve self-efficacy. But this fracture-surgery study does not establish that CBT in hand therapy improves pain or distress by increasing adjustment to hand injury; its Conclusions say self-efficacy interventions merit further study. Page numbers were not provided for these passages. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [40] source
- Partly supportedcites [41] sourceExperimental — accuracy not yet measured
The Introduction links psychological distress with pain and impairment in patients with upper-extremity conditions, and the Discussion identifies poor coping as relevant to outcomes and suggests directing patients with heightened anxiety or depression toward treatment (pages not available in our copy). The paper does not assess CBT or say that it improves pain and distress by changing illness perception, coping strategies, or adjustment to hand injury. (LLM, conf=0.83)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
36 more claims · 3 with their cited sources checked
Create a free account to see all 113 claims and to verify the 7 references still open.
- It may state two separate claims as one. 36
- Probably not a substantial claim. 46
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Cited works that were retracted
Works this paper cites that were later retracted, from the retraction notices publishers deposit. Major when the notice came out before this paper was published.
A note, not an issue: for example, a cited work that was retracted only after this paper was published, which its authors could not have known.
In the paper
“Several studies have established the mediating effect of psychological distress on hand and upper limb pain and disability [21-24] based on the far-reaching impact of psychosocial problems on pain and disability, and patient expectations after hand and upper limb injuries, a greater understanding…”
Cited work 10.1007/s11999-015-4269-y · retracted 2020-10-09 · notice 10.1097/corr.0000000000001499 · this paper published 2020-05-06
Citations
Cites
1 retracted
Roh, Y. H., Noh, J. H., Oh, J. H., Gong, H. S., & Baek, G. H. (2015) · Clinical Orthopaedics & Related Research · doi:10.1007/s11999-015-4269-y · Cited by 22 · cited 1×
“Several studies have established the mediating effect of psychological distress on hand and upper limb pain and disability [21-24] based on the far-reaching impact of psychosocial problems on pain and disability, and patient expectations after hand and upper limb injuries, a greater understanding…”
RetractedThe Content Analysis Guidebook
Neuendorf, K. A. (2017) · doi:10.4135/9781071802878 · Cited by 9,286 · cited 1×
“Content analysis [77] of transcripts from the thinking aloud sessions, field notes, and feedback interviews was coded using predetermined codes related to usability issues (navigation, content, layout, learnability, errors, and satisfaction) after each iterative cycle.”
Mindfulness training as a clinical intervention: a conceptual and empirical review
Baer, R. A. (2003) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpg015 · Cited by 4,577
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,354
Nielsen, J. (1994) · Conference companion on Human factors in computing systems - CHI '94 · doi:10.1145/259963.260531 · Cited by 2,759
The Technology Acceptance Model: Its past and its future in health care
Holden, R. J., & Karsh, B.-T. (2010) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.07.002 · Cited by 2,669 · cited 1×
“Hand Therapy Online Coping Skills (HOCOS) is an evidence-based and theory-based psychosocial coping skills program based on CBT principles [37] and the Technology Acceptance Model [54].”
Nielsen, J. (1995) · Conference companion on Human factors in computing systems - CHI '95 · doi:10.1145/223355.223730 · Cited by 2,620
Knowledge translation of research findings
Grimshaw, J. M., Eccles, M. P., Lavis, J. N., Hill, S. J., & Squires, J. E. (2012) · Implementation Science · doi:10.1186/1748-5908-7-50 · Cited by 2,407
A mathematical model of the finding of usability problems
Nielsen, J., & Landauer, T. K. (1993) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93 · doi:10.1145/169059.169166 · Cited by 1,961 · cited 1×
“We enrolled four ICT experts to act as evaluators during heuristics evaluation, which meets the optimal requirement for detecting all usability problems [78].”
The Technique of Clear Writing.
Gunning, R. C. (1968) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,641
Research works printed but not linked: 3
- Monkman, H, 2015, Stud Health Technol Inform, 216, 358
- 10.5555/2817912.2817913 · doi:10.5555/2817912.2817913
- Chad-Friedman, E, 2017, Arch Bone Jt Surg, 5, 400
Cited by
Usability research in educational technology: a state-of-the-art systematic review
Lu, J., Schmidt, M., Lee, M., & Huang, R. (2022) · Educational Technology Research and Development · doi:10.1007/s11423-022-10152-6 · Cited by 124
Yuan, L., Lu, L., Wang, X., Qu, M., Gao, Y., & Pan, B. (2023) · BMC Psychiatry · doi:10.1186/s12888-023-04638-7 · Cited by 41
Cucciare, M. A., Abraham, T. H., Kemp, L., White, P., Marchant, K., Hagedorn, H. J., & Humphreys, K. (2022) · Journal of Medical Internet Research · doi:10.2196/35514 · Cited by 18
Heuristic Evaluation and Usability Testing of G-MoMo Applications
Ali, G. (2022) · Journal of Information Systems Engineering & Management · doi:10.55267/iadt.07.12296 · Cited by 9
Feroz, A. S., Yasmin, H., Saleem, S., et al. (2023) · Informatics · doi:10.3390/informatics10040079 · Cited by 8
Metadata
- Authors
- Babatunde, F. O., MacDermid, J., Grewal, R., Macedo, L., & Szekeres, M.
- Affiliations
- McMaster University (CA)
- Western University (CA)
- Corresponding author
- Babatunde, Folarin Omoniyi
- Venue
- JMIR Human Factors
- Publisher
- JMIR Publications Inc.
- Published
- 2020-05-06
- Volume
- 7
- Issue
- 2
- Pages
- e17088
- ISSN
- 2292-9495 (ISSN-L)
- PMC
- PMC7240444
- OpenAlex
- W3007738972
- Semantic Scholar
- 4e9d9b2566e5c3ce240942be54e2d61bce68e001
- Cited by
- 12
- References
- 97
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 2 · 2023: 2 · 2022: 5 · 2021: 1
- FWCI
- 1.81
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Human Factors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Scholarship@Western (Western University) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Scholarship@Western (Western University) (submittedVersion)
- Funders
- Canadian Institutes of Health Research
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- hand therapy, cognitive behavioral therapy, psychosocial problems, usability evaluation, heuristic evaluation, System Usability Scale, cognitive interviewing, hand therapists, technology acceptance model, ADDIE model
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Development and usability testing of a web-based and therapist-assisted coping skills program for managing psychosocial problems in individuals with hand and upper limb injuries: Mixed methods study. https://app.cochat.ai/papers/10.2196/17088
- The paper
- Babatunde, F. O., MacDermid, J., Grewal, R., Macedo, L., & Szekeres, M. (2020). Development and usability testing of a web-based and therapist-assisted coping skills program for managing psychosocial problems in individuals with hand and upper limb injuries: Mixed methods study. JMIR Human Factors. https://doi.org/10.2196/17088
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.