Developing, Implementing, and Improving Assessment and Treatment Fidelity in Clinical Aphasia Research
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Purpose: The purpose of this study was to describe the development and implementation of a fidelity program for an ongoing, multifacility, aphasia intervention study and to explain how initial fidelity measures are being used to improve study integrity. Method: A Clinical Core team developed and incorporated a fidelity plan in this study. The aims of the Clinical Core team were to (a) supervise data collection and data management at each clinical site, (b) optimize and monitor assessment fidelity, and (c) optimize and monitor treatment fidelity. Preliminary data are being used to guide ongoing efforts to preserve and improve the fidelity of this intervention study. Results: Preliminary results show that specific recruitment strategies help to improve appropriate referrals and that accommodations to participants and their families help to maintain excellent retention. A streamlined and centralized training program assures the reliability of assessors and raters for the study's assessment and treatment protocols. Ongoing monitoring of both assessment and treatment tasks helps to maintain study integrity. Less-than-optimal interrater reliability data for the raters of some of the discourse measures guided the Clinical Core team to address the training and coding inconsistencies in a timely manner. Conclusions: The creation of a Clinical Core team is instrumental in developing and implementing a fidelity plan for improved assessment and treatment fidelity. Intentional planning and assignment of study staff to implement and monitor ongoing fidelity measures assures that clinical data are reliable and valid. Ongoing review of the plan shows areas of strengths and weaknesses for continuing adjustments and improvement of study fidelity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620 · cited 6×
“According to the Behavior Change Consortium workgroup, establishing treatment fidelity should address the following five components (Bellg et al., 2004): (a) study design—the study should be designed appropriately so that hypotheses can be tested and inferences are valid, (b) training—training procedures should be sta…”
BackgroundMethodInfluentialWestern Aphasia Battery--Revised
Kertesz, A. (2012) · PsycTESTS Dataset · doi:10.1037/t15168-000 · Cited by 1,367
Speech and language therapy for aphasia following stroke
Brady, M. C., Kelly, H., Godwin, J., Enderby, P., & Campbell, P. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000425.pub4 · Cited by 1,159
Intensity of Aphasia Therapy, Impact on Recovery
Bhogal, S. K., Teasell, R., & Speechley, M. (2003) · Stroke · doi:10.1161/01.str.0000062343.64383.d0 · Cited by 719
Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.829 · Cited by 533
Hróbjartsson, A., Thomsen, A. S. S., Emanuelsson, F., Tendal, B., Hilden, J., Boutron, I., Ravaud, P., & Brorson, S. (2013) · Canadian Medical Association Journal · doi:10.1503/cmaj.120744 · Cited by 527 · cited 1×
“Additionally, inflated effect sizes are observed when subjective measures are not rated without bias and/or when raters are not properly trained on scoring procedures, again lending strong but unearned support to the intervention (e.g., Hróbjartsson et al., 2013; Stitt et al., 2003).”
BackgroundA meta-analysis of clinical outcomes in the treatment of aphasia
Robey, R. R. (1998) · Journal of Speech, Language, and Hearing Research · doi:10.1044/jslhr.4101.172 · Cited by 506 · cited 7×
“Although the “more treatment is better” view is generally supported (Basso, 2005; Bhogal et al., 2003; Brady et al., 2016; Cherney et al., 2008; Robey, 1998), it is unclear which treatment elements and targets should be emphasized (Barthel et al., 2008; Brady et al., 2016; Robey, 1998) and which…”
BackgroundResultInfluentialClinical trials: The challenge of recruitment and retention of participants
Gul, R. B., & Ali, P. A. (2010) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2009.03041.x · Cited by 449 · cited 4×
“Sufficient time and staffing should be dedicated to recruitment (Gul & Ali, 2010) with the use of more interactive recruitment channels (e.g., telephone, interpersonal communication) versus passive recruitment channels (e.g., mass media; McDonald, 1999).”
BackgroundInfluentialWhat people with aphasia want: Their goals according to the ICF
Worrall, L., Sherratt, S., Rogers, P., Howe, T., Hersh, D., Ferguson, A., & Davidson, B. (2011) · Aphasiology · doi:10.1080/02687038.2010.508530 · Cited by 443
Cited by
Current Approaches to the Treatment of Post-Stroke Aphasia
Fridriksson, J., & Hillis, A. E. (2021) · Journal of Stroke · doi:10.5853/jos.2020.05015 · Cited by 172
Self-citationPeñaloza, C., Scimeca, M., Gaona, A., Carpenter, E., Mukadam, N., Gray, T., Shamapant, S., & Kiran, S. (2021) · Frontiers in Neurology · doi:10.3389/fneur.2021.589330 · Cited by 36
“While it is important to assess whether clinicians who provide the same treatment to different individuals with aphasia do so in the same way to ensure the validity of the therapeutic effects (47), treatment fidelity has been evaluated inconsistently and infrequently in aphasia intervention studies and RCTs (48, 49),…”
BackgroundDiscourse- and lesion-based aphasia quotient estimation using machine learning
Riccardi, N., Nelakuditi, S., den Ouden, D. B., Rorden, C., Fridriksson, J., & Desai, R. H. (2024) · NeuroImage: Clinical · doi:10.1016/j.nicl.2024.103602 · Cited by 8
“Inter and intra rater reliability is completed every spring on 10 % of all transcripts (see Spell et al. (2020)).”
BackgroundMethodSelf-citation
Metadata
- Authors
- Spell, L. A., Richardson, J. D., Basilakos, A., Stark, B. C., Teklehaimanot, A., Hillis, A. E., & Fridriksson, J.
- Venue
- American Journal of Speech-Language Pathology
- Published
- 2020-02-07
- Volume
- 29
- Issue
- 1
- Pages
- 286-298
- ISSN
- 1058-0360 (ISSN-L)
- 1558-9110
- OpenAlex
- W3003198438
- Cited by
- 38
- References
- 13
- FWCI
- 6.71
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Developing, Implementing, and Improving Assessment and Treatment Fidelity in Clinical Aphasia Research. https://app.cochat.ai/papers/10.1044/2019_ajslp-19-00126
- The paper
- Spell, L. A., Richardson, J. D., Basilakos, A., Stark, B. C., Teklehaimanot, A., Hillis, A. E., & Fridriksson, J. (2020). Developing, Implementing, and Improving Assessment and Treatment Fidelity in Clinical Aphasia Research. American Journal of Speech-Language Pathology. https://doi.org/10.1044/2019_ajslp-19-00126
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.