CoChat

Understanding Plain English summaries. A comparison of two approaches to improve the quality of Plain English summaries in research reports

Open access
Kirkpatrick, Emma, Gaisford, Wendy, Williams, Elaine, Brindley, Elizabeth, Tembo, Doreen, Wright, David · 2017 · Research Involvement and Engagement
Cited by 39

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

Abstract

PLAIN ENGLISH SUMMARY: There is a need for the authors of research reports to be able to communicate their work clearly and effectively to readers who are not familiar with the research area. The National Institute for Health Research (NIHR), along with a number of other funding bodies and journals, require researchers to write short lay summaries, often termed plain English summaries (PESs), to make research accessible to the general public. Because many researchers write using technical, specialised language, particularly in scientific reports, writing PESs can be challenging. In this study we looked at how to improve the quality of PESs. We took PESs which had been submitted to the NIHR Journals Library and asked authors to rewrite them using new guidance. We also asked an independent medical writer to edit the summaries. We measured the quality of these three versions (original summary, rewritten summary and edited summary) in two ways. First, we asked a group of people who were not specialists in the subject area to read and rate how easy the summaries were to understand. Secondly, we used a well-known measure called the Flesch reading ease score to assess how easy the PESs were to read. We found that there was no difference in how easy people found the summaries to understand across the three versions. However, the PESs that were rewritten by the authors and that were edited by the independent medical writer were both easier to read than the originals. This shows that PESs can be improved and for organisations who feel that employing an independent writer to edit summaries, providing clear, practical guidance to authors may be a cost-effective alternative. BACKGROUND: Plain English summaries (PES) or lay summaries are often included as part of research reports and journal articles. These summaries are vital to ensure that research findings are accessible and available to non-specialist audiences, for example patients and members of the public. Writing a PES requires the adoption of a different style than is generally used in a traditional scientific report, and researchers can find this challenging. This study explored two possible ways to improve the quality of PESs in the NIHR Journals Library: 1) Providing enhanced guidance to authors and asking them to rewrite the PES and 2) Employing an independent medical writer to edit the PES. METHODS: We compared the three versions of the PES (original, author rewritten and independent writer edited) to assess 1) how easy they were to understand and 2) how easy they were to read. In order to establish how easy PESs were to understand, a group of 60 public reviewers read a set of summaries and rated them on a four point scale from "Did not understand" to "Understood all". The Flesch reading ease score was used to measure how easy the summaries were to read. RESULTS: Results indicated no significant difference across the three versions of the PES in terms of ease of understanding. However, both the author rewritten and independent writer edited versions were significantly easier to read than the original. There was no significant difference in ease of reading between these two versions. CONCLUSION: These findings suggest that employing independent medical writers to edit PESs and providing clear, practical guidance to authors are two ways in which the readability of PESs could be improved. Results have implications for journal editors and publishers seeking to enhance accessibility and availability of research findings.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s40900-017-0064-0

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 1 references

Cited by

See all 39

Metadata

Authors
Kirkpatrick, E., Gaisford, W., Williams, E., Brindley, E., Tembo, D., & Wright, D.
Venue
Research Involvement and Engagement
Published
2017-10-09
Volume
3
Issue
1
Pages
17-17
ISSN
2056-7529 (ISSN-L)
OpenAlex
W2749105991
Cited by
39
References
1
FWCI
11.66
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Understanding Plain English summaries. A comparison of two approaches to improve the quality of Plain English summaries in research reports. https://app.cochat.ai/papers/10.1186/s40900-017-0064-0
The paper
Kirkpatrick, E., Gaisford, W., Williams, E., Brindley, E., Tembo, D., & Wright, D. (2017). Understanding Plain English summaries. A comparison of two approaches to improve the quality of Plain English summaries in research reports. Research Involvement and Engagement. https://doi.org/10.1186/s40900-017-0064-0

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.