Can the Accuracy of Abstracts Be Improved by Providing Specific Instructions?: A Randomized Controlled Trial
Abstract
CONTEXT: The most-read section of a research article is the abstract, and therefore it is especially important that the abstract be accurate. OBJECTIVE: To test the hypothesis that providing authors with specific instructions about abstract accuracy will result in improved accuracy. DESIGN: Randomized controlled trial of an educational intervention specifying 3 types of common defects in abstracts of articles that had been reviewed and were being returned to the authors with an invitation to revise. MEAN OUTCOME MEASURE: Proportion of abstracts containing 1 or more of the following defects: inconsistency in data between abstract and body of manuscript (text, tables, and figures), data or other information given in abstract but not in body, and/or conclusions not justified by information in the abstract. RESULTS: Of 250 manuscripts randomized, 13 were never revised and 34 were lost to follow-up, leaving a final comparison between 89 in the intervention group and 114 in the control group. Abstracts were defective in 25 (28%) and 30 (26%) cases, respectively (P=.78). Among 55 defective abstracts, 28 (51%) had inconsistencies, 16 (29%) contained data not present in the body, 8 (15%) had both types of defects, and 3 (5%) contained unjustified conclusions. CONCLUSIONS: Defects in abstracts, particularly inconsistencies between abstract and body and the presentation of data in abstract but not in body, occur frequently. Specific instructions to authors who are revising their manuscripts are ineffective in lowering this rate. Journals should include in their editing processes specific and detailed attention to abstracts.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Researchers, clinicians, policymakers, and research consumers depend on knowledge presented in abstracts of SRs/MAs as an initial step.
“Researchers, clinicians, policymakers, and research consumers depend on the knowledge presented in abstracts of SRs/MAs [6] as an initial step.”
Cited by
Sorted by citations
Boutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008 · Cited by 2,292 · see citing works
Cook, D. A., & Reed, D. A. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000786 · Cited by 781 · see citing works
Accuracy of data in abstracts of published research articles
Pitkin, R. M. (1999) · JAMA · doi:10.1001/jama.281.12.1110 · Cited by 302 · see citing works
Self-citationJournal reading habits of internists
Saint, S., Christakis, D. A., Saha, S., Elmore, J. G., Welsh, D. E., Baker, P., & Koepsell, T. D. (2000) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2000.00202.x · Cited by 204 · see citing works
Rosmarakis, E. S., Soteriades, E. S., Vergidis, P. I., Kasiakou, S. K., & Falagas, M. E. (2005) · The FASEB Journal · doi:10.1096/fj.04-3140lfe · Cited by 83 · see citing works
Technical editing of research reports in biomedical journals
Wager, E., & Middleton, P. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000002.pub3 · Cited by 68 · see citing works
Marcelo, A., Gavino, A., Isip-Tan, I. T., Apostol-Nicodemus, L., Mesa-Gaerlan, F. J., Firaza, P. N., Faustorilla, J. F., Callaghan, F. M., & Fontelo, P. (2013) · Evidence Based Medicine · doi:10.1136/eb-2012-100537 · Cited by 63 · see citing works
Technical editing of research reports in biomedical journals
Wager, E., & Middleton, P. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000002.pub2 · Cited by 20 · see citing works
El Ansari, W., AlRumaihi, K., El-Ansari, K., Arafa, M., Elbardisi, H., Majzoub, A., Shamsodini, A., & Al Ansari, A. (2023) · Arab Journal of Urology · doi:10.1080/2090598x.2022.2113127 · Cited by 6 · see citing works
- Authors
- Pitkin, R. M., & Branagan, M. A.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 1998-07-15
- Volume
- 280
- Issue
- 3
- Pages
- 267
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2077230885
- Cited by
- 104
- References
- 0
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 1 · 2023: 2 · 2022: 4 · 2021: 1 · 2020: 2 · 2019: 10 · 2018: 1 · 2017: 5 · 2016: 4 · 2015: 3 · 2014: 4 · 2013: 7 · 2012: 3
- FWCI
- 41.88
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- JAMA (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Academic Writing and Publishing
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Publishing and Scholarly Communication
- Keywords
- author guidelines, manuscript revision, editorial intervention, data inconsistency, peer review, scholarly publishing
- MeSH terms
- Abstracting and Indexing, Humans, Periodicals as Topic, Publishing, Quality Control
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review