Are the abstracts of high impact articles more readable? Investigating the evidence from top research institutions in the world
The DOI matches its Crossref record; 34 of the 35 references it cites were found in a registry or an index.
Abstract
This paper examines the abstracts of the articles of the five most cited institutions in the world to determine their text reading level. Around 260,000 articles were analysed during 2000—2009 and the Flesch reading ease (RE) formula was applied to calculate the difficulty level of the abstracts according to the readability scores. The present study tries to: determine the abstracts reading level; discover the difference in the abstracts reading level among various disciplines; check the changes in the reading level of the abstracts during the examined years; test the correlation between the readability of the abstracts and their scientific impact. The results revealed that the texts of the abstracts are very difficult to read. Although this fact is true for all disciplines, disciplines can be divided into two groups based on their reading level, with some clearly less readable than others. No considerable change was observed in the readability scores of the abstracts over the examined years. Although the results of this research indicate that academics always write their abstracts in a difficult manner, these findings may result from the limitations in the readability formulas. Some researchers argue that these formulas ignore the readers’ prior knowledge, interest and motivation and, based on the findings, it is clear that academics do tolerate such apparently difficult texts (RE score).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Research indicates that abstracts of articles typically receive more attention from readers than complete manuscripts, and this pattern likely extends to SR and MA as well.[3,4]”
From Quality of Reporting Abstracts of Systematic Reviews and Meta-Analysis in Preventive Dentistry: An Assessment Using the PRISMA 2020 Extension (2026) · cites this paper as [4]
Citations
Cites
Flesch, R. (1948) · Journal of Applied Psychology · doi:10.1037/h0057532 · Cited by 5,391 · cited 2×
“The result of the formula is a score normally ranging from undefined/unlimited negative results (there is no theoretical lower bound on the score) to a maximum positive score of 120, in which the lower score means the text is more difficult to read [15].”
BackgroundMethodThe Principles of Readability.
DuBay, W. H. (2004) · Cited by 1,249
The measurement of readability: useful information for communicators
Klare, G. R. (2000) · ACM Journal of Computer Documentation · doi:10.1145/344599.344630 · Cited by 504
Klare, G. R. (1963) · Cited by 480
Comprehension and recall of text as a function of content variables
Kintsch, W., Kozminsky, E., Streby, W. J., McKoon, G., & Keenan, J. M. (1975) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(75)80065-x · Cited by 404 · cited 1×
“[32] showed that stories are easier to remember than technical texts because they are related to human goals and actions.”
BackgroundThe quest for citations: Drivers of article impact
Stremersch, S., Verniers, I., & Verhoef, P. C. (2007) · Journal of Marketing · doi:10.1509/jmkg.71.3.171 · Cited by 400 · cited 1×
“Stremersch, Verniers and Verhoef [30] and Hartley, Sotto and Pennebaker [22] examined the correlation between the number of times articles were cited and their readability, and came to the same conclusions.”
BackgroundPearson, P. D., Hansen, J., & Gordon, C. (1979) · Journal of Reading Behavior · doi:10.1080/10862967909547324 · Cited by 382 · cited 1×
“This argument is also confirmed by some other studies such as Woern [33], Pearson, Hanson and Gordon [34], Fass and Schumacher [35], etc.”
ResultThe use of readability formulas in health care
Ley, P., & Florio, T. (1996) · Psychology, Health & Medicine · doi:10.1080/13548509608400003 · Cited by 341
Unintelligible Management Research and Academic Prestige
Armstrong, J. S. (1980) · Interfaces · doi:10.1287/inte.10.2.80 · Cited by 208
Linguistic Complexity and Text Comprehension: Readability Issues Reconsidered
Perfetti, C. A., Davison, A., & Green, G. M. (1989) · Language · doi:10.2307/415234 · Cited by 148
Research works printed but not linked: 11
- H. Marcovitch, 2008, Journalology, 6, 237
- L. Wiest, 2003, Philosophy of Mathematics Education Journal
- C.L. Palmer, 2009, Scholarly Information Practices in the Online Environment
- E. Dale, 1949, Elementary English, 26, 23
- J. Hartley, 2000, Bulletin of the Medical Library Association, 88, 332
- S.L. Mailloux, 1995, Computers and Nursing, 13, 221
- J. Hartley, 1992, Psychology Teaching Review, 1, 46
- M. Pinto, 1999, Library Trends, 48, 234
- C. Tenopir, 1993, Online, 17, 44
- J. Adams, 2007, Report for HEFCE
- E.B. Entin, 1985, Advances in Reading/Language Research, 3, 9
Cited by
Didegah, F., & Thelwall, M. (2013) · Journal of Informetrics · doi:10.1016/j.joi.2013.08.006 · Cited by 318
“There are numerous readability measures available but each of them has its own limitations (Gazni, 2011).”
BackgroundMethodInfluentialTo know is not enough: research knowledge and its use
Levin, B. (2013) · Review of Education · doi:10.1002/rev3.3001 · Cited by 280
The Impact of Author-Selected Keywords on Citation Counts
Uddin, S., & Khan, A. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.10.004 · Cited by 143
Can ChatGPT effectively complement teacher assessment of undergraduate students’ academic writing?
Lu, Q., Yao, Y., Xiao, L., Yuan, M., Wang, J., & Zhu, X. (2024) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2024.2301722 · Cited by 137
“…‘IMraD (Introduction, Methods, results, and Discussion)’ structure for social sciences academic writing (Tabuena 2020) and emphasized readability (Gazni 2011). since both the ability to organize the content logically (reflected in the first four dimensions) and express the content concisely…”
Zhou, S., Jeong, H., & Green, P. (2017) · IEEE Transactions on Professional Communication · doi:10.1109/tpc.2016.2635720 · Cited by 124
Metadata
- Authors
- Gazni, A.
- Affiliations
- Islamic World Science Citation Center (ISC), Shiraz, Iran,
- Corresponding author
- Gazni, Ali
- ORCID
- Gazni, Ali
- Venue
- Journal of Information Science
- Publisher
- SAGE Publications
- Published
- 2011-05-09
- Volume
- 37
- Issue
- 3
- Pages
- 273-281
- ISSN
- 0165-5515 (ISSN-L)
- 1741-6485
- OpenAlex
- W2107927577
- Cited by
- 75
- References
- 35
- Citations by year
- 2026: 8 · 2025: 3 · 2024: 6 · 2023: 5 · 2022: 9 · 2021: 13 · 2020: 2 · 2019: 4 · 2018: 5 · 2017: 4 · 2016: 6 · 2015: 2 · 2014: 2 · 2013: 5 · 2012: 1
- FWCI
- 16.31
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of Information Science (publishedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Linguistics and Language › Text Readability and Simplification
- Keywords
- Flesch Reading Ease, scientific writing, readability formulas, scientific impact, academic writing quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Are the abstracts of high impact articles more readable? Investigating the evidence from top research institutions in the world. https://app.cochat.ai/papers/10.1177/0165551511401658
- The paper
- Gazni, A. (2011). Are the abstracts of high impact articles more readable? Investigating the evidence from top research institutions in the world. Journal of Information Science. https://doi.org/10.1177/0165551511401658
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.