The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
The readability of scientific texts is decreasing over time
Open accessPublished version of a preprint
Abstract
Clarity and accuracy of reporting are fundamental to the scientific process. Readability formulas can estimate how difficult a text is to read. Here, in a corpus consisting of 709,577 abstracts published between 1881 and 2015 from 123 scientific journals, we show that the readability of science is steadily decreasing. Our analyses show that this trend is indicative of a growing use of general scientific jargon. These results are concerning for scientists and for the wider public, as they impact both the reproducibility and accessibility of research findings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669
Flesch, R. (1948) · Journal of Applied Psychology · doi:10.1037/h0057532 · Cited by 5,391
Natural language processing with Python
Bird, S., Klein, E., & Loper, E. (2009) · CERN Document Server (European Organization for Nuclear Research) · Cited by 3,955
Kincaid, J. P., Fishburne, Jr., Robert P., R., Richard L., C., & Brad, S. (1975) · doi:10.21236/ada006655 · Cited by 3,497
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Fitting Linear Mixed-Effects Models Using lme4
Bates, D. M., Maechler, M., Bolker, B. M., & Walker, S. (2014) · arXiv (Cornell University) · doi:10.3929/ethz-b-000105397 · Cited by 2,541
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888
Evaluating replicability of laboratory experiments in economics
Camerer, C. F., Dreber, A., Forsell, E., Ho, T.-H., Huber, J., Johannesson, M., Kirchler, M., Almenberg, J., Altmejd, A., Chan, T., et al. (2016) · Science · doi:10.1126/science.aaf0918 · Cited by 1,314
The Principles of Readability.
DuBay, W. H. (2004) · Cited by 1,249
Reproducibility in Science: Improving the Standard for Basic and Preclinical Research
Begley, C. G., & Ioannidis, J. P. A. (2015) · Circulation Research · doi:10.1161/circresaha.114.303819 · Cited by 1,035
(1995) · Medical Entomology and Zoology · Cited by 706
Assessing Readability of Patient Education Materials: Current Role in Orthopaedics
Badarudeen, S., & Sabharwal, S. (2010) · Clinical Orthopaedics & Related Research · doi:10.1007/s11999-010-1380-y · Cited by 657
Miller, J. D. (2004) · Public Understanding of Science · doi:10.1177/0963662504044908 · Cited by 633
Science communication reconsidered
Bubela, T., Nisbet, M. C., Borchelt, R., Brunger, F., Critchley, C., Einsiedel, E., Geller, G., Gupta, A., Hampel, J., Hyde-Lay, R., et al. (2009) · Nature Biotechnology · doi:10.1038/nbt0609-514 · Cited by 477
Brownell, S. E., Price, J. V., & Steinman, L. (2013) · Europe PMC (PubMed Central) · Cited by 420
The sciences of science communication
Fischhoff, B. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1213273110 · Cited by 362
Didegah, F., & Thelwall, M. (2013) · Journal of Informetrics · doi:10.1016/j.joi.2013.08.006 · Cited by 318
McNutt, M. (2014) · Science · doi:10.1126/science.1250475 · Cited by 291
Benjamin, R. G. (2012) · Educational Psychology Review · doi:10.1007/s10648-011-9181-8 · Cited by 281
Vinkers, C. H., Tijdink, J. K., & Otte, W. M. (2015) · BMJ · doi:10.1136/bmj.h6467 · Cited by 237
(1978) · Applied Ergonomics · doi:10.1016/0003-6870(78)90107-2 · Cited by 231
Readability of Texts: State of the Art
Zamanian, M., & Heydari, P. (2012) · Theory and Practice in Language Studies · doi:10.4304/tpls.2.1.43-53 · Cited by 225
Multiple Authorship: The Contribution of Senior Authors
Drenth, J. P. H. (1998) · JAMA · doi:10.1001/jama.280.3.219 · Cited by 178
Advancing Science Communication: A Survey of Science Communicators
Treise, D. M., & Weigold, M. F. (2002) · Science Communication · doi:10.1177/107554700202300306 · Cited by 165
Readability formulas have even more limitations than Klare discusses
Redish, J. C. (2000) · ACM Journal of Computer Documentation · doi:10.1145/344599.344637 · Cited by 159
True enough: learning to live in a post-fact society
(2008) · Choice Reviews Online · doi:10.5860/choice.45-6552 · Cited by 157
Hartley, J. R. (2013) · Routledge eBooks · doi:10.4324/9781315041445 · Cited by 129
Public communication of science 2.0
Peters, H. P., Dunwoody, S., Allgaier, J., Lo, Y., & Brossard, D. (2014) · EMBO Reports · doi:10.15252/embr.201438979 · Cited by 111
Lay summaries needed to enhance science communication
Kuehne, L. M., & Olden, J. D. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1500882112 · Cited by 104
Scientific Communication and the Nature of Science
Nielsen, K. H. (2012) · Science & Education · doi:10.1007/s11191-012-9475-3 · Cited by 103
Six authors in search of a citation: villains or victims of the Vancouver convention?
Epstein, R. J. (1993) · BMJ · doi:10.1136/bmj.306.6880.765 · Cited by 98
Improving the Clarity of Journal Abstracts in Psychology: The Case for Structure
Hartley, J. R. (2003) · Science Communication · doi:10.1177/1075547002250301 · Cited by 97
The growing inaccessibility of science
Hayes, D. P. (1992) · Nature · doi:10.1038/356739a0 · Cited by 86
Testing a readable writing approach to text revision.
Duffy, T. M., & U'Ren, P. K. (1982) · Journal of Educational Psychology · doi:10.1037/0022-0663.74.5.733 · Cited by 85
An evaluation of structured abstracts in journals published by the British Psychological Society
Hartley, J. R., & Benjamin, M. (1998) · British Journal of Educational Psychology · doi:10.1111/j.2044-8279.1998.tb01303.x · Cited by 76
Three ways to improve the clarity of journal abstracts
Hartley, J. R. (1994) · British Journal of Educational Psychology · doi:10.1111/j.2044-8279.1994.tb01106.x · Cited by 37
Abstract readability as a factor in information systems
Dronberger, G. B., & Kowitz, G. T. (1975) · Journal of the American Society for Information Science · doi:10.1002/asi.4630260206 · Cited by 27
The reliability of readability formulae
Stokes, A. (1978) · Journal of Research in Reading · doi:10.1111/j.1467-9817.1978.tb00170.x · Cited by 25
Chasing 60% of maternal deaths in the post-fact era
Nordenstedt, H., & Rosling, H. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31793-7 · Cited by 17
Journalists and Novelists: A Study of Diverging Styles
Danielson, W. A., Lasorsa, D. L., & Im, D. S. (1992) · Journalism Quarterly · doi:10.1177/107769909206900217 · Cited by 8
Research works printed but not linked: 11
- Bruce, 1981, Why readability formulas fail, IEEE Transactions on Professional Communication, 24, 50, 10.1109/TPC.1981.6447826 · doi:10.1109/tpc.1981.6447826
- Danielson, 1987, Readability formulas: a necessary evil?, Reading Horizons, 27
- Hinnant, 2009, Tacit understandings of health literacy, Science Communication, 31, 84, 10.1177/1075547009335345 · doi:10.1177/1075547009335345
- Jatowt, 2012, Longitudinal analysis of historical texts’ readability, Proceedings of the 12th ACM/IEEE-CS Joint Conference on Digital Libraries, 353, 10.1145/2232817.2232887 · doi:10.1145/2232817.2232887
- Knight, 2003, Scientific literacy: Clear as mud, Nature, 423, 376, 10.1038/423376a · doi:10.1038/423376a
- Kovalchik S. 2016. RISmed: Download Content from NCBI Databases. R Package Version. 2.1.6.
- Lim, 2008, The Anti-Intellectual Presidency: The Decline of Presidential Rhetoric From George Washington To George W Bush, 10.1093/acprof:oso/9780195342642.001.0001 · doi:10.1093/acprof:oso/9780195342642.001.0001
- Redish, 1985, The place of readability formulas in technical communication, Journal of Reading Behavior, 32, 46
- Schmid, 1994, Proceedings of the International Conference on New Methods in Language Processing, 44
- Štajner, 2012, Workshop on Natural Language Processing for Improving Textual Accessibility, 14
- Stevenson, 1964, Readability of conservative and sensational papers since 1872, Journalism Quarterly, 41, 201, 10.1177/107769906404100206 · doi:10.1177/107769906404100206
Cited by
Towards reproducible computational drug discovery
Schaduangrat, N., Lampa, S., Simeon, S., Gleeson, M. P., Spjuth, O., & Nantasenamat, C. (2020) · Journal of Cheminformatics · doi:10.1186/s13321-020-0408-x · Cited by 208
Zombie leadership: Dead ideas that still walk among us
Haslam, S. A., Alvesson, M., & Reicher, S. D. (2024) · The Leadership Quarterly · doi:10.1016/j.leaqua.2023.101770 · Cited by 100
Scientific novelty beyond the experiment
Hallsworth, J. E., Udaondo, Z., Pedrós‐Alió, C., Höfer, J., Benison, K. C., Lloyd, K. G., Cordero, R. J. B., de Campos, C. B. L., Yakimov, M. M., & Amils, R. (2023) · Microbial Biotechnology · doi:10.1111/1751-7915.14222 · Cited by 62
Ante, L. (2022) · Journal of Informetrics · doi:10.1016/j.joi.2022.101252 · Cited by 63
Software support for environmental evidence synthesis
Westgate, M. J., Haddaway, N. R., Cheng, S. H., McIntosh, E. J., Marshall, C., & Lindenmayer, D. B. (2018) · Nature Ecology & Evolution · doi:10.1038/s41559-018-0502-x · Cited by 51
Metadata
- Authors
- Plavén-Sigray, P., Matheson, G. J., Schiffler, B. C., & Thompson, W. H.
- Venue
- eLife
- Publisher
- eLife Sciences Publications, Ltd
- Published
- 2017-09-05
- Volume
- 6
- ISSN
- 2050-084X (ISSN-L)
- OpenAlex
- W2888211956
- Cited by
- 257
- References
- 41
- FWCI
- 10.66
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0/ (vor)
- creativecommons.org/licenses/by/4.0/ (am)
- creativecommons.org/licenses/by/4.0/ (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.