What Words Are Worth: National Science Foundation Grant Abstracts Indicate Award Funding
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Can word patterns from grant abstracts predict National Science Foundation (NSF) funding? In an analysis of over 7.4 million words covering 19,569 proposals, this article presents evidence that the writing style of NSF grant abstracts corresponds to the amount of money received for the award. The data describe a clear relationship between word patterns and funding magnitude: Grant abstracts that are longer than the average abstract, contain fewer common words, and are written with more verbal certainty receive more money from the NSF (approximately $372 per one-word increase). While such language patterns correspond to award amount, they largely contradict the NSF’s call to communicate science in a plain manner, suggesting an inconsistency between the injunctive norms of the NSF and the descriptive norms of science writing. Broadly, the results support a tradition of research that uses big text data to evaluate social and psychological dynamics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774 · cited 2×
“LIWC’s word counting method is a valid approach to quantify word patterns for spoken and written text (Boyd & Pennebaker, 2015; Tausczik & Pennebaker, 2010), with hundreds of studies using this tool for social and psychological evaluations of language data across disciplines.”
MethodInfluentialFlesch, R. (1948) · Journal of Applied Psychology · doi:10.1037/h0057532 · Cited by 5,391 · cited 2×
“More words per sentence suggests that the text is more complex, since longer sentences are more difficult to read and comprehend than shorter sentences (Flesch, 1948).”
BackgroundExperimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687 · cited 1×
“The effect sizes are largely consistent with other evaluations of language patterns taken from natural data sources, however (Kramer et al., 2014), and the ability to observe these relationships likely benefited from scale.”
ResultLazer, D., Pentland, A., Adamic, L., Aral, S., Barabási, A.-L., Brewer, D., Christakis, N., Contractor, N., Fowler, J., Gutmann, M., et al. (2009) · Science · doi:10.1126/science.1167742 · Cited by 3,365
BERGER, C. R., & CALABRESE, R. J. (1975) · Human Communication Research · doi:10.1111/j.1468-2958.1975.tb00258.x · Cited by 3,006
An Explication of Social Norms
Lapinski, M. K., & Rimal, R. N. (2005) · Communication Theory · doi:10.1111/j.1468-2885.2005.tb00329.x · Cited by 1,424 · cited 1×
“The uptake of these different norm types can have important consequences for how people interpret and perceive a target (Lapinski & Rimal, 2005).”
BackgroundDiurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures
Golder, S. A., & Macy, M. W. (2011) · Science · doi:10.1126/science.1202775 · Cited by 1,155
Linguistic Markers of Psychological Change Surrounding September 11, 2001
Cohn, M. A., Mehl, M. R., & Pennebaker, J. W. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.00741.x · Cited by 808
Pennebaker, J. W. (2011) · New Scientist · doi:10.1016/s0262-4079(11)62167-2 · Cited by 780
When Small Words Foretell Academic Success: The Case of College Admissions Essays
Pennebaker, J. W., Chung, C. K., Frazee, J., Lavergne, G. M., & Beaver, D. I. (2014) · PLoS ONE · doi:10.1371/journal.pone.0115844 · Cited by 568
Cited by
Boyd, R. L., & Schwartz, H. A. (2021) · Journal of Language and Social Psychology · doi:10.1177/0261927x20967028 · Cited by 317
“In particular, research on persuasion has begun to thrive, with scholars starting to leverage language analysis methods in the exploration of how social appraisals are shaped by subtle linguistic cues (Althoff et al., 2014; Markowitz, 2019).”
BackgroundAssessing the mobilization potential of environmental advocacy communication
Gulliver, R., Fielding, K. S., & Louis, W. R. (2021) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2021.101563 · Cited by 28
Promotional language and the adoption of innovative ideas in science
Peng, H., Qiu, H. S., Fosse, H. B., & Uzzi, B. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2320066121 · Cited by 26
“Evidence also suggests that promotional language may play a substantial role in communicating a grant proposal’s merits by helping to convey its originality, novelty, and significance to reviewers (24, 25).”
Background
Metadata
- Authors
- Markowitz, D. M.
- Venue
- Journal of Language and Social Psychology
- Publisher
- SAGE Publications
- Published
- 2019-01-30
- Volume
- 38
- Issue
- 3
- Pages
- 264-282
- ISSN
- 0261-927X (ISSN-L)
- 1552-6526
- OpenAlex
- W2913707598
- Cited by
- 53
- References
- 13
- FWCI
- 4.01
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What Words Are Worth: National Science Foundation Grant Abstracts Indicate Award Funding. https://app.cochat.ai/papers/10.1177/0261927x18824859
- The paper
- Markowitz, D. M. (2019). What Words Are Worth: National Science Foundation Grant Abstracts Indicate Award Funding. Journal of Language and Social Psychology. https://doi.org/10.1177/0261927x18824859
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.