An analysis of the titles of papers submitted to the UK REF in 2014: authors, disciplines, and stylistic details
Open accessThe DOI matches its Crossref record; 37 of the 38 references it cites were found in a registry or an index.
Abstract
In 2014 over 52,000 academics submitted >155,500 journal articles in 36 different disciplines for assessment in the UK's four-year Research Evaluation Framework (the REF). In this paper the characteristics of the titles of these papers are assessed. Although these varied considerably between the disciplines, the main findings were that: (i) the lengths of the titles increased with the number of authors in almost all disciplines, (ii) the use of colons and question marks tended to decline with increasing author numbers-although there were a few disciplines, such as economics, where the reverse was evident, (iii) papers published later on in the 4-year period tended to have more authors than those published earlier, and (iv), in some disciplines, the numbers of subsequent citations to papers were higher when the titles were shorter and when they employed colons but lower when they used question marks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Although longer titles may provide more information regarding the content, they reduce the interest generated (39).”
From The Principles of Biomedical Scientific Writing: Title (2019) · cites this paper as [39]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
What is research collaboration?
Katz, J. S., & Martin, B. R. (1997) · Research Policy · doi:10.1016/s0048-7333(96)00917-1 · Cited by 2,972 · cited 1×
“Katz and Martin (1997) focus specifically on coauthorship and the extent to which it coincides with collaboration.”
BackgroundCollaborative Research Across Disciplinary and Organizational Boundaries
Cummings, J. N., & Kiesler, S. (2005) · Social Studies of Science · doi:10.1177/0306312705055535 · Cited by 759 · cited 1×
“Cummings and Kiesler (2005) analyse the coordination costs with respect to researchers in multi-university collaborations, mainly in the sciences and engineering but also psychology and mathematics.”
BackgroundGroups That Work (And Those That Don't): Creating Conditions for Effective Teamwork
Mathiasen, D. G., & Hackman, J. R. (1991) · Journal of Policy Analysis and Management · doi:10.2307/3325003 · Cited by 567
Reflections on Scientific Collaboration (and its study): Past, Present, and Future
Beaver, D. D. (2001) · Scientometrics · doi:10.1023/a:1014254214337 · Cited by 526
Cronin, B. (2001) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.1097 · Cited by 500 · cited 1×
“Indeed it may be, as suggested by Cronin (2001), that not all authors contribute to the writing of the paper rather than the research.”
BackgroundPersson, O., Glänzel, W., & Danell, R. (2004) · Scientometrics · doi:10.1023/b:scie.0000034384.35498.7d · Cited by 494 · cited 1×
“10 Thus, for example Persson et al. (2004) find the number of references to increase with the number of authors, which of course has implications for the text of the paper itself. the whole of scientific work the results from a partial analysis.”
BackgroundArticle title type and its relation with the number of downloads and citations
Jamali, H. R., & Nikzad, M. (2011) · Scientometrics · doi:10.1007/s11192-011-0412-z · Cited by 332 · cited 1×
“However seeming to contradict this, Jamali and Nikzad (2011) detected a negative, although insignificant, correlation between citations and title length.”
ResultTrends in Multi-Authored Papers in Economics
Hudson, J. (1996) · Journal of Economic Perspectives · doi:10.1257/jep.10.3.153 · Cited by 289 · cited 1×
“There is also evidence to link the structure and style of the title to the number of authors, which in itself has tended to increase over time (Hudson 1996).”
BackgroundSelf-citationJacques, T. S., & Sebire, N. J. (2010) · JRSM Short Reports · doi:10.1258/shorts.2009.100020 · Cited by 220
Co-authorship and the output of academic economists
Hollis, A. (2001) · Labour Economics · doi:10.1016/s0927-5371(01)00041-0 · Cited by 206 · cited 2×
“Katz and Martin (1997) focus specifically on coauthorship and the extent to which it coincides with collaboration.”
Background
Cited by
How do authors select keywords? A preliminary study of author keyword selection behavior
Lu, W. P., Liu, Z., Huang, Y., Bu, Y., Li, X., & Cheng, Q. (2020) · Journal of Informetrics · doi:10.1016/j.joi.2020.101066 · Cited by 141
Hyland, K., & Zou, H. (2022) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2022.101094 · Cited by 104
“In the largest study to date, Hudson (2016) examined the impact of multiple authorship on the titles of papers submitted to the UK ’ s four-yearly Research Evaluation Framework (the REF) in 2014.”
BackgroundInfluentialAcademic publishing and the attention economy
Hyland, K. (2023) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2023.101253 · Cited by 95
The Principles of Biomedical Scientific Writing: Title
Bahadoran, Z., Mirmiran, P., Kashfi, K., & Ghasemi, A. (2019) · International Journal of Endocrinology and Metabolism · doi:10.5812/ijem.98326 · Cited by 61
Milojević, S. (2017) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2017.00002 · Cited by 62
“This trend has naturally led some researchers to examine whether the change in authorship had an effect on title construction (e.g., Hudson, 2016).”
BackgroundInfluential
Metadata
- Authors
- Hudson, J.
- Affiliations
- University of Bath (GB)
- Corresponding author
- Hudson, John
- ORCID
- Hudson, John
- Venue
- Scientometrics
- Published
- 2016-07-29
- Volume
- 109
- Issue
- 2
- Pages
- 871-889
- ISSN
- 0138-9130 (ISSN-L)
- 1588-2861
- PMC
- PMC5065898
- OpenAlex
- W2500177191
- Cited by
- 54
- References
- 38
- Citations by year
- 2026: 2 · 2025: 7 · 2024: 6 · 2023: 8 · 2022: 7 · 2021: 6 · 2020: 7 · 2019: 5 · 2017: 4 · 2016: 2
- FWCI
- 3.42
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Scientometrics (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- research paper titles, title length, authorship, disciplinary differences, punctuation, colon, question marks, citation impact, Research Excellence Framework, journal articles
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An analysis of the titles of papers submitted to the UK REF in 2014: authors, disciplines, and stylistic details. https://app.cochat.ai/papers/10.1007/s11192-016-2081-4
- The paper
- Hudson, J. (2016). An analysis of the titles of papers submitted to the UK REF in 2014: authors, disciplines, and stylistic details. Scientometrics. https://doi.org/10.1007/s11192-016-2081-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
