Five years post-DORA: promoting best practices for research assessment
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
The San Francisco Declaration on Research Assessment (DORA) was penned 5 years ago to articulate best practices for how we communicate and judge our scientific contributions. In particular, it adamantly declared that Journal Impact Factor (JIF) should never be used as a surrogate measure of the quality of individual research contributions, or for hiring, promotion, or funding decisions. Since then, a heightened awareness of the damaging practice of using JIFs as a proxy for the quality of individual papers, and to assess an individual’s or institution’s accomplishments has led to changes in policy and the design and application of best practices to more accurately assess the quality and impact of our research. Herein I summarize the considerable progress made and remaining challenges that must be met to ensure a fair and meritocratic approach to research assessment and the advancement of research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hutchins, B. I., Yuan, X., Anderson, J. M., & Santangelo, G. M. (2016) · PLoS Biology · doi:10.1371/journal.pbio.1002541 · Cited by 500 · cited 1×
“• Researchers are developing new article-level and field-independent metrics that provide a more accurate and transparent approach to research assessment (Hutchins et al., 2016; Santangelo, 2017).”
BackgroundQuan (2017) · doi:10.1108/ajim-01-2017-0014 · Cited by 306 · cited 1×
“• Researchers are developing new article-level and field-independent metrics that provide a more accurate and transparent approach to research assessment (Hutchins et al., 2016; Santangelo, 2017).”
BackgroundPublication metrics and success on the academic job market
van Dijk, D., Manor, O., & Carey, L. B. (2014) · Current Biology · doi:10.1016/j.cub.2014.04.039 · Cited by 238
Accelerating scientific publication in biology
Vale, R. D. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1511912112 · Cited by 208
Cited by
Roldan-Valadez, E., Salazar-Ruiz, S. Y., Ibarra-Contreras, R., & Rios, C. (2019) · Irish Journal of Medical Science (1971 -) · doi:10.1007/s11845-018-1936-5 · Cited by 443
Changing how we evaluate research is difficult, but not impossible
Hatch, A., & Curry, S. (2020) · eLife · doi:10.7554/elife.58654 · Cited by 55
False authorship: an explorative case study around an AI-generated article published under my name
Spinellis, D. (2025) · Research Integrity and Peer Review · doi:10.1186/s41073-025-00165-z · Cited by 37
From methods to monographs: fostering a culture of research quality
Crawford, D. C., Hoye, M. L., & Silberberg, S. D. (2023) · eneuro · doi:10.1523/eneuro.0247-23.2023 · Cited by 25
“Therefore, many suggest that researcher assessment by institutions and funders should be refocused away from JIF and other bibliometrics (Hicks et al., 2015; Schmid, 2017; Mckiernan et al., 2019; Moher et al., 2020), including Collins and Tabak: “University promotion and tenure committees must resist the temptation to…”
BackgroundInfluentialScientific impact and the quest for visibility
Madsen, R. R. (2019) · The FEBS Journal · doi:10.1111/febs.15043 · Cited by 12
Metadata
- Authors
- Schmid, S. L.
- Venue
- Molecular Biology of the Cell
- Published
- 2017-11
- Volume
- 28
- Issue
- 22
- Pages
- 2941-2944
- ISSN
- 1059-1524 (ISSN-L)
- 1939-4586
- OpenAlex
- W2766500274
- Cited by
- 51
- References
- 4
- FWCI
- 3.85
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Five years post-DORA: promoting best practices for research assessment. https://app.cochat.ai/papers/10.1091/mbc.e17-08-0534
- The paper
- Schmid, S. L. (2017). Five years post-DORA: promoting best practices for research assessment. Molecular Biology of the Cell. https://doi.org/10.1091/mbc.e17-08-0534
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.