The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Lost in publication: how measurement harms science
Open accessAbstract
ESEP Ethics in Science and Environmental Politics Contact the journal RSS Mailing List Subscribe to our mailing list via Mailchimp HomeLatest VolumeAbout the JournalEditorsTheme Sections ESEP 8:9-11 (2008) - DOI: https://doi.org/10.3354/esep00079 Lost in publication: how measurement harms science Peter A. Lawrence* Department of Zoology, University of Cambridge, Downing Street, Cambridge CB2 3EJ, UK, and MRC Laboratory of Molecular Biology, Hills Road, Cambridge CB2 0QH, UK *Email: pal@mrc-lmb.cam.ac.uk ABSTRACT: Measurement of scientific productivity is difficult. The measures used (impact factor of the journal, citations to the paper being measured) are crude. But these measures are now so universally adopted that they determine most things that matter: tenure or unemployment, a postdoctoral grant or none, success or failure. As a result, scientists have been forced to downgrade their primary aim from making discoveries to publishing as many papers as possible—and trying to work them into high impact factor journals. Consequently, scientific behaviour has become distorted and the utility, quality and objectivity of articles has deteriorated. Changes to the way scientists are assessed are urgently needed, and I suggest some here. KEY WORDS: Impact factors · Citations · h-index · Measurement · Scientific careers Full text in pdf format PreviousNextCite this article as: Lawrence PA (2008) Lost in publication: how measurement harms science. Ethics Sci Environ Polit 8:9-11. https://doi.org/10.3354/esep00079 Export citation Mail this link - Contents Mailing Lists - RSS Facebook - Tweet - linkedIn Cited by Published in ESEP Vol. 8, No. 1. Online publication date: June 03, 2008 Print ISSN: 1863-5415; Online ISSN: ISSN Copyright © 2008 Inter-Research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Graduate students and postdoctoral fellows are pressured into establishing themselves as quickly as possible (Lawrence 2008), and swapping care and vigilance for increased output is almost inevitable unless action is taken.”
From One in four citations in marine biology papers is inappropriate (2010) · cites this paper as Lawrence 2008
Citations
Cites
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669
Babcock, L. C., & Laschever, S. (2003) · Princeton University Press eBooks · doi:10.1515/9780691212845 · Cited by 855
Gender Differences in Publication Output: Towards an Unbiased Metric of Research Performance
Symonds, M. R. E., Gemmell, N. J., Braisher, T. L., Gorringe, K. L., & Elgar, M. A. (2006) · PLoS ONE · doi:10.1371/journal.pone.0000127 · Cited by 363
Lawrence, P. A. (2003) · Nature · doi:10.1038/422259a · Cited by 354
Self-citationLawrence, P. A. (2007) · Current Biology · doi:10.1016/j.cub.2007.06.014 · Cited by 296
Self-citationWomen Don't Ask: Negotiation and the Gender Divide
Solnick, S. J., Babcock, L. C., & Laschever, S. (2004) · Southern Economic Journal · doi:10.2307/4135303 · Cited by 275
The publishing imperative: the pervasive influence of publication metrics
Steele, C., Butler, L., & Kingsley, D. A. (2006) · Learned Publishing · doi:10.1087/095315106778690751 · Cited by 91
Men, Women, and Ghosts in Science
Lawrence, P. A. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040019 · Cited by 58
Self-citationI wish I'd made you angry earlier: essays on science, scientists, and humanity
(1998) · Choice Reviews Online · doi:10.5860/choice.36-2148 · Cited by 50
Uncovering the Biodiversity of Genetic and Reproductive Systems: Time for a More Open Approach
Keller, L. (2006) · The American Naturalist · doi:10.1086/509938 · Cited by 44
Flagged first, then by citations
Cited by
Sorted by citations
Items 101–128 of 128
Bibliometric analysis for Ciencias Marinas 45 years after its inception
Huerta, M. A., Jesús, M. D., & Cabello‐Pasini, A. (2019) · Ciencias Marinas · doi:10.7773/cm.v45i1.2993 · Cited by 2
Intrinsic and Extrinsic Motivation in Academic Management: An Alternative Personalist Approach
Hoevel, C. (2025) · Journal of Human Values · doi:10.1177/09716858251384170 · Cited by 1
Williams, F. I., & Hoell, R. C. (2011) · Journal of Business & Economics Research (JBER) · doi:10.19030/jber.v9i9.5632 · Cited by 1
Nedostaci sadašnjeg sistema vrednovanja naučnika – kako ga usavršiti?
Vučković-Dekić, L. (2014) · Биомедицинска истраживања · doi:10.7251/bii1402072v · Cited by 1
Citation Counts and More Citation Counts: Useful? Interesting? or Counterproductive?
Campbell, J. P. (2017) · Industrial and Organizational Psychology · doi:10.1017/iop.2017.65 · Cited by 1
Vázquez, J. M. (2017) · Revista de Estudios Teóricos y Epistemológicos en Política Educativa · doi:10.5212/retepe.v.2.018 · Cited by 1
Current Trends and the Consequences of Research Activities among Chinese Universities
Amuthenu, S. H. (2019) · OALib · doi:10.4236/oalib.1105847 · Cited by 1
Licandro, Ó. (2023) · Revista Colombiana de Ciencias Sociales · doi:10.21501/22161201.4615 · Cited by 1
Academic Ethos, Pathos, and Logos. Research Ethos
Callaos, N., & Callaos, B. (2014) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 1
Rigorous and Relevant – introducing a critical discourse analysis to the relevance debate
Bäckström, I., & Ahlgren, K. (2018) · European Business Review · doi:10.1108/ebr-11-2016-0151 · Cited by 1
Book Review: The Publish or Perish Book: Your Guide to Effective and Responsible Citation Analysis
Brumback, R. A. (2012) · Journal of Evidence-Based Complementary & Alternative Medicine · doi:10.1177/2156587212438103 · Cited by 1
Framing employment research using behavioural science
Anderson, C. G. (2017) · Stirling Online Research Repository (University of Stirling) · Cited by 1
Jérôme, D. (2008) · Reflets de la physique · doi:10.1051/refdp/2008017
Unequal opportunities in science: expanding our perspectives
David, M. (2013) · Ideas in Ecology and Evolution · doi:10.4033/iee.2013.6.13.f
Notice of Retraction: Renewal model in academic knowledge systems
Kasim, R. S. R., Cope, B., Chik, C. T., & Selaman, F. (2012) · International Conference on Innovation Management and Technology Research · doi:10.1109/icimtr.2012.6236482
RetractedPalea, V. (2015) · Institutional Research Information System University of Turin (University of Turin)
Alvesson, M. G., & Sandberg, J. (2017) · Revista Interdisciplinar de Gestão Social · doi:10.9771/rigs.v5i3.21443 · Cited by 1
Deep Impact: Unintended consequences of journal rank
Brembs, B., Button, K. S., & Munafo, M. R. (2013) · University of Regensburg Publication Server (University of Regensburg) · doi:10.48550/arxiv.1301.3748
Japanese Universities’ Community in International Environment: Maneuvers or Heading Down?
Zhilina, L. V. (2019) · Vestnik RUDN International Relations · doi:10.22363/2313-0660-2019-19-1-119-129
Holmberg, K. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-100273-5.00001-6
Rimoldi, L., & Monchietti, A. (2020) · Iberoromania · doi:10.1515/iber-2020-0021
A Measure of Research TastePreprint
Koltun, V., & Hafner, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.08089 · Cited by 4
(2016) · Wiley eBooks · doi:10.1002/9783527681969.biblio
(2015) · Elsevier eBooks · doi:10.1016/b978-0-08-100273-5.09986-5
The potential of private universities in promotion of national science: Current status and trends
Polikhina, N. A. (2022) · Science Editor and Publisher · doi:10.24069/sep-22-14 · Cited by 1
Teoría y proceso de los dúos en ciencia
Rimoldi, L., & Monchietti, A. (2023) · Prometeica - Revista de Filosofía y Ciencias · doi:10.34024/prometeica.2023.26.14127
Prometeica, R. (2023) · Prometeica - Revista de Filosofía y Ciencias · doi:10.34024/prometeica.2023.26.14894
Metadata
- Authors
- Lawrence, P.
- Venue
- Ethics in Science and Environmental Politics
- Publisher
- Inter-Research Science Center
- Published
- 2008-06-03
- Volume
- 8
- Pages
- 9-11
- ISSN
- 1611-8014 (ISSN-L)
- 1863-5415
- OpenAlex
- W1999768848
- Cited by
- 127
- References
- 11
- Citations by year
- 2025: 2 · 2024: 5 · 2023: 3 · 2022: 3 · 2021: 3 · 2020: 6 · 2019: 7 · 2018: 13 · 2017: 15 · 2016: 5 · 2015: 8 · 2014: 13 · 2013: 11 · 2012: 8
- FWCI
- 9.91
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Ethics in Science and Environmental Politics (publishedVersion, cc-by)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- impact factor, citation analysis, h-index, scientific careers, academic assessment, publication pressure, research quality, tenure and promotion
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review