CoChat

Advancing science or advancing careers? Researchers’ opinions on success indicators

Open access
Aubert Bonn, Noémie, Pinxten, Wim · 2021 · PLOS ONE

Published version of a preprint

Cited by 54

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

Abstract

The way in which we assess researchers has been under the radar in the past few years. Critics argue that current research assessments focus on productivity and that they increase unhealthy pressures on scientists. Yet, the precise ways in which assessments should change is still open for debate. We circulated a survey with Flemish researchers to understand how they work, and how they would rate the relevance of specific indicators used in research assessments. We found that most researchers worked far beyond their expected working schedule. We also found that, although they spent most of their time doing research, respondents wished they could dedicate more time to it and spend less time writing grants and performing other activities such as administrative duties and meetings. When looking at success indicators, we found that indicators related to openness, transparency, quality, and innovation were perceived as highly important in advancing science, but as relatively overlooked in career advancement. Conversely, indicators which denoted of prestige and competition were generally rated as important to career advancement, but irrelevant or even detrimental in advancing science. Open comments from respondents further revealed that, although indicators which indicate openness, transparency, and quality (e.g., publishing open access, publishing negative findings, sharing data, etc.) should ultimately be valued more in research assessments, the resources and support currently in place were insufficient to allow researchers to endorse such practices. In other words, current research assessments are inadequate and ignore practices which are essential in contributing to the advancement of science. Yet, before we change the way in which researchers are being assessed, supporting infrastructures must be put in place to ensure that researchers are able to commit to the activities that may benefit the advancement of science.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0243664

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 19

  1. L Butler, 2003, Modifying publication practices in response to funding formulas, Research Evaluation, 12, 39, 10.3152/147154403781776780 · DOI · Paper page
  2. J Tregoning, 2018, How will you judge me if not by impact factor?, Nature, 558, 345, 10.1038/d41586-018-05467-5 · DOI
  3. N Aubert Bonn, 2020, Rethinking success, integrity, and culture in research (Part 1)—A multi-actor qualitative study on success in science, bioRxiv
  4. N Aubert Bonn, 2020, Rethinking success, integrity, and culture in research (Part 2)—A multi-actor qualitative study on problems of science, bioRxiv
  5. E Allen, 2007, Likert Scales and Data Analyses, Quality Progress, 40, 64
  6. SS Mangiafico, 2016, Summary and Analysis of Extension Program Evaluation in R, 152
  7. T Imai, 2016, Validity and reproducibility of self-reported working hours among Japanese male employees, J Occup Health, 58, 340, 10.1539/joh.15-0260-OA · DOI
  8. A Barnett, 2019, Working 9 to 5, not the way to make an academic living: observational analysis of manuscript and peer review submissions over time, BMJ, 367
  9. K Powell, 2016, Young, talented and fed-up: scientists tell their stories, Nature, 538, 446, 10.1038/538446a · DOI
  10. B Maher, 2016, Young scientists under pressure: what the data show, Nature, 538, 444, 10.1038/538444a · doi:10.1038/538444a
  11. JK Tijdink, 2016, How do scientists perceive the current publication culture? A qualitative focus group interview study among Dutch biomedical researchers, BMJ Open, 6, e008681, 10.1136/bmjopen-2015-008681 · DOI · Paper page
  12. C Woolston, 2017, Graduate survey: A love–hurt relationship, Nature, 550, 549, 10.1038/nj7677-549a · DOI · Paper page
  13. MA Padilla, 2016, Burning Out Faculty at Doctoral Research Universities, Stress and health: journal of the International Society for the Investigation of Stress, 32, 551, 10.1002/smi.2661 · DOI · Paper page
  14. 2019, The mental health of PhD researchers demands urgent attention, Nature, 575, 257, 10.1038/d41586-019-03489-1 · DOI
  15. K Stroobants, 2013, Flanders overrates impact factors, Nature, 500, 29, 10.1038/500029b · doi:10.1038/500029b
  16. D Moher, 2020, The Hong Kong Principles for assessing researchers: Fostering research integrity, PloS Biol, 18, e3000737, 10.1371/journal.pbio.3000737 · DOI · Paper page
  17. S Saha, 2003, Impact factor: a valid measure of journal quality?, J Med Libr Assoc, 91, 42
  18. BC Martinson, 2011, The academic birth rate. Production and reproduction of the research work force, and its effect on innovation and research misconduct, EMBO Rep, 12, 758, 10.1038/embor.2011.142 · DOI
  19. DL Herbert, 2013, On the time spent preparing grant proposals: an observational study of Australian researchers, BMJ Open, 3, e002800, 10.1136/bmjopen-2013-002800 · DOI · Paper page

Cited by

See all 54

Metadata

Authors
Aubert Bonn, N., & Pinxten, W.
Venue
PLOS ONE
Published
2021-02-11
Volume
16
Issue
2
Pages
e0243664
ISSN
1932-6203 (ISSN-L)
OpenAlex
W3126686681
Cited by
54
References
7
FWCI
4.66
Type
journal article
Language
en
Open access
gold
Funders
Bijzonder Onderzoeksfonds (15NI05)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.