The DOI matches its Crossref record; 101 of the 108 references it cites were found in a registry or an index; 50 of the 104 sources its claims cite were checked for support.
Open Science 2.0: Towards a truly collaborative research ecosystem
Open accessAbstract
Conversations about open science have reached the mainstream, yet many open science practices such as data sharing remain uncommon. Our efforts towards openness therefore need to increase in scale and aim for a more ambitious target. We need an ecosystem not only where research outputs are openly shared but also in which transparency permeates the research process from the start and lends itself to more rigorous and collaborative research. To support this vision, this Essay provides an overview of a selection of open science initiatives from the past 2 decades, focusing on methods transparency, scholarly communication, team science, and research culture, and speculates about what the future of open science could look like. It then draws on these examples to provide recommendations for how funders, institutions, journals, regulators, and other stakeholders can create an environment that is ripe for improvement.
Overview
CoChat Summary
TL;DR
This Essay proposes Open Science 2.0, an ecosystem where most research products and processes are openly available and researchers regularly interact with others’ open scholarship to improve rigor and collaboration. It reviews past open science initiatives across methods transparency, scholarly communication, team science, and research culture, then offers seven recommendations for funders, institutions, journals, regulators, and other stakeholders.
Key findings
- The authors define Open Science 2.0 as meeting two criteria: the vast majority of research products and processes are openly available, and scientific actors directly and regularly interact with openly available scholarship to increase research impact and rigor; Open Science 1.0 is proposed as a retronym for widespread openness alone.
- Examples show uneven progress: EQUATOR includes over 500 reporting guidelines; the RRID initiative is in its ninth year with over a thousand journals requesting RRIDs, and sufficient antibody-tracking information rose from 15% in the 1990s to nearly half in 2020. ClinicalTrials.gov and ISRCTN contain over half a million registrations, but preregistration remains around or below 10% in psychology and one preclinical registry had only 161 registrations as of September 2023.
- A meta-analysis of over 2 million publications found 5% to 11% declared publicly available data, but only 1% to 3% actually had publicly available data; code sharing was estimated at <0.5%.
- The authors make seven recommendations: monitor progress and policy compliance; fund open science infrastructure, training, and support; invite innovation; fund meta-research; align incentives across stakeholders; promote teams and specialization; and treat open science as a means, not an end.
Methods
- This is an Essay/commentary, not an empirical study; it synthesizes selected open science initiatives from the past two decades across methods transparency, scholarly communication, team science, and research culture.
- The authors use illustrative examples, Table 1, Fig 1, and three personal-perspective boxes; they do not report primary data collection, systematic review, or formal meta-analysis.
- The paper proposes a conceptual framework for Open Science 2.0 and derives high-level recommendations for stakeholders, stating that advocating for specific platforms or workflows goes beyond its scope.
Limitations
- Stated: the four topics were selected based on the authors’ expertise and are “not intended to be exhaustive”; the recommendations are high-level, and advocating for specific platforms or workflows goes beyond the article’s scope.
- Stated/anticipated: Open Science 2.0 could amplify existing inequalities, since large open datasets are more likely to come from the Global North, may prioritize those populations’ research questions, and can have limited generalizability; requiring high openness and rigor could increase upfront costs and risk excluding researchers in the Global South.
- Evident from the text: as an Essay, it does not systematically search or empirically test the proposed recommendations, and its examples are illustrative rather than a comprehensive assessment of the open science landscape.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
26 Valid · 13 Not valid · 30 Not checked · 50 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“For example, despite the first iteration of the ARRIVE guidelines being endorsed by over a thousand journals [22], they had limited impact on improving transparent reporting, even when authors were explicitly requested to use the ARRIVE checklist [23].”
§ Open Science 2.0: Towards a truly collaborative research ecosystem > Open science: A primer > Methods transparency
What the sources say
- Partly supportedcites [22] V Leung, 2018, ARRIVE has not ARRIVEd: Support for the ARRIVE (Animal Research: Reporting of in vivo Experiments) guidelines does not improve the reporting quality of papers in animal welfare, analgesia or anesthesia, PLoS ONE sourceExperimental — accuracy not yet measured
Two of the three elements are in our copy: the Introduction states that 'Over 1000 journals have responded to publication of the guidelines by linking to it on their websites and in their instructions to authors', and the Discussion/Abstract conclude that 'journal support for the ARRIVE guidelines has not resulted in a meaningful improvement in reporting quality' (SUPP vs nonSUPP fully-reported items 60.5% vs 60.2%, p = 0.89). The qualifier 'even when authors were explicitly requested to use the ARRIVE checklist' is not supported: in this study 'supporting' journals were only those whose instructions to authors mentioned the guidelines, and the paper stresses 'a lack of enforcement of reporting standards' as the common feature of such work. Indeed the Discussion states the contrary for enforced requests — that mandatory checklist submission did improve reporting (bias-criteria reporting 0 → 16.4%, sample-size mention <2% → 58%), crediting that result to other studies it cites [22, 23, 24]. So the citing sentence overstates the source by treating an unenforced mention as an explicit request and by extending 'limited impact' to a condition under which this paper reports improvement. (LLM, conf=0.72)
- Supportedcites [23] IICARus Collaboration, 2019, A randomised controlled trial of an Intervention to Improve Compliance with the ARRIVE guidelines (IICARus), Res Integr Peer Rev source
The IICARus trial is precisely the study in which authors were explicitly requested to complete the ARRIVE checklist, and our copy states in the Discussion that 'Requesting completion of an ARRIVE checklist at submission did not increase full adherence with the ARRIVE guidelines', with median compliance under 40% and improvement in only one subitem (animal husbandry). The Abstract Conclusions echo this: requesting a completed checklist 'is not enough to improve compliance with the ARRIVE guidelines'. The Background also records that since first publication the guidelines 'have been endorsed by many journals in their instructions to authors, but this has not been accompanied by substantial improvements in reporting'. The 'over a thousand journals' figure is carried by the separate citation [22] and is not attributed to this source; our copy says only 'many journals'. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“One unfortunate legacy of the print era—when publishing was expensive and limited in length and structure—is that publications often serve as an advertisement of research rather than a complete record of the research process and outcomes [32].”
§ Open Science 2.0: Towards a truly collaborative research ecosystem > Open science: A primer > Scholarly communication
What the sources say
- Could not verifycites [32] DB Rice, 2020, Academic criteria for promotion and tenure in biomedical sciences faculties: cross sectional analysis of international sample of universities, BMJ sourceExperimental — accuracy not yet measured
Our copy of Rice et al. (BMJ 2020, 10.1136/bmj.m2081) contains no passage stating that publications serve as an advertisement of research rather than a complete record of the research process and outcomes, and nothing about a 'print era' legacy or publishing being expensive and limited in length and structure. The closest material is the Introduction (p.1) noting 'poorly conducted and inadequately reported research remains highly prevalent' and the Discussion/What this study sections on traditional promotion criteria (peer reviewed publications, journal impact) versus transparent reporting, data sharing and registration — themes adjacent to but not the claim's causal/historical assertion. Searched with: 'advertisement of research / complete record of the research process and outcomes', 'print era publishing expensive limited in length and structure', 'full account of what was done / limited reporting of methods, data, and outcomes', and 'traditional publishing model restrictions / open science reporting entire research process'; no decisive passage, and the copy is not truncated. (LLM, conf=0.70)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
Every source the paper cites for this claim was checked and supports it.
In the paper
“Conversations about open science have reached the mainstream, yet many open science practices such as data sharing remain uncommon.”
§ Open Science 2.0: Towards a truly collaborative research ecosystem > Abstract
What the sources say
- Supportedcites [48] DG Hamilton, 2023, Prevalence and predictors of data and code sharing in the medical and health sciences: systematic review with meta-analysis of individual participant data, BMJ source
The Abstract Results (p. null) report meta-analysed prevalence of declared and actual public data availability of 8% (95% CI 5% to 11%) and 2% (1% to 3%) between 2016 and 2021, with public code sharing <0.5%; the Discussion ('Potential implications of our findings') states 'the average prevalence of data sharing is low', and the Conclusion calls such declarations 'rare'. This directly supports the attributed content that data sharing remains uncommon (within medical and health sciences); the wider framing about 'conversations reaching the mainstream' and 'many open science practices' is the citing authors' own, not a claim this source makes. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The predominant model of academic research—where a senior researcher supervises several more junior researchers who each lead almost every aspect of their own project [53]—remains a vestige of an outdated apprenticeship model of scientific research.”
§ Open Science 2.0: Towards a truly collaborative research ecosystem > Open science: A primer > Team science
What the sources say
- Partly supportedcites [53] V Larivière, 2021, Investigating the division of scientific labor using the Contributor Roles Taxonomy (CRediT), Quant Sci Stud sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“For code sharing, the estimate was <0.5%.”
§ Open Science 2.0: Towards a truly collaborative research ecosystem > Open science: A primer > Scholarly communication
What the sources say
- Supportedcites [48] DG Hamilton, 2023, Prevalence and predictors of data and code sharing in the medical and health sciences: systematic review with meta-analysis of individual participant data, BMJ source
The Abstract (Results) states that 'For public code sharing, both the prevalence of declared and actual availability were estimated to be <0.5% since 2016,' and the Discussion's Principal findings section repeats that pooled declared and actual code sharing prevalence estimates were 'both estimated to be <0.5%, with little change over time.' The Results (Public data and code sharing) give the corresponding point estimates of 0.3% (0% to 1%, k=26) declared and 0.1% (0% to 0.3%, k=21) actual, both below 0.5%, so the citing sentence's <0.5% code-sharing estimate is directly supported. (LLM, conf=0.92)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
31 more claims · 18 with their cited sources checked
Create a free account to see all 119 claims and to verify the 54 references still open.
- Probably not a substantial claim. 54
- It may state two separate claims as one. 44
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Open science practices are crucial for prediction model research in healthcare as they promote transparency, reproducibility, and collaboration between researchers.”
From TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods (2024) · cites this paper as [95]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Open Science 2.0: Towards a truly collaborative research ecosystem > Open science: A primer > The open science landscape: A whistle-stop tour
“I will start in the year 2000 with the publication and endorsement by over 1,000 journals of the ARRIVE guidelines for reporting animal research [13,14].”
§ Open Science 2.0: Towards a truly collaborative research ecosystem > References
“13. Kilkenny C, Browne W, Cuthill IC, Emerson M, Altman DG. Animal research: reporting in vivo experiments: the ARRIVE guidelines. Br J Pharmacol. 2010; 160: 1577.”
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764 · cited 1×
“In a particularly striking example, the Alpha Fold Protein Structure Database used AI to predict structures for over 200 million proteins, most of which were based on UniProt sequences [88].”
MethodWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000410 · Cited by 5,939
The Universal Protein Resource (UniProt)
Bairoch, A. (2004) · Nucleic Acids Research · doi:10.1093/nar/gki070 · Cited by 3,774
Animal research: Reporting in vivo experiments: The ARRIVE guidelines
Kilkenny, C., Browne, W., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · British Journal of Pharmacology · doi:10.1111/j.1476-5381.2010.00872.x · Cited by 3,625
The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · Experimental Physiology · doi:10.1113/ep088870 · Cited by 3,497
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Avoidable waste in the production and reporting of research evidence
Chalmers, I., & Glasziou, P. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60329-9 · Cited by 2,208
What makes UK Biobank special?
Collins, R. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60404-8 · Cited by 1,128 · cited 1×
“For example, the UK Biobank contains detailed genetic, biological, and questionnaire data from over 500,000 individuals and has been analyzed by over 30,000 researchers in about 100 countries [59–61].”
BackgroundFoster, E. D., & Deardorff, A. (2017) · Journal of the Medical Library Association · doi:10.5195/jmla.2017.88 · Cited by 715 · cited 1×
“Many of the COS initiatives, such as the Open Science Framework (OSF), facilitate collaborative and transparent research workflows [71].”
BackgroundA roadmap to increase diversity in genomic studies
Fatumo, S., Chikowore, T., Choudhury, A., Ayub, M., Martin, A. R., & Kuchenbaecker, K. (2022) · Nature Medicine · doi:10.1038/s41591-021-01672-4 · Cited by 707
Kidwell, M. C., Lazarević, L. B., Baranski, E., Hardwicke, T. E., Piechowski, S., Falkenberg, L.-S., Kennett, C., Slowik, A., Sonnleitner, C., Hess-Holden, C., et al. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002456 · Cited by 700
Registered Reports: A new publishing initiative at Cortex
Chambers, C. D. (2013) · Cortex · doi:10.1016/j.cortex.2012.12.016 · Cited by 570
The Hong Kong Principles for assessing researchers: Fostering research integrity
Moher, D., Bouter, L., Kleinert, S., Glasziou, P., Sham, M. H., Barbour, V., Coriat, A.-M., Foeger, N., & Dirnagl, U. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000737 · Cited by 540
The past, present and future of Registered Reports
Chambers, C. D., & Tzavella, L. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01193-7 · Cited by 499
Investigating the replicability of preclinical cancer biology
Errington, T. M., Mathur, M., Soderberg, C. K., Denis, A., Perfito, N., Iorns, E., & Nosek, B. A. (2021) · eLife · doi:10.7554/elife.71601 · Cited by 462
Clinical trial registration: a statement from the International Committee of Medical Journal Editors
De Angelis, C., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P., et al. (2004) · The Lancet · doi:10.1016/s0140-6736(04)17034-7 · Cited by 408
McNutt, M. K., Bradford, M., Drazen, J. M., Hanson, B., Howard, B., Jamieson, K. H., Kiermer, V., Marcus, E., Pope, B. K., Schekman, R., et al. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1715374115 · Cited by 392 · cited 1×
“CRediT statements also provide a dataset that meta-researchers can use to study the research ecosystem and realign incentives [53,58].”
BackgroundSayers, E. W., Cavanaugh, M., Clark, K., Ostell, J., Pruitt, K. D., & Karsch-Mizrachi, I. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz956 · Cited by 391
Moshontz, H., Campbell, L., Ebersole, C. R., IJzerman, H., Urry, H. L., Forscher, P. S., Grahe, J. E., McCarthy, R. J., Musser, E. D., Antfolk, J., et al. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918797607 · Cited by 377
Hardwicke, T. E., Mathur, M. B., MacDonald, K., Nilsonne, G., Banks, G. C., Kidwell, M. C., Hofelich Mohr, A., Clayton, E., Yoon, E. J., Henry Tessler, M., et al. (2018) · Royal Society Open Science · doi:10.1098/rsos.180448 · Cited by 336
Hosseini, M., & Horbach, S. P. J. M. (2023) · Research Integrity and Peer Review · doi:10.1186/s41073-023-00133-5 · Cited by 328
An open investigation of the reproducibility of cancer biology research
Errington, T. M., Iorns, E., Gunn, W., Tan, F. E., Lomax, J., & Nosek, B. A. (2014) · eLife · doi:10.7554/elife.04333 · Cited by 312
Berlin Declaration on Open Access to Knowledge in the Sciences and Humanities
(2008) · Cited by 283
UK Biobank: From Concept to Reality
Ollier, W., Sprosen, T., & Peakman, T. (2005) · Pharmacogenomics · doi:10.2217/14622416.6.6.639 · Cited by 278
Rice, D. B., Raffoul, H., Ioannidis, J. P. A., & Moher, D. (2020) · BMJ · doi:10.1136/bmj.m2081 · Cited by 241
Hardwicke, T. E., Wallach, J. D., Kidwell, M. C., Bendixen, T., Crüwell, S., & Ioannidis, J. P. A. (2020) · Royal Society Open Science · doi:10.1098/rsos.190806 · Cited by 217
Claesen, A., Gomes, S., Tuerlinckx, F., & Vanpaemel, W. (2021) · Royal Society Open Science · doi:10.1098/rsos.211037 · Cited by 197
Hardwicke, T. E., Thibault, R. T., Kosie, J. E., Wallach, J. D., Kidwell, M. C., & Ioannidis, J. P. A. (2022) · Perspectives on Psychological Science · doi:10.1177/1745691620979806 · Cited by 187
Self-citationImproving the quality of reporting of randomized controlled trials. The CONSORT statement
Begg, C., Cho, M., Eastwood, S., Horton, R., Moher, D., Olkin, I., Pitkin, R., Rennie, D., Schulz, K. F., Simel, D., et al. (1998) · Revista Española de Salud Pública · doi:10.1590/s1135-57271998000100002 · Cited by 177
Ten commercial antibodies for alpha-1-adrenergic receptor subtypes are nonspecific
Jensen, B. C., Swigart, P. M., & Simpson, P. C. (2009) · Naunyn-Schmiedeberg's Archives of Pharmacology · doi:10.1007/s00210-008-0368-6 · Cited by 176
on behalf of the IICARus Collaboration, Hair, K., Macleod, M. R., & Sena, E. S. (2019) · Research Integrity and Peer Review · doi:10.1186/s41073-019-0069-3 · Cited by 174
Leung, V., Rousseau-Blass, F., Beauchamp, G., & Pang, D. S. J. (2018) · PLOS ONE · doi:10.1371/journal.pone.0197882 · Cited by 172
THE PARTICIPATORY WEB: A user perspective on Web 2.0
Blank, G., & Reisdorf, B. C. (2012) · Information, Communication & Society · doi:10.1080/1369118x.2012.665935 · Cited by 160
Laflamme, C., McKeever, P. M., Kumar, R., Schwartz, J., Kolahdouzan, M., Chen, C. X., You, Z., Benaliouad, F., Gileadi, O., McBride, H. M., et al. (2019) · eLife · doi:10.7554/elife.48363 · Cited by 155
Assessment of transparency indicators across the biomedical literature: How open is open?
Serghiou, S., Contopoulos-Ioannidis, D. G., Boyack, K. W., Riedel, N., Wallach, J. D., & Ioannidis, J. P. A. (2021) · PLOS Biology · doi:10.1371/journal.pbio.3001107 · Cited by 139
Ensuring the quality and specificity of preregistrations
Bakker, M., Veldkamp, C. L. S., van Assen, M. A. L. M., Crompvoets, E. A. V., Ong, H. H., Nosek, B. A., Soderberg, C. K., Mellor, D., & Wicherts, J. M. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000937 · Cited by 138 · cited 1×
“One study found that 2 researchers could only agree on the number of hypotheses in 14% of the preregistrations they assessed [45].”
BackgroundThe Budapest Open Access Initiative
Friend, F. J. (2002) · E-LIS Repository (University of Naples Federico II) · Cited by 130
A proposal for the future of scientific publishing in the life sciences
Stern, B. M., & O’Shea, E. K. (2019) · PLoS Biology · doi:10.1371/journal.pbio.3000116 · Cited by 130
An update to SPIRIT and CONSORT reporting guidelines to enhance transparency in randomized trials
Hopewell, S., Boutron, I., Chan, A.-W., Collins, G. S., de Beyer, J. A., Hróbjartsson, A., Nejstgaard, C. H., Østengaard, L., Schulz, K. F., Tunn, R., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01989-8 · Cited by 127
Bethesda Statement on Open Access Publishing
Brown, P. O., Cabell, D., Chakravarti, A., et al. (2003) · Open Scholarship Press · doi:10.17613/0dc04-8k829 · Cited by 123
Siontis, K. C. M., Patsopoulos, N. A., & Ioannidis, J. P. A. (2010) · European Journal of Human Genetics · doi:10.1038/ejhg.2010.26 · Cited by 117
Everything Matters: The ReproNim Perspective on Reproducible Neuroimaging
Kennedy, D. N., Abraham, S. A., Bates, J. F., Crowley, A., Ghosh, S., Gillespie, T., Goncalves, M., Grethe, J. S., Halchenko, Y. O., Hanke, M., et al. (2019) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2019.00001 · Cited by 113
Sivertsen, G. (2017) · Palgrave Communications · doi:10.1057/palcomms.2017.78 · Cited by 102
Correction: Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2022) · PLoS Medicine · doi:10.1371/journal.pmed.1004085 · Cited by 98
Calibrating the Scientific Ecosystem Through Meta-Research
Hardwicke, T. E., Serghiou, S., Janiaud, P., Danchev, V., Crüwell, S., Goodman, S. N., & Ioannidis, J. P. A. (2020) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041104 · Cited by 98
Investigating the division of scientific labor using the Contributor Roles Taxonomy (CRediT)
Larivière, V., Pontille, D., & Sugimoto, C. R. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00097 · Cited by 97
The Rigor and Transparency Index Quality Metric for Assessing Biological and Medical Science Methods
Menke, J., Roelandse, M., Ozyurt, B., Martone, M., & Bandrowski, A. (2020) · iScience · doi:10.1016/j.isci.2020.101698 · Cited by 90
Self-citationAl-Durra, M., Nolan, R. P., Seto, E., & Cafazzo, J. A. (2020) · BMJ · doi:10.1136/bmj.m982 · Cited by 89
Hamilton, D. G., Hong, K., Fraser, H., Rowhani-Farid, A., Fidler, F., & Page, M. J. (2023) · BMJ · doi:10.1136/bmj-2023-075767 · Cited by 86
Coles, N. A., Hamlin, J. K., Sullivan, L. L., Parker, T. H., & Altschul, D. (2022) · Nature · doi:10.1038/d41586-022-00150-2 · Cited by 86
Preregistration of exploratory research: Learning from the golden age of discovery
Dirnagl, U. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000690 · Cited by 81
Is the future of peer review automated?
Schulz, R., Barnett, A., Bernard, R., Brown, N. J. L., Byrne, J. A., Eckmann, P., Gazda, M. A., Kilicoglu, H., Prager, E. M., Salholz-Hillel, M., et al. (2022) · BMC Research Notes · doi:10.1186/s13104-022-06080-6 · Cited by 80
Self-citationOpen science, done wrong, will compound inequities
Ross-Hellauer, T. (2022) · Nature · doi:10.1038/d41586-022-00724-0 · Cited by 77
Macleod, M., Collings, A. M., Graf, C., Kiermer, V., Mellor, D., Swaminathan, S., Sweet, D., & Vinson, V. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2103238118 · Cited by 77
Introduction to the EQIPD quality system
Bespalov, A., Bernard, R., Gilis, A., Gerlach, B., Guillén, J., Castagné, V., Lefevre, I. A., Ducrey, F., Monk, L., Bongiovanni, S., et al. (2021) · eLife · doi:10.7554/elife.63294 · Cited by 76
Refining animal research: The Animal Study Registry
Bert, B., Heinl, C., Chmielewska, J., Schwarz, F., Grune, B., Hensel, A., Greiner, M., & Schönfelder, G. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000463 · Cited by 67
Implementing a "publish, then review" model of publishing
Eisen, M. B., Akhmanova, A. S., Behrens, T. E. J., Harper, D. M., Weigel, D., & Zaidi, M. (2020) · eLife · doi:10.7554/elife.64910 · Cited by 65 · cited 2×
“In a similar vein, the journal eLife recently decided to no longer make accept/reject decisions and now only reviews manuscripts that are already posted as preprints [83].”
BackgroundBasson, I., Simard, M.-A., Ouangré, Z. A., Sugimoto, C. R., & Larivière, V. (2022) · PLOS ONE · doi:10.1371/journal.pone.0265545 · Cited by 62
CONSORT endorsement improves the quality of reports of randomized clinical trials in dentistry
Sarkis-Onofre, R., Poletto-Neto, V., Cenci, M. S., Moher, D., & Pereira-Cenci, T. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.01.020 · Cited by 59 · cited 1×
“Some of the highly adopted checklists include CONSORT (Consolidated Standards of Reporting Trials) [19,20], ARRIVE (Animal Research: Reporting of In Vivo Experiments) [13,14], and PRISMA (Pre-ferred Reporting Items for Systematic Reviews and Meta-Analyses) [21].”
MethodRedesign open science for Asia, Africa and Latin America
Onie, S. (2020) · Nature · doi:10.1038/d41586-020-03052-3 · Cited by 56 · cited 1×
“Monitoring, funding, and innovation would be necessary to ensure that open science serves people across the globe [116].”
BackgroundCrüwell, S., Apthorp, D., Baker, B. J., Colling, L., Elson, M., Geiger, S. J., Lobentanzer, S., Monéger, J., Patterson, A., Schwarzkopf, D. S., et al. (2023) · Psychological Science · doi:10.1177/09567976221140828 · Cited by 54
Strech, D., Weissgerber, T. L., Dirnagl, U., & on behalf of QUEST Group (2020) · PLoS Biology · doi:10.1371/journal.pbio.3000576 · Cited by 48
Shifting the Level of Selection in Science
Tiokhin, L., Panchanathan, K., Smaldino, P. E., & Lakens, D. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916231182568 · Cited by 44
Scientific rigor and the art of motorcycle maintenance
Munafò, M., Noble, S., Browne, W. J., Brunner, D., Button, K., Ferreira, J., Holmans, P., Langbehn, D., Lewis, G., Lindquist, M., et al. (2014) · Nature Biotechnology · doi:10.1038/nbt.3004 · Cited by 43
Speich, B., Mann, E., Schönenberger, C. M., Mellor, K., Griessbach, A. N., Dhiman, P., Gandhi, P., Lohner, S., Agarwal, A., Odutayo, A., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.17651 · Cited by 41
Lack of specificity shown by P2Y6 receptor antibodies
Yu, W., & Hill, W. G. (2013) · Naunyn-Schmiedeberg's Archives of Pharmacology · doi:10.1007/s00210-013-0894-8 · Cited by 36 · cited 2×
“By asking researchers to publish RRIDs, researchers were also inadvertently encouraged to double-check their reagents, reducing not only errors in antibodies but also the use of problematic cell lines, with no additional effort on the part of journals [29].”
BackgroundTorrance, H. (2020) · Qualitative Inquiry · doi:10.1177/1077800419878748 · Cited by 35
Dirnagl, U., Kurreck, C., Castaños‐Vélez, E., & Bernard, R. (2018) · The EMBO Reports · doi:10.15252/embr.201847143 · Cited by 35
From grassroots to global: A blueprint for building a reproducibility network
UK Reproducibility Network Steering Committee (2021) · PLoS Biology · doi:10.1371/journal.pbio.3001461 · Cited by 34
The increasing significance of impact within the Research Excellence Framework (REF)
Sutton, E. (2020) · Radiography · doi:10.1016/j.radi.2020.02.004 · Cited by 34
TARG Meta-Research Group & Collaborators (2023) · BMJ Open · doi:10.1136/bmjopen-2023-076264 · Cited by 33
Center for Open Science: Strategic PlanPreprint
Nosek, B. A., Shaw, L. C., Errington, T. M., Pfeiffer, N., & Zaringhalam, M. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/x2w9h · Cited by 30 · cited 1×
“The Center for Open Science (COS), a nonprofit organization based in the United States, has also been pivotal in advancing open science practices and promoting transparency in research [70].”
Backgroundvan der Naald, M., Chamuleau, S. A. J., Menon, J. M. L., de Leeuw, W., de Haan, J., Duncker, D. J., & Wever, K. E. (2022) · BMJ Open Science · doi:10.1136/bmjos-2021-100259 · Cited by 26
Menke, J., Eckmann, P., Ozyurt, I. B., Roelandse, M., Anderson, N., Grethe, J., Gamst, A., & Bandrowski, A. (2022) · Journal of Medical Internet Research · doi:10.2196/37324 · Cited by 25
Self-citationPush button replication: Is impact evaluation evidence for international development verifiable?
Wood, B. D. K., Müller, R., & Brown, A. N. (2018) · PLOS ONE · doi:10.1371/journal.pone.0209416 · Cited by 24
Reflections on Preregistration: Core Criteria, Badges, Complementary Workflows
Thibault, R. T., Pennington, C. R., & Munafo, M. R. (2023) · Journal of Trial and Error · doi:10.36850/mr6 · Cited by 22
Self-citationImproving My Lab, My Science With the Open Science Framework
(2014) · Cited by 22
FAIR adoption, assessment and challenges at UniProt
Garcia, L., Bolleman, J., Gehant, S., Redaschi, N., Martin, M., UniProt Consortium, Bateman, A., Magrane, M., Martin, M., Orchard, S., et al. (2019) · Scientific Data · doi:10.1038/s41597-019-0180-9 · Cited by 20
Biologists urged to hug a preprint
Callaway, E., & Powell, K. (2016) · Nature · doi:10.1038/530265a · Cited by 20
Thibault, R. T., Clark, R. W. A., Pedder, H., van den Akker, O. R., Westwood, S. J., Thompson, J., & Munafo, M. R. (2021) · medRxiv · doi:10.1101/2021.07.07.21259868 · Cited by 18
Self-citationA qualitative analysis of stakeholder experiences with Registered Reports Funding Partnerships
Drax, K., Clark, R. W. A., Chambers, C., Munafo, M. R., & Thompson, J. (2021) · Wellcome Open Research · doi:10.12688/wellcomeopenres.17029.1 · Cited by 15
To fix peer review, break it into stages
Amaral, O. B. (2022) · Nature · doi:10.1038/d41586-022-03791-5 · Cited by 12 · cited 1×
“They could also be leveraged during peer review to systematically check for issues that many expert reviewers regularly overlook [93–95] or be applied to entire corpuses of research [96,97].”
BackgroundSelf-citationDrude, N., Martinez‐Gamboa, L., Haven, T. L., Holman, C., Holst, M., Kniffert, S., McCann, S., Rackoll, T., Schulz, R., & Weschke, S. (2022) · BMC Research Notes · doi:10.1186/s13104-022-06108-x · Cited by 12
Self-citationScholarly Journals at the Crossroads
Schaffer, A., Calkin, N., & Echt, R. (1996) · The Serials Librarian · doi:10.1300/j123v28n03_23 · Cited by 10
Jones, C. W., Adams, A., Misemer, B. S., Weaver, M. A., Schroter, S., Khan, H., Margolis, B., Schriger, D. L., & Platts-Mills, T. F. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-066624 · Cited by 10
Sticker open science: just science done right
Imming, M., & Tennant, J. (2018) · Zenodo · doi:10.5281/zenodo.1285575 · Cited by 9
Updating splits, lumps, and shuffles: Reconciling GenBank names with standardized avian taxonomies
Hosner, P. A., Zhao, M., Kimball, R. T., Braun, E. L., & Burleigh, J. G. (2022) · Ornithology · doi:10.1093/ornithology/ukac045 · Cited by 8
Octopus and ResearchEquals aim to break the publishing mould
Dhar, P. (2023) · Nature · doi:10.1038/d41586-023-00861-0 · Cited by 8
Sticker open science: just science done right
Imming, M., Tennant, J., & Grigorov, I. (2018) · Figshare · doi:10.5281/zenodo.1285574 · Cited by 8
Ensuring the success of data sharing in Canada
Moher, D., & Cobey, K. D. (2021) · FACETS · doi:10.1139/facets-2021-0031 · Cited by 5 · cited 1×
“While these policies are a step in the right direction, ensuring their success will take substantial effort beyond the policy alone [51,52].”
BackgroundEvaluating Registered Reports Funding Partnerships: a feasibility study
Clark, R., Drax, K., Chambers, C. D., Munafò, M., & Thompson, J. (2021) · Wellcome Open Research · doi:10.12688/wellcomeopenres.17028.1 · Cited by 5
MDAR: Towards minimum reporting standards for life scientistsPreprint
Mellor, D. T., Chambers, K., Collings, A., Graf, C., Kiermer, V., Macleod, M. R., Swaminathan, S., Sweet, D. J., & Vinson, V. J. (2019) · OSF · doi:10.17605/osf.io/2k3va · Cited by 5
Reflections on Preregistration: Core Criteria, Badges, Complementary Workflows
Thibault, R. T., Pennington, C. R., & Munafo, M. R. (2022) · doi:10.31234/osf.io/w6tj4 · Cited by 3
Self-citationInstitutions can retool to make research more rigorous
Dirnagl, U. (2020) · Nature · doi:10.1038/d41586-020-02905-1 · Cited by 3
New UK clinical trials legislation will prioritise transparency
DeVito, N. J., & Goldacre, B. (2023) · BMJ · doi:10.1136/bmj.p1547 · Cited by 3
Research gets a boost in final 2023 spending agreement
Staff, S. N. (2022) · Science · doi:10.1126/science.adg3932 · Cited by 3
The White House’s march towards open science: implications for Canada
Moher, D., & Cobey, K. D. (2023) · FACETS · doi:10.1139/facets-2022-0242 · Cited by 3
Research works printed but not linked: 7
- E Callaway, 2016, ‘Hug a preprint, biologists!’ ASAPbio meeting discusses the ins and outs of posting work online before peer review, Nature, 530, 265
- Saderi D, Greaves S. ASAPbio Blog. In: Using preprint reviews to drive journal peer review [Internet]. Available from: https://asapbio.org/using-preprint-reviews-to-drive-journal-peer-review
- C Hudson-Vitale, 2021, Persistent Identifiers Connect a Scholarly Record with Many Versions, ARLViews
- eLife. eLife’s New Model: Your questions answered. Inside eLife [Internet]. 2023 Mar 30. Available from: https://elifesciences.org/inside-elife/2b765a27/elife-s-new-model-your-questions-answered.
- EW Sayers, 2020, GenBank, Nucleic Acids Res, 48, D84
- S. Buck, 2023, Metascience Since 2012: A Personal History, The Good Science Project
- K Murphy, 2023, NASA’s Transform to Open Science (TOPS) Initiative, AMS
Cited by
Collins, G. S., Moons, K. G. M., Dhiman, P., Riley, R. D., Beam, A. L., Van Calster, B., Ghassemi, M., Liu, X., Reitsma, J. B., van Smeden, M., et al. (2024) · BMJ · doi:10.1136/bmj-2023-078378 · Cited by 4,718
Ethical considerations in AI-enhanced medical decision support systems: A review
Olorunsogo, T. O., Adenyi, A. O., Okolo, C. A., & Babawarun, O. (2024) · World Journal of Advanced Engineering Technology and Sciences · doi:10.30574/wjaets.2024.11.1.0061 · Cited by 55
Narbaev, T., Amirbekova, D., & Bakdaulet, A. (2025) · Publications · doi:10.3390/publications13030035 · Cited by 34
Norris, E., O’Mahony, A., Coyne, R., Varol, T., Green, J., Reynolds, J. P., & Toomey, E. C. (2024) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2024.2351939 · Cited by 6
“Beyond journals, institutions and their leaders also have a role to play in developing a supportive culture where Open Science is rewarded in funding, hiring and promotion criteria (Thibault et al., 2023).”
Background
Metadata
- Authors
- Thibault, R. T., Amaral, O. B., Argolo, F., Bandrowski, A. E., Davidson, A. R., & Drude, N. I.
- Affiliations
- Stanford University (US)
- Universidade Federal do Rio de Janeiro (BR)
- University of California San Diego (US)
- Bond University (AU)
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin (DE)
- Corresponding author
- Thibault, Robert T.
- Drude, Natascha I.
- ORCID
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2023-10-19
- Volume
- 21
- Issue
- 10
- Pages
- e3002362
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC10617723
- OpenAlex
- W4387770932
- Semantic Scholar
- 58499598d3e628d4abe94526c381bab76a38b9c6
- Cited by
- 72
- References
- 108
- Citations by year
- 2026: 29 · 2025: 23 · 2024: 18 · 2023: 2
- FWCI
- 16.87
- Type
- journal article
- Language
- en
- Update notices
- new_version (2023-10-31)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- Bond University Research Portal (Bond University) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- University of California, San Diego
- National Institute of General Medical Sciences (R24GM144308)
- Topics
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Interdisciplinary Research and Collaboration
- Keywords
- open science, research transparency, data sharing, scholarly communication, team science, research culture, research funding, research institutions, open science initiatives, research ecosystem
- MeSH terms
- Scholarly Communication, Communication, Ecosystem, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.