Research Data in Core Journals in Biology, Chemistry, Mathematics, and Physics
Open accessThe DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.
Abstract
This study takes a stratified random sample of articles published in 2014 from the top 10 journals in the disciplines of biology, chemistry, mathematics, and physics, as ranked by impact factor. Sampled articles were examined for their reporting of original data or reuse of prior data, and were coded for whether the data was publicly shared or otherwise made available to readers. Other characteristics such as the sharing of software code used for analysis and use of data citation and DOIs for data were examined. The study finds that data sharing practices are still relatively rare in these disciplines' top journals, but that the disciplines have markedly different practices. Biology top journals share original data at the highest rate, and physics top journals share at the lowest rate. Overall, the study finds that within the top journals, only 13% of articles with original data published in 2014 make the data available to others.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, assessment of analytic reproducibility is typically precluded by poor access to research data [7–14].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In the absence of stringent community norms or regulations, scientific claims are regularly published without public release of the research data upon which they are based [7,9,14].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [14]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The conundrum of sharing research data
Borgman, C. L. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22634 · Cited by 880
The Availability of Research Data Declines Rapidly with Article Age
Vines, T. H., Albert, A. Y. K., Andrew, R. L., Débarre, F., Bock, D. G., Franklin, M. T., Gilbert, K. J., Moore, J.-S., Renaut, S., & Rennison, D. J. (2014) · Current Biology · doi:10.1016/j.cub.2013.11.014 · Cited by 482
Wicherts, J. M., Bakker, M., & Molenaar, D. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026828 · Cited by 424 · cited 1×
“At the same time, some may be reluctant to share data, although this could be related to the weakness of the authors’ findings [12].”
(2000) · Technometrics · doi:10.1080/00401706.2000.10486038 · Cited by 412
Public Availability of Published Research Data in High-Impact Journals
Alsheikh-Ali, A. A., Qureshi, W., Al-Mallah, M. H., & Ioannidis, J. P. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024357 · Cited by 363 · cited 2×
“[27] examined papers published in 50 of the highest impact factor journals across all disciplines.”
BackgroundLohr, S. L. (2019) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 350
What Drives Academic Data Sharing?
Fecher, B., Friesike, S., & Hebing, M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118053 · Cited by 338
Who Shares? Who Doesn't? Factors Associated with Openly Archiving Raw Research Data
Piwowar, H. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0018657 · Cited by 214
Mandated data archiving greatly improves access to research data
Vines, T. H., Andrew, R. L., Bock, D. G., Franklin, M. T., Gilbert, K. J., Kane, N. C., Moore, J., Moyers, B. T., Renaut, S., Rennison, D. J., et al. (2013) · The FASEB Journal · doi:10.1096/fj.12-218164 · Cited by 191
Sayogo, D. S., & Pardo, T. A. (2012) · Government Information Quarterly · doi:10.1016/j.giq.2012.06.011 · Cited by 181
Kim, Y., & Stanton, J. M. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23424 · Cited by 166
Mons, B., van Haagen, H., Chichester, C., Hoen, P.-B. '., den Dunnen, J. T., van Ommen, G., van Mulligen, E., Singh, B., Hooft, R., Roos, M., et al. (2011) · Nature Genetics · doi:10.1038/ng0411-281 · Cited by 149
Researcher Perspectives on Publication and Peer Review of Data
Kratz, J. E., & Strasser, C. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0117619 · Cited by 127
Murray‐Rust, P. (2008) · Serials Review · doi:10.1016/j.serrev.2008.01.001 · Cited by 125
Murray‐Rust, P. (2008) · Serials Review · doi:10.1080/00987913.2008.10765152 · Cited by 80
Data Sharing and Discovery: What Librarians Need to Know
MacMillan, D. (2014) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2014.06.011 · Cited by 78
A Unified Framework for Measuring Stewardship Practices Applied to Digital Environmental Datasets
Peng, G., Privette, J. L., Kearns, E. J., Ritchey, N. A., & Ansari, S. (2015) · Data Science Journal · doi:10.2481/dsj.14-049 · Cited by 78
Statistical Modelling of Citation Exchange Between Statistics Journals
Varin, C., Cattelan, M., & Firth, D. (2015) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/rssa.12124 · Cited by 73
Diwakar, S., Lombardo, P., Solinas, S. M. G., Naldi, G., & D'Angelo, E. U. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021928 · Cited by 71
Zelen, M., Fienberg, S. E., Martin, M. E., & Straf, M. L. (1987) · Journal of the American Statistical Association · doi:10.2307/2289493 · Cited by 71
The Evolution of Data Citation: From Principles to Implementation
Crosas, M. (2014) · IASSIST Quarterly · doi:10.29173/iq504 · Cited by 63
Open data and open code for big science of science studies
Light, R. P., Polley, T., & Börner, K. (2014) · Scientometrics · doi:10.1007/s11192-014-1238-2 · Cited by 61
The Royal Society of Chemistry and the delivery of chemistry data repositories for the community
Williams, A. J., & Tkachenko, V. (2014) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-014-9784-5 · Cited by 57
Douglass, K., Allard, S. L., Tenopir, C., Wu, L., & Frame, M. (2013) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.22988 · Cited by 43
Altman, M., Adams, M., Crabtree, J., Donakowski, D., Maynard, M., Pienta, A., & Young, C. H. (2009) · The American Archivist · doi:10.17723/aarc.72.1.eu7252lhnrp7h188 · Cited by 38
Data sharing in sociology journals
Zenk-Möltgen, W., & Lepthien, G. (2014) · Online Information Review · doi:10.1108/oir-05-2014-0119 · Cited by 33
Statistical Modelling of Citation Exchange Between Statistics Journals
Varin, C., Ca, U., Venezia, F., Profile, S., Cattelan, M., Varin, C., & Firth, D. (2016) · Cited by 26
Data Sharing: Academic Libraries and the Scholarly Enterprise
Nicholson, S., & Bennett, T. (2011) · Swinburne figshare (Swinburne University of Technology) · Cited by 15
Differences among Faculty Ranks in Views on Research Data Management
Akers, K. G., & Doty, J. L. (2013) · IASSIST Quarterly · doi:10.29173/iq771 · Cited by 14
Make Research Data Public?—Not Always so Simple: A Dialogue for Statisticians and Science Editors
Sedransk, N., Cox, L. H., Nolan, D., Soper, K. A., Spiegelman, C. H., Young, L. J., Kelner, K. L., Moffitt, R., Thakar, A., Raddick, J., et al. (2010) · Statistical Science · doi:10.1214/10-sts320 · Cited by 10
Rule rewrite aims to clean up scientific software
Hayden, E. C. (2015) · Nature · doi:10.1038/520276a · Cited by 9
Data-PE: A Framework for Evaluating Data Publication Policies at Scholarly Journals
Moles, N. (2015) · Data Science Journal · doi:10.2481/dsj.14-047 · Cited by 8
Mooney, H. (2014) · IASSIST Quarterly · doi:10.29173/iq240 · Cited by 7
Rockwell, R. C. (1994) · Social Science Computer Review · doi:10.1177/089443939401200205 · Cited by 6
Advancing the practice of data citation: A to‐do list
Hourclé, J. A. (2012) · Bulletin of the American Society for Information Science and Technology · doi:10.1002/bult.2012.1720380507 · Cited by 5
PLOS data policy: Catalyst for a better research process
Ganley, E. (2014) · College & Research Libraries News · doi:10.5860/crln.75.6.9138 · Cited by 1
Cited by
Hardwicke, T. E., Mathur, M. B., MacDonald, K., Nilsonne, G., Banks, G. C., Kidwell, M. C., Hofelich Mohr, A., Clayton, E., Yoon, E. J., Henry Tessler, M., et al. (2018) · Royal Society Open Science · doi:10.1098/rsos.180448 · Cited by 336
Schweinsberg, M., Feldman, M., Staub, N., van den Akker, O. R., van Aert, R. C. M., van Assen, M. A. L. M., Liu, Y., Althoff, T., Heer, J., Kale, A. M., et al. (2021) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2021.02.003 · Cited by 171
Theory and practice of data citation
Silvello, G. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23917 · Cited by 154
Hamilton, D. G., Hong, K., Fraser, H., Rowhani-Farid, A., Fidler, F., & Page, M. J. (2023) · BMJ · doi:10.1136/bmj-2023-075767 · Cited by 86
Digital open science—Teaching digital tools for reproducible and transparent research
Toelch, U., & Ostwald, D. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2006022 · Cited by 80
Metadata
- Authors
- Womack, R. P.
- Affiliations
- Rutgers, The State University of New Jersey (US)
- Corresponding author
- Womack, Ryan P.
- ORCID
- Womack, Ryan P.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-12-04
- Volume
- 10
- Issue
- 12
- Pages
- e0143460
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4670119
- OpenAlex
- W2184744691
- Cited by
- 50
- References
- 37
- Citations by year
- 2025: 3 · 2024: 2 · 2023: 6 · 2022: 8 · 2021: 9 · 2020: 8 · 2019: 2 · 2018: 4 · 2017: 6 · 2016: 2
- FWCI
- 10.75
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Rutgers University Community Repository (Rutgers University) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Rutgers University Community Repository (Rutgers University)
- Topics
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- research data sharing, data availability, data reuse, data citation, impact factor, biology, chemistry, mathematics, physics, open science
- MeSH terms
- Biology, Chemistry, Data Interpretation, Statistical, Humans, Mathematics, Periodicals as Topic, Physics, Research, Bibliometrics, Information Dissemination, Journal Impact Factor
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.