Public Data Archiving in Ecology and Evolution: How Well Are We Doing?
Open accessThe DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Abstract
Policies that mandate public data archiving (PDA) successfully increase accessibility to data underlying scientific publications. However, is the data quality sufficient to allow reuse and reanalysis? We surveyed 100 datasets associated with nonmolecular studies in journals that commonly publish ecological and evolutionary research and have a strong PDA policy. Out of these datasets, 56% were incomplete, and 64% were archived in a way that partially or entirely prevented reuse. We suggest that cultural shifts facilitating clearer benefits to authors are necessary to achieve high-quality PDA and highlight key guidelines to help authors increase their data's reuse potential and compliance with journal data policies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Unfortunately, the existing digital ecosystem surrounding scholarly data publication prevents us from extracting maximum benefit from our research investments (e.g., ref. 1).”
From The FAIR Guiding Principles for scientific data management and stewardship (2016) · cites this paper as [1]
The cited source says what the claim attributes to it.
In the citing paper
“While there have been a number of recent, often domain-focused publications advocating for specific improvements in practices relating to data management and archival1,11,12, FAIR differs in that it describes concise, domain-independent, high-level principles that can be applied to a wide range of scholarly outputs.”
From The FAIR Guiding Principles for scientific data management and stewardship (2016) · cites this paper as [1]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Data Sharing by Scientists: Practices and Perceptions
Tenopir, C., Allard, S., Douglass, K., Aydinoglu, A. U., Wu, L., Read, E., Manoff, M., & Frame, M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021101 · Cited by 1,432
Big data and the future of ecology
Hampton, S. E., Strasser, C. A., Tewksbury, J. J., Gram, W. K., Budden, A. E., Batcheller, A. L., Duke, C. S., & Porter, J. H. (2013) · Frontiers in Ecology and the Environment · doi:10.1890/120103 · Cited by 924 · cited 6×
“These benefits can take many forms, including credit from hiring or promotion committees and funding agencies [12], as well as prizes from departments, societies, and publishers for most reusable or reused dataset, best data paper, or most reproducible results [63].”
BackgroundResultInfluentialTen Simple Rules for Reproducible Computational Research
Sandve, G. K., Nekrutenko, A., Taylor, J., & Hovig, E. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003285 · Cited by 880 · cited 1×
“, [53,54]).”
Data reuse and the open data citation advantage
Piwowar, H. A., & Vision, T. J. (2013) · PeerJ · doi:10.7717/peerj.175 · Cited by 603
Challenges and opportunities of open data in ecology
Reichman, O. J., Jones, M. B., & Schildhauer, M. P. (2011) · Science · doi:10.1126/science.1197962 · Cited by 600 · cited 2×
“These findings are notable given that PDA is arguably most widely accepted in areas of biology that produce genetic data [12,28].”
BackgroundThe Carrot or the Stick: Rewards, Punishments, and Cooperation
Andreoni, J., Harbaugh, W., & Vesterlund, L. (2003) · American Economic Review · doi:10.1257/000282803322157142 · Cited by 570
Repeatability of published microarray gene expression analyses
Ioannidis, J. P. A., Allison, D. B., Ball, C. A., Coulibaly, I., Cui, X., Culhane, A. C., Falchi, M., Furlanello, C., Game, L., Jurman, G., et al. (2009) · Nature Genetics · doi:10.1038/ng.295 · Cited by 551 · cited 2×
“Amongst these, one recent survey of 18 microarray studies found that only two were fully reproducible using the archived data [27].”
BackgroundResultShedding Light on the Dark Data in the Long Tail of Science
Heidorn, P. B. (2008) · Library trends · doi:10.1353/lib.0.0036 · Cited by 470
Wicherts, J. M., Bakker, M., & Molenaar, D. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026828 · Cited by 424 · cited 1×
“Despite the obvious benefits of PDA for science, many researchers remain reluctant to share their data publicly [1,3,12,14–19].”
Background
Cited by
Items 101–200 of 331
Thelwall, M. A., Munafo, M. R., Más-Bleda, A., Stuart, E., Makita, M., Weigert, V., Keene, C., Khan, N., Drax, K., & Kousha, K. (2020) · PLoS ONE · doi:10.1371/journal.pone.0229578 · Cited by 30
“Nevertheless, most shared ecology and evolutionary research datasets are unable to be reused due to incompleteness or practical difficulties [26].”
BackgroundStrčić, J., Čivljak, A., Gložinić, T., Pacheco, R. L., Brković, T., & Puljak, L. (2022) · Scientometrics · doi:10.1007/s11192-022-04346-1 · Cited by 27
“They reported that 56% of the analyzed datasets were incomplete, and 64% archived in a manner that partially or entirely prevented their reuse (Roche et al., 2015).”
BackgroundErkens, R. H. J., Blanpain, L. M. P., Jara, I. C., Runge, K., Verspagen, N., Cosiaux, A., & Couvreur, T. L. P. (2022) · Plants People Planet · doi:10.1002/ppp3.10321 · Cited by 30
Global change and premature hatching of aquatic embryos
Cowan, Z., Green, L., Clark, T. D., Blewett, T. A., Bonville, J. D., Gagnon, T., Hoots, E. C., Kuchenmüller, L., Leeuwis, R. H. J., Acedo, J. N., et al. (2024) · Global Change Biology · doi:10.1111/gcb.17488 · Cited by 25
Self-citationAn academic researcher's guide to increased impact on regulatory assessment of chemicals
Ågerstrand, M., Sobek, A., Lilja, K., Linderoth, M., Wendt-Rasch, L., Wernersson, A.-S., & Rudén, C. (2017) · Environmental Science Processes & Impacts · doi:10.1039/c7em00075h · Cited by 29
Simple decision rules underlie collaborative hunting in yellow saddle goatfish
Steinegger, M., Roche, D. G., & Bshary, R. (2018) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2017.2488 · Cited by 24
Self-citationSchofield, P. N., Kulka, U., Tapio, S., & Grosche, B. (2019) · International Journal of Radiation Biology · doi:10.1080/09553002.2019.1589026 · Cited by 24
“A similar proportion of data from ecological studies – 56% – was also found to be incomplete and much unusable (Roche et al. 2015).”
BackgroundOpen government data and environmental science: a federal Canadian perspective
Roche, D. G., Granados, M., Austin, C. C., Wilson, S., Mitchell, G. M., Smith, P. A., Cooke, S. J., & Bennett, J. (2020) · FACETS · doi:10.1139/facets-2020-0008 · Cited by 26
“For example, a 2015 study found that over 50% of open data sets shared by ecologists and evolutionary biologists were unusable (Roche et al. 2015).”
BackgroundSelf-citationThe Environmental Data Initiative: Connecting the past to the future through data reuse
Gries, C., Hanson, P. C., O'Brien, M. C., Servilla, M., Vanderbilt, K., & Waide, R. B. (2023) · Ecology and Evolution · doi:10.1002/ece3.9592 · Cited by 23
“, 2019) and must pass a rigorous quality assessment before being published to the repository following community recommendations for best practices (Briney et al., 2020; Contaxis et al., 2022; Goodman et al., 2014; Hanisch et al., 2022; Roche et al., 2015; Whitlock, 2011).”
BackgroundNorberg, J., Blenckner, T., Cornell, S., Petchey, O. L., & Hillebrand, H. (2022) · Ecology Letters · doi:10.1111/ele.13984 · Cited by 27
“Part of this is the commitment to FAIR data principles (Wilkinson et al., 2016).”
BackgroundInfluentialGauging the Purported Costs of Public Data Archiving for Long-Term Population Studies
Evans, S. R. (2016) · PLoS Biology · doi:10.1371/journal.pbio.1002432 · Cited by 24
Drivers and Distribution of Henipavirus-Induced Syncytia: What Do We Know?
Gamble, A., Yeo, Y. Y., Butler, A., Tang, H., Snedden, C. E., Mason, C., Buchholz, D., Bingham, J., Aguilar, H. C., & Lloyd‐Smith, J. O. (2021) · Viruses · doi:10.3390/v13091755 · Cited by 24
The data‐index: An author‐level metric that values impactful data and incentivizes data sharing
Hood, A. S. C., & Sutherland, W. J. (2021) · Ecology and Evolution · doi:10.1002/ece3.8126 · Cited by 29
“However, the majority of authors in ecology and evolution (estimated 64% by Roche et al. (2015)) archive their data in a way that prevents reuse.”
BackgroundCorrelates of social role and conflict severity in wild vervet monkey agonistic screams
Mercier, S., Déaux, É. C., van de Waal, E., Bono, A., & Zuberbühler, K. (2019) · PLoS ONE · doi:10.1371/journal.pone.0214640 · Cited by 26
Imker, H. J., Luong, H., Mischo, W. H., Schlembach, M. C., & Wiley, C. (2021) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2021.102369 · Cited by 27
A Guide to Using GitHub for Developing and Versioning Data Standards and Reporting Formats
Crystal‐Ornelas, R., Varadharajan, C., Bond‐Lamberty, B., Boye, K., Burrus, M., Cholia, S., Crow, M., Damerow, J., Devarakonda, R., Ely, K., et al. (2021) · Earth and Space Science · doi:10.1029/2021ea001797 · Cited by 21
“For example, in one study where researchers attempted to reuse 100 data sets stored in a long-term data repository, they found that over 60% of the data sets were unusable due to incomplete data sets or insufficient metadata (Roche et al., 2015).”
BackgroundThe effects of ocean acidification on fishes – history and future outlook
Sundin, J. (2023) · Journal of Fish Biology · doi:10.1111/jfb.15323 · Cited by 26
“Experiments should be systematically documented and transparent (Parker et al ., 2016; Roche et al ., 2015; Roche et al ., 2022) so that we can reach a true understanding of any potential impacts of ocean acidification on fish behaviour and physiology.”
MethodSundin, J., Amcoff, M., Mateos‐González, F., Raby, G. D., & Clark, T. D. (2019) · Oecologia · doi:10.1007/s00442-019-04430-z · Cited by 24
Synthesizing connectivity information from migratory marine species for area-based management
Kot, C. Y., DeLand, S. E., Harrison, A., Alberini, A., Blondin, H. E., Chory, M., Cleary, J., Curtice, C., Donnelly, B., Fujioka, E., et al. (2023) · Biological Conservation · doi:10.1016/j.biocon.2023.110142 · Cited by 25
Temperature moderates eDNA –biomass relationships in northern pike
Ogonowski, M., Karlsson, E., Vasemägi, A., Sundin, J., Bohman, P., & Sundblad, G. (2023) · Environmental DNA · doi:10.1002/edn3.440 · Cited by 25
Kambouris, S., Wilkinson, D. P., Smith, E. T., & Fidler, F. M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0300333 · Cited by 28
Vervet monkeys greet adult males during high-risk situations
Mercier, S., Neumann, C., van de Waal, E., Chollet, E., de Bellefon, J. M., & Zuberbühler, K. (2017) · Animal Behaviour · doi:10.1016/j.anbehav.2017.07.021 · Cited by 23
Cue-based decision rules of cleaner fish in a biological market task
Wismer, S., Pinto, A. I., Triki, Z., Grutter, A. S., Roche, D. G., & Bshary, R. (2019) · Animal Behaviour · doi:10.1016/j.anbehav.2019.09.013 · Cited by 19
Self-citationWilliams, C., Yang, Y., Lagisz, M., Morrison, K., Ricolfi, L., Warton, D. I., & Nakagawa, S. (2024) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14415 · Cited by 25
“While most journals in ecology and evolution mandate public data archiving (Roche et al., 2015 ; Sholler et al., 2019; Whitlock, 2011 ), more effort is needed to encourage code archiving.”
Making data meaningful: guidelines for good quality open data
Towse, A. S., Ellis, D. A., & Towse, J. N. (2021) · The Journal of Social Psychology · doi:10.1080/00224545.2021.1938811 · Cited by 25
“Nearly half were at risk of being orphaned due to the lack of a permanent link between data and research paper (for similar dataset quality issues, see also D. G. Roche et al., 2015; Hardwicke et al., 2018).”
BackgroundTen simple rules for annotating sequencing experiments
Stevens, I., Mukarram, A. K., Hörtenhuber, M., Meehan, T. F., Rung, J., & Daub, C. O. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008260 · Cited by 21
Why sharing data and code during peer review can enhance behavioral ecology research
Fernández‐Juricic, E. (2021) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-021-03036-x · Cited by 20
“2020), although a large proportion of these datasets appear incomplete to be reused (Roche et al. 2015).”
BackgroundDreujou, E., Carrier‐Belleau, C., Goldsmit, J., Fiorentino, D., Ben‐Hamadou, R., Muelbert, J. H., Godbold, J. A., Daigle, R., & Beauchesne, D. (2020) · PeerJ · doi:10.7717/peerj.8171 · Cited by 18
Synthesis of sexual selection: a systematic map of meta‐analyses with bibliometric analysis
Pollo, P., Lagisz, M., Yang, Y., Čulina, A., & Nakagawa, S. (2024) · Biological reviews/Biological reviews of the Cambridge Philosophical Society · doi:10.1111/brv.13117 · Cited by 21
“These fi ndings are a little more optimistic than those found by a survey of the primary literature in ecology and evolution (Roche et al ., 2015; Kambouris et al ., 2024).”
Renaut, S., Budden, A. E., Gravel, D., Poisot, T., & Peres‐Neto, P. R. (2018) · BioScience · doi:10.1093/biosci/biy038 · Cited by 19
Context-aware movement analysis in ecology: a systematic review
Brum-Bastos, V. D. S., Łoś, M., Long, J., NELSON, T. A., & Demšar, U. (2021) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2021.1962528 · Cited by 20
“While ecology is at the forefront of open data use (Roche et al. 2015), ensuring that data sources are reported will foster data transparency and help to increase the speed of new developments in the field (McNutt 2014).”
BackgroundBest practices for building and curating databases for comparative analyses
Schwanz, L. E., Gunderson, A. R., Iglesias‐Carrasco, M., Johnson, M. A., Kong, J. D., Riley, J., & Wu, N. C. (2022) · Journal of Experimental Biology · doi:10.1242/jeb.243295 · Cited by 19
“Similarly, around 64% of data archives in ecology and evolution are not usable (Roche et al., 2015).”
BackgroundScientific Misconduct: The Elephant in the Lab. A Response to Parker et al.
Clark, T. D., Binning, S. A., Raby, G. D., Speers‐Roesch, B., Sundin, J., Jutfelt, F., & Roche, D. G. (2016) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2016.09.006 · Cited by 17
“Despite these progressive measures, publishers often do not adequately enforce these policies [12].”
BackgroundSelf-citationFrom policy to practice: progress towards data- and code-sharing in ecology and evolution
Ivimey‐Cook, E. R., Sánchez‐Tójar, A., Berberi, I., Čulina, A., Roche, D. G., Almeida, R. A., Amin, B., Bairos‐Novak, K. R., Balti, H., Bertram, M. G., et al. (2025) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2025.1394 · Cited by 25
“However, despite an increase in policy implementation in journals in recent years, compliance with these data-and code-sharing policies appears to be lagging [2,4,5,10–12].”
Self-citationHoney bee (Apis mellifera) wing images: a tool for identification and conservation
Oleksa, A., Căuia, E., Siceanu, A., Puškadija, Z., Kovačić, M., Pinto, M. A., Rodrigues, P. J., Hatjina, F., Charistos, L., Bouga, M., et al. (2023) · GigaScience · doi:10.1093/gigascience/giad019 · Cited by 16
“Even if some data are provided, they are often incomplete [59].”
Effects of elevated carbon dioxide on male and female behavioural lateralization in a temperate goby
Sundin, J., & Jutfelt, F. (2018) · Royal Society Open Science · doi:10.1098/rsos.171550 · Cited by 19
Sharing is caring: Ethical implications of transparent research in psychology.
Bosma, C. M., & Granger, A. M. (2022) · American Psychologist · doi:10.1037/amp0001002 · Cited by 24
Gingins, S., Roche, D. G., & Bshary, R. (2017) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2016.2469 · Cited by 16
Self-citationFAIR compliant database development for human microbiome data samples
Dorst, M., Zeevenhooven, N., Wilding, R., Mende, D. R., Brandt, B. W., Zaura, E., Hoekstra, A. G., & Sheraton, V. M. (2024) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2024.1384809 · Cited by 21
Open Data Policies among Library and Information Science Journals
Jackson, B. (2021) · Publications · doi:10.3390/publications9020025 · Cited by 21
“As a potential solution, much of this research points to the (re)development of data sharing policies to ensure that they are consistent, detailed and specific, unambiguous, and stringent, while highlighting incentives for open data publishing [8,11,17,26].”
Backgroundannonex2embl : automatic preparation of annotated DNA sequences for bulk submissions to ENA
Gruenstaeudl, M. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa209 · Cited by 16
Rey-Campos, M., Ríos-Castro, R., Gallardo‐Escárate, C., Novoa, B., & Figueras, A. J. (2022) · International Journal of Molecular Sciences · doi:10.3390/ijms232416029 · Cited by 14
“However, this type of study continues to be difficult due to the large amount of missing data (it was estimated that 56% of ecological and evolutionary databases are incomplete [45]).”
BackgroundCuff, J. P., Barrett, M., Gray, H., Fox, C. W., Watt, A. D., & Aimé, E. (2024) · Agricultural and Forest Entomology · doi:10.1111/afe.12617 · Cited by 14
“Inadequate (or at least poorly communicated) incentives are thought to be partly responsible for this (Nosek et al., 2012; Reichman et al., 2011; Roche et al., 2015), but insufficient guidance and practical support are also a key barrier.”
InfluentialData-based, synthesis-driven: Setting the agenda for computational ecology
Poisot, T., LaBrie, R. A., Larson, E. I., Rahlin, A. A., & Simmons, B. I. (2019) · Ideas in Ecology and Evolution · doi:10.24908/iee.2019.12.2.e · Cited by 16
Marine megavertebrate migrations connect the global ocean
Bentley, L. K., Nisthar, D., Fujioka, E., Curtice, C., DeLand, S. E., Donnelly, B., Harrison, A., Heywood, E. I., Kot, C. Y., Crespo, G. O., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-59271-7 · Cited by 15
“There are also questions around the effectiveness of data archiving policies to truly ensure raw datasets are accessible 21 .”
Schweinar, A., Wagner, F., Klingner, C. M., Festag, S., Spreckelsen, C., & Brodoehl, S. (2024) · Applied Clinical Informatics · doi:10.1055/a-2259-0008 · Cited by 11
“1,5,6 In general, RDM describes the organization, storage, preservation, and sharingof scienti fi cdata.”
BackgroundFunctional R code is rare in species distribution and abundance papers
Kellner, K. F., Doser, J. W., & Belant, J. L. (2024) · Ecology · doi:10.1002/ecy.4475 · Cited by 15
Code-sharing policies are associated with increased reproducibility potential of ecological findings
Sánchez‐Tójar, A., Bezine, A., Purgar, M., & Čulina, A. (2025) · Peer Community Journal · doi:10.24072/pcjournal.541 · Cited by 13
“…reporting needs improvement to allow reproducibility, and previous studies have found that open code (Obels et al., 2020; Laurinavichyute et al., 2022; Henderson et al., 2024) and data are often incomplete and difficult to use due to poor documentation (Roche et al., 2015; Roche et al., 2022b).”
Fast and Accurate Metadata Authoring Using Ontology-Based Recommendations.
Martínez-Romero, M., O’Connor, M. J., Shankar, R., Panahiazar, M., Willrett, D., Egyedi, A. L., Gevaert, O., Graybeal, J. B., & Musen, M. A. (2017) · PubMed · Cited by 15
Ehlers, M. R., & Lonsdorf, T. B. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104958 · Cited by 14
Nguyen, P., McKenzie, J. E., Hamilton, D. G., Moher, D., Tugwell, P., Fidler, F. M., Haddaway, N., Higgins, J. P. T., Kanukula, R., Karunananthan, S., et al. (2023) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.12008 · Cited by 12
“Valuable lessons can be learned from ecological sciences' successful initiatives, ranging from mandatory public data archiving policies enforced by leading journals [52], to international research networks establishing policies governing the responsibility of data providers and data users [53].”
Myrenås, E., Näslund, J., Persson, J., & Sundin, J. (2023) · Journal of Fish Diseases · doi:10.1111/jfd.13822 · Cited by 11
Does the presence of an odd individual affect group choice?
Quattrini, F., Bshary, R., & Roche, D. G. (2018) · Behavioral Ecology · doi:10.1093/beheco/ary062 · Cited by 11
Self-citationWagner, E. L. E., Roche, D. G., Binning, S. A., Wismer, S., & Bshary, R. (2015) · PeerJ · doi:10.7717/peerj.1459 · Cited by 14
“The data and code for this study are deposited in the public respository figshare (Wagner et al., 2015) following best practices (White et al., 2013; Roche et al., 2015).”
MethodSelf-citationTier-based standards for FAIR sequence data and metadata sharing in microbiome research
Kim, L., Lavrinienko, A., Sebechlebská, Z., Stoltenberg, S., & Bokulich, N. A. (2025) · Nucleic Acids Research · doi:10.1093/nar/gkaf777 · Cited by 14
“This is a wider problem across numerous scientific disciplines, with publication data often remaining incomplete [ 28 , 29 ].”
Saboyá‐Acosta, L. P., & Urbina-Cardona, N. (2023) · Tropical Conservation Science · doi:10.1177/19400829231169984 · Cited by 12
“Data papers are a type of recent academic publication that offers relevant information regarding the visibility and re-use of data that can be available for public use and maintains both scienti fi c rigor and public con fi dence (Roche et al., 2015; Jiao & Darch, 2020; Machuca-Mart´ ı nez, 2020).”
BackgroundSupporting study registration to reduce research waste
Purgar, M., Glasziou, P., Klanjšček, T., Nakagawa, S., & Čulina, A. (2024) · Nature Ecology & Evolution · doi:10.1038/s41559-024-02433-5 · Cited by 17
“The second stage of the review process for registered reports, where reviewers check whether the conducted research aligns with the accepted proposal and review any deviations and the full study, including the results and discussion 11 .”
Poor hypotheses and research waste in biology: learning from a theory crisis in psychology
Nakagawa, S., Armitage, D. W., Froese, T., Yang, Y., & Lagisz, M. (2025) · BMC Biology · doi:10.1186/s12915-025-02134-w · Cited by 15
Quality Assurance for Security Applications of Big Data
Clarke, R. (2016) · European Intelligence and Security Informatics Conference · doi:10.1109/eisic.2016.010 · Cited by 11
“Despite this, recent articles in science journals have thrown into doubt the reproducibility of a considerable amount of published research [26-27].”
BackgroundEvaluating a thesaurus for discovery of ecological data
Porter, J. H. (2019) · Ecological Informatics · doi:10.1016/j.ecoinf.2019.03.002 · Cited by 13
Motivating data contributions via a distinct career currency
Westoby, M., Falster, D. S., & Schrader, J. (2021) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2020.2830 · Cited by 11
“First, compliance may be grudging and minimal (e.g. [37]).”
Bhat, A., & Wani, Z. A. (2024) · IFLA Journal · doi:10.1177/03400352241270692 · Cited by 10
“Good stewardship aids research data availability and usage; however, the current academic publication procedure prevents researchers from maximizing their research bene fi ts (Ayris et al., 2016; Roche et al., 2015).”
Ten best practices to strengthen stewardship and sharing of water science data in Canada
Persaud, B., Dukacz, K. A., Saha, G. C., Peterson, A. M., Moradi, L., O'Hearn, S., Clary, E., Mai, J., Steeleworthy, M., Venkiteswaran, J. J., et al. (2021) · Hydrological Processes · doi:10.1002/hyp.14385 · Cited by 9
Kraft, A., Dreyer, B., Löwe, P., & Ziedorn, F. (2017) · Data Science Journal · doi:10.5334/dsj-2017-036 · Cited by 9
“…is addressed by multiple working groups across the world (e.g. European Union 2010; Crosas 2011; Lecarpentier et al. 2013; Starr et al. 2015) and seems to make good progress, the social (human) side is still staggering and changing slowly (Data Citation Synthesis Group 2014; Roche et al. 2015).”
BackgroundEvaluating Science's open-data policy
Roche, D. G. (2017) · Science · doi:10.1126/science.aan8158 · Cited by 9
Self-citationThe SORTEE guidelines for data and code quality control in ecology and evolutionary biology
Pick, J. L., Allen, B. J., Bachelot, B., Bairos‐Novak, K. R., Brand, J. A., Class, B., Dallas, T., D'Amelio, P. B., Fenollosa, E., Fernández‐Juricic, E., et al. (2026) · Peer Community Journal · doi:10.24072/pcjournal.687 · Cited by 11
“However, archived data are often incomplete or not in a state where they can be reused (Roche et al. 2015, Roche et al. 2022).”
Make like a glass frog: In support of increased transparency in herpetology
Marshall, B. M. (2021) · Herpetological Journal · doi:10.33256/31.1.3545 · Cited by 10
The frontier of data discoverability: Why we need to share our data1
Culley, T. M. (2017) · Applications in Plant Sciences · doi:10.3732/apps.1700111 · Cited by 8
“In a review of 100 data sets supporting ecological and evolutionary publications, 56% were determined to be incomplete and 64% were archived in such a way that partially or entirely prevented their subsequent reuse (Roche et al., 2015).”
BackgroundIn pursuit of data immortality
Eisenstein, M. S. (2022) · Nature · doi:10.1038/d41586-022-00929-3 · Cited by 8
A Cloud-Native Web Application for Assisted Metadata Generation and Retrieval: THESPIAN-NER
Bombini, A., Alkhansa, A., Cappelli, L., Felicetti, A., Giacomini, F. M., & Costantini, A. (2022) · Applied Sciences · doi:10.3390/app122412910 · Cited by 8
Hering, J. G., Nunnenmacher, L., & von Waldow, H. (2018) · Wiley eBooks · doi:10.1002/9781119271659.ch1 · Cited by 8
Gruenstaeudl, M., & Hartmaring, Y. (2019) · PLoS ONE · doi:10.1371/journal.pone.0210347 · Cited by 9
Make like a glass frog: In support of increased transparency in herpetologyPreprint
Marshall, B. M., & Strine, C. T. (2020) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/74frd · Cited by 8
Future of coral bleaching research
Grottoli, A. G., Hulver, A. M., Thurber, R. L. V., Toonen, R. J., Schmeltzer, E. R., Kuffner, I. B., Barott, K. L., Baums, I. B., Castillo, K. D., Chapron, L., et al. (2025) · BioScience · doi:10.1093/biosci/biaf066 · Cited by 8
“The disparity in funding opportunities among low-, middle-, and high-income countries is exacerbated by the cost of journal subscriptions, resulting in publications and their data sets being hidden behind paywalls (Roche et al. 2015 , Piwowar et al. 2018 ).”
ShareTrait : Towards interoperable and reusable individual trait‐based data in ectotherms
Leiva, F. P., Ellers, J., Berg, M. P., Cuxart‐Erruz, R., Barneche, D. R., Blackburn, T. M., Castañeda, L. E., Chown, S. L., Gaitán‐Espitía, J. D., Gebauer, P., et al. (2025) · Functional Ecology · doi:10.1111/1365-2435.70147 · Cited by 8
Assessing computational reproducibility in Behavior Research Methods
Ellis, D. A., Towse, J. N., Brown, O., Cork, A., Davidson, B. I., Devereux, S., Hinds, J. M., Ivory, M. R., Nightingale, S. J., Parry, D. A., et al. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02501-5 · Cited by 12
“…and resource descriptors supporting a paper were publicly available (Roche et al., 2015; Towse et al., 2021a), with reusability also scored on an ordinal 1-to-5 scale, assessing how readily resources could be accessed and understood by third parties (Roche et al., 2015; Towse et al., 2021a).”
BackgroundMethodInfluentialProvide proactive reproducible analysis transparency with every publication
Meijer, P., Howard, N., Liang, J., Kelsey, A., Subramanian, S., Johnson, E., Mariz, P., Harvey, J. F., Ambrose, M., Tereshchenko, V., et al. (2025) · Royal Society Open Science · doi:10.1098/rsos.241936 · Cited by 11
“Current practices may result in partially reconstructed analysis traces, making it difficult for other researchers to find, understand and ultimately reproduce the original findings [20,21].”
Animal behavior missing from data archives
Miller, S., Jernigan, C. M., Legan, A. W., Miller, C. H., Tumulty, J. P., Walton, A., & Sheehan, M. J. (2021) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2021.07.008 · Cited by 7
StreamingHub: interactive stream analysis workflows
Jayawardana, Y., Ashok, V. G., & Jayarathna, S. (2022) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3529372.3530936 · Cited by 9
“However, a 2015 study [51] reports that 56% of natural sciences datasets had incomplete metadata, and 64% of them were archived in a manner that hindered data reuse.”
BackgroundAre we all on the same page? Subfield differences in open science practices in psychology
Rochios, C., & Richmond, J. L. (2022) · Infant and Child Development · doi:10.1002/icd.2361 · Cited by 9
Kumuthini, J., Zass, L. J., Chaouch, M., Fadlelmola, F. M., Mulder, N., Radouani, F., Ras, V., Samtal, C., Tchamga, M. S. S., Sathan, D., et al. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-819803-2.00003-1 · Cited by 7
Open data: policies need policing
Roche, D. G. (2016) · Nature · doi:10.1038/538041c · Cited by 7
Self-citationOpening Research Data: What Does It Mean for Social Sciences?
Berkowitz, H. A., & Delacour, H. (2022) · M n gement · doi:10.37725/mgmt.v25.9123 · Cited by 12
Facilitating Effective Reuse of Soil Research Data: The BonaRes Repository
Lachmuth, S., Dönmez, C., Hoffmann, C., Specka, X., Svoboda, N., & Helming, K. (2025) · European Journal of Soil Science · doi:10.1111/ejss.70103 · Cited by 6
“Importantly, data discovery and reusability are not guaranteed through publication in Open Access repositories (Roche et al. 2015; Husen et al. 2017) but are rather enhanced by specialized repositories (Hampton et al. 2013; Khan et al. 2022) focused on discipline-specific needs, meta-data and…”
Haubrock, P. J., Everts, T., Kouba, A., Soto, I., Mammola, S., Sousa, R., & Britton, J. R. (2026) · Conservation Biology · doi:10.1111/cobi.70228 · Cited by 6
“Despite recent improvements, the majority of available datasets remain incomplete, limiting their reusability (Roche et al., 2015, 2022).”
The promise of community-driven preprints in ecology and evolution
Noble, D. W. A., Xirocostas, Z. A., Wu, N. C., Martinig, A. R., Almeida, R. A., Bairos‐Novak, K. R., Balti, H., Bertram, M. G., Bliard, L., Brand, J. A., et al. (2025) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2024.1487 · Cited by 6
Self-citationRuberto, C. (2023) · RENDICONTI LINCEI · doi:10.1007/s12210-023-01175-z · Cited by 6
Sharing data in Ecology: how to add more value to data
Pérez‐Luque, A. J., & Ros‐Candeira, A. (2019) · Ecosistemas · doi:10.7818/ecos.1838 · Cited by 8
“Lo cierto es que la gran mayoría de los estudios científicos no son reproducibles y, en ocasiones, incluso la trazabilidad de los resultados es un misterio para los propios autores (Rodríguez-Sánchez et al. 2016).”
BackgroundSchuchert, P. (2017) · Biodiversity Heritage Library (Smithsonian Institution) · doi:10.5281/zenodo.893549 · Cited by 8
Replication alert: behavioural lateralisation in a detour test is not repeatable in fishesPreprint
Roche, D. G., Amcoff, M., Morgan, R., Sundin, J., Andreassen, A. H., Finnøen, M. H., Lawrence, M. J., Henderson, E., Norin, T., & Speers‐Roesch, B. (2019) · EcoEvoRxiv · doi:10.32942/osf.io/6kcwa · Cited by 6
Self-citationLUSTRE: An Online Data Management and Student Project Resource
Towse, J. N., Davies, R. A. I., Ball, E., James, R., Gooding, B., & Ivory, M. R. (2022) · Journal of Statistics and Data Science Education · doi:10.1080/26939169.2022.2118645 · Cited by 5
“Roche et al. (2015) demonstrated that there were problems with the majority of open datasets for Ecology and Evolution, with issues that limited or prevented their exploitation or reuse.”
BackgroundBobrov, E., Riedel, N., & Kip, M. (2024) · Quantitative Science Studies · doi:10.1162/qss_a_00301 · Cited by 5
“Research regarding data sharing covers a wide range of research fields (Hamilton, Hong et al., 2023; Roche, Kruuk et al., 2015; see Velden & Tcypina, 2023, for a comparison between fields).”
BackgroundThe promises and challenges of archiving insect behavior and natural history in a changing world
Sheehan, M. J., & Miller, S. (2021) · Current Opinion in Insect Science · doi:10.1016/j.cois.2021.03.008 · Cited by 5
Transparency and Replication in Brazilian Political Science: A First Look
Avelino, G., DESPOSATO, S. W., & Mardegan, I. O. (2021) · Dados · doi:10.1590/dados.2021.64.3.242 · Cited by 8
Postma, E., González‐Voyer, A., & Holman, L. (2021) · Journal of Evolutionary Biology · doi:10.1111/jeb.13885 · Cited by 5
BioHackathon 2015: Semantics of data for life sciences and reproducible research
Vos, R. A., Katayama, T., Mishima, H., Kawano, S., Kawashima, S., Kim, J.-D., Moriya, Y., Tokimatsu, T., Yamaguchi, A., Yamamoto, Y., et al. (2020) · F1000Research · doi:10.12688/f1000research.18236.1 · Cited by 5
Data Communities: Empowering Researcher-Driven Data Sharing in the Sciences
Springer, R., & Cooper, D. (1970) · International Journal of Digital Curation · doi:10.2218/ijdc.v15i1.695 · Cited by 5
Common-sense approaches to sharing tabular data alongside publication
Tierney, N. J., & Ram, K. (2021) · Patterns · doi:10.1016/j.patter.2021.100368 · Cited by 4
“19,20 Unlike code, datasets are far more diverse in terms of heterogeneity, size, and format.”
BackgroundAn open source web application for distributed geospatial data exploration
Curry, P. A., & Moosdorf, N. (2019) · Scientific Data · doi:10.1038/sdata.2019.14 · Cited by 5
“Journal and funding agencies have made policy changes on data availability and analytical methodology that re fl ect the sentiment expressed in these papers 14,20 – 22 .”
BackgroundDigital Open Science – Teaching digital tools for reproducible and transparent researchPreprint
Toelch, U., & Ostwald, D. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/fbvep · Cited by 5
Metadata
- Authors
- Roche, D. G., Kruuk, L. E. B., Lanfear, R., & Binning, S. A.
- Affiliations
- Australian National University (AU)
- Corresponding author
- Roche, Dominique G.
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-11-10
- Volume
- 13
- Issue
- 11
- Pages
- e1002295
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC4640582
- OpenAlex
- W1857123336
- Cited by
- 303
- References
- 63
- Citations by year
- 2026: 15 · 2025: 31 · 2024: 27 · 2023: 33 · 2022: 29 · 2021: 39 · 2020: 28 · 2019: 29 · 2018: 22 · 2017: 29 · 2016: 19 · 2015: 1
- FWCI
- 65.42
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- ANU Open Research (Australian National University) (submittedVersion)
- Funders
- Australian National University
- Topics
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Sociology and Political Science › Data Analysis and Archiving
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Keywords
- data quality, data reuse, reanalysis, ecological research, evolutionary research, data completeness, data sharing, author incentives
- MeSH terms
- Data Accuracy, Workforce, Animals, Biology, Ecology, Biological Evolution, Humans, Periodicals as Topic, Guidelines as Topic, Internet, Access to Information, Datasets as Topic, Data Curation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.