The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Our path to better science in less time using open data science tools
Open accessAbstract
Reproducibility has long been a tenet of science but has been challenging to achieve—we learned this the hard way when our old approaches proved inadequate to efficiently reproduce our own work. Here we describe how several free software tools have fundamentally upgraded our approach to collaborative research, making our entire workflow more transparent and streamlined. By describing specific tools and how we incrementally began using them for the Ocean Health Index project, we hope to encourage others in the scientific community to do the same—so we can all produce better science in less time. Reproducibility starts with having a transparent and streamlined workflow. Here, the authors describe how they achieved this using open data tools for the collaborative Ocean Health Index project.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
1,500 scientists lift the lid on reproducibility
Baker, M. (2016) · Nature · doi:10.1038/533452a · Cited by 4,209
mediation:R Package for Causal Mediation Analysis
Tingley, D., Yamamoto, T., Hirose, K., Keele, L., & Imai, K. (2014) · Journal of Statistical Software · doi:10.18637/jss.v059.i05 · Cited by 4,155
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708 · cited 1×
“Many researchers do not attempt to reproduce their own work 17,72 —ourselves included before 2013—and thus may not realize that there could be reproduc ibility issues in their own approaches.”
Backgroundtidyverse: Easily Install and Load the 'Tidyverse'
Wickham, H. (2016) · CRAN: Contributed Packages · doi:10.32614/cran.package.tidyverse · Cited by 1,381
Big data and the future of ecology
Hampton, S. E., Strasser, C. A., Tewksbury, J. J., Gram, W. K., Budden, A. E., Batcheller, A. L., Duke, C. S., & Porter, J. H. (2013) · Frontiers in Ecology and the Environment · doi:10.1890/120103 · Cited by 924
An index to assess the health and benefits of the global ocean
Halpern, B. S., Longo, C., Hardy, D., McLeod, K. L., Samhouri, J. F., Katona, S. K., Kleisner, K., Lester, S. E., O’Leary, J., Ranelletti, M., et al. (2012) · Nature · doi:10.1038/nature11397 · Cited by 920
Self-citationWickham, H. (2014) · Journal of Statistical Software · doi:10.18637/jss.v059.i10 · Cited by 901
Ten Simple Rules for Reproducible Computational Research
Sandve, G. K., Nekrutenko, A., Taylor, J., & Hovig, E. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003285 · Cited by 880
How Open Science Helps Researchers Succeed
McKiernan, E. C., Bourne, P. E., Brown, C. T., Buck, S., Kenall, A., Lin, J., McDougall, D., Nosek, B. A., Ram, K., Soderberg, C. K., et al. (2016) · eLife · doi:10.7554/elife.16800 · Cited by 798
Best Practices for Scientific Computing
Wilson, G., Aruliah, D. A., Brown, C. T., Chue Hong, N. P., Davis, M., Guy, R. T., Haddock, S. H. D., Huff, K. D., Mitchell, I. M., Plumbley, M. D., et al. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1001745 · Cited by 723 · cited 2×
“Coding is “as important to modern scientific research as telescopes and test tubes” 50 , but it is critical to “dispel the misconception that these skills are intuitive, obvious, or in any way inherent” 41 .”
BackgroundMethodKidwell, M. C., Lazarević, L. B., Baranski, E., Hardwicke, T. E., Piechowski, S., Falkenberg, L.-S., Kennett, C., Slowik, A., Sonnleitner, C., Hess-Holden, C., et al. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002456 · Cited by 700
Challenges and opportunities of open data in ecology
Reichman, O. J., Jones, M. B., & Schildhauer, M. P. (2011) · Science · doi:10.1126/science.1197962 · Cited by 600
Ecoinformatics: supporting ecology as a data-intensive science
Michener, W. K., & Jones, M. B. (2012) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2011.11.016 · Cited by 441
Publish your computer code: it is good enough
Barnes, N. (2010) · Nature · doi:10.1038/467753a · Cited by 315
Ten Simple Rules for Creating a Good Data Management Plan
Michener, W. K. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004525 · Cited by 246
Ten Simple Rules for the Care and Feeding of Scientific Data
Goodman, A., Pepe, A., Blocker, A. W., Borgman, C. L., Cranmer, K., Crosas, M., Di Stefano, R., Gil, Y., Groth, P., Hedstrom, M., et al. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003542 · Cited by 231
Git can facilitate greater reproducibility and increased transparency in science
Ram, K. (2013) · Source Code for Biology and Medicine · doi:10.1186/1751-0473-8-7 · Cited by 230
Ten Simple Rules for Taking Advantage of Git and GitHub
Perez-Riverol, Y., Gatto, L., Wang, R., Sachsenberg, T., Uszkoreit, J., Leprevost, F. D. V., Fufezan, C., Ternent, T., Eglen, S. J., Katz, D. S., et al. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004947 · Cited by 230
The New Bioinformatics: Integrating Ecological Data from the Gene to the Biosphere
Jones, M. B., Schildhauer, M. P., Reichman, O. J., & Bowers, S. (2006) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev.ecolsys.37.091305.110031 · Cited by 228
A Quick Introduction to Version Control with Git and GitHub
Blischak, J. D., Davenport, E. R., & Wilson, G. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004668 · Cited by 192
The Tao of open science for ecology
Hampton, S. E., Anderson, S. S., Bagby, S. C., Gries, C., Han, X., Hart, E. M., Jones, M. B., Lenhardt, W. C., MacDonald, A., Michener, W. K., et al. (2015) · Ecosphere · doi:10.1890/es14-00402.1 · Cited by 187
Software Carpentry: lessons learned
Wilson, G. (2016) · F1000Research · doi:10.12688/f1000research.3-62.v2 · Cited by 174
Unmet needs for analyzing biological big data: A survey of 704 NSF principal investigators
Barone, L., Williams, J., & Micklos, D. A. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005755 · Cited by 173
Over half of psychology studies fail reproducibility test
Baker, M. (2015) · Nature · doi:10.1038/nature.2015.18248 · Cited by 162
Software Carpentry: Getting Scientists to Write Better Code by Making Them More Productive
Wilson, G. (2006) · Computing in Science & Engineering · doi:10.1109/mcse.2006.122 · Cited by 144
Patterns and Emerging Trends in Global Ocean Health
Halpern, B. S., Longo, C., Lowndes, J. S. S., Best, B. D., Frazier, M., Katona, S. K., Kleisner, K. M., Rosenberg, A. A., Scarborough, C., & Selig, E. R. (2015) · PLOS ONE · doi:10.1371/journal.pone.0117863 · Cited by 139
Self-citationAdvances in global change research require open science by individual researchers
Wolkovich, E. M., Regetz, J., & O'Connor, M. I. (2012) · Global Change Biology · doi:10.1111/j.1365-2486.2012.02693.x · Cited by 111 · cited 6×
“Ecologists and environmental scientists arguably have a height ened responsibility for transparency and openness, as data products provide important snapshots of systems that may be forever altered due to climate change and other human pressures 16,18 .”
BackgroundInfluentialCasadevall, A., & Fang, F. C. (2010) · Infection and Immunity · doi:10.1128/iai.00908-10 · Cited by 111
Research integrity: Don't let transparency damage science
Lewandowsky, S., & Bishop, D. (2016) · Nature · doi:10.1038/529459a · Cited by 107
Cancer reproducibility project releases first results
Baker, M., & Dolgin, E. (2017) · Nature · doi:10.1038/541269a · Cited by 104
Nine simple ways to make it easier to (re)use your data
White, E., Baldridge, E., Brym, Z., Locey, K., McGlinn, D., & Supp, S. (2013) · Ideas in Ecology and Evolution · doi:10.4033/iee.2013.6b.6.f · Cited by 103
Data publication consensus and controversies
Kratz, J. E., & Strasser, C. A. (2014) · F1000Research · doi:10.12688/f1000research.3979.3 · Cited by 100
Environmental information for all
Hope, C. W., & Parker, J. (1990) · Energy Policy · doi:10.1016/0301-4215(90)90189-b · Cited by 97
Elevating The Status of Code in Ecology
Mislan, K. A. S., Heer, J., & White, E. P. (2015) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2015.11.006 · Cited by 85
Democratic databases: science on GitHub
Perkel, J. M. (2016) · Nature · doi:10.1038/538127a · Cited by 79
Where’s the Real Bottleneck in Scientific Computing?
Wilson, G. (2005) · American Scientist · doi:10.1511/2006.1.5 · Cited by 77
Building Software, Building Community: Lessons from the rOpenSci Project
Boettiger, C., Chamberlain, S., Hart, E., & Ram, K. (2015) · Journal of Open Research Software · doi:10.5334/jors.bu · Cited by 74
Buck, S. (2015) · Science · doi:10.1126/science.aac8041 · Cited by 72
Water, Water, Everywhere: Defining and Assessing Data Sharing in Academia
Tuyl, S. V., & Whitmire, A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0147942 · Cited by 68
Nine simple ways to make it easier to (re)use your dataPreprint
White, E. P., Baldridge, E., Brym, Z., Locey, K. J., McGlinn, D. J., & Supp, S. R. (2013) · doi:10.7287/peerj.preprints.7v2 · Cited by 65
Ten Simple Rules to Enable Multi-site Collaborations through Data Sharing
Boland, M. R., Karczewski, K. J., & Tatonetti, N. P. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005278 · Cited by 61
Computing Workflows for Biologists: A Roadmap
Shade, A. L., & Teal, T. K. (2015) · PLoS Biology · doi:10.1371/journal.pbio.1002303 · Cited by 43
Why scientists must share their research code
Baker, M. (2016) · Nature · doi:10.1038/nature.2016.20504 · Cited by 34
Scientific computing: Code alert
Baker, M. (2017) · Nature · doi:10.1038/nj7638-563a · Cited by 33
Frew, J. E., & Dozier, J. (2012) · Annual Review of Environment and Resources · doi:10.1146/annurev-environ-042711-121244 · Cited by 32
Practical computing for biologists
(2011) · Choice Reviews Online · doi:10.5860/choice.48-5133 · Cited by 31
Best practices for assessing ocean health in multiple contexts using tailorable frameworks
Lowndes, J. S., Pacheco, E. J., Best, B. D., Scarborough, C., Longo, C., Katona, S. K., & Halpern, B. S. (2015) · PeerJ · doi:10.7717/peerj.1503 · Cited by 31
Self-citationMapping Uncertainty Due to Missing Data in the Global Ocean Health Index
Frazier, M. R., Longo, C., & Halpern, B. S. (2016) · PLoS ONE · doi:10.1371/journal.pone.0160377 · Cited by 26
Self-citationCommon Errors in Ecological Data Sharing
Kervin, K., Michener, W. K., & Cook, R. B. (2013) · Journal of eScience Librarianship · doi:10.7191/jeslib.2013.1024 · Cited by 21
Mozilla plan seeks to debug scientific code
Hayden, E. C. (2013) · Nature · doi:10.1038/501472a · Cited by 14
Good Enough Practices in Scientific Computing
Wilson, G., Bryan, J., Cranston, K., Kitzes, J., Nederbragt, L., & Teal, T. K. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005510 · Cited by 8
Cited by
Applications for deep learning in ecology
Christin, S., Hervet, É., & Lecomte, N. (2019) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13256 · Cited by 724
Open science challenges, benefits and tips in early career and beyond
Allen, C., & Mehler, D. M. A. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000246 · Cited by 608
Situating Ecology as a Big-Data Science: Current Advances, Challenges, and Solutions
Farley, S. S., Dawson, A., Goring, S. J., & Williams, J. W. (2018) · BioScience · doi:10.1093/biosci/biy068 · Cited by 331
MicrobiotaProcess: A comprehensive R package for deep mining microbiome
Xu, S., Zhan, L., Tang, W., Wang, Q., Dai, Z., Zhou, L., Feng, T., Chen, M., Wu, T., Hu, E., et al. (2023) · The Innovation · doi:10.1016/j.xinn.2023.100388 · Cited by 308
Data sharing, management, use, and reuse: Practices and perceptions of scientists worldwide
Tenopir, C., Rice, N. M., Allard, S., Baird, L., Borycz, J., Christian, L., Grant, B., Olendorf, R., & Sandusky, R. J. (2020) · PLOS ONE · doi:10.1371/journal.pone.0229003 · Cited by 298
Metadata
- Authors
- Lowndes, J. S. S., Best, B. D., Scarborough, C., Afflerbach, J. C., Frazier, M. R., O’Hara, C. C., Jiang, N., & Halpern, B. S.
- Venue
- Nature Ecology & Evolution
- Published
- 2017-05-23
- Volume
- 1
- Issue
- 6
- Pages
- 160-160
- ISSN
- 2397-334X (ISSN-L)
- OpenAlex
- W2617908299
- Cited by
- 286
- References
- 53
- FWCI
- 51.65
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.