The MDAR (Materials Design Analysis Reporting) Framework for transparent reporting in the life sciences
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Transparency in reporting benefits scientific communication on many levels. While specific needs and expectations vary across fields, the effective interpretation and use of research findings relies on the availability of core information about research materials, study design, data, and experimental and analytical methods. For preclinical research, transparency in reporting is a key focus in response to concerns of replication failure. The inconsistent reporting of key elements of experimental and analytical design, alongside ambiguous description of reagents and lack of access to underlying data and code, has been shown to impair replication (1) and raise doubt about the robustness of results (2, 3). In response to early concerns about replication of published results, funders, publishers, and other stakeholders have called for improvements in reporting transparency (4⇓⇓–7). Several initiatives ensued, including journal policies and joint efforts by journals, funders, and other stakeholders (8⇓–10). One of these initiatives, the Transparency and Openness Promotion (TOP) guidelines (11), outlines a policy framework at the journal level that over 1,000 journals and publishers have adopted. The National Academies have focused on reproducibility and replicability* challenges through several recent initiatives leading to consensus reports, including Reproducibility and Replicability in Science (12), Open Science by Design: Realizing a Vision for 21st Century Research (13), and Fostering Integrity in Research (14). Each of these reports concludes that lack of reporting transparency is one factor which contributes to these systemic problems. Building on these findings, the National Academies convened a public workshop in September 2019 titled “Enhancing Scientific Reproducibility in Biomedical Research Through Transparent Reporting.” The workshop was designed to discuss the current state of transparency in reporting biomedical research and to explore the possibility of improving the harmonization of guidelines across journals and funding agencies. During this workshop, we provided … [↵][1]1To whom correspondence may be addressed: Email: Malcolm.Macleod{at}ed.ac.uk (correspondence regarding the development and evaluation of the guideline) or mellor.david{at}gmail.com (for further information about implementation and stewardship). [1]: #xref-corresp-1-1
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Development of reporting standards is an ongoing process, and some are now being harmonized through initiatives such as the MDAR Checklist (Materials, Design, Analysis, and Reporting) [24,25] and the alignment of guidelines for reporting trial protocols (SPIRIT) and results (CONSORT) [26].”
From Open Science 2.0: Towards a truly collaborative research ecosystem (2023) · cites this paper as [25]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
A call for transparent reporting to optimize the predictive value of preclinical research
Landis, S. C., Amara, S. G., Asadullah, K., Austin, C. P., Blumenstein, R., Bradley, E. W., Crystal, R. G., Darnell, R. B., Ferrante, R. J., Fillit, H., et al. (2012) · Nature · doi:10.1038/nature11556 · Cited by 1,196
Self-citationReproducibility and Replicability in Science
Committee on Reproducibility and Replicability in Science, Board on Behavioral, C., Committee on National Statistics, Education, D. O. B. A. S. S. A., Nuclear and Radiation Studies Board, Studies, D. O. E. A. L., Board on Mathematical Sciences and Analytics, Committee on Applied and Theoretical Statistics, Sciences, D. O. E. A. P., Board on Research Data and Information, et al. (2019) · doi:10.17226/25303 · Cited by 924
Simera, I., Moher, D., Hirst, A., Hoey, J., Schulz, K. F., & Altman, D. G. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-24 · Cited by 590
Risk of bias in reports of in vivo research: a focus for improvement
Macleod, M. R., Lawson McLean, A., Kyriakopoulou, A., Serghiou, S., de Wilde, A., Sherratt, N., Hirst, T., Hemblade, R., Bahor, Z., Nunes-Fonseca, C., et al. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002273 · Cited by 358
Self-citationReproducible Research Practices and Transparency across the Biomedical Literature
Iqbal, S. A., Wallach, J. D., Khoury, M. J., Schully, S. D., & Ioannidis, J. P. A. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002333 · Cited by 310
Journals unite for reproducibility
McNutt, M. (2014) · Science · doi:10.1126/science.aaa1724 · Cited by 300
Announcement: Reducing our irreproducibility
(2013) · Nature · doi:10.1038/496398a · Cited by 243
on behalf of the IICARus Collaboration, Hair, K., Macleod, M. R., & Sena, E. S. (2019) · Research Integrity and Peer Review · doi:10.1186/s41073-019-0069-3 · Cited by 174
Self-citationArrison, T., & Nerem, R. M. (2017) · Special Publications · doi:10.1002/9781119067825.ch2 · Cited by 135
Han, S., Olonisakin, T. F., Pribis, J. P., Zupetic, J., Yoon, J. H., Holleran, K. M., Jeong, K., Shaikh, N., Rubio, D. M., & Lee, J. S. (2017) · PLOS ONE · doi:10.1371/journal.pone.0183591 · Cited by 131
Did a change in Nature journals’ editorial policy for life sciences research improve reporting?
The NPQIP Collaborative group, Study steering committee, Macleod, M., Sena, E., Howells, D., Macleod, M., Sena, E., Howells, D., Kiermer, V., Swaminathan, S., et al. (2019) · BMJ Open Science · doi:10.1136/bmjos-2017-000035 · Cited by 102
Self-citationThe Rigor and Transparency Index Quality Metric for Assessing Biological and Medical Science Methods
Menke, J., Roelandse, M., Ozyurt, B., Martone, M., & Bandrowski, A. (2020) · iScience · doi:10.1016/j.isci.2020.101698 · Cited by 90
Checklists work to improve science
(2018) · Nature · doi:10.1038/d41586-018-04590-7 · Cited by 57
Marcus, E. (2016) · Cell · doi:10.1016/j.cell.2016.08.021 · Cited by 55
UK funders demand strong statistics for animal studies
Cressey, D. (2015) · Nature · doi:10.1038/520271a · Cited by 33
(2017) · eLife · doi:10.7554/elife.23693 · Cited by 27
Towards minimum reporting standards for life scientists
Chambers, K., Collings, A., Graf, C., Kiermer, V., Mellor, D. T., Macleod, M. R., Swaminathan, S., Sweet, D., & vinson, V. (2019) · doi:10.31222/osf.io/9sm4x · Cited by 17
Self-citationEnhancing Scientific Reproducibility in Biomedical Research Through Transparent Reporting
Forum on Drug Discovery, D., Disorders, F. O. N. A. N. S., Forum, N. C. P., Health, R. O. G. A. P., Board on Health Sciences Policy, Board on Health Care Services, Division, H. A. M., & National Academies of Sciences, E. (2020) · National Academies Press eBooks · doi:10.17226/25627 · Cited by 10
Research works printed but not linked: 2
- National Academies of Sciences, Engineering, and Medicine, Open Science by Design: Realizing a Vision for 21st Century Research (National Academies Press, Washington, DC, 2018). 30212065
- National Academies of Sciences, Engineering, and Medicine, Fostering Integrity in Research (National Academies Press, Washington, DC, 2017). 29341557
Cited by
Challenges for assessing replicability in preclinical cancer biology
Errington, T. M., Denis, A., Perfito, N., Iorns, E., & Nosek, B. A. (2021) · eLife · doi:10.7554/elife.67995 · Cited by 267
“Since then, some publishers have taken steps to improve reporting and standards have emerged to promote consistency, clarity, and accuracy (Marcus, 2016; Nature, 2013), and a coalition of publishers and other stakeholders are promoting minimum reporting standards for life science (Macleod et al., 2021).”
BackgroundREFORMS: Consensus-based Recommendations for Machine-learning-based Science
Kapoor, S., Cantrell, E. M., Peng, K., Pham, T. H., Bail, C. A., Gundersen, O. E., Hofman, J. M., Hullman, J., Lones, M. A., Malik, M. M., et al. (2024) · Science Advances · doi:10.1126/sciadv.adk3452 · Cited by 129
“Similar checklists are in place in a number of journals ( 90 , 91 ); however, they are usually used for specific disciplines rather than for methods that are prevalent across disciplines ( 192 ).”
Open Science 2.0: Towards a truly collaborative research ecosystem
Thibault, R. T., Amaral, O. B., Argolo, F., Bandrowski, A. E., Davidson, A. R., & Drude, N. I. (2023) · PLOS Biology · doi:10.1371/journal.pbio.3002362 · Cited by 72
Björndahl, L., Barratt, C. L. R., Mortimer, D., Agarwal, A., Aitken, R. J., Alvarez, J. G., Aneck-Hahn, N., Arver, S., Baldi, E., Bassas, L., et al. (2022) · Human Reproduction · doi:10.1093/humrep/deac189 · Cited by 71
“…programmes, such as The MDAR (Materials Design Analysis Reporting) Framework, for transparent reporting in the life sciences have been launched (Macleod et al., 2021) and specific consortia have been developed to repeat key published experiments, e.g. Reproducibility Project: Cancer Biology…”
MethodRecommendations for robust and reproducible preclinical research in personalised medicine
Fosse, V., Oldoni, E., Biétrix, F., Budillon, A., Daskalopoulos, E. P., Fratelli, M., Gerlach, B., Groenen, P. M. A., Hölter, S. M., Menon, J. M. L., et al. (2023) · BMC Medicine · doi:10.1186/s12916-022-02719-0 · Cited by 63
“Initiatives aimed at scientific journals include the MDAR (Materials, Design, Analysis, Reporting) framework to improve research practices through transparent reporting [66].”
Background
Metadata
- Authors
- Macleod, M., Collings, A. M., Graf, C., Kiermer, V., Mellor, D., Swaminathan, S., Sweet, D., & Vinson, V.
- Affiliations
- University of Edinburgh (GB)
- eLife Sciences Publications Ltd., Cambridge CB4 1YG, United Kingdom;
- John Wiley & Sons (United Kingdom) (GB)
- Public Library of Science, San Francisco, CA 94111;
- Center for Open Science (US)
- Springer Nature (United States) (US)
- Cell Press, Cambridge, MA 02139;
- American Association For The Advancement of Science (US)
- Corresponding author
- Macleod, Malcolm
- Mellor, David
- ORCID
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2021-04-23
- Volume
- 118
- Issue
- 17
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC8092464
- OpenAlex
- W3153733588
- Cited by
- 77
- References
- 19
- Citations by year
- 2026: 18 · 2025: 8 · 2024: 10 · 2023: 13 · 2022: 21 · 2021: 7
- FWCI
- 10.88
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Funders
- Massachusetts Department of Agricultural Resources
- University of Edinburgh
- National Institutes of Health
- National Institute on Aging (R24AG048124)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Health Sciences › Veterinary › Small Animals › Animal testing and alternatives
- Keywords
- reporting transparency, preclinical research, research reproducibility, replicability, research data access, code sharing, research integrity, biomedical research
- MeSH terms
- Scholarly Communication, Biological Science Disciplines, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.