CoChat

Toward good in vitro reporting standards

Open access
Hartung, Thomas · 2019 · ALTEX

The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index; 17 of the 34 sources its claims cite were checked for support.

Abstract

A good experiment reported badly is worthless. Meaningful contributions to the body of science are made by sharing the full methodology and results so that they can be evaluated and reproduced by peers. Erroneous and incomplete reporting does not do justice to the resources spent on conducting the experiment and the time peers spend reading the article. In theory peer-review should ensure adequate reporting - in practice it does not. Many areas have developed reporting standards and checklists to support the adequate reporting of scientific efforts, but in vitro research still has no generally accepted criteria. It is characterized by a "Wild West" or "anything goes" attitude. Such a culture may undermine trust in the reproducibility of animal-free methods, and thus parallel the "reproducibility crisis" discussed for other life science fields. The increasing data retrieval needs of computational approaches (in extreme as "big data" and artificial intelligence) makes reporting quality even more important so that the scientific community can take full advantage of the results. The first priority of reporting standards is to ensure the completeness and transparency of information provided (data focus). The second tier is a quality of data display that makes information digestible and easy to grasp, compare and further analyze (information focus). This article summarizes a series of initiatives geared towards improving the quality of in vitro work and its reporting. This shall ultimately lead to Good In Vitro Reporting Standards (GIVReSt).

Overview

CoChat Summary

TL;DR

The paper argues that in vitro research needs Good In Vitro Reporting Standards (GIVReSt) to improve reproducibility, evidence retrieval, and data integration. It reviews QA/QC concepts and related initiatives such as GCCP, GIVIMP, OECD GD 211, IV-CAT, and TOP, and proposes a reporting framework.

Key findings

  • Poor reporting severely hampers risk-of-bias assessment: citing SYRCLE experience, the paper states that in 80–90% of cases it is not possible to assess the actual risk of bias because crucial details of study design and conduct are not reported.
  • Irreproducibility is costly: citing Freedman et al. (2015), the paper reports that the cumulative prevalence of irreproducible preclinical research exceeds 50%, resulting in approximately US$28,000,000,000 (US$28B)/year spent on non-reproducible preclinical research in the United States alone.
  • Many reporting guidance efforts exist: the EQUATOR network identified 408 reporting guidelines, and the TOP guidelines have been elected by over 1,000 journals and publishers; the CAAT GIVReSt initiative involves about 90 experts.
  • Test-readiness scoring has been proposed: Bal-Price et al. (2018) defined more than 60 scoring items bundled into 13 groups for new approach methods, exemplified for developmental neurotoxicity.

Methods

  • Design: conceptual “Food for Thought” article/perspective, not an empirical study; it synthesizes QA/QC principles and reporting initiatives for in vitro work.
  • Data or sample: no primary data or sample; it draws on cited guidance documents, workshops, and prior publications, including GCCP, GIVIMP, OECD GD 211, IV-CAT, and TOP.
  • Main analysis: narrative synthesis and proposal of GIVReSt, including tables differentiating QA and QC and a chapter structure/responsibilities for the CAAT GIVReSt effort.

Limitations

  • Stated: the article “summarizes, probably not even comprehensively, the activities known to and/or involving the authors,” so coverage is not exhaustive and is author-centered.
  • Evident: it is a perspective/commentary without a systematic search or empirical validation of the proposed standards.
  • Disclosed conflict: Thomas Hartung is the founder of Organome LLC, which aims to commercialize the mini-brains mentioned.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.14573/altex.1812191

Cites

62 of 62 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 The quality chain from cell model to satisfying an information need
Fig. 1 The quality chain from cell model to satisfying an information needCC-BY · From the PDF

Verification

Claims the paper makes

15 Valid · 2 Not valid · 11 Not checked · 28 Own results and interpretations

8 more claims

Create a free account to see all 56 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 37
  • It may state two separate claims as one. 18

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

  • Yaşlı Kadınlarda Üreme Sağlığı

    Kokanalı, D., & Engin Üstün, Y. (n.d.) · DergiPark (Istanbul University) · Cited by 170,090

  • Yaşlı Kadınlarda Üreme Sağlığı

    Kokanalı, D., & Üstün, Y. E. (2019) · Jinekoloji-Obstetrik ve Neonatoloji Tıp Dergisi · Cited by 169,581

  • SYRCLE’s risk of bias tool for animal studies

    Hooijmans, C. R., Rovers, M. M., de Vries, R. B., Leenaars, M., Ritskes-Hoitinga, M., & Langendam, M. W. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-43 · Cited by 4,415 · cited 1×

    “In these cases, the risks of bias have to be scored as “unclear”; after all, the researchers might have applied measures to avoid bias, such as randomization and blinding, but just not reported them (Hooijmans et al., 2014).”
  • 1,500 scientists lift the lid on reproducibility

    Baker, M. (2016) · Nature · doi:10.1038/533452a · Cited by 4,209 · cited 1×

    “However, the reproducibility crisis (Baker, 2016; Jarvis and Williams, 2016) in science alone should prompt and cement such quality assurance.”
    Background
  • Minimum information about a microarray experiment (MIAME)-toward standards for microarray data

    Brazma, A., Hingamp, P., Quackenbush, J., Sherlock, G., Spellman, P., Stoeckert, C., Aach, J., Ansorge, W., Ball, C. A., Causton, H. C., et al. (2001) · Nature Genetics · doi:10.1038/ng1201-365 · Cited by 4,109 · cited 1×

    “Rennie and Flanagin, 2018 Brazma et al., 2001 Eskes et al., 2017 Landis et al., 2012; Collins and Tabak, 2014; Clayton and Collins, 2014; Lorsch et al., 2014 O’Brien et al., 2014 Nakayama et al., 2005 Foster and Deardorff, 2017 ahttps://bit.ly/1F0K2O6; bhttps://www.nlm.nih.gov/cde/index.html;…”
    Background
  • Policy: NIH to balance sex in cell and animal studies

    Clayton, J. A., & Collins, F. S. (2014) · Nature · doi:10.1038/509282a · Cited by 1,816 · cited 1×

    “Rennie and Flanagin, 2018 Brazma et al., 2001 Eskes et al., 2017 Landis et al., 2012; Collins and Tabak, 2014; Clayton and Collins, 2014; Lorsch et al., 2014 O’Brien et al., 2014 Nakayama et al., 2005 Foster and Deardorff, 2017 ahttps://bit.ly/1F0K2O6; bhttps://www.nlm.nih.gov/cde/index.html;…”
    Background
  • Policy: NIH plans to enhance reproducibility

    Collins, F. S., & Tabak, L. A. (2014) · Nature · doi:10.1038/505612a · Cited by 1,247 · cited 1×

    “Rennie and Flanagin, 2018 Brazma et al., 2001 Eskes et al., 2017 Landis et al., 2012; Collins and Tabak, 2014; Clayton and Collins, 2014; Lorsch et al., 2014 O’Brien et al., 2014 Nakayama et al., 2005 Foster and Deardorff, 2017 ahttps://bit.ly/1F0K2O6; bhttps://www.nlm.nih.gov/cde/index.html;…”
    Background
  • A call for transparent reporting to optimize the predictive value of preclinical research

    Landis, S. C., Amara, S. G., Asadullah, K., Austin, C. P., Blumenstein, R., Bradley, E. W., Crystal, R. G., Darnell, R. B., Ferrante, R. J., Fillit, H., et al. (2012) · Nature · doi:10.1038/nature11556 · Cited by 1,196 · cited 1×

    “Rennie and Flanagin, 2018 Brazma et al., 2001 Eskes et al., 2017 Landis et al., 2012; Collins and Tabak, 2014; Clayton and Collins, 2014; Lorsch et al., 2014 O’Brien et al., 2014 Nakayama et al., 2005 Foster and Deardorff, 2017 ahttps://bit.ly/1F0K2O6; bhttps://www.nlm.nih.gov/cde/index.html;…”
  • The economics of reproducibility in preclinical research

    Freedman, L. P., Cockburn, I. M., & Simcoe, T. S. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002165 · Cited by 1,055 · cited 1×

    “Freedman et al. (2015) have estimated how this translates to wasted money: “the cumulative (total) prevalence of irreproducible preclinical research exceeds 50%, resulting in approximately US$28,000,000,000 (US $28B)/year spent on preclinical research that is not reproducible – in the United States…”
  • Untitled work

    (2018) · doi:10.1001/jama · Cited by 932

Show all 62 references

Research works printed but not linked: 3

  1. Griesinger, C., Hoffmann, S., Kinsner-Ovaskainen, A. et al. (2009). Proceedings of the First International Forum To- wards Evidence-Based Toxicology. Conference Centre Spazio Villa Erba, Como, Italy. 15-18 October 2007. Human Exp Toxicol, Spec Issue: Evidence-Based Toxicology (EBT) 28, 83-163.
  2. Hoffmann, S., Edler, L., Gardner, I. et al. (2008). Points of reference in validation -The report and recommendations of ECVAM Workshop. Altern Lab Anim 36, 343-352.
  3. Whaley, P., Watford S., Allard P. et al. (in preparation). En- hancing systematic review and evidence mapping with shared ontologies and semantic matching: An example from epigenetic research.

Cited by

See all 65

Metadata

Authors
Hartung, T.
Venue
ALTEX
Publisher
ALTEX Edition
Published
2019
Volume
36
Issue
1
Pages
3-17
ISSN
  • 0946-7785 (ISSN-L)
  • 1868-596X
OpenAlex
W2910963560
Cited by
65
References
60
Citations by year
2026: 5 · 2025: 6 · 2024: 5 · 2023: 9 · 2022: 7 · 2021: 11 · 2020: 14 · 2019: 8
FWCI
14.98
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • ALTEX (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Lancaster EPrints (Lancaster University) (acceptedVersion, other-oa)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • KOPS (University of Konstanz) (submittedVersion, cc-by)
  • Radboud Repository (Radboud University) (submittedVersion)
  • Radboud Repository (Radboud University) (submittedVersion, other-oa)
Topics
  • Health Sciences › Veterinary › Small Animals › Animal testing and alternatives
  • Social Sciences › Library and Information Sciences › Academic Writing and Publishing
  • Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
Keywords
in vitro research, reporting guidelines, reproducibility, peer review, reporting quality, data transparency, data presentation, replication crisis
MeSH terms
Publishing, Research Design, Reproducibility of Results, Checklist, In Vitro Techniques

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Toward good in vitro reporting standards. https://app.cochat.ai/papers/10.14573/altex.1812191
The paper
Hartung, T. (2019). Toward good in vitro reporting standards. ALTEX. https://doi.org/10.14573/altex.1812191

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.