Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index; 3 of the 8 sources its claims cite were checked for support.

No raw data, no science: another possible source of the reproducibility crisis

Open access
Miyakawa, Tsuyoshi · 2020 · Molecular Brain

Abstract

A reproducibility crisis is a situation where many scientific studies cannot be reproduced. Inappropriate practices of science, such as HARKing, p-hacking, and selective reporting of positive results, have been suggested as causes of irreproducibility. In this editorial, I propose that a lack of raw data or data fabrication is another possible cause of irreproducibility. As an Editor-in-Chief of Molecular Brain , I have handled 180 manuscripts since early 2017 and have made 41 editorial decisions categorized as “Revise before review,” requesting that the authors provide raw data. Surprisingly, among those 41 manuscripts, 21 were withdrawn without providing raw data, indicating that requiring raw data drove away more than half of the manuscripts. I rejected 19 out of the remaining 20 manuscripts because of insufficient raw data. Thus, more than 97% of the 41 manuscripts did not present the raw data supporting their results when requested by an editor, suggesting a possibility that the raw data did not exist from the beginning, at least in some portions of these cases. Considering that any scientific study should be based on raw data, and that data storage space should no longer be a challenge, journals, in principle, should try to have their authors publicize raw data in a public database or journal site upon the publication of the paper to increase reproducibility of the published results and to increase public trust in science.

Overview

CoChat Summary

TL;DR

This editorial argues that lack of raw data—and possibly data fabrication—is another likely source of the reproducibility crisis, based on the author’s experience handling manuscripts as Editor-in-Chief of *Molecular Brain*. The author reports that when asked for raw data, more than 97% of 41 flagged manuscripts did not provide appropriate raw data, and proposes that journals require raw data deposition before publication.

Key findings

  • Of 180 manuscripts handled since early 2017 to September 2019, 41 received “Revise before review” decisions requesting raw data; 21 were withdrawn without providing raw data, and of the remaining 20, 19 were rejected for insufficient raw data. Only 1 was sent for review and accepted, meaning more than 97% of the 41 did not or could not provide appropriate raw data.
  • Among the 20 resubmitted with some raw data, 9 presented partial or no data, 7 had raw data that did not match the results, 11 of 18 western blotting manuscripts lacked size markers and/or entire membrane images, and 2 showed evidence of image duplications and inappropriate cuts/pastes.
  • Among 40 withdrawn or rejected manuscripts, 14 were later published elsewhere; 12 of those journals require or recommend raw data upon request. The author contacted authors of the 12 papers: 10 did not respond, 1 sent raw data for only one sample per condition when each condition was supposed to have 6 samples, and 1 declined.
  • Informal Twitter surveys: about 53% of 227 life-science respondents suspected more than two-thirds of withdrawn/insufficient manuscripts might have fabricated data; more than 60% of 56 researchers thought careful fabricators equal or outnumber careless ones, leading the author to roughly estimate that more than a quarter of the 180 manuscripts may include some misconduct.

Methods

  • Editorial/descriptive analysis by the Editor-in-Chief of *Molecular Brain*, covering 180 manuscripts handled from early 2017 to September 2019, with 41 “Revise before review” decisions requesting raw data, absolute p-values, and multiple-test corrections.
  • Counts of manuscript withdrawal, rejection, raw-data sufficiency, mismatches between raw data and results, and image problems; follow-up requests to authors of 14 later-published papers; and two informal Japanese-language Twitter surveys (227 and 56 life-science respondents).
  • No formal statistical modeling or systematic sampling is reported; the analysis is descriptive and based on the editor’s caseload and online speculation.

Limitations

  • The paper states that it cannot know what percentage of manuscripts had fabricated data without formal investigation, that its estimates are rough and casual speculation based on non-scientific and anecdotal episodes, and that the Twitter surveys reflect speculation or “gut feelings” rather than concrete examples.
  • The paper notes alternative reasons authors may withdraw after being asked for raw data, including unwillingness to gather/upload data, data-mining concerns, or choosing journals that do not require disclosure; it also notes that rejected cases could be honest and careless mistakes, and that requests included absolute p-values and multiple-test corrections, so raw data may not be the sole reason for withdrawal.
  • Evident from the text: the findings come from a single editor at one journal, use a non-random convenience sample, rely on subjective triggers such as data looking “too beautiful to be true,” and include no formal verification of fabrication or misconduct.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s13041-020-0552-2

Cites

14 of 14 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Flowchart of the manuscripts handled by Tsuyoshi Miyakawa in Molecular Brain from December 2017 to September 2019
Fig. 1 Flowchart of the manuscripts handled by Tsuyoshi Miyakawa in Molecular Brain from December 2017 to September 2019CC BY · PubMed Central

Verification

Claims the paper makes

3 Valid · 5 Not valid · 5 Not checked · 30 Own results and interpretations

17 more claims

Create a free account to see all 43 claims and to verify the 5 references still open.

See all claims — free account
  • It may state two separate claims as one. 5
  • Probably not a substantial claim. 18

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

1 retracted

Show all 14 references

Research works printed but not linked: 1

  1. Cell Press STAR★Methods. Available from: https://www.cell.com/star-authors-guide. Cited 5 Nov 2019.

Cited by

See all 268

Metadata

Authors
Miyakawa, T.
Affiliations
Fujita Health University (JP)
Corresponding author
Miyakawa, Tsuyoshi
Venue
Molecular Brain
Published
2020-02-21
Volume
13
Issue
1
Pages
24-24
ISSN
1756-6606 (ISSN-L)
OpenAlex
W3012838233
Cited by
268
References
14
Citations by year
2026: 13 · 2025: 21 · 2024: 67 · 2023: 35 · 2022: 44 · 2021: 53 · 2020: 34
Type
journal article
Language
en
Open access
Licence
Locations
  • Molecular Brain (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
  • Social Sciences › Education › Academic integrity and plagiarism
Keywords
replication crisis, raw data availability, data fabrication, data sharing, editorial policy, manuscript rejection, scholarly publishing, research integrity, selective reporting
MeSH terms
Data Analysis, Publications, Science, Reproducibility of Results

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: No raw data, no science: another possible source of the reproducibility crisis. https://app.cochat.ai/papers/10.1186/s13041-020-0552-2
The paper
Miyakawa, T. (2020). No raw data, no science: another possible source of the reproducibility crisis. Molecular Brain. https://doi.org/10.1186/s13041-020-0552-2

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.