CoChat

Does big data require a methodological change in medical research?

Open access
Caliebe, Amke, Leverkus, Friedhelm, Antes, Gerd, Krawczak, Michael · 2019 · BMC Medical Research Methodology

The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.

Abstract

BACKGROUND: Use of big data is becoming increasingly popular in medical research. Since big data-based projects differ notably from classical research studies, both in terms of scope and quality, a debate is apt as to whether big data require new approaches to scientific reasoning different from those established in statistics and philosophy of science. MAIN TEXT: The progressing digitalization of our societies generates vast amounts of data that also become available for medical research. Here, the big promise of big data is to facilitate major improvements in the treatment, diagnosis and prevention of diseases. An ongoing examination of the idiosyncrasies of big data is therefore essential to ensure that the field stays congruent with the principles of evidence-based medicine. We discuss the inherent challenges and opportunities of big data in medicine from a methodological point of view, particularly highlighting the relative importance of causality and correlation in commercial and medical research settings. We make a strong case for upholding the distinction between exploratory data analysis facilitating hypothesis generation and confirmatory approaches involving hypothesis validation. An independent verification of research results will be ever more important in the context of big data, where data quality is often hampered by a lack of standardization and structuring. CONCLUSIONS: We argue that it would be both unnecessary and dangerous to discard long-established principles of data generation, analysis and interpretation in the age of big data. While many medical research areas may reasonably benefit from big data analyses, they should nevertheless be complemented by carefully designed (prospective) studies.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s12874-019-0774-0

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Comparison of big data studies and controlled clinical trials. Whereas big data studies (left inset) usually benefit from the opportunistic use of existing data resources, controlled clinical trials (CCT, right inset) follow a hypothesis-driven study design that determines the type, amount and provenance of the data to be collected. The subsequent data analyses may be methodologically similar or even identical, but the results of the two study types serve rather different purposes: The outcome of a big data study, at best, is a new hypothesis that would require verification in a CCT or controlled experiment to count as ‘scientific’ (dotted arrow). A CCT, by contrast, allows validation (i.e. falsification or verification) of the initial hypothesis, potentially stimulating further studies geared at the solidification, modification or diversification of this hypothesis
Fig. 1 Comparison of big data studies and controlled clinical trials. Whereas big data studies (left inset) usually benefit from the opportunistic use of existing data resources, controlled clinical trials (CCT, right inset) follow a hypothesis-driven study design that determines the type, amount and provenance of the data to be collected. The subsequent data analyses may be methodologically similar or even identical, but the results of the two study types serve rather different purposes: The outcome of a big data study, at best, is a new hypothesis that would require verification in a CCT or controlled experiment to count as ‘scientific’ (dotted arrow). A CCT, by contrast, allows validation (i.e. falsification or verification) of the initial hypothesis, potentially stimulating further studies geared at the solidification, modification or diversification of this hypothesisCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 20 references

Research works printed but not linked: 1

  1. Institute of Medicine (US) Roundtable on evidence-based medicine, the learning healthcare system: workshop summary 2007 Washington (DC) National Academies Press (US) 21452449

Cited by

See all 31

Metadata

Authors
Caliebe, A., Leverkus, F., Antes, G., & Krawczak, M.
Affiliations
  • Christian-Albrechts-Universität zu Kiel (DE)
  • Pfizer (Germany) (DE)
  • LMU Klinikum (DE)
Corresponding author
Caliebe, Amke
Venue
BMC Medical Research Methodology
Published
2019-06-17
Volume
19
Issue
1
Pages
125-125
ISSN
1471-2288 (ISSN-L)
OpenAlex
W2951900635
Cited by
28
References
19
Citations by year
2026: 4 · 2025: 2 · 2024: 4 · 2023: 5 · 2022: 2 · 2021: 5 · 2020: 4 · 2019: 2
FWCI
3.85
Type
journal article
Language
en
Open access
Licence
Locations
  • BMC Medical Research Methodology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
Ludwig-Maximilians-Universität München
Topics
  • Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
big data, medical research methodology, evidence-based medicine, correlation versus causation, exploratory data analysis, hypothesis generation, hypothesis verification, data quality, digitalization, research verification, prospective study
MeSH terms
Big Data, Data Interpretation, Statistical, Humans, Prospective Studies, Research Design, Databases, Factual, Biomedical Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Does big data require a methodological change in medical research? https://app.cochat.ai/papers/10.1186/s12874-019-0774-0
The paper
Caliebe, A., Leverkus, F., Antes, G., & Krawczak, M. (2019). Does big data require a methodological change in medical research? BMC Medical Research Methodology. https://doi.org/10.1186/s12874-019-0774-0

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.