Does big data require a methodological change in medical research?
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Use of big data is becoming increasingly popular in medical research. Since big data-based projects differ notably from classical research studies, both in terms of scope and quality, a debate is apt as to whether big data require new approaches to scientific reasoning different from those established in statistics and philosophy of science. MAIN TEXT: The progressing digitalization of our societies generates vast amounts of data that also become available for medical research. Here, the big promise of big data is to facilitate major improvements in the treatment, diagnosis and prevention of diseases. An ongoing examination of the idiosyncrasies of big data is therefore essential to ensure that the field stays congruent with the principles of evidence-based medicine. We discuss the inherent challenges and opportunities of big data in medicine from a methodological point of view, particularly highlighting the relative importance of causality and correlation in commercial and medical research settings. We make a strong case for upholding the distinction between exploratory data analysis facilitating hypothesis generation and confirmatory approaches involving hypothesis validation. An independent verification of research results will be ever more important in the context of big data, where data quality is often hampered by a lack of standardization and structuring. CONCLUSIONS: We argue that it would be both unnecessary and dangerous to discard long-established principles of data generation, analysis and interpretation in the age of big data. While many medical research areas may reasonably benefit from big data analyses, they should nevertheless be complemented by carefully designed (prospective) studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“An additional major current concern lies in the light-minded interchange of correlation and causality with flawed conclusions on presumed psychological processes (Antes, 2016; Caliebe et al., 2019), as observed in some privately funded studies resorting to big data gathered by large tech companies.”
From More Light? Opportunities and Pitfalls in Digitalized Psychotherapy Process Research (2021) · cites this paper as Caliebe et al., 2019
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
The environment and disease: association or causation?
Hill, A. B. (2015) · Journal of the Royal Society of Medicine · doi:10.1177/0141076814562718 · Cited by 7,285 · cited 1×
“…in particular, causality can often be inferred from observational data with reasonable certainty [13] and the Bradford-Hill criteria, first proposed > 50 years ago, still provide a good guide to transforming correlation into likely causality by way of combining different lines of evidence [14].”
BackgroundThe Environment and Disease: Association or Causation?
Hill, A. B. (1965) · Proceedings of the Royal Society of Medicine · doi:10.1177/003591576505800503 · Cited by 6,974
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Big data: a revolution that will transform how we live, work, and think
(2013) · Choice Reviews Online · doi:10.5860/choice.50-6804 · Cited by 3,630
Khera, A. V., Chaffin, M., Aragam, K. G., Haas, M. E., Roselli, C., Choi, S. H., Natarajan, P., Lander, E. S., Lubitz, S. A., Ellinor, P. T., et al. (2018) · Nature Genetics · doi:10.1038/s41588-018-0183-z · Cited by 2,953
Shmueli, G. (2010) · Statistical Science · doi:10.1214/10-sts330 · Cited by 2,517
N., E., & Popper, K. (1935) · The Journal of Philosophy · doi:10.2307/2016612 · Cited by 1,424
Personalized medicine: Time for one-person trials
Schork, N. J. (2015) · Nature · doi:10.1038/520609a · Cited by 1,223
Popper, K. (1935) · Springer eBooks · doi:10.1007/978-3-7091-4177-9 · Cited by 982
Research works printed but not linked: 1
- Institute of Medicine (US) Roundtable on evidence-based medicine, the learning healthcare system: workshop summary 2007 Washington (DC) National Academies Press (US) 21452449
Cited by
Bickman, L. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01065-8 · Cited by 184
“Caliebe et al. (2019) see big data, and I would assume AI, as contributing to hypotheses generation that could then be tested in RCTs.”
BackgroundSedláková, J., Daniore, P., Horn, A. B., Wolf, M., Stanikić, M., Haag, C., Sieber, C., Schneider, G., Staub, K., Ettlin, D. A., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000347 · Cited by 164
Big data: Historic advances and emerging trends in biomedical research
Cremin, C. J., Dash, S., & Huang, X. (2022) · Current Research in Biotechnology · doi:10.1016/j.crbiot.2022.02.004 · Cited by 104
Including diverse and admixed populations in genetic epidemiology research
Caliebe, A., Ayele, F. T., Darst, B. F., Wang, X., Song, Y. E., Gui, J., Sebro, R., Balding, D. J., Saad, M., & Dubé, M. (2022) · Genetic Epidemiology · doi:10.1002/gepi.22492 · Cited by 51
Self-citationAn overview of healthcare data analytics with applications to the COVID-19 pandemic
Fei, Z., Ryeznik, Y., Sverdlov, A., Tan, C. W., & Wong, W. K. (2021) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2021.3103458 · Cited by 63
“but there are constant debates on the analytic approaches [22].”
Background
Metadata
- Authors
- Caliebe, A., Leverkus, F., Antes, G., & Krawczak, M.
- Affiliations
- Christian-Albrechts-Universität zu Kiel (DE)
- Pfizer (Germany) (DE)
- LMU Klinikum (DE)
- Corresponding author
- Caliebe, Amke
- Venue
- BMC Medical Research Methodology
- Published
- 2019-06-17
- Volume
- 19
- Issue
- 1
- Pages
- 125-125
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC6580448
- OpenAlex
- W2951900635
- Cited by
- 28
- References
- 19
- Citations by year
- 2026: 4 · 2025: 2 · 2024: 4 · 2023: 5 · 2022: 2 · 2021: 5 · 2020: 4 · 2019: 2
- FWCI
- 3.85
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (tdm)
- creativecommons.org/licenses/by/4.0/ (vor)
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Ludwig-Maximilians-Universität München
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- big data, medical research methodology, evidence-based medicine, correlation versus causation, exploratory data analysis, hypothesis generation, hypothesis verification, data quality, digitalization, research verification, prospective study
- MeSH terms
- Big Data, Data Interpretation, Statistical, Humans, Prospective Studies, Research Design, Databases, Factual, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Does big data require a methodological change in medical research? https://app.cochat.ai/papers/10.1186/s12874-019-0774-0
- The paper
- Caliebe, A., Leverkus, F., Antes, G., & Krawczak, M. (2019). Does big data require a methodological change in medical research? BMC Medical Research Methodology. https://doi.org/10.1186/s12874-019-0774-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.