Are Randomized Controlled Trials the (G)old Standard? From Clinical Intelligence to Prescriptive Analytics
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Despite the accelerating pace of scientific discovery, the current clinical research enterprise does not sufficiently address pressing clinical questions. Given the constraints on clinical trials, for a majority of clinical questions, the only relevant data available to aid in decision making are based on observation and experience. Our purpose here is 3-fold. First, we describe the classic context of medical research guided by Poppers' scientific epistemology of "falsificationism." Second, we discuss challenges and shortcomings of randomized controlled trials and present the potential of observational studies based on big data. Third, we cover several obstacles related to the use of observational (retrospective) data in clinical studies. We conclude that randomized controlled trials are not at risk for extinction, but innovations in statistics, machine learning, and big data analytics may generate a completely new ecosystem for exploration and validation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group* (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-152-11-201006010-00232 · Cited by 3,824
Big data analytics in healthcare: promise and potential
Raghupathi, W., & Raghupathi, V. (2014) · Health Information Science and Systems · doi:10.1186/2047-2501-2-3 · Cited by 3,034 · cited 1×
“With the accumulation of large amounts of health-related data, the methods for therapeutic effect quantification have been rapidly evolving and are driven by recent innovations in statistics, machine learning, and big data analytics [3].”
The Framingham Heart Study and the epidemiology of cardiovascular disease: a historical perspective
Mahmood, S. S., Levy, D., Vasan, R. S., & Wang, T. J. (2014) · The Lancet · doi:10.1016/s0140-6736(13)61752-3 · Cited by 1,622 · cited 1×
“The Framingham Heart Study is a historical example of a large, productive prospective cohort study [11].”
George, H., Duke Jon, D., Shah Nigam, H., Reich Christian, G., Vojtech, H., Schuemie Martijn, J., Suchard Marc, A., Woong, P. R., Kei, W. I. C., Rijnbeek Peter, R., et al. (2015) · Studies in Health Technology and Informatics · doi:10.3233/978-1-61499-564-7-574 · Cited by 1,542
Streptomycin Treatment of Pulmonary Tuberculosis: A Medical Research Council Investigation
(1948) · BMJ · doi:10.1136/bmj.2.4582.769 · Cited by 986
Observational studies: Cohort and case-control studies
Song, J. W., & Chung, K. C. (2010) · Plastic and Reconstructive Surgery · doi:10.1097/prs.0b013e3181f44abc · Cited by 948 · cited 1×
“Observational studies could complement RCTs in generating hypotheses, establishing questions for future RCTs, and defining clinical conditions [73].”
Ozenne, B., Subtil, F., & Maucort-Boulch, D. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.02.010 · Cited by 379
An estimate of the science-wise false discovery rate and application to the top medical literature
Jager, L. R., & Leek, J. T. (2014) · Biostatistics · doi:10.1093/biostatistics/kxt007 · Cited by 179 · cited 1×
“Limitations of RCTs or suboptimally designed RCTs are at times overlooked or ignored [14].”
Marginal space deep learning: efficient architecture for volumetric image parsing
Ghesu, F. C., Krubasik, E., Georgescu, B., Singh, V., Zheng, Y., Hornegger, J., & Comaniciu, D. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2538802 · Cited by 142
Cited by
Personalized treatment of patients with very early hepatocellular carcinoma
Vitale, A., Peck-Radosavljevic, M., Giannini, E. G., Vibert, E., Sieghart, W., Van Poucke, S., & Pawlik, T. M. (2017) · Journal of Hepatology · doi:10.1016/j.jhep.2016.09.012 · Cited by 168
“Along with these changes, many experts worldwide are now strongly supporting the use of observational studies and data derived from “big data” [8, 9] to derive and validate individual prognostic prediction and treatment decision tools at the individual patient level.”
BackgroundSelf-citationCresswell, K., Callaghan, M., Khan, S., Sheikh, Z., Mozaffar, H., & Sheikh, A. (2020) · Health Informatics Journal · doi:10.1177/1460458219900452 · Cited by 87
Web-Based Tools for Text-Based Patient-Provider Communication in Chronic Conditions: Scoping Review
Voruganti, T., Grunfeld, E., Makuwaza, T., & Bender, J. L. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7987 · Cited by 38
East, M. L., Havard, B., & Hastings, N. B. (2016) · Journal of Technology in Human Services · doi:10.1080/15228835.2016.1233842 · Cited by 7
El Morr, C., & Ali-Hassan, H. (2019) · SpringerBriefs in Health Care Management and Economics · doi:10.1007/978-3-030-04506-7_2 · Cited by 2
Metadata
- Authors
- Van Poucke, S., Thomeer, M., Heath, J., & Vukicevic, M.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2016-07-06
- Volume
- 18
- Issue
- 7
- Pages
- e185
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2462687589
- Cited by
- 46
- References
- 9
- FWCI
- 8.12
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Are Randomized Controlled Trials the (G)old Standard? From Clinical Intelligence to Prescriptive Analytics. https://app.cochat.ai/papers/10.2196/jmir.5549
- The paper
- Van Poucke, S., Thomeer, M., Heath, J., & Vukicevic, M. (2016). Are Randomized Controlled Trials the (G)old Standard? From Clinical Intelligence to Prescriptive Analytics. Journal of Medical Internet Research. https://doi.org/10.2196/jmir.5549
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.