Routinely collected data and comparative effectiveness evidence: promises and limitations
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Routinely collected data (RCD) are increasingly used for biomedical research. Extensive resources have been invested in this field: they include the set-up of disease registries and clinical databases at regional, national or international levels; the promotion of the use of electronic health
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010 · Cited by 17,796
Benchimol, E. I., Smeeth, L., Guttmann, A., Harron, K., Moher, D., Petersen, I., Sørensen, H. T., von Elm, E., Langan, S. M., & RECORD Working Committee (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001885 · Cited by 5,749
The well-built clinical question: A key to evidence-based decisions
(1995) · ACP Journal Club · doi:10.7326/acpjc-1995-123-3-a12 · Cited by 2,931
How to increase value and reduce waste when research priorities are set
Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., Howells, D. W., Ioannidis, J. P. A., & Oliver, S. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62229-1 · Cited by 1,436
Self-citationReducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319
Instruments for Causal Inference: An Epidemiologist's Dream?
Hernán, M. A., & Robins, J. M. (2006) · Epidemiology · doi:10.1097/01.ede.0000222409.00878.37 · Cited by 961
Subgroup analysis in randomised controlled trials: importance, indications, and interpretation
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17709-5 · Cited by 942
Comparison of Evidence of Treatment Effects in Randomized and Nonrandomized Studies
Ioannidis, J. P. A. (2001) · JAMA · doi:10.1001/jama.286.7.821 · Cited by 919
Self-citationIncreasing value and reducing waste: addressing inaccessible research
Chan, A.-W., Song, F., Vickers, A., Jefferson, T., Dickersin, K., Gøtzsche, P. C., Krumholz, H. M., Ghersi, D., & van der Worp, H. B. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62296-5 · Cited by 887
Demystifying trial networks and network meta-analysis
Mills, E. J., Thorlund, K., & Ioannidis, J. P. A. (2013) · BMJ · doi:10.1136/bmj.f2914 · Cited by 742
Self-citationRepresentation of the Elderly, Women, and Minorities in Heart Failure Clinical Trials
Heiat, A., Gross, C. P., & Krumholz, H. M. (2002) · Archives of Internal Medicine · doi:10.1001/archinte.162.15.1682 · Cited by 723 · cited 7×
“CMAJ, May 17, 2016, 188(8) E159 health care systems make large investments in infrastructure and maintenance because of the increasing popularity of electronic health records).”
BackgroundInfluentialNaci, H., & Ioannidis, J. P. A. (2013) · BMJ · doi:10.1136/bmj.f5577 · Cited by 630
Self-citationData linkage: a powerful research tool with potential problems
Bohensky, M. A., Jolley, D., Sundararajan, V., Evans, S., Pilcher, D. V., Scott, I., & Brand, C. A. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-346 · Cited by 234
Informed Consent, Big Data, and the Oxymoron of Research That Is Not Research
Ioannidis, J. P. A. (2013) · The American Journal of Bioethics · doi:10.1080/15265161.2013.768864 · Cited by 111
Self-citation
Cited by
Why Most Clinical Research Is Not Useful
Ioannidis, J. P. A. (2016) · PLOS Medicine · doi:10.1371/journal.pmed.1002049 · Cited by 655
Self-citationTrustworthy Online Controlled Experiments: A Practical Guide to A/B Testing
Kohavi, R., Tang, D., & Xu, Y. (2020) · doi:10.1017/9781108653985 · Cited by 297
Mc Cord, K. A., Ewald, H., Agarwal, A., Glinz, D., Aghlmandi, S., Ioannidis, J. P. A., & Hemkens, L. G. (2021) · BMJ · doi:10.1136/bmj.n450 · Cited by 61
Self-citationSommerlad, A., Werbeloff, N., Perera, G., Smith, T., Costello, H., Mueller, C., Kormilitzin, A., Broadbent, M., Nevado‐Holgado, A., Lovestone, S., et al. (2022) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.5625 · Cited by 14
“Our use of data from three different services covering around 5% of the UK's population, as well as the inclusion of almost all eligible people in this naturalistic study, ensures that our findings are generalizable and avoids the selection bias common in randomised controlled trials.(45,46) Our use of mixed linear mo…”
MethodSyversen, A. M., Schønning, V., Fjellheim, G. S., Elgen, I., & Wergeland, G. J. (2024) · BMC Psychiatry · doi:10.1186/s12888-024-05876-z · Cited by 6
“Studies evaluating DBT-A with treatment implemented as part of the routine clinical services delivered could complement findings from efficacy studies regarding the effectiveness of the treatment [25, 26].”
Method
Metadata
- Authors
- Hemkens, L. G., Contopoulos-Ioannidis, D. G., & Ioannidis, J. P. A.
- Venue
- Canadian Medical Association Journal
- Publisher
- CMA Joule Inc.
- Published
- 2016-02-16
- Volume
- 188
- Issue
- 8
- Pages
- E158-E164
- ISSN
- 0820-3946 (ISSN-L)
- 1488-2329
- OpenAlex
- W2402580331
- Cited by
- 181
- References
- 15
- FWCI
- 18.99
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.