The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Comparison of Population-Based Observational Studies With Randomized Trials in Oncology
Open accessAbstract
PURPOSE: Comparative efficacy research performed using population registries can be subject to significant bias. There is an absence of objective data demonstrating factors that can sufficiently reduce bias and provide accurate results. METHODS: MEDLINE was searched from January 2000 to October 2016 for observational studies comparing two treatment regimens for any diagnosis of cancer, using SEER, SEER-Medicare, or the National Cancer Database. Reporting quality and statistical methods were assessed using components of the STROBE criteria. Randomized trials comparing the same treatment regimens were identified. Primary outcome was correlation between survival hazard ratio (HR) estimates provided by the observational studies and randomized trials. Secondary outcomes included agreement between matched pairs and predictors of agreement. RESULTS: Of 3,657 studies reviewed, 350 treatment comparisons met eligibility criteria and were matched to 121 randomized trials. There was no significant correlation between the HR estimates reported by observational studies and randomized trials (concordance correlation coefficient, 0.083; 95% CI, −0.068 to 0.230). Forty percent of matched studies were in agreement regarding treatment effects (κ, 0.037; 95% CI, −0.027 to 0.1), and 62% of the observational study HRs fell within the 95% CIs of the randomized trials. Cancer type, data source, reporting quality, adjustment for age, stage, or comorbidities, use of propensity weighting, instrumental variable or sensitivity analysis, and well-matched study population did not predict agreement. CONCLUSION: We were unable to identify any modifiable factor present in population-based observational studies that improved agreement with randomized trials. There was no agreement beyond what is expected by chance, regardless of reporting quality or statistical rigor of the observational study. Future work is needed to identify reliable methods for conducting population-based comparative efficacy research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Writing Group for the Women's Health Initiative Investigators (2002) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.288.3.321 · Cited by 15,889
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563
A comparison of observational studies and randomized, controlled trials.
Benson, K., & Hartz, A. J. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422506 · Cited by 2,347
Randomized versus historical controls for clinical trials
Sacks, H., Chalmers, T. C., & Smith, H. (1982) · The American Journal of Medicine · doi:10.1016/0002-9343(82)90815-4 · Cited by 834
Cited by
Association of Black Race With Prostate Cancer–Specific and Other-Cause Mortality
Dess, R. T., Hartman, H. E., Mahal, B. A., Soni, P. D., Jackson, W. C., Cooperberg, M. R., Amling, C. L., Aronson, W. J., Kane, C. J., Terris, M. K., et al. (2019) · JAMA Oncology · doi:10.1001/jamaoncol.2019.0826 · Cited by 414
Self-citationAvoidable flaws in observational analyses: an application to statins and cancer
Dickerman, B. A., García-Albéniz, X., Logan, R. W., Denaxas, S., & Hernán, M. A. (2019) · Nature Medicine · doi:10.1038/s41591-019-0597-x · Cited by 308
Prevalence of Missing Data in the National Cancer Database and Association with Overall Survival
Yang, D. X., Khera, R., Miccio, J. A., Jairam, V., Chang, E., Yu, J. B., Park, H. S., Krumholz, H. M., & Aneja, S. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.1793 · Cited by 135
“Recent systematic comparisons of registry studies and randomized trials do not demonstrate concordant results.(7,9) Poor quality All rights reserved.”
BackgroundToews, I., Anglemyer, A., Nyirenda, J. L., Alsaid, D., Balduzzi, S., Grummich, K., Schwingshackl, L., & Bero, L. (2024) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000034.pub3 · Cited by 60
Metadata
- Authors
- Soni, P. D., Hartman, H. E., Dess, R. T., Abugharib, A., Allen, S. G., Feng, F. Y., Zietman, A. L., Jagsi, R., Schipper, M. J., & Spratt, D. E.
- Venue
- Journal of Clinical Oncology
- Published
- 2019-05-10
- Volume
- 37
- Issue
- 14
- Pages
- 1209-1216
- ISSN
- 0732-183X (ISSN-L)
- 1527-7755
- OpenAlex
- W2923168788
- Cited by
- 171
- References
- 6
- FWCI
- 21.50
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.