The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
RE: "SHOULD META-ANALYSES OF INTERVENTIONS INCLUDE OBSERVATIONAL STUDIES IN ADDITION TO RANDOMIZED CONTROLLED TRIALS? A CRITICAL EXAMINATION OF UNDERLYING PRINCIPLES"
Abstract
In their recent article, Shrier et al. (l) considered a 95% confidence interval as being one with a 95% probability that a population parameter is included in the interval and a 5% probability that it will lie outside the interval. We wish to clarify some aspects of confidence intervals' interpretation. A simple example illustrates our points. Let us consider a group of 20 patients who receive a new treatment. Only 6 fail to respond to the treatment. Let π be the population proportion of possible patients who would not respond to the treatment. π is the parameter of interest; its true unknown value is the quantity to be estimated. Considering the Bernoulli process, the likelihood is π6(1 − π)14 for 0 < π < 1. We calculate an exact interval with 90% confidence (2) that happens to be nonsymmetric around 6/20: (0.175, 0.505). This may be the smallest (most precise) 90% confidence interval for the observation “6 out of 20.” The correct interpretation of the information that π is in this interval with 90% confidence is as follows: If we could repeat this procedure over a large number of samples of size 20, the true unknown value of π would be contained in 90% of the intervals; hence, we are confident that our particular interval, (0.175, 0.505), contains the true value of π. Note that we never use the term probability, since this interpretation is actually a frequentist one. The evaluation is based on samples that could have been observed but were not. Note also that since π is not a random quantity in the frequentist environment, π belongs (or not) to the interval without any probability attached to the statement. This is the reason to speak about confidence, not probability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Hapeman, D. E. (1991) · Technometrics · doi:10.1080/00401706.1991.10484817 · Cited by 9,373
CAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C. (2001) · The Philosophical Review · doi:10.1215/00318108-110-4-639 · Cited by 4,741
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563
Clinical Epidemiology: A Basic Science for Clinical Medicine.
(1991) · Annals of Internal Medicine · doi:10.7326/0003-4819-114-9-825_9 · Cited by 3,476
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“In choosing to include observational studies, we must remain cautious not to overinterpret the data because there may be a greater risk of publication bias ( 43 ), and any between-study heterogeneity needs to be appropriately explored.”
BackgroundAir Pollution and Hospital Admissions for Heart Disease in Eight U.S. Counties
Schwartz, J. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00005 · Cited by 3,038
Evaluating non-randomised intervention studies
Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D. (2003) · Health Technology Assessment · doi:10.3310/hta7270 · Cited by 2,907
A structural approach to selection bias
Hernán, M. A., Hernández-Díaz, S., & Robins, J. M. (2004) · Epidemiology · doi:10.1097/01.ede.0000135174.63482.43 · Cited by 2,844 · cited 1×
“... yield an unconfounded estimate by adjusting for the correct mix of potential confounders at the design stage by matching or restriction, or at the analysis stage with a multiple regression analysis, propensity scores, and so forth (14, 15) (as long as the underlying statistical assumptions are valid; e.g., is tran…”
BackgroundSystematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,401
Cited by
Tufanaru, C., Munn, Z., Stephenson, M., & Aromataris, E. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000065 · Cited by 1,057
Diffusion Theory and Knowledge Dissemination, Utilization, and Integration in Public Health
Green, L. W., Ottoson, J. M., García, C., & Hiatt, R. A. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100049 · Cited by 953
Ganesan, A. N., Shipp, N. J., Brooks, A. G., Kuklik, P., Lau, D. H., Lim, H. S., Sullivan, T., Roberts‐Thomson, K. C., & Sanders, P. (2013) · Journal of the American Heart Association · doi:10.1161/jaha.112.004549 · Cited by 800
“In recent years, however, meta-analysis has become accepted in the literature to aggregate results from observational data, to facilitate synthesis of available evidence and generation of new hypotheses.(37,38) In the case of AF ablation, the procedure is relatively new, with significant ongoing innovation in technolo…”
Making research relevant: if it is an evidence-based practice, where's the practice-based evidence?
Green, L. W. (2008) · Family Practice · doi:10.1093/fampra/cmn055 · Cited by 628
Pickup, J. C., & Sutton, A. J. (2008) · Diabetic Medicine · doi:10.1111/j.1464-5491.2008.02486.x · Cited by 617
Anatomy of bipolar disorder and schizophrenia: A meta-analysis
Ellison-Wright, I., & Bullmore, E. (2010) · Schizophrenia Research · doi:10.1016/j.schres.2009.12.022 · Cited by 565
Ajuied, A., Wong, F., Smith, C., Norris, M., Earnshaw, P., Back, D., & Davies, A. (2014) · The American Journal of Sports Medicine · doi:10.1177/0363546513508376 · Cited by 481
Reasons or excuses for avoiding meta-analysis in forest plots
Ioannidis, J. P. A., Patsopoulos, N. A., & Rothstein, H. R. (2008) · BMJ · doi:10.1136/bmj.a117 · Cited by 457
Effectiveness of recanalization of chronic total occlusions: A systematic review and meta-analysis
Joyal, D., Afilalo, J., & Rinfret, S. (2010) · American Heart Journal · doi:10.1016/j.ahj.2010.04.015 · Cited by 402
Predicting outcomes in radiation oncology—multifactorial decision support systems
Lambin, P., van Stiphout, R. G. P. M., Starmans, M. H. W., Rios-Velazquez, E., Nalbantov, G., Aerts, H. J. W. L., Roelofs, E., van Elmpt, W., Boutros, P. C., Granone, P., et al. (2013) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2012.196 · Cited by 402
Mason, A., Paulsen, R., Babuska, J. M., Rajpal, S., Burneikiene, S., Nelson, E. L., & Villavicencio, A. T. (2014) · Journal of Neurosurgery: Spine · doi:10.3171/2013.11.spine13413 · Cited by 384
Ziff, O. J., Lane, D. A., Samra, M., Griffith, M., Kirchhof, P., Lip, G. Y. H., Steeds, R. P., Townend, J., & Kotecha, D. (2015) · BMJ · doi:10.1136/bmj.h4451 · Cited by 341
Morbidity and mortality of candidaemia in Europe: an epidemiologic meta-analysis
Koehler, P., Stecher, M., Cornely, O. A., Koehler, D., Vehreschild, M. J. G. T., Bohlius, J., Wisplinghoff, H., & Vehreschild, J. J. (2019) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2019.04.024 · Cited by 336
Lambert, A. A., Lam, J. O., Paik, J. J., Ugarte-Gil, C., Drummond, M. B., & Crowell, T. A. (2015) · PLOS ONE · doi:10.1371/journal.pone.0128004 · Cited by 327
The effectiveness of Multisystemic Therapy (MST): A meta-analysis
van der Stouwe, T., Asscher, J. J., Stams, G. J. J. M., Deković, M., & van der Laan, P. H. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.06.006 · Cited by 321
Home telehealth for chronic obstructive pulmonary disease: a systematic review and meta-analysis
Polisena, J., Tran, K., Cimon, K., Hutton, B., McGill, S., Palmer, K., & Scott, R. E. (2010) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2009.090812 · Cited by 300
Smoking and dental implants: A systematic review and meta-analysis
Chrcanovic, B. R., Albrektsson, T., & Wennerberg, A. (2015) · Journal of Dentistry · doi:10.1016/j.jdent.2015.03.003 · Cited by 310
Gademan, M. G. J., Hofstede, S. N., Vliet Vlieland, T. P. M., Nelissen, R. G. H. H., & Marang-van de Mheen, P. J. (2016) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-016-1325-z · Cited by 265
Ribaric, G., Buchwald, J. N., & McGlennon, T. W. (2014) · Obesity Surgery · doi:10.1007/s11695-013-1160-3 · Cited by 264
Home telehealth for diabetes management: a systematic review and meta‐analysis
Polisena, J., Tran, K., Cimon, K., Hutton, B., McGill, S., & Palmer, K. (2009) · Diabetes, Obesity and Metabolism · doi:10.1111/j.1463-1326.2009.01057.x · Cited by 239
Home telemonitoring for congestive heart failure a systematic review and meta-analysis
Polisena, J., Tran, K., Cimon, K., Hutton, B., McGill, S., Palmer, K., & Scott, R. E. (2010) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2009.090406 · Cited by 218
Prado, C. E., Watt, S., & Crowe, S. F. (2018) · Neuropsychology Review · doi:10.1007/s11065-018-9369-5 · Cited by 188
Nutritionist Visits, Diabetes Classes, and Hospitalization Rates and Charges
Robbins, J. M., Thatcher, G. E., Webb, D. A., & Valdmanis, V. G. (2008) · Diabetes Care · doi:10.2337/dc07-1871 · Cited by 183
Manchikanti, L. (2009) · Pain Physician · doi:10.36076/ppj.2009/12/819 · Cited by 168
Pabalan, N., Singian, E., Tabangay, L., Jarjanazi, H., Boivin, M. J., & Ezeamama, A. E. (2018) · PLoS neglected tropical diseases · doi:10.1371/journal.pntd.0005523 · Cited by 176
Jack, H. E., Arabadjis, S. D., Sun, L., Sullivan, E. E., & Phillips, R. S. (2017) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3922-9 · Cited by 156
Ezeamama, A. E., Bustinduy, A. L., Nkwata, A. K., Martinez, L., Pabalan, N., Boivin, M. J., & King, C. H. (2018) · PLoS neglected tropical diseases · doi:10.1371/journal.pntd.0005524 · Cited by 149
“Our approach of including both interventional and non-interventional studies is consistent with theoretical and empirical evidence that meta-analyses based on observational studies generally produce estimates of effect similar to those from meta-analyses based on randomized controlled trials, and that a priori exclusi…”
BackgroundResultPerinetti, G., Primožič, J., Franchi, L., & Contardo, L. (2015) · PLoS ONE · doi:10.1371/journal.pone.0141198 · Cited by 138
Simunovic, N., Sprague, S., & Bhandari, M. (2009) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.h.01576 · Cited by 100
Age-Dependent Effect of β-Blockers in Preventing Vasovagal Syncope
Sheldon, R. S., Morillo, C. A., Klingenheben, T., Krahn, A. D., Sheldon, A., & Rose, M. S. (2012) · Circulation: Arrhythmia and Electrophysiology · doi:10.1161/circep.112.974386 · Cited by 72
Corticosteroids and cognition: a meta-analysis
Prado, C. E., & Crowe, S. F. (2019) · Neuropsychology Review · doi:10.1007/s11065-019-09405-8 · Cited by 58
Patient-focused Internet interventions in reproductive medicine: a scoping review
Aarts, J. W. M., van den Haak, P., Nelen, W. L. D. M., Tuil, W. S., Faber, M. J., & Kremer, J. A. M. (2012) · Human Reproduction Update · doi:10.1093/humupd/dmr045 · Cited by 52
Han, A., Yuen, H. K., Lee, H. Y., & Zhou, X. (2020) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2020.10.004 · Cited by 39
(2008) · Cited by 28
Metadata
- Authors
- Pereira, C., & Castilho, E.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2009-01-06
- Volume
- 169
- Issue
- 6
- Pages
- 783-783
- ISSN
- 0002-9262 (ISSN-L)
- 1476-6256
- OpenAlex
- W2151402586
- Cited by
- 375
- References
- 47
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.