The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
RE: "SHOULD META-ANALYSES OF INTERVENTIONS INCLUDE OBSERVATIONAL STUDIES IN ADDITION TO RANDOMIZED CONTROLLED TRIALS? A CRITICAL EXAMINATION OF UNDERLYING PRINCIPLES"
Abstract
In their recent article, Shrier et al. (l) considered a 95% confidence interval as being one with a 95% probability that a population parameter is included in the interval and a 5% probability that it will lie outside the interval. We wish to clarify some aspects of confidence intervals' interpretation. A simple example illustrates our points. Let us consider a group of 20 patients who receive a new treatment. Only 6 fail to respond to the treatment. Let π be the population proportion of possible patients who would not respond to the treatment. π is the parameter of interest; its true unknown value is the quantity to be estimated. Considering the Bernoulli process, the likelihood is π6(1 − π)14 for 0 < π < 1. We calculate an exact interval with 90% confidence (2) that happens to be nonsymmetric around 6/20: (0.175, 0.505). This may be the smallest (most precise) 90% confidence interval for the observation “6 out of 20.” The correct interpretation of the information that π is in this interval with 90% confidence is as follows: If we could repeat this procedure over a large number of samples of size 20, the true unknown value of π would be contained in 90% of the intervals; hence, we are confident that our particular interval, (0.175, 0.505), contains the true value of π. Note that we never use the term probability, since this interpretation is actually a frequentist one. The evaluation is based on samples that could have been observed but were not. Note also that since π is not a random quantity in the frequentist environment, π belongs (or not) to the interval without any probability attached to the statement. This is the reason to speak about confidence, not probability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Hapeman, D. E. (1991) · Technometrics · doi:10.1080/00401706.1991.10484817 · Cited by 9,373
CAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C. (2001) · The Philosophical Review · doi:10.1215/00318108-110-4-639 · Cited by 4,741
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563
Clinical Epidemiology: A Basic Science for Clinical Medicine.
(1991) · Annals of Internal Medicine · doi:10.7326/0003-4819-114-9-825_9 · Cited by 3,476
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“In choosing to include observational studies, we must remain cautious not to overinterpret the data because there may be a greater risk of publication bias ( 43 ), and any between-study heterogeneity needs to be appropriately explored.”
BackgroundAir Pollution and Hospital Admissions for Heart Disease in Eight U.S. Counties
Schwartz, J. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00005 · Cited by 3,038
Evaluating non-randomised intervention studies
Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D. (2003) · Health Technology Assessment · doi:10.3310/hta7270 · Cited by 2,907
A structural approach to selection bias
Hernán, M. A., Hernández-Díaz, S., & Robins, J. M. (2004) · Epidemiology · doi:10.1097/01.ede.0000135174.63482.43 · Cited by 2,844 · cited 1×
“... yield an unconfounded estimate by adjusting for the correct mix of potential confounders at the design stage by matching or restriction, or at the analysis stage with a multiple regression analysis, propensity scores, and so forth (14, 15) (as long as the underlying statistical assumptions are valid; e.g., is tran…”
BackgroundSystematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,312
Measurement of health state utilities for economic appraisal
Torrance, G. W. (1986) · Journal of Health Economics · doi:10.1016/0167-6296(86)90020-2 · Cited by 2,203
Systematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
Is the Placebo Powerless?: An Analysis of Clinical Trials Comparing Placebo with No Treatment
Hróbjartsson, A., & Gøtzsche, P. C. (2001) · New England Journal of Medicine · doi:10.1056/nejm200105243442106 · Cited by 1,503
Contradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465
Hernan, M. A. (2002) · American Journal of Epidemiology · doi:10.1093/aje/155.2.176 · Cited by 1,445
(2016) · Biostatistics in Public Health Using STATA · doi:10.1201/b19547-8 · Cited by 1,037
Comparison of Evidence of Treatment Effects in Randomized and Nonrandomized Studies
Ioannidis, J. P. A. (2001) · JAMA · doi:10.1001/jama.286.7.821 · Cited by 919
Randomized versus historical controls for clinical trials
Sacks, H., Chalmers, T. C., & Smith, H. (1982) · The American Journal of Medicine · doi:10.1016/0002-9343(82)90815-4 · Cited by 834
Kunz, R., & Oxman, A. D. (1998) · BMJ · doi:10.1136/bmj.317.7167.1185 · Cited by 770 · cited 1×
“Although the results of meta-analyses based on observational studies are often similar to those based on RCTs, some authors argue against the inclusion of observational studies because the researcher needs to know the estimate of the effect for a particular topic and not whether the observational studies agree with RC…”
MethodA note on graphical presentation of estimated odds ratios from several clinical trials
Galbraith, R. F. (1988) · Statistics in Medicine · doi:10.1002/sim.4780070807 · Cited by 663
The double-blind, randomized, placebo-controlled trial
Kaptchuk, T. J. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00347-4 · Cited by 595
The Impact of Stretching on Sports Injury Risk: A Systematic Review of the Literature
THACKER, S. B., GILCHRIST, J., STROUP, D. F., & KIMSEY, C. D. (2004) · Medicine & Science in Sports & Exercise · doi:10.1249/01.mss.0000117134.83018.f7 · Cited by 542
Shrier, I., Boivin, J.-F., Steele, R. J., Platt, R. W., Furlan, A., Kakuma, R., Brophy, J., & Rossignol, M. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwm189 · Cited by 493
Balk, E. M. (2002) · JAMA · doi:10.1001/jama.287.22.2973 · Cited by 478
A definition of causal effect for epidemiological research
Hernán, M. A. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2002.006361 · Cited by 462
Herbert, R. D., & Gabriel, M. (2002) · BMJ · doi:10.1136/bmj.325.7362.468 · Cited by 404
Confounding in Health Research
Greenland, S., & Morgenstern, H. (2001) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.22.1.189 · Cited by 388
A randomized trial of preexercise stretching for prevention of lower-limb injury
POPE, R. P., HERBERT, R. D., KIRWAN, J. D., & GRAHAM, B. J. (2000) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-200002000-00004 · Cited by 386
Greenland, S. (2001) · Biostatistics · doi:10.1093/biostatistics/2.4.463 · Cited by 359 · cited 2×
“Am J Epidemiol 2007;166:1203–1209 most promising statistical technique to date may be response-surface estimation because it can accommodate factors that lead to bias from any cause (including study design) ( 47 , 48).”
Background‘Powerful Placebo: The Dark Side of the Randomised Controlled Trial’
Kaptchuk, T. J. (1998) · The Lancet · doi:10.1016/s0140-6736(97)10111-8 · Cited by 339
Statistics: A Bayesian Perspective
Berry, D. A. (1995) · Medical Entomology and Zoology · Cited by 332
MacLehose, Reeves, Harvey, Sheldon, Russell, & Black (2000) · Health Technology Assessment · doi:10.3310/hta4340 · Cited by 311
The need for randomization in the study of intended effects
Miettinen, O. S. (1983) · Statistics in Medicine · doi:10.1002/sim.4780020222 · Cited by 277
Shrier, I. (1999) · Clinical Journal of Sport Medicine · doi:10.1097/00042752-199910000-00007 · Cited by 211
Why and how Sources of Heterogeneity Should be Investigated
Thompson, S. G. (2001) · Wiley eBooks · doi:10.1002/9780470693926.ch9 · Cited by 114
Statistical Issues Arising in the Women's Health Initiative
Prentice, R. L., Pettinger, M. B., & Anderson, G. L. (2005) · Biometrics · doi:10.1111/j.0006-341x.2005.454_1.x · Cited by 103
Bergmann, J., Chassany, O., Gandiol, J., Deblois, P., Ja, K., Jm, S., Caulin, C., & Dahan, R. (1994) · PubMed · Cited by 100
Randomized trials versus observational studies in adolescent pregnancy prevention
Guyatt, G. H. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00160-2 · Cited by 94
Do double-blind studies with informed consent yield externally valid results?
Kirsch, I., & Rosadino, M. J. (1993) · Psychopharmacology · doi:10.1007/bf02244650 · Cited by 82
Hughes, J. R., Gulliver, S. B., Amori, G., Mireanlt, G. C., & Fenwick, J. W. (1989) · Psychopharmacology · doi:10.1007/bf00589896 · Cited by 66
The Effects of a Smoking Cessation Intervention on 14.5-Year Mortality
Anthonisen, N. R. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-143-8-200510180-00019 · Cited by 57
Dahan, R., Caulin, C., Figea, L., Kanis, J. A., Caulin, F., & Segrestaa, J. M. (1986) · BMJ · doi:10.1136/bmj.293.6543.363 · Cited by 55
Dictionary of Pharmacoepidemiology
Bégaud, B. (2000) · Wiley eBooks · doi:10.1002/0470842547 · Cited by 49
Observational Studies and Randomized Trials
Kunz, R., Khan, K. S., & Neumayer, H. (2000) · New England Journal of Medicine · doi:10.1056/nejm200010193431613 · Cited by 43
The Cochrane Collaboration in the 21st Century: Ten Challenges and One Reason Why They Must Be Met
Oxman, A. D. (2001) · Wiley eBooks · doi:10.1002/9780470693926.ch26 · Cited by 18
Cochrane Reviews: new blocks on the kids
Shrier, I. (2003) · British Journal of Sports Medicine · doi:10.1136/bjsm.37.6.473 · Cited by 15
Meta-Analysis and Response Surface Extrapolation: A Least Squares Approach
Vanhonacker, W. R. (1996) · The American Statistician · doi:10.1080/00031305.1996.10473555 · Cited by 13
Cited by
Tufanaru, C., Munn, Z., Stephenson, M., & Aromataris, E. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000065 · Cited by 1,057
Diffusion Theory and Knowledge Dissemination, Utilization, and Integration in Public Health
Green, L. W., Ottoson, J. M., García, C., & Hiatt, R. A. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100049 · Cited by 953
Ganesan, A. N., Shipp, N. J., Brooks, A. G., Kuklik, P., Lau, D. H., Lim, H. S., Sullivan, T., Roberts‐Thomson, K. C., & Sanders, P. (2013) · Journal of the American Heart Association · doi:10.1161/jaha.112.004549 · Cited by 800
“In recent years, however, meta-analysis has become accepted in the literature to aggregate results from observational data, to facilitate synthesis of available evidence and generation of new hypotheses.(37,38) In the case of AF ablation, the procedure is relatively new, with significant ongoing innovation in technolo…”
Making research relevant: if it is an evidence-based practice, where's the practice-based evidence?
Green, L. W. (2008) · Family Practice · doi:10.1093/fampra/cmn055 · Cited by 628
Pickup, J. C., & Sutton, A. J. (2008) · Diabetic Medicine · doi:10.1111/j.1464-5491.2008.02486.x · Cited by 617
Metadata
- Authors
- Pereira, C., & Castilho, E.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2009-01-06
- Volume
- 169
- Issue
- 6
- Pages
- 783-783
- ISSN
- 0002-9262 (ISSN-L)
- 1476-6256
- OpenAlex
- W2151402586
- Cited by
- 375
- References
- 47
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.