Cited by 534Meta-analysis and systematic reviewsAdvanced Causal Inference TechniquesStatistical Methods in Epidemiology

The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.

Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials

Open access

Anglemyer, Andrew, Horvath, Hacsi T, Bero, Lisa·2014·Cochrane Database of Systematic Reviews

DOI 10.1002/14651858.mr000034.pub2PMC PMC8191367

Open this paper in CoChat — free account

Abstract

BACKGROUND: Researchers and organizations often use evidence from randomized controlled trials (RCTs) to determine the efficacy of a treatment or intervention under ideal conditions. Studies of observational designs are often used to measure the effectiveness of an intervention in 'real world' scenarios. Numerous study designs and modifications of existing designs, including both randomized and observational, are used for comparative effectiveness research in an attempt to give an unbiased estimate of whether one treatment is more effective or safer than another for a particular population.A systematic analysis of study design features, risk of bias, parameter interpretation, and effect size for all types of randomized and non-experimental observational studies is needed to identify specific differences in design types and potential biases. This review summarizes the results of methodological reviews that compare the outcomes of observational studies with randomized trials addressing the same question, as well as methodological reviews that compare the outcomes of different types of observational studies. OBJECTIVES: To assess the impact of study design (including RCTs versus observational study designs) on the effect measures estimated.To explore methodological variables that might explain any differences identified.To identify gaps in the existing research comparing study designs. SEARCH METHODS: We searched seven electronic databases, from January 1990 to December 2013.Along with MeSH terms and relevant keywords, we used the sensitivity-specificity balanced version of a validated strategy to identify reviews in PubMed, augmented with one term ("review" in article titles) so that it better targeted narrative reviews. No language restrictions were applied. SELECTION CRITERIA: We examined systematic reviews that were designed as methodological reviews to compare quantitative effect size estimates measuring efficacy or effectiveness of interventions tested in trials with those tested in observational studies. Comparisons included RCTs versus observational studies (including retrospective cohorts, prospective cohorts, case-control designs, and cross-sectional designs). Reviews were not eligible if they compared randomized trials with other studies that had used some form of concurrent allocation. DATA COLLECTION AND ANALYSIS: In general, outcome measures included relative risks or rate ratios (RR), odds ratios (OR), hazard ratios (HR). Using results from observational studies as the reference group, we examined the published estimates to see whether there was a relative larger or smaller effect in the ratio of odds ratios (ROR).Within each identified review, if an estimate comparing results from observational studies with RCTs was not provided, we pooled the estimates for observational studies and RCTs. Then, we estimated the ratio of ratios (risk ratio or odds ratio) for each identified review using observational studies as the reference category. Across all reviews, we synthesized these ratios to get a pooled ROR comparing results from RCTs with results from observational studies. MAIN RESULTS: Our initial search yielded 4406 unique references. Fifteen reviews met our inclusion criteria; 14 of which were included in the quantitative analysis.The included reviews analyzed data from 1583 meta-analyses that covered 228 different medical conditions. The mean number of included studies per paper was 178 (range 19 to 530).Eleven (73%) reviews had low risk of bias for explicit criteria for study selection, nine (60%) were low risk of bias for investigators' agreement for study selection, five (33%) included a complete sample of studies, seven (47%) assessed the risk of bias of their included studies,Seven (47%) reviews controlled for methodological differences between studies,Eight (53%) reviews controlled for heterogeneity among studies, nine (60%) analyzed similar outcome measures, and four (27%) were judged to be at low risk of reporting bias.Our primary quantitative analysis, including 14 reviews, showed that the pooled ROR comparing effects from RCTs with effects from observational studies was 1.08 (95% confidence interval (CI) 0.96 to 1.22). Of 14 reviews included in this analysis, 11 (79%) found no significant difference between observational studies and RCTs. One review suggested observational studies had larger effects of interest, and two reviews suggested observational studies had smaller effects of interest.Similar to the effect across all included reviews, effects from reviews comparing RCTs with cohort studies had a pooled ROR of 1.04 (95% CI 0.89 to 1.21), with substantial heterogeneity (I(2) = 68%). Three reviews compared effects of RCTs and case-control designs (pooled ROR: 1.11 (95% CI 0.91 to 1.35)).No significant difference in point estimates across heterogeneity, pharmacological intervention, or propensity score adjustment subgroups were noted. No reviews had compared RCTs with observational s

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1002/14651858.mr000034.pub2

Cites

74 of 74 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cochrane Handbook for Systematic Reviews of Interventions
Tarsilla, M. (2010) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v6i14.284 · Cited by 5,232
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563
Interaction revisited: the difference between two estimates.
Altman, D. G., & Bland, J. M. (2003) · BMJ · doi:10.1136/bmj.326.7382.219 · Cited by 3,203
Evaluating non-randomised intervention studies
Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D. (2003) · Health Technology Assessment · doi:10.3310/hta7270 · Cited by 2,907
A comparison of observational studies and randomized, controlled trials.
Benson, K., & Hartz, A. J. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422506 · Cited by 2,347
The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis.
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
Industry sponsorship and research outcome
Lundh, A., Lexchin, J., Mintzes, B., Schroll, J. B., & Bero, L. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000033.pub3 · Cited by 1,697
Self-citation
Contradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465
Primary total hip replacement surgery: a systematic review of outcomes and modelling of cost-effectiveness associated with different prostheses.
Fitzpatrick, R. M., Shortall, Sculpher, Murray, Morris, Lodge, Dawson, Carr, Britton, & Briggs, A. H. (1998) · Health Technology Assessment · doi:10.3310/hta2200 · Cited by 969
Comparison of Evidence of Treatment Effects in Randomized and Nonrandomized Studies
Ioannidis, J. P. A. (2001) · JAMA · doi:10.1001/jama.286.7.821 · Cited by 919

Show all 74 references

Research works printed but not linked: 2

Deeks JJ D'Amico R Sakarovitch C Are comparability of case-mix and the use of statistical adjustment markers of quality in non-randomised studies? An empirical investigation 4th Symposium on Systematic Reviews: Pushing the Boundaries Oxford, UK 2002
Shepherd J Bagnall A Colquitt J 'Sometimes similar, sometimes different': a systematic review of meta-analyses of randomised and non-randomised policy intervention studies 14th Cochrane Colloquium, Dublin, Ireland

Sorted by citations

Items 301–400 of 532

Implantable Cardioverter-Defibrillator in Dilated Cardiomyopathy after the DANISH-Trial Lesson. A Poly-Parametric Risk Evaluation Is Needed to Improve the Selection of Patients
Disertori, M., Masè, M., Rigoni, M., Nollo, G., Arbustini, E., & Ravelli, F. (2017) · Frontiers in Physiology · doi:10.3389/fphys.2017.00873 · Cited by 9
COVID-19, equipoise and observational studies: a reminder of forgotten issues
Yusuf, E., & Maiwald, M. (2020) · Infection · doi:10.1007/s15010-020-01466-9 · Cited by 9
Role of real-world digital data for orthopedic implant automated surveillance: a systematic review
Dhalluin, T., Fakhiri, S., Bouzillé, G., Herbert, J., Rosset, P., Marc Cuggia, A., & Grammatico‐Guillon, L. (2021) · Expert Review of Medical Devices · doi:10.1080/17434440.2021.1943361 · Cited by 9
Real-World Effectiveness of Adjuvant Oxaliplatin Chemotherapy in Stage III Colon Cancer: A Controlled Interrupted Time Series Analysis
Huang, W., Hsu, H., Chang, S., Chou, W., Chang, P., Chiang, S.-F., Chang, J. W., Chen, J., Yang, T., & See, L. (2021) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.693009 · Cited by 10
What Does Quality of Care Mean in Lower-Grade Glioma Patients: A Precision Molecular-Based Management of the Tumor or an Individualized Medicine Centered on Patient’s Choices?
Taillandier, L., Obara, T., & Duffau, H. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2021.719014 · Cited by 10
Immediate radiotherapy versus observation in patients with node-positive prostate cancer after radical prostatectomy
Schaufler, C., Kaul, S., Fleishman, A., Korets, R., Chang, P., Wagner, A. A., Kim, S., Joaquim Bellmunt, B., Kaplan, I., Olumi, A. F., et al. (2022) · Prostate Cancer and Prostatic Diseases · doi:10.1038/s41391-022-00619-1 · Cited by 9
Comparison of evidence of treatment effects in randomized and nonrandomized studies on allergen immunotherapy
Bona, D. D., Carlucci, P., Spataro, F., Paoletti, G., Heffler, E. M., Pulkanen, J., Macchia, L., Giacco, S. D., Agache, I. O., Jutel, M., et al. (2023) · Clinical & Experimental Allergy · doi:10.1111/cea.14311 · Cited by 9
Comparing Effectiveness with Efficacy: Outcomes of Palliative Chemotherapy for Non-Small-Cell Lung Cancer in Routine Practice
Harrison, L. D., Zhang‐Salomons, J., Mates, M., Booth, C. M., King, W. D., & Mackillop, W. J. (2015) · Current Oncology · doi:10.3747/co.22.2419 · Cited by 9
Using Observational Data to Inform HIV Policy Change for Children and Youth
Sohn, A. H., Judd, A., MOFENSON, L. M., Vicari, M., Jerene, D., Leroy, V., Bekker, L., & Davies, M. (2018) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000001745 · Cited by 9
The Predicament of Comparative Effectiveness Research Using Observational Data
Curtis, J. P., & Krumholz, H. M. (2015) · Annals of Internal Medicine · doi:10.7326/m15-2490 · Cited by 9
Endometrial preparation protocols for frozen embryo transfer: risk assessment and individualized management
Polyzos, N. P. (2025) · Human Reproduction · doi:10.1093/humrep/deaf149 · Cited by 8
Methods for the Inclusion of Real-World Evidence in a Rare Events Meta-Analysis of Randomized Controlled Trials
Yao, M., Wang, Y., Mei, F., Zou, K., Li, L., & Sun, X. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12041690 · Cited by 8
Identification of potential new COVID-19 treatments via RWD-driven drug repurposing
Liao, Y. (2023) · Scientific Reports · doi:10.1038/s41598-023-40033-8 · Cited by 7
Rapid review: A review of methods and recommendations based on current evidence
Guo, Q., Jiang, G., Zhao, Q., Long, Y., Feng, K., Gu, X., Xu, Y., Li, Z., Huang, J., & Du, L. (2024) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12594 · Cited by 8
While modern medicine evolves continuously, evidence-based research methodology remains: how register studies should be interpreted and appreciated
Svantesson, E., Senorski, E. H., Spindler, K. P., Ayeni, O. R., Fu, F. H., Karlsson, J., & Samuelsson, K. (2017) · Knee Surgery Sports Traumatology Arthroscopy · doi:10.1007/s00167-017-4582-y · Cited by 8
Organ preservation and oncological outcomes in early laryngeal cancer: a propensity score-based study
de Carvalho, G. B., Köhler, H. F., de Mello, J. B. H., Lira, R. B., Pellizzon, A. C. A., Vartanian, J. G., & Kowalski, L. P. (2021) · Acta Otorhinolaryngologica Italica · doi:10.14639/0392-100x-n0870 · Cited by 8
Antihypertensive effects of yoga in a general patient population: real-world evidence from electronic health records, a retrospective case-control study
Penrod, N. M., & Moore, J. H. (2022) · BMC Public Health · doi:10.1186/s12889-022-12569-3 · Cited by 10
There is (probably) no (meaningful) difference in (most) outcomes between ‘spinal' and ‘general' anaesthesia for hip fracture surgery: time to move forward
White, S., Tedore, T. R., & Shelton, C. (2023) · British Journal of Anaesthesia · doi:10.1016/j.bja.2023.01.013 · Cited by 9
Endoscopy Unit Level Interventions to Improve Adenoma Detection Rate: A Systematic Review and Meta-Analysis
Arora, A., McDonald, C. L., Guizzetti, L., Iansavitchene, A., Brahmania, M., Khanna, N., Wilson, A. S., Jairath, V., & Sey, M. S. L. (2023) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2023.03.049 · Cited by 9
Unknown confounders did not bias the treatment effect when improving balance of known confounders in randomized trials
Kuß, O., & Miller, M. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.06.012 · Cited by 8
How Can We Make More Rapid Progress in the Leveraging of Real-World Evidence by Regulatory Decision Makers?
Berger, M. L., & Crown, W. H. (2021) · Value in Health · doi:10.1016/j.jval.2021.09.002 · Cited by 8
Apophenia and anesthesia: how we sometimes change our practice prematurely
Hanson, N. A., Lavallee, M. B., & Thiele, R. H. (2021) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-021-02005-2 · Cited by 8
Calibrating a network meta-analysis of diabetes trials of sodium glucose cotransporter 2 inhibitors, glucagon-like peptide-1 receptor analogues and dipeptidyl peptidase-4 inhibitors to a representative routine population: a systematic review protocol
Butterly, E. W., Wei, L. S., Adler, A., Almazam, S. A., Alsallumi, K., Blackbourn, L. A. K., Dias, S., Hanlon, P., Hughes, K., Lewsey, J., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-066491 · Cited by 7
Clinical Outcomes of Laparoscopic Versus Laparotomic Distal Gastrectomy in Gastric Cancer Patients: A Multilevel Analysis Based on a Nationwide Administrative Database in Japan
Shibao, K., Fujino, Y., Joden, F., Tajima, T., Nagata, J., Sato, N., Fujimoto, K., Shin'ya, M., & Hirata, K. (2020) · World Journal of Surgery · doi:10.1007/s00268-020-05709-6 · Cited by 7
Comparison of All-Cause Mortality Following VTE Treatment Between Propensity Score-Adjusted Observational Studies and Matched Randomized Controlled Trials
Coscia, C., Oriol, A. J., Quezada, C. A., Muriel, A., Monréal, M., Villén, T., Barbero, E., Chiluiza, D., Yusen, R. D., & Jiménez, D. (2018) · CHEST Journal · doi:10.1016/j.chest.2018.10.016 · Cited by 7
Dysthymia increases the risk of temporomandibular disorder
Lin, S.-L., Wu, S.-L., Ko, S., Lu, C.-H., Wang, D.-W., Ben, R.-J., Horng, C., & Yang, J. (2016) · Medicine · doi:10.1097/md.0000000000004271 · Cited by 7
Early adoption of critical care interventions is unjustifiable without concomitant effectiveness study
Gershengorn, H. B. (2020) · Critical Care · doi:10.1186/s13054-020-03382-8 · Cited by 8
Cost-effectiveness of lumbar fenestration surgery in the Japanese universal health insurance system
Fujimori, T., Miwa, T., Iwasaki, M., & Oda, T. (2018) · Journal of Orthopaedic Science · doi:10.1016/j.jos.2018.06.020 · Cited by 6
Observational studies of traditional Chinese medicine may provide evidence nearly consistent with the randomized controlled trials: A meta-epidemiological study
Song, H., Li, N., Yang, W., Wu, M., Liao, X., & Zhang, Y. (2022) · Integrative Medicine Research · doi:10.1016/j.imr.2022.100889 · Cited by 6
The Relative Merits of Observational and Experimental Research: Four Key Principles for Optimising Observational Research Designs
Hamlin, R. (2022) · Nutrients · doi:10.3390/nu14214649 · Cited by 6
Measuring and interpreting pervasive heterogeneity, poikilosis
Vihinen, M. (2021) · FASEB BioAdvances · doi:10.1096/fba.2021-00015 · Cited by 5
Evaluating the heterogeneous effect of a modifiable risk factor on suicide: The case of vitamin D deficiency
Zubizarreta, J. R., Umhau, J. C., Deuster, P. A., Brenner, L. A., King, A. J., Petukhova, M. V., Sampson, N. A., Tizenberg, B., Upadhyaya, S. K., RachBeisel, J. A., et al. (2021) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1897 · Cited by 5
Healthy Dietary Patterns on Clinical Periodontal Parameters: A GRADE Compliant Systematic Review and Meta-analysis
Sáenz‐Ravello, G., Matamala, L., dos Santos, N. C. C., Cisternas, P., Gamonal, J. A., Fernández, A., V, Bello-Escamilla, N., Hernández, M., & Baeza, M. (2022) · Current Oral Health Reports · doi:10.1007/s40496-022-00307-y · Cited by 7
Electronic Health Record–Triggered Research Infrastructure Combining Real-world Electronic Health Record Data and Patient-Reported Outcomes to Detect Benefits, Risks, and Impact of Medication: Development Study
Hek, K., Rolfes, L., van Puijenbroek, E., Flinterman, L. E., Vorstenbosch, S., van Dijk, L., & Verheij, R. A. (2022) · JMIR Medical Informatics · doi:10.2196/33250 · Cited by 6
An Empirical Evaluation of the Impact Scenario of Pooling Bodies of Evidence from Randomized Controlled Trials and Cohort Studies in Nutrition Research
Schwingshackl, L., Bröckelmann, N., Beyerbach, J., Werner, S. S., Zähringer, J., Schwarzer, G., & Meerpohl, J. J. (2022) · Advances in Nutrition · doi:10.1093/advances/nmac042 · Cited by 6
COVID-19 in Africa: What else?
Sokhna, C., Brah, S., DJIMDÉ, A. A., Mouffok, N., Zahraoui, M., Boukhary, A. O. M. S., Bitam, I., Cissé, B., Thera, M. A., Lékana-Douki, J. B., et al. (2022) · New Microbes and New Infections · doi:10.1016/j.nmni.2022.100982 · Cited by 6
Identifying and handling unbalanced baseline characteristics in a non-randomized, controlled, multicenter social care nurse intervention study for patients in advanced stages of cancer
Frick, J., Gebert, P., Grittner, U., Letsch, A., Schindel, D., & Schenk, L. (2022) · BMC Cancer · doi:10.1186/s12885-022-09646-6 · Cited by 6
Introductory Chapter: The Contribution of Cohort Studies to Health Sciences
Barría, R. M. (2018) · InTech eBooks · doi:10.5772/intechopen.80178 · Cited by 6
Anaesthetic management and unplanned admission to intensive care after thoracic surgery
Licker, M. J. (2019) · Anaesthesia · doi:10.1111/anae.14741 · Cited by 6
PROTOCOL: The effects of road infrastructure, and transport and logistics services interventions on women's participation in informal and formal labour markets in low‐ and middle‐income countries: a systematic review
Gupta, M., Bandyopadhyay, S. K., Mahapatro, M., & Jha, S. (2018) · Campbell Systematic Reviews · doi:10.1002/cl2.200 · Cited by 6
Evidence synthesis and decision modelling to support complex decisions: stockpiling neuraminidase inhibitors for pandemic influenza usage
Watson, S., Chen, Y., Nguyen‐Van‐Tam, J. S., Myles, P. R., Venkatesan, S., Zambon, M. C. F. A., Uthman, O. A., Chilton, P. J., & Lilford, R. J. (2017) · F1000Research · doi:10.12688/f1000research.9414.2 · Cited by 6
Evidence synthesis and decision modelling to support complex decisions: stockpiling neuraminidase inhibitors for pandemic influenza usage
Watson, S., Chen, Y., Nguyen‐Van‐Tam, J. S., Myles, P. R., Venkatesan, S., Zambon, M. C. F. A., Uthman, O. A., Chilton, P. J., & Lilford, R. J. (2016) · F1000Research · doi:10.12688/f1000research.9414.1 · Cited by 6
International Variation in Intubation and Extubation Practices and Adverse Events Among Critically Ill Patients Receiving Mechanical Ventilation
Gershengorn, H. B. (2021) · JAMA · doi:10.1001/jama.2021.1178 · Cited by 6
Invited Commentary: New Directions in Machine Learning Analyses of Administrative Data to Prevent Suicide-Related Behaviors
Bossarte, R. M., Kennedy, C. J., Luedtke, A. R., Nock, M. K., Smoller, J. W., Stokes, C. M., & Kessler, R. C. (2021) · American Journal of Epidemiology · doi:10.1093/aje/kwab111 · Cited by 7
Treatment outcome of oropharyngeal squamous cell carcinoma through propensity score analysis
Lau, F., Lisatchok, M., Tamanini, J. B., Gazmenga, F. P., Teixeira, D. N. A., Couto, E. V., & Chone, C. T. (2023) · Brazilian Journal of Otorhinolaryngology · doi:10.1016/j.bjorl.2023.101335 · Cited by 5
Problematic meta-analyses: Bayesian and frequentist perspectives on combining randomized controlled trials and non-randomized studies
Moran, J. L., & Linden, A. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02215-4 · Cited by 5
Vision protection therapy for prevention of neovascular age-related macular degeneration
Luttrull, J. K., Gray, G. W., & Bhavan, S. V. (2023) · Scientific Reports · doi:10.1038/s41598-023-43605-w · Cited by 4
IR (index of reactivity)-house dust mite sublingual immunotherapy liquid formulation for allergic rhinoconjunctivitis: Systematic review and meta-analysis of randomized and nonrandomized studies
Bona, D. D., Carlucci, P., Spataro, F., Paoletti, G., Cognet-Sicé, J., Scurati, S., & Canonica, G. W. (2024) · Journal of Allergy and Clinical Immunology Global · doi:10.1016/j.jacig.2024.100208 · Cited by 5
UK Electronic Healthcare Records for Research: A Scientometric Analysis of Respiratory, Cardiovascular, and COVID-19 Publications
Massen, G. M., Blamires, O., Grainger, M., Matta, M., Twumasi, R., Joshi, T., Laity, A., Nakariakova, E., Thavaranjan, T., Sheikh, A., et al. (2024) · Pragmatic and Observational Research · doi:10.2147/por.s469973 · Cited by 5
Integrating randomized controlled trials and non-randomized studies of interventions to assess the effect of rare events: a Bayesian re-analysis of two meta-analyses
Zhou, Y., Yao, M., Mei, F., Ma, Y., Huan, J., Zou, K., Li, L., & Sun, X. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02347-7 · Cited by 5
Modified-Power-Piston: Short-Incudial-Process-Vibroplasty and Simultaneous Stapedotomy in Otosclerosis
Dejaco, D., Riedl, D., Gottfried, T. M., Rasse, T., Fischer, N., Prejban, D., Koci, V., Riechelmann, H., Schmutzhard, J., & Keintzel, T. G. (2019) · Otology & Neurotology · doi:10.1097/mao.0000000000002146 · Cited by 5
Child-therapist interaction features impact Autism treatment response trajectories
Bertamini, G., Perzolli, S., Bentenuto, A., Paolizzi, E., Furlanello, C., & Venuti, P. (2023) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2023.104452 · Cited by 5
Dimethyl Fumarate or Teriflunomide for Relapsing–Remitting Multiple Sclerosis: A Meta-analysis of Post-marketing Studies
Prosperini, L., Haggiag, S., Ruggieri, S., Tortorella, C., & Gasperini, C. (2023) · Neurotherapeutics · doi:10.1007/s13311-023-01416-x · Cited by 5
Wheel Replacing Pyramid: Better Paradigm Representing Totality of Evidence-Based Medicine
Aldous, C. M., Dancis, B. M., Dancis, J., & Oldfield, P. R. (2024) · Annals of Global Health · doi:10.5334/aogh.4341 · Cited by 6
Pre-delivery remifentanil infusion for placenta accreta cesarean delivery under general anesthesia: an observational study
Shaylor, R., Ginosar, Y., Avidan, A., Eventov‐Friedman, S., Amison, N., & Weiniger, C. F. (2015) · The Journal of Maternal-Fetal & Neonatal Medicine · doi:10.3109/14767058.2015.1104297 · Cited by 5
Reproducing a Prospective Clinical Study as a Computational Retrospective Study in MIMIC-II.
Kury, F. S. P., Huser, V., & Cimino, J. J. (2015) · PubMed Central · Cited by 5
Descriptive analysis of cochrane child-relevant systematic reviews: an update and comparison between 2009 and 2013
Crick, K., Thomson, D., Fernandes, R. M., Nuspl, M., Eurich, D. T., Rowe, B. H., & Hartling, L. (2017) · BMC Pediatrics · doi:10.1186/s12887-017-0908-7 · Cited by 5
The prevalence of and factors related to alcohol consumption among young people in Thailand: a systematic review of observational studies
Luecha, T., Peremans, L., Dilles, T., Poontawee, P., & Rompaey, B. V. (2020) · Drugs Education Prevention and Policy · doi:10.1080/09687637.2020.1729701 · Cited by 5
Randomized controlled trials: still the backbone of vascular surgery?
Naylor, A. R. (2015) · Gefässchirurgie · doi:10.1007/s00772-015-0100-z · Cited by 5
Discontinuation of non-anti-TNF drugs for rheumatoid arthritis in interventional versus observational studies: a systematic review and meta-analysis
Tonin, F. S., Steimbach, L. M., Leonart, L. P., Ferreira, V. L., Borba, H. H. L., Piazza, T., Araujo, A., Fernández-Llimós, F., Pontarolo, R., & Wiens, A. (2018) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-018-2524-3 · Cited by 5
Is research from databases reliable? Not sure
Varkila, M. R. J., & Cremer, O. L. (2018) · Intensive Care Medicine · doi:10.1007/s00134-018-5498-9 · Cited by 5
Indispensable but deceptive evidence-based medicine
Funck‐Brentano, C. (2020) · Diabetes & Metabolism · doi:10.1016/j.diabet.2020.09.006 · Cited by 5
Experiences of Using Cochrane Systematic Reviews by Local HTA Units
Poder, T. G., Rhainds, M., Bellemare, C. A., Deblois, S., Hammana, I., Safianyk, C., St‐Jacques, S., & Dagenais, P. (2020) · International Journal of Health Policy and Management · doi:10.34172/ijhpm.2020.133 · Cited by 4
Old dog with new tricks: An introduction to real-world evidence for pharmacists
Rahmatian, D., & Tadrous, M. (2021) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/zxab261 · Cited by 4
Comparison between neonatal outcomes of labor and delivery with labor neuraxial analgesia and without analgesia: A propensity score‐matched study
Watanabe, K., Sakamaki, D., Shiko, Y., Kawasaki, Y., Noguchi, S., & Mazda, Y. (2023) · Journal of obstetrics and gynaecology research · doi:10.1111/jog.15571 · Cited by 4
Schmerzregister und verwandte Datensammlungen
Freytag, A., Scriba, B., Kaiser, U., & Meißner, W. (2016) · Der Schmerz · doi:10.1007/s00482-016-0118-5 · Cited by 4
Question 2: In children with Marfan’s should we beta block from point of diagnosis?
Tennyson, M. (2018) · Archives of Disease in Childhood · doi:10.1136/archdischild-2018-315848 · Cited by 4
Routinely collected data for population-based outcomes research
Welk, B. K. (2019) · Canadian Urological Association Journal · doi:10.5489/cuaj.6158 · Cited by 4
Randomised controlled trials reflected clinical practice when comparing the course of low back pain symptoms in similar populations.
Maas, E., van Dongen, J. V., Juch, J. N. S., Groeneweg, J., Kallewaard, J., de Boer, M. D., Koes, B., Verhagen, A., Huygen, F., van Tulder, M. V., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.09.006 · Cited by 6
Predictive factors of clinical assays on hydroxychloroquine for COVID-19 mortality during the first year of the pandemic: A meta-synthesis
Million, M., Dudouet, P., Chabrière, É., Cortaredona, S., Roussel, Y., Brouqui, P., & Raoult, D. (2022) · African Journal of Clinical and Experimental Microbiology · doi:10.4314/ajcem.v23i1.1 · Cited by 4
Virtual Trials: Causally-validated treatment effects efficiently learned from an observational cancer registry
Wasserman, A., Musella, A., Shapiro, M. A., & Shrager, J. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2022.102450 · Cited by 4
Is Real-World Evidence Used in P&T Monographs and Therapeutic Class Reviews?
Hurwitz, J. T., Brown, M., Graff, J. S., Peters, L., & Malone, D. C. (2020) · Journal of Managed Care & Specialty Pharmacy · doi:10.18553/jmcp.2020.26.12.1604 · Cited by 4
Randomized Trials and Observational Studies: The Current Philosophical Controversy
Howick, J., & Mebius, A. (2015) · Springer eBooks · doi:10.1007/978-94-017-8706-2_45-1 · Cited by 4
Early Treatment with Hydroxychloroquine and Azithromycin: A ‘Real-World’ Monocentric Retrospective Cohort Study of 30,423 COVID-19 PatientsPreprint
Million, M., Cortaredona, S., Delorme, L., Colson, P., Levasseur, A., Tissot‐Dupont, H., Cassir, N., Bendamardji, K., Lahouel, S., Scola, B. L., et al. (2023) · medRxiv · doi:10.1101/2023.04.03.23287649 · Cited by 4
The Effects of Hospital Volume on Short-Term Outcomes of Laparoscopic Surgery for Rectal Cancer: A Large-Scale Analysis of 37,821 Cases on a Nationwide Administrative Database
Oba, T., Tomioka, S., Sato, N., Otani, M., Sakurai, A., Akiyama, Y., Nagata, J., Torigoe, T., Matsuda, S., & Hirata, K. (2023) · Digestive Surgery · doi:10.1159/000529752 · Cited by 3
Opioid use and adverse health effects in breast cancer survivors
Haque, R., Chen, L. H., Shi, J. M., Gu, Z., Brady-Rogers, M., Chlebowski, R. T., & Hechter, R. C. (2024) · The Oncologist · doi:10.1093/oncolo/oyae270 · Cited by 3
Moxibustion Treatment, Alongside Conventional Western and Chinese Herbal Medical Therapies, May Improve Survival in Stage-IV Pulmonary Adenocarcinomas in a Dosage-Dependent Manner: A Prospective Observational Study With Propensity Score Analysis
Li, H., Lindberg, V., Zhu, L., Huang, X., Feng, J., & Baak, J. P. A. (2025) · Integrative Cancer Therapies · doi:10.1177/15347354251342739 · Cited by 3
Clinical Development of Rivaroxaban: Emerging New Clinical evidences?
Mont, L., Marín, F. R., Garcia-Bragado, F., Martínez, M. S., & Culleré, J. G. (2015) · Future Cardiology · doi:10.2217/fca.15.31 · Cited by 3
The Power of Disparate Data Sources for Answering Thorny Questions in Healthcare: Four Case Studies
Harper, E. M., & McNair, D. (2017) · Health informatics · doi:10.1007/978-3-319-53300-1_18 · Cited by 3
Metaepidemiologie und Qualitätssicherung klinischer Evidenzproduktion
Haring, R. (2017) · Springer eBooks · doi:10.1007/978-3-662-55377-0_4 · Cited by 3
Der Stellenwert von Real-World-Evidenz im deutschen Sozial- und Gesundheitsrecht
Trute, H.-H. (2018) · Gefässchirurgie · doi:10.1007/s00772-018-0471-z · Cited by 3
Observational Studies
Donzelli, S., Loss, K. L., Zaina, F., & Négrini, S. (2021) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0000000000001824 · Cited by 3
Intensified training before Olympic-distance triathlon in recreational triathletes: “Less pain, more gain”
Zarranz-Domench, X., García-Tabar, I., Lizarazu, J. C., Ruesta, M., & Gorostiaga, E. M. (2022) · Physiology International · doi:10.1556/2060.2022.00181 · Cited by 3
Observational studies of antidepressant use and suicide risk are selectively published in psychiatric journals
Plöderl, M., Amendola, S., & Hengartner, M. P. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.07.015 · Cited by 3
Synthesis and Anti-Inflammatory Activity of (Z)-4-(2-(3-Oxopiperazin-2-ylidene)acetyl)benzoic Acid
Дмитриев, М. В., Khramtsova, E. E., Apushkin, D., Andreev, A., Kovalenko, I. I., Mashevskaya, I. V., & Maslivets, A. N. (2024) · Molbank · doi:10.3390/m1772 · Cited by 3
Evaluating the Practicality of Causal Inference From Non-randomized Observational Data in Small-Scale Clinical Settings: A Study on the Effects of Ninjin’yoeito
Okui, N. (2024) · Cureus · doi:10.7759/cureus.55825 · Cited by 3
Independent Supported Housing vs institutional housing rehabilitation settings for non-homeless individuals with severe mental illness – longitudinal results from an observational study
Adamus, C., Mötteli, S., Jäger, M., & Richter, D. (2024) · BMC Psychiatry · doi:10.1186/s12888-024-05995-7 · Cited by 3
Comparing the effectiveness of peer‐led healthy aging interventions on depression and quality of life in community‐dwelling older adults: A systematic review and network meta‐analysis
Kim, J., Kim, S., Kim, U. O., Yim, E., Lee, I., Hong, H., Lee, D., & Lee, K. (2024) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12753 · Cited by 3
Short- and long-term effects of mandibular advancement device therapy for obstructive sleep apnea on temporomandibular disorders: A systematic review and meta-analysis
Liu, S., Ishiyama, H., Angkulmahasuk, S., Nishiyama, A., & Fueki, K. (2025) · Journal of Prosthodontic Research · doi:10.2186/jpr.jpr_d_25_00034 · Cited by 3
My Take on the Biopsychosocial Model of Patient-Centered Care
Cheng, J. (2018) · Pain Medicine · doi:10.1093/pm/pny187 · Cited by 3
Does postoperative prophylactic irradiation of para-aortic lymph nodes reduce the risk of recurrence in uterine cervical cancer with positive pelvic lymph nodes?
Yoshida, K., Kajiyama, H., Yoshihara, M., Ikeda, Y., Yoshikawa, N., Nishino, K., Utsumi, F., Niimi, K., Suzuki, S., & Kikkawa, F. (2019) · International Journal of Clinical Oncology · doi:10.1007/s10147-018-1376-2 · Cited by 3
Evidence-Based Medicine: Boom or Bust in Orthopaedic Trauma?
Harvey, E. J., Martineau, P. A., Schemitsch, E. H., Nowak, L. L., & Agel, J. A. (2019) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.19.00547 · Cited by 3
Pyridylimine palladium(II) complexes: one-pot synthesis and monoamine oxidase inhibition
Denisov, M. S., Gagarskikh, O. N., & Utushkina, T. A. (2021) · Вестник Пермского университета Серия «Химия» = Bulletin of Perm University CHEMISTRY · doi:10.17072/2223-1838-2021-1-30-58 · Cited by 3
Participating in Longitudinal Observational Research on Psychiatric Rehabilitation: Quantitative Results From a Patient Perspective Study
Dehn, L. B., Drießen, M., Steinhart, I., & Beblo, T. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.834389 · Cited by 4
Working in the New Big Data World: Academic/Corporate Partnership Model
Crown, W. H., & Clancy, T. R. (2017) · Health informatics · doi:10.1007/978-3-319-53300-1_9 · Cited by 3
A ‘reluctant’ critical review: ‘Manual for evidence‐based clinical practice (2015)’
Seshia, S. S. (2015) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12509 · Cited by 3
The Use of Metaanalysis in Pharmacoepidemiology
Berlin, J. A., Crowe, B. J., Xia, H. A., & Evans, S. J. W. (2019) · Pharmacoepidemiology · doi:10.1002/9781119413431.ch36 · Cited by 3
The randomized clinical trial trustworthiness crisis
Butt, F., Fawzy, M. M., Wattar, B. H. A., Bueno‐Cavanillas, A., Khan, K. S., & Khalaf, Y. (2024) · Middle East Fertility Society Journal · doi:10.1186/s43043-023-00161-7 · Cited by 4
Real-World Evidence on the Effectiveness of Pembrolizumab in Patients With Recurrent/Metastatic/Unresectable Head and Neck Squamous Cell Cancer: A Systematic Review and Meta-Analysis
Meenu, M., Dhiman, P., Kumar, M., Pradhan, P., & Pandey, S. (2025) · Cureus · doi:10.7759/cureus.76709 · Cited by 2
Assessing the replicability of RCTs in RWE emulations
Köppe, J., Micheloud, C., Erdmann, S., Heyard, R., & Held, L. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02589-z · Cited by 5

Authors: Anglemyer, A., Horvath, H. T., & Bero, L.
Affiliations: University of California, San Francisco (US)
University of California, San Francisco; Global Health Sciences; San Francisco California USA 94105
ORCID: Anglemyer, Andrew
Bero, Lisa
Venue: Cochrane Database of Systematic Reviews
Publisher: Wiley
Published: 2014-04-29
Volume: 2014
Issue: 4
Pages: MR000034-MR000034
ISSN: 1361-6137 (ISSN-L)
1465-1858
DOI: 10.1002/14651858.mr000034.pub2
PMC: PMC8191367
OpenAlex: W1972783815
Cited by: 534
References: 74
Citations by year: 2026: 10 · 2025: 21 · 2024: 37 · 2023: 45 · 2022: 63 · 2021: 73 · 2020: 60 · 2019: 50 · 2018: 43 · 2017: 49 · 2016: 41 · 2015: 36 · 2014: 6
FWCI: 43.06
Type: journal article
Language: en
Update notices: new_version (2024-01-04)
Open access: green
www.ncbi.nlm.nih.gov
Locations: Cochrane Database of Systematic Reviews (publishedVersion)
PubMed Central (publishedVersion)
PubMed (publishedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Keywords: randomized controlled trials, observational studies, comparative effectiveness research, effect size estimation, risk of bias, study design comparison, relative risk, odds ratio, hazard ratio, retrospective cohort, prospective cohort, case-control study, cross-sectional study, methodological review, real-world effectiveness, bias in observational studies, effect size heterogeneity
MeSH terms: Humans, Meta-Analysis as Topic, Randomized Controlled Trials as Topic, Outcome Assessment, Health Care, Observational Studies as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks