Association is not causation: treatment effects cannot be estimated from observational data in heart failure
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Aims: Treatment 'effects' are often inferred from non-randomized and observational studies. These studies have inherent biases and limitations, which may make therapeutic inferences based on their results unreliable. We compared the conflicting findings of these studies to those of prospective randomized controlled trials (RCTs) in relation to pharmacological treatments for heart failure (HF). Methods and results: We searched Medline and Embase to identify studies of the association between non-randomized drug therapy and all-cause mortality in patients with HF until 31 December 2017. The treatments of interest were: angiotensin-converting enzyme inhibitors, angiotensin receptor blockers, beta-blockers, mineralocorticoid receptor antagonists (MRAs), statins, and digoxin. We compared the findings of these observational studies with those of relevant RCTs. We identified 92 publications, reporting 94 non-randomized studies, describing 158 estimates of the 'effect' of the six treatments of interest on all-cause mortality, i.e. some studies examined more than one treatment and/or HF phenotype. These six treatments had been tested in 25 RCTs. For example, two pivotal RCTs showed that MRAs reduced mortality in patients with HF with reduced ejection fraction. However, only one of 12 non-randomized studies found that MRAs were of benefit, with 10 finding a neutral effect, and one a harmful effect. Conclusion: This comprehensive comparison of studies of non-randomized data with the findings of RCTs in HF shows that it is not possible to make reliable therapeutic inferences from observational associations. While trials undoubtedly leave gaps in evidence and enrol selected participants, they clearly remain the best guide to the treatment of patients.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1992) · New England Journal of Medicine · doi:10.1056/nejm199209033271003 · Cited by 3,725
Eplerenone in patients with systolic heart failure and mild symptoms
Zannad, F., McMurray, J. J. V., Krum, H., van Veldhuisen, D. J., Swedberg, K., Shi, H., Vincent, J., Pocock, S. J., & Pitt, B. (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1009492 · Cited by 3,111
Self-citationEffect of carvedilol on survival in severe chronic heart failure
Packer, M., Coats, A. J. S., Fowler, M. B., Katus, H. A., Krum, H., Mohacsi, P., Rouleau, J. L., Tendera, M., Castaigne, A., Roecker, E. B., et al. (2001) · New England Journal of Medicine · doi:10.1056/nejm200105313442201 · Cited by 3,093
The effect of digoxin on mortality and morbidity in patients with heart failure
(1997) · New England Journal of Medicine · doi:10.1056/nejm199702203360801 · Cited by 3,016
Cohn, J. N., Johnson, G., Ziesche, S., Cobb, F., Francis, G., Tristani, F., Smith, R., Dunkman, W. B., Loeb, H., Wong, M., et al. (1991) · New England Journal of Medicine · doi:10.1056/nejm199108013250502 · Cited by 2,833
Spironolactone for heart failure with preserved ejection fraction
Pitt, B., Pfeffer, M. A., Assmann, S. F., Boineau, R., Anand, I. S., Claggett, B., Clausell, N., Desai, A. S., Diaz, R., Fleg, J. L., et al. (2014) · New England Journal of Medicine · doi:10.1056/nejmoa1313731 · Cited by 2,809 · cited 6×
“We identified one observational study of ARB use in patients with HFpEF which suggested no mortality benefit.39 A further three nonrandomized studies reported estimates of a treatment ‘effect’ for use of either an ACEI or ARB in HFpEF.”
BackgroundInfluentialMcMurray, J. J., Östergren, J., Swedberg, K., Granger, C. B., Held, P., Michelson, E. L., Olofsson, B., Yusuf, S., & Pfeffer, M. A. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14283-3 · Cited by 2,604
Self-citationIrbesartan in patients with heart failure and preserved ejection fraction
Massie, B. M., Carson, P. E., McMurray, J. J., Komajda, M., McKelvie, R., Zile, M. R., Anderson, S., Donovan, M., Iverson, E., Staiger, C., et al. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0805450 · Cited by 1,960
Self-citationGranger, C. B., McMurray, J. J., Yusuf, S., Held, P., Michelson, E. L., Olofsson, B., Östergren, J., Pfeffer, M. A., & Swedberg, K. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14284-5 · Cited by 1,686
Self-citationBias and causal associations in observational research
Grimes, D. A., & Schulz, K. F. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07451-2 · Cited by 1,553
Cited by
Andrade, J. G., Aguilar, M., Atzema, C., Bell, A., Cairns, J. A., Cheung, C. C., Cox, J. L., Dorian, P., Gladstone, D. J., Healey, J. S., et al. (2020) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2020.09.001 · Cited by 562
Suchard, M. A., Schuemie, M. J., Krumholz, H. M., You, S. C., Chen, R., Pratt, N., Reich, C. G., Duke, J., Madigan, D., Hripcsak, G., et al. (2019) · The Lancet · doi:10.1016/s0140-6736(19)32317-7 · Cited by 359
Real-world studies no substitute for RCTs in establishing efficacy
Gerstein, H. C., McMurray, J., & Holman, R. R. (2019) · The Lancet · doi:10.1016/s0140-6736(18)32840-x · Cited by 97
Self-citationDocherty, K. F., Shen, L., Castagno, D., Petrie, M. C., Abraham, W. T., Böhm, M., Desai, A. S., Dickstein, K., Køber, L. V., Packer, M., et al. (2020) · European Journal of Heart Failure · doi:10.1002/ejhf.1682 · Cited by 42
Self-citation
Metadata
- Authors
- Rush, C. J., Campbell, R. T., Jhund, P. S., Petrie, M. C., & McMurray, J. J. V.
- Venue
- European Heart Journal
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-08-01
- Volume
- 39
- Issue
- 37
- Pages
- 3417-3438
- ISSN
- 0195-668X (ISSN-L)
- 1522-9645
- OpenAlex
- W2886506768
- Cited by
- 48
- References
- 25
- FWCI
- 6.37
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Association is not causation: treatment effects cannot be estimated from observational data in heart failure. https://app.cochat.ai/papers/10.1093/eurheartj/ehy407
- The paper
- Rush, C. J., Campbell, R. T., Jhund, P. S., Petrie, M. C., & McMurray, J. J. V. (2018). Association is not causation: treatment effects cannot be estimated from observational data in heart failure. European Heart Journal. https://doi.org/10.1093/eurheartj/ehy407
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.