Randomized clinical trials of cardiovascular disease in obstructive sleep apnea: understanding and overcoming bias
Open accessThe DOI matches its Crossref record; 121 of the 122 references it cites were found in a registry or an index.
Abstract
Three recent randomized control trials (RCTs) found that treatment of obstructive sleep apnea (OSA) with continuous positive airway pressure (CPAP) did not reduce rates of future cardiovascular events. This article discusses the biases in these RCTs that may explain their negative results, and how to overcome these biases in future studies. First, sample selection bias affected each RCT. The subjects recruited were not patients typically presenting for treatment of OSA. In particular, subjects with excessive sleepiness were excluded due to ethical concerns. As recent data indicate that the excessively sleepy OSA subtype has increased cardiovascular risk, subjects most likely to benefit from treatment were excluded. Second, RCTs had low adherence to therapy. Reported adherence is lower than found clinically, suggesting it is in part related to selection bias. Each RCT showed a CPAP benefit consistent with epidemiological studies when restricting to adherent patients, but was underpowered. Future studies need to include sleepy individuals and maximize adherence. Since it is unethical and impractical to randomize very sleepy subjects to no therapy, alternative designs are required. Observational designs using propensity scores, which are accepted by FDA for studies of medical devices, provide an opportunity. The design needs to ensure covariate balance, including measures assessing healthy user and healthy adherer biases, between regular users of CPAP and non-users. Sensitivity analyses can evaluate the robustness of results to unmeasured confounding, thereby improving confidence in conclusions. Thus, these designs can robustly assess the cardiovascular benefit of CPAP in real-world patients, overcoming biases in RCTs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“RCTs also had inadequate adherence to PAP therapy and on secondary analysis of data in adherent patients, CPAP benefit was found to be consistent with prior epidemiological studies.1206”
From International Consensus Statement on Obstructive Sleep Apnea (2023) · cites this paper as [1206]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
International physical activity questionnaire: 12-country reliability and validity
CRAIG, C. L., MARSHALL, A. L., SJ??STR??M, M., BAUMAN, A. E., BOOTH, M. L., AINSWORTH, B. E., PRATT, M., EKELUND, U., YNGVE, A., SALLIS, J. F., et al. (2003) · Medicine & Science in Sports & Exercise · doi:10.1249/01.mss.0000078924.61453.fb · Cited by 21,619
The Occurrence of Sleep-Disordered Breathing among Middle-Aged Adults
Young, T., Palta, M., Dempsey, J., Skatrud, J., Weber, S., & Badr, S. (1993) · New England Journal of Medicine · doi:10.1056/nejm199304293281704 · Cited by 10,183 · cited 2×
“While individuals with OSA from the general population can be a convenient source of recruitment, they tend to be relatively asymptomatic, raising questions as to the clinical significance of their disease [9, 58].”
BackgroundClassification and regression trees
Praagman, J. (1985) · European Journal of Operational Research · doi:10.1016/0377-2217(85)90321-2 · Cited by 10,053
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Austin, P. C. (2009) · Statistics in Medicine · doi:10.1002/sim.3697 · Cited by 6,758 · cited 1×
“This is most readily accomplished through comparisons of standardized mean differences between treatment groups (on both the original and absolute scales) before and after accounting for the PS design [101].”
MethodCholesterol Treatment Trialists' (CTT) Collaboration (2010) · The Lancet · doi:10.1016/s0140-6736(10)61350-5 · Cited by 6,550
Research works printed but not linked: 3
- 17. follow-up from the Wisconsin sleep cohort. Arterioscler Thromb Vasc Biol. 2014; 34 (10):2338-2342.
- 84. FDA Center for Devices and Radiological Health. Design Considerations for Pivotal Clinical Investigations for Medical Devices: Guidance for Industry, Clinical Investigators, Institutional Review Boards and Food and Drug Administration Staff . Silver Spring, MD: Center for Devices and Radiological Health, FDA; 2013.
- 97. Maislin G, et al . Design of non-randomized medical device trials based on sub-classification using propensity score quintiles. Proc Joint Stat Meet, Biopharm Stat. 2010:2182-2196.
Cited by
Items 101–114 of 114
Koo, J., Gohari, A., Pendharkar, S. R., & Ayas, N. (2021) · Canadian Journal of Respiratory Critical Care and Sleep Medicine · doi:10.1080/24745332.2021.1877216
Taillard, J., Launois, S. H., & Vecchierini, M.-F. (2021) · Médecine du Sommeil · doi:10.1016/j.msom.2021.05.002
Goodwin, A. T., Karadoğan, D., Santis, M. M. D., Alsafadi, H. N., Hawthorne, I. J., Bradicich, M., Siciliano, M., Duyar, S. Ş., Targa, A., Mészáros, M., et al. (2021) · Breathe · doi:10.1183/20734735.0080-2021
“Nevertheless, evidence by means of randomised controlled trials with cardiovascular cohorts is currently lacking [42].”
BackgroundMorgenthaler, T. I. (2021) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.9718
Case report on Acute Cardiopulmonary failure with Pneumonitis with Pickwickian syndrome
Patil, T., Dambare, M., Munjewar, P., & Pathade, A. (2022) · Journal of Pharmaceutical Negative Results · doi:10.47750/pnr.2022.13.s07.169
Coexistence of Obstructive Sleep Apnea and Cardiovascular Disease: A Narrative Review
Harsas, N. A., Amanda, R. Z., Laksono, S., & Kusharsamita, H. (2023) · Current Medical Issues · doi:10.4103/cmi.cmi_101_22
Staring us in the face: resumption of CPAP therapy
Joosten, S. A., & Genta, P. R. (2024) · European Respiratory Journal · doi:10.1183/13993003.02213-2023
Large Scale Data Analysis with Application to Computational Epidemiology and Network Science
Irany, F. A. (2024) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc2415893 · Cited by 2
Multidimensional Variability in Obstructive Sleep Apnoea – Does it Matter?
Bradicich, M., & Schwarz, E. I. (2026) · Current Pulmonology Reports · doi:10.1007/s13665-026-00400-y
“…in AHI, misclassification risk when diagnosis is based on a single night study (high likelihood of a false negative study in mild OSA), wrong assessment of treatment response (e.g., in MAD) Body position variability [5] Supine time between nights, influencing AHI, event type, SpO2-nadir etc.”
Unmeasured confounders in residual OSA: The roles of polypharmacy, loop gain, and weight trajectory
Zhong, L., & Zhu, X. (2026) · European Journal of Internal Medicine · doi:10.1016/j.ejim.2026.106737
Cai, Y., Lin, A., Kutler, R. B., Lopez-Peña, J. A., Suurna, M. V., Kacker, A., Cheng, B., Kezirian, E. J., Golub, J. S., Jelić, S., et al. (2026) · Sleep And Breathing · doi:10.1007/s11325-026-03597-z
“Several studies have demonstrated an association between insulin resistance and OSA [ 1, 2], but studies with CPAP have shown varying effects on insulin resistance in OSA [ 3, 4, 6, 15].”
InfluentialBraem, M. J. A., Lins, M., Bergh, A. V. D., Verhelst, F., Willes, L., & Collier, E. (2026) · Biomedicines · doi:10.3390/biomedicines14071652
“Together, both approaches are needed to understand not only whether a treatment can work under ideal conditions, but also whether it works in everyday clinical care [16–18].”
Obstructive sleep apnea pharmacology
Sunwoo, B. Y., Schmickl, C. N., & Malhotra, A. (2026) · Canadian Journal of Respiratory Critical Care and Sleep Medicine · doi:10.1080/24745332.2026.2695024
“85 Thus, in practice both obesity and OSA should be addressed, particularly given the increasing efficacy of anti-obesity medications.”
Time matters in obstructive sleep apnoea: a neglected dimension of disease burden and treatment
Schwarz, E. I. (2026) · Sleep Medicine · doi:10.1016/j.sleep.2026.109261
Metadata
- Authors
- Pack, A. I., Magalang, U. J., Singh, B., Kuna, S. T., Keenan, B. T., & Maislin, G.
- Affiliations
- University of Pennsylvania (US)
- The Ohio State University Wexner Medical Center (US)
- Sir Charles Gairdner Hospital (AU)
- Philadelphia VA Medical Center (US)
- Corresponding author
- Pack, Allan I
- Venue
- Sleep
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-11-09
- Volume
- 44
- Issue
- 2
- ISSN
- 0161-8105 (ISSN-L)
- 1550-9109
- PMC
- PMC7879410
- OpenAlex
- W3103233613
- Cited by
- 114
- References
- 122
- Citations by year
- 2026: 7 · 2025: 10 · 2024: 23 · 2023: 26 · 2022: 27 · 2021: 21
- FWCI
- 11.13
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- SLEEP (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (P01 HL094307)
- Topics
- Health Sciences › Medicine › Physiology (medical) › Obstructive Sleep Apnea Research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and related disorders
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- obstructive sleep apnea, continuous positive airway pressure, cardiovascular events, sample selection bias, excessive daytime sleepiness, CPAP adherence, healthy user bias, propensity score, observational study design, sensitivity analysis, unmeasured confounding, cardiovascular risk
- MeSH terms
- Cardiovascular Diseases, Humans, Patient Compliance, Bias, Randomized Controlled Trials as Topic, Sleep Apnea, Obstructive, Continuous Positive Airway Pressure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.