Reflection on modern methods: demystifying robust standard errors for epidemiologists
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
All statistical estimates from data have uncertainty due to sampling variability. A standard error is one measure of uncertainty of a sample estimate (such as the mean of a set of observations or a regression coefficient). Standard errors are usually calculated based on assumptions underpinning the statistical model used in the estimation. However, there are situations in which some assumptions of the statistical model including the variance or covariance of the outcome across observations are violated, which leads to biased standard errors. One simple remedy is to use robust standard errors, which are robust to violations of certain assumptions of the statistical model. Robust standard errors are frequently used in clinical papers (e.g. to account for clustering of observations), although the underlying concepts behind robust standard errors and when to use them are often not well understood. In this paper, we demystify robust standard errors using several worked examples in simple situations in which model assumptions involving the variance or covariance of the outcome are misspecified. These are: (i) when the observed variances are different, (ii) when the variance specified in the model is wrong and (iii) when the assumption of independence is wrong.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
A Note on Robust Variance Estimation for Cluster‐Correlated Data
Williams, R. L. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00645.x · Cited by 2,501
Statistical Analysis of Correlated Data Using Generalized Estimating Equations: An Orientation
Hanley, J. A. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwf215 · Cited by 2,185
On The So-Called “Huber Sandwich Estimator” and “Robust Standard Errors”
Freedman, D. A. (2006) · The American Statistician · doi:10.1198/000313006x152207 · Cited by 498 · cited 1×
“However, robust standard errors are less useful when estimating conditionally adjusted effects with a seriously misspecified regression model, where one would obtain accurate standard errors to a mostly meaningless parameter.(26) Robust standard errors (also referred to as sandwich or Huber–White standard errors) are…”
Background
Cited by
Gebremedhin, A. T., Hogan, A. B., Blyth, C. C., Glass, K., & Moore, H. C. (2022) · Scientific Reports · doi:10.1038/s41598-021-04080-3 · Cited by 399
Mansournia, M. A., Collins, G. S., Nielsen, R. O., Nazemipour, M., Jewell, N. P., Altman, D. G., & Campbell, M. J. (2021) · British Journal of Sports Medicine · doi:10.1136/bjsports-2020-103652 · Cited by 263
Self-citationEzpeleta, M., Gabel, K., Cienfuegos, S., Kalam, F., Lin, S., Pavlou, V., Song, Z., Haus, J. M., Koppe, S., Alexandria, S. J., et al. (2023) · Cell Metabolism · doi:10.1016/j.cmet.2022.12.001 · Cited by 181
Metadata
- Authors
- Mansournia, M. A., Nazemipour, M., Naimi, A. I., Collins, G. S., & Campbell, M. J.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-12-22
- Volume
- 50
- Issue
- 1
- Pages
- 346-351
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W3115857595
- Cited by
- 235
- References
- 4
- FWCI
- 14.86
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.