Random-Effects, Fixed-Effects and the within-between Specification for Clustered Data in Observational Health Studies: A Simulation Study
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
BACKGROUND: When unaccounted-for group-level characteristics affect an outcome variable, traditional linear regression is inefficient and can be biased. The random- and fixed-effects estimators (RE and FE, respectively) are two competing methods that address these problems. While each estimator controls for otherwise unaccounted-for effects, the two estimators require different assumptions. Health researchers tend to favor RE estimation, while researchers from some other disciplines tend to favor FE estimation. In addition to RE and FE, an alternative method called within-between (WB) was suggested by Mundlak in 1978, although is utilized infrequently. METHODS: We conduct a simulation study to compare RE, FE, and WB estimation across 16,200 scenarios. The scenarios vary in the number of groups, the size of the groups, within-group variation, goodness-of-fit of the model, and the degree to which the model is correctly specified. Estimator preference is determined by lowest mean squared error of the estimated marginal effect and root mean squared error of fitted values. RESULTS: Although there are scenarios when each estimator is most appropriate, the cases in which traditional RE estimation is preferred are less common. In finite samples, the WB approach outperforms both traditional estimators. The Hausman test guides the practitioner to the estimator with the smallest absolute error only 61% of the time, and in many sample sizes simply applying the WB approach produces smaller absolute errors than following the suggestion of the test. CONCLUSIONS: Specification and estimation should be carefully considered and ultimately guided by the objective of the analysis and characteristics of the data. The WB approach has been underutilized, particularly for inference on marginal effects in small samples. Blindly applying any estimator can lead to bias, inefficiency, and flawed inference.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
On the Pooling of Time Series and Cross Section Data
Mundlak, Y. (1978) · Econometrica · doi:10.2307/1913646 · Cited by 5,412
Fixed Effects Regression Models
Allison, P. (2009) · doi:10.4135/9781412993869 · Cited by 3,999
Hubbard (2010) · doi:10.1097/ede.0b013e3181caeb90 · Cited by 1,139
Context, composition and heterogeneity: using multilevel models in health research
Duncan, C., Jones, K., & Moon, G. (1998) · Social Science & Medicine · doi:10.1016/s0277-9536(97)00148-2 · Cited by 689
Correlated random effects models with unbalanced panels
Wooldridge, J. M. (2019) · Journal of Econometrics · doi:10.1016/j.jeconom.2018.12.010 · Cited by 661
Cited by
Schenck-Fontaine, A., & Panico, L. (2019) · Demography · doi:10.1007/s13524-019-00833-y · Cited by 101
“The most important difference between the mixed- and fixed-effects models is the source of variation each model draws on to estimate the parameters (Dieleman and Templin 2014).”
BackgroundMethodFrank, R. W., & Martínez i Coma, F. (2023) · Political Behavior · doi:10.1007/s11109-021-09720-y · Cited by 56
Metadata
- Authors
- Dieleman, J. L., & Templin, T.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-10-24
- Volume
- 9
- Issue
- 10
- Pages
- e110257
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2046481462
- Cited by
- 179
- References
- 6
- FWCI
- 9.97
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.