The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Assessment of vibration of effects due to model specification can demonstrate the instability of observational associations
Open accessAbstract
Objectives Model specification -- what adjusting variables are analytically modeled –may influence results of observational associations. We present a standardized approach to quantify the variability of results obtained with choices of adjustments called the “vibration of effects” (VoE). Study Design and Setting We estimated the VoE for 417 clinical, environmental, and physiological variables in association with all-cause mortality using National Health and Nutrition Examination Survey data. We selected 13 variables as adjustment co-variates and computed 8,192 Cox models for each of 417 variables’ associations with all-cause mortality. Results We present the VoE by assessing the variance of the effect size and in the −log10(p-value) obtained by different combinations of adjustments. We present whether there are multimodality patterns in effect sizes and p-values and the trajectory of results with increasing adjustments. For 31% of the 417 variables we observed a Janus effect, with the effect being in opposite direction in the 99th versus the 1st percentile of analyses. For example, the vitamin E variant α-tocopherol had a VoE that indicated higher and lower risk for mortality. Conclusions Estimating VoE offers empirical estimates of associations are under different model specifications. When VoE is large, claims for observational associations should be very cautious.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61602-x · Cited by 21,320
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationModeling Survival Data: Extending the Cox Model
Therneau, T. M., & Grambsch, P. M. (2000) · Statistics for Biology and Health · doi:10.1007/978-1-4757-3294-8 · Cited by 8,674 · cited 1×
“We used the R-project survival and survey library for all analyses and accounted for clusters pseudo-strata, pseudo-sampling units, and participant weights to accommodate the complex sampling of the data [27, 28].”
Compendium of physical activities: an update of activity codes and MET intensities
AINSWORTH, B. E., HASKELL, W. L., WHITT, M. C., IRWIN, M. L., SWARTZ, A. M., STRATH, S. J., O???BRIEN, W. L., BASSETT, D. R., SCHMITZ, K. H., EMPLAINCOURT, P. O., et al. (2000) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-200009001-00009 · Cited by 8,497
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“This may help avoiding surprises when some unstable associations are not replicated in subsequent studies, a common feature in observational research [9, 41] that can lead to contradictory statements and endless debates.”
Self-citationHoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118
Meta-Analysis: High-Dosage Vitamin E Supplementation May Increase All-Cause Mortality
Miller, E. R., Pastor-Barriuso, R., Dalal, D., Riemersma, R. A., Appel, L. J., & Guallar, E. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-1-200501040-00110 · Cited by 2,577
I Just Ran Two Million Regressions
Sala-i-Martín, X. (1997) · American Economic Review · Cited by 2,321
Cited by
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Self-citationIncreasing Transparency Through a Multiverse Analysis
Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616658637 · Cited by 1,372
Variability in the analysis of a single neuroimaging dataset by many teams
(2020) · doi:10.1038/s41586-020-2314-9 · Cited by 1,097
Best practice guidance for linear mixed-effects models in psychological science
Meteyard, L., & Davies, R. A. I. (2020) · Journal of Memory and Language · doi:10.1016/j.jml.2020.104092 · Cited by 698
Johnston, B. C., Zeraatkar, D., Han, M. A., Vernooij, R. W. M., Valli, C., El Dib, R., Marshall, C., Stover, P. J., Fairweather-Taitt, S., Wójcik, G., et al. (2019) · Annals of Internal Medicine · doi:10.7326/m19-1621 · Cited by 322
Self-citation
Metadata
- Authors
- Patel, C. J., Burford, B., & Ioannidis, J. P. A.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2015-09
- Volume
- 68
- Issue
- 9
- Pages
- 1046-1058
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2157931132
- Cited by
- 274
- References
- 62
- FWCI
- 10.80
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessment of vibration of effects due to model specification can demonstrate the instability of observational associations. https://app.cochat.ai/papers/10.1016/j.jclinepi.2015.05.029
- The paper
- Patel, C. J., Burford, B., & Ioannidis, J. P. A. (2015). Assessment of vibration of effects due to model specification can demonstrate the instability of observational associations. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2015.05.029
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.