Correcting Misinterpretations of the E-Value
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Editorials15 January 2019Correcting Misinterpretations of the E-ValueTyler J. VanderWeele, PhD, Maya B. Mathur, PhD, and Peng Ding, PhDTyler J. VanderWeele, PhDHarvard T.H. Chan School of Public Health, Boston, Massachusetts (T.J.V., M.B.M.), Maya B. Mathur, PhDHarvard T.H. Chan School of Public Health, Boston, Massachusetts (T.J.V., M.B.M.), and Peng Ding, PhDUniversity of California, Berkeley, Berkeley, California (P.D.)Author, Article, and Disclosure Informationhttps://doi.org/10.7326/M18-3112 SectionsAboutFull TextPDF ToolsAdd to favoritesDownload CitationsTrack CitationsPermissions ShareFacebookTwitterLinkedInRedditEmail We thank Ioannidis and colleagues (1) for raising several important issues concerning the potential misuse of the E-value (2). These issues are not new, and we have addressed them previously and provided guidance as to how to avoid misuse (2–4). Let us begin with where we think Ioannidis and colleagues are correct (1).First, biases other than confounding, such as measurement error, selection bias, and publication bias, can also undermine estimates of causal effects. We agree, we have noted this previously (2–4), and we have now developed similar techniques to address other biases (5, 6).Second, the E-value is monotonically ...References1. Ioannidis JPA, Tan YJ, Blum MR. Limitations and misinterpretations of E-values for sensitivity analyses of observational studies. Ann Intern Med. 2019;170:108-11. doi:10.7326/M18-2159 LinkGoogle Scholar2. VanderWeele TJ, Ding P. Sensitivity analysis in observational research: introducing the E-value. Ann Intern Med. 2017;167:268-74. [PMID: 28693043]. doi:10.7326/M16-2607 LinkGoogle Scholar3. Ding P, VanderWeele TJ. Sensitivity analysis without assumptions. Epidemiology. 2016;27:368-77. [PMID: 26841057] doi:10.1097/EDE.0000000000000457 CrossrefMedlineGoogle Scholar4. VanderWeele TJ, Ding P, Mathur M. Technical considerations in the use of the E-value. J Causal Inference. 2019;7. Preprint available at: https://biostats.bepress.com/harvardbiostat/paper215. Google Scholar5. Smith LH, VanderWeele TJ. Bounding bias due to selection. Epidemiology. 2019;30. Preprint available at: https://arxiv.org/abs/1810.13402. Google Scholar6. VanderWeele TJ, Mathur MB, Chen Y. Outcome-wide longitudinal analyses for causal inference: a new template for empirical studies. Stat Sci. 2019;34. https://arxiv.org/abs/1810.10164. Google Scholar7. Mathur MB, Ding P, Riddell CA, VanderWeele TJ. Web site and R package for computing E-values. Epidemiology. 2018;29:e45-7. [PMID: 29912013] doi:10.1097/EDE.0000000000000864 CrossrefMedlineGoogle Scholar8. Benjamin DJ, Berger JO, Johannesson M, Nosek BA, Wagenmakers EJ, Berk R, et al. Redefine statistical significance. Nat Hum Behav. 2018;2:6-10. CrossrefMedlineGoogle Scholar Author, Article, and Disclosure InformationAffiliations: Harvard T.H. Chan School of Public Health, Boston, Massachusetts (T.J.V., M.B.M.)University of California, Berkeley, Berkeley, California (P.D.)Disclosures: Authors have disclosed no conflicts of interest. Forms can be viewed at www.acponline.org/authors/icmje/ConflictOfInterestForms.do?msNum=M18-3112.Corresponding Author: Tyler J. VanderWeele, PhD, Department of Epidemiology, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston MA 02115; e-mail, [email protected]harvard.edu.Current Author Addresses: Dr. VanderWeele: Department of Epidemiology, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston MA 02115.Dr. Mathur: Harvard University, 655 Huntington Avenue, Building 2, Boston MA 02115.Dr. Ding: University of California, Berkeley, 425 Evans Hall, Berkeley, CA 94720.This article was published at Annals.org on 1 January 2019. PreviousarticleNextarticle Advertisement FiguresReferencesRelatedDetailsSee AlsoLimitations and Misinterpretations of E-Values for Sensitivity Analyses of Observational Studies John P.A. Ioannidis , Yuan Jin Tan , and Manuel R. Blum Metrics Cited byAre Greenland, Ioannidis and Poole opposed to the Cornfield conditions? A defence of the E-valueE-values for effect heterogeneity and approximations for causal interactionHow to report E-values for meta-analyses: Recommended improvements and additions to the new GRADE approachAssociation of Alcohol Use Diagnostic Codes in Pregnancy and Offspring Conotruncal and Endocardial Cushion Heart DefectsAn approach to quantifying the potential importance of residual confounding in systematic reviews of observational studies: A GRADE concept paperEffects of hearing impairment and hearing aid use on the incidence of cognitive impairment among community-dwelling older adults: evidence from the Taiwan Longitudinal Study on Aging (TLSA)The Importance of Making Assumptions in Bias AnalysisBias Analysis Gone BadPharmacoepidemiology for nephrologists (part 2): potential biases and how to overcome themUncontrolled ConfoundersOn the use of the E-value for sensitivity analysis in epidemiologic studiesLong-term exposure to NO2 a
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sensitivity analysis in observational research: Introducing the E-value
VanderWeele, T. J., & Ding, P. (2017) · Annals of Internal Medicine · doi:10.7326/m16-2607 · Cited by 6,350
Self-citationRedefine statistical significance
Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E.-J., Berk, R., Bollen, K. A., Brembs, B., Brown, L., Camerer, C., et al. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0189-z · Cited by 2,772
Cited by
Huangfu, P., & Atkinson, R. (2020) · Environment International · doi:10.1016/j.envint.2020.105998 · Cited by 522
Sensitivity Analysis for Publication Bias in Meta-Analyses
Mathur, M. B., & VanderWeele, T. J. (2020) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/rssc.12440 · Cited by 354
Self-citationThe Importance of Making Assumptions in Bias Analysis
MacLehose, R. F., Ahern, T. P., Lash, T. L., Poole, C., & Greenland, S. (2021) · Epidemiology · doi:10.1097/ede.0000000000001381 · Cited by 39
Elevated body temperature is associated with depressive symptoms: results from the TemPredict Study
Mason, A. E., Kasl, P., Soltani, S., Green, A., Hartogensis, W., Dilchert, S., Chowdhary, A., Pandya, L. S., Siwik, C. J., Foster, S. L., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-51567-w · Cited by 31
“For each linear and logistic regression model, we performed sensitivity analyses by calculating E-values 70,71 , which provide estimates of the magnitude of unmeasured confounding that could explain the observed effects and have been recommended as a type of sensitivity analysis 70,72 .”
Metadata
- Authors
- VanderWeele, T. J., Mathur, M. B., & Ding, P.
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2019-01-15
- Volume
- 170
- Issue
- 2
- Pages
- 131-132
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W2907043907
- Cited by
- 53
- References
- 2
- FWCI
- 6.65
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.