Goodness of fit tools for dose–response meta‐analysis of binary outcomes
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Goodness of fit evaluation should be a natural step in assessing and reporting dose–response meta‐analyses from aggregated data of binary outcomes. However, little attention has been given to this topic in the epidemiological literature, and goodness of fit is rarely, if ever, assessed in practice. We briefly review the two‐stage and one‐stage methods used to carry out dose–response meta‐analyses. We then illustrate and discuss three tools specifically aimed at testing, quantifying, and graphically evaluating the goodness of fit of dose–response meta‐analyses. These tools are the deviance, the coefficient of determination, and the decorrelated residuals‐versus‐exposure plot. Data from two published meta‐analyses are used to show how these three tools can improve the practice of quantitative synthesis of aggregated dose–response data. In fact, evaluating the degree of agreement between model predictions and empirical data can help the identification of dose–response patterns, the investigation of sources of heterogeneity, and the assessment of whether the pooled dose–response relation adequately summarizes the published results. © 2015 The Authors. Research Synthesis Methods published by John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multivariate meta-analysis for non-linear and other multi-parameter associations
Gasparrini, A., Armstrong, B., & Kenward, M. G. (2012) · Statistics in Medicine · doi:10.1002/sim.5471 · Cited by 772
Quantifying the impact of between-study heterogeneity in multivariate meta-analyses
Jackson, D., White, I. R., & Riley, R. D. (2012) · Statistics in Medicine · doi:10.1002/sim.5453 · Cited by 577 · cited 1×
“If the study-specific dose–response associations are described by more than one parameter, that is, if p> 1, then the multivariate version of the Q test is to be used (Jackson et al., 2012; Ritz et al., 2008).”
MethodCoffee Consumption and Risk of Stroke: A Dose-Response Meta-Analysis of Prospective Studies
Larsson, S. C., & Orsini, N. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr226 · Cited by 196 · cited 3×
“Example 2 (Larsson and Orsini, 2011): decorrelated residuals-versus-exposure plots.”
BackgroundInfluentialSelf-citationObesity and risk of bladder cancer: A dose-response meta-analysis of 15 cohort studies
Sun, J.-W., Zhao, L.-G., Yang, Y., Ma, X., Wang, Y.-Y., & Xiang, Y.-B. (2015) · PLOS ONE · doi:10.1371/journal.pone.0119313 · Cited by 133
Detecting and describing heterogeneity in meta-analysis
Hardy, R. J., & Thompson, S. G. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980430)17:8<841::aid-sim781>3.0.co;2-d · cited 1×
“Heterogeneity in the dose–response relation across studies can be tested at the second stage by means of the Cochran Q test (Cochran, 1954), but it should be noted that this test suffers from low power, and therefore, it is of “limited use” (Hardy and Thompson, 1998).”
Method
Cited by
Ekelund, U., Tarp, J., Steene-Johannessen, J., Hansen, B. H., Jefferis, B., Fagerland, M. W., Whincup, P., Diaz, K. M., Hooker, S. P., Chernofsky, A., et al. (2019) · BMJ · doi:10.1136/bmj.l4570 · Cited by 1,769
One-stage dose–response meta-analysis for aggregated data
Crippa, A., Discacciati, A., Bottai, M., Spiegelman, D., & Orsini, N. (2019) · Statistical Methods in Medical Research · doi:10.1177/0962280218773122 · Cited by 365
“An assessment of the goodness-of-fit of the model can be based on the analysis of a transformation of the residuals, in order to take into account the covariance structure of the data.(11) The de-correlated residuals, e i , are computed as e i 1⁄4 C 1 i yi Xib , where Ci is the lower triangular matrix in the Cholesky…”
MethodSelf-citationBlond, K., Brinkløv, C. F., Ried-Larsen, M., Crippa, A., & Grøntved, A. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2018-100393 · Cited by 201
Self-citationSemnani-Azad, Z., Khan, T. A., Blanco Mejia, S., de Souza, R. J., Leiter, L. A., Kendall, C. W. C., Hanley, A. J., & Sievenpiper, J. L. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.9993 · Cited by 103
Liu, Q., Ayoub‐Charette, S., Khan, T. A., Au‐Yeung, F., Blanco Mejia, S., de Souza, R. J., Wolever, T. M. S., Leiter, L. A., Kendall, C. W. C., & Sievenpiper, J. L. (2019) · Journal of the American Heart Association · doi:10.1161/jaha.118.010977 · Cited by 65
Metadata
- Authors
- Discacciati, A., Crippa, A., & Orsini, N.
- Venue
- Research Synthesis Methods
- Publisher
- Wiley
- Published
- 2015-12-17
- Volume
- 8
- Issue
- 2
- Pages
- 149-160
- ISSN
- 1759-2879 (ISSN-L)
- 1759-2887
- OpenAlex
- W2204660565
- Cited by
- 41
- References
- 5
- FWCI
- 3.59
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.