Meta‐analysis of diagnostic test studies using individual patient data and aggregate data
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
A meta‐analysis of diagnostic test studies provides evidence‐based results regarding the accuracy of a particular test, and usually involves synthesizing aggregate data (AD) from each study, such as the 2 by 2 tables of diagnostic accuracy. A bivariate random‐effects meta‐analysis (BRMA) can appropriately synthesize these tables, and leads to clinical results, such as the summary sensitivity and specificity across studies. However, translating such results into practice may be limited by between‐study heterogeneity and that they relate to some ‘average’ patient across studies. In this paper we describe how the meta‐analysis of individual patient data (IPD) from diagnostic studies can lead to clinical results more tailored to the individual patient. We develop IPD models that extend the BRMA framework to include study‐level covariates, which help explain the between‐study heterogeneity, and also patient‐level covariates, which allow one to assess the effect of patient characteristics on test accuracy. We show how the inclusion of patient‐level covariates requires a careful separation of within‐study and across‐study accuracy‐covariate effects, as the latter are particularly prone to confounding. Our models are assessed through simulation and extended to allow IPD studies to be combined with AD studies, as IPD are not always available for all studies. Application is made to 23 studies assessing the accuracy of ear thermometers for diagnosing fever in children, with 16 IPD and 7 AD studies. The models reveal that between‐study heterogeneity is partly explained by the use of different measurement devices, but there is no evidence that being an infant modifies diagnostic accuracy. Copyright © 2008 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A. (2006) · Bayesian Analysis · doi:10.1214/06-ba117a · Cited by 4,050
Reitsma, J. B., Glas, A. S., Rutjes, A. W. S., Scholten, R. J. P. M., Bossuyt, P. M., & Zwinderman, A. H. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.02.022 · Cited by 3,369
Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated
Thompson, S. G. (1994) · BMJ · doi:10.1136/bmj.309.6965.1351 · Cited by 1,017 · cited 2×
“It is thus advisable to explore the reasons for heterogeneity where possible [13, 16], for example using meta-regression [17], and obtain meta-analysis results for relevant subgroups of studies, such as those using the same measuring device.”
BackgroundMethodEcological Bias, Confounding, and Effect Modification
GREENLAND, S., & MORGENSTERN, H. (1989) · International Journal of Epidemiology · doi:10.1093/ije/18.1.269 · Cited by 540
Lambert, P. C., Sutton, A. J., Burton, P. R., Abrams, K. R., & Jones, D. R. (2005) · Statistics in Medicine · doi:10.1002/sim.2112 · Cited by 511
Can meta-analysis help target interventions at individuals most likely to benefit?
Thompson, S. G., & Higgins, J. P. (2005) · The Lancet · doi:10.1016/s0140-6736(05)70200-2 · Cited by 174
Dodd, S. R., Lancaster, G. A., Craig, J. V., Smyth, R. L., & Williamson, P. R. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.10.004 · Cited by 90
Self-citation
Cited by
Meta-analysis of individual participant data: rationale, conduct, and reporting
Riley, R. D., Lambert, P. C., & Abo-Zaid, G. (2010) · BMJ · doi:10.1136/bmj.c221 · Cited by 1,701
Self-citationLevis, B., Benedetti, A., & Thombs, B. D. (2019) · BMJ · doi:10.1136/bmj.l1476 · Cited by 1,718
Levis, B., Negeri, Z., Sun, Y., Benedetti, A., & Thombs, B. D. (2020) · BMJ · doi:10.1136/bmj.m4022 · Cited by 922
Levis, B., Sun, Y., He, C., Wu, Y., Krishnan, A., Bhandari, P. M., Neupane, D., Imran, M., Brehaut, E., Negeri, Z., et al. (2020) · JAMA · doi:10.1001/jama.2020.6504 · Cited by 577
Multivariate meta‐analysis: Potential and promise
Jackson, D., Riley, R., & White, I. R. (2011) · Statistics in Medicine · doi:10.1002/sim.4172 · Cited by 530
Self-citationWu, Y., Levis, B., Riehm, K. E., Saadat, N., Levis, A. W., Azar, M., Rice, D. B., Boruff, J., Cuijpers, P., Gilbody, S., et al. (2020) · Psychological Medicine · doi:10.1017/s0033291719001314 · Cited by 423
Negeri, Z. F., Levis, B., Sun, Y., He, C., Krishnan, A., Wu, Y., Bhandari, P. M., Neupane, D., Brehaut, E., Benedetti, A., et al. (2021) · BMJ · doi:10.1136/bmj.n2183 · Cited by 364
Tierney, J. F., Vale, C., Riley, R., Smith, C. T., Stewart, L., Clarke, M., & Rovers, M. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001855 · Cited by 361
Self-citationWu, Y., Levis, B., Sun, Y., He, C., Krishnan, A., Neupane, D., Bhandari, P. M., Negeri, Z., Benedetti, A., & Thombs, B. D. (2021) · BMJ · doi:10.1136/bmj.n972 · Cited by 265
Hua, H., Burke, D. L., Crowther, M. J., Ensor, J., Tudur Smith, C., & Riley, R. D. (2017) · Statistics in Medicine · doi:10.1002/sim.7171 · Cited by 113
Self-citationThombs, B. D., Benedetti, A., Kloda, L. A., Levis, B., Riehm, K. E., Azar, M., Cuijpers, P., Gilbody, S., Ioannidis, J. P. A., McMillan, D., et al. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-009742 · Cited by 57
“provide individual patient data in the main metaanalysis.(54) If there are a large number of studies that do not contribute primary data, this analysis may become”
BackgroundMethodInfluential
Metadata
- Authors
- Riley, R. D., Dodd, S. R., Craig, J. V., Thompson, J. R., & Williamson, P. R.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2008-09-24
- Volume
- 27
- Issue
- 29
- Pages
- 6111-6136
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2142183725
- Cited by
- 98
- References
- 7
- FWCI
- 4.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.