The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Estimating data from figures with a Web‐based program: Considerations for a systematic review
Abstract
Background: Systematic reviewers often encounter incomplete or missing data, and the information desired may be difficult to obtain from a study author. Thus, systematic reviewers may have to resort to estimating data from figures with little or no raw data in a study's corresponding text or tables. Methods: We discuss a case study in which participants used a publically available Web‐based program, called webplotdigitizer, to estimate data from 2 figures. We evaluated and used the intraclass coefficient and the accuracy of the estimates to the true data to inform considerations when using estimated data from figures in systematic reviews. Results: The estimates for both figures were consistent, although the distribution of estimates in the figure of a continuous outcome was slightly higher. For the continuous outcome, the percent difference ranged from 0.23% to 30.35% while the percent difference of the event rate ranged from 0.22% to 8.92%. For both figures, the intraclass coefficient was excellent (>0.95). Conclusions: Systematic reviewers should consider and be transparent when estimating data from figures when the information cannot be obtained from study authors and perform sensitivity analyses of pooled results to reduce bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial
Hallgren, K. A. (2012) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.08.1.p023 · Cited by 3,884
Cognitive-behavioral treatment of chronically parasuicidal borderline patients
Linehan, M. M. (1991) · Archives of General Psychiatry · doi:10.1001/archpsyc.1991.01810360024003 · Cited by 2,203
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.004 · Cited by 1,858
Bateman, A., & Fonagy, P. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.10.1563 · Cited by 1,416 · cited 1×
“In the systematic review(6) from which the figures in this study were identified,7–10 the use of WEBPLOTDIGITIZER was not mentioned in the methods section nor were the studies with estimated data specifically identified as such in the evidence tables, and only 1 of the studies was used in a meta‐analysis (of suicide a…”
MethodFinding What Works in Health Care: Standards for Systematic Reviews
Eden, J., Levit, L. A., Berg, A. O., & Morton, S. C. (2013) · Cited by 943
Jelicic Kadic, A., Vucic, K., Dosenovic, S., Sapunar, D., & Puljak, L. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.01.002 · Cited by 222
O'Connor, E., Gaynes, B. N., Burda, B. U., Soh, C., & Whitlock, E. P. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-10-201305210-00642 · Cited by 193
Self-citationComtois, K. A., Jobes, D. A., S. O'Connor, S., Atkins, D. C., Janis, K., E. Chessen, C., Landes, S. J., Holen, A., & Yuodelis-Flores, C. (2011) · Depression and Anxiety · doi:10.1002/da.20895 · Cited by 177
Extreme positive allometry of animal adhesive pads and the size limits of adhesion-based climbing
Labonte, D., Clemente, C. J., Dittrich, A., Kuo, C., Crosby, A. J., Irschick, D. J., & Federle, W. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1519459113 · Cited by 142
Cited by
A meta-analysis of the weight of advice in decision-making
Bailey, P. E., Leon, T., Ebner, N. C., Moustafa, A. A., & Weidemann, G. (2023) · Current Psychology · doi:10.1007/s12144-022-03573-2 · Cited by 82
The effects of L-theanine consumption on sleep outcomes: a systematic review and meta-analysis
Bulman, A., D’Cunha, N. M., Marx, W., Turner, M., McKune, A., & Naumovski, N. (2025) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2025.102076 · Cited by 20
Wang, Y., Lan, B., Zhang, S., Mu, Y., Mi, J., Yu, J., Zhan, Q., Luo, B., Lin, F., Teng, J., et al. (2025) · Diabetology & Metabolic Syndrome · doi:10.1186/s13098-025-01877-4 · Cited by 8
Metadata
- Authors
- Burda, B. U., O'Connor, E. A., Webber, E. M., Redmond, N., & Perdue, L. A.
- Venue
- Research Synthesis Methods
- Publisher
- Wiley
- Published
- 2017-03-07
- Volume
- 8
- Issue
- 3
- Pages
- 258-262
- ISSN
- 1759-2879 (ISSN-L)
- 1759-2887
- OpenAlex
- W2592082180
- Cited by
- 375
- References
- 15
- FWCI
- 2.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Estimating data from figures with a Web‐based program: Considerations for a systematic review. https://app.cochat.ai/papers/10.1002/jrsm.1232
- The paper
- Burda, B. U., O'Connor, E. A., Webber, E. M., Redmond, N., & Perdue, L. A. (2017). Estimating data from figures with a Web‐based program: Considerations for a systematic review. Research Synthesis Methods. https://doi.org/10.1002/jrsm.1232
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.