CoChat

Reporting standards for literature searches and report inclusion criteria: making research syntheses more transparent and easy to replicate

Open access
Atkinson, Kayla M., Koenka, Alison C., Sanchez, Carmen E., Moshontz, Hannah, Cooper, Harris · 2015 · Research Synthesis Methods
Cited by 125

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

Abstract

A complete description of the literature search, including the criteria used for the inclusion of reports after they have been located, used in a research synthesis or meta‐analysis is critical if subsequent researchers are to accurately evaluate and reproduce a synthesis' methods and results. Based on previous guidelines and new suggestions, we present a set of focused and detailed standards for reporting the methods used in a literature search. The guidelines cover five search strategies: reference database searches, journal and bibliography searches, searches of the reference lists of reports, citation searches, and direct contact searches. First, we bring together all the unique recommendations made in existing guidelines for research synthesis. Second, we identify gaps in reporting standards for search strategies. Third, we address these gaps by providing new reporting recommendations. Our hope is to facilitate successful evaluation and replication of research synthesis results. Copyright © 2014 John Wiley & Sons, Ltd.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/jrsm.1127

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Research works printed but not linked: 16

  1. American Psychological Association, 2010, Publication Manual of the American Psychological Association
  2. 10.1177/107554708901000301 · DOI · Paper page
  3. 10.1186/cc3803 · DOI · Paper page
  4. Fink A, 2005, Conducting research literature reviews: From the internet to paper
  5. Galvan JL, 2006, Writing literature reviews
  6. 10.1371/journal.pone.0072467 · DOI · Paper page
  7. Hart C, 1998, Doing a literature review: Releasing the social science research imagination
  8. 10.1016/S0140-6736(99)04149-5 · DOI · Paper page
  9. 10.1371/journal.pmed.1000097 · DOI · Paper page
  10. 10.1371/journal.pmed.0040078 · DOI · Paper page
  11. OldsJ.2014.Replication problem workshop at NSF [Web log post]. Retrieved March 2014 fromhttp://krasnow.blogspot.com/2014/02/replication‐problem‐workshop‐at‐nsf.html
  12. Pan ML, 2008, Preparing literature reviews: Qualitative and quantitative approaches
  13. 10.1126/science.149.3683.510 · DOI · Paper page
  14. 10.1111/1467-9280.00169 · DOI · Paper page
  15. 10.1001/jama.283.15.2008 · DOI · Paper page
  16. W.T. Grant Foundation, 2013, Portfolio of Grants Related to Education

Cited by

Metadata

Authors
Atkinson, K. M., Koenka, A. C., Sanchez, C. E., Moshontz, H., & Cooper, H.
Venue
Research Synthesis Methods
Publisher
Wiley
Published
2014-09-24
Volume
6
Issue
1
Pages
87-95
ISSN
  • 1759-2879 (ISSN-L)
  • 1759-2887
OpenAlex
W1580073794
Cited by
125
References
9
FWCI
3.84
Type
journal article
Language
en
Open access
green
Funders
WT Grant Foundation (181179)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.