The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Literature searches in systematic reviews and meta-analyses: A review, evaluation, and recommendations
Abstract
Abstract The search strategy used in systematic reviews is an important consideration, as the comprehensiveness and representativeness of studies identified influences the quality of conclusions derived from the review. Despite the importance of this step, little in the way of best practice recommendations exist. In an effort to inform future reviews, we report the results of two studies. In Study 1, we outline a series of recommendations for designing comprehensive systematic literature searches. We review the search strategies used in 152 recent systematic reviews published in top applied psychology (including organizational psychology, counseling psychology, and management) journals and evaluate them against these criteria. In Study 2, we build on the findings of our review, carrying out an original meta-analysis, which we use as an opportunity to empirically demonstrate effects of database selection and inclusion of a complementary search protocol on search outcomes. Our results suggest that database selection could have a large effect on conclusions from reviews. Implications and recommendations for carrying out comprehensive literature reviews are described.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement
McGowan, J., Sampson, M., Salzwedel, D. M., Cogo, E., Foerster, V., & Lefebvre, C. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.01.021 · Cited by 5,700
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
The proactive component of organizational behavior: A measure and correlates
Bateman, T. S., & Crant, J. M. (1993) · Journal of Organizational Behavior · doi:10.1002/job.4030140202 · Cited by 3,115
(2015) · An Einstein Encyclopedia · doi:10.1515/9781400873364-029 · Cited by 2,581
Siddaway, A. P., Wood, A. M., & Hedges, L. V. (2019) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-102803 · Cited by 2,550
Appelbaum, M., Cooper, H., Kline, R. B., Mayo-Wilson, E., Nezu, A. M., & Rao, S. M. (2018) · American Psychologist · doi:10.1037/amp0000191 · Cited by 1,449
Rudolph, C. W., Lavigne, K. N., & Zacher, H. (2017) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2016.09.002 · Cited by 837
Cited by
Kumar, S., Sharma, D., Rao, S., Lim, W. M., & Mangla, S. K. (2025) · Annals of Operations Research · doi:10.1007/s10479-021-04410-8 · Cited by 437
Klarin, A. (2024) · International Journal of Consumer Studies · doi:10.1111/ijcs.13031 · Cited by 292
How to conduct a meta-analysis in eight steps: A practical guide
Hansen, C., Steinmetz, H., & Block, J. (2022) · Management Review Quarterly · doi:10.1007/s11301-021-00247-4 · Cited by 218
Leadership Development Strategies in Interprofessional Healthcare Collaboration: A Rapid Review
Bornman, J., & Louw, B. (2023) · Journal of Healthcare Leadership · doi:10.2147/jhl.s405983 · Cited by 71
Batubara, S. O., Tonapa, S. I., Saragih, I. D., Mulyadi, M., & Lee, B.-O. (2022) · Geriatric Nursing · doi:10.1016/j.gerinurse.2021.10.016 · Cited by 19
Metadata
- Authors
- Harari, M. B., Parola, H. R., Hartwell, C. J., & Riegelman, A.
- Venue
- Journal of Vocational Behavior
- Publisher
- Elsevier BV
- Published
- 2020-04
- Volume
- 118
- Pages
- 103377
- ISSN
- 0001-8791 (ISSN-L)
- OpenAlex
- W3000685013
- Cited by
- 291
- References
- 71
- FWCI
- 7.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Literature searches in systematic reviews and meta-analyses: A review, evaluation, and recommendations. https://app.cochat.ai/papers/10.1016/j.jvb.2020.103377
- The paper
- Harari, M. B., Parola, H. R., Hartwell, C. J., & Riegelman, A. (2020). Literature searches in systematic reviews and meta-analyses: A review, evaluation, and recommendations. Journal of Vocational Behavior. https://doi.org/10.1016/j.jvb.2020.103377
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.