Cited by 222Meta-analysis and systematic reviewsPsychology Research and BibliometricsBusiness Strategies and Management Research

Best-Practice Recommendations for Producers, Evaluators, and Users of Methodological Literature Reviews

Open access
Aguinis, Herman, Ramani, Ravi S., Alabduljader, Nawaf·2023·Organizational Research Methods

Abstract

We categorized and content-analyzed 168 methodological literature reviews published in 42 management and applied psychology journals. First, our categorization uncovered that the majority of published reviews (i.e., 85.10%) belong in three categories (i.e., critical, narrative, and descriptive reviews), which points to opportunities and promising directions for additional types of methodological literature reviews in the future (e.g., meta-analytic and umbrella reviews). Second, our content analysis uncovered implicit features of published methodological literature reviews. Based on the results of our content analysis, we created a checklist of actionable recommendations regarding 10 components to include to enhance a methodological literature review’s thoroughness, clarity, and ultimately, usefulness. Third, we describe choices and judgment calls in published reviews and provide detailed explications of exemplars that illustrate how those choices and judgment calls can be made explicit. Overall, our article offers recommendations that are useful for three methodological literature review stakeholder groups: producers (i.e., potential authors), evaluators (i.e., journal editors and reviewers), and users (i.e., substantive researchers interested in learning about a particular methodological issue and individuals tasked with training the next generation of scholars).

Integrity signals

Registry

Crossref · 10.1177/1094428120943281

Cites

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The methodology is grounded in a comprehensive literature review adhering to rigorous criteria and methodological recommendations established in the scientific literature, specifically the criteria proposed by [58] and the practical guidelines for methodological reviews outlined by [59].

    “The methodology employed in this study is grounded in a comprehensive literature review, adhering to rigorous criteria and methodological recommendations established in the scientific literature.To ensure the validity, clarity, and utility of the analysis, the criteria proposed by [58] and the practical guidelines for methodological reviews outlined by [59] were applied.”

No citation lists for this paper

No citation lists for this paper yet — checked again daily.

References 134 · Cited by 222

Authors
Aguinis, H., Ramani, R. S., & Alabduljader, N.
Affiliations
  • George Washington University (US)
  • Morgan State University (US)
  • Kuwait University (KW)
Corresponding author
Aguinis, Herman
Venue
Organizational Research Methods
Published
2020-08-04
Volume
26
Issue
1
Pages
46-76
ISSN
  • 1094-4281 (ISSN-L)
  • 1552-7425
OpenAlex
W3047026630
Cited by
222
References
134
Citations by year
2026: 61 · 2025: 43 · 2024: 45 · 2023: 35 · 2022: 20 · 2021: 14 · 2020: 4
FWCI
11.00
Type
journal article
Language
en
Open access
Locations
Organizational Research Methods (publishedVersion, cc-by-nc)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Business Strategies and Management Research
Keywords
critical review, umbrella review, review checklist, review quality, research methodology training

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review