Best-Practice Recommendations for Producers, Evaluators, and Users of Methodological Literature Reviews
Open accessAbstract
We categorized and content-analyzed 168 methodological literature reviews published in 42 management and applied psychology journals. First, our categorization uncovered that the majority of published reviews (i.e., 85.10%) belong in three categories (i.e., critical, narrative, and descriptive reviews), which points to opportunities and promising directions for additional types of methodological literature reviews in the future (e.g., meta-analytic and umbrella reviews). Second, our content analysis uncovered implicit features of published methodological literature reviews. Based on the results of our content analysis, we created a checklist of actionable recommendations regarding 10 components to include to enhance a methodological literature review’s thoroughness, clarity, and ultimately, usefulness. Third, we describe choices and judgment calls in published reviews and provide detailed explications of exemplars that illustrate how those choices and judgment calls can be made explicit. Overall, our article offers recommendations that are useful for three methodological literature review stakeholder groups: producers (i.e., potential authors), evaluators (i.e., journal editors and reviewers), and users (i.e., substantive researchers interested in learning about a particular methodological issue and individuals tasked with training the next generation of scholars).
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The methodology is grounded in a comprehensive literature review adhering to rigorous criteria and methodological recommendations established in the scientific literature, specifically the criteria proposed by [58] and the practical guidelines for methodological reviews outlined by [59].
“The methodology employed in this study is grounded in a comprehensive literature review, adhering to rigorous criteria and methodological recommendations established in the scientific literature.To ensure the validity, clarity, and utility of the analysis, the criteria proposed by [58] and the practical guidelines for methodological reviews outlined by [59] were applied.”
From Towards Sustainability in Hydraulic Machinery Manufacturing by 3D Printing (2024) · cites this paper as [59]
No citation lists for this paper
No citation lists for this paper yet — checked again daily.
References 134 · Cited by 222
- Authors
- Aguinis, H., Ramani, R. S., & Alabduljader, N.
- Affiliations
- George Washington University (US)
- Morgan State University (US)
- Kuwait University (KW)
- Corresponding author
- Aguinis, Herman
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2020-08-04
- Volume
- 26
- Issue
- 1
- Pages
- 46-76
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W3047026630
- Cited by
- 222
- References
- 134
- Citations by year
- 2026: 61 · 2025: 43 · 2024: 45 · 2023: 35 · 2022: 20 · 2021: 14 · 2020: 4
- FWCI
- 11.00
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Organizational Research Methods (publishedVersion, cc-by-nc)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Business Strategies and Management Research
- Keywords
- critical review, umbrella review, review checklist, review quality, research methodology training
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review