Utilization and development of systematic reviews in management research: What do we know and where do we go from here?
Open accessThe DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Several years since the introduction of systematic review in management research, our paper takes stock of how the methodology has been used thus far to elicit potential areas for improvement and a future best practice agenda. It was our focus to investigate how synthesis methods have been approached and how implications are spelled out for future research, practice and, where relevant, policy. To address this, we conducted a systematic review of systematic reviews published in management research since the early 2000s (N = 391). We found that whilst scholars adopted similar methodological steps, there was variability in focus, with more attention paid to explaining the systematic review methodology protocol and search strategy utilized, than on detailed analysis and synthesis of the included studies’ findings. These aspects should be addressed more explicitly from the outset as an integral aspect of a systematic review protocol to support more refined application of relevant synthesis methods to develop the field. We conclude with a guide for ‘best practice’, including recommendations and published examples where available and an agenda for future refinement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
How Many Interviews Are Enough?: An Experiment with Data Saturation and Variability
Guest, G., Bunce, A., & Johnson, L. (2006) · Field Methods · doi:10.1177/1525822x05279903 · Cited by 20,808
Tranfield, D., Denyer, D., & Smart, P. (2003) · British Journal of Management · doi:10.1111/1467-8551.00375 · Cited by 15,386
Cochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · cited 3×
“…to reflect on the evidence presented, interpret the research findings and relate the patterns and themes discovered during the literature review (Greenhalgh et al., 2004; Popay et al., 2006) to how such may be applied (Boaz et al., 2006; Pawson, 2002; Rousseau et al., 2008), either for future…”
What is an adequate sample size? Operationalising data saturation for theory-based interview studies
Francis, J. J., Johnston, M., Robertson, C., Glidewell, L., Entwistle, V., Eccles, M. P., & Grimshaw, J. M. (2010) · Psychology & Health · doi:10.1080/08870440903194015 · Cited by 3,429 · cited 2×
“Our decision to review a subset of exactly 40 papers is based on the idea of data saturation: in line with Francis et al. (2010), we initially reviewed a subset of 20 papers in more detail, finding many themes and ideas repeated here.”
The well-built clinical question: A key to evidence-based decisions
(1995) · ACP Journal Club · doi:10.7326/acpjc-1995-123-3-a12 · Cited by 2,931
Empirical studies of agile software development: A systematic review
Dybå, T., & Dingsøyr, T. (2008) · Information and Software Technology · doi:10.1016/j.infsof.2008.01.006 · Cited by 2,668
Green Human Resource Management: A Review and Research Agenda*
Renwick, D. W. S., Redman, T., & Maguire, S. (2013) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2011.00328.x · Cited by 2,586
Greenhalgh, T., & Peacock, R. (2005) · BMJ · doi:10.1136/bmj.38636.593461.68 · Cited by 2,045
The impact of electronic word-of-mouth communication: A literature analysis and integrative model
Cheung, C. M. K., & Thadani, D. R. (2012) · Decision Support Systems · doi:10.1016/j.dss.2012.06.008 · Cited by 2,005
Servant Leadership: A systematic review and call for future research
Eva, N., Robin, M., Sendjaya, S., van Dierendonck, D., & Liden, R. C. (2019) · The Leadership Quarterly · doi:10.1016/j.leaqua.2018.07.004 · Cited by 1,858
Networking and innovation: a systematic review of the evidence
Pittaway, L., Robertson, M., Munir, K., Denyer, D., & Neely, A. (2004) · International Journal of Management Reviews · doi:10.1111/j.1460-8545.2004.00101.x · Cited by 1,747
Linnenluecke, M. K. (2017) · International Journal of Management Reviews · doi:10.1111/ijmr.12076 · Cited by 1,682
Entrepreneurship Education: A Systematic Review of the Evidence
Pittaway, L., & Cope, J. (2007) · International Small Business Journal: Researching Entrepreneurship · doi:10.1177/0266242607080656 · Cited by 1,537
The Science of Evaluation: A Realist Manifesto
Pawson, R. (2013) · doi:10.4135/9781473913820 · Cited by 1,271
The concept of perceived value: a systematic review of the research
Sánchez-Fernández, R., & Iniesta-Bonillo, M. Á. (2007) · Marketing Theory · doi:10.1177/1470593107083165 · Cited by 1,269
Followership theory: A review and research agenda
Uhl-Bien, M., Riggio, R. E., Lowe, K. B., & Carsten, M. K. (2014) · The Leadership Quarterly · doi:10.1016/j.leaqua.2013.11.007 · Cited by 1,213
Clarifying differences between review designs and methods
Gough, D., Thomas, J., & Oliver, S. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-28 · Cited by 1,063
Developing design propositions through research synthesis
Denyer, D., Tranfield, D., & van Aken, J. E. (2008) · Organization Studies · doi:10.1177/0170840607088020 · Cited by 1,057
Baker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., & Robertson, N. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub2 · Cited by 1,003
A systematic literature review of servant leadership theory in organizational contexts
Parris, D. L., & Peachey, J. W. (2013) · Journal of Business Ethics · doi:10.1007/s10551-012-1322-6 · Cited by 957
The influence of management journals in the 1980s and 1990s
Podsakoff, P. M., MacKenzie, S. B., Bachrach, D. G., & Podsakoff, N. P. (2005) · Strategic Management Journal · doi:10.1002/smj.454 · Cited by 912 · cited 1×
“Frequently they cited Podsakoff et al. (2005), who suggested that journal articles can be considered validated knowledge and are likely to have the highest impact on the field.”
At What Level (and in Whom) We Trust: Trust Across Multiple Organizational Levels
Fulmer, C. A., & Gelfand, M. J. (2012) · Journal of Management · doi:10.1177/0149206312439327 · Cited by 886
Newman, A., Obschonka, M., Schwarz, S., Cohen, M., & Nielsen, I. (2019) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2018.05.012 · Cited by 875
Motivation and retention of health workers in developing countries: a systematic review
Willis-Shattuck, M., Bidwell, P., Thomas, S., Wyness, L., Blaauw, D., & Ditlopo, P. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-247 · Cited by 874
Burnout prevention: A review of intervention programs
Awa, W. L., Plaumann, M., & Walter, U. (2010) · Patient Education and Counseling · doi:10.1016/j.pec.2009.04.008 · Cited by 827
Supply chain risk management: a new methodology for a systematic literature review
Colicchia, C., & Strozzi, F. (2012) · Supply Chain Management: An International Journal · doi:10.1108/13598541211246558 · Cited by 750
The cost of work-related stress to society: A systematic review
Hassard, J., Teoh, K. R. H., Visockaite, G., Dewe, P., & Cox, T. (2018) · Journal of Occupational Health Psychology · doi:10.1037/ocp0000069 · Cited by 652
Architectural Leverage: Putting Platforms in Context
Thomas, L. D. W., Autio, E., & Gann, D. M. (2014) · Academy of Management Perspectives · doi:10.5465/amp.2011.0105 · Cited by 639
Reporting and Justifying the Number of Interview Participants in Organization and Workplace Research
Saunders, M. N. K., & Townsend, K. (2016) · British Journal of Management · doi:10.1111/1467-8551.12182 · Cited by 599
When Suits Meet Roots: The Antecedents and Consequences of Community Engagement Strategy
Bowen, F., Newenham-Kahindi, A., & Herremans, I. (2010) · Journal of Business Ethics · doi:10.1007/s10551-009-0360-1 · Cited by 594
De Croon, E., Sluiter, J., Kuijer, P. P., & Frings-Dresen, M. (2005) · Ergonomics · doi:10.1080/00140130512331319409 · Cited by 450
Finney, C., Stergiopoulos, E., Hensel, J., Bonato, S., & Dewa, C. S. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-82 · Cited by 429
Flodgren, G., Eccles, M. P., Shepperd, S., Scott, A., Parmelli, E., & Beyer, F. R. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009255 · Cited by 418
Evidence-based Policy: In Search of a Method
Pawson, R. (2002) · Evaluation · doi:10.1177/1358902002008002512 · Cited by 403 · cited 2×
“Synthesis is particularly useful in areas of contested findings, to present evidence, consolidate knowledge and therefore progress an area of inquiry (Pawson, 2002).”
Identifying categories of service innovation: A review and synthesis of the literature
Snyder, H., Witell, L., Gustafsson, A., Fombelle, P., & Kristensson, P. (2016) · Journal of Business Research · doi:10.1016/j.jbusres.2016.01.009 · Cited by 401
Achieving supply chain resilience: The role of procurement
Roberta Pereira, C., Christopher, M., & Lago Da Silva, A. (2014) · Supply Chain Management: An International Journal · doi:10.1108/scm-09-2013-0346 · Cited by 396
Voegtlin, C., & Greenwood, M. (2016) · Human Resource Management Review · doi:10.1016/j.hrmr.2015.12.003 · Cited by 385
Customer participation and value creation: a systematic review and research implications
Mustak, M., Jaakkola, E., & Halinen, A. (2013) · Managing Service Quality: An International Journal · doi:10.1108/msq-03-2013-0046 · Cited by 302
Determinants of organizational performance: a proposed framework
Almatrooshi, B., Singh, S. K., & Farouk, S. (2016) · International Journal of Productivity and Performance Management · doi:10.1108/ijppm-02-2016-0038 · Cited by 300
The relevance of systematic reviews to educational policy and practice
Davies, P. (2000) · Oxford Review of Education · doi:10.1080/713688543 · Cited by 286
Leadership practices and staff nurses’ intent to stay: a systematic review
COWDEN, T., CUMMINGS, G., & PROFETTO-MCGRATH, J. (2011) · Journal of Nursing Management · doi:10.1111/j.1365-2834.2011.01209.x · Cited by 280
A Systematic Review of Literature on Offshoring of Value Chain Activities
Schmeisser, B. (2013) · Journal of International Management · doi:10.1016/j.intman.2013.03.011 · Cited by 228
Delbufalo, E. (2012) · Supply Chain Management: An International Journal · doi:10.1108/13598541211246549 · Cited by 214
Analysing supply chain integration through a systematic literature review: a normative perspective
Mustafa Kamal, M., & Irani, Z. (2014) · Supply Chain Management: An International Journal · doi:10.1108/scm-12-2013-0491 · Cited by 139
The JOINT model of nurse absenteeism and turnover: A systematic review
Daouk-Öyry, L., Anouze, A.-L., Otaki, F., Dumit, N. Y., & Osman, I. (2014) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2013.06.018 · Cited by 114
Non-Compliant Work Behaviour in Purchasing: An Exploration of Reasons Behind Maverick Buying
Karjalainen, K., Kemppainen, K., & van Raaij, E. M. (2009) · Journal of Business Ethics · doi:10.1007/s10551-008-9768-2 · Cited by 97
Bouwman, R., & Grimmelikhuijsen, S. (2016) · International Journal of Public Sector Management · doi:10.1108/ijpsm-07-2015-0129 · Cited by 95
The winding road of social entrepreneurship definitions: a systematic literature review
Conway Dato-on, M., & Kalakay, J. (2016) · Social Enterprise Journal · doi:10.1108/sej-06-2015-0016 · Cited by 71
Conflicts of interest and spin in reviews of psychological therapies: a systematic review
Lieb, K., Osten-Sacken, J. V. D., Stoffers-Winterling, J., Reiss, N., & Barth, J. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010606 · Cited by 69
Cited by
A century of labour turnover research: A systematic literature review
Bolt, E. E. T., Winterton, J., & Cafferkey, K. (2022) · International Journal of Management Reviews · doi:10.1111/ijmr.12294 · Cited by 116
Lauder, K., McDowall, A., & Tenenbaum, H. R. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.893469 · Cited by 36
Self-citation
Metadata
- Authors
- Rojon, C., Okupe, A., & McDowall, A.
- Venue
- International Journal of Management Reviews
- Publisher
- Wiley
- Published
- 2021-02
- Volume
- 23
- Issue
- 2
- Pages
- 191-223
- ISSN
- 1460-8545 (ISSN-L)
- 1468-2370
- OpenAlex
- W3126898575
- Cited by
- 174
- References
- 50
- FWCI
- 0.98
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.