Sample Selection in Systematic Literature Reviews of Management Research
Open accessThe DOI matches its Crossref record; 126 of the 126 references it cites were found in a registry or an index.
Abstract
Systematic review techniques are about to become the “new normal” in reviews of management research. However, there is not yet much advice on how to organize the sample selection process as part of such reviews. This article addresses this void and analyzes this vital part of systematic reviews in more detail. In particular, it offers a critical review of systematic literature reviews published in the Academy of Management Annals and the International Journal of Management Reviews between 2004 and 2018. Based on this methodological literature review, the article presents issues to consider in the most critical choices during the sample selection process. Furthermore, this review identifies several descriptive features such as the mean number of research items included in systematic reviews, the mean number of databases used, and the mean coverage period of such reviews. These numbers may be used as benchmark figures in future reviews.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We searched 13 databases, which is a high number compared to other literature reviews in the field of economics (Hiebl 2021), conducted a backward search, and applied a broad search string, so we adequately covered the technostress literature that deals with leadership.”
From Leadership and technostress: A systematic literature review (2025) · cites this paper as Hiebl 2021
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 4×
“However, because transparency is one of the critical objectives of systematic reviews, it can be assumed that most authors adhering to systematic review guidelines have reported most—if not all—steps taken to arrive at their review samples (cf. Moher et al., 2009).”
BackgroundInfluentialTranfield, D., Denyer, D., & Smart, P. (2003) · British Journal of Management · doi:10.1111/1467-8551.00375 · Cited by 15,386 · cited 26×
“Methodological pieces on systematic reviews mostly advocate quality assessments based on criteria other than journal rankings (e.g., Booth et al., 2016; Jesson et al., 2011; Petticrew & Roberts, 2012; Tranfield et al., 2003; Williams et al., 2020).”
BackgroundMethodResultInfluentialThe Content Analysis Guidebook
Neuendorf, K. A. (2017) · doi:10.4135/9781071802878 · Cited by 9,286 · cited 1×
“This translates into an intercoder agreement5 of 99.6%—as defined by Neuendorf (2017), an acceptable level of agreement.”
BackgroundInfluentialBibliometric Methods in Management and Organization
Zupic, I., & Čater, T. (2015) · Organizational Research Methods · doi:10.1177/1094428114562629 · Cited by 7,495 · cited 1×
“…compared with systematic reviews reported in a more narrative way because the numbers of included articles in bibliometric analyses are usually much higher than those of systematic reviews, and the associated depth of checking inclusion and exclusion criteria is often lower (Zupic & Čater, 2015).”
BackgroundMoher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Practical Assessment, Research & Evaluation, 2000-2001.
Rudner, L. M., & Schafer, W. D. (2001) · Practical assessment, research & evaluation · Cited by 3,905
Writing Integrative Literature Reviews: Guidelines and Examples
Torraco, R. J. (2005) · Human Resource Development Review · doi:10.1177/1534484305278283 · Cited by 3,534 · cited 2×
“A transparent disclosure of a full list of research items included in this sample is necessary because otherwise, readers do not know which research items exactly build the basis for the review study’s results (e.g., Torraco, 2005; Tranfield et al., 2003).”
BackgroundContent Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability
Lombard, M., Snyder-Duch, J., & Bracken, C. C. (2002) · Human Communication Research · doi:10.1111/j.1468-2958.2002.tb00826.x · Cited by 3,068 · cited 1×
“Because of the nominal nature of most of the codes, intercoder agreement is an appropriate measure in the present study (Lombard et al., 2002).”
BackgroundGreen Human Resource Management: A Review and Research Agenda*
Renwick, D. W. S., Redman, T., & Maguire, S. (2013) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2011.00328.x · Cited by 2,586 · cited 1×
“…of Management Annals; IJMR ¼ International Journal of Management Reviews. aThe totals do not add up to 232 but only to 231 because for one article (Renwick et al., 2013), the principal search approach could not be identified due to missing information. considered the title, abstracts, and…”
BackgroundThe SAGE handbook of organizational research methods
Buchanan, D., & Bryman, A. E. (2009) · Cited by 2,555
Gusenbauer, M., & Haddaway, N. R. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1378 · Cited by 2,379 · cited 1×
“…aims at integrating gray literature in a structured way, then Google Scholar would be an attractive complement to other multipublisher databases (Gusenbauer & Haddaway, 2020) because Google Scholar currently covers more nonjournal content than the other multipublisher databases named in Table 4…”
BackgroundThe art of writing literature review: What do we know and what do we need to know?
Paul, J., & Criado, A. R. (2020) · International Business Review · doi:10.1016/j.ibusrev.2020.101717 · Cited by 2,347 · cited 1×
“Email: martin.hiebl@uni-siegen.de In particular, in the field of management research, insights into how researchers can conduct such sample selection and what pitfalls there are to avoid remain scarce (Paul & Criado, 2020; Williams et al., 2020).”
BackgroundWriting narrative literature reviews for peer-reviewed journals: secrets of the trade
Green, B. N., Johnson, C. D., & Adams, A. (2006) · Journal of Chiropractic Medicine · doi:10.1016/s0899-3467(07)60142-6 · Cited by 2,224 · cited 1×
“Some authors from other fields generally suggest a minimum of two databases to alleviate the effects of differing coverage between individual databases (Green et al., 2006).”
BackgroundGreenhalgh, T., & Peacock, R. (2005) · BMJ · doi:10.1136/bmj.38636.593461.68 · Cited by 2,045 · cited 2×
“Others report that researchers only identified 30% of relevant articles through keyword searches in databases while identifying the remaining 70% of articles through “snowballing” techniques, personal knowledge, or personal contacts (Greenhalgh & Peacock, 2005).”
BackgroundJ, M., & A, A. K. (2020) · Skyfox Publishing Group eBooks · doi:10.22573/spg.020.bk/s/026 · Cited by 2,013
Google Scholar, Scopus and the Web of Science: A Longitudinal and Cross-Disciplinary Comparison
Harzing, A.-W., & Alakangas, S. (2016) · Scientometrics · doi:10.1007/s11192-015-1798-9 · Cited by 1,784
Networking and innovation: a systematic review of the evidence
Pittaway, L., Robertson, M., Munir, K., Denyer, D., & Neely, A. (2004) · International Journal of Management Reviews · doi:10.1111/j.1460-8545.2004.00101.x · Cited by 1,747 · cited 6×
“, 2012) Focus on empirical or nonempirical research – When restricting the review to empirical or nonempirical research items, disclosing this decision and the underlying reasons can increase transparency Apply quality assessments – Quality assessments may help to include only research items of sufficient quality in t…”
BackgroundMethodInfluentialLinnenluecke, M. K. (2017) · International Journal of Management Reviews · doi:10.1111/ijmr.12076 · Cited by 1,682 · cited 1×
“In this approach, the identification of one or several seminal research items can be operationalized with the help of high citation rates or other bibliometric methods (e.g., Linnenluecke, 2017).”
BackgroundConducting systematic literature reviews and bibliometric analyses
Linnenluecke, M. K., Marrone, M., & Singh, A. K. (2020) · Australian Journal of Management · doi:10.1177/0312896219877678 · Cited by 1,649 · cited 1×
“A systematic review can therefore be useful as a precursor of most primary research to assess the state of the field before adding to it (Linnenluecke et al., 2020; Rojon et al., 2011).”
BackgroundEntrepreneurship Education: A Systematic Review of the Evidence
Pittaway, L., & Cope, J. (2007) · International Small Business Journal: Researching Entrepreneurship · doi:10.1177/0266242607080656 · Cited by 1,537 · cited 1×
“Such a process also requires significant resources (e.g., access to electronic databases; see Pittaway & Cope, 2007), which makes systematic reviews expensive (Thielen et al., 2016).”
BackgroundUndertaking a literature review: a step-by-step approach
Cronin, P., Ryan, F., & Coughlan, M. (2008) · British Journal of Nursing · doi:10.12968/bjon.2008.17.1.28059 · Cited by 1,426 · cited 3×
“arrive at the presented conclusions (Cronin et al., 2008; Tranfield et al., 2003).”
BackgroundSchilke, O., Hu, S., & Helfat, C. E. (2018) · Academy of Management Annals · doi:10.5465/annals.2016.0014 · Cited by 1,226 · cited 1×
“One such reasoning, referred to as category (f) in Table 1 and as also suggested by Short (2009), is that an earlier review of the same topic exists and that the later review excludes the coverage period of the prior review (e.g., Josefy et al., 2015; Schilke et al., 2018).”
BackgroundMicrocomputer Playfulness: Development of a Measure With Workplace Implications
Webster, J., & Martocchio, J. J. (1992) · MIS Quarterly · doi:10.2307/249576 · Cited by 1,106
Review articles: purpose, process, and structure
Palmatier, R. W., Houston, M. B., & Hulland, J. (2018) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-017-0563-4 · Cited by 1,051 · cited 1×
“Second, an overemphasis on sample selection could risk the mechanical aspects of a systematic review dominating more creative aspects such as synthesizing the literature and developing new insights (cf. Palmatier et al., 2018).”
BackgroundAdams, R. J., Smart, P., & Huff, A. S. (2017) · International Journal of Management Reviews · doi:10.1111/ijmr.12102 · Cited by 995 · cited 17×
“The second desired attribute of systematic reviews is delivering a synthesis of the reviewed research field that is as comprehensive as possible (Adams et al., 2017; Cronin et al., 2008).”
BackgroundInfluentialOn the shoulders of giants: undertaking a structured literature review in accounting
Massaro, M., Dumay, J., & Guthrie, J. (2016) · Accounting, Auditing & Accountability Journal · doi:10.1108/aaaj-01-2015-1939 · Cited by 978 · cited 1×
“There are some recommendations in management research and adjacent fields regarding what databases to choose for such purposes (e.g., Adams et al., 2017; Jones & Gatrell, 2014; Massaro et al., 2016; Webster & Watson, 2002).”
BackgroundRousseau, D. M., Manning, J., & Denyer, D. (2008) · Academy of Management Annals · doi:10.1080/19416520802211651 · Cited by 953
Strategy‐as‐practice: A review and future directions for the field
Jarzabkowski, P., & Paul Spee, A. (2009) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2008.00250.x · Cited by 929
Systematic Review and Evidence Synthesis as a Practice and Scholarship Tool
Briner, R. B., & Denyer, D. (2012) · The Oxford Handbook of Evidence-Based Management · doi:10.1093/oxfordhb/9780199763986.013.0007 · Cited by 835 · cited 5×
“Further important kinds of screening criteria are quality assessments (Briner & Denyer, 2012; Macpherson & Jones, 2010; Sharma & Bansal, 2020; Tranfield et al., 2003).”
BackgroundMethodInfluentialUsing knowledge within small and medium‐sized firms: A systematic review of the evidence
Thorpe, R., Holt, R., Macpherson, A., & Pittaway, L. (2005) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2005.00116.x · Cited by 822 · cited 2×
“…a structured and transparent examination of the content fit of initially identified research items is the A/B/C logic suggested by Pittaway et al. (2004) and applied similarly in several reviewed articles (e.g., Aguinis et al., 2018; Kauppi et al., 2018; Leseure et al., 2004; Thorpe et al., 2005).”
MethodThe Dynamic Capability View in Strategic Management: A Bibliometric Review
Vogel, R., & Güttel, W. H. (2013) · International Journal of Management Reviews · doi:10.1111/ijmr.12000 · Cited by 804 · cited 1×
“In this selection process, I excluded articles geared toward bibliometric analyses of the literature (e.g., Vogel & Guettel, 2013).”
MethodDoing your literature review: traditional and systematic techniques
Cronin, C. (2011) · Evaluation & Research in Education · doi:10.1080/09500790.2011.581509 · Cited by 753
Gaur, A., & Kumar, M. (2018) · Journal of World Business · doi:10.1016/j.jwb.2017.11.003 · Cited by 706
Strategy-as-Practice: Taking Social Practices Seriously
Vaara, E., & Whittington, R. (2012) · Academy of Management Annals · doi:10.5465/19416520.2012.672039 · Cited by 698 · cited 1×
“…cost-efficient approach to systematic reviews because skimming through a predefined list of journals should be less strenuous than analyzing a virtually endless amount of available other journals (Pittaway et al., 2004; Radaelli & Sitton-Kent, 2016; Vaara & Whittington, 2012; Wang & Chugh, 2014).”
BackgroundGusenbauer, M. (2019) · Scientometrics · doi:10.1007/s11192-018-2958-5 · Cited by 687 · cited 2×
“…Google Scholar would be an attractive complement to other multipublisher databases (Gusenbauer & Haddaway, 2020) because Google Scholar currently covers more nonjournal content than the other multipublisher databases named in Table 4 (Bar-Ilan, 2010; Gusenbauer, 2019; Harzing & Alakangas, 2016).”
BackgroundThe Why and How of the Integrative Review
Cronin, M. A., & George, E. (2023) · Organizational Research Methods · doi:10.1177/1094428120935507 · Cited by 677 · cited 1×
“For such, and potentially further, review articles, the development or redirection of theory is of primary interest, which may warrant why they do not focus so much on the rationale for the selection of informing articles (cf. Breslin & Gatrell, 2020; Cronin & George, 2020).”
BackgroundPredatory publishers are corrupting open access
Beall, J. (2012) · Nature · doi:10.1038/489179a · Cited by 658 · cited 1×
“However, the selfdeclaration of journals as being “peer-reviewed” may no longer serve as a useful quality criterion because thousands of so-called predatory journals have emerged (Beall, 2012).”
BackgroundTaking Stock of Temporary Organizational Forms: A Systematic Review and Research Agenda
Bakker, R. M. (2010) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2010.00281.x · Cited by 647
Systematic Literature Reviews in Engineering Education and Other Developing Interdisciplinary Fields
Borrego, M., Foster, M. J., & Froyd, J. E. (2014) · Journal of Engineering Education · doi:10.1002/jee.20038 · Cited by 620 · cited 1×
“That is, although not fully agreeing on the exact ingredients of such a review (e.g., Borrego et al., 2014), authors of methodological pieces on systematic reviews usually agree that a structured and transparent sample selection that enables a comprehensive review of a given field is a cornerstone…”
BackgroundEntrepreneurial Learning: Past Research and Future Challenges
Wang, C. L., & Chugh, H. (2014) · International Journal of Management Reviews · doi:10.1111/ijmr.12007 · Cited by 585 · cited 3×
“Such openness in the identification step is important because only when based on an unbiased and representative review sample can the systematic review generalize about the state of a particular research field or on a specific research question (cf. Wang & Chugh, 2014).”
BackgroundMethodThe Benefits and Challenges of Using Systematic Reviews in International Development Research
Mallett, R., Hagen-Zanker, J., Slater, R., & Duvendack, M. (2012) · Journal of Development Effectiveness · doi:10.1080/19439342.2012.711342 · Cited by 565 · cited 6×
“Thus, clear definitions help to base inclusion or exclusion decisions on objective criteria—in particular, by defining the inclusion and exclusion criteria before the actual search for potentially relevant research items (Denyer & Tranfield, 2009; Mallett et al., 2012; Rojon et al., 2011).”
BackgroundInfluentialThe Strategic Management of Innovation: A Systematic Review and Paths for Future Research
Keupp, M. M., Palmié, M., & Gassmann, O. (2012) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2011.00321.x · Cited by 551 · cited 6×
“Additionally, the length of time since the publishing of a specific research item needs to be incorporated because more recent research items usually have fewer citations than those published long ago (Barley et al., 2018; Keupp et al., 2012).”
BackgroundMethodInfluentialHällgren, M., Rouleau, L., & de Rond, M. (2018) · Academy of Management Annals · doi:10.5465/annals.2016.0017 · Cited by 520 · cited 1×
“For instance, Hällgren et al. (2018) aimed to review the contributions from extreme context research to MOS.”
BackgroundWhat You See Is What You Get? Enhancing Methodological Transparency in Management Research
Aguinis, H., Ramani, R. S., & Alabduljader, N. (2018) · Academy of Management Annals · doi:10.5465/annals.2016.0011 · Cited by 463 · cited 2×
“Although the three articles focusing on nonempirical research items (Adams et al., 2017; Aguinis et al., 2018; Symon et al., 2018) disclosed the reasons for focusing on nonempirical research in a very transparent fashion, the articles only including empirical research have mostly not disclosed such reasons but only st…”
BackgroundJournal list fetishism and the perversion of scholarship: reactivity and the ABS list
Willmott, H. (2011) · Organization · doi:10.1177/1350508411403532 · Cited by 453 · cited 1×
“Although journal rankings can and probably should be discussed critically (e.g., Rowlinson et al., 2015; Tourish & Willmott, 2015; Willmott, 2011), these rankings show that AMA and IJMR are regarded highly in the international scholarly community.”
BackgroundChecking reference lists to find additional studies for systematic reviews
Horsley, T., Dingwall, O., & Sampson, M. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000026.pub2 · Cited by 443 · cited 2×
“…many such reviews disclose keywords, search engines, and search strings in great detail, the reporting of snowballing techniques is often opaque (Horsley et al., 2011) and free from giving details as to exactly which initially found research items have been referenced or cited by the research…”
BackgroundSystematic Approaches to a Successful Literature Review
Louise, D. (2013) · Nurse Education in Practice · doi:10.1016/j.nepr.2012.12.007 · Cited by 443 · cited 10×
“Methodological pieces on systematic reviews mostly advocate quality assessments based on criteria other than journal rankings (e.g., Booth et al., 2016; Jesson et al., 2011; Petticrew & Roberts, 2012; Tranfield et al., 2003; Williams et al., 2020).”
BackgroundResultInfluentialEmployer Branding: A Brand Equity‐based Literature Review and Research Agenda
Theurer, C. P., Tumasjan, A., Welpe, I. M., & Lievens, F. (2018) · International Journal of Management Reviews · doi:10.1111/ijmr.12121 · Cited by 397 · cited 1×
“Accordingly, more recent entries among the 133 database-driven reviews (e.g., Stumbitz et al., 2018; Theurer et al., 2018) made use of online supplements offering more detailed information on the database search process.”
BackgroundValidation in interpretive management accounting research
Lukka, K., & Modell, S. (2010) · Accounting, Organizations and Society · doi:10.1016/j.aos.2009.10.004 · Cited by 396 · cited 1×
“So the sum of codes represents a mix of deductively and inductively generated categories, which renders this study’s analytical approach abductive (Lukka & Modell, 2010).”
BackgroundConsumer Behaviour and Order Fulfilment in Online Retailing: A Systematic Review
Nguyen, D. H., de Leeuw, S., & Dullaert, W. E. H. (2018) · International Journal of Management Reviews · doi:10.1111/ijmr.12129 · Cited by 385 · cited 2×
“The other 21 articles explicitly mentioning quality assessments either left their operationalization of quality unexplained or referred to other forms of quality assessment—some of them in a very structured and transparent way (e.g., Nguyen et al., 2018; Pittaway et al., 2004).”
BackgroundSavino, T., Messeni Petruzzelli, A., & Albino, V. (2017) · International Journal of Management Reviews · doi:10.1111/ijmr.12081 · Cited by 367 · cited 2×
“…in management research refer to prior review articles for certain methodological choices in sample selection (e.g., Mueller-Seitz, 2012; Pillai et al., 2017; Savino et al., 2017) but, due to unavailability, cannot refer to advice based on more evidence than just single applications of such choices.”
BackgroundThe Art of Writing a Review Article
Short, J. (2009) · Journal of Management · doi:10.1177/0149206309337489 · Cited by 334 · cited 4×
“One such reasoning, referred to as category (f) in Table 1 and as also suggested by Short (2009), is that an earlier review of the same topic exists and that the later review excludes the coverage period of the prior review (e.g., Josefy et al., 2015; Schilke et al., 2018).”
BackgroundMethodInfluentialSystematic review adherence to methodological or reporting quality
Pussegoda, K., Turner, L., Garritty, C., Mayhew, A., Skidmore, B., Stevens, A., Boutron, I., Sarkis-Onofre, R., Bjerre, L. M., Hróbjartsson, A., et al. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0527-2 · Cited by 322
Hulland, J., & Houston, M. B. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-020-00721-7 · Cited by 311 · cited 2×
“…research question(s) and inclusion and exclusion criteria are subject to discretion, these need to be clear, and it must be transparent why they are in place and how conforming to them was achieved (Booth et al., 2016; Hulland & Houston, 2020; Jesson et al., 2011; Petticrew & Roberts, 2012).”
BackgroundWilliams, R. I., Clark, L. A., Clark, W. R., & Raffo, D. M. (2021) · European Management Journal · doi:10.1016/j.emj.2020.09.007 · Cited by 300 · cited 7×
“Methodological pieces on systematic reviews mostly advocate quality assessments based on criteria other than journal rankings (e.g., Booth et al., 2016; Jesson et al., 2011; Petticrew & Roberts, 2012; Tranfield et al., 2003; Williams et al., 2020).”
BackgroundInfluentialTime in Strategic Change Research
Kunisch, S., Bartunek, J. M., Mueller, J., & Huy, Q. N. (2017) · Academy of Management Annals · doi:10.5465/annals.2015.0133 · Cited by 294 · cited 1×
“For other excluded articles, I know from private communication that they were based on a highly structured review process (e.g., Kunisch et al., 2017).”
BackgroundA Review of Theory in Family Business Research: The Implications for Corporate Governance
Siebels, J., & zu Knyphausen‐Aufseß, D. (2012) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2011.00317.x · Cited by 283
Adoption and Outcomes of ISO 14001: A Systematic Review
Boiral, O., Guillaumie, L., Heras‐Saizarbitoria, I., & Tayo Tene, C. V. (2018) · International Journal of Management Reviews · doi:10.1111/ijmr.12139 · Cited by 279 · cited 1×
“For instance, Boiral et al. (2018) limited their review on the adoption and outcomes of ISO 14001 to the years between 1996 and 2015 because 1996 “was the year in which ISO 14001 was launched” (p. 414).”
BackgroundBiodiversity data should be published, cited, and peer reviewed
Costello, M. J., Michener, W. K., Gahegan, M., Zhang, Z.-Q., & Bourne, P. E. (2013) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2013.05.002 · Cited by 271 · cited 1×
“Such details require space, which has long been considered scarce in peerreviewed journals but is now less of an issue thanks to online appendices, which are offered by an increasing number of journals (Aguinis et al., 2018; Costello et al., 2013; Mallett et al., 2012).”
BackgroundTheorizing Through Literature Reviews: The Miner-Prospector Continuum
Breslin, D., & Gatrell, C. (2023) · Organizational Research Methods · doi:10.1177/1094428120943288 · Cited by 269 · cited 1×
“For such, and potentially further, review articles, the development or redirection of theory is of primary interest, which may warrant why they do not focus so much on the rationale for the selection of informing articles (cf. Breslin & Gatrell, 2020; Cronin & George, 2020).”
BackgroundCitations to the “Introduction to informetrics” indexed by WOS, Scopus and Google Scholar
Bar-Ilan, J. (2010) · Scientometrics · doi:10.1007/s11192-010-0185-9 · Cited by 264 · cited 3×
“…Google Scholar would be an attractive complement to other multipublisher databases (Gusenbauer & Haddaway, 2020) because Google Scholar currently covers more nonjournal content than the other multipublisher databases named in Table 4 (Bar-Ilan, 2010; Gusenbauer, 2019; Harzing & Alakangas, 2016).”
BackgroundBarley, W. C., Treem, J. W., & Kuhn, T. (2018) · Academy of Management Annals · doi:10.5465/annals.2016.0041 · Cited by 237 · cited 7×
“For instance, Barley et al. (2018) selected the 10 most cited journal articles on knowledge management for each year between 1996 and 2015.”
BackgroundInfluentialExpanding the Domain of Festival Research: A Review and Research Agenda
Wilson, J., Arshed, N., Shaw, E., & Pret, T. (2016) · International Journal of Management Reviews · doi:10.1111/ijmr.12093 · Cited by 227 · cited 1×
“For such articles, a skim or complete reading of the full text will be necessary (e.g., Iqbal et al., 2015; Wilson et al., 2017).”
BackgroundThe many moods of inter‐organizational imitation: A critical review
Ordanini, A., Rubera, G., & DeFillippi, R. (2008) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2008.00233.x · Cited by 225 · cited 1×
“…time-saving strategy to narrow down such large numbers of research items is first to skim only through research items’ titles for content fit before moving onto analyzing abstracts and keywords where a content fit could not yet be assessed (e.g., Ordanini et al., 2008; see also Rojon et al., 2011).”
BackgroundAguinis, H., Ramani, R. S., & Alabduljader, N. (2023) · Organizational Research Methods · doi:10.1177/1094428120943281 · Cited by 222 · cited 2×
“Although a transparent reporting of the research methods applied should probably be a quality criterion for every management research article (Aguinis et al., 2018, 2020), many earlier and traditional review articles in management research have received particular criticism due to their…”
BackgroundMethodEditorial: The Future of Writing and Reviewing for IJMR
Jones, O., & Gatrell, C. (2014) · International Journal of Management Reviews · doi:10.1111/ijmr.12038 · Cited by 217 · cited 4×
“Considering such high esteem and the two journals’ high standards for rigor and quality (Elsbach & van Knippenberg, 2018; Jones & Gatrell, 2014), it can be assumed that a review article published in one of these two journals can be considered high quality.”
BackgroundInfluentialWhat's the Evidence on Evidence-Based Management?
Reay, T., Berta, W., & Kohn, M. K. (2009) · Academy of Management Perspectives · doi:10.5465/amp.2009.45590137 · Cited by 217 · cited 2×
“This multilevel quality assessment and further points- and level-based examples in the management literature (e.g., Reay et al., 2009; Wong et al., 2012) exemplify the availability of approaches beyond unexplained quality assessments and journal rankings.”
BackgroundTowards a theory of supply chain alignment enablers: a systematic literature review
Wong, C., Skipworth, H., Godsell, J., & Achimugu, N. (2012) · Supply Chain Management: An International Journal · doi:10.1108/13598541211246567 · Cited by 213
Cardinal, L. B., Kreutzer, M., & Miller, C. C. (2017) · Academy of Management Annals · doi:10.5465/annals.2014.0086 · Cited by 210 · cited 2×
“Several of the analyzed review articles report that the research focus and views on key constructs within a topic field have shifted or changed over time (e.g., Cardinal et al., 2017; Korica et al., 2017; Saggese et al., 2016).”
BackgroundLeadership in Interorganizational Networks: A Literature Review and Suggestions for Future Research
Müller‐Seitz, G. (2012) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2011.00324.x · Cited by 209 · cited 1×
“…is that many review articles in management research refer to prior review articles for certain methodological choices in sample selection (e.g., Mueller-Seitz, 2012; Pillai et al., 2017; Savino et al., 2017) but, due to unavailability, cannot refer to advice based on more evidence than just…”
BackgroundEffectiveness of Performance Appraisal: An Integrated Framework
Iqbal, M. Z., Akbar, S., & Budhwar, P. S. (2014) · International Journal of Management Reviews · doi:10.1111/ijmr.12050 · Cited by 200 · cited 1×
“For such articles, a skim or complete reading of the full text will be necessary (e.g., Iqbal et al., 2015; Wilson et al., 2017).”
BackgroundStrategic Renewal: Past Research, Theoretical Tensions and Future Challenges
Schmitt, A., Raisch, S., & Volberda, H. W. (2018) · International Journal of Management Reviews · doi:10.1111/ijmr.12117 · Cited by 193 · cited 1×
“Some articles required the respective articles to be published in journals awarded a two-year impact factor by Clarivate7 of at least 1.0 (e.g., Schmitt et al., 2018), others required a five-year impact factor of at least 1.5 (Perri & Peruffo, 2016), whereas still others only considered the top 30…”
BackgroundInfluentialLiminality in Management and Organization Studies: Process, Position and Place
Söderlund, J., & Borg, E. (2018) · International Journal of Management Reviews · doi:10.1111/ijmr.12168 · Cited by 193 · cited 1×
“…was the criterion that the included research items had to be published in “peer-reviewed journals” (without reference to any journal ranking), which should assure some minimum quality of the selected items due to the peer-review process (e.g., Radaelli & Sitton-Kent, 2016; Soederlund & Borg, 2018).”
BackgroundThe Negative Effects of Social Capital in Organizations: A Review and Extension
Pillai, K. G., Hodgkinson, G. P., Kalyanaram, G., & Nair, S. R. (2017) · International Journal of Management Reviews · doi:10.1111/ijmr.12085 · Cited by 185 · cited 2×
“A sign that such insights would be desirable is that many review articles in management research refer to prior review articles for certain methodological choices in sample selection (e.g., Mueller-Seitz, 2012; Pillai et al., 2017; Savino et al., 2017) but, due to unavailability, cannot refer to advice based on more e…”
BackgroundXiao, S. H., & Nicholson, M. (2013) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2012.00345.x · Cited by 184 · cited 1×
“For instance, for topics at the intersection of management and psychology, the review articles I analyzed often drew on PsycINFO in addition to other multipublisher databases (e.g., Anseel et al., 2007; Atewologun et al., 2017; Xiao & Nicholson, 2013).”
Radaelli, G., & Sitton‐Kent, L. (2016) · International Journal of Management Reviews · doi:10.1111/ijmr.12094 · Cited by 183 · cited 2×
“…cost-efficient approach to systematic reviews because skimming through a predefined list of journals should be less strenuous than analyzing a virtually endless amount of available other journals (Pittaway et al., 2004; Radaelli & Sitton-Kent, 2016; Vaara & Whittington, 2012; Wang & Chugh, 2014).”
BackgroundAll Things Great and Small: Organizational Size, Boundaries of the Firm, and a Changing Environment
Josefy, M., Kuban, S., Ireland, R. D., & Hitt, M. A. (2015) · Academy of Management Annals · doi:10.5465/19416520.2015.1027086 · Cited by 181 · cited 1×
“One such reasoning, referred to as category (f) in Table 1 and as also suggested by Short (2009), is that an earlier review of the same topic exists and that the later review excludes the coverage period of the prior review (e.g., Josefy et al., 2015; Schilke et al., 2018).”
BackgroundIn Defiance of Folly: Journal rankings, mindless measures and the ABS Guide
Tourish, D., & Willmott, H. (2015) · Critical Perspectives on Accounting · doi:10.1016/j.cpa.2014.02.004 · Cited by 175 · cited 1×
“Although journal rankings can and probably should be discussed critically (e.g., Rowlinson et al., 2015; Tourish & Willmott, 2015; Willmott, 2011), these rankings show that AMA and IJMR are regarded highly in the international scholarly community.”
BackgroundWood, M. S., & McKelvie, A. (2015) · International Journal of Management Reviews · doi:10.1111/ijmr.12053 · Cited by 168 · cited 1×
“Searching such publisher-specific databases, too, may nevertheless make sense because they also include in-press articles, which are usually not yet indexed by multipublisher databases such as EBSCO (cf. Wood & McKelvie, 2015).”
BackgroundEndres, S., & Weibler, J. (2016) · International Journal of Management Reviews · doi:10.1111/ijmr.12095 · Cited by 165 · cited 1×
“Thirty-two articles complemented one of the four principal search approaches with so-called manual searches or an inclusion of articles that were personally known to the authors or their colleagues (e.g., Endres & Weibler, 2017; Saggese et al., 2016).”
BackgroundScience for sale: the rise of predatory journals
Bartholomew, R. E. (2014) · Journal of the Royal Society of Medicine · doi:10.1177/0141076814548526 · Cited by 164 · cited 1×
“These journals ostensibly offer a standard peer-review process, yet in reality, they publish anything based on a “pay for publication” approach (cf. Bartholomew, 2014; Bell et al., 2019).”
BackgroundThe Challenge of Integration: A Review of the M&A Integration Literature
Steigenberger, N. (2017) · International Journal of Management Reviews · doi:10.1111/ijmr.12099 · Cited by 163 · cited 1×
“An exemption to this observation is the article by Steigenberger (2017).”
Teamworking and organizational performance: A review of survey‐based research
Delarue, A., Van Hootegem, G., Procter, S., & Burridge, M. (2008) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2007.00227.x · Cited by 162 · cited 2×
“, with an asterisk), which was also used by somewhat older articles (e.g., Bakker, 2010; Delarue et al., 2008).”
MethodWilliams, R. I., Pieper, T. M., Kellermanns, F. W., & Astrachan, J. H. (2018) · International Journal of Management Reviews · doi:10.1111/ijmr.12167 · Cited by 160 · cited 3×
“…was only applied in five of the reviewed articles (Hopkinson & Blois, 2014; Jarzabkowski & Spee, 2009; Peltoniemi, 2011; Waller et al., 2016; Williams et al., 2018), but its main idea is clearly different from the previously discussed approaches: First, identify one or several research…”
BackgroundNiesten, E., & Jolink, A. (2015) · International Journal of Management Reviews · doi:10.1111/ijmr.12037 · Cited by 158 · cited 1×
“…snowballing techniques is that they may also identify research items that use different terms for capturing the phenomenon in question rather than those entered in the keyword search (e.g., Niesten & Jolink, 2015; O’Mahoney, 2016) or that have not been published in the predefined set of journals.”
BackgroundAdoption of promising practices: a systematic review of the evidence
Leseure, M. J., Bauer, J., Birdi, K., Neely, A., & Denyer, D. (2004) · International Journal of Management Reviews · doi:10.1111/j.1460-8545.2004.00102.x · Cited by 158 · cited 2×
“…a structured and transparent examination of the content fit of initially identified research items is the A/B/C logic suggested by Pittaway et al. (2004) and applied similarly in several reviewed articles (e.g., Aguinis et al., 2018; Kauppi et al., 2018; Leseure et al., 2004; Thorpe et al., 2005).”
MethodRedirecting Research Efforts on the Diversification–Performance Linkage: The Search for Synergy
Ahuja, G., & Novelli, E. (2017) · Academy of Management Annals · doi:10.5465/annals.2014.0079 · Cited by 155 · cited 2×
“Several reviewed articles tried to circumvent this limitation by not drawing solely on MOS journals but also on top journals from other fields relevant to their research question(s) (e.g., Ahuja & Novelli, 2017; Jang et al., 2018).”
BackgroundKnowledge Spillovers from FDI : A Critical Review from the International Business Perspective
Perri, A., & Peruffo, E. (2014) · International Journal of Management Reviews · doi:10.1111/ijmr.12054 · Cited by 154 · cited 1×
“…a two-year impact factor by Clarivate7 of at least 1.0 (e.g., Schmitt et al., 2018), others required a five-year impact factor of at least 1.5 (Perri & Peruffo, 2016), whereas still others only considered the top 30 journals by five-year impact factors in the respective Journal Citation…”
BackgroundInfluentialAnseel, F., Lievens, F., & Levy, P. E. (2007) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2007.00210.x · Cited by 150 · cited 1×
“For instance, for topics at the intersection of management and psychology, the review articles I analyzed often drew on PsycINFO in addition to other multipublisher databases (e.g., Anseel et al., 2007; Atewologun et al., 2017; Xiao & Nicholson, 2013).”
Revealed or Concealed? Transparency of Procedures, Decisions, and Judgment Calls in Meta-Analyses
Aytug, Z. G., Rothstein, H. R., Zhou, W., & Kern, M. C. (2012) · Organizational Research Methods · doi:10.1177/1094428111403495 · Cited by 147
Reviewing Industry Life-cycle Theory: Avenues for Future Research
Peltoniemi, M. (2011) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2010.00295.x · Cited by 146 · cited 6×
“The seminal-work-driven approach was only applied in five of the reviewed articles (Hopkinson & Blois, 2014; Jarzabkowski & Spee, 2009; Peltoniemi, 2011; Waller et al., 2016; Williams et al., 2018), but its main idea is clearly different from the previously discussed approaches: First, identify one or several research…”
BackgroundMethodInfluentialConceptualizing Emergent States: A Strategy to Advance the Study of Group Dynamics
Waller, M. J., Okhuysen, G. A., & Saghafian, M. (2016) · Academy of Management Annals · doi:10.5465/19416520.2016.1120958 · Cited by 143 · cited 3×
“Two review studies (Peltoniemi, 2011; Williams et al., 2018) gave a rather detailed account of how they identified the seminal works, but the other three (Hopkinson & Blois, 2014; Jarzabkowski & Spee, 2009; Waller et al., 2016) only posited that the work they focused on was seminal.”
BackgroundIndividual‐level Foci of Identification at Work: A Systematic Review of the Literature
Atewologun, D., Kutzer, R., Doldor, E., Anderson, D., & Sealy, R. H. V. (2017) · International Journal of Management Reviews · doi:10.1111/ijmr.12148 · Cited by 136 · cited 1×
“For instance, for topics at the intersection of management and psychology, the review articles I analyzed often drew on PsycINFO in addition to other multipublisher databases (e.g., Anseel et al., 2007; Atewologun et al., 2017; Xiao & Nicholson, 2013).”
Family Business Performance from a Governance Perspective: A Review of Empirical Research
Pindado, J., & Requejo, I. (2015) · International Journal of Management Reviews · doi:10.1111/ijmr.12040 · Cited by 133 · cited 2×
“…of at least 1.0 (e.g., Schmitt et al., 2018), others required a five-year impact factor of at least 1.5 (Perri & Peruffo, 2016), whereas still others only considered the top 30 journals by five-year impact factors in the respective Journal Citation Reports categories (Pindado & Requejo, 2015).”
BackgroundMethodInfluentialHow Do I Know Who You Think You Are? A Review of Research Methods on Organizational Identity
Ravasi, D., & Canato, A. (2013) · International Journal of Management Reviews · doi:10.1111/ijmr.12008 · Cited by 133 · cited 1×
“…is that if a well-regarded journal publishes an article, then the article is presumably built on sufficiently rigorous research methods (e.g., Ahuja & Novelli, 2017; Ravasi & Canato, 2013; Rawhouser et al., 2017), which can clear the quality assessment as required by Tranfield et al. (2003).”
BackgroundThielen, F., Van Mastrigt, G., Burgers, L., Bramer, W., Majoie, H., Evers, S., & Kleijnen, J. (2016) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1080/14737167.2016.1246962 · Cited by 132 · cited 4×
“, access to electronic databases; see Pittaway & Cope, 2007), which makes systematic reviews expensive (Thielen et al., 2016).”
BackgroundMethodInfluentialEvaluative Practices in Qualitative Management Research: A Critical Review
Symon, G., Cassell, C. M., & Johnson, P. (2016) · International Journal of Management Reviews · doi:10.1111/ijmr.12120 · Cited by 125 · cited 2×
“Although the three articles focusing on nonempirical research items (Adams et al., 2017; Aguinis et al., 2018; Symon et al., 2018) disclosed the reasons for focusing on nonempirical research in a very transparent fashion, the articles only including empirical research have mostly not disclosed such…”
BackgroundRevisiting Paradigm(s) in Management Research: A Rhetorical Analysis of the Paradigm Wars
Shepherd, C., & Challenger, R. (2012) · International Journal of Management Reviews · doi:10.1111/ijmr.12004 · Cited by 116 · cited 1×
“…while upholding rigorous standards—for instance, by including gray literature only when a certain number of the relevant articles found in the predefined journals (e.g., five) cited a specific research item from the gray literature (for a similar approach, see Shepherd & Challenger, 2013).”
BackgroundSourcing from Africa: A Systematic Review and a Research Agenda
Kauppi, K., Salmi, A., & You, W. (2017) · International Journal of Management Reviews · doi:10.1111/ijmr.12158 · Cited by 116 · cited 3×
“…a structured and transparent examination of the content fit of initially identified research items is the A/B/C logic suggested by Pittaway et al. (2004) and applied similarly in several reviewed articles (e.g., Aguinis et al., 2018; Kauppi et al., 2018; Leseure et al., 2004; Thorpe et al., 2005).”
MethodEditorial: Strategies for the Development of International Journal of Management Reviews
Macpherson, A., & Jones, O. (2010) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2010.00282.x · Cited by 112 · cited 4×
“Some refer to this strategy as “fit for purpose” (Macpherson & Jones, 2010).”
InfluentialKunisch, S., Menz, M., Bartunek, J. M., Cardinal, L. B., & Denyer, D. (2018) · Organizational Research Methods · doi:10.1177/1094428118770750 · Cited by 112 · cited 1×
“…objectives, I have critically reviewed systematic reviews published in the two most prominent outlets exclusively devoted to literature reviews in management research (cf. Kunisch et al., 2018), the Academy of Management Annals (AMA2) and the International Journal of Management Reviews (IJMR).”
BackgroundPluralism in Organizations: Learning from Unconventional Forms of Organizations
Bres, L. P., Raufflet, E., & Boghossian, J. (2017) · International Journal of Management Reviews · doi:10.1111/ijmr.12136 · Cited by 111 · cited 1×
“The mean number of research items included in the review sample for category (a) amounts to 109 and may thus be regarded as sufficiently “manageable” (cf. Bres et al., 2018) because it is below the overall mean number of included articles, which amounts to 139.”
BackgroundLegitimizing Diverse Uses for Qualitative Research: A Rhetorical Analysis of Two Management Journals
Welch, C., Plakoyiannaki, E., Piekkari, R., & Paavilainen‐Mäntymäki, E. (2012) · International Journal of Management Reviews · doi:10.1111/ijmr.12001 · Cited by 105 · cited 1×
“So, given the usual restrictions of research time and other resources, many review authors may need to make trade-offs when defining their review’s research question and inclusion/exclusion criteria (cf. Adams et al., 2017; Welch et al., 2013).”
BackgroundMore than a Phase: Form and Features of a General Theory of Negotiation
Jang, D., Elfenbein, H. A., & Bottom, W. P. (2017) · Academy of Management Annals · doi:10.5465/annals.2016.0053 · Cited by 97 · cited 1×
“Several reviewed articles tried to circumvent this limitation by not drawing solely on MOS journals but also on top journals from other fields relevant to their research question(s) (e.g., Ahuja & Novelli, 2017; Jang et al., 2018).”
BackgroundIn Search of ‘Managerial Work’: Past, Present and Future of an Analytical Category
Korica, M., Nicolini, D., & Johnson, B. (2015) · International Journal of Management Reviews · doi:10.1111/ijmr.12090 · Cited by 95 · cited 1×
“Several of the analyzed review articles report that the research focus and views on key constructs within a topic field have shifted or changed over time (e.g., Cardinal et al., 2017; Korica et al., 2017; Saggese et al., 2016).”
BackgroundStrategies and Tools for Entrepreneurial Resource Access: A Cross‐disciplinary Review and Typology
Rawhouser, H. N., Villanueva, J., & Newbert, S. L. (2016) · International Journal of Management Reviews · doi:10.1111/ijmr.12105 · Cited by 95 · cited 2×
“…is that if a well-regarded journal publishes an article, then the article is presumably built on sufficiently rigorous research methods (e.g., Ahuja & Novelli, 2017; Ravasi & Canato, 2013; Rawhouser et al., 2017), which can clear the quality assessment as required by Tranfield et al. (2003).”
BackgroundMethodKnights, D., & Clarke, C. A. (2017) · International Journal of Management Reviews · doi:10.1111/ijmr.12147 · Cited by 92 · cited 1×
“When skimming through the AMA and IJMR articles, I also found several reviews leaning toward theory development (e.g., Knights & Clarke, 2017) instead of presenting a synthesis of prior research.”
BackgroundScoring and classifying examinees using measurement decision theory
Rudner, L. M. (2020) · doi:10.7275/vksg-rh07 · Cited by 88
Meaning at the Source: The Dynamics of Field Formation in Institutional Research
Leibel, E., Hallett, T., & Bechky, B. A. (2017) · Academy of Management Annals · doi:10.5465/annals.2016.0035 · Cited by 87
Power‐base Research in Marketing Channels: A Narrative Review
Hopkinson, G. C., & Blois, K. J. (2013) · International Journal of Management Reviews · doi:10.1111/ijmr.12013 · Cited by 80 · cited 6×
“For instance, Hopkinson and Blois (2014) not only considered journal content from the base discipline of their seminal work (i.e., marketing) but also citations from other disciplines.”
BackgroundMethodInfluentialMaternity Management in SMEs: A Transdisciplinary Review and Research Agenda
Stumbitz, B., Lewis, S., & Rouse, J. (2018) · International Journal of Management Reviews · doi:10.1111/ijmr.12143 · Cited by 76 · cited 1×
“Accordingly, more recent entries among the 133 database-driven reviews (e.g., Stumbitz et al., 2018; Theurer et al., 2018) made use of online supplements offering more detailed information on the database search process.”
BackgroundPartnering Up: Including Managers as Research Partners in Systematic Reviews
Sharma, G., & Bansal, P. (2020) · Organizational Research Methods · doi:10.1177/1094428120965706 · Cited by 73 · cited 4×
“When identifying potentially relevant research items, a structured search should not only cover the research already known to the review authors but also be free from preexisting beliefs (e.g., Briner & Denyer, 2012; Mallett et al., 2012; Sharma & Bansal, 2020).”
BackgroundInfluentialSaggese, S., Sarto, F., & Cuccurullo, C. (2016) · International Journal of Management Reviews · doi:10.1111/ijmr.12072 · Cited by 68 · cited 2×
“Thirty-two articles complemented one of the four principal search approaches with so-called manual searches or an inclusion of articles that were personally known to the authors or their colleagues (e.g., Endres & Weibler, 2017; Saggese et al., 2016).”
BackgroundShort, J. C., Sharma, P., Lumpkin, G. T., & Pearson, A. W. (2016) · Family Business Review · doi:10.1177/0894486515622294 · Cited by 67 · cited 1×
“For the field of family business research, Short et al. (2016) provided even more specific guidelines and mentioned 50 articles as the minimum number of research items to be covered in a review article.”
BackgroundExplicit and Implicit Subject Bias in theABS Journal Quality Guide
Hoepner, A. G. F., & Unerman, J. (2012) · Accounting Education · doi:10.1080/09639284.2011.651291 · Cited by 65 · cited 1×
“In particular, choosing ranking criteria geared toward higher ranked journals may lead to a focus on general interest journals, which tend to be ranked above specialist journals (e.g., Hoepner & Unerman, 2012; McKinnon, 2017).”
BackgroundDatabase selection in systematic reviews: an insight through clinical neurology
Vassar, M., Yerokhin, V., Sinnett, P. M., Weiher, M., Muckelrath, H., Carr, B., Varney, L., & Cook, G. (2017) · Health Information & Libraries Journal · doi:10.1111/hir.12176 · Cited by 58 · cited 5×
“I coded each included review article along 50 dimensions (cf. Aytug et al., 2010; Vassar et al., 2017), which resulted in a total of 11,600 codings.”
BackgroundMethodInfluentialThe New CEO and the Post‐succession Process: An Integration of Past Research and Future Directions
Ma, S., Seidl, D. N., & Guérard, S. (2014) · International Journal of Management Reviews · doi:10.1111/ijmr.12048 · Cited by 55 · cited 1×
“Most of the analyzed reviews that used the Web of Science did not disclose such restrictions within this database (but see exceptions such as Ma et al., 2015; Pindado & Requejo, 2015).”
MethodDoes J apan Still Matter? Past Tendencies and Future Opportunities in the Study of J apanese Firms
Endo, T., Delbridge, R., & Morris, J. (2014) · International Journal of Management Reviews · doi:10.1111/ijmr.12039 · Cited by 54 · cited 6×
“Methods to tackle this issue include comparing relevant research items only to others that have been published in the same decade (Endo et al., 2015) or dividing total citations by the years since the publication of the respective research item.”
BackgroundInfluentialRojon, C., McDowall, A., & Saunders, M. N. K. (2011) · Journal of Personnel Psychology · doi:10.1027/1866-5888/a000041 · Cited by 51 · cited 9×
“First, a systematic review is not always appropriate when performing a literature review (Petticrew & Roberts, 2012; Rojon et al., 2011).”
BackgroundMethodInfluentialAccounting for research quality: Research audits and the journal rankings debate
Rowlinson, M., Harvey, C. E., Kelly, A., Morris, H., & Todeva, E. (2013) · Critical Perspectives on Accounting · doi:10.1016/j.cpa.2013.05.012 · Cited by 51 · cited 1×
“Although journal rankings can and probably should be discussed critically (e.g., Rowlinson et al., 2015; Tourish & Willmott, 2015; Willmott, 2011), these rankings show that AMA and IJMR are regarded highly in the international scholarly community.”
BackgroundThe Academy of Management Annals: Looking Back, Looking Forward
Elsbach, K. D., & van Knippenberg, D. (2018) · Academy of Management Annals · doi:10.5465/annals.2016.0167 · Cited by 48
Connecting Knowledge to Management: The Case of Academic Research
Sousa, C. A. A., & Hendriks, P. (2008) · Organization · doi:10.1177/1350508408091004 · Cited by 44 · cited 1×
“…remain a “major challenge” (p. 216); this is not least because research quality is a much debated and controversial issue in management research, and a generally accepted view of what constitutes quality research is not yet foreseeable (e.g., Denyer & Tranfield, 2009; Sousa & Hendriks, 2008).”
BackgroundGond, J.-P., Mena, S., & Mosonyi, S. (2023) · Organizational Research Methods · doi:10.1177/1094428120935494 · Cited by 44 · cited 1×
“What these examples show is that for reviewing any specific field, there is not one definite list of research items that comprehensively captures the field (cf. Gond et al., 2020).”
BackgroundArchetypes of Translation: Recommendations for Dialogue
O’Mahoney, J. (2016) · International Journal of Management Reviews · doi:10.1111/ijmr.12103 · Cited by 41 · cited 1×
“A benefit of snowballing techniques is that they may also identify research items that use different terms for capturing the phenomenon in question rather than those entered in the keyword search (e.g., Niesten & Jolink, 2015; O’Mahoney, 2016) or that have not been published in the predefined set of journals.”
BackgroundStarry-eyed II: the logistics journal ranking debate revisited
McKinnon, A. C. (2017) · International Journal of Physical Distribution & Logistics Management · doi:10.1108/ijpdlm-02-2017-0097 · Cited by 22 · cited 1×
“In particular, choosing ranking criteria geared toward higher ranked journals may lead to a focus on general interest journals, which tend to be ranked above specialist journals (e.g., Hoepner & Unerman, 2012; McKinnon, 2017).”
Background
Research works printed but not linked: 3
- Lawrence A., 2014, Where is the evidence? Realising the value of grey literature for public policy and practice: A discussion paper
- Randolph J. J., 2009, Practical Assessment, Research & Evaluation, 14, 1
- Thomson Reuters. (2016). Thomson Reuters announces definitive agreement to sell its Intellectual Property & Science business to Onex and Baring Asia for $3.55 billion. https://www.thomsonreuters.com/en/press-releases/2016/july/thomson-reuters-announces-definitive-agreement-to-sell-its-intellectual-property-science-business.html
Cited by
The digital divide: A review and future research agenda
Lythreatis, S., Singh, S. K., & El-Kassar, A.-N. (2022) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.121359 · Cited by 1,044
Marzi, G., Balzano, M., Caputo, A., & Pellegrini, M. M. (2025) · International Journal of Management Reviews · doi:10.1111/ijmr.12381 · Cited by 577
“In terms of source quality, because Scopus and WoS (and Dimension) have a wide coverage of indexed journals, they sometimes index lower-ranked or newly established journals (Hiebl, 2023; Mongeon & Paul-Hus, 2016).”
Zamani, E. D., Smyth, C., Gupta, S., & Dennehy, D. (2023) · Annals of Operations Research · doi:10.1007/s10479-022-04983-y · Cited by 409
“We focused exclusively on studies published in CABS ranked journals as it a common practice within the broader field of Business and Management (Hiebl, 2021).”
Advancing literature review methodology through rigour, generativity, scope and transparency
Fan, D., Breslin, D., Callahan, J. L., & Iszatt‐White, M. (2022) · International Journal of Management Reviews · doi:10.1111/ijmr.12291 · Cited by 283
“For example, focusing on the mechanics of search and selection may overshadow the more creative aspects such as synthesizing the literature and developing new insights (Hiebl, 2021).”
Behl, A., Jayawardena, N., Pereira, V., Islam, N., Giudice, M. D., & Choudrie, J. (2022) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.121445 · Cited by 253
Metadata
- Authors
- Hiebl, M. R. W.
- Affiliations
- Johannes Kepler University of Linz (AT)
- Corresponding author
- Hiebl, Martin R. W.
- ORCID
- Hiebl, Martin R. W.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2021-01-29
- Volume
- 26
- Issue
- 2
- Pages
- 229-261
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W3127773267
- Cited by
- 635
- References
- 126
- Citations by year
- 2026: 151 · 2025: 178 · 2024: 151 · 2023: 87 · 2022: 54 · 2021: 13
- FWCI
- 3.17
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Organizational Research Methods (publishedVersion, cc-by-nc)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Business, Management and Accounting › Strategy and Management › Business Strategies and Management Research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- systematic reviews, sample selection, management research, review methodology, research databases
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.