The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Literature searches in systematic reviews and meta-analyses: A review, evaluation, and recommendations
Abstract
Abstract The search strategy used in systematic reviews is an important consideration, as the comprehensiveness and representativeness of studies identified influences the quality of conclusions derived from the review. Despite the importance of this step, little in the way of best practice recommendations exist. In an effort to inform future reviews, we report the results of two studies. In Study 1, we outline a series of recommendations for designing comprehensive systematic literature searches. We review the search strategies used in 152 recent systematic reviews published in top applied psychology (including organizational psychology, counseling psychology, and management) journals and evaluate them against these criteria. In Study 2, we build on the findings of our review, carrying out an original meta-analysis, which we use as an opportunity to empirically demonstrate effects of database selection and inclusion of a complementary search protocol on search outcomes. Our results suggest that database selection could have a large effect on conclusions from reviews. Implications and recommendations for carrying out comprehensive literature reviews are described.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement
McGowan, J., Sampson, M., Salzwedel, D. M., Cogo, E., Foerster, V., & Lefebvre, C. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.01.021 · Cited by 5,700
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
The proactive component of organizational behavior: A measure and correlates
Bateman, T. S., & Crant, J. M. (1993) · Journal of Organizational Behavior · doi:10.1002/job.4030140202 · Cited by 3,115
(2015) · An Einstein Encyclopedia · doi:10.1515/9781400873364-029 · Cited by 2,581
Siddaway, A. P., Wood, A. M., & Hedges, L. V. (2019) · Annual Review of Psychology · doi:10.1146/annurev-psych-010418-102803 · Cited by 2,550
Appelbaum, M., Cooper, H., Kline, R. B., Mayo-Wilson, E., Nezu, A. M., & Rao, S. M. (2018) · American Psychologist · doi:10.1037/amp0000191 · Cited by 1,449
Rudolph, C. W., Lavigne, K. N., & Zacher, H. (2017) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2016.09.002 · Cited by 837
Three options for citation tracking: Google Scholar, Scopus and Web of Science
Bakkalbasi, N., Bauer, K., Glover, J., & Wang, L. (2006) · Biomedical Digital Libraries · doi:10.1186/1742-5581-3-7 · Cited by 752
Change driven by nature: A meta-analytic review of the proactive personality literature
Fuller, B., & Marler, L. E. (2009) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2009.05.008 · Cited by 688
Lefebvre, C., Manheimer, E., & Glanville, J. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch6 · Cited by 559
A Review and Evaluation of Meta-Analysis Practices in Management Research
Geyskens, I., Krishnan, R., Steenkamp, J.-B. E. M., & Cunha, P. V. (2009) · Journal of Management · doi:10.1177/0149206308328501 · Cited by 536
2015 48th Hawaii International Conference on System Sciences
(2015) · doi:10.1109/hicss35350.2015 · Cited by 520
Ferguson, C. J., & Brannick, M. T. (2012) · Psychological Methods · doi:10.1037/a0024445 · Cited by 493
Allen, D. G., Weeks, K. P., & Moffitt, K. R. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.5.980 · Cited by 405
Publication Bias in the Organizational Sciences
Kepes, S., Banks, G. C., McDaniel, M., & Whetzel, D. L. (2012) · Organizational Research Methods · doi:10.1177/1094428112452760 · Cited by 398
The process of reinventing a job: A meta–synthesis of qualitative job crafting research
Lazazzara, A., Tims, M., & de Gennaro, D. (2020) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2019.01.001 · Cited by 371
Harari, M. B., Manapragada, A., & Viswesvaran, C. (2017) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2017.06.002 · Cited by 292
Self-citationBorst, R. T., Kruyen, P. M., & Lako, C. J. (2019) · Review of Public Personnel Administration · doi:10.1177/0734371x17729870 · Cited by 245
Mentor and protégé predictors and outcomes of mentoring in a formal mentoring program
Wanberg, C. R., Kammeyer-Mueller, J., & Marchese, M. (2006) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2006.05.010 · Cited by 238
psychmeta: An R Package for Psychometric Meta-Analysis
Dahlke, J. A., & Wiernik, B. M. (2019) · Applied Psychological Measurement · doi:10.1177/0146621618795933 · Cited by 234
Kepes, S., McDaniel, M. A., Brannick, M. T., & Banks, G. C. (2013) · Journal of Business and Psychology · doi:10.1007/s10869-013-9300-2 · Cited by 220
The within and cross domain effects of work-family enrichment: A meta-analysis
Zhang, Y., Xu, S., Jin, J., & Ford, M. T. (2018) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2017.11.003 · Cited by 206
Meta-analysis of work–family conflict mean differences: Does national context matter?
Allen, T. D., French, K. A., Dumani, S., & Shockley, K. M. (2015) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2015.07.006 · Cited by 197
Paterson, T. A., Harms, P. D., Steel, P., & Credé, M. (2016) · Journal of Leadership & Organizational Studies · doi:10.1177/1548051815614321 · Cited by 194
WANG, M., ZHAN, Y., MCCUNE, E., & TRUXILLO, D. (2011) · Personnel Psychology · doi:10.1111/j.1744-6570.2010.01205.x · Cited by 174
Sheu, H.-B., Lent, R. W., Miller, M. J., Penn, L. T., Cusick, M. E., & Truong, N. N. (2018) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2018.10.003 · Cited by 168
Koffel, J. B. (2015) · PLOS ONE · doi:10.1371/journal.pone.0125931 · Cited by 159
Su, R. (2018) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2018.10.016 · Cited by 150
Cross-cultural work and family research: A review of the literature
Shockley, K. M., Douek, J., Smith, C., Yu, P. P., Dumani, S., & French, K. A. (2017) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2017.04.001 · Cited by 140
Obtaining Unbiased Results in Meta-Analysis: The Importance of Correcting for Statistical Artifacts
Wiernik, B. M., & Dahlke, J. A. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919885611 · Cited by 135
Career plateau: A review of 40 years of research
Yang, W., Niven, K. R., & Johnson, S. J. (2018) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2018.11.005 · Cited by 134
Harari, M. B., Herst, D. E. L., Parola, H. R., & Carmona, B. P. (2016) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muw056 · Cited by 127
Self-citationProactive personality, social capital, helping, and turnover intentions
Yang, J., Gong, Y., & Huo, Y. (2011) · Journal of Managerial Psychology · doi:10.1108/02683941111181806 · Cited by 125
Joo, B.-K. B., Hahn, H., & Peterson, S. L. (2015) · Human Resource Development International · doi:10.1080/13678868.2015.1026549 · Cited by 106
Antecedents and outcomes of career plateaus: The roles of mentoring others and proactive personality
Wang, Y., Hu, C., Hurst, C. S., & Yang, C. (2014) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2014.08.003 · Cited by 95
Woods, S. A., Wille, B., Wu, C., Lievens, F., & Fruyt, F. D. (2018) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2018.11.010 · Cited by 90
Kim, J. G., Kim, H. J., & Lee, K. (2019) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2019.01.004 · Cited by 90
Age Differences in Proactive Newcomer Socialization Strategies in Two Populations
Finkelstein, L. M., Kulas, J. T., & Dages, K. D. (2003) · Journal of Business and Psychology · doi:10.1023/a:1023400201387 · Cited by 83
Career commitment, proactive personality, and work outcomes: a cross-lagged study
Vandenberghe, C., & Ok, A. B. (2013) · Career Development International · doi:10.1108/cdi-02-2013-0013 · Cited by 67
Toward an Inductive Theory of Stayers and Seekers in the Organization
Woo, S. E., & Allen, D. G. (2013) · Journal of Business and Psychology · doi:10.1007/s10869-013-9303-z · Cited by 55
Buffering emotional job demands: The interplay between proactive personality and team potency
Loi, R. C. H., Liu, Y., Lam, L. W., & Xu, A. J. (2016) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2016.08.007 · Cited by 47
Virtues, work satisfactions and psychological wellbeing among nurses
Burke, R. J., Ng, E. S., & Fıksenbaum, L. (2009) · International Journal of Workplace Health Management · doi:10.1108/17538350910993403 · Cited by 45
Empirical Benchmarks for Interpreting Effect Size Variability in Meta-Analysis
Wiernik, B., Kostal, J. W., Wilmot, M. P., Dilchert, S., & Ones, D. (2017) · Industrial and Organizational Psychology · doi:10.1017/iop.2017.44 · Cited by 38
If It Were Only That Easy: The Use of Meta-Analytic Research by Organizational Scholars
DeSimone, J. A., Köhler, T., & Schoen, J. L. B. (2018) · Organizational Research Methods · doi:10.1177/1094428118756743 · Cited by 33
Corporate identity management and employees’ responses
Bravo, R., Matute, J., & Pérez, J. M. P. (2015) · Journal of Strategic Marketing · doi:10.1080/0965254x.2015.1076876 · Cited by 31
Proactive personality in the context of job complexity.
Chung‐Yan, G. A., & Butler, A. M. (2011) · Canadian Journal of Behavioural Science/Revue canadienne des sciences du comportement · doi:10.1037/a0024501 · Cited by 30
Surface acting as a mediator between personality and attitudes
Andrews, M. C., Kacmar, K. M., & Valle, M. (2016) · Journal of Managerial Psychology · doi:10.1108/jmp-11-2015-0414 · Cited by 28
Gender differences in work experiences, satisfactions and wellbeing among physicians in Turkey
Burke, R. J., Koyuncu, M., & Fıksenbaum, L. (2009) · Gender in Management An International Journal · doi:10.1108/17542410910938781 · Cited by 25
Prabhu, V. P. (2007) · Cited by 21
Rios, J. A., Ihlenfeldt, S. D., Dosedel, M., & Riegelman, A. (2019) · Educational Measurement Issues and Practice · doi:10.1111/emip.12282 · Cited by 21
Self-citationKane, L. M. (2014) · CUNY Academic Works (City University of New York) · Cited by 13
Ford, D. K. (2000) · doi:10.15760/etd.515 · Cited by 10
An Expansion of the Beneficial Outcomes Associated With the Proactive Employee
Slatten, L. A. D., CARSON, K. D., Baker, D. S., & Carson, P. P. (2013) · Journal of Behavioral and Applied Management · doi:10.21818/001c.17928 · Cited by 10
Moore, J. E., Hester, A. J., & Yager, S. E. (2016) · ACM SIGMIS Database the DATABASE for Advances in Information Systems · doi:10.1145/2894216.2894218 · Cited by 9
Prabhu, V. P. (2013) · Cited by 8
Potential Antecedents and Consequences of Work-Family Conflict: A Three Country Study
Burke, R. J., Fıksenbaum, L., El‐Kot, G., Koyuncu, M., & Jing, W. (2010) · Springer eBooks · doi:10.1007/978-3-642-16199-5_6 · Cited by 7
Follmer, E. H., Kristof‐Brown, A. L., Rynes, S. L., Colbert, A. E., Firth, B. M., & Li, N. (2016) · doi:10.17077/etd.ebd2lt9f · Cited by 7
Antecedents and consequences of trust within organizations
Ristig, K. (2004) · Cited by 7
der Westhuizen, N. V. (2014) · SUNScholar (Stellenbosch University) · Cited by 6
Roberts, M. L. (2004) · Cited by 6
The Role of Voice in Retention of IT Workers: Paving the Higher Road
Hester, A. J., Moore, J. E., & Yager, S. E. (2014) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2014.493 · Cited by 5
Prabhu, V. P. (2013) · Cited by 5
Obtaining unbiased results in meta-analysis: the importance of correcting for statistical artefactsPreprint
Wiernik, B. M., & Dahlke, J. A. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/9mpbn · Cited by 5
Bolino, A. V. (2009) · Cited by 4
Newcomer Socialization: The Roles of Social Networks
Choi, Y. (2014) · University of Minnesota Digital Conservancy (University of Minnesota) · Cited by 4
Che, X. (2012) · Digital Commons - University of South Florida (University of South Florida) · Cited by 2
Reinventing the Wheel: Examining the Antecedents, Moderators, and Outcomes of the Innovation Process
Smothers, J. E. (2012) · Cited by 2
Virtues, Work Experiences, Satisfactions And Well-Being Among Physicians In Turkey
Koyuncu, M. (2008) · iş, güç/İktisadi yenilik dergisi · doi:10.4026/1303-2860.2008.0078.x · Cited by 1
Cited by
Kumar, S., Sharma, D., Rao, S., Lim, W. M., & Mangla, S. K. (2025) · Annals of Operations Research · doi:10.1007/s10479-021-04410-8 · Cited by 437
Klarin, A. (2024) · International Journal of Consumer Studies · doi:10.1111/ijcs.13031 · Cited by 292
How to conduct a meta-analysis in eight steps: A practical guide
Hansen, C., Steinmetz, H., & Block, J. (2022) · Management Review Quarterly · doi:10.1007/s11301-021-00247-4 · Cited by 218
Leadership Development Strategies in Interprofessional Healthcare Collaboration: A Rapid Review
Bornman, J., & Louw, B. (2023) · Journal of Healthcare Leadership · doi:10.2147/jhl.s405983 · Cited by 71
Batubara, S. O., Tonapa, S. I., Saragih, I. D., Mulyadi, M., & Lee, B.-O. (2022) · Geriatric Nursing · doi:10.1016/j.gerinurse.2021.10.016 · Cited by 19
Metadata
- Authors
- Harari, M. B., Parola, H. R., Hartwell, C. J., & Riegelman, A.
- Venue
- Journal of Vocational Behavior
- Publisher
- Elsevier BV
- Published
- 2020-04
- Volume
- 118
- Pages
- 103377
- ISSN
- 0001-8791 (ISSN-L)
- OpenAlex
- W3000685013
- Cited by
- 291
- References
- 71
- FWCI
- 7.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.