The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Guidance on Conducting a Systematic Literature Review
Open accessAbstract
Literature reviews establish the foundation of academic inquires. However, in the planning field, we lack rigorous systematic reviews. In this article, through a systematic search on the methodology of literature review, we categorize a typology of literature reviews, discuss steps in conducting a systematic literature review, and provide suggestions on how to enhance rigor in literature reviews in planning education and research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The research questions should drive the entire literature review process (Xiao and Watson 2019), and therefore, researchers' choices have a great impact on the literature selection.”
From Terror Management Theory in the Consumer Domain: A Systematic Review and Meta‐Analysis on Mortality Salience Driven Consumer Responses (2025) · cites this paper as Xiao and Watson 2019
In the citing paper
“The vast body of studies retrieved from the search on climate-induced migration in Africa were thoroughly screened for relevant articles to ensure the validity, reliability, and repeatability of the review process (Mengist et al., 2020 [28]; Xiao and Watson, 2019 [27]).”
From A Systematic Review of International and Internal Climate-Induced Migration in Africa (2023) · cites this paper as Xiao and Watson, 2019 [27]
In the citing paper
“This protocol serves to outline the study process in a rigorous and transparent manner, mitigating researcher bias in study selection and data extraction [88].”
From A systematic literature review of empirical research on ChatGPT in education (2024) · cites this paper as [88]
Citations
Cites
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742
The Structure of Scientific Revolutions: 50th Anniversary Edition
Kuhn, T. S., & Hacking, I. (2012) · doi:10.7208/chicago/9780226458144.001.0001 · Cited by 21,170
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
The integrative review: updated methodology
Whittemore, R., & Knafl, K. (2005) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2005.03621.x · Cited by 10,241
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Guidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472
Analyzing the Past to Prepare for the Future: Writing a Literature Review
Webster, J., & Watson, R. T. (2002) · MIS Quarterly · doi:10.2307/4132319 · Cited by 7,449
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Travel and the Built Environment: A Meta-Analysis
Ewing, R., & Cervero, R. (2010) · Journal of the American Planning Association · doi:10.1080/01944361003766766 · Cited by 5,360
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Systematic Reviews in the Social Sciences: A Practical Guide
Petticrew, M., & Roberts, H. (2006) · doi:10.1002/9780470754887 · Cited by 3,586
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · cited 6×
“Types of testing reviews include meta-analysis (Glass 1976), Bayesian meta-analysis (Spiegelhalter et al. 1999; Sutton and Abrams 2001), realist review (Pawson et al. 2005), and ecological triangulation (Banning 2005).”
BackgroundMethodInfluentialNoblit, G., & Hare, R. (1988) · doi:10.4135/9781412985000 · Cited by 2,723
Brereton, P., Kitchenham, B. A., Budgen, D., Turner, M., & Khalil, M. (2007) · Journal of Systems and Software · doi:10.1016/j.jss.2006.07.009 · Cited by 2,394
Dixon-Woods, M., Cavers, D., Agarwal, S., Annandale, E., Arthur, A., Harvey, J., Hsu, R., Katbamna, S., Olsen, R., Smith, L., et al. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-35 · Cited by 2,289
Writing narrative literature reviews for peer-reviewed journals: secrets of the trade
Green, B. N., Johnson, C. D., & Adams, A. (2006) · Journal of Chiropractic Medicine · doi:10.1016/s0899-3467(07)60142-6 · Cited by 2,224 · cited 1×
“Types of descriptive reviews include the narrative review (Green, Johnson, and Adams 2001), textual narrative synthesis (Popay et al. 2006; Lucas et al. 2007), metasummary (Sandelowski, Barroso, and Voils 2007), meta-narrative (Greenhalgh et al. 2005), and scoping review (Arksey and O’Malley 2005).”
BackgroundMeta-Ethnography: Synthesizing Qualitative Studies
Noblit, G. W., & Hare, R. D. (1988) · Medical Entomology and Zoology · Cited by 2,191
Synthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132
Methods for the synthesis of qualitative research: a critical review
Barnett-Page, E., & Thomas, J. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-59 · Cited by 2,042
Synthesizing information systems knowledge: A typology of literature reviews
Paré, G., Trudel, M.-C., Jaana, M., & Kitsiou, S. (2015) · Information & Management · doi:10.1016/j.im.2014.08.008 · Cited by 1,987
Conducting research literature reviews: from the Internet to paper
(2005) · Choice Reviews Online · doi:10.5860/choice.42-6198 · Cited by 1,854
Undertaking a literature review: a step-by-step approach
Cronin, P., Ryan, F., & Coughlan, M. (2008) · British Journal of Nursing · doi:10.12968/bjon.2008.17.1.28059 · Cited by 1,426
Mays, N., Pope, C., & Popay, J. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308576 · Cited by 1,375
Are Compact Cities a Desirable Planning Goal?
Gordon, P., & Richardson, H. W. (1997) · Journal of the American Planning Association · doi:10.1080/01944369708975727 · Cited by 1,159
Using meta ethnography to synthesise qualitative research: a worked example
Britten, N., Campbell, R., Pope, C., Donovan, J., Morgan, M., & Pill, R. (2002) · Journal of Health Services Research & Policy · doi:10.1258/135581902320432732 · Cited by 1,110
A complex landscape of inequity in access to urban parks: A literature review
Rigolon, A. (2016) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2016.05.017 · Cited by 954
Wheat From Chaff: Meta-Analysis As Quantitative Literature Review
Stanley, T. D. (2001) · Journal of Economic Perspectives · doi:10.1257/jep.15.3.131 · Cited by 948
Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review
Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., Kyriakidou, O., & Peacock, R. (2005) · Social Science & Medicine · doi:10.1016/j.socscimed.2004.12.001 · Cited by 913
Conducting a literature review
Rowley, J., & Slack, F. (2004) · Management Research News · doi:10.1108/01409170410784185 · Cited by 885
Bayesian methods in meta-analysis and evidence synthesis
Sutton, A. J., & Abrams, K. R. (2001) · Statistical Methods in Medical Research · doi:10.1177/096228020101000404 · Cited by 710
Meta-Study of Qualitative Health Research
Paterson, B., Thorne, S., Canam, C., & Jillings, C. (2001) · doi:10.4135/9781412985017 · Cited by 664
“Best fit” framework synthesis: refining the method
Carroll, C., Booth, A., Leaviss, J., & Rick, J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-37 · Cited by 649
Household Adjustment to Earthquake Hazard: A Review of Research
Lindell, M. K., & Perry, R. W. (2000) · Environment and Behavior · doi:10.1177/00139160021972621 · Cited by 605
A Framework for Guiding and Evaluating Literature Reviews
Templier, M., & Paré, G. (2015) · Communications of the Association for Information Systems · doi:10.17705/1cais.03706 · Cited by 553
Lucas, P. J., Baird, J., Arai, L., Law, C., & Roberts, H. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-4 · Cited by 553
Using qualitative metasummary to synthesize qualitative and quantitative descriptive findings
Sandelowski, M., Barroso, J., & Voils, C. I. (2007) · Research in Nursing & Health · doi:10.1002/nur.20176 · Cited by 528
Using framework-based synthesis for conducting reviews of qualitative studies
Dixon-Woods, M. (2011) · BMC Medicine · doi:10.1186/1741-7015-9-39 · Cited by 487
Spiegelhalter, D. J., Myles, J. P., Jones, D. R., & Abrams, K. R. (1999) · BMJ · doi:10.1136/bmj.319.7208.508 · Cited by 421
Writing Usable Qualitative Health Research Findings
Sandelowski, M., & Leeman, J. (2012) · Qualitative Health Research · doi:10.1177/1049732312450368 · Cited by 418
Making literature reviews more reliable through application of lessons from systematic reviews
Haddaway, N. R., Woodcock, P., Macura, B., & Collins, A. (2015) · Conservation Biology · doi:10.1111/cobi.12541 · Cited by 416
Methodological Issues in Combining Diverse Study Types in Systematic Reviews
Harden, A., & Thomas, J. (2005) · International Journal of Social Research Methodology · doi:10.1080/13645570500155078 · Cited by 371
Methods for knowledge synthesis: An overview
Whittemore, R., Chao, A., Jang, M., Minges, K. E., & Park, C. (2014) · Heart & Lung · doi:10.1016/j.hrtlng.2014.05.014 · Cited by 349
Kastner, M., Tricco, A. C., Soobiah, C., Lillie, E., Perrier, L., Horsley, T., Welch, V., Cogo, E., Antony, J., & Straus, S. E. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-114 · Cited by 345 · cited 5×
“Many of these synthesis methods have been compiled from the medical field, where quality synthesis is paramount to control the influx of new research, as well as qualitative methods papers looking for appropriate ways to find generalizations and overarching themes (Kastner et al. 2012; Dixon-Woods et al. 2005; Whittem…”
BackgroundMethodInfluentialArnold, R., & Fletcher, D. (2012) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.34.3.397 · Cited by 318
Advancements in Research Synthesis Methods: From a Methodologically Inclusive Perspective
Suri, H., & Clarke, D. (2009) · Review of Educational Research · doi:10.3102/0034654308326349 · Cited by 316
Review of methodology of quantitative reviews using meta‐analysis in ecology
Gates, S. (2002) · Journal of Animal Ecology · doi:10.1046/j.1365-2656.2002.00634.x · Cited by 235
Conducting systematic reviews of economic evaluations
Gomersall, J. S., Jadotte, Y. T., Xue, Y., Lockwood, S., Riddle, D., & Preda, A. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000063 · Cited by 205
Metatheory, Metamethod, Meta-Data-Analysis: What, Why, and How?
Zhao, S. (1991) · Sociological Perspectives · doi:10.2307/1389517 · Cited by 181
Analyzing the past to prepare for the future
(2002) · MIS Quarterly · doi:10.5555/2017160.2017162 · Cited by 179
Synthesis of quantitative and qualitative research: an example using Critical Interpretive Synthesis
Flemming, K. (2009) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2009.05173.x · Cited by 175
Malekpour, S., Brown, R. R., & de Haan, F. J. (2015) · Cities · doi:10.1016/j.cities.2015.05.003 · Cited by 170
Using Sandelowski and Barroso’s Meta-Synthesis Method in Advancing Qualitative Evidence
Ludvigsen, M. S., Hall, E. O. C., Meyer, G., Fegran, L., Aagaard, H., & Uhrenfeldt, L. (2016) · Qualitative Health Research · doi:10.1177/1049732315576493 · Cited by 167
Roberts, K. A., Dixon-Woods, M., Fitzpatrick, R., Abrams, K. R., & Jones, D. R. (2002) · The Lancet · doi:10.1016/s0140-6736(02)11560-1 · Cited by 159
Young people's food practices and social relationships. A thematic synthesis
Neely, E., Walton, M., & Stephens, C. V. (2014) · Appetite · doi:10.1016/j.appet.2014.07.005 · Cited by 130
Harden, S. M., McEwan, D., Sylvester, B. D., Kaulius, M., Ruissen, G. R., Burke, S. M., Estabrooks, P. A., & Beauchamp, M. R. (2015) · BMC Public Health · doi:10.1186/s12889-015-2270-8 · Cited by 111
Meta‐synthesis and evidence‐based health care – a method for systematic review
Korhonen, A., Hakulinen, T., Jylhä, V., & Holopainen, A. (2012) · Scandinavian Journal of Caring Sciences · doi:10.1111/scs.12003 · Cited by 107
A meta-study of qualitative research on mental toughness development
Anthony, D. R., Gucciardi, D. F., & Gordon, S. (2016) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2016.1146787 · Cited by 93
Systematic reviews in nutrition: standardized methodology
Wanden-Berghe, C., & Sanz‐Valero, J. (2012) · British Journal Of Nutrition · doi:10.1017/s0007114512001432 · Cited by 82
Issues in synthesizing research in education
Andrews, R., & Harlen, W. (2006) · Educational Research · doi:10.1080/00131880600992330 · Cited by 73
Finding open access articles using Google, Google Scholar, OAIster and OpenDOAR
Norris, M. W., Oppenheim, C., & Rowland, F. (2008) · Online Information Review · doi:10.1108/14684520810923881 · Cited by 69
Systematic reviews and meta-analyses: when they are useful and when to be careful
Noordzij, M., Hooft, L., Dekker, F. W., Zoccali, C., & Jager, K. J. (2009) · Kidney International · doi:10.1038/ki.2009.339 · Cited by 59
Information retrieval for ecological syntheses
Bayliss, H. R., & Beyer, F. R. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1120 · Cited by 45 · cited 2×
“Depending on the purpose of the review, the search can be exhaustive and comprehensive or selective and representative (Bayliss and Beyer 2015; Suri and Clarke 2009; Paré Xiao and Watson 105 et al. 2015).”
BackgroundSystematic review and metasummary of attitudes toward research in emergency medical conditions
Limkakeng, A. T., de Oliveira, L. L. H., Moreira, T., Phadtare, A., Rodrigues, C. G., Hocker, M., McKinney, R. E., Voils, C. I., & Pietrobon, R. S. (2013) · Journal of Medical Ethics · doi:10.1136/medethics-2012-101147 · Cited by 43
An Empirical Assessment of Meta-Analytic Practice
Dieckmann, N. F., Malle, B. F., & Bodner, T. (2009) · Review of General Psychology · doi:10.1037/a0015107 · Cited by 40
Applying mixed methods research at the synthesis level: An overview
Heyvaert, M., Maes, B., & Onghena, P. (2011) · Lirias · Cited by 35
Talking About Familial Breast Cancer Risk
Fisher, C. L., Maloney, E. K., Glogowski, E., et al. (2014) · Qualitative Health Research · doi:10.1177/1049732314524638 · Cited by 34
Research Synthesis: Coding and Conjectures
Stock, W. A., Gómez‐Benito, J., & Balluerka, N. (1996) · Evaluation & the Health Professions · doi:10.1177/016327879601900108 · Cited by 29
Adding Up the Evidence: Systematic Reviews and Meta-Analyses
Noordzij, M., Zoccali, C., Dekker, F. W., & Jager, K. J. (2011) · Nephron Clinical Practice · doi:10.1159/000328914 · Cited by 11
Research works printed but not linked: 16
- 10.2307/1174772 · DOI · Paper page
- Green B. N., 2001, Journal of Sports Chiropractic & Rehabilitation, 15, 5
- Heyvaert Mieke, 2011, Research in the Schools, 18, 12
- Kitchenham Barbara, 2007, EBSE Technical Report
- Kuhn Thomas S., 1970, The Structure of Scientific Revolutions, International Encyclopedia of Unified Science, 2
- Levy Y., 2006, Informing Science Journal, 9, 182
- Myers P. M. D., 2008, Qualitative Research in Business & Management
- Okoli C., 2010, Sprouts: Working Papers on Information Systems, 10
- Onwuegbuzie Anthony J., 2012, Qualitative Report, 17
- Popay Jennie, 2006, A product from the ESRC methods programme Version, 1, b92
- Rousseau D. M., 2008, AIM Research Working Paper Series
- Sandelowski Margarete, 2006, Research in the Schools, 13, 29
- Schutz Alfred, 1962, Collected Papers, 2
- Webster Jane, 2002, MIS Quarterly, 26
- Weed Mike, 2005, Forum Qualitative Sozialforschung/Forum: Qualitative Social Research
- Weingroff Richard F., 1996, Public Roads, 60
Cited by
The ABC of systematic literature review: the basic methodological guidance for beginners
Mohamed Shaffril, H. A., Samsuddin, S. F., & Abu Samah, A. (2021) · Quality & Quantity · doi:10.1007/s11135-020-01059-6 · Cited by 656
Hydrogen liquefaction and storage: Recent progress and perspectives
Zhang, T., Uratani, J., Huang, Y., Xu, L., Griffiths, S., & Ding, Y. (2023) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2023.113204 · Cited by 576
Almeqdad, Q. I., Alodat, A. M., Alquraan, M. F., Mohaidat, M. A., & Al-Makhzoomy, A. K. (2023) · Cogent Education · doi:10.1080/2331186x.2023.2218191 · Cited by 444
Dos Santos, P. H., Neves, S. M., Sant’Anna, D. O., Oliveira, C. H. D., & Carvalho, H. D. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.11.270 · Cited by 430
Sauer, P. C., & Seuring, S. (2023) · Review of Managerial Science · doi:10.1007/s11846-023-00668-3 · Cited by 427
Metadata
- Authors
- Xiao, Y., & Watson, M.
- Affiliations
- Texas A&M University (US)
- Corresponding author
- Xiao, Yu
- ORCID
- Watson, Maria
- Venue
- Journal of Planning Education and Research
- Publisher
- SAGE Publications
- Published
- 2017-08-28
- Volume
- 39
- Issue
- 1
- Pages
- 93-112
- ISSN
- 0739-456X (ISSN-L)
- 1552-6577
- OpenAlex
- W2750168540
- Cited by
- 3,467
- References
- 69
- Citations by year
- 2026: 494 · 2025: 582 · 2024: 721 · 2023: 769 · 2022: 538 · 2021: 249 · 2020: 70 · 2019: 34 · 2018: 9
- FWCI
- 7.67
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- public-domain
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of Planning Education and Research (publishedVersion)
- University of Derby Online Research Archive. (University of Derby) (submittedVersion, public-domain)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- systematic reviews, literature review methodology, research rigor, planning education, planning research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.