The DOI matches its Crossref record; 54 of the 55 references it cites were found in a registry or an index.
A methodology for systematic mapping in environmental sciences
Open accessAbstract
Systematic mapping was developed in social sciences in response to a lack of empirical data when answering questions using systematic review methods, and a need for a method to describe the literature across a broad subject of interest. Systematic mapping does not attempt to answer a specific question as do systematic reviews, but instead collates, describes and catalogues available evidence (e.g. primary, secondary, theoretical, economic) relating to a topic or question of interest. The included studies can be used to identify evidence for policy-relevant questions, knowledge gaps (to help direct future primary research) and knowledge clusters (sub-sets of evidence that may be suitable for secondary research, for example systematic review). Evidence synthesis in environmental sciences faces similar challenges to those found in social sciences. Here we describe the translation of systematic mapping methodology from social sciences for use in environmental sciences. We provide the first process-based methodology for systematic maps, describing the stages involved: establishing the review team and engaging stakeholders; setting the scope and question; setting inclusion criteria for studies; scoping stage; protocol development and publication; searching for evidence; screening evidence; coding; production of a systematic map database; critical appraisal (optional); describing and visualising the findings; report production and supporting information. We discuss the similarities and differences in methodology between systematic review and systematic mapping and provide guidance for those choosing which type of synthesis is most suitable for their requirements. Furthermore, we discuss the merits and uses of systematic mapping and make recommendations for improving this evolving methodology in environmental sciences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Reflecting standard practice for SM (James et al 2016, Collaboration for Environmental Evidence 2018), we specified the study type and grey/scholarly literature classification which can give some indication of quality, though we do not explicitly assess the quality of these articles as critical appraisal is only optional for systematic maps (James et al 2016).”
From Framing climate change for effective communication: a systematic map (2020) · cites this paper as James et al 2016
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“CADIMA is also suitable for assisting in the process of conducting other forms of evidence synthesis, including systematic maps [8, 9] and rapid reviews [26]”
From Online tools supporting the conduct and reporting of systematic reviews and systematic maps: a case study on CADIMA and review of existing tools (2018) · cites this paper as [8]
In the citing paper
“Systematic reviews and related systematic maps follow standardised and rigorous methodologies aiming to ensure comprehensiveness, minimise bias, and increase transparency [7, 8].”
From Online tools supporting the conduct and reporting of systematic reviews and systematic maps: a case study on CADIMA and review of existing tools (2018) · cites this paper as [8]
In the citing paper
“Nevertheless, an underlying expectation of systematic maps is that the searching and eligibility screening steps should be conducted with the same rigor as for systematic reviews [5].”
From Eligibility screening in evidence synthesis of environmental management topics (2017) · cites this paper as [5]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“For example, using a similar template to that provided in CEE guidance for systematic review [17] or a PRISMA-type flow chart [54].”
MethodPreferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817 · cited 1×
“The included studies can be used to develop a greater understanding of concepts, identify evidence for policy-relevant questions, knowledge gaps (topics that are underrepresented in the literature that would benefit from primary research), and knowledge clusters (sub-sets of evidence that may be suitable for secondary…”
BackgroundThe need for evidence-based conservation
Sutherland, W. J., Pullin, A. S., Dolman, P. M., & Knight, T. M. (2004) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2004.03.018 · Cited by 1,822
An Introduction to Systematic Reviews
Gough, D., Oliver, S., & Thomas, J. (2017) · doi:10.4135/9781036234942 · Cited by 1,239
Clarifying differences between review designs and methods
Gough, D., Thomas, J., & Oliver, S. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-28 · Cited by 1,063 · cited 2×
“The evidence gathered may be used to inform the development of new theories, conceptualisations or understandings [11, 16, 26].”
BackgroundAuthority, E. G. F. T. C. O. S. R. E. F. S. (2010) · EFSA Journal · doi:10.2903/j.efsa.2010.1637 · Cited by 693
Do conservation managers use scientific evidence to support their decision-making?
Pullin, A. S., Knight, T. M., Stone, D. A., & Charman, K. (2004) · Biological Conservation · doi:10.1016/j.biocon.2003.11.007 · Cited by 675 · cited 1×
“Background The last decade saw increasing concerns that scientific research was not being used to underpin policy and practice in the fields of conservation and environmental science [1–7], with decisions generally being experiencebased rather than evidence-based [2, 8].”
BackgroundEffectiveness in Conservation Practice: Pointers from Medicine and Public Health
Pullin, A. S., & Knight, T. M. (2001) · Conservation Biology · doi:10.1046/j.1523-1739.2001.99499.x · Cited by 481 · cited 2×
“One of the most recognised evidence synthesis methods is systematic review, which is often regarded as the gold standard [2, 3, 8, 14, 15].”
Background
Research works printed but not linked: 3
- Department for Environment Food and Rural Affairs. Defra’s evidence investment strategy: 2010–2013 and beyond. London: Defra; 2013.
- Collaboration for Environmental Evidence. Guidelines for systematic review and evidence synthesis in environmental Management. Version 4.2. Environmental Evidence 2013 http://www.environmentalevidence.org/wp-content/uploads/2014/06/Review-guidelines-version-4.2-final.pdf Accessed 19 Oct 2015.
- Environmental Evidence Journal: http://environmentalevidencejournal.biomedcentral.com/ Accessed 19 Oct 2015.
Cited by
Haddaway, N. R., Macura, B., Whaley, P., & Pullin, A. S. (2018) · Environmental Evidence · doi:10.1186/s13750-018-0121-7 · Cited by 946
“Fourthly, we have extended the methodological scope to follow trends in methodological development [43] and included reporting and methodological guidance for systematic maps.”
BackgroundSelf-citationO'Dea, R. E., Lagisz, M., Jennions, M. D., Koricheva, J., Noble, D. W. A., Parker, T. H., Gurevitch, J., Page, M. J., Stewart, G., Moher, D., et al. (2021) · Biological Reviews · doi:10.1111/brv.12721 · Cited by 697
Mapping the effectiveness of nature‐based solutions for climate change adaptation
Chausson, A., Turner, B., Seddon, D., Chabaneix, N., Girardin, C. A. J., Kapos, V., Key, I., Roe, D., Smith, A., Woroniecki, S., et al. (2020) · Global Change Biology · doi:10.1111/gcb.15310 · Cited by 707
“Responding to calls for more innovative ways to visualize evidence bases (James et al., 2016), we present the results of our systematic map as an open-source, userfriendly online platform that will be updated over time (www.natur ebase dsolu tions evide nce.info).”
BackgroundKhan, I. S., Ahmad, M. O., & Majava, J. (2021) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2021.126655 · Cited by 489
“…understanding of concepts, general research trends (e.g., publication trends over time, research methods and publication outlets), identify knowledge gaps, and classify the sub-sets of knowledge clusters (James et al., 2016; Petersen et al., 2015), which fits to the exact scope of this research.”
BackgroundMeeting the review family: exploring review types and associated information retrieval requirements
Sutton, A., Clowes, M., Preston, L., & Booth, A. (2019) · Health Information & Libraries Journal · doi:10.1111/hir.12276 · Cited by 570
Metadata
- Authors
- James, K. L., Randall, N. P., & Haddaway, N. R.
- Affiliations
- Harper Adams University (GB)
- Stockholm Environment Institute (SE)
- Corresponding author
- Randall, Nicola P.
- Venue
- Environmental Evidence
- Published
- 2016-04-26
- Volume
- 5
- Issue
- 1
- ISSN
- 2047-2382 (ISSN-L)
- OpenAlex
- W2344290876
- Cited by
- 769
- References
- 55
- Citations by year
- 2026: 82 · 2025: 90 · 2024: 111 · 2023: 97 · 2022: 113 · 2021: 104 · 2020: 74 · 2019: 42 · 2018: 31 · 2017: 20 · 2016: 4
- FWCI
- 30.17
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Environmental Evidence (publishedVersion, cc-by)
- Harper Adams University Repository (GuildHE Research) (acceptedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Decision Sciences › Management Science and Operations Research › Diverse Interdisciplinary Research Innovations
- Keywords
- systematic mapping, systematic reviews, scoping review, knowledge gaps, knowledge clusters, stakeholder engagement, critical appraisal, methodological recommendations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A methodology for systematic mapping in environmental sciences. https://app.cochat.ai/papers/10.1186/s13750-016-0059-6
- The paper
- James, K. L., Randall, N. P., & Haddaway, N. R. (2016). A methodology for systematic mapping in environmental sciences. Environmental Evidence. https://doi.org/10.1186/s13750-016-0059-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.