CoChat

Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing

Open access

Published version of a preprint

The DOI matches its Crossref record; 81 of the 81 references it cites were found in a registry or an index; 4 of the 39 sources its claims cite were checked for support.

Abstract

Today, more than 70 carbon pricing schemes have been implemented around the globe, but their contributions to emissions reductions remains a subject of heated debate in science and policy. Here we assess the effectiveness of carbon pricing in reducing emissions using a rigorous, machine-learning assisted systematic review and meta-analysis. Based on 483 effect sizes extracted from 80 causal ex-post evaluations across 21 carbon pricing schemes, we find that introducing a carbon price has yielded immediate and substantial emission reductions for at least 17 of these policies, despite the low level of prices in most instances. Statistically significant emissions reductions range between –5% to –21% across the schemes (–4% to –15% after correcting for publication bias). Our study highlights critical evidence gaps with regard to dozens of unevaluated carbon pricing schemes and the price elasticity of emissions reductions. More rigorous synthesis of carbon pricing and other climate policies is required across a range of outcomes to advance our understanding of “what works” and accelerate learning on climate solutions in science and policy.

Overview

CoChat Summary

TL;DR

This systematic review and meta-analysis finds that introducing carbon pricing has caused immediate, statistically significant emissions reductions for at least 17 of 21 evaluated schemes, with effects ranging from –5% to –21% (–4% to –15% after publication-bias correction). The authors conclude that context and policy design, rather than carbon price level, sector coverage, or tax-vs-trading choice, best explain heterogeneity across schemes.

Key findings

  • Across 483 effect sizes from 80 ex-post evaluations of 21 carbon pricing schemes, the average treatment effect is –10.4% [95% CI = (–11.9%, –8.9%)]; 17 schemes show statistically significant reductions ranging from about –21% to –5%.
  • Publication-bias correction, using the ~30% of effect sizes with adequate statistical power, reduces the average treatment effect to –6.8% [95% CI = (–8.1%, –5.6%)] and adjusts scheme-wise estimates to –15% to –4%.
  • Scheme-specific estimates include Chinese pilot ETS –13.1% [95% CI = (–15.2%, –11.1%)], EU ETS –7.3% [95% CI = (–10.5%, –4.0%)], and British Columbia carbon tax –5.4% [95% CI = (–9.6%, –1.2%)].
  • Bayesian model averaging finds relevant explanatory variables (PIP ≥ 0.5) are dummies for RGGI, Chinese pilot ETS, Swiss ETS, city-level data, and duration; carbon price level, sector coverage, and tax-vs-cap-and-trade are not relevant (PIP < 0.5).
  • Evidence gaps remain: only 20 of 73 carbon pricing policies in place in 2023 plus the repealed Australian carbon tax had ex-post evidence; 18 of 38 schemes implemented by 2015 had no effectiveness study; only nine price elasticity studies were identified.

Methods

  • Systematic review following Collaboration for Environmental Evidence guidance, with machine-learning-assisted screening of 16,748 articles from Web of Science, Scopus, JSTOR, RePEc, and Google Scholar; 80 quantitative ex-post evaluations across 21 carbon pricing schemes were included.
  • Effect sizes were harmonised to a common treatment-effect metric: percentage difference between counterfactual emissions without carbon pricing and observed emissions after introduction; 483 effect sizes were analysed.
  • Multilevel random and mixed effects models estimated average treatment effects; critical appraisal adapted ROBINS-I criteria; publication bias assessed via precision effect test and corrected using adequately powered effect sizes; Bayesian model averaging tested heterogeneity.

Limitations

  • The paper states the approach is purely quantitative and meta-econometric, inherently dependent on the available evidence base, and cannot answer why particular policy designs work or under what conditions; it suggests mixed-method realist synthesis for such questions.
  • The paper states substantial evidence gaps: more than 50 carbon pricing schemes have not been evaluated, fewer than ten studies assess schemes with mean carbon prices above US$ 30, only about half of studies have low risk of bias, and only 30% are adequately powered.
  • The paper states that carbon price variation is dominated by between-scheme differences (91%) versus within-scheme variation (9%), limiting power to identify price effects; most primary studies assume constant treatment effects, so the finding that longer study periods show larger reductions should be treated with caution.
  • Evident from the text: many schemes are covered by only one to five studies, and scheme dummies in the heterogeneity analysis may absorb omitted contextual variables, making the price coefficient difficult to interpret when scheme dummies are excluded.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1038/s41467-024-48512-w

Cites

81 of 81 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Average emissions changes by scheme. Panel (a, d, g) present weighted mean effect sizes together with their 95% confidence intervals based on multilevel random and mixed effects models and represent the effect of the policy observed in each period after its introduction in comparison to the counterfactual emissions without the policy. The estimates are ordered according to the number of studies they comprise (depicted on the left). The average treatment effect for the Chinese ETS pilots comprises the effects of all eight regional pilot schemes. Cross-country collects the evidence from studies assessing countries with and without carbon pricing, not focusing on a specific carbon pricing scheme. Panel (a, d, g) comprise, respectively n = 470, n = 253, and n = 142 effect sizes clustered on the study level. Panels (b, e, h) show the distribution of assigned risks of bias (RoB). Panel (c, f, i) show the distribution of statistical power. Power above 80% is considered adequate. For synthetic control designs no statistical power was derived, thus presented as “NA".
Fig. 1 Average emissions changes by scheme. Panel (a, d, g) present weighted mean effect sizes together with their 95% confidence intervals based on multilevel random and mixed effects models and represent the effect of the policy observed in each period after its introduction in comparison to the counterfactual emissions without the policy. The estimates are ordered according to the number of studies they comprise (depicted on the left). The average treatment effect for the Chinese ETS pilots comprises the effects of all eight regional pilot schemes. Cross-country collects the evidence from studies assessing countries with and without carbon pricing, not focusing on a specific carbon pricing scheme. Panel (a, d, g) comprise, respectively n = 470, n = 253, and n = 142 effect sizes clustered on the study level. Panels (b, e, h) show the distribution of assigned risks of bias (RoB). Panel (c, f, i) show the distribution of statistical power. Power above 80% is considered adequate. For synthetic control designs no statistical power was derived, thus presented as “NA".CC BY · PubMed Central
Fig. 2 Heterogeneity assessment using Bayesian model averaging. The columns in the figure depict the best 26,435 estimated meta-regressions, with each column showing the outcome of one estimated meta-regression model. The dependent variable for each of the meta-regression models is the percentage change in emissions. The possible explanatory variables are depicted in the rows (ordered by their PIP in descending order) and the explanatory variables included in a respective meta-regression model of the column is indicated by the colours. Red colour indicates the variable was included with a negative sign (larger emission reductions). Blue colour indicates a positive sign (smaller emission reductions). No colour indicates that the variable was not included in the meta-regression model represented by that column. The horizontal axis indicates the cumulative posterior model probabilities across all models. The models are ranked by their posterior model probability with the model on the left accounting for the largest posterior model probability. The definitions of the explanatory variables are provided in the Supplementary Information.
Fig. 2 Heterogeneity assessment using Bayesian model averaging. The columns in the figure depict the best 26,435 estimated meta-regressions, with each column showing the outcome of one estimated meta-regression model. The dependent variable for each of the meta-regression models is the percentage change in emissions. The possible explanatory variables are depicted in the rows (ordered by their PIP in descending order) and the explanatory variables included in a respective meta-regression model of the column is indicated by the colours. Red colour indicates the variable was included with a negative sign (larger emission reductions). Blue colour indicates a positive sign (smaller emission reductions). No colour indicates that the variable was not included in the meta-regression model represented by that column. The horizontal axis indicates the cumulative posterior model probabilities across all models. The models are ranked by their posterior model probability with the model on the left accounting for the largest posterior model probability. The definitions of the explanatory variables are provided in the Supplementary Information.CC BY · PubMed Central
Fig. 3 Flow diagram of the literature search and screening process. Adapted from the ROSES flow diagram for systematic reviews97.
Fig. 3 Flow diagram of the literature search and screening process. Adapted from the ROSES flow diagram for systematic reviews97.CC BY · PubMed Central

Verification

Claims the paper makes

2 Valid · 1 Not valid · 17 Not checked · 57 Own results and interpretations

53 more claims

Create a free account to see all 77 claims and to verify the 35 references still open.

See all claims — free account
  • It may state two separate claims as one. 5
  • Probably not a substantial claim. 13
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 81 references

Research works printed but not linked: 5

  1. IPCC. Climate Change 2022: Mitigation of Climate Change. Contribution of Working Group III to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change (Cambridge University Press, Cambridge, UK and New York, NY, USA, 2022).
  2. Brodeur, A., Lé, M., Sangnier, M. & Zylberberg, Y. Star wars: The empirics strike back. Am. Econ. J.: Appl. Econ. 8, 1–32 (2016).
  3. Dahl, C. A. Measuring global gasoline and diesel price and income elasticities. Model. Transp. (Energy) Demand Policies 41, 2–13 (2012).
  4. Agnolucci, P.et al. Measuring Total Carbon Pricing. The World Bank Research Observer lkad009 (2023). https://academic.oup.com/wbro/advance-article/doi/10.1093/wbro/lkad009/7283905. · doi:10.1093/wbro/lkad009/7283905
  5. Ringquist, E.Meta-analysis for public management and policy (John Wiley & Sons, 2013).

Cited by

See all 164

Metadata

Authors
Döbbeling-Hildebrandt, N., Miersch, K., Khanna, T. M., Bachelet, M., Bruns, S. B., Callaghan, M., Edenhofer, O., Flachsland, C., Forster, P. M., Kalkuhl, M., Koch, N., Lamb, W. F., Ohlendorf, N., Steckel, J. C., & Minx, J. C.
Affiliations
  • University of Leeds (GB)
  • Mercator Research Institute on Global Commons and Climate Change (DE)
  • University of British Columbia (CA)
  • University of Kassel (DE)
  • Hertie School (DE)
  • University of Potsdam (DE)
  • IZA - Institute of Labor Economics (DE)
Corresponding author
  • Döbbeling-Hildebrandt, Niklas
  • Minx, Jan C.
Venue
Nature Communications
Published
2024-05-16
Volume
15
Issue
1
Pages
4147-4147
ISSN
2041-1723 (ISSN-L)
OpenAlex
W4396956648
Cited by
164
References
80
Citations by year
2026: 78 · 2025: 65 · 2024: 20
FWCI
17.78
Type
journal article
Language
en
Open access
Licence
Locations
  • Nature Communications (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
  • Document Server@UHasselt (UHasselt) (submittedVersion, cc-by)
  • Publication Database PIK (Potsdam Institute for Climate Impact Research (PIK)) (submittedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • OPUS 4 (Zuse Institute Berlin) (submittedVersion)
  • publish.UP (University of Potsdam) (submittedVersion, cc-by)
Funders
  • Heinrich Böll Stiftung
  • Bundesministerium für Bildung und Forschung (03SFK5J0)
  • Horizon Europe, European Commission, Directorate-General for Research and Innovation
Topics
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Climate Change Policy and Economics
  • Physical Sciences › Energy › Renewable Energy, Sustainability and the Environment › Energy, Environment, and Transportation Policies
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Energy, Environment, Economic Growth
Keywords
carbon pricing, emission reduction, ex-post evaluation, policy effectiveness, climate policy, publication bias, evidence gaps

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing. https://app.cochat.ai/papers/10.1038/s41467-024-48512-w
The paper
Döbbeling-Hildebrandt, N., Miersch, K., Khanna, T. M., Bachelet, M., Bruns, S. B., Callaghan, M., Edenhofer, O., Flachsland, C., Forster, P. M., Kalkuhl, M., Koch, N., Lamb, W. F., Ohlendorf, N., Steckel, J. C., & Minx, J. C. (2024). Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing. Nature Communications. https://doi.org/10.1038/s41467-024-48512-w

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.