Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing
Open accessPublished version of a preprint
The DOI matches its Crossref record; 81 of the 81 references it cites were found in a registry or an index; 4 of the 39 sources its claims cite were checked for support.
Abstract
Today, more than 70 carbon pricing schemes have been implemented around the globe, but their contributions to emissions reductions remains a subject of heated debate in science and policy. Here we assess the effectiveness of carbon pricing in reducing emissions using a rigorous, machine-learning assisted systematic review and meta-analysis. Based on 483 effect sizes extracted from 80 causal ex-post evaluations across 21 carbon pricing schemes, we find that introducing a carbon price has yielded immediate and substantial emission reductions for at least 17 of these policies, despite the low level of prices in most instances. Statistically significant emissions reductions range between –5% to –21% across the schemes (–4% to –15% after correcting for publication bias). Our study highlights critical evidence gaps with regard to dozens of unevaluated carbon pricing schemes and the price elasticity of emissions reductions. More rigorous synthesis of carbon pricing and other climate policies is required across a range of outcomes to advance our understanding of “what works” and accelerate learning on climate solutions in science and policy.
Overview
CoChat Summary
TL;DR
This systematic review and meta-analysis finds that introducing carbon pricing has caused immediate, statistically significant emissions reductions for at least 17 of 21 evaluated schemes, with effects ranging from –5% to –21% (–4% to –15% after publication-bias correction). The authors conclude that context and policy design, rather than carbon price level, sector coverage, or tax-vs-trading choice, best explain heterogeneity across schemes.
Key findings
- Across 483 effect sizes from 80 ex-post evaluations of 21 carbon pricing schemes, the average treatment effect is –10.4% [95% CI = (–11.9%, –8.9%)]; 17 schemes show statistically significant reductions ranging from about –21% to –5%.
- Publication-bias correction, using the ~30% of effect sizes with adequate statistical power, reduces the average treatment effect to –6.8% [95% CI = (–8.1%, –5.6%)] and adjusts scheme-wise estimates to –15% to –4%.
- Scheme-specific estimates include Chinese pilot ETS –13.1% [95% CI = (–15.2%, –11.1%)], EU ETS –7.3% [95% CI = (–10.5%, –4.0%)], and British Columbia carbon tax –5.4% [95% CI = (–9.6%, –1.2%)].
- Bayesian model averaging finds relevant explanatory variables (PIP ≥ 0.5) are dummies for RGGI, Chinese pilot ETS, Swiss ETS, city-level data, and duration; carbon price level, sector coverage, and tax-vs-cap-and-trade are not relevant (PIP < 0.5).
- Evidence gaps remain: only 20 of 73 carbon pricing policies in place in 2023 plus the repealed Australian carbon tax had ex-post evidence; 18 of 38 schemes implemented by 2015 had no effectiveness study; only nine price elasticity studies were identified.
Methods
- Systematic review following Collaboration for Environmental Evidence guidance, with machine-learning-assisted screening of 16,748 articles from Web of Science, Scopus, JSTOR, RePEc, and Google Scholar; 80 quantitative ex-post evaluations across 21 carbon pricing schemes were included.
- Effect sizes were harmonised to a common treatment-effect metric: percentage difference between counterfactual emissions without carbon pricing and observed emissions after introduction; 483 effect sizes were analysed.
- Multilevel random and mixed effects models estimated average treatment effects; critical appraisal adapted ROBINS-I criteria; publication bias assessed via precision effect test and corrected using adequately powered effect sizes; Bayesian model averaging tested heterogeneity.
Limitations
- The paper states the approach is purely quantitative and meta-econometric, inherently dependent on the available evidence base, and cannot answer why particular policy designs work or under what conditions; it suggests mixed-method realist synthesis for such questions.
- The paper states substantial evidence gaps: more than 50 carbon pricing schemes have not been evaluated, fewer than ten studies assess schemes with mean carbon prices above US$ 30, only about half of studies have low risk of bias, and only 30% are adequately powered.
- The paper states that carbon price variation is dominated by between-scheme differences (91%) versus within-scheme variation (9%), limiting power to identify price effects; most primary studies assume constant treatment effects, so the finding that longer study periods show larger reductions should be treated with caution.
- Evident from the text: many schemes are covered by only one to five studies, and scheme dummies in the heterogeneity analysis may absorb omitted contextual variables, making the price coefficient difficult to interpret when scheme dummies are excluded.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
2 Valid · 1 Not valid · 17 Not checked · 57 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“We apply a multilevel estimation to account for the non-independence of effect sizes from the same study, assuming a compound symmetric variance-covariance matrix84.”
§ Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing > Methods > Effect size averaging
What the sources say
- Disputedcites [84] Viechtbauer, W. Conducting Meta-Analyses in R with the metafor Package. J. Stat. Softw. 36 (2010). http://www.jstatsoft.org/v36/i03/. sourceExperimental — accuracy not yet measured
The Conclusions (p. 42) state that the model-fitting functions described in this paper assume independent outcomes and that functions for correlated outcomes were still under development. The paper therefore does not support attributing to these models an estimation method that accounts for within-study dependence using a compound-symmetric variance-covariance matrix. (LLM, conf=0.87)
Checked by a reasoning model — may be wrong.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Similar effects are found for the EU ETS, where the effectiveness increases with the increasing stringency from phases I, II, and III70–73.”
§ Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing > Discussion
What the sources say
- Not checked yetcites [70] Colmer, J., Martin, R., Muûls, M. & Wagner, U. J. Does pricing carbon mitigate climate change? Firm-level evidence from the European Union emissions trading scheme (2022). Publisher: CEPR Discussion Paper No. DP16982.
- Partly supportedcites [71] Fernández Fernández, Y., Fernández López, M., González Hernández, D. & Olmedillas Blanco, B. Institutional change and environment: Lessons from the European emission trading system. Energies 11, 706 (2018). sourceExperimental — accuracy not yet measured
The Results and Conclusions report that each EU ETS phase had a greater emissions-reducing impact than the previous one. They describe this as a strengthening of the market, but do not establish that increasing stringency caused the increase; the Results offer several possible explanations instead. No page numbers are available in our copy. (LLM, conf=0.84)
- Not checked yetcites [72] Gupta, N., Shah, J., Gupta, S. & Kaul, R. Causal impact of european union emission trading scheme on firm behaviour and economic performance: A study of german manufacturing firms (2021). https://arxiv.org/abs/2108.07163. Publisher: arXiv Version Number: 1.
- Partly supportedcites [73] Petrick, S. & Wagner, U. J. The impact of carbon trading on industry: Evidence from german manufacturing firms. SSRN Electr. J. (2014). http://www.ssrn.com/abstract=2389800. sourceExperimental — accuracy not yet measured
The Main Results (p. 18) find little emissions abatement in phase I but substantial reductions among regulated German manufacturing firms in phase II. The Introduction (p. 3) says the analysis ends in 2010, during phase II. The paper therefore does not establish a further increase in effectiveness in phase III or show that increasing stringency caused the phase-I-to-II difference. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Studies assessing the effectiveness of carbon pricing over longer time periods find larger emission reductions.”
§ Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing > Results > Explaining heterogeneity in effect sizes
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Statistically significant emissions reductions range between –5% to –21% across the schemes (–4% to –15% after correcting for publication bias).”
- Also stated in: § Critical appraisal and publication bias · plain
“ranging from –15% to –4%.”
§ Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Critical appraisal and publication bias · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These are estimated at –7.3% [95% CI = (–10.5%, –4.0%)] and –5.4% [95% CI = (–9.6%, –1.2%)].”
§ Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing > Results > Average emissions reductions across carbon pricing schemes
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
53 more claims
Create a free account to see all 77 claims and to verify the 35 references still open.
- It may state two separate claims as one. 5
- Probably not a substantial claim. 13
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While carbon pricing has proven effective in reducing industry GHG emissions, 105”
From Decarbonizing lithium-ion battery primary raw materials supply chain (2024) · cites this paper as [105]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing > Results > Evidence base — larger and more diverse than previously suggested
“| RGGI | 11 northeastern US states | 2009 | power | 14% | $3 | 8 | 10 |”
§ Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing > Results > Evidence base — larger and more diverse than previously suggested
“five on the Regional Greenhouse Gas Initiative (RGGI) in the United States.”
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722 · cited 1×
“C) If possible, the author should include more mathematical details about “Standardising effect sizes” and “Effect size averaging” in the main body of the paper rather than in the Supplementary Information.”
BackgroundConducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · cited 1×
“Despite these adjustments, the publication bias corrected estimates support the overall finding that carbon pricing policies cause significant reductions in in GHG emissions.”
ResultWeitzman, M. L. (1974) · The Review of Economic Studies · doi:10.2307/2296698 · Cited by 2,071
Markets in licenses and efficient pollution control programs
Montgomery, W. D. (1972) · Journal of Economic Theory · doi:10.1016/0022-0531(72)90049-x · Cited by 1,781
Bayesian Model Averaging for Linear Regression Models
Raftery, A. E., Hoeting, J. A., & Madigan, D. (1997) · Cited by 1,746
Bias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model
Viechtbauer, W. (2005) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986030003261 · Cited by 1,699
Bayesian Model Averaging for Linear Regression Models
Raftery, A. E., Madigan, D., & Hoeting, J. A. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10473615 · Cited by 1,287
Research works printed but not linked: 5
- IPCC. Climate Change 2022: Mitigation of Climate Change. Contribution of Working Group III to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change (Cambridge University Press, Cambridge, UK and New York, NY, USA, 2022).
- Brodeur, A., Lé, M., Sangnier, M. & Zylberberg, Y. Star wars: The empirics strike back. Am. Econ. J.: Appl. Econ. 8, 1–32 (2016).
- Dahl, C. A. Measuring global gasoline and diesel price and income elasticities. Model. Transp. (Energy) Demand Policies 41, 2–13 (2012).
- Agnolucci, P.et al. Measuring Total Carbon Pricing. The World Bank Research Observer lkad009 (2023). https://academic.oup.com/wbro/advance-article/doi/10.1093/wbro/lkad009/7283905. · doi:10.1093/wbro/lkad009/7283905
- Ringquist, E.Meta-analysis for public management and policy (John Wiley & Sons, 2013).
Cited by
Climate policies that achieved major emission reductions: Global evidence from two decades
Stechemesser, A., Koch, N., Mark, E., Dilger, E., Klösel, P., Menicacci, L., Nachtigall, D., Pretis, F., Ritter, N., Schwarz, M., et al. (2024) · Science · doi:10.1126/science.adl6547 · Cited by 322
Self-citationTo tax or to trade? A global review of carbon emissions reduction strategies
Pan, J., Cross, J. L., Zou, X., & Zhang, B. (2024) · Energy Strategy Reviews · doi:10.1016/j.esr.2024.101508 · Cited by 102
Ahmad, M., Li, X. F., & Wu, Q. (2024) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2024.143761 · Cited by 97
Decarbonizing lithium-ion battery primary raw materials supply chain
Istrate, R., Mas-Fons, A., Beylot, A., Northey, S., Vaidya, K., Sonnemann, G., Kleijn, R., & Steubing, B. (2024) · Joule · doi:10.1016/j.joule.2024.10.003 · Cited by 60
Zhang, T., & Deng, M. (2025) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2025.145279 · Cited by 30
Metadata
- Authors
- Döbbeling-Hildebrandt, N., Miersch, K., Khanna, T. M., Bachelet, M., Bruns, S. B., Callaghan, M., Edenhofer, O., Flachsland, C., Forster, P. M., Kalkuhl, M., Koch, N., Lamb, W. F., Ohlendorf, N., Steckel, J. C., & Minx, J. C.
- Affiliations
- University of Leeds (GB)
- Mercator Research Institute on Global Commons and Climate Change (DE)
- University of British Columbia (CA)
- University of Kassel (DE)
- Hertie School (DE)
- University of Potsdam (DE)
- IZA - Institute of Labor Economics (DE)
- Corresponding author
- Döbbeling-Hildebrandt, Niklas
- Minx, Jan C.
- ORCID
- Venue
- Nature Communications
- Published
- 2024-05-16
- Volume
- 15
- Issue
- 1
- Pages
- 4147-4147
- ISSN
- 2041-1723 (ISSN-L)
- PMC
- PMC11099057
- OpenAlex
- W4396956648
- Semantic Scholar
- 70e2ae1f78f032da9244be355822390de43d9e53
- Cited by
- 164
- References
- 80
- Citations by year
- 2026: 78 · 2025: 65 · 2024: 20
- FWCI
- 17.78
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Nature Communications (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Document Server@UHasselt (UHasselt) (submittedVersion, cc-by)
- Publication Database PIK (Potsdam Institute for Climate Impact Research (PIK)) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- OPUS 4 (Zuse Institute Berlin) (submittedVersion)
- publish.UP (University of Potsdam) (submittedVersion, cc-by)
- Funders
- Heinrich Böll Stiftung
- Bundesministerium für Bildung und Forschung (03SFK5J0)
- Horizon Europe, European Commission, Directorate-General for Research and Innovation
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Climate Change Policy and Economics
- Physical Sciences › Energy › Renewable Energy, Sustainability and the Environment › Energy, Environment, and Transportation Policies
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Energy, Environment, Economic Growth
- Keywords
- carbon pricing, emission reduction, ex-post evaluation, policy effectiveness, climate policy, publication bias, evidence gaps
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing. https://app.cochat.ai/papers/10.1038/s41467-024-48512-w
- The paper
- Döbbeling-Hildebrandt, N., Miersch, K., Khanna, T. M., Bachelet, M., Bruns, S. B., Callaghan, M., Edenhofer, O., Flachsland, C., Forster, P. M., Kalkuhl, M., Koch, N., Lamb, W. F., Ohlendorf, N., Steckel, J. C., & Minx, J. C. (2024). Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing. Nature Communications. https://doi.org/10.1038/s41467-024-48512-w
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.