Create a culture of experiments in environmental programs
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Organizations need a better “learning by doing” approach
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The multitude of supplementary or conflicting policies as well as other confounding factors pose a challenge to the clear identification of the causal effects of a specific policy77.”
From Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing (2024) · cites this paper as [77]
Citations
Cites
Against pandemic research exceptionalism
London, A. J., & Kimmelman, J. (2020) · Science · doi:10.1126/science.abc1731 · Cited by 375
Duflo, E. (2017) · American Economic Review · doi:10.1257/aer.p20171153 · Cited by 258
Randomized Government Safety Inspections Reduce Worker Injuries with No Detectable Job Loss
Levine, D. I., Toffel, M. W., & Johnson, M. S. (2012) · Science · doi:10.1126/science.1215191 · Cited by 212
Monitoring and enforcement of environmental regulations
Telle, K. E. (2013) · Journal of Public Economics · doi:10.1016/j.jpubeco.2013.01.001 · Cited by 81
What role should randomized control trials play in providing the evidence base for conservation?
Pynegar, E., Gibbons, J., Asquith, N., & Jones, J. P. G. (2019) · Oryx · doi:10.1017/s0030605319000188 · Cited by 81
(2006) · PsycEXTRA Dataset · doi:10.1037/e525572012-001 · Cited by 63 · cited 1×
“This evidence would provide opportunities to adjust and improve current and future programs (6, 7).”
BackgroundBrook, R. H., Keeler, E. B., Lohr, K. N., Newhouse, J. P., Ware, J. E., Rogers, W. H., Davies, A. R., Sherbourne, C. D., Goldberg, G. A., Camp, P., et al. (2006) · RAND Corporation eBooks · doi:10.7249/rb9174 · Cited by 4
Cited by
Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing
Döbbeling-Hildebrandt, N., Miersch, K., Khanna, T. M., Bachelet, M., Bruns, S. B., Callaghan, M., Edenhofer, O., Flachsland, C., Forster, P. M., Kalkuhl, M., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-48512-w · Cited by 164
Restoration of herbivory on Caribbean coral reefs: are fishes, urchins, or crabs the solution?
Butler, M. J., Durán, A., Feehan, C. J., Harborne, A. R., Hylkema, A., Patterson, J. T., Sharp, W. C., Spadaro, A. J., Wijers, T., & Williams, S. M. (2024) · Frontiers in Marine Science · doi:10.3389/fmars.2024.1329028 · Cited by 41
The causal revolution in biodiversity conservation
Jones, J. P. G., & Shreedhar, G. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01897-6 · Cited by 37
Policy evaluation and the causal analysis of public support
Carattini, S., Dur, R. A. J., & List, J. A. (2024) · Science · doi:10.1126/science.adp7497 · Cited by 38
Leveraging plant functional traits in the design of nature‐based solutions: A research agenda
Ramachandran, A., Dee, L. E., Hayden, M. T., & Suding, K. N. (2024) · Journal of Ecology · doi:10.1111/1365-2745.14371 · Cited by 11
“A promising route to achieve this is for prac - titioners and scientists to collaboratively utilize NbS as experiments from which new information is generated, which can then be used to adaptively update management strategies (Ferraro et al., 2023).”
RCTs in the wild: Designing and implementing conservation programs as randomized control trials
Pynegar, E., Booth, H., Doulton, H., Ferraro, P. J., Mohamed, M., Rakotonarivo, O. S., & Jones, J. P. G. (2025) · Conservation Science and Practice · doi:10.1111/csp2.70029 · Cited by 17
“However, while the ethical challenges associated with randomization are real (Evans, 2023; Ravallion, 2020), it can also be argued that not randomizing when randomization is possible can also be unethical (Evans, 2023; Ferraro et al., 2023).”
InfluentialSelf-citationConservation practice must catch up with commitments to local people for 30 × 30 success
Rakotonarivo, O. S., Shyamsundar, P., Kramer, R. A., & Hockley, N. J. (2025) · Nature Reviews Biodiversity · doi:10.1038/s44358-025-00021-4 · Cited by 10
Booth, H. L., Pienkowski, T., Ramdlan, M. S., Naira, K. B., Muhsin, Milner‐Gulland, E. J., Adrianto, L., & Ferraro, P. J. (2025) · Science Advances · doi:10.1126/sciadv.adr1000 · Cited by 9
“Yet, incentive programs, like most environmental programs, are rarely randomized ( 32 ).”
InfluentialSelf-citationThe value of qualitative approaches to impact evaluation in biodiversity conservation
Sharkey, W., Jeha, L., Lo, M. G. Y., Simkins, A. T., Llopis, J. C., Cadillo, M. M. F., Clarke, C., Brown, M. R. C., Sharma, P., Serem, E. K., et al. (2025) · Conservation Science and Practice · doi:10.1111/csp2.70102 · Cited by 12
Creating Pro-Environmental Behavior Change: Economic Incentives or Norm-Nudges?Preprint
Ekström, M., Bjorvatn, K., & Sjåstad, H. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4968244 · Cited by 8
Caruana, A., Muir, M. J., White, T., & Jones, J. P. G. (2024) · Conservation Science and Practice · doi:10.1111/csp2.13260 · Cited by 12
“Randomization is also challenging and will not be practical or ethical in many circumstances (Pynegar et al., 2021) but more experimental evaluation of conservation interventions should be possible (Ferraro et al., 2023; Ockendon et al., 2021; Pynegar et al., 2024).”
Rural electrification, the credibility revolution, and the limits of evidence-based policy
Peters, J., & Schmidt, C. Μ. (2025) · Environment and Development Economics · doi:10.1017/s1355770x24000263 · Cited by 7
Berger, I., Bhan, M., Bhangaonkar, R., Chaudhary, A., Mallapu, G. R., Nair, T., Ramireddy, E., Rengalakshmi, R., Ramprasad, V., Sankararaman, V., et al. (2025) · Frontiers in Sustainable Food Systems · doi:10.3389/fsufs.2025.1594356 · Cited by 7
Ferraro, P. J., & Messer, K. D. (2025) · Conservation Science and Practice · doi:10.1111/csp2.70047 · Cited by 6
“By “ formal experimentation, ” we mean the deliberate creation of spatial or temporal variation in agri-environmental program implementation with the intent of quantifying impacts and elucidating mechanisms (Ferraro et al., 2023).”
InfluentialSelf-citationLi, T., Liu, Y., Weersink, A. J., & Wagner‐Riddle, C. (2025) · npj Sustainable Agriculture · doi:10.1038/s44264-025-00078-w · Cited by 5
Policy principles for sustainable and just land systems
Garrett, R. D., Meyfroidt, P., de Bremond, A., Wartenberg, A. C., Barbieri, L. K., Fernández‐Llamazares, Á., Acheampong, E., Addoah, T., Adeleye, M. A., Alexander, P., et al. (2025) · Royal Society Open Science · doi:10.1098/rsos.250810 · Cited by 8
“To evaluate policy success, desired outcomes must be able to be monitored, including through impact evaluations [92].”
Combining price and non-price interventions for water conservation
Vivek, V., Kar, T., Meka, S., & Malghan, D. V. (2024) · Environmental Research Letters · doi:10.1088/1748-9326/ad747b · Cited by 5
Farmers’ attitudes toward economic experimentation
Englberger, L., Colen, L., & Rommel, J. (2025) · Q Open · doi:10.1093/qopen/qoaf005 · Cited by 6
Lost in the Design Space? Construct Validity in the Microfinance LiteraturePreprint
Masselus, L., Petrik, C., & Peters, J. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/nwp8k · Cited by 8
Targeted policies to break the deadlock on heating bans
Edenhofer, O., Gerster, A., Gessner, J. E., Myers, E. C., Pahle, M., & Palmer, K. (2025) · Nature Climate Change · doi:10.1038/s41558-025-02343-9 · Cited by 4
Barreiro‐Hurlé, J., & Rommel, J. (2025) · European Review of Agricultural Economics · doi:10.1093/erae/jbaf029 · Cited by 4
Benami, E., Carroll, A., Messer, K. D., Zhang, W., & Cecil, M. (2025) · Agricultural Economics · doi:10.1111/agec.70034 · Cited by 4
A landmark environmental law looks ahead
Fischman, R. L., Ruhl, J. B., Forester, B. R., Lama, T. M., Kardos, M. D., Rojas, G. A., Robinson, N. A., Shirey, P. D., Lamberti, G. A., Ando, A. W., et al. (2023) · Science · doi:10.1126/science.adn3245 · Cited by 4
Not Only for the Money: Nudging SMEs to Promote Environmental SustainabilityPreprint
Grieder, M., Kistler, D., Schlüter, F., & Schmitz, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4351587 · Cited by 5
Harnessing impact evaluation to build evidence in upstream conservation initiatives
Bianco, G. B., & Tobin, D. (2024) · Biological Conservation · doi:10.1016/j.biocon.2024.110564 · Cited by 4
Miller, J. R. B., Hendrix, T., Carlson, D., Carleton, S. A., & Muir, M. J. (2025) · Conservation Science and Practice · doi:10.1111/csp2.70050 · Cited by 3
Evaluating past and future contributions of conservation programs to species recovery
Young, R., Akçakaya, H. R., Bennett, E. L., Hoffmann, M., Hudson, M. A., Long, B., Hamilton, T. M., Neam, K., Owen, M. A., Young, R. P., et al. (2025) · Conservation Biology · doi:10.1111/cobi.70183 · Cited by 5
“However, experimental impact evaluation is rarely used in conservation (Ferraro et al., 2023; Schleicher et al., 2020).”
Assessing the past and future impact of a long‐term island restoration program
Young, R., Hudson, M. A., Cole, N. C., Cottrill, C., Henshaw, S. M., Jones, C. G., Moorhouse‐Gann, R. J., Ruhomaun, K., Seeneevassin, P., Tatayah, V., et al. (2025) · Conservation Science and Practice · doi:10.1111/csp2.70109 · Cited by 3
“While efforts are being made to address the challenge of integrating experimental and quasi-experimental evidence into conservation practice (Ferraro et al., 2023; Ockendon et al., 2021; Pynegar et al., 2024) it is still common that such approaches will not be practical or feasible for many…”
From lab to field to farm: Applying behavioral science insights to agri-environmental programs
Fleming, P., Palm‐Forster, L. H., Connuck, H., & Fodor, A. E. (2025) · Journal of Soil and Water Conservation · doi:10.1080/00224561.2025.2459580 · Cited by 3
Ghost fishing and the voluntary adoption of biodegradable gear
Do, H.-L., & Cherry, T. L. (2025) · Resource and Energy Economics · doi:10.1016/j.reseneeco.2025.101534 · Cited by 2
Self-citationFerraro, P. J., & Shimshack, J. P. (2025) · Journal of Policy Analysis and Management · doi:10.1002/pam.70056 · Cited by 2
Self-citationØrbeck, M., Lindhjem, H., Kipperberg, G., & Loureiro, M. L. (2026) · Resource and Energy Economics · doi:10.1016/j.reseneeco.2026.101569 · Cited by 2
Managing protected areas takes a village
Buřivalová, Z., & Rakotonarivo, O. S. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2425972122 · Cited by 2
Burbach, M. E., Kennedy, S. M., Rudnick, D. R., Stockton, M. C., Burr, C. A., & Rhoades, K. (2025) · Journal of Soil and Water Conservation · doi:10.1080/00224561.2025.2484975 · Cited by 3
Role of funders in embedding tests in conservation practice
Smith, R. K., Ockendon, N., Al‐Fulaij, N., Badalotti, A., Beattie, R., Byrne, J., Cooke, S. C., de Zoeten, T., Frick, W. F., Funk, S. M., et al. (2026) · Conservation Biology · doi:10.1111/cobi.70309 · Cited by 2
The Impact of Experiments on Environmental and Natural Resource Policy
Vossler, C. A., Cason, T. N., Murphy, J. J., Ferraro, P. J., Cherry, T. L., Loewenstein, G. F., Martinsson, P., Shogren, J. F., Leaf Van Boven, A., & Soest, D. P. V. (2026) · Review of Environmental Economics and Policy · doi:10.1086/741736 · Cited by 1
Self-citationBooth, H. L. (2026) · Biological Conservation · doi:10.1016/j.biocon.2026.112022 · Cited by 2
Dannenberg, A. (2025) · Water Economics and Policy · doi:10.1142/s2382624x25710018 · Cited by 1
Self-citationStream Water Age Reveals Hydrological and Human Drivers of Inland Freshwater SalinizationPreprint
Grant, S. B., Bhide, S. V., McGuire, K. J., Prestegaard, K. L., Kaushal, S. S., Sekellick, A. J., Webber, J., Jastram, J. D., Rippy, M. A., Schenk, T., et al. (2023) · Research Square · doi:10.21203/rs.3.rs-3474883/v1
Houser, M. K., Fisher, K., Fife, A., Bunn, A., & McHenry, J. (2026) · Journal of Rural Studies · doi:10.1016/j.jrurstud.2026.104192 · Cited by 1
Booth, H. L. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6643240
Shimshack, J. P., & Ferraro, P. J. (2025) · OSF Preprints (OSF Preprints)
Self-citationTemporal and spatial trends in study designs used to understand what works in conservation
Staples, A., Morgan, W. H., Dicks, L. V., Petrovan, S. O., Smith, R. K., Sutherland, W. J., & Christie, A. P. (2026) · Journal of Applied Ecology · doi:10.1111/1365-2664.70478
Rommel, J. (2026) · Springer eBooks · doi:10.1007/978-3-032-31066-8_12
Xie, L., Messer, K. D., Palm‐Forster, L. H., Masters, M., Michael, H. A., & Rowles, K. (2026) · American Journal of Agricultural Economics · doi:10.1002/ajae.70101
Metadata
- Authors
- Ferraro, P. J., Cherry, T. L., Shogren, J. F., Vossler, C. A., Cason, T. N., Flint, H. B., Hochard, J. P., Johansson-Stenman, O., Martinsson, P., Murphy, J. J., Newbold, S. C., Thunström, L., van Soest, D., van ’t Veld, K., Dannenberg, A., Loewenstein, G. F., & van Boven, L.
- Affiliations
- Johns Hopkins University (US)
- University of Wyoming (US)
- University of Tennessee at Knoxville (US)
- Purdue University West Lafayette (US)
- Department of Economics, University of Gothenburg, Gothenburg, Sweden.
- Technical University of Denmark (DK)
- University of Alaska Anchorage (US)
- Department of Economics, Tilburg University, Tilburg, Netherlands.
- Department of Economics, University of Wyoming, Laramie, WY, USA.
- University of Kassel (DE)
- Carnegie Mellon University (US)
- Department of Psychology and Neuroscience, University of Colorado, Boulder, CO, USA.
- ORCID
- Venue
- Science
- Published
- 2023-08-18
- Volume
- 381
- Issue
- 6659
- Pages
- 735-737
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W4385927882
- Cited by
- 46
- References
- 7
- Citations by year
- 2026: 9 · 2025: 24 · 2024: 10 · 2023: 3
- FWCI
- 8.45
- Type
- journal article
- Language
- en
- Open access
- Licence
- other-oa
- Locations
- Science (publishedVersion)
- Tilburg University Research Portal (publishedVersion, other-oa)
- Research portal (Tilburg University) (publishedVersion, other-oa)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Institutional Research Information System University of Turin (University of Turin) (submittedVersion)
- Topics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Research, Science, and Academia
- Physical Sciences › Environmental Science › Management, Monitoring, Policy and Law › Conservation, Ecology, Wildlife Education
- Keywords
- organizational learning, hands-on learning, experimentation, environmental programs, organizational culture, environmental management
- MeSH terms
- Learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.