The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Is voluntary certification of tropical agricultural commodities achieving sustainability goals for small-scale producers? A review of the evidence
Open accessAbstract
Over the last several decades, voluntary certification programs have become a key approach to promote sustainable supply chains for agricultural commodities. These programs provide premiums and other benefits to producers for adhering to environmental and labor practices established by the certifying entities. Following the principles of Cochrane Reviews used in health sciences, we assess evidence to evaluate whether voluntary certification of tropical agricultural commodities (bananas, cocoa, coffee, oil palm, and tea) has achieved environmental benefits and improved economic and social outcomes for small-scale producers at the level of the farm household. We reviewed over 2600 papers in the peer-review literature and identified 24 cases of unique combinations of study area, certification program, and commodity in 16 papers that rigorously analyzed differences between treatment (certified households) and control groups (uncertified households) for a wide range of response variables. Based on analysis of 347 response variables reported in these papers, we conclude that certification is associated on average with positive outcomes for 34% of response variables, no significant difference for 58% of variables, and negative outcomes for 8% of variables. No significant differences were observed for different categories of responses (environmental, economic and social) or for different commodities (banana, coffee and tea), except negative outcomes were significantly less for environmental than other outcome categories ( p = 0.01). Most cases (20 out of 24) investigated coffee certification and response variables were inconsistent across cases, indicating the paucity of studies to conduct a conclusive meta-analysis. The somewhat positive results indicate that voluntary certification programs can sometimes play a role in meeting sustainable development goals and do not support the view that such programs are merely greenwashing. However, results also indicate that certification is not a panacea to improve social outcomes or overall incomes of smallholder farmers. Rigorous analysis, standardized criteria, and independent evaluation are needed to assess effectiveness of certification programs in the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242
Cochrane Handbook for Systematic Reviews of Interventions
Higgins, J. P. T., Green, S., & Ben Van Den, A. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.123 · Cited by 5,670
Matching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478 · cited 1×
“The treatment and control groups are constructed from the matched pairs (Stuart 2010).”
Inference with Difference-in-Differences and Other Panel Data
Donald, S. G., & Lang, K. (2007) · Review of Economics and Statistics · doi:10.1162/rest.89.2.221 · Cited by 1,324
Shade Coffee: A Disappearing Refuge for Biodiversity
Perfecto, I., Rice, R. A., Greenberg, R., & van der Voort, M. E. (1996) · BioScience · doi:10.2307/1312989 · Cited by 1,040
Bacon, C. (2005) · World Development · doi:10.1016/j.worlddev.2004.10.002 · Cited by 793
The Economics of Smallholder Organic Contract Farming in Tropical Africa
Bolwig, S., Gibbon, P., & Jones, S. (2009) · World Development · doi:10.1016/j.worlddev.2008.09.012 · Cited by 410
Poverty and biodiversity: Measuring the overlap of human poverty and the biodiversity hotspots
Fisher, B., & Christopher, T. (2007) · Ecological Economics · doi:10.1016/j.ecolecon.2006.05.020 · Cited by 361
De Beenhouwer, M., Aerts, R., & Honnay, O. (2013) · Agriculture, Ecosystems & Environment · doi:10.1016/j.agee.2013.05.003 · Cited by 355
Food Standards, Certification, and Poverty among Coffee Farmers in Uganda
Chiputwa, B., Spielman, D. J., & Qaim, M. (2015) · World Development · doi:10.1016/j.worlddev.2014.09.006 · Cited by 318
Producer-Level Benefits of Sustainability Certification
BLACKMAN, A., & RIVERA, J. (2011) · Conservation Biology · doi:10.1111/j.1523-1739.2011.01774.x · Cited by 314
The Impact of Fair Trade Certification for Coffee Farmers in Peru
Ruben, R., & Fort, R. (2012) · World Development · doi:10.1016/j.worlddev.2011.07.030 · Cited by 305
Field‐Testing Ecological and Economic Benefits of Coffee Certification Programs
PHILPOTT, S. M., BICHIER, P., RICE, R., & GREENBERG, R. (2007) · Conservation Biology · doi:10.1111/j.1523-1739.2007.00728.x · Cited by 210
Méndez, V. E., Bacon, C. M., Olson, M., Petchers, S., Herrador, D., Carranza, C., Trujillo, L., Guadarrama-Zugasti, C., Cordón, A., & Mendoza, A. (2010) · Renewable Agriculture and Food Systems · doi:10.1017/s1742170510000268 · Cited by 205
Responding to Globalization: Impacts of Certification on Colombian Small-Scale Coffee Growers
Rueda, X., & Lambin, E. F. (2013) · Ecology and Society · doi:10.5751/es-05595-180321 · Cited by 205
Tscharntke, T., Milder, J. C., Schroth, G., Clough, Y., DeClerck, F., Waldron, A., Rice, R., & Ghazoul, J. (2015) · Conservation Letters · doi:10.1111/conl.12110 · Cited by 203
Arnould, E. J., Plastina, A., & Ball, D. (2009) · Journal of Public Policy & Marketing · doi:10.1509/jppm.28.2.186 · Cited by 202
Jena, P. R., Chichaibelu, B. B., Stellmacher, T., & Grote, U. (2012) · Agricultural Economics · doi:10.1111/j.1574-0862.2012.00594.x · Cited by 193
Sustainability Standards for Palm Oil: Challenges for Smallholder Certification Under the RSPO
Brandi, C., Cabani, T., Hosang, C., Schirmbeck, S., Westermann, L., & Wiese, H. (2015) · The Journal of Environment & Development · doi:10.1177/1070496515593775 · Cited by 186
Bacon, C. M., Sundstrom, W. A., Flores Gómez, M. E., Ernesto Méndez, V., Santos, R., Goldoftas, B., & Dougherty, I. (2014) · Global Environmental Change · doi:10.1016/j.gloenvcha.2014.02.005 · Cited by 185
van Rijsbergen, B., Elbers, W., Ruben, R., & Njuguna, S. N. (2016) · World Development · doi:10.1016/j.worlddev.2015.08.021 · Cited by 184
Productivity and profitability of multistrata organic versus conventional coffee farms in Costa Rica
Lyngbæk, A. E., Muschler, R. G., & Sinclair, F. (2001) · Agroforestry Systems · doi:10.1023/a:1013332722014 · Cited by 155
Green, S., & Higgins, J. P. T. (2008) · Wiley eBooks · doi:10.1002/9780470712184.ch2 · Cited by 140
Milder, J. C., Arbuthnot, M., Blackman, A., Brooks, S. E., Giovannucci, D., Gross, L., Kennedy, E. T., Komives, K., Lambin, É. F., Lee, A., et al. (2014) · Conservation Biology · doi:10.1111/cobi.12411 · Cited by 131
Gockowski, J., Afari-Sefa, V., Sarpong, D. B., Osei-Asare, Y., & Agyeman, N. F. (2013) · International Journal of Agricultural Sustainability · doi:10.1080/14735903.2013.772714 · Cited by 124
Qiao, Y., Halberg, N., Vaheesan, S., & Scott, S. (2015) · Renewable Agriculture and Food Systems · doi:10.1017/s1742170515000162 · Cited by 122
Assessing Certification as Governance: Effects and Broader Consequences for Coffee
Auld, G. A. (2010) · The Journal of Environment & Development · doi:10.1177/1070496510368506 · Cited by 115
Rueda, X., Thomas, N. E., & Lambin, É. F. (2014) · Regional Environmental Change · doi:10.1007/s10113-014-0607-y · Cited by 110
Assessing the environmental impact of palm oil produced in Thailand
Saswattecha, K., Kroeze, C., Jawjit, W., & Hein, L. (2015) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2015.03.037 · Cited by 102
McDermott, C. L. (2012) · Environmental Science & Policy · doi:10.1016/j.envsci.2012.06.008 · Cited by 91
Takahashi, R., & Todo, Y. (2013) · Journal of Environmental Management · doi:10.1016/j.jenvman.2013.08.025 · Cited by 81
Farm Resilience in Organic and Nonorganic Cocoa Farming Systems in Alto Beni, Bolivia
Jacobi, J., Schneider, M., Pillco, M. I., Huber, S., Weidmann, S., Bottazzi, P., & Rist, S. (2015) · Agroecology and Sustainable Food Systems · doi:10.1080/21683565.2015.1039158 · Cited by 74
Living in times of solidarity: Fair trade and the fractured life worlds of Guatemalan coffee farmers
Arce, A. M. G. (2009) · Journal of International Development · doi:10.1002/jid.1634 · Cited by 67
Rainforest Alliance Certification of Kenyan tea farms: a contribution to sustainability or tokenism?
Ochieng, B., Hughey, K. F. D., & Bigsby, H. R. (2012) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2012.07.048 · Cited by 48
Byerlee, D., & Rueda, X. (2015) · Forests · doi:10.3390/f6041301 · Cited by 46
The COSA Measuring Sustainability Report: Coffee and Cocoa in 12 CountriesPreprint
Cosa (2013) · SSRN Electronic Journal · Cited by 42
Empirical Assessment of Eco-Certification: The Case of Ecuadorian Bananas
Melo, C. J., & Wolf, S. A. (2005) · Organization & Environment · doi:10.1177/1086026605279461 · Cited by 34
Cited by
The role of supply-chain initiatives in reducing deforestation
Lambin, E. F., Gibbs, H. K., Heilmayr, R., Carlson, K. M., Fleck, L. C., Garrett, R. D., le Polain de Waroux, Y., McDermott, C. L., McLaughlin, D., Newton, P., et al. (2018) · Nature Climate Change · doi:10.1038/s41558-017-0061-1 · Cited by 481
Downs, S. M., Ahmed, S., Fanzo, J., & Herforth, A. (2020) · Foods · doi:10.3390/foods9040532 · Cited by 466
Self-citationBarrios, E., Gemmill-Herren, B., Bicksler, A., Siliprandi, E., Brathwaite, R., Moller, S., Batello, C., & Tittonell, P. (2020) · Ecosystems and People · doi:10.1080/26395916.2020.1808705 · Cited by 293
“…to foster broader partnerships among farmers, cooperatives, consumer associations as well as national research and advisory services, rural development organization and local governments, embodied in the main-streaming circular and solidarity economy (Méndez et al. 2010; DeFries et al. 2017).”
BackgroundTraders as sustainability governance actors in global food supply chains: a research agenda
Grabs, J., & Carodenuto, S. L. (2021) · Business Strategy and the Environment · doi:10.1002/bse.2686 · Cited by 151
Designing effective and equitable zero-deforestation supply chain policies
Grabs, J., Cammelli, F., Levy, S. A., & Garrett, R. D. (2021) · Global Environmental Change · doi:10.1016/j.gloenvcha.2021.102357 · Cited by 95
Metadata
- Authors
- DeFries, R. S., Fanzo, J., Mondal, P., Remans, R., & Wood, S. A.
- Venue
- Environmental Research Letters
- Publisher
- IOP Publishing
- Published
- 2017-03-01
- Volume
- 12
- Issue
- 3
- Pages
- 033001
- ISSN
- 1748-9326 (ISSN-L)
- OpenAlex
- W2590153719
- Cited by
- 265
- References
- 37
- FWCI
- 39.27
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.