Assessing the Sustainability of Small Farmer Natural Resource Management Systems. A Critical Analysis of the MESMIS Program (1995-2010)
Open accessThe DOI matches its Crossref record; 68 of the 74 references it cites were found in a registry or an index; 5 of the 40 sources its claims cite were checked for support.
Abstract
Astier, M., L. García-Barrios, Y. Galván-Miyoshi, C. E. González-Esquivel, and O. R. Masera. 2012. Assessing the sustainability of small farmer natural resource management systems. A critical analysis of the MESMIS program (1995-2010). Ecology and Society 17(3): 25. https://doi.org/10.5751/ES-04910-170325
Overview
CoChat Summary
TL;DR
This paper is a critical review of the MESMIS program, a 15-year sustainability assessment effort for small-farmer natural resource management systems (NRMS), with reported impact in 60 case studies and 20 undergraduate and graduate programs mainly in Ibero-America. It argues that MESMIS has been useful for participatory, interdisciplinary sustainability assessment, but that stronger treatment of dynamics, trade-offs, longitudinal evaluation, and stakeholder participation is still needed.
Key findings
- The MESMIS experience spans more than 60 case studies in Latin America, Spain, Portugal, and the United States, and the authors note 20 undergraduate and graduate programs mainly in Ibero-America.
- From a reviewed sample of 25 case studies, the authors report that 13 were in Mexico, 8 in Central and South America, 3 in Spain and Portugal, and 1 in the USA.
- In those case studies, the framework was able to: characterize NRMS and subsystems; link systemic attributes to sustainability indicators; integrate indicators with multicriteria tools; propose multiscale assessment; develop multimedia learning tools; and promote participatory processes.
- The paper identifies major gaps across the reviewed cases: difficulty deriving stability/resilience indicators, insufficient attention to trade-offs, partial stakeholder involvement, few longitudinal evaluations, and lack of tools for long-term participatory evaluation without external funding.
Methods
- This is a critical analysis / program review, not an empirical experiment; it synthesizes the MESMIS program’s 15 years of experience and discusses its components: theoretical framework, operational structure, case studies, teaching/training, and participatory processes.
- The authors draw on a sample of 25 case studies selected from the 60 documented by their group, chosen based on the quality and quantity of available data.
- The analysis is largely descriptive and comparative, using the case studies to examine how MESMIS was applied and to motivate an improved iterative evaluation cycle.
Limitations
- The paper explicitly states that many case studies struggled to incorporate dynamic concepts, and that there was lack of quantitative and qualitative analysis of system dynamical behaviors.
- The paper also states that there was insufficient consideration of trade-offs, partial involvement of rural producers and other actors, lack of longitudinal evaluations, and lack of scientific approaches/tools for long-term participatory evaluation without funding.
- Evident from the text: the review is based on a non-random sample of 25 cases selected for data availability, so its conclusions are not a complete statistical assessment of all MESMIS applications.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
1 Valid · 8 Not valid · 23 Not checked · 44 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“In most cases, the alternative NRMS is based on agroecological principles, such as crop diversification, soil conservation, and external input reduction (Astier et al. 2011).”
What the sources say
- Could not verifycites Astier et al. 2011 sourceExperimental — accuracy not yet measured
The retrieved passages consist of bibliographic material and an Abstract, but no passage from the paper’s main text addresses whether most alternative NRMS cases used the three stated principles. Searches for “alternative NRMS,” “agroecological principles,” “soil conservation,” and “external input use” did not retrieve a decisive main-text passage. (LLM, conf=0.65)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“One of the few exceptions was the work of Martínez (2005) in Sinaloa, Mexico, where an alternative crop-forestry-grazing system, based on tropical legumes and semifeedlot silage, was compared against a conventional system over a nine-year period (Fig. 4; Martínez 2005, Astier et al. 2011).”
What the sources say
- Not matchedcites Martínez 2005
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Could not verifycites Astier et al. 2011 sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 2 unverifiable. Expand the claim to see per-atom verdicts.
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(b) link attributes, i.e., general systemic properties, with sustainability indicators to assess critical socioeconomic and environmental aspects of the NRMS;”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(d) propose an initial multiscale assessment to articulate processes and actors at different spatial scales;”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“(e) develop multimedia learning tools, i.e., Interactive-MESMIS, to help users understand dynamic concepts, trade-offs, and counter-intuitive behavior;”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
23 more claims
Create a free account to see all 76 claims and to verify the 2 references still open.
- Probably not a substantial claim. 41
- It may state two separate claims as one. 15
- The quote only partly states this claim. 2
Citations
Cites
A General Framework for Analyzing Sustainability of Social-Ecological Systems
Ostrom, E. (2009) · Science · doi:10.1126/science.1172133 · Cited by 8,656
Understanding the complexity of economic, ecological and social systems
Holling, C. S. (2001) · Ecosystems · doi:10.1007/s10021-001-0101-5 · Cited by 4,087
(2002) · Cited by 3,806
Panarchy: Understanding Transformations in Human and Natural Systems
Price, M. F. (2003) · Biological Conservation · doi:10.1016/s0006-3207(03)00041-7 · Cited by 3,293
An overview of APSIM, a model designed for farming systems simulation
Keating, B. A., Carberry, P. S., Hammer, G. L., Probert, M. E., Robertson, M. J., Holzworth, D., Huth, N. I., Hargreaves, J. N. G., Meinke, H., Hochman, Z., et al. (2003) · European Journal of Agronomy · doi:10.1016/s1161-0301(02)00108-9 · Cited by 2,878
Navigating Social-Ecological Systems: Building Resilience for Complexity and Change
Berkes, F., Colding, J., & Folke, C. (2008) · Cited by 2,793
Walker, B., Carpenter, S. R., Anderies, J. M., Abel, N., Cumming, G., Janssen, M. A., Lebel, L., Norberg, J., Peterson, G. D., & Pritchard, R. (2002) · Conservation Ecology · doi:10.5751/es-00356-060114 · Cited by 1,567
Critical Transitions in Nature and Society
Scheffer, M. (2009) · doi:10.1515/9781400833276 · Cited by 1,394
Learning in and about complex systems
Sterman, J. D. (1994) · System Dynamics Review · doi:10.1002/sdr.4260100214 · Cited by 1,279
Navigating Social-Ecological Systems: Building Resilience for Complexity and Change
(2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511541957 · Cited by 1,059
Cited by
Agroecology and the design of climate change-resilient farming systems
Altieri, M. A., Nicholls, C. I., Henao, A., & Lana, M. A. (2015) · Agronomy for Sustainable Development · doi:10.1007/s13593-015-0285-2 · Cited by 1,472
“9) Many of the 60 case studies of sustainability assessments conducted in Latin America using the MESMIS framework have confirmed this (Astier et al. 2012).”
BackgroundA Systematic Review of the Measurement of Sustainable Diets
Jones, A. D., Hoey, L., Blesh, J., Miller, L., Green, A., & Shapiro, L. F. (2016) · Advances in Nutrition · doi:10.3945/an.115.011015 · Cited by 299
Gaming for smallholder participation in the design of more sustainable agricultural landscapes
Speelman, E. N., García‐Barrios, L., Groot, J. C. J., & Tittonell, P. A. (2013) · Agricultural Systems · doi:10.1016/j.agsy.2013.09.002 · Cited by 151
Self-citationMethods to assess farming sustainability in developing countries. A review
Schindler, J., Graef, F., & König, H. J. (2015) · Agronomy for Sustainable Development · doi:10.1007/s13593-015-0305-2 · Cited by 113
Soto, R. L., Martínez‐Mena, M., Padilla, M. C., & de Vente, J. (2020) · Agriculture Ecosystems & Environment · doi:10.1016/j.agee.2020.107191 · Cited by 114
Metadata
- Authors
- Astier, M., García-Barrios, L., Galván-Miyoshi, Y., González-Esquivel, C. E., & Masera, O. R.
- Affiliations
- Centro de Investigaciones en Geografía Ambiental (MX)
- El Colegio de la Frontera Sur (MX)
- Michigan State University (US)
- Universidad Nacional Autónoma de México (MX)
- Venue
- Ecology and Society
- Publisher
- Resilience Alliance, Inc.
- Published
- 2012
- Volume
- 17
- Issue
- 3
- ISSN
- 1708-3087 (ISSN-L)
- OpenAlex
- W2096604110
- Cited by
- 137
- References
- 74
- Citations by year
- 2026: 8 · 2025: 8 · 2024: 3 · 2023: 10 · 2022: 9 · 2021: 12 · 2020: 20 · 2019: 6 · 2018: 16 · 2017: 11 · 2016: 10 · 2015: 12 · 2014: 6 · 2013: 5 · 2012: 1
- FWCI
- 6.12
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Ecology and Society (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Digital Library Of The Commons Repository (Indiana University) (submittedVersion)
- Funders
- Consejo Nacional de Ciencia y Tecnología
- Topics
- Life Sciences › Agricultural and Biological Sciences › Agronomy and Crop Science › Sustainable Agricultural Systems Analysis
- Physical Sciences › Environmental Science › Global and Planetary Change › Conservation, Biodiversity, and Resource Management
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Socioeconomics of Resources and Conservation
- Keywords
- smallholder farmers, natural resource management, sustainability assessment, agricultural extension, program evaluation, sustainable agriculture, Mexico
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing the Sustainability of Small Farmer Natural Resource Management Systems. A Critical Analysis of the MESMIS Program (1995-2010). https://app.cochat.ai/papers/10.5751/es-04910-170325
- The paper
- Astier, M., García-Barrios, L., Galván-Miyoshi, Y., González-Esquivel, C. E., & Masera, O. R. (2012). Assessing the Sustainability of Small Farmer Natural Resource Management Systems. A Critical Analysis of the MESMIS Program (1995-2010). Ecology and Society. https://doi.org/10.5751/es-04910-170325
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.