The Case for Participatory Evaluation in an Era of Accountability
The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the reception and use of participatory approaches to evaluation must include an understanding of the practices of new public management and of the concomitant call for accountability and performance measurement standards that currently prevail. In this article, the author discusses how accountability has been defined and understood in the context of government policies, programs, and services and provides a brief discussion of participatory and collaborative approaches to evaluation and the interrelationship between participatory evaluation and technical approaches to evaluation. The main part of the article is a critical look at key tensions between participatory and technocratic approaches to evaluation. The article concludes with a focus on the epistemological and cultural implications of the current culture of public accountability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Situated Learning: Legitimate Peripheral Participation.
Bloch, M., Lave, J., & Wenger, E. (1994) · Man · doi:10.2307/2804509 · Cited by 39,454
Situated Learning: Legitimate Peripheral Participation
Lave, J., & Wenger, E. (1991) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815355 · Cited by 35,324 · cited 1×
“…evaluation, while learning at the conceptual level moves beyond the practical and technical aspect (beyond ‘‘knowing how’’) to incorporate interactive, social, and dialogic learning, to what can be considered a form of ‘‘learning-in-practice’’ or ‘‘situated learning’’ (Lave & Wenger, 1991, p. 527).”
Background(1976) · Cited by 10,813
Mixed Methods in Social Inquiry
Greene, J. C. (2007) · Cited by 3,786
The Audit Society: Rituals of VerificationPreprint
Power, M. (1999) · RePEc: Research Papers in Economics · Cited by 3,647
The Audit Society: Rituals of Verification
Quam, L. (1998) · BMJ · doi:10.1136/bmj.316.7133.787a · Cited by 3,575 · cited 3×
“As such, accountability does not lead to greater dialogue among relevant program stakeholders (Power, 1997), but to less, as stakeholders busily engage in endless fact checking and reporting in response to state accountability requirements.”
BackgroundKnowledge and Human Interests.
Parsons, H. L., Habermas, J., & Shapiro, J. J. (1972) · Philosophy and Phenomenological Research · doi:10.2307/2106475 · Cited by 2,606
What is participatory research?
Cornwall, A., & Jewkes, R. (1995) · Social Science & Medicine · doi:10.1016/0277-9536(95)00127-s · Cited by 2,560 · cited 1×
“As Cornwall and Jewkes (1995) have observed, participatory research can be distinguished from other approaches based on ‘‘who defines the research problems and who generates, analyses, represents, owns and acts on the information which is sought’’ (p. 1668).”
BackgroundThe Educational Imagination: On the Design and Evaluation of School Programs
Eisner, E. W. (1994) · Medical Entomology and Zoology · Cited by 1,877
The SAGE Dictionary of Qualitative Inquiry
Schwandt, T. (2007) · Sage eBooks · doi:10.4135/9781412986281 · Cited by 1,516 · cited 4×
“…singular focus on performance measurement and monitoring is thus politically motivated (e.g., see Greene, 2009; Norris & Kushner, 2007; Ryan, 2007; Schwandt, 2007), as it limits stakeholder input and public dialogue, narrows program and community understanding to predetermined measures of program…”
BackgroundInfluentialCo-operative inquiry: research into the human condition
(1997) · Choice Reviews Online · doi:10.5860/choice.35-0587 · Cited by 1,199
Carter, S. M., & Little, M. (2007) · Qualitative Health Research · doi:10.1177/1049732307306927 · Cited by 1,141 · cited 9×
“As a pervasive feature of democratic liberal governments, there is no shortage of academic and popular texts on NPM broadly described as a private sector approach to governance characterized by demands for accountability and performance measures in public institutions (Blalock, 1999; Davies, 1999; McDavid & Huse, 2006…”
BackgroundMethodInfluentialLong, N., & Long, A. (2025) · doi:10.4324/9781003725367 · Cited by 861
Rethinking Democratic Accountability
Behn, R. D. (2001) · Project Muse (Johns Hopkins University) · Cited by 818
Toward Reform of Program Evaluation
Gowin, D. B., Millman, J., Cronbach, L. J., Ambron, S. R., Dornbusch, S. M., Hess, R. D., Hornik, R. C., Phillips, D. C., Walker, D. F., & Weiner, S. S. (1981) · Educational Evaluation and Policy Analysis · doi:10.2307/1163707 · Cited by 801
Framing participatory evaluation
Cousins, J. B., & Whitmore, E. (1998) · New Directions for Evaluation · doi:10.1002/ev.1114 · Cited by 680 · cited 3×
“, & Weiner, S. S. (1980). Toward a reform of program evaluation.”
BackgroundMethodRethinking Democratic Accountability
Hambrick, R. (2002) · Public Integrity · doi:10.1080/15580989.2002.11770920 · Cited by 565 · cited 1×
“Behn (2001) describes NPM as ‘‘ the entire collection of tactics and strategies that seek to enhance the performance of the public sector—to improve the ability of governmental agencies and their nonprofit and for-profit collaborators to produce results’’ (p. 26).”
BackgroundThe Case for Participatory Evaluation
Cousins, J. B., & Earl, L. M. (1992) · Educational Evaluation and Policy Analysis · doi:10.2307/1164283 · Cited by 507
Franklin, U. M. (1990) · Medical Entomology and Zoology · Cited by 405
Projects with people: the practice of participation in rural development
(1991) · Choice Reviews Online · doi:10.5860/choice.29-1005 · Cited by 397 · cited 3×
“As such, learning occurs at a practical or informational level concerning the program, the organization, the context, and the evaluation itself, as well as at a conceptual or reflective level concerning relationships to self and others (Oakley, 1991).”
BackgroundBiesta, G. J. J. (2004) · Educational Theory · doi:10.1111/j.0013-2004.2004.00017.x · Cited by 348 · cited 4×
“A technocratic approach to evaluation, on the other hand, assumes a far more modest and detached position relationally, as accountability has redefined relations between the state and its citizens to somewhat formal relationships based on economic identities (Biesta, 2004).”
BackgroundInfluentialWallerstein, N. (1999) · Social Science & Medicine · doi:10.1016/s0277-9536(99)00073-8 · Cited by 292 · cited 1×
“…potential tension between micro and macro levels highlights the tension not only between the needs of the community and the needs of the sponsor (Biott & Cook, 2000; Chaytor, MacDonald, & Melvin, 2002; Wallerstein, 1999) but also between the participatory and technocratic approach to evaluation.”
BackgroundProfessional evaluation: social impact and political consequences
(1993) · Choice Reviews Online · doi:10.5860/choice.31-1583 · Cited by 289 · cited 5×
“Historically, there has always been a very strong link between evaluation and the workings of government, where evaluation is seen as a means of informing and legitimizing governmental decision making (House, 1993), thus becoming a key part of government’s ‘‘legitimizing rhetoric’’ (Stronach et al.”
BackgroundInfluentialBecoming EcologicalAn Expedition Into Community Psychology
Kelly, J. G. (2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195173796.001.0001 · Cited by 208 · cited 4×
“The relationship itself is considered a key component of participatory research (Kelly, 2006; Trickett & Espono, 2004), as evaluators and stakeholders work together in the joint construction of evaluative knowledge (Rebien, 1996).”
BackgroundInfluentialWhat counts as credible evidence in applied research and evaluation practice?
Donaldson, S., Christie, C., & Mark, M. (2009) · Sage eBooks · doi:10.4135/9781412995634 · Cited by 204
(2001) · Cited by 175
Authorship: What is an Author?
Foucault, M. (1979) · Screen · doi:10.1093/screen/20.1.13 · Cited by 153 · cited 1×
“Power is thus conceptualized as a dynamic, relational, and productive concept (Foucault, 1979), something that is not possessed by any one individual but something that circulates and structures knowledge and its social construction at multiple levels (Foucault, 1980).”
BackgroundTrickett, E. J., & Espino, S. L. R. (2004) · American Journal of Community Psychology · doi:10.1023/b:ajcp.0000040146.32749.7d · Cited by 143
Non-Western Educational Traditions: Alternative Approaches to Educational Thought and Practice
Reagan, T. (1996) · Cited by 140
Fundamental Issues in Evaluation
Swan, A. (2009) · Drug and Alcohol Review · doi:10.1111/j.1465-3362.2009.00088_2.x · Cited by 134 · cited 2×
“…and quasi-experimental methods and toward approaches that are more inclusive and sensitive to local contexts, questions about methodologies and method choice continue to generate significant debate, remaining what Smith (2008) refers to as one of the ‘‘fundamental issues’’ in evaluation.”
BackgroundMethodKushner, S. (2000) · SAGE Publications Ltd eBooks · doi:10.4135/9781849209557 · Cited by 112
`Back to the Rough Ground!' Beyond Theory to Practice in Evaluation
Schwandt, T. A. (2003) · Evaluation · doi:10.1177/13563890030093008 · Cited by 104 · cited 1×
“Evaluation is itself considered a pedagogical undertaking (Schwandt, 2003), as learning is implicated in the creation and use of evaluation findings and through stakeholder involvement in the process and practice of evaluation.”
BackgroundMaking sense of participatory evaluation practice
King, J. A. (1998) · New Directions for Evaluation · doi:10.1002/ev.1117 · Cited by 99 · cited 5×
“Evaluation is itself considered a pedagogical undertaking (Schwandt, 2003), as learning is implicated in the creation and use of evaluation findings and through stakeholder involvement in the process and practice of evaluation. To understand the key difference between the two approaches in terms of learning, consider…”
BackgroundInfluentialSharing Stories: Narrative and Dialogue in Responsive Nursing Evaluation
Abma, T., & Widdershoven, G. A. M. (2005) · Evaluation & the Health Professions · doi:10.1177/0163278704273080 · Cited by 94
Evaluation and Performance Management in Government
Davies, I. (1999) · Evaluation · doi:10.1177/13563899922208896 · Cited by 88 · cited 2×
“…of democratic liberal governments, there is no shortage of academic and popular texts on NPM broadly described as a private sector approach to governance characterized by demands for accountability and performance measures in public institutions (Blalock, 1999; Davies, 1999; McDavid & Huse, 2006).”
BackgroundParticipatory Evaluation of Development Assistance: Dealing with Power and Facilitative Learning
Rebien, C. C. (1996) · Evaluation · doi:10.1177/135638909600200203 · Cited by 87
Fundamental issues in evaluation
Smith, N. L., & Brandon, P. R. (2008) · Cited by 56
OECD Environmental Performance Review Programme: Accountability (f)or Learning?
Lehtonen, M. (2005) · Evaluation · doi:10.1177/1356389005055536 · Cited by 56
Letiecq, B. L., & Bailey, S. J. (2004) · Evaluation Review · doi:10.1177/0193841x04265185 · Cited by 51 · cited 1×
“…diverse communities thus remains, as culturally specific and locally meaningful knowledge that is based on local (and perhaps indigenous) epistemological constructs continues to challenge the parameters of what is considered accurate, reliable, and valid knowledge (Letiecq & Bailey, 2004).”
BackgroundRandomized Experiments and Quasi-Experimental Designs in Educational Research
Steiner, P. M., Wroblewski, A., & Cook, T. D. (2009) · Sage eBooks · doi:10.4135/9781452226606.n5 · Cited by 42
The New Public Management and Evaluation
Norris, N., & Kushner, S. (2007) · Advances in program evaluation · doi:10.1016/s1474-7863(07)10001-6 · Cited by 36
Methods and mindsets: Towards an understanding of the tyranny of methodology
Bell, S. (1994) · Public Administration and Development · doi:10.1002/pad.4230140401 · Cited by 34 · cited 1×
“The focus on outcome measures at the expense of other important and relevant evaluation issues, what Bell (2004) refers to as the ‘‘tyranny of methods,’’ reduces contextual complexity and diversity to narrowly observable and recordable parameters.”
BackgroundStake, R. E. (2001) · American Journal of Evaluation · doi:10.1016/s1098-2140(01)00144-8 · Cited by 26
Fitzpatrick, J. L., Christie, C. A., & Mark, M. M. (2009) · SAGE Publications Ltd eBooks · doi:10.4135/9781412990288 · Cited by 24
Possible Palliatives for the Paralyzing Pre/Post Paranoia that Plagues Some PEP’s
Hake, R. R. (2006) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v3i6.41 · Cited by 22
When Getting It Right Matters: The Case for High-Quality Policy and Program Impact Evaluations
Henry, G. (2009) · Sage eBooks · doi:10.4135/9781412995634.d9 · Cited by 15 · cited 4×
“As such, evaluators and stakeholders are not considered separate but rather inextricably linked together in what Heron (1996) has referred to as ‘‘intersubjective space.”
BackgroundInfluentialWill Evaluation Prosper in the Future?
McDavid, J. C., & Huse, I. (2007) · Canadian Journal of Program Evaluation · doi:10.3138/cjpe.0021.004 · Cited by 15 · cited 2×
“…and performance measurement have each become strategic components of NPM, the focus on accountability and results has led to a more prominent role for performance measurement and a more circumscribed role for evaluation within public sector reform (Mayne & Rist, 2006; McDavid & Huse, 2006).”
BackgroundChanging Contexts and Relationships in Educational Evaluation
Ryan, K. E. (2007) · Advances in program evaluation · doi:10.1016/s1474-7863(07)10007-7 · Cited by 7 · cited 2×
“The singular focus on performance measurement and monitoring is thus politically motivated (e.g., see Greene, 2009; Norris & Kushner, 2007; Ryan, 2007; Schwandt, 2007), as it limits stakeholder input and public dialogue, narrows program and community understanding to predetermined measures of program success, confines…”
Background
Cited by
Culturally Responsive Evaluation
Hood, S., Hopson, R. K., & Kirkhart, K. E. (2015) · Handbook of Practical Program Evaluation · doi:10.1002/9781119171386.ch12 · Cited by 262
Metadata
- Authors
- Chouinard, J. A.
- Venue
- American Journal of Evaluation
- Publisher
- SAGE Publications
- Published
- 2013-05-06
- Volume
- 34
- Issue
- 2
- Pages
- 237-253
- ISSN
- 1098-2140 (ISSN-L)
- 1557-0878
- OpenAlex
- W1965824013
- Cited by
- 173
- References
- 48
- FWCI
- 14.96
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.