Performance Measurement Challenges in Nonprofit Human Service Organizations
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
This qualitative study examines the experiences of four nonprofit human service organizations engaging in performance measurement processes to satisfy accountability requirements and increase organizational and program effectiveness. Nonprofits are increasingly required to respond to performance measurement mandates issuing from multiple sources. However, many of the recommended strategies have been developed in the for-profit and public sectors, and are less appropriate or feasible for nonprofit organizations. Three central findings emerged from interviews, focus groups, and review of archival data. First, the complexity of human change processes and the variation among individual clients complicate efforts to define client outcomes. Second, staff skills play a critical role in effective utilization of data systems. Third, organizational strategies to support performance measurement include incorporating user perspectives into system design and providing adequate staff access to data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1984) · Cited by 81,983
Case study research: design and methods
Phelan, S. (2011) · Evaluation & Research in Education · doi:10.1080/09500790.2011.582317 · Cited by 21,763
Hartley, J. (2004) · Essential Guide to Qualitative Methods in Organizational Research · doi:10.4135/9781446280119.n26 · Cited by 15,461
Qualitative Interviewing: The Art of Hearing Data
Brooks, F. B., Rubin, H. J., & Rubin, I. S. (1996) · The Modern Language Journal · doi:10.2307/329757 · Cited by 11,180
Stake, R. E. (2005) · Cited by 6,198
Analyzing Social Settings: A Guide To Qualitative Observation And Analysis
Lofland, J., & , J. (1971) · Works - Scholarship, Research, & Creative Expression (Swarthmore College) · Cited by 5,634
Qualitative Interviewing (2nd ed.): The Art of Hearing Data
Rubin, H., & Rubin, I. (2005) · Sage eBooks · doi:10.4135/9781452226651 · Cited by 1,947 · cited 1×
“…and themes; (b) discussions among analyst team members to check and validate concepts and themes; (c) sorting and comparing to develop an “integrated analysis” (Rubin & Rubin, 2005, p. 227); and (d) discussion of findings with individual organizations to validate and further explore themes.”
BackgroundHandbook of Practical Program Evaluation
Wholey, J. S., Hatry, H. P., & Newcomer, K. E. (2010) · Cited by 960
Performance Measurement: Getting Results
Hatry, H. P. (2007) · Cited by 490
Melkers, J. E., & Willoughby, K. (2005) · Public Administration Review · doi:10.1111/j.1540-6210.2005.00443.x · Cited by 454 · cited 1×
“Performance management practices are generally internal organizational processes incorporating logic models, program evaluation, and strategic planning to create “results-oriented systems” (Hatry, 2006; Melkers & Willoughby, 2005; Speckbacher, 2003).”
BackgroundThe economics of performance management in nonprofit organizations
Speckbacher, G. (2003) · Nonprofit Management and Leadership · doi:10.1002/nml.15 · Cited by 239 · cited 2×
“Performance management practices are generally internal organizational processes incorporating logic models, program evaluation, and strategic planning to create “results-oriented systems” (Hatry, 2006; Melkers & Willoughby, 2005; Speckbacher, 2003).”
BackgroundEvaluation Practice Among Community-Based Organizations: Research Into the Reality
Carman, J. G. (2007) · American Journal of Evaluation · doi:10.1177/1098214006296245 · Cited by 191 · cited 2×
“However, many nonprofit human service organizations experience challenges related to organizational and staff capacity, and may lack the technology resources needed to collect, store, and analyze the data required for performance measurement (Carman, 2007, 2009; Zimmerman & Stevens, 2006).”
BackgroundRitchie, W. J., & Kolodinsky, R. W. (2003) · Nonprofit Management and Leadership · doi:10.1002/nml.5 · Cited by 169 · cited 1×
“…to public human service agencies (Hatry, 1997; Lindgren, 2001; McBeath & Meezan, 2006; Poole, Nelson, Carnahan, Chepenik, & Tubiak, 2000) and private foundations demanding financial and program accountability (Benjamin, 2008; Ritchie & Kolodinsky, 2003; Tassie, Murray, Cutt, & Bragg, 1996).”
Account Space: How Accountability Requirements Shape Nonprofit Practice
Benjamin, L. M. (2008) · Nonprofit and Voluntary Sector Quarterly · doi:10.1177/0899764007301288 · Cited by 159 · cited 2×
“…to public human service agencies (Hatry, 1997; Lindgren, 2001; McBeath & Meezan, 2006; Poole, Nelson, Carnahan, Chepenik, & Tubiak, 2000) and private foundations demanding financial and program accountability (Benjamin, 2008; Ritchie & Kolodinsky, 2003; Tassie, Murray, Cutt, & Bragg, 1996).”
BackgroundNonprofits, Funders, and Evaluation: Accountability in Action
Carman, J. G. (2008) · The American Review of Public Administration · doi:10.1177/0275074008320190 · Cited by 145
The Accountability Movement: What’s Wrong With This Theory of Change?
Carman, J. G. (2009) · Nonprofit and Voluntary Sector Quarterly · doi:10.1177/0899764008330622 · Cited by 141
Hatry, H. P. (2002) · Public Performance & Management Review · doi:10.1080/15309576.2002.11643671 · Cited by 133
Improving performance? The adoption and implementation of quality systems in U.K. nonprofits
Cairns, B., Harris, M., Hutchison, R., & Tricker, M. (2005) · Nonprofit Management and Leadership · doi:10.1002/nml.97 · Cited by 132
Associations between outcome measurement, accountability and learning for non‐profit organisations
Buckmaster, N. (1999) · International Journal of Public Sector Management · doi:10.1108/09513559910263499 · Cited by 130 · cited 1×
“While studies have noted that board members may also seek metrics to assess service outcomes (Buckmaster, 1999; Newcomer, 2008), the role of other internal stakeholders in determining specific goals and measures has received less attention.”
BackgroundSavaya, R., & Waysman, M. (2005) · Administration in Social Work · doi:10.1300/j147v29n02_06 · Cited by 128
Information Struggles: The Role of Information in the Reproduction of NGO-Funder Relationships
Ebrahim, A. (2002) · Nonprofit and Voluntary Sector Quarterly · doi:10.1177/0899764002311004 · Cited by 127
Understanding Contracting Performance: An Empirical Analysis
Fernández, S. (2008) · Administration & Society · doi:10.1177/0095399708330257 · Cited by 98
Exploring the Role of Funders’ Performance Reporting Mandates in Nonprofit Performance Measurement
Thomson, D. E. (2010) · Nonprofit and Voluntary Sector Quarterly · doi:10.1177/0899764009360575 · Cited by 96 · cited 1×
“Thomson (2010) found that outcome reporting mandates from government funders were associated with increased levels of performance measurement by nonprofit organizations.”
BackgroundEdwards, M. B., & Hulme, D. (2014) · doi:10.4324/9781315070704-9 · Cited by 89 · cited 1×
“Nonprofit human service organizations experience resource constraints related to staff, money, and technology needed to develop and manage performance measurement systems (Carman, 2007, 2009; Ebrahim, 2002; Edwards & Hulme, 1995; Uphoff, 1995).”
BackgroundClinical Data-Mining: Integrating Practice and Research
Epstein, I. (2009) · Medical Entomology and Zoology · Cited by 87
Learning for Performance in Nonprofit Organizations
McHargue, S. K. (2003) · Advances in Developing Human Resources · doi:10.1177/1523422303005002007 · Cited by 85 · cited 1×
“The terms performance measurement and performance management complement each other, but are sometimes confused or used interchangeably in practice and in the literature (Hatry, 2002; McHargue, 2003).”
BackgroundOrganizational Responses to Social Policy: The Case of Welfare Reform
Hasenfeld, Y. (2010) · Administration in Social Work · doi:10.1080/03643101003608976 · Cited by 75 · cited 1×
“Human service agencies operate within broad policy frameworks and unique local political economies, subjecting them to limited and fluctuating financial resources Carnochan et al. 1017 (Hasenfeld, 2010).”
BackgroundClinical Data-Mining: Integrating Practice and Research
Fouché, C. (2011) · Social Work Education · doi:10.1080/02615479.2011.586570 · Cited by 66
Carrilio, T., Packard, T. R., & Clapp, J. D. (2004) · Administration in Social Work · doi:10.1300/j147v27n04_05 · Cited by 56
The Non-profit Sector Meets the Performance-management Movement
Lindgren, L. (2001) · Evaluation · doi:10.1177/13563890122209694 · Cited by 43 · cited 2×
“…performance measurement has come primarily from external sources, including contractual obligations to public human service agencies (Hatry, 1997; Lindgren, 2001; McBeath & Meezan, 2006; Poole, Nelson, Carnahan, Chepenik, & Tubiak, 2000) and private foundations demanding financial and program…”
BackgroundWhere the rubber meets the road: Performance measurement for state and local public agencies
Hatry, H. P. (1997) · New Directions for Evaluation · doi:10.1002/ev.1078 · Cited by 37 · cited 1×
“…to engage in performance measurement has come primarily from external sources, including contractual obligations to public human service agencies (Hatry, 1997; Lindgren, 2001; McBeath & Meezan, 2006; Poole, Nelson, Carnahan, Chepenik, & Tubiak, 2000) and private foundations demanding financial…”
Background
Cited by
Nonprofit capacity and social performance: Mapping the field and future directions
Nordin, N., Khatibi, A., & Azam, S. M. F. (2024) · Management Review Quarterly · doi:10.1007/s11301-022-00297-2 · Cited by 52
Metadata
- Authors
- Carnochan, S., Samples, M., Myers, M., & Austin, M. J.
- Venue
- Nonprofit and Voluntary Sector Quarterly
- Publisher
- SAGE Publications
- Published
- 2013-10-29
- Volume
- 43
- Issue
- 6
- Pages
- 1014-1032
- ISSN
- 0094-0607 (ISSN-L)
- 0899-7640
- 1552-7395
- OpenAlex
- W2028931323
- Cited by
- 184
- References
- 31
- FWCI
- 23.70
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.