Does civilian oversight impact police legitimacy?
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index; 1 of the 20 sources its claims cite were checked for support.
Abstract
Does the implementation of external oversight in policing improve public perceptions of police legitimacy? Civilian review boards (CRBs) are frequently promoted as mechanisms to enhance the legitimacy of police agencies by providing independent oversight. Despite public support for CRBs, their adoption and effectiveness remain limited, raising concerns about their actual impact on procedural fairness and police legitimacy. This study assesses the role of CRBs in shaping public perceptions by examining various decision-making scenarios involving police chiefs and CRBs. Using a survey experiment fielded to 2,503 respondents, we investigate whether CRBs enhance legitimacy when they either coincide with or conflict with police chiefs' determinations in cases of officer misconduct. Our findings suggest that while CRBs may enhance perceptions of procedural fairness for some, particularly those with negative views of police, their involvement does not generally increase legitimacy. In fact, when CRBs conflict with police chiefs, they may diminish public trust in both policing and civilian oversight and further entrench politically polarized attitudes towards policing. These results provide empirical evidence to support concerns that CRBs might not fulfill their intended role in enhancing police legitimacy, especially in cases of institutional disagreement.
Overview
CoChat Summary
## TL;DR
In a preregistered survey experiment with 2,503 U.S. adults, the paper finds that civilian review boards (CRBs) do not generally increase perceived procedural or police legitimacy. When CRBs and police chiefs disagree, perceived legitimacy falls for both institutions, with effects that are strongly shaped by respondents’ prior attitudes and politics.
## Key findings
- The experiment surveyed 2,503 American adults in late August 2024 and found no statistically significant evidence that CRB presence increases aggregate procedural legitimacy for police misconduct investigations.
- CRB presence did matter for some respondents: people with colder feelings toward police showed higher perceived procedural legitimacy when a CRB was present, with a significant difference by police warmth (P = 0.002), while those with warm feelings saw no gain or a small negative effect.
- When CRBs matched the police chief’s decision, there was no significant boost to perceived police legitimacy (P = 0.069 when misconduct did not occur; P = 0.754 when misconduct did occur). When CRBs disagreed with the chief, police legitimacy dropped by −0.35 points and −0.41 points on the Likert scale, both P < 0.001.
- Chief determinations that misconduct occurred increased perceived police legitimacy by 0.42 Likert points (0.37 SD, P < 0.001). CRB findings that misconduct occurred increased perceived CRB legitimacy by 0.11 points (0.12 SD, P = 0.016), but this masked partisan divergence: Democrats rose by 0.45 points (0.46 SD, P < 0.001) and Republicans fell by −0.42 points (−0.44 SD, P < 0.001).
## Methods
- Design: Preregistered survey experiment with six vignette conditions. Two control vignettes had only a police-chief determination; four treatment vignettes added a CRB, either matching or mismatching the chief. Participants were also randomized to one of three misconduct types: rude language, taser use, or firearm use.
- Sample/data: Fielded in late August 2024 with 2,503 U.S. adults recruited through Prolific; the authors state the sample is representative of the U.S. population in terms of sex, age, and ethnicity.
- Analysis: Main tests used ordinary least squares (OLS) regression; for the procedural-legitimacy hypothesis, they pooled the four CRB-present conditions and compared them with the two no-CRB controls, controlling for demographics and prior attitudes/experiences.
## Limitations
- The paper states several standard survey-experiment limitations: the simplification inherent in informational vignettes, cross-sectional research, potential self-reporting bias, and stronger internal than external validity.
- The authors also note the study assumes a fixed form and function of CRBs and that interpretations of “independence” may vary across contexts; they say future research should use observational data on CRB existence and authority.
- Evidence from subgroup patterns is suggestive but not universal; the text itself makes evident that the findings are based on hypothetical scenarios, so real-world behavior or policy adoption may differ.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
1 Valid · 0 Not valid · 10 Not checked · 64 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we find that there are significant differences between individuals with warmer and colder feelings toward the police (P=0.002).”
§ Does civilian oversight impact police legitimacy? > Results > CRBs largely do not boost procedural legitimacy
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When the chief and CRB concur, agreement with their determination is very high (95% for Democrats and 84% for Republicans) when they find that misconduct occurred.”
§ Does civilian oversight impact police legitimacy? > Results > Preferences for outcomes trump preferences for institutions
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When they concur that misconduct did not occur, agreement is still quite high amongst both Democrats (72%) and Republicans (88%).”
§ Does civilian oversight impact police legitimacy? > Results > Preferences for outcomes trump preferences for institutions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We find a significant and large police legitimacy loss of 0.35 points on average on the Likert scale (0.31 SD) when a CRB says that misconduct occurred after a chief’s determination of no misconduct.”
§ Does civilian oversight impact police legitimacy? > Results > Conflict hurts police legitimacy more than consensus helps
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In addition, we find a larger significant reduction in perceived CRB legitimacy when CRBs alone say that misconduct did not occur compared to consensus between the chief and CRB that misconduct occurred (−0.38 points on the Likert scale, 0.39 SD, P<0.001).”
§ Does civilian oversight impact police legitimacy? > Results > CRB legitimacy is hurt by conflict and is politically polarized
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
27 more claims
Create a free account to see all 75 claims and every source verdict.
- Probably not a substantial claim. 16
- It may state two separate claims as one. 30
Citations
Cites
Institutionalized Organizations: Formal Structure as Myth and Ceremony
Meyer, J. W., & Rowan, B. (1977) · American Journal of Sociology · doi:10.1086/226550 · Cited by 28,308 · cited 1×
“Similarly, if CRBs appear largely symbolic — serving to satisfy external demands but remaining peripheral to actual discipline — this de-coupling from substantive outcomes further damages trust in both the oversight body and the police (10, 13).”
Toward a More General Theory of Regulation
Peltzman, S. (1976) · The Journal of Law and Economics · doi:10.1086/466865 · Cited by 4,729 · cited 1×
“However, we expect the opposite effect for CRBs that might be perceived as the relatively more lenient actor and thus as a “cap-tured” institution (27, 28).”
The role of procedural justice and legitimacy in shaping public support for policing
Sunshine, J., & Tyler, T. R. (2003) · Law & Society Review · doi:10.1111/1540-5893.3703002 · Cited by 2,973
Lupia, A. (1994) · American Political Science Review · doi:10.2307/2944882 · Cited by 1,850 · cited 1×
“In reality, most citizens know relatively little about many criminal justice institu - tions, yet public judgments of policy interventions often emerge from limited, context-specific information (34, 35).”
Stealth Democracy: Americans' Beliefs About How Government Should Work
Hibbing, J. R., & Theiss-Morse, E. (2002) · doi:10.1017/cbo9780511613722 · Cited by 1,349
Dal Bo, E. (2006) · Oxford Review of Economic Policy · doi:10.1093/oxrep/grj013 · Cited by 960 · cited 1×
“However, we expect the opposite effect for CRBs that might be perceived as the relatively more lenient actor and thus as a “cap-tured” institution (27, 28).”
Berinsky, A. J., Margolis, M. F., & Sances, M. W. (2014) · American Journal of Political Science · doi:10.1111/ajps.12081 · Cited by 951
The Etiology of Public Support for the Supreme Court
Caldeira, G. A., & Gibson, J. L. (1992) · American Journal of Political Science · doi:10.2307/2111585 · Cited by 650 · cited 1×
“Studies of the Supreme Court demonstrate competing views on whether legitimacy depends on agreement with specific rulings (15 – 17) or persists through a reservoir of goodwill despite disagreement with outcomes (18, 19).”
On the Ideological Foundations of Supreme Court Legitimacy in the American Public
Bartels, B. L., & Johnston, C. D. (2013) · American Journal of Political Science · doi:10.1111/j.1540-5907.2012.00616.x · Cited by 349 · cited 1×
“Studies of the Supreme Court demonstrate competing views on whether legitimacy depends on agreement with specific rulings (15 – 17) or persists through a reservoir of goodwill despite disagreement with outcomes (18, 19).”
An Institutional Perspective of Policing
Crank, J. P., & Langworthy, R. (1992) · The Journal of Criminal Law and Criminology (1973-) · doi:10.2307/1143860 · Cited by 313
Research works printed but not linked: 1
- Walker, 2000, Police accountability: the role of citizen oversight
Cited by
Does the type of police oversight influence public opinion about accountability?
Eck, K., & Steinert, C. (2026) · The British Journal of Criminology · doi:10.1093/bjc/azag049
Novick, R., & Robles, M. (2026) · Criminal Justice Policy Review · doi:10.1177/08874034261458676
“Experimental evidence further suggests that individuals with more favorable views of police and conservative political orientations express lower perceived legitimacy of civilian review boards when those boards challenge police authority (Schiff et al., 2025).”
Metadata
- Authors
- Schiff, K. J., Schiff, D. S., Moy, B. J., McCrain, J., Mourtgos, S. M., & Adams, I. T.
- Affiliations
- Purdue University West Lafayette (US)
- New York University (US)
- University of Utah (US)
- University of South Carolina (US)
- Corresponding author
- Schiff, Kaylyn Jackson
- ORCID
- Venue
- PNAS Nexus
- Publisher
- Oxford University Press (OUP)
- Published
- 2025-08-21
- Volume
- 4
- Issue
- 9
- Pages
- pgaf267-pgaf267
- ISSN
- 2752-6542 (ISSN-L)
- PMC
- PMC12406122
- OpenAlex
- W4413400122
- Cited by
- 2
- References
- 32
- Citations by year
- 2026: 2
- FWCI
- 7.40
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PNAS Nexus (publishedVersion, cc-by-nc)
- CrimRxiv (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by-nc)
- Funders
- National Institute of Justice (15PNIJ-23-GG-05487-RESS)
- Topics
- Social Sciences › Political Science and International Relations › Policing Practices and Perceptions
- Social Sciences › Public Administration › Public Policy and Administration Research
- Social Sciences › Law › Criminal Justice and Penology
- Keywords
- citizen oversight, police legitimacy, public trust in police, procedural justice, police misconduct, Chief of Police, political polarization, police accountability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Does civilian oversight impact police legitimacy? https://app.cochat.ai/papers/10.1093/pnasnexus/pgaf267
- The paper
- Schiff, K. J., Schiff, D. S., Moy, B. J., McCrain, J., Mourtgos, S. M., & Adams, I. T. (2025). Does civilian oversight impact police legitimacy? PNAS Nexus. https://doi.org/10.1093/pnasnexus/pgaf267
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.