Speaking of reform: experimental insights into influencing police executives’ perspectives on civilian oversight
Open accessAbstract
Research summary: This study investigates how information about public opinion and peer practices influences police executives' views on civilian review boards. We applied structural topic modeling in an experimental paradigm, a novel approach diverging from traditional experimental survey methods, to the open‐ended responses of 1331 police executives collected in an original survey experiment. This technique enables the capture of subtle shifts in belief directly from the executives' own words. The experiment systematically varied the information provided to police executives, including state‐level public opinion data from a representative sample of 16,840 U.S. residents, and peer practices in major city police agencies. Our findings reveal that police executives, although generally aligned in their views, demonstrate a readiness to update their beliefs when presented with cohesive local public opinion and information about peer practices in policing. Policy implications: In a democratic society, the core policy beliefs of police executives critically shape the existence and efficacy of civilian oversight mechanisms. Our findings demonstrate the adaptability of police executives in updating their policy positions, reflecting their commitment to informed decision making in response to the dynamic nature of police governance. We find that police executives are willing to update their beliefs related to the public's ability to oversee policing in an unbiased and qualified manner when presented with information about reforms adopted by peer agencies. In contrast, information about public demand for more aggressive forms of oversight can lead to a backlash, increasing the likelihood of police executives to favor existing oversight mechanisms and to doubt the public's qualification. For executives, reformers, and scholars, these findings highlight the limitations of public opinion and benefits of peer influence as mechanisms for policy learning in policing.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The asymmetry helps explain why police leaders, wary of these downside risks, often resist fully embracing civilian oversight.
“This asymmetry helps explain why police leaders, wary of these downside risks, often resist fully embracing civilian oversight (5, 12).”
From Does civilian oversight impact police legitimacy? (2025) · cites this paper as [12]
Cites
Rational choice and the structure of the environment.
Simon, H. A. (1956) · Psychological Review · doi:10.1037/h0042769 · Cited by 5,919 · see citing works
Congress, The Electoral Connection
Ross, M. J., & Mayhew, D. R. (1975) · The Western Political Quarterly · doi:10.2307/447379 · Cited by 4,094 · see citing works
Structural Topic Models for Open‐Ended Survey Responses
Roberts, M. E., Stewart, B., Tingley, D. H., Lucas, C., Leder-Luis, J., Gadarian, S. K., Albertson, B. L., & Rand, D. G. (2014) · American Journal of Political Science · doi:10.1111/ajps.12103 · Cited by 1,969 · see citing works
<b>stm</b> : An <i>R</i> Package for Structural Topic Models
Roberts, M. E., Stewart, B. M., & Tingley, D. (2019) · Journal of Statistical Software · doi:10.18637/jss.v091.i02 · Cited by 1,714 · see citing works
Critical Issues in Policing: Contemporary Readings
McLean, K. D., Alpert, G. P., & Dunham, R. G. (1993) · Cited by 500 · see citing works
An Institutional Perspective of Policing
Crank, J. P., & Langworthy, R. (1992) · The Journal of Criminal Law and Criminology (1973-) · doi:10.2307/1143860 · Cited by 313 · see citing works
Enns, P. K. (2016) · Cambridge University Press eBooks · doi:10.1017/cbo9781316471029 · Cited by 297 · see citing works
The Decline of the Death Penalty and the Discovery of Innocence
Baumgartner, F. R., De Boef, S. L., & Boydstun, A. E. (2001) · Cambridge University Press · doi:10.1017/cbo9780511790638 · Cited by 242 · see citing works
Text as Data: A New Framework for Machine Learning and the Social Sciences
adams, J. (2023) · Contemporary Sociology A Journal of Reviews · doi:10.1177/00943061231214609o · Cited by 212 · see citing works
Police research, officer surveys, and response rates
Nix, J., Pickett, J. T., Baek, H., & Alpert, G. P. (2017) · Policing & Society · doi:10.1080/10439463.2017.1394300 · Cited by 204 · see citing works
Institutional theory of police: a review of the state of the art
Crank, J. P. (2003) · Policing An International Journal · doi:10.1108/13639510310475723 · Cited by 169 · see citing works
Text Mining: A Guidebook for the Social Sciences
Ignatow, G., & Mihalcea, R. F. (2017) · Sage eBooks · doi:10.4135/9781483399782 · Cited by 166 · see citing works
A Practical Algorithm for Topic Modeling with Provable GuaranteesPreprint
Arora, S., Ge, R., Halpern, Y., et al. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1212.4777 · Cited by 163 · see citing works
Judicial Selection and Death Penalty Decisions
Canes‐Wrone, B., Clark, T. S., & KELLY, J. P. (2014) · American Political Science Review · doi:10.1017/s0003055413000622 · Cited by 157 · see citing works
Navigating the Local Modes of Big Data: The Case of Topic Models
Roberts, M. E., Stewart, B., & Tingley, D. H. (2016) · Computational Social Science · doi:10.1017/cbo9781316257340.004 · Cited by 140 · see citing works
Models of police oversight: A critique
Prenzler, T., & Ronken, C. A. (2001) · Policing & Society · doi:10.1080/10439463.2001.9964860 · Cited by 106 · see citing works
All Politics Is Local? County Sheriffs and Localized Policies of Immigration Enforcement
Farris, E. M., & Holman, M. R. (2016) · Political Research Quarterly · doi:10.1177/1065912916680035 · Cited by 106 · see citing works
Surviving Information Overload: How Elite Politicians Select Information
Walgrave, S., & Dejaeghere, Y. (2016) · Governance · doi:10.1111/gove.12209 · Cited by 105 · see citing works
Thompson, D. M. (2019) · American Political Science Review · doi:10.1017/s0003055419000613 · Cited by 85 · see citing works
The communication of innovation in American policing
Weiss, A. (1997) · Policing An International Journal · doi:10.1108/13639519710169144 · Cited by 73 · see citing works
Prenzler, T. (2000) · The British Journal of Criminology · doi:10.1093/bjc/40.4.659 · Cited by 61 · see citing works
How Powerful is the Evidence in Criminology? On Whether We Should Fear a Coming Crisis of Confidence
Barnes, J. C., TenEyck, M. F., Pratt, T. C., & Cullen, F. T. (2019) · Justice Quarterly · doi:10.1080/07418825.2018.1495252 · Cited by 59 · see citing works
Nix, J., Pickett, J. T., & Wolfe, S. E. (2019) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427819873957 · Cited by 59 · see citing works
Mourtgos, S. M., & Adams, I. T. (2019) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2019.101627 · Cited by 57 · see citing works
Self-citationMourtgos, S. M., Mayer, R. C., Wise, R. A., & O’Rourke, H. P. (2019) · Criminal Justice Policy Review · doi:10.1177/0887403419851850 · Cited by 47 · see citing works
Self-citationHope, K. R. (2020) · Journal of Applied Security Research · doi:10.1080/19361610.2020.1777807 · Cited by 43 · see citing works
An exploratory study of the New York City Civilian Complaint Review Board mediation program
Bartels, E. C., & Silverman, E. B. (2005) · Policing: An International Journal of Police Strategies & Management · doi:10.1108/13639510510628703 · Cited by 39 · see citing works
Seeking 'Civilianness': Police Complaints and the Civilian Control Model of Oversight
Savage, S. P. (2013) · The British Journal of Criminology · doi:10.1093/bjc/azt033 · Cited by 36 · see citing works
Police Chief Performance and Leadership Styles
Krimmel, J. T., & Lindenmuth, P. (2001) · Police Quarterly · doi:10.1177/109861101129197950 · Cited by 34 · see citing works
Dimensionality of local police chiefs' institutional sovereigns
Matusiak, M. C. (2014) · Policing & Society · doi:10.1080/10439463.2014.989156 · Cited by 32 · see citing works
Worden, R. E., Bonner, H. S., & McLean, S. J. (2018) · Police Quarterly · doi:10.1177/1098611117739812 · Cited by 31 · see citing works
Partisan Policymaking in the Extended Party Network: The Case of Cap-and-Trade Regulations
Albert, Z. (2019) · Political Research Quarterly · doi:10.1177/1065912919838326 · Cited by 28 · see citing works
Mughan, S., Li, D., & Nicholson‐Crotty, S. (2019) · The American Review of Public Administration · doi:10.1177/0275074019891993 · Cited by 24 · see citing works
Generically partisan: Polarization in political communication
Novoa, G., Echelbarger, M., Gelman, A., & Gelman, S. A. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2309361120 · Cited by 16 · see citing works
Alpert, G., Cawthray, T. I. 0.-0.-1.-5., Rojek, J., et al. (2015) · CRC Press eBooks · doi:10.1201/b19040 · Cited by 15 · see citing works
Police Chief Culture: A View From the Top
Ingram, J. R., Paoline, E. A., Rockwell, A. R., et al. (2022) · Police Quarterly · doi:10.1177/10986111221114332 · Cited by 15 · see citing works
Adams, I. T. (2024) · Police Quarterly · doi:10.1177/10986111241241750 · Cited by 14 · see citing works
Self-citationLi, Y., & Brown, B. B. (2019) · Police Quarterly · doi:10.1177/1098611119845664 · Cited by 13 · see citing works
Getting It Right: Building Effective Civilian Review Boards to Oversee Police
Ofer, U. (2016) · Seton Hall University eRepository (Seton Hall University) · Cited by 12 · see citing works
Locally Elected Sheriffs and Money Compensation
Helms, R. (2008) · Criminal Justice Review · doi:10.1177/0734016808315588 · Cited by 11 · see citing works
Fairley, S. R. (2020) · eYLS (Yale Law School) · Cited by 9 · see citing works
The Impact of Police Unions: Summary Report.
Juris, H. A., & Feuille, P. (1973) · Cited by 6 · see citing works
Do New Chiefs Mean Fresh Perspectives? The Institutionalization of the Police Executive Environment
Matusiak, M. C. (2021) · Criminal Justice and Behavior · doi:10.1177/00938548211006753 · Cited by 6 · see citing works
Greene, H. T., & Gabbidon, S. L. (2009) · Encyclopedia of Race and Crime · doi:10.4135/9781412971928.n253 · Cited by 6 · see citing works
Public Pressure or Peer Influence: What Shapes Police Executives' Views on Civilian Oversight?Preprint
Adams, I. T., McCrain, J., Schiff, D. S., Schiff, K. J., & Mourtgos, S. M. (2022) · doi:10.31235/osf.io/mdu96 · Cited by 6 · see citing works
Self-citationThe adoption of culturally contentious innovations: The case of citizen oversight of police
Ali, M. U. (2023) · Policy Studies Journal · doi:10.1111/psj.12499 · Cited by 5 · see citing works
The Office of Sheriff in the United States
Hayes, C. (2001) · The Police Journal Theory Practice and Principles · doi:10.1177/0032258x0107400106 · Cited by 4 · see citing works
Chung, G., Rodriguez, M., Lanier, P., & Gibbs, D. (2021) · doi:10.31219/osf.io/enzst · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Adams, I. T., McCrain, J., Schiff, D. S., Schiff, K. J., & Mourtgos, S. M. (2025) · Journal of Policy Analysis and Management · doi:10.1002/pam.22620 · Cited by 13 · see citing works
Self-citationDoes civilian oversight impact police legitimacy?
Schiff, K. J., Schiff, D. S., Moy, B. J., McCrain, J., Mourtgos, S. M., & Adams, I. T. (2025) · PNAS Nexus · doi:10.1093/pnasnexus/pgaf267 · Cited by 2 · see citing works
“This asymmetry helps explain why police leaders, wary of these downside risks, often resist fully embracing civilian oversight (5, 12).”
Self-citation
- Authors
- Mourtgos, S. M., Adams, I. T., McCrain, J., Schiff, K. J., & Schiff, D. S.
- Affiliations
- University of South Carolina (US)
- University of Utah (US)
- Purdue University West Lafayette (US)
- Corresponding author
- Mourtgos, Scott M.
- Venue
- Criminology & Public Policy
- Publisher
- Informa UK Limited
- Published
- 2024-06-05
- Volume
- 23
- Issue
- 3
- Pages
- 689-720
- ISSN
- 1538-6473 (ISSN-L)
- 1745-9133
- OpenAlex
- W4399367555
- Semantic Scholar
- d7f36be1d3ac8477422885346ea46a8ef1f52700
- Cited by
- 8
- References
- 49
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 2
- FWCI
- 12.74
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Criminology & Public Policy (publishedVersion, cc-by-nc-nd)
- Topics
- Social Sciences › Political Science and International Relations › Policing Practices and Perceptions
- Social Sciences › Public Administration › Public Policy and Administration Research
- Social Sciences › Law › Criminal Justice and Penology
- Keywords
- citizen oversight of police, police executives, public opinion, peer influence, police reform, belief updating, police governance, structural topic modeling, police accountability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review