Searching for Equilibrium: The Tenuous Nature of the Outcome Test
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Based on Engel's critique of the outcome test and Persico and Todd's response, the underlying assumptions critical to the outcome test are summarized and discussed. It is argued that many of these assumptions are not met when applied to police search data. The key underlying assumption—the principle of equilibrium—is examined in detail, and several additional concerns are raised. Thereafter, the proper interpretations of outcome test analyses are reiterated, and discussion regarding the types of racial bias demonstrated by these analyses is further explored.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“the KPT model of behaviour requires strong assumptions, including that drivers and officers are rational actors and that every driver has perfect knowledge of the likelihood that he or she will be searched.”
From A large-scale analysis of racial disparities in police stops across the United States (2020) · cites this paper as [28]
Citations
Cites
Racial Bias in Motor Vehicle Searches: Theory and Evidence
Knowles, J., Persico, N., & Todd, P. (2001) · Journal of Political Economy · doi:10.1086/318603 · Cited by 608
An Alternative Test of Racial Prejudice in Motor Vehicle Searches: Theory and Evidence
Anwar, S., & Fang, H. (2006) · American Economic Review · doi:10.1257/000282806776157579 · Cited by 293
A New Look at Racial Profiling: Evidence from the Boston Police Department
Antonovics, K., & Knight, B. G. (2009) · Review of Economics and Statistics · doi:10.1162/rest.91.1.163 · Cited by 292 · cited 1×
“…other economists have also questioned the strength of the KPT model based on these problematic underlying assumptions or have altered the model in an attempt to address the inframarginality problem (e.g., Antonovics & Knight, 2004; Dharmapala & Ross, 2004; Hernandez-Murillo & Knowles, 2004).”
BackgroundOutcome Tests of Racial Disparities in Police Practices
Ayres, I. (2002) · Justice Research and Policy · doi:10.3818/jrp.4.1.2002.131 · Cited by 156
A New Look at Racial Profiling: Evidence from the Boston Police Department
Antonovics, K., & Knight, B. (2004) · National Bureau of Economic Research · doi:10.3386/w10634 · Cited by 98
Tomaskovic-Devey, D., Mason, M., & Zingraff, M. (2004) · Police Quarterly · doi:10.1177/1098611103259858 · Cited by 96
Toward a better understanding of racial and ethnic disparities in search and seizure rates
ENGEL, R. S., & Johnson, R. (2006) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2006.09.014 · Cited by 93
Self-citationPersico, N., & Todd, P. (2006) · The Economic Journal · doi:10.1111/j.1468-0297.2006.01126.x · Cited by 86 · cited 11×
“Despite the apparent applicability of the outcome test in other social relationships, as reported by Persico and Todd (2008), there is clear empirical evidence to suggest that both police and citizens do not possess ready known information regarding the behavior of the other group.”
BackgroundResultInfluentialINTERIM REPORT OF THE STATE POLICE REVIEW TEAM REGARDING ALLEGATIONS OF RACIAL PROFILING
Verniero, P., Zoubek, P. H., & Stone, D. L. (1999) · Cited by 71
A Critique of the “Outcome Test” in Racial Profiling Research
ENGEL, R. S. (2008) · Justice Quarterly · doi:10.1080/07418820701717177 · Cited by 71 · cited 12×
“Essentially, the economic perspective argues that even if historically oppressed groups are searched at higher rates compared to Caucasians, this type of police behavior is acceptable so long as the outcomes of those searches are equivalent across racial groups (Engel, 2008).”
BackgroundInfluentialSelf-citation
Research works printed but not linked: 10
- Colorado State Patrol . 2004 . 2003 Traffic stop data Retrieved 14 July 2006, from http://www.csp.state.co.us/
- Engel , R. S. 2004 . Arizona Department of Safety Traffic Stop Data Report, January 2003–December 2003 Submitted to the US District Attorney's Office (District of Arizona) in the matter of US v. Gayle and the Coconino County, Arizona Prosecutor's Office in the matter of Arizona v. Palacios
- Engel , R. S. , Calnon , J. M. , Tillyer , R. , Johnson , R. R. , Liu , L. and Wang , X. 2005 . Project on police–citizen contacts, year 2 final report Harrisburg, PA Submitted to the Pennsylvania State Police
- Engel , R. S. , Tillyer , R. and Cherkauskas , J. 2007 . Understanding best search and seizure practices: Final report , Columbus, OH : Officer of the Superintendent . Submitted to the Ohio State Highway Patrol
- Iowa Division of Criminal and Juvenile Justice Planning . 2003 . An examination of Iowa State Patrol traffic stops 10/00–3/02 , Des Moines, IA : Iowa Division of Criminal and Juvenile Justice .
- Lovrich , N. , Gaffney , M. , Mosher , C. , Pickerill , M. and Smith , M. R. 2003 . Washington State Patrol traffic stop data analysis project report , Pullman, WA : Washington State University .
- Missouri Attorney General's Office . 2004 . Racial profiling data, 2003 , Columbia, MO : Missouri Division of Criminal Justice .
- Smith , W. R. , Tomaskovic‐Devey , D. , Zingraff , M. T. , Mason , H. M. , Warren , P. Y. and Wright , C. P. 2003 . The North Carolina highway traffic study , Raleigh, NC : North Carolina State University .
- Texas Department of Public Safety . 2003 . Traffic stop data report Retrieved 14 July 2006, from http://www.txdps.state.tx.us/directorstaff/publicinformation/trafrep/2001totals.pdf
- Wilson , G. 2002 . Kentucky vehicle stops database 2001 report , Frankfurt : Kentucky Justice Cabinet .
Cited by
A large-scale analysis of racial disparities in police stops across the United States
Pierson, E., Simoiu, C., Overgoor, J., Corbett-Davies, S., Jenson, D., Shoemaker, A., Ramachandran, V., Barghouty, P., Phillips, C., Shroff, R., et al. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0858-1 · Cited by 552
Race Discrimination: An Economic Perspective
Lang, K., & Spitzer, A. K.-L. (2020) · Journal of Economic Perspectives · doi:10.1257/jep.34.2.68 · Cited by 220
The problem of infra-marginality in outcome tests for discrimination
Simoiu, C., Corbett-Davies, S., & Goel, S. (2017) · The Annals of Applied Statistics · doi:10.1214/17-aoas1058 · Cited by 154
“For example, Engel and Tillyer (2008) argue that because consent searches involve decisions by both officers and drivers, they should not be used to investigate possible discrimination in officer decisions; Maclin (2008) disagrees, claiming that consent searches give officers “discretion to conduct…”
BackgroundInfluentialOut of Place: Racial Stereotypes and the Ecology of Frisks and Searches Following Traffic Stops
Carroll, L., & Gonzalez, M. L. (2014) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427814523788 · Cited by 94
Methodological Challenges and Opportunities in Testing for Racial Discrimination in Policing
Neil, R., & Winship, C. (2018) · Annual Review of Criminology · doi:10.1146/annurev-criminol-011518-024731 · Cited by 87
Metadata
- Authors
- Engel, R. S., & Tillyer, R.
- Affiliations
- University of Cincinnati (US)
- Corresponding author
- Engel, Robin S.
- Venue
- Justice Quarterly
- Publisher
- Informa UK Limited
- Published
- 2008-03
- Volume
- 25
- Issue
- 1
- Pages
- 54-71
- ISSN
- 0741-8825 (ISSN-L)
- 1745-9109
- OpenAlex
- W2135544201
- Cited by
- 30
- References
- 19
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 2 · 2023: 2 · 2021: 2 · 2020: 2 · 2019: 1 · 2018: 3 · 2017: 2 · 2016: 4 · 2014: 1 · 2013: 1 · 2012: 2
- FWCI
- 10.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Justice Quarterly (publishedVersion)
- Funders
- University of Cincinnati
- Topics
- Social Sciences › Political Science and International Relations › Policing Practices and Perceptions
- Social Sciences › Law › Criminal Law and Evidence
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Keywords
- police searches, racial bias, racial disparities in policing, police stop and frisk
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Searching for Equilibrium: The Tenuous Nature of the Outcome Test. https://app.cochat.ai/papers/10.1080/07418820701717243
- The paper
- Engel, R. S., & Tillyer, R. (2008). Searching for Equilibrium: The Tenuous Nature of the Outcome Test. Justice Quarterly. https://doi.org/10.1080/07418820701717243
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.