A Critique of the “Outcome Test” in Racial Profiling Research
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
In racial profiling research, four different research perspectives—legalistic, criminological, economic, and normative—have emerged. The analytical techniques of two of these perspectives, the legalistic and criminological, have been thoroughly detailed in prior research. More recently, the economic perspective has presented an alternative analytical strategy (i.e., the outcome test), to determine racial and ethnic discrimination by police. When applied to police searches, the outcome test is a statistical comparison of search success rates across racial and ethnic groups. The outcome test, however, is based on a number of underlying assumptions regarding police and citizen behaviors that do not coincide with what is known about decision‐making during police–citizen encounters. These underlying assumptions are described and the conclusions based on the use of the outcome test are critiqued. The implications for the use of the outcome test and other analytical techniques for the future of racial profiling research are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tyler, T. R. (2006) · doi:10.1515/9781400828609 · Cited by 5,156
The Economics of Discrimination
Becker, G. S. (1971) · doi:10.7208/chicago/9780226041049.001.0001 · Cited by 1,794
Racial Bias in Motor Vehicle Searches: Theory and Evidence
Knowles, J., Persico, N., & Todd, P. (2001) · Journal of Political Economy · doi:10.1086/318603 · Cited by 608
Causes of Police Behavior: the Current State of Quantitative Research
Sherman, L. W. (1980) · Journal of Research in Crime and Delinquency · doi:10.1177/002242788001700106 · Cited by 333 · cited 3×
“Yet, research examining police behavior has consistently shown that citizen behaviors during police–citizen encounters do influence officer behavior (Brooks, 2001; Engel & Silver, 2001; Engel, Sobol, & Worden, 2000; Mastrofski, Snipes, Parks, & Maxwell, 2000; Mastrofski et al., 1995; Novak et al., 2002; Riksheim & Che…”
BackgroundAn Alternative Test of Racial Prejudice in Motor Vehicle Searches: Theory and Evidence
Anwar, S., & Fang, H. (2006) · American Economic Review · doi:10.1257/000282806776157579 · Cited by 293
Engel, R. S., Sobol, J. J., & Worden, R. E. (2000) · Justice Quarterly · doi:10.1080/07418820000096311 · Cited by 259
Self-citationOutcome Tests of Racial Disparities in Police Practices
Ayres, I. (2002) · Justice Research and Policy · doi:10.3818/jrp.4.1.2002.131 · Cited by 156 · cited 2×
“…pedestrian stop, search and seizure data in an effort to determine racial and ethnic discrimination at the hands of the police (Anwar & Fang, 2006; Ayres, 2002; Borooah, 2001; Dominitz, 2003; Hernandez-Murillo & Knowles, 2004; Knowles et al., 2001; Persico & Castleman, 2005; Persico & Todd, 2006).”
BackgroundDEMEANOR OR CRIME? THE MIDWEST CITY POLICE‐CITIZEN ENCOUNTERS STUDY*
LUNDMAN, R. J. (1994) · Criminology · doi:10.1111/j.1745-9125.1994.tb01168.x · Cited by 102 · cited 1×
“…resistance, and/or physical resistance during police–citizen encounters have an influence over coercive police behavior toward those citizens (Engel & Silver, 2001; Klinger, 1994; Lundman, 1994, 1996; Novak et al., 2002; Novak & Engel, 2005; Terrill & Mastrofski, 2002; Worden & Shepard, 1996).”
BackgroundDeterminants of Citations to Articles in Elite Law Reviews
Ayres, I., & Vars, F. E. (2000) · The Journal of Legal Studies · doi:10.1086/468081 · Cited by 100
Lange, J. E., Johnson, M. B., & Voas, R. B. (2005) · Justice Quarterly · doi:10.1080/07418820500088952 · Cited by 72
Cited by
Administrative Records Mask Racially Biased Policing
Knox, D., Lowe, W., & Mummolo, J. (2019) · doi:10.2139/ssrn.3336338 · Cited by 314
Administrative Records Mask Racially Biased Policing
KNOX, D., LOWE, W., & MUMMOLO, J. (2020) · American Political Science Review · doi:10.1017/s0003055420000039 · Cited by 314
A multidisciplinary survey on discrimination analysis
Romei, A., & Ruggieri, S. (2014) · The Knowledge Engineering Review · doi:10.1017/s0269888913000039 · Cited by 288
Cumulative Disadvantage in the American Criminal Justice System
Kurlychek, M. C., & Johnson, B. D. (2019) · Annual Review of Criminology · doi:10.1146/annurev-criminol-011518-024815 · Cited by 262
Modern Police Tactics, Police-Citizen Interactions, and the Prospects for Reform
Mummolo, J. (2018) · The Journal of Politics · doi:10.1086/694393 · Cited by 161
Metadata
- Authors
- Engel, R. S.
- Venue
- Justice Quarterly
- Publisher
- Informa UK Limited
- Published
- 2008-03
- Volume
- 25
- Issue
- 1
- Pages
- 1-36
- ISSN
- 0741-8825 (ISSN-L)
- 1745-9109
- OpenAlex
- W1997598311
- Cited by
- 64
- References
- 10
- FWCI
- 47.01
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Critique of the “Outcome Test” in Racial Profiling Research. https://app.cochat.ai/papers/10.1080/07418820701717177
- The paper
- Engel, R. S. (2008). A Critique of the “Outcome Test” in Racial Profiling Research. Justice Quarterly. https://doi.org/10.1080/07418820701717177
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.