Advantages of Matched Over Unmatched Opt-in Samples for Studying Criminal Justice Attitudes: A Research Note
The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
Despite the growing popularity of online opt-in samples in criminology, recent work shows that resultant findings often do not generalize. Not all opt-in samples are alike, however, and matching may improve data quality. Replicating and extending prior work, we compare the generalizability of relational inferences from unmatched and matched opt-in samples. Estimating identical models for four criminal justice outcomes, we compare multivariate regression results from national matched (YouGov) and unmatched (MTurk) opt-in samples to those from the General Social Survey (GSS). YouGov coefficients are almost always in the same direction as GSS coefficients, especially when statistically significant, and are mostly of a similar magnitude; less than 10% of the YouGov and GSS coefficients differ significantly. By contrast, MTurk coefficients are more likely to be in the wrong direction, more likely to be much larger or smaller, and are about three times as likely to differ significantly from GSS coefficients. Matched opt-in samples provide a relatively inexpensive data source for criminal justice researchers, compared to probability samples, and also appear to carry a smaller generalizability penalty than unmatched samples. Our study suggests relational inferences from matched opt-in samples are more likely to generalize than those from unmatched samples.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“YouGov uses a model-based sampling approach to produce matched, weighted samples that generalize extremely well to the US adult population”
From Rape or Homicide: Which Is Worse? (2024) · cites this paper as Graham et al., 2021
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
USING THE CORRECT STATISTICAL TEST FOR THE EQUALITY OF REGRESSION COEFFICIENTS
PATERNOSTER, R., BRAME, R., MAZEROLLE, P., & PIQUERO, A. (1998) · Criminology · doi:10.1111/j.1745-9125.1998.tb01268.x · Cited by 2,742
Reputation as a sufficient condition for data quality on Amazon Mechanical Turk
Peer, E., Vosgerau, J., & Acquisti, A. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0434-y · Cited by 1,618 · cited 1×
“Respondents were limited to those who had completed over 500 HITs (human intelligence tasks), had a 95% or higher approval rating, and were aged 18 or older in order to capture high-quality respondents (Peer et al., 2014).”
BackgroundThe Generalizability of Survey Experiments
Mullinix, K. J., Leeper, T. J., Druckman, J. N., & Freese, J. (2015) · Journal of Experimental Political Science · doi:10.1017/xps.2015.19 · Cited by 1,228 · cited 5×
“Recent research suggests that observational findings from such samples often fail to generalize (Thompson & Pickett, 2019), even though experimental results tend to be externally valid (Coppock, 2019; Mullinix et al., 2015).”
BackgroundMethodInfluentialLanders, R. N., & Behrend, T. S. (2015) · Industrial and Organizational Psychology · doi:10.1017/iop.2015.13 · Cited by 714 · cited 1×
“These are convenience samples (Landers & Behrend, 2015), but they provide a relatively inexpensive method of exploring many theories and ideas and have the potential to yield a diverse, nationwide group of respondents (Weinberg et al., 2014).”
MethodSummary Report of the AAPOR Task Force on Non-probability Sampling
Baker, R., Brick, J. M., Bates, N. A., Battaglia, M., Couper, M. P., Dever, J. A., Gile, K. J., & Tourangeau, R. (2013) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smt008 · Cited by 652 · cited 3×
“, 2018), and never has complete or even near complete coverage—it only includes Internet users who are signed up on a specific survey platform (Baker et al., 2013; Callegaro et al., 2015).”
BackgroundWeinberg, J., Freese, J., & McElhattan, D. (2014) · Sociological Science · doi:10.15195/v1.a19 · Cited by 582 · cited 1×
“These are convenience samples (Landers & Behrend, 2015), but they provide a relatively inexpensive method of exploring many theories and ideas and have the potential to yield a diverse, nationwide group of respondents (Weinberg et al., 2014).”
MethodDoes Survey Mode Still Matter? Findings from a 2010 Multi-Mode Comparison
Ansolabehere, S., & Schaffner, B. F. (2014) · Political Analysis · doi:10.1093/pan/mpt025 · Cited by 573 · cited 1×
“…Current Population Survey (Simmons & Bobo, 2015).5 Other studies find that when compared against each other, there often are as many inconsistencies in results between different probability samples as between opt-in samples and probability samples (Ansolabehere & Schaffner, 2014; Bhutta, 2012).”
ResultGeneralizing from Survey Experiments Conducted on Mechanical Turk: A Replication Approach
Coppock, A. (2019) · Political Science Research and Methods · doi:10.1017/psrm.2018.10 · Cited by 515 · cited 2×
“Finally, we focused on observational relational inferences, but research shows that opt-in samples perform better in experiments (Coppock, 2019; Mullinix et al., 2015), because of low levels of effect heterogeneity (Coppock et al.”
BackgroundGeneralizability of heterogeneous treatment effect estimates across samples
Coppock, A., Leeper, T. J., & Mullinix, K. J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1808083115 · Cited by 445 · cited 2×
“Finally, we focused on observational relational inferences, but research shows that opt-in samples perform better in experiments (Coppock, 2019; Mullinix et al., 2015), because of low levels of effect heterogeneity (Coppock et al., 2018).”
BackgroundCallegaro, M., Manfreda, K. L., & Vehovar, V. (2015) · SAGE Publications Ltd eBooks · doi:10.4135/9781529799651 · Cited by 380
The 2006 Cooperative Congressional Election Study
Vavreck, L., & Rivers, D. (2008) · Journal of Elections, Public Opinion and Parties · doi:10.1080/17457280802305177 · Cited by 368 · cited 1×
“…National Election Survey [ANES]) and random digit dial phone surveys, which suggests that this methodology may address the ignorability concern sufficiently for those outcomes–and at a fraction of the cost of large probability-based surveys (Ansolabehere & Rivers, 2013; Vavreck & Rivers, 2008).”
BackgroundTHE SOCIAL SOURCES OF AMERICANS' PUNITIVENESS: A TEST OF THREE COMPETING MODELS*
UNNEVER, J. D., & CULLEN, F. T. (2010) · Criminology · doi:10.1111/j.1745-9125.2010.00181.x · Cited by 335 · cited 1×
“Independent Variables Based on previous public opinion research on crime and justice (Brown & Socia, 2017; Cochran & Sanders, 2009; Unnever & Cullen, 2010), sociodemographic and attitudinal predictors were included in these models.”
MethodSelf-citationNot by the Book: Facebook as a Sampling Frame
Brickman Bhutta, C. (2012) · Sociological Methods & Research · doi:10.1177/0049124112440795 · Cited by 290 · cited 1×
“…Current Population Survey (Simmons & Bobo, 2015).5 Other studies find that when compared against each other, there often are as many inconsistencies in results between different probability samples as between opt-in samples and probability samples (Ansolabehere & Schaffner, 2014; Bhutta, 2012).”
ResultBrame, R., Paternoster, R., Mazerolle, P., & Piquero, A. (1998) · Journal of Quantitative Criminology · doi:10.1023/a:1023030312801 · Cited by 257 · cited 1×
“The test is appropriate because our analysis treats the different samples as representing the same population, and thus assumes the residual term’s dispersion and the functional form of the relationships are the same in all three samples (Brame et al., 1998).”
BackgroundAnsolabehere, S., & Rivers, D. (2013) · Annual Review of Political Science · doi:10.1146/annurev-polisci-022811-160625 · Cited by 257 · cited 4×
“The matched sample strategy seeks to eliminate bias due to confounded sampling by adjusting—through matching and weighting—for variables that influence selection, thus yielding a sample that approximates a simple random sample of the population (Ansolabehere & Rivers, 2013; Mercer et al., 2018).”
BackgroundMethodInfluentialPICKETT, J. T., MANCINI, C., & MEARS, D. P. (2013) · Criminology · doi:10.1111/1745-9125.12018 · Cited by 245 · cited 4×
“The matched sample strategy seeks to eliminate bias due to confounded sampling by adjusting—through matching and weighting—for variables that influence selection, thus yielding a sample that approximates a simple random sample of the population (Ansolabehere & Rivers, 2013; Mercer et al., 2018).”
BackgroundMethodInfluentialSelf-citationLIBERALISM AND FEAR AS EXPLANATIONS OF PUNITIVENESS
LANGWORTHY, R. H., & WHITEHEAD, J. T. (1986) · Criminology · doi:10.1111/j.1745-9125.1986.tb00391.x · Cited by 205 · cited 1×
“…theoretical and empirical scholarship on public opinion has considered fear of crime—under a utilitarian model of attitudes—to be a potential cause of punitiveness and support for aggressive policing (Baker et al., 2016; Kleck & Jackson, 2017; Langworthy & Whitehead, 1986; Silver & Pickett, 2015).”
BackgroundSimmons, A. D., & Bobo, L. D. (2015) · Sociological Methodology · doi:10.1177/0081175015570096 · Cited by 187 · cited 3×
“Simmons and Bobo (2015), for example, found evidence suggesting YouGov’s sample matching method eliminated bias in regression models predicting egalitarianism, but not in those predicting racial resentment.”
BackgroundResultInfluentialRace and Worrying About Police Brutality: The Hidden Injuries of Minority Status in America
Graham, A., Haner, M., Sloan, M. M., Cullen, F. T., Kulig, T. C., & Jonson, C. L. (2020) · Victims & Offenders · doi:10.1080/15564886.2020.1767252 · Cited by 175 · cited 2×
“, 2019), police brutality (Graham et al., 2020), body-worn cameras (Graham et al.”
BackgroundSelf-citationThompson, A. J., & Pickett, J. T. (2019) · Journal of Quantitative Criminology · doi:10.1007/s10940-019-09436-7 · Cited by 139 · cited 15×
“…is that any relationship between sample selection and the outcome variable(s) is spurious, due to common causes of both, such as respondent demographics, and that adjusting for these confounders through matching and weighting renders selection independent of the outcome (Thompson & Pickett, 2019).”
BackgroundMethodInfluentialSelf-citationTwenty-First Century Punitiveness: Social Sources of Punitive American Views Reconsidered
Brown, E. K., & Socia, K. M. (2016) · Journal of Quantitative Criminology · doi:10.1007/s10940-016-9319-4 · Cited by 128
Belief in Redeemability and Punitive Public Opinion: “Once a Criminal, Always a Criminal” Revisited
Burton, A. L., Cullen, F. T., Burton, V. S., Graham, A., Butler, L. C., & Thielo, A. J. (2020) · Criminal Justice and Behavior · doi:10.1177/0093854820913585 · Cited by 128 · cited 1×
“, 2019), and offender redeemability (Burton et al., 2020).”
Self-citationSILVER, J. R., & PICKETT, J. T. (2015) · Criminology · doi:10.1111/1745-9125.12092 · Cited by 121 · cited 1×
“…theoretical and empirical scholarship on public opinion has considered fear of crime—under a utilitarian model of attitudes—to be a potential cause of punitiveness and support for aggressive policing (Baker et al., 2016; Kleck & Jackson, 2017; Langworthy & Whitehead, 1986; Silver & Pickett, 2015).”
BackgroundSelf-citationENNS, P. K., & RAMIREZ, M. D. (2018) · Criminology · doi:10.1111/1745-9125.12178 · Cited by 94 · cited 2×
“…and one that is quickly becoming the most commonly utilized online sampling methodology in both criminological and sociological studies (e.g., Enns and Ramirez, 2018; Filindra & Kaplan, 2017; Haner, Cullen, et al., 2019; Lee et al., 2020; Lehmann & Pickett, 2017; Schutten et al., 2020;…”
BackgroundPublic Concern about Terrorism: Fear, Worry, and Support for Anti-Muslim Policies
Haner, M., Sloan, M. M., Cullen, F. T., Kulig, T. C., & Jonson, C. L. (2019) · Socius Sociological Research for a Dynamic World · doi:10.1177/2378023119856825 · Cited by 91
Self-citationTesting Theories of Gun Policy Preferences Among Blacks, Latinos, and Whites in America*
Filindra, A., & Kaplan, N. (2017) · Social Science Quarterly · doi:10.1111/ssqu.12418 · Cited by 88 · cited 2×
“…to, attitudes toward the death penalty and other punitive policies (Lehmann & Pickett, 2017; Norris & Mullinix, 2019; Simmons, 2017), gun control (Filindra & Kaplan, 2017; Haner, Cullen, et al., 2019), sex offenders (Social & Harris, 2016; Socia et al., 2019), specialty courts (Thielo et al.,…”
BackgroundThe gender gap in death penalty support: An exploratory study
Cochran, J. K., & Sanders, B. A. (2009) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2009.09.001 · Cited by 87 · cited 1×
“Independent Variables Based on previous public opinion research on crime and justice (Brown & Socia, 2017; Cochran & Sanders, 2009; Unnever & Cullen, 2010), sociodemographic and attitudinal predictors were included in these models.”
MethodFraming innocence: an experimental test of the effects of wrongful convictions on public opinion
Norris, R. J., & Mullinix, K. J. (2020) · Journal of Experimental Criminology · doi:10.1007/s11292-019-09360-7 · Cited by 81 · cited 1×
“…criminal justice attitudes, including, but not limited to, attitudes toward the death penalty and other punitive policies (Lehmann & Pickett, 2017; Norris & Mullinix, 2019; Simmons, 2017), gun control (Filindra & Kaplan, 2017; Haner, Cullen, et al., 2019), sex offenders (Social & Harris, 2016;…”
BackgroundDoes Crime Cause Punitiveness?
Kleck, G., & Jackson, D. B. (2016) · Crime & Delinquency · doi:10.1177/0011128716638503 · Cited by 73
Fight or flight: Integral emotions and violent intentions
Barnum, T. C., & Solomon, S. J. (2019) · Criminology · doi:10.1111/1745-9125.12222 · Cited by 70 · cited 1×
“Some studies have used unmatched opt-in samples, such as Amazon Mechanical Turk (MTurk), which allow nearly any of a platform’s users to answer the online questionnaire (e.g., Barnum & Solomon, 2019; Herman & Pogarksy, 2020; Miethe et al., 2019; Pickett et al., 2013; SeigfriedSpellar et al., 2017).”
BackgroundSocia, K. M., & Harris, A. J. (2016) · Psychology Public Policy and Law · doi:10.1037/law0000081 · Cited by 67 · cited 1×
“…& Pickett, 2017; Norris & Mullinix, 2019; Simmons, 2017), gun control (Filindra & Kaplan, 2017; Haner, Cullen, et al., 2019), sex offenders (Social & Harris, 2016; Socia et al., 2019), specialty courts (Thielo et al., 2019), prison privatization (Enns & Ramirez, 2018), terrorism (Haner,…”
Miethe, T. D., Venger, O., & Lieberman, J. D. (2018) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2018.10.006 · Cited by 58 · cited 1×
“Some studies have used unmatched opt-in samples, such as Amazon Mechanical Turk (MTurk), which allow nearly any of a platform’s users to answer the online questionnaire (e.g., Barnum & Solomon, 2019; Herman & Pogarksy, 2020; Miethe et al., 2019; Pickett et al., 2013; SeigfriedSpellar et al., 2017).”
BackgroundPunitive Attitudes Toward Individuals Convicted of Sex Offenses: A Vignette Study
Socia, K. M., Rydberg, J., & Dum, C. P. (2021) · Justice Quarterly · doi:10.1080/07418825.2019.1683218 · Cited by 56 · cited 4×
“…in both criminological and sociological studies (e.g., Enns and Ramirez, 2018; Filindra & Kaplan, 2017; Haner, Cullen, et al., 2019; Lee et al., 2020; Lehmann & Pickett, 2017; Schutten et al., 2020; Simmons, 2017; Socia et al., 2019), is matched opt-in samples, such as those from YouGov.”
BackgroundInfluentialComputer criminal behavior is related to psychopathy and other antisocial behavior
Seigfried‐Spellar, K. C., Villacís-Vukadinović, N., & Lynam, D. R. (2017) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2017.06.003 · Cited by 52
Morality, Deterrability, and Offender Decision Making
Herman, S., & Pogarsky, G. (2020) · Justice Quarterly · doi:10.1080/07418825.2019.1709884 · Cited by 51
Crime Salience and Public Willingness to Pay for Child Saving and Juvenile Punishment
Baker, T., Cleary, H. M. D., Pickett, J. T., & Gertz, M. (2013) · Crime & Delinquency · doi:10.1177/0011128713505487 · Cited by 48 · cited 3×
“attitudes—to be a potential cause of punitiveness and support for aggressive policing (Baker et al., 2016; Kleck & Jackson, 2017; Langworthy & Whitehead, 1986; Silver & Pickett, 2015).”
BackgroundSelf-citationPrisons or Problem-Solving: Does the Public Support Specialty Courts?
Thielo, A. J., Cullen, F. T., Burton, A. L., Moon, M. M., & Burton, V. S. (2019) · Victims & Offenders · doi:10.1080/15564886.2019.1595243 · Cited by 46 · cited 1×
“…gun control (Filindra & Kaplan, 2017; Haner, Cullen, et al., 2019), sex offenders (Social & Harris, 2016; Socia et al., 2019), specialty courts (Thielo et al., 2019), prison privatization (Enns & Ramirez, 2018), terrorism (Haner, Sloan, et al., 2019; Haner et al., 2020), school shootings (Lee…”
Self-citationVideos Don’t Lie: African Americans’ Support for Body-Worn Cameras
Graham, A., McManus, H. D., Cullen, F. T., Burton, V. S., & Jonson, C. L. (2019) · Criminal Justice Review · doi:10.1177/0734016819846229 · Cited by 46 · cited 1×
“…(Haner, Sloan, et al., 2019; Haner et al., 2020), school shootings (Lee et al., 2020; Schutten et al., 2020), police-community relations (McManus et al., 2019), police brutality (Graham et al., 2020), body-worn cameras (Graham et al., 2019), and offender redeemability (Burton et al., 2020).”
BackgroundSelf-citationLehmann, P. S., & Pickett, J. T. (2017) · Justice Quarterly · doi:10.1080/07418825.2016.1226939 · Cited by 40
Self-citationSimmons, A. D. (2017) · Social Forces · doi:10.1093/sf/sox031 · Cited by 36 · cited 4×
“…in both criminological and sociological studies (e.g., Enns and Ramirez, 2018; Filindra & Kaplan, 2017; Haner, Cullen, et al., 2019; Lee et al., 2020; Lehmann & Pickett, 2017; Schutten et al., 2020; Simmons, 2017; Socia et al., 2019), is matched opt-in samples, such as those from YouGov.”
BackgroundInfluentialAttributions as Anchors: How the Public Explains School Shootings and Why It Matters
Lee, H., Pickett, J. T., Burton, A. L., Cullen, F. T., Jonson, C. L., & Burton, Jr. (2022) · Justice Quarterly · doi:10.1080/07418825.2020.1769710 · Cited by 31 · cited 2×
“…(Thielo et al., 2019), prison privatization (Enns & Ramirez, 2018), terrorism (Haner, Sloan, et al., 2019; Haner et al., 2020), school shootings (Lee et al., 2020; Schutten et al., 2020), police-community relations (McManus et al., 2019), police brutality (Graham et al., 2020), body-worn…”
BackgroundMethodSelf-citationPrice of Liberty or Never Again: Americans’ Views on Preventing Mass Murder
Haner, M., Cullen, F. T., Jonson, C. L., Burton, A. L., & Kulig, T. C. (2019) · Justice Evaluation Journal · doi:10.1080/24751979.2019.1569474 · Cited by 29
Self-citationPunishing Rampage: Public Opinion on Sanctions for School Shooters
Schutten, N. M., Pickett, J. T., Burton, A. L., Cullen, F. T., Jonson, C. L., & Burton, V. S. (2020) · Justice Quarterly · doi:10.1080/07418825.2019.1707857 · Cited by 28 · cited 4×
“…2019), prison privatization (Enns & Ramirez, 2018), terrorism (Haner, Sloan, et al., 2019; Haner et al., 2020), school shootings (Lee et al., 2020; Schutten et al., 2020), police-community relations (McManus et al., 2019), police brutality (Graham et al., 2020), body-worn cameras (Graham et al.,…”
BackgroundInfluentialSelf-citationMaking America Safe Again: Public Support for Policies to Reduce Terrorism
Haner, M., Sloan, M. M., Cullen, F. T., Graham, A., Jonson, C. L., Kulig, T. C., & Aydın, Ö. (2020) · Deviant Behavior · doi:10.1080/01639625.2020.1738638 · Cited by 21 · cited 1×
“…Socia et al., 2019), specialty courts (Thielo et al., 2019), prison privatization (Enns & Ramirez, 2018), terrorism (Haner, Sloan, et al., 2019; Haner et al., 2020), school shootings (Lee et al., 2020; Schutten et al., 2020), police-community relations (McManus et al., 2019), police brutality…”
BackgroundSelf-citationFriend Not Foe? Reconsidering Race, the Police, and Community Relations
McManus, H. D., Graham, A., Cullen, F. T., Burton, V. S., & Jonson, C. L. (2019) · Race and Justice · doi:10.1177/2153368719849486 · Cited by 7 · cited 1×
“…terrorism (Haner, Sloan, et al., 2019; Haner et al., 2020), school shootings (Lee et al., 2020; Schutten et al., 2020), police-community relations (McManus et al., 2019), police brutality (Graham et al., 2020), body-worn cameras (Graham et al., 2019), and offender redeemability (Burton et al.,…”
BackgroundSelf-citation
Research works printed but not linked: 2
- Groves R. M., 2009, Survey methodology
- Mercer A., 2018, For weighting online opt-in samples, what matters most
Cited by
The American racial divide in fear of the police
Pickett, J. T., Graham, A., & Cullen, F. T. (2022) · Criminology · doi:10.1111/1745-9125.12298 · Cited by 177
“Studies have shown that YouGov’s sample-matching methodology produces high-quality data (Ansolabehere & Schaffner, 2014; Graham et al., 2021; Simmons & Bobo, 2015).”
Self-citationMetcalfe, C. F., & Pickett, J. T. (2021) · Criminology · doi:10.1111/1745-9125.12291 · Cited by 93
Self-citationMass support for proposals to reshape policing depends on the implications for crime and safety
Vaughn, P. E., Peyton, K., & Huber, G. A. (2022) · Criminology & Public Policy · doi:10.1111/1745-9133.12572 · Cited by 75
Are guns the new dog whistle? Gun control, racial resentment, and vote choice*
Schutten, N. M., Pickett, J. T., Burton, A. L., Jonson, C. L., Cullen, F. T., & Burton, V. S. (2021) · Criminology · doi:10.1111/1745-9125.12292 · Cited by 42
“…is evidence that YouGov’s sampling method works well for analyzing voting, evaluations of politicians, racial resentment, and criminal justice opinions— the topics of our study (Ansolabehere & Schaffner, 2014; Graham et al., 2020; Sanders et al., 2007; Simmons & Bobo, 2015; Vavreck & Rivers, 2008).”
Self-citationAn apple in one hand, a gun in the other: Public support for arming our nation's schools
Jonson, C. L., Burton, A. L., Cullen, F. T., Pickett, J. T., & Burton, V. S. (2021) · Criminology & Public Policy · doi:10.1111/1745-9133.12538 · Cited by 34
Self-citation
Metadata
- Authors
- Graham, A., Pickett, J. T., & Cullen, F. T.
- Affiliations
- Georgia Southern University (US)
- University at Albany, State University of New York (US)
- University of Cincinnati (US)
- Corresponding author
- Graham, Amanda
- Venue
- Crime & Delinquency
- Publisher
- SAGE Publications
- Published
- 2020-12-07
- Volume
- 67
- Issue
- 12
- Pages
- 1962-1981
- ISSN
- 0011-1287 (ISSN-L)
- 1552-387X
- OpenAlex
- W3111058860
- Semantic Scholar
- 7f893eb4a7b30c8a9740fc1c08f64d67219230f0
- Cited by
- 114
- References
- 46
- Citations by year
- 2026: 22 · 2025: 27 · 2024: 22 · 2023: 16 · 2022: 13 · 2021: 14
- FWCI
- 14.37
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Crime & Delinquency (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Keywords
- matched samples, generalizability, criminal justice attitudes, Amazon Mechanical Turk, General Social Survey, data quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.