The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Misleading Evidence and Evidence-Led Policy: Making Social Science more Experimental
Abstract
Increasing demands by government for “evidence-led” policy raise the risk that research evidence will mislead government rather than leading to an unbiased conclusion. The need for unbiased research conclusions has never been greater, yet few consumers of research understand the statistical biases with which science must always struggle. This article introduces the volume's discussion of those issues with an explanation of the major threats of bias in social science research and a map of the differing scientific opinions on how to deal with those threats. The thesis of the volume is that many of these threats could be reduced by making social science more experimental. The fact that even experimental evidence contains threats of bias does not alter that claim but merely suggests another: that educated consumers of social science may be the best defense against misleading evidence of all kinds.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890 · cited 1×
“The lumpers in this instance are those scientists who rely on a single estimate from all available studies taken together, a procedure usually called metaanalysis (see Glass 1976; Cooper and Hedges 1994).”
BackgroundIdentification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Streptomycin Treatment of Pulmonary Tuberculosis: A Medical Research Council Investigation
(1948) · BMJ · doi:10.1136/bmj.2.4582.769 · Cited by 986
Cited by
The Empirical Status of Social Learning Theory: A Meta‐Analysis
Pratt, T. C., Cullen, F. T., Sellers, C. S., Thomas Winfree, L., Madensen, T. D., Daigle, L. E., Fearn, N. E., & Gau, J. M. (2010) · Justice Quarterly · doi:10.1080/07418820903379610 · Cited by 670
Effects of early family/parent training programs on antisocial behavior and delinquency
Piquero, A. R., Farrington, D. P., Welsh, B. C., Tremblay, R., & Jennings, W. G. (2009) · Journal of Experimental Criminology · doi:10.1007/s11292-009-9072-x · Cited by 402
Welsh, B. C., Peel, M. E., Farrington, D. P., Elffers, H., & Braga, A. A. (2011) · Journal of Experimental Criminology · doi:10.1007/s11292-010-9117-1 · Cited by 79
How can we improve surgical research and innovation?: The IDEAL framework for action
Hirst, A., Agha, R. A., Rosin, D., & McCulloch, P. (2013) · International Journal of Surgery · doi:10.1016/j.ijsu.2013.09.016 · Cited by 50
Conditional Objectivism: A Strategy for Connecting the Social Sciences and Practical Decision-Making
Reber, R., & Bullot, N. J. (2019) · Theory and History in the Human and Social Sciences · doi:10.1007/978-3-030-33099-6_5 · Cited by 7
Metadata
- Authors
- Sherman, L. W.
- Venue
- The ANNALS of the American Academy of Political and Social Science
- Publisher
- SAGE Publications
- Published
- 2003-09
- Volume
- 589
- Issue
- 1
- Pages
- 6-19
- ISSN
- 0002-7162 (ISSN-L)
- 1552-3349
- OpenAlex
- W2085798590
- Cited by
- 179
- References
- 3
- FWCI
- 52.20
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Misleading Evidence and Evidence-Led Policy: Making Social Science more Experimental. https://app.cochat.ai/papers/10.1177/0002716203256266
- The paper
- Sherman, L. W. (2003). Misleading Evidence and Evidence-Led Policy: Making Social Science more Experimental. The ANNALS of the American Academy of Political and Social Science. https://doi.org/10.1177/0002716203256266
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.