The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Trying to do more Good than Harm in Policy and Practice: The Role of Rigorous, Transparent, Up-to-Date Evaluations
Abstract
Because professionals sometimes do more harm than good when they intervene in the lives of other people, their policies and practices should be informed by rigorous, transparent, up-to-date evaluations. Surveys often reveal wide variations in the type and frequency of practice and policy interventions, and this evidence of collective uncertainty should prompt the humility that is a precondition for rigorous evaluation. Evaluation should begin with systematic assessment of as high a proportion as possible of existing relevant, reliable research, and then, if appropriate, additional research. Systematic, up-to-date reviews of research—such as those that the Cochrane and Campbell Collaborations endeavor to prepare and maintain—are designed to minimize the likelihood that the effects of interventions will be confused with the effects of biases and chance. Policy makers and practitioners can choose whether, and if so how, they wish their policies and practices to be informed by research. They should be clear, however, that the lives of other people will often be affected by the validity of their judgments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309 · cited 1×
“…create comparison groups, those in which the allocation schedule has not been concealed from the people making decisions about the eligibility and assignment of participants yield larger estimates of treatment effects (Juni, Altman, and Egger 2001; Kunz and Oxman 1998; Kunz, Vist, and Oxman 2003).”
BackgroundTransplantation of Embryonic Dopamine Neurons for Severe Parkinson's Disease
Freed, C. R., Greene, P. E., Breeze, R. E., Tsai, W.-Y., DuMouchel, W., Kao, R., Dillon, S., Winfield, H., Culver, S., Trojanowski, J. Q., et al. (2001) · New England Journal of Medicine · doi:10.1056/nejm200103083441002 · Cited by 2,366
Kunz, R., & Oxman, A. D. (1998) · BMJ · doi:10.1136/bmj.317.7167.1185 · Cited by 770 · cited 2×
“…systematic reviews of research assessing the effects of interventions must take into account that studies with different research designs tend to yield different estimates of the effects of interventions (Kunz and Oxman 1998; Britton et al. 1998; MacLehose et al. 2000; Kunz, Vist, and Oxman 2003).”
BackgroundCHALMERS, I. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26345.x · Cited by 561
Self-citationA brief history of research synthesis
Chalmers, I., Hedges, L. V., & Cooper, H. (2002) · Evaluation & the Health Professions · doi:10.1177/0163278702025001003 · Cited by 552
Self-citationInvestigating and Dealing with Publication and Other Biases
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch11 · Cited by 449
Does research design affect study outcomes in criminal justice?
Weisburd, D., Lum, C. M., & Petrosino, A. (2001) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/000271620157800104 · Cited by 335
MacLehose, Reeves, Harvey, Sheldon, Russell, & Black (2000) · Health Technology Assessment · doi:10.3310/hta4340 · Cited by 311
Paradigm wars: Some thoughts on a personal and public trajectory
Oakley, A. (1999) · International Journal of Social Research Methodology · doi:10.1080/136455799295041 · Cited by 112 · cited 1×
“Researchers need to draw on a variety of research designs (Oakley 1999, 2000; Macintyre and Petticrew 2000), for example, to develop defining criteria for attention-deficit hyperactivity disorder, to survey the frequency of mental illness in prison populations, to investigate the validity of…”
Background
Cited by
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Cambridge Handbook of Experimental Political Science
(2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511921452 · Cited by 611
The Use of Research Evidence in Public Health Decision Making Processes: Systematic Review
Orton, L., Lloyd-Williams, F., Taylor-Robinson, D., O'Flaherty, M., & Capewell, S. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021704 · Cited by 599
O. B. O. T. C.-S. G., Grant, S., Mayo-Wilson, E., Montgomery, P., Macdonald, G., Michie, S., Hopewell, S., & Moher, D. (2018) · Trials · doi:10.1186/s13063-018-2735-z · Cited by 348
Use of evidence in WHO recommendations
Oxman, A. D., Lavis, J. N., & Fretheim, A. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60675-8 · Cited by 287
Metadata
- Authors
- Chalmers, I.
- Venue
- The ANNALS of the American Academy of Political and Social Science
- Publisher
- SAGE Publications
- Published
- 2003-09
- Volume
- 589
- Issue
- 1
- Pages
- 22-40
- ISSN
- 0002-7162 (ISSN-L)
- 1552-3349
- OpenAlex
- W2103777651
- Cited by
- 229
- References
- 11
- FWCI
- 12.06
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Trying to do more Good than Harm in Policy and Practice: The Role of Rigorous, Transparent, Up-to-Date Evaluations. https://app.cochat.ai/papers/10.1177/0002716203254762
- The paper
- Chalmers, I. (2003). Trying to do more Good than Harm in Policy and Practice: The Role of Rigorous, Transparent, Up-to-Date Evaluations. The ANNALS of the American Academy of Political and Social Science. https://doi.org/10.1177/0002716203254762
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.