Data collection instrument and procedure for systematic reviews in the guide to community preventive services11The names and affiliations of the Task Force members are listed on page v of this supplement and at http://www.thecommunityguide.org
Open accessAbstract
INTRODUCTION: A standardized abstraction form and procedure was developed to provide consistency, reduce bias, and improve validity and reliability in the Guide to Community Preventive Services: Systematic Reviews and Evidence-Based Recommendations (the Guide). DATA COLLECTION INSTRUMENT: The content of the abstraction form was based on methodologies used in other systematic reviews; reporting standards established by major health and social science journals; the evaluation, statistical and meta-analytic literature; expert opinion and review; and pilot-testing. The form is used to classify and describe key characteristics of the intervention and evaluation (26 questions) and assess the quality of the study's execution (23 questions). Study procedures and results are collected and specific threats to the validity of the study are assessed across six categories (intervention and study descriptions, sampling, measurement, analysis, interpretation of results and other execution issues). DATA COLLECTION PROCEDURES: Each study is abstracted by two independent reviewers and reconciled by the chapter development team. Reviewers are trained and provided with feedback. DISCUSSION: What to abstract and how to summarize the data are discretionary choices that influence conclusions drawn on the quality of execution of the study and its effectiveness. The form balances flexibility for the evaluation of papers with different study designs and intervention types with the need to ask specific questions to maximize validity and reliability. It provides a structured format that researchers and others can use to review the content and quality of papers, conduct systematic reviews, or develop manuscripts. A systematic approach to developing and evaluating manuscripts will help to promote overall improvement of the scientific literature.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Guide to Community Preventive Services methods were used for this review.
“Guide to Community Preventive Services (“Community Guide”) methods were used for this review.8,9”
Studies of limited quality of execution were excluded from analysis.
“Studies of limited quality of execution were excluded from analysis.8,9”
From Permanent Supportive Housing with Housing First to Reduce Homelessness and Promote Health among Homeless Populations with Disability: A Community Guide Systematic Review (2020) · cites this paper as [9]
The Data Collection Instrument section (p. 3) describes scoring studies for quality of execution, and the study-quality instructions (p. 24) explain how to record limitations. Neither passage says that studies rated as having limited quality were excluded from analysis; searches for exclusion and evidence synthesis found no such rule in our copy. (LLM, conf=0.72)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Qualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420 · see citing works
(2008) · Springer eBooks · doi:10.1007/978-0-387-77282-0_6 · Cited by 17,410 · see citing works
Evidence-Based Medicine: How to Practice and Teach EBM
Sackett, D. L. (2000) · Cited by 5,950 · see citing works
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,657 · see citing works
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127 · see citing works
Guide to Clinical Preventive Services
Allen, T. W. (1991) · The Journal of the American Osteopathic Association · doi:10.1515/jom-1991-900515 · Cited by 2,132 · see citing works
van Aalst, J., Mu, J., Damşa, C. I., & Msonde, S. E. (2021) · Routledge eBooks · doi:10.4324/9781315697239-20 · Cited by 1,363 · see citing works
Sackett, D. L. (1997) · Seminars in Perinatology · doi:10.1016/s0146-0005(97)80013-4 · Cited by 1,063 · see citing works
Briss (2000) · doi:10.1016/s0749-3797(99)00119-1 · Cited by 565 · see citing works
Healing Medicare: Managing Health System Change the Canadian Way
Spasoff, R. A. (1995) · Europe PMC (PubMed Central) · Cited by 334 · see citing works
Improving Immunization Coverage Rates: An Evidence-based Review of the Literature
Shefer, A. M., Briss, P. A., Rodewald, L. E., Bernier, R. H., Strikas, R. A., Yusuf, H., Ndiaye, S. M., Wiliams, S., Pappaioanou, M., & Hinman, A. R. (1999) · Epidemiologic Reviews · doi:10.1093/oxfordjournals.epirev.a017992 · Cited by 178 · see citing works
Self-citationTruman, B. I., Smith-Akin, C. K., Hinman, A. R., Gebbie, K. M., Brownson, R. C., Novick, L. F., Lawrence, R. S., Pappaioanou, M., Fielding, J. E., Evans, C. A., et al. (2000) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(99)00124-5 · Cited by 177 · see citing works
Self-citationThe Program Evaluation Standards: How to Assess Evaluations of Educational Programs
Sanders, J. R. (1994) · Medical Entomology and Zoology · Cited by 164 · see citing works
(1994) · PubMed · Cited by 69 · see citing works
Zaza, S., Lawrence, R. S., Mahan, C. S., Fullilove, M. T., Fleming, D., Isham, G. J., & Pappaioanou, M. (2000) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(99)00123-3 · Cited by 55 · see citing works
Self-citationImproving immunization coverage.
Joseph, A., Abraham, S., Bhattacharji, S., Muliyil, J., Kr, J., Ethirajan, N., George, K., & Ks, J. (1988) · PubMed · Cited by 31 · see citing works
[Statistics and public health].
Enderica, R. (1968) · PubMed · Cited by 2 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [9]9. Kafadar K, Andrews JS. Investigating health effects and hazards in the community. In: Stroup DF, Teutsch SM, eds. Statistics and public health: quantitative approaches to public health problems. New York: Oxford University Press, 1998:93-122.
Cited by
Sorted by citations
Grading quality of evidence and strength of recommendations
(2004) · BMJ · doi:10.1136/bmj.328.7454.1490 · Cited by 8,477 · see citing works
Actual Causes of Death in the United States, 2000
Mokdad, A. H. (2004) · JAMA · doi:10.1001/jama.291.10.1238 · Cited by 5,211 · see citing works
The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers
Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., et al. (2018) · Education for Information · doi:10.3233/efi-180221 · Cited by 4,737 · see citing works
“The algorithm was developed based on several existing algorithms of quantitative study designs (Hartling et al., 2010; Hartling et al., 2011; National Institute for Health Care Excellence, 2012; Scottish Intercollegiate Guidelines Network; Seo et al., 2016; West et al., 2002; Zaza et al., 2000).”
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553 · see citing works
Evaluating non-randomised intervention studies
Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D. (2003) · Health Technology Assessment · doi:10.3310/hta7270 · Cited by 2,907 · see citing works
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755 · see citing works
Glanz, K., & Bishop, D. B. (2010) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.012809.103604 · Cited by 2,336 · see citing works
The effectiveness of interventions to increase physical activityA systematic review1 and 2
KAHN, E., RAMSEY, L., BROWNSON, R., HEATH, G., HOWZE, E., POWELL, K., STONE, E., RAJAB, M., & CORSO, P. (2002) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(02)00434-8 · Cited by 2,022 · see citing works
Sanderson, S., Tatt, I. D., & Higgins, J. P. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym018 · Cited by 1,531 · see citing works
Speck, R. M., Courneya, K. S., Mâsse, L. C., Duval, S., & Schmitz, K. H. (2010) · Journal of Cancer Survivorship · doi:10.1007/s11764-009-0110-5 · Cited by 1,352 · see citing works
Atkins, D., Eccles, M., Flottorp, S., Guyatt, G. H., Henry, D., Hill, S., Liberati, A., O'Connell, D., Oxman, A. D., Phillips, B., et al. (2004) · BMC Health Services Research · doi:10.1186/1472-6963-4-38 · Cited by 1,235 · see citing works
Heyn, P., Abreu, B. C., & Ottenbacher, K. J. (2004) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2004.03.019 · Cited by 1,223 · see citing works
Kim, S. Y., Park, J. E., Lee, Y. J., Seo, H.-J., Sheen, S.-S., Hahn, S., Jang, B.-H., & Son, H.-J. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.09.016 · Cited by 1,165 · see citing works
Livingston, J. D., Milne, T., Fang, M. L., & Amari, E. (2012) · Addiction · doi:10.1111/j.1360-0443.2011.03601.x · Cited by 927 · see citing works
Flynn, M. A. T., McNeil, D. A., Maloff, B., Mutasingwa, D., Wu, M., Ford, C., & Tough, S. C. (2006) · Obesity Reviews · doi:10.1111/j.1467-789x.2006.00242.x · Cited by 925 · see citing works
Heath, G. W., Brownson, R. C., Kruger, J., Miles, R., Powell, K. E., Ramsey, L. T., & _, _. (2006) · Journal of Physical Activity and Health · doi:10.1123/jpah.3.s1.s55 · Cited by 703 · see citing works
Controlled Physical Activity Trials in Cancer Survivors: A Systematic Review and Meta-analysis
Schmitz, K. H., Holtzman, J., Courneya, K. S., Mâsse, L. C., Duval, S., & Kane, R. (2005) · Cancer Epidemiology, Biomarkers & Prevention · doi:10.1158/1055-9965.epi-04-0703 · Cited by 638 · see citing works
Anderson, L. M., Quinn, T. A., Glanz, K., Ramirez, G., Kahwati, L. C., Johnson, D. B., Buchanan, L. R., Archer, W. R., Chattopadhyay, S., Kalra, G. P., et al. (2009) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.07.003 · Cited by 623 · see citing works
Self-citationSay, L., & Raine, R. (2007) · Bulletin of the World Health Organization · doi:10.2471/blt.06.035659 · Cited by 585 · see citing works
Increasing Physical Activity With Mobile Devices: A Meta-Analysis
Fanning, J., Mullen, S. P., & McAuley, E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2171 · Cited by 457 · see citing works
Balk, E. M., Earley, A., Raman, G., Avendano, E. A., Pittas, A. G., & Remington, P. L. (2015) · Annals of Internal Medicine · doi:10.7326/m15-0452 · Cited by 371 · see citing works
HIV risk and preventive interventions in transgender women sex workers
Poteat, T., Wirtz, A. L., Radix, A., Borquez, A., Silva-Santisteban, A., Deutsch, M. B., Khan, S. I., Winter, S., & Operario, D. (2015) · The Lancet · doi:10.1016/s0140-6736(14)60833-3 · Cited by 359 · see citing works
Web 2.0 chronic disease self-management for older adults: a systematic review
Stellefson, M., Chaney, B., Barry, A. E., Chavarria, E., Tennant, B., Walsh-Childers, K., Sriram, P. S., & Zagora, J. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2439 · Cited by 315 · see citing works
Effectiveness of participatory ergonomic interventions on health outcomes: a systematic review
Rivilis, I., Van Eerd, D., Cullen, K., Cole, D. C., Irvin, E., Tyson, J., & Mahood, Q. (2008) · Applied Ergonomics · doi:10.1016/j.apergo.2007.08.006 · Cited by 326 · see citing works
Effectiveness of Universal School-Based Programs to Prevent Violent and Aggressive Behavior
Hahn, R., Fuqua-Whitley, D., Wethington, H., Lowy, J., Crosby, A., Fullilove, M., Johnson, R., Liberman, A., Moscicki, E., Price, L., et al. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.04.012 · Cited by 307 · see citing works
A critical review of interventions for the primary prevention of perpetration of partner violence
Whitaker, D. J., Morrison, S., Lindquist, C., Hawkins, S. R., O'Neil, J. A., Nesius, A. M., Mathew, A., & Reese, L. (2006) · Aggression and Violent Behavior · doi:10.1016/j.avb.2005.07.007 · Cited by 299 · see citing works
Ampatzoglou, A., Bibi, S., Avgeriou, P., Verbeek, M., & Chatzigeorgiou, A. (2019) · Information and Software Technology · doi:10.1016/j.infsof.2018.10.006 · Cited by 305 · see citing works
Cigarette Smoking Increases Complications Following Fracture: A Systematic Review
Scolaro, J. A., Schenker, M. L., Yannascoli, S., Baldwin, K., Mehta, S., & Ahn, J. (2014) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.m.00081 · Cited by 279 · see citing works
Coordinated School Health Programs and Academic Achievement: A Systematic Review of the Literature
Murray, N. G., Low, B. J., Hollis, C., Cross, A. W., & Davis, S. M. (2007) · Journal of School Health · doi:10.1111/j.1746-1561.2007.00238.x · Cited by 251 · see citing works
School-Based Health Centers to Advance Health Equity
Knopf, J. A., Finnie, R. K. C., Peng, Y., Hahn, R. A., Truman, B. I., Vernon-Smiley, M., Johnson, V. C., Johnson, R. L., Fielding, J. E., Muntaner, C., et al. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.01.009 · Cited by 248 · see citing works
“Information on study methods, results, and interpretation was abstracted following standard Community Guide criteria.(44) Using Community Guide methods,(44,45) each study was assessed for threats to internal and external validity—including inadequate descriptions of the intervention, population, sampling frame, and in…”
Self-citationSmokefree Policies to Reduce Tobacco Use
Hopkins, D. P., Razi, S., Leeks, K. D., Priya Kalra, G., Chattopadhyay, S. K., & Soler, R. E. (2010) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.10.029 · Cited by 242 · see citing works
Self-citationMathes, T., Klaßen, P., & Pieper, D. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0431-4 · Cited by 240 · see citing works
Beerens, H. C., Zwakhalen, S. M. G., Verbeek, H., Ruwaard, D., & Hamers, J. P. H. (2013) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2013.02.005 · Cited by 219 · see citing works
Fisher, E. B., Boothroyd, R. I., Elstad, E. A., Hays, L., Henes, A., Maslow, G. R., & Velicer, C. (2017) · Clinical Diabetes and Endocrinology · doi:10.1186/s40842-017-0042-3 · Cited by 196 · see citing works
Dissemination and Implementation Research on Community-Based Cancer Prevention
Rabin, B. A., Glasgow, R. E., Kerner, J. F., Klump, M. P., & Brownson, R. C. (2010) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.12.035 · Cited by 172 · see citing works
Trabold, N., McMahon, J., Alsobrooks, S., Whitney, S., & Mittal, M. (2020) · Trauma, Violence, & Abuse · doi:10.1177/1524838018767934 · Cited by 174 · see citing works
Katz, D. L. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100307 · Cited by 169 · see citing works
Baron, R. C., Melillo, S., Rimer, B. K., Coates, R. J., Kerner, J., Habarta, N., Chattopadhyay, S., Sabatino, S. A., Elder, R., & Leeks, K. J. (2010) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.09.031 · Cited by 163 · see citing works
Erbas, B., Jazayeri, M., Lambert, K. A., Katelaris, C. H., Prendergast, L. A., Tham, R., Parrodi, M. J., Davies, J., Newbigin, E., Abramson, M. J., et al. (2018) · Allergy · doi:10.1111/all.13407 · Cited by 156 · see citing works
Financial incentives for physical activity in adults: systematic review and meta-analysis
Mitchell, M. S., Orstad, S. L., Biswas, A., Oh, P. I., Jay, M., Pakosh, M. T., & Faulkner, G. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2019-100633 · Cited by 143 · see citing works
History of preterm birth and subsequent cardiovascular disease: a systematic review
Robbins, C. L., Hutchings, Y., Dietz, P. M., Kuklina, E. V., & Callaghan, W. M. (2014) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2013.09.020 · Cited by 125 · see citing works
Mindfulness interventions in schools: Integrity and feasibility of implementation
Emerson, L.-M., de Diaz, N. N., Sherwood, A., Waters, A., & Farrell, L. (2020) · International Journal of Behavioral Development · doi:10.1177/0165025419866906 · Cited by 117 · see citing works
Food environment and obesity: A systematic review and meta-analysis
Pineda, E., Stockton, J., Scholes, S., Lassale, C., & Mindell, J. S. (2024) · BMJ Nutrition, Prevention & Health · doi:10.1136/bmjnph-2023-000663 · Cited by 125 · see citing works
Peng, Y., Hahn, R. A., Finnie, R. K. C., Cobb, J., Williams, S. P., Fielding, J. E., Johnson, R. L., Montgomery, A. E., Schwartz, A. F., Muntaner, C., et al. (2020) · Journal of Public Health Management and Practice · doi:10.1097/phh.0000000000001219 · Cited by 96 · see citing works
“Guide to Community Preventive Services (“Community Guide”) methods were used for this review.(8,9) This review is PRISMA adherent, and the checklist is available at http://links.”
MethodSelf-citationShort, C. E., James, E. L., Stacey, F., & Plotnikoff, R. C. (2013) · Journal of Cancer Survivorship · doi:10.1007/s11764-013-0296-4 · Cited by 78 · see citing works
Seo, H.-J., Kim, S. Y., Lee, Y. J., Jang, B.-H., Park, J.-E., Sheen, S.-S., & Hahn, S. K. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.09.013 · Cited by 74 · see citing works
Alcohol Electronic Screening and Brief Intervention
Tansil, K. A., Esser, M. B., Sandhu, P., Reynolds, J. A., Elder, R. W., Williamson, R. S., Chattopadhyay, S. K., Bohm, M. K., Brewer, R. D., McKnight-Eily, L. R., et al. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.04.013 · Cited by 57 · see citing works
Fischer, L. S., Asher, A., Stein, R., Becasen, J., Doreson, A., Mermin, J., Meltzer, M. I., & Edlin, B. R. (2025) · BMC Public Health · doi:10.1186/s12889-025-22210-8 · Cited by 59 · see citing works
“The Community Guide methodology to assess intervention effectiveness informed our approach to assess study quality [23].”
- Authors
- Zaza, S., Wright-De Agüero, L. K., Briss, P. A., Truman, B. I., Hopkins, D. P., Hennessy, M. H., Sosin, D. M., Anderson, L., Carande-Kulis, V. G., Teutsch, S. M., & Pappaioanou, M.
- Affiliations
- Centers for Disease Control and Prevention (US)
- Corresponding author
- Zaza, Stephanie
- ORCID
- Venue
- American Journal of Preventive Medicine
- Publisher
- Elsevier BV
- Published
- 2000-01
- Volume
- 18
- Issue
- 1
- Pages
- 44-74
- ISSN
- 0749-3797 (ISSN-L)
- OpenAlex
- W2151006952
- Cited by
- 464
- References
- 17
- Citations by year
- 2026: 4 · 2025: 11 · 2024: 12 · 2023: 9 · 2022: 15 · 2021: 18 · 2020: 16 · 2019: 22 · 2018: 30 · 2017: 19 · 2016: 26 · 2015: 24 · 2014: 21 · 2013: 22 · 2012: 29
- FWCI
- 3.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- public-domain
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Locations
- American Journal of Preventive Medicine (publishedVersion, public-domain)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- systematic reviews, study quality assessment, community preventive services, evidence-based recommendations, research validity, reliability statistics, interobserver agreement, meta-analysis, reporting guidelines
- MeSH terms
- Data Collection, Decision Making, Forms and Records Control, Humans, Preventive Health Services, Research Design, United States, Practice Guidelines as Topic, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
