The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Formulating Questions and Locating Primary Studies for Inclusion in Systematic Reviews
Abstract
Much time and effort are spent on designing primary research studies. Similar care must be given to planning systematic reviews. The review should be based on an important, well-focused question that is relevant to patient care. By formulating the question properly, the criteria that primary studies must meet to be included in the review become clear. These criteria, which comprise the types of persons involved, exposure, control group, outcomes, and study designs of interest, can then be refined so that they are clinically relevant, sensible, and workable. Inclusion criteria that are too narrow will limit the amount of data in the review, thereby increasing the risk for chance results and making the review less useful for the reader. Reviews should include studies whose designs offer the least biased answer to the question being asked. To maximize available data and reduce the risk for bias, as many relevant studies as possible need to be identified, regardless of publication status or language. Multiple overlapping search strategies should therefore be used and must be carefully planned. Strategies include searching the many electronic databases available (after careful consideration of which terms to enter), manually searching journals and conference proceedings, searching bibliographies of articles, searching existing registers of studies, and contacting companies or researchers. The time taken to formulate the question adequately and develop appropriate searches will increase the chance of producing a high-quality, meaningful review.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Over the last two decades, empirical evidence has accumulated from studies investigating different sources of bias related to specific SR tasks.”
From How to conduct systematic reviews more expeditiously? (2015) · cites this paper as [33]
In the citing paper
“Sometimes broad questions might increase the applicability of the results and facilitate detection of bias, exploratory analyses, and sensitivity analyses [35],[36].”
From The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration (2009) · cites this paper as [35]
Citations
Cites
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Meta-analysis in social research
(1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90011-8 · Cited by 3,853
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“Publication bias— the selective publication of studies based on the direction and strength of their results (32)—affects all types of studies (including randomized, controlled trials [32-34]), but it seems to be a greater problem for small, nonrandomized studies (32, 33, 35).”
BackgroundGuidelines for authors and peer reviewers of economic submissions to the BMJ
Drummond, M. F., & Jefferson, T. O. (1996) · BMJ · doi:10.1136/bmj.313.7052.275 · Cited by 1,827
Surrogate End Points in Clinical Trials: Are We Being Misled?
Fleming, T. R., & DeMets, D. L. (1996) · Annals of Internal Medicine · doi:10.7326/0003-4819-125-7-199610010-00011 · Cited by 1,651
Jaeschke, R. (1994) · JAMA · doi:10.1001/jama.1994.03510290071040 · Cited by 1,049
Yusuf, S. (1991) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1991.03470010097038 · Cited by 1,014
Guyatt, G. H. (1993) · JAMA · doi:10.1001/jama.1993.03510210084032 · Cited by 944
A consumer's guide to subgroup analyses
Oxman, A. D., & Guyatt, G. H. (1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-1-78 · Cited by 914
Users' Guides to the Medical Literature: VI. How to Use an Overview
Oxman, A. D. (1994) · JAMA · doi:10.1001/jama.1994.03520170077040 · Cited by 775
Cited by
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Metadata
- Authors
- Counsell, C.
- Affiliations
- Western General Hospital (GB)
- Corresponding author
- Counsell, Carl
- ORCID
- Counsell, Carl
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 1997-09-01
- Volume
- 127
- Issue
- 5
- Pages
- 380-387
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W2050066532
- Cited by
- 505
- References
- 48
- Citations by year
- 2026: 15 · 2025: 16 · 2024: 19 · 2023: 18 · 2022: 30 · 2021: 20 · 2020: 17 · 2019: 21 · 2018: 17 · 2017: 13 · 2016: 18 · 2015: 17 · 2014: 20 · 2013: 21 · 2012: 18
- FWCI
- 15.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.acpjournals.org/journal/aim/text-and-data-mining (tdm)
- Locations
- Annals of Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Wellcome Trust
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Nursing › Research and Theory › Methodologies in Health Research and Practice
- Keywords
- research question formulation, inclusion criteria, search strategies, literature searching, study bias, online databases, publication status
- MeSH terms
- Clinical Trials as Topic, Humans, Research Design, Meta-Analysis as Topic, Databases, Factual
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Formulating Questions and Locating Primary Studies for Inclusion in Systematic Reviews. https://app.cochat.ai/papers/10.7326/0003-4819-127-5-199709010-00008
- The paper
- Counsell, C. (1997). Formulating Questions and Locating Primary Studies for Inclusion in Systematic Reviews. Annals of Internal Medicine. https://doi.org/10.7326/0003-4819-127-5-199709010-00008
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.