Improving question formulation for use in evidence appraisal in a tertiary care setting: a randomised controlled trial [ISRCTN66375463]
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The specificity of clinical questions is gauged by explicit descriptions of four dimensions: subjects, interventions, comparators and outcomes of interest. This study determined whether adding simple instructions and examples on clinical question formulation would increase the specificity of the submitted question compared to using a standard form without instructions and examples. METHODS: A randomised controlled trial was conducted in an evidence-search and appraisal service. New participants were invited to reformulate clinical queries. The Control Group was given no instructions. The Intervention Group was given a brief explanation of proper formulation, written instructions, and diagrammatic examples. The primary outcome was the change in the proportion of reformulated questions that described each the dimensions of specificity. RESULTS: Fifty-two subjects agreed to participate in the trial of which 13 were lost to follow-up. The remaining 17 Intervention Group and 22 Control Group participants were analysed. Baseline characteristics were comparable. Overall, 20% of initially submitted questions from both groups were properly specified (defined as an explicit statement describing all dimensions of specificity). On follow-up, 7/14 questions previously rated as mis-specified in the Intervention Group had all dimensions described at follow-up (p = 0.008) while the Control Group did not show any changes from baseline. Participants in the Intervention Group were also more likely to explicitly describe patients (p = 0.028), comparisons (p = 0.014), and outcomes (p = 0.008). CONCLUSIONS: This trial demonstrated the positive impact of specific instructions on the proportion of properly-specified clinical queries. The evaluation of the long-term impact of such changes is an area of continued research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The well-built clinical question: A key to evidence-based decisions
(1995) · ACP Journal Club · doi:10.7326/acpjc-1995-123-3-a12 · Cited by 2,931
Problems in the “Evidence” of “Evidence-Based Medicine”
Feinstein, A. R., & Horwitz, R. I. (1997) · The American Journal of Medicine · doi:10.1016/s0002-9343(97)00244-1 · Cited by 653 · cited 1×
“ply the "best available evidence" to guide clinical decisions [6], the practical implementation of such advice is not often carried through [17–19].”
Analysis of questions asked by family doctors regarding patient care
Ely, J. W., Osheroff, J. A., Ebell, M. H., Bergus, G. R., Levy, B. T., Chambliss, M. L., & Evans, E. R. (1999) · BMJ · doi:10.1136/bmj.319.7206.358 · Cited by 522 · cited 1×
“For instance, Ely and co-workers [17] report that a sample of US family doctors failed to pursue up to 64% of their questions about patient care and those who did spent an average of two minutes seeking an answer.”
Formulating Questions and Locating Primary Studies for Inclusion in Systematic Reviews
Counsell, C. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-5-199709010-00008 · Cited by 505 · cited 4×
“The Intervention Group received a revised form (see 1Additional file 2) containing a brief explanation of the importance of proper question formulation, some written instructions, and a diagrammatic example of how dimensional elements may be arranged [4].”
Influential
Cited by
Utilization of the PICO framework to improve searching PubMed for clinical questions
Schardt, C., Adams, M. B., Owens, T., Keitz, S., & Fontelo, P. (2007) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-7-16 · Cited by 3,053
Beyond PICO: The SPIDER Tool for Qualitative Evidence Synthesis
Cooke, A., Smith, D., & Booth, A. (2012) · Qualitative Health Research · doi:10.1177/1049732312452938 · Cited by 2,608
Instruments for Evaluating Education in Evidence-Based Practice: A Systematic Review
Shaneyfelt, T., Baum, K. D., Bell, D., Feldstein, D., Houston, T. K., Kaatz, S., Whelan, C., & Green, M. (2006) · JAMA · doi:10.1001/jama.296.9.1116 · Cited by 427
Clear and present questions: formulating questions for evidence based practice
Booth, A. (2006) · Library Hi Tech · doi:10.1108/07378830610692127 · Cited by 344
“ask more questions (Villanueva et al., 2001); .”
BackgroundEvidence based practice in postgraduate healthcare education: A systematic review
Flores-Mateo, G., & Argimon, J. M. (2007) · BMC Health Services Research · doi:10.1186/1472-6963-7-119 · Cited by 175
“Forsetlund L, Bradley P, Forsen L, Nordheim L, Jamtvedt G, Bjorndal A: Randomised controlled trial of a theoretically grounded tailored intervention to diffuse evidence-based public health practice [ISRCTN23257060].”
BackgroundInfluential
Metadata
- Authors
- Villanueva, E. V., Burrows, E. A., Fennessy, P. A., Rajendran, M., & Anderson, J. N.
- Venue
- BMC Medical Informatics and Decision Making
- Published
- 2001-11-08
- Volume
- 1
- Issue
- 1
- Pages
- 4-4
- ISSN
- 1472-6947 (ISSN-L)
- OpenAlex
- W2152980078
- Cited by
- 62
- References
- 4
- FWCI
- 1.65
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Improving question formulation for use in evidence appraisal in a tertiary care setting: a randomised controlled trial [ISRCTN66375463]. https://app.cochat.ai/papers/10.1186/1472-6947-1-4
- The paper
- Villanueva, E. V., Burrows, E. A., Fennessy, P. A., Rajendran, M., & Anderson, J. N. (2001). Improving question formulation for use in evidence appraisal in a tertiary care setting: a randomised controlled trial [ISRCTN66375463]. BMC Medical Informatics and Decision Making. https://doi.org/10.1186/1472-6947-1-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.