Overview of systematic reviews of the effectiveness of reminders in improving healthcare professional behavior
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: The purpose of this project was to conduct an overview of existing systematic reviews to evaluate the effectiveness of reminders in changing professional behavior in clinical settings. MATERIALS AND METHODS: Relevant systematic reviews of reminder interventions were identified through searches in MEDLINE, EMBASE, DARE and the Cochrane Library in conjunction with a larger project examining professional behavioral change interventions. Reviews were appraised using AMSTAR, a validated tool for assessing the quality of systematic reviews. As most reviews only reported vote counting, conclusions about effectiveness for each review were based on a count of positive studies. If available, we also report effect sizes. Conclusions were based on the findings from higher quality and current systematic reviews. RESULTS: Thirty-five reviews were eligible for inclusion in this overview. Ten reviews examined the effectiveness of reminders generally, 5 reviews focused on specific health care settings, 14 reviews concentrated on specific behaviors and 6 reviews addressed specific patient populations. The quality of the reviews was variable (median = 3, range = 1 to 8). Seven reviews had AMSTAR scores >5 and were considered in detail. Five of these seven reviews demonstrated positive effects of reminders in changing provider behavior. Few reviews used quantitative pooling methods; in one high quality and current review, the overall observed effects were moderate with an absolute median improvement in performance of 4.2% (IQR: 0.5% to 6.6%). DISCUSSION: The results support that modest improvements can occur with the use of reminders. The effect size is consistent with other interventions that have been used to improve professional behavior. CONCLUSION: Reminders appear effective in improving different clinical behaviors across a range of settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A surgical safety checklist to reduce morbidity and mortality in a global population
Haynes, A. B., Weiser, T. G., Berry, W. R., Lipsitz, S. R., Breizat, A.-H. S., Dellinger, E. P., Herbosa, T., Joseph, S., Kibatala, P. L., Lapitan, M. C. M., et al. (2009) · New England Journal of Medicine · doi:10.1056/nejmsa0810119 · Cited by 5,688
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044 · cited 2×
“This effect size is consistent with other interventions that have been used to improve professional behavior [12].”
BackgroundResultSelf-citationShea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755 · cited 2×
“AMSTAR is an 11-item tool to assess the methodological quality of systematic reviews that has been internally and externally validated and has been found to have good reliability [8,9].”
MethodSelf-citationEffect of Clinical Decision-Support Systems: A Systematic Review
Bright, T. J., Wong, A., Dhurjati, R., Bristow, E., Bastian, L., Coeytaux, R. R., Samsa, G., Hasselblad, V., Williams, J. W., Musty, M. D., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-1-201207030-00450 · Cited by 1,200
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J. M., Thomas, R. E., MacLennan, G., Fraser, C., Ramsay, C. R., Vale, L., Whitty, P., Eccles, M. P., Matowe, L., Shirran, L., et al. (2005) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462305290190 · Cited by 864
Self-citationExternal Validation of a Measurement Tool to Assess Systematic Reviews (AMSTAR)
Shea, B. J., Bouter, L. M., Peterson, J., Boers, M., Andersson, N., Ortiz, Z., Ramsay, T., Bai, A., Shukla, V. K., & Grimshaw, J. M. (2007) · PLoS ONE · doi:10.1371/journal.pone.0001350 · Cited by 569 · cited 2×
“AMSTAR is an 11-item tool to assess the methodological quality of systematic reviews that has been internally and externally validated and has been found to have good reliability [8,9].”
MethodSelf-citationAnalysis of cluster randomized trials in primary care: a practical approach
Campbell, M. K., Mollison, J., Steen, N., Grimshaw, J. M., & Eccles, M. (2000) · Family Practice · doi:10.1093/fampra/17.2.192 · Cited by 327
Self-citationSchedlbauer, A., Prasad, V., Mulvaney, C., Phansalkar, S., Stanton, W., Bates, D. W., & Avery, A. J. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2910 · Cited by 262 · cited 1×
“Fourteen of our included reviews focused on specific behaviors with the majority of studies examining prescribing changes [3,17,19,21,22,38-46].”
BackgroundEvaluation of Outpatient Computerized Physician Medication Order Entry Systems: A Systematic Review
Eslami, S., Abu-Hanna, A., & de Keizer, N. F. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2238 · Cited by 200 · cited 1×
“Fourteen of our included reviews focused on specific behaviors with the majority of studies examining prescribing changes [3,17,19,21,22,38-46].”
BackgroundPearson, S.-A., Moxey, A., Robertson, J., Hains, I., Williamson, M., Reeve, J., & Newby, D. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-154 · Cited by 193 · cited 2×
“In fact, 35% (160) of these studies were “double-counted” in the three largest systematic reviews in this overview [27,28,43].”
Background
Cited by
Squires, J. E., Sullivan, K., Eccles, M. P., Worswick, J., & Grimshaw, J. M. (2014) · Implementation Science · doi:10.1186/s13012-014-0152-6 · Cited by 368
Self-citationPereira, V. C., Silva, S. N., Carvalho, V. K. S., Zanghelini, F., & Barreto, J. O. M. (2022) · Health Research Policy and Systems · doi:10.1186/s12961-022-00815-4 · Cited by 294
Pantoja, T., Opiyo, N., Lewin, S., Paulsen, E., Ciapponi, A., Wiysonge, C. S., Herrera, C. A., Rada, G., Peñaloza, B., Dudley, L., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011086.pub2 · Cited by 252
Rouleau, G., Gagnon, M.-P., Côté, J., Payne-Gagnon, J., Hudson, E., & Dubois, C.-A. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6686 · Cited by 244
Tomasone, J. R., Kauffeldt, K. D., Chaudhary, R., & Brouwers, M. C. (2020) · Implementation Science · doi:10.1186/s13012-020-0971-6 · Cited by 103
“[59] reported modest improvements in HCP behaviour following reminders in a variety of clinical settings .”
Background
Metadata
- Authors
- Cheung, A., Weir, M., Mayhew, A., Kozloff, N., Brown, K., & Grimshaw, J.
- Venue
- Systematic Reviews
- Published
- 2012-08-16
- Volume
- 1
- Issue
- 1
- Pages
- 36-36
- ISSN
- 2046-4053 (ISSN-L)
- OpenAlex
- W2113686669
- Cited by
- 141
- References
- 13
- FWCI
- 1.70
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Overview of systematic reviews of the effectiveness of reminders in improving healthcare professional behavior. https://app.cochat.ai/papers/10.1186/2046-4053-1-36
- The paper
- Cheung, A., Weir, M., Mayhew, A., Kozloff, N., Brown, K., & Grimshaw, J. (2012). Overview of systematic reviews of the effectiveness of reminders in improving healthcare professional behavior. Systematic Reviews. https://doi.org/10.1186/2046-4053-1-36
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.