The DOI matches its Crossref record; 331 of the 331 references it cites were found in a registry or an index.
The effects of on-screen, point of care computer reminders on processes and outcomes of care
Open accessAbstract
BACKGROUND: The opportunity to improve care by delivering decision support to clinicians at the point of care represents one of the main incentives for implementing sophisticated clinical information systems. Previous reviews of computer reminder and decision support systems have reported mixed effects, possibly because they did not distinguish point of care computer reminders from e-mail alerts, computer-generated paper reminders, and other modes of delivering 'computer reminders'. OBJECTIVES: To evaluate the effects on processes and outcomes of care attributable to on-screen computer reminders delivered to clinicians at the point of care. SEARCH STRATEGY: We searched the Cochrane EPOC Group Trials register, MEDLINE, EMBASE and CINAHL and CENTRAL to July 2008, and scanned bibliographies from key articles. SELECTION CRITERIA: Studies of a reminder delivered via a computer system routinely used by clinicians, with a randomised or quasi-randomised design and reporting at least one outcome involving a clinical endpoint or adherence to a recommended process of care. DATA COLLECTION AND ANALYSIS: Two authors independently screened studies for eligibility and abstracted data. For each study, we calculated the median improvement in adherence to target processes of care and also identified the outcome with the largest such improvement. We then calculated the median absolute improvement in process adherence across all studies using both the median outcome from each study and the best outcome. MAIN RESULTS: Twenty-eight studies (reporting a total of thirty-two comparisons) were included. Computer reminders achieved a median improvement in process adherence of 4.2% (interquartile range (IQR): 0.8% to 18.8%) across all reported process outcomes, 3.3% (IQR: 0.5% to 10.6%) for medication ordering, 3.8% (IQR: 0.5% to 6.6%) for vaccinations, and 3.8% (IQR: 0.4% to 16.3%) for test ordering. In a sensitivity analysis using the best outcome from each study, the median improvement was 5.6% (IQR: 2.0% to 19.2%) across all process measures and 6.2% (IQR: 3.0% to 28.0%) across measures of medication ordering. In the eight comparisons that reported dichotomous clinical endpoints, intervention patients experienced a median absolute improvement of 2.5% (IQR: 1.3% to 4.2%). Blood pressure was the most commonly reported clinical endpoint, with intervention patients experiencing a median reduction in their systolic blood pressure of 1.0 mmHg (IQR: 2.3 mmHg reduction to 2.0 mmHg increase). AUTHORS' CONCLUSIONS: Point of care computer reminders generally achieve small to modest improvements in provider behaviour. A minority of interventions showed larger effects, but no specific reminder or contextual features were significantly associated with effect magnitude. Further research must identify design features and contextual factors consistently associated with larger improvements in provider behaviour if computer reminders are to succeed on more than a trial and error basis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Crossing the Quality Chasm: A New Health System for the 21st Century
Baker, A. (2001) · BMJ · doi:10.1136/bmj.323.7322.1192 · Cited by 10,736
The quality of health care delivered to adults in the United States
McGlynn, E. A., Asch, S. M., Adams, J., Keesey, J., Hicks, J., DeCristofaro, A., & Kerr, E. A. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa022615 · Cited by 5,079
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044
Self-citationKawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005) · BMJ · doi:10.1136/bmj.38398.500764.8f · Cited by 2,703
Hunt, D. L., Haynes, R. B., Hanna, S. E., & Smith, K. (1998) · JAMA · doi:10.1001/jama.280.15.1339 · Cited by 1,669
Educational outreach visits: effects on professional practice and health care outcomes
O'Brien, M. A., Rogers, S., Jamtvedt, G., Oxman, A. D., Odgaard-Jensen, J., Kristoffersen, D. T., Forsetlund, L., Bainbridge, D., Freemantle, N., Davis, D., et al. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000409.pub2 · Cited by 1,279
Electronic Alerts to Prevent Venous Thromboembolism among Hospitalized Patients
Kucher, N., Koo, S., Quiroz, R., Cooper, J. M., Paterno, M. D., Soukonnikov, B., & Goldhaber, S. Z. (2005) · New England Journal of Medicine · doi:10.1056/nejmoa041533 · Cited by 942
How Good Is the Quality of Health Care in the United States?
Schuster, M. A., McGlynn, E. A., & Brook, R. H. (1998) · The Milbank Quarterly · doi:10.1111/1468-0009.00105 · Cited by 908
Evidence-Based Quality Improvement: The State Of The Science
Shojania, K. G., & Grimshaw, J. M. (2005) · Health Affairs · doi:10.1377/hlthaff.24.1.138 · Cited by 691
Self-citationPain and Suffering in Seriously Ill Hospitalized Patients
Desbiens, N. A., & Wu, A. W. (2000) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2000.tb03130.x · Cited by 676
Cited by
Flynn, J. T., Kaelber, D. C., Baker-Smith, C. M., Blowey, D., Carroll, A. E., Daniels, S. R., de Ferranti, S. D., Dionne, J. M., Falkner, B., Flinn, S. K., et al. (2017) · Pediatrics · doi:10.1542/peds.2017-1904 · Cited by 3,651
Clinical Practice Guidelines We Can Trust
Committee on Standards for Developing Trustworthy Clinical Practice Guidelines, Board on Health Care Services, & Institute of Medicine (2011) · National Academies Press eBooks · doi:10.17226/13058 · Cited by 3,081
Knowledge translation of research findings
Grimshaw, J. M., Eccles, M. P., Lavis, J. N., Hill, S. J., & Squires, J. E. (2012) · Implementation Science · doi:10.1186/1748-5908-7-50 · Cited by 2,407
Self-citationThe Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview
Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1000387 · Cited by 1,442
Effectiveness of telemedicine: A systematic review of reviews
Ekeland, A. G., Bowes, A., & Flottorp, S. (2010) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2010.08.006 · Cited by 1,162
Local opinion leaders: effects on professional practice and health care outcomes
Flodgren, G., Parmelli, E., Doumit, G., Gattellari, M., O'Brien, M. A., Grimshaw, J., & Eccles, M. P. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000125.pub4 · Cited by 1,070
Self-citationEnhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda
Powell, B. J., Fernandez, M. E., Williams, N. J., Aarons, G. A., Beidas, R. S., Lewis, C. C., McHugh, S. M., & Weiner, B. J. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00003 · Cited by 775
A systematic review of chronic disease management interventions in primary care
Reynolds, R., Dennis, S., Hasan, I., Slewa, J., Chen, W., Tian, D., Bobba, S., & Zwar, N. (2018) · BMC Family Practice · doi:10.1186/s12875-017-0692-3 · Cited by 566
Johnson, M. J., & May, C. R. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-008592 · Cited by 513
The impact of health information technology on patient safety
Alotaibi, Y. K., & Federico, F. (2017) · Saudi Medical Journal · doi:10.15537/smj.2017.12.20631 · Cited by 467
Kwan, J. L., Lo, L., Ferguson, J., Goldberg, H., Diaz-Martinez, J. P., Tomlinson, G., Grimshaw, J. M., & Shojania, K. G. (2020) · BMJ · doi:10.1136/bmj.m3216 · Cited by 461
Self-citationA guiding framework and approach for implementation research in substance use disorders treatment.
Damschroder, L. J., & Hagedorn, H. J. (2011) · Psychology of Addictive Behaviors · doi:10.1037/a0022284 · Cited by 427
Squires, J. E., Sullivan, K., Eccles, M. P., Worswick, J., & Grimshaw, J. M. (2014) · Implementation Science · doi:10.1186/s13012-014-0152-6 · Cited by 368
Self-citationNuckols, T. K., Smith-Spangler, C., Morton, S. C., Asch, S. M., Patel, V. M., Anderson, L. J., Deichsel, E. L., & Shekelle, P. G. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-56 · Cited by 340
Effect of point-of-care computer reminders on physician behaviour: a systematic review
Shojania, K. G., Jennings, A., Mayhew, A., Ramsay, C., Eccles, M., & Grimshaw, J. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.090578 · Cited by 338
Self-citationPereira, V. C., Silva, S. N., Carvalho, V. K. S., Zanghelini, F., & Barreto, J. O. M. (2022) · Health Research Policy and Systems · doi:10.1186/s12961-022-00815-4 · Cited by 294
Lau, R., Stevenson, F., Ong, B. N., Dziedzic, K., Treweek, S., Eldridge, S., Everitt, H., Kennedy, A., Qureshi, N., Rogers, A., et al. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-009993 · Cited by 254
Ryan, R. E., Santesso, N., Lowe, D., Hill, S., Grimshaw, J. M., Prictor, M., Kaufman, C., Cowie, G., & Taylor, M. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007768.pub3 · Cited by 273
Self-citationLocal opinion leaders: effects on professional practice and healthcare outcomes
Flodgren, G., O'Brien, M. A., Parmelli, E., & Grimshaw, J. M. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000125.pub5 · Cited by 259
Self-citationComputerized advice on drug dosage to improve prescribing practice
Durieux, P., Trinquart, L., Colombet, I., Niès, J., Walton, R., Rajeswaran, A., Rège-Walther, M., Harvey, E., & Burnand, B. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002894.pub2 · Cited by 253
Pantoja, T., Opiyo, N., Lewin, S., Paulsen, E., Ciapponi, A., Wiysonge, C. S., Herrera, C. A., Rada, G., Peñaloza, B., Dudley, L., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011086.pub2 · Cited by 252
Van de Velde, S., Heselmans, A., Delvaux, N., Brandt, L., Marco-Ruiz, L., Spitaels, D., Cloetens, H., Kortteisto, T., Roshanov, P., Kunnamo, I., et al. (2018) · Implementation Science · doi:10.1186/s13012-018-0790-1 · Cited by 156
“Lobach et al. [6] and the subgroup analysis by Shojania et al. [20] also found that CDS which is combined with professional-oriented strategies resulted in better adherence.”
BackgroundMethodInfluentialPraveen, D., Patel, A., Raghu, A., Clifford, G. D., Maulik, P. K., Mohammad Abdul, A., Mogulluru, K., Tarassenko, L., MacMahon, S., & Peiris, D. (2014) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3568 · Cited by 131
Maulik, P. K., Kallakuri, S., Devarapalli, S., Vadlamani, V. K., Jha, V., & Patel, A. (2017) · Journal of Global Health · doi:10.7189/jogh.07.010408 · Cited by 125
Flodgren, G., Deane, K., Dickinson, H. O., Kirk, S., Alberti, H., Beyer, F. R., Brown, J. G., Penney, T. L., Summerbell, C. D., & Eccles, M. P. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000984.pub2 · Cited by 90
Nurek, M., Kostopoulou, O., Delaney, B. C., & Esmail, A. (2015) · European Journal of General Practice · doi:10.3109/13814788.2015.1043123 · Cited by 60
Clyne, B., Bradley, M. C., Hughes, C. M., Clear, D., McDonnell, R., Williams, D., Fahey, T., & Smith, S. M. (2013) · BMC Health Services Research · doi:10.1186/1472-6963-13-307 · Cited by 58
Silveira, D. V., Marcolino, M. S., Machado, E. L., Ferreira, C. G., Alkmim, M. B. M., Resende, E. S., Carvalho, B. C., Antunes, A. P., & Ribeiro, A. L. P. (2019) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9869 · Cited by 51
Guiriguet, C., Muñoz-Ortiz, L., Burón, A., Rivero, I., Grau, J., Vela-Vallespín, C., Vilarrubí, M., Torres, M., Hernández, C., Méndez-Boo, L., et al. (2016) · British Journal of General Practice · doi:10.3399/bjgp16x685657 · Cited by 47
Development and Implementation of Sepsis Alert Systems
Harrison, A. M., Gajic, O., Pickering, B. W., & Herasevich, V. (2016) · Clinics in Chest Medicine · doi:10.1016/j.ccm.2016.01.004 · Cited by 46
“The task of generating clinically meaningful alerts while concurrently minimizing information overload and task interruption is challenging.(48) Successful sepsis alert systems must be designed to minimize alert fatigue, interruption, human error, and information overload.”
BackgroundCare Provision to Prevent Chronic Disease by Community Mental Health Clinicians
Bartlem, K. M., Bowman, J. A., Freund, M., Wye, P. M., McElwaine, K. M., Wolfenden, L., Campbell, E. M., Gillham, K. E., & Wiggers, J. H. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.08.003 · Cited by 43
Tao, L., Zhang, C., Zeng, L., Zhu, S., Li, N., Li, W., Zhang, H., Zhao, Y., Zhan, S., & Ji, H. (2020) · JMIR Medical Informatics · doi:10.2196/16912 · Cited by 42
Kavanagh, T., Stevens, B., Seers, K., Sidani, S., & Watt-Watson, J. (2010) · Implementation Science · doi:10.1186/1748-5908-5-90 · Cited by 35
Bell, H., Garfield, S., Khosla, S., Patel, C., & Franklin, B. D. (2019) · European Journal of Hospital Pharmacy · doi:10.1136/ejhpharm-2017-001483 · Cited by 29
Patient-specific computer-based decision support in primary healthcare—a randomized trial
Kortteisto, T., Raitanen, J., Komulainen, J., Kunnamo, I., Mäkelä, M., Rissanen, P., & Kaila, M. (2014) · Implementation Science · doi:10.1186/1748-5908-9-15 · Cited by 27
Konijnendijk, A. A. J., Boere-Boonekamp, M. M., Fleuren, M. A. H., Haasnoot, M. E., & Need, A. (2016) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2015.11.006 · Cited by 28
Algorithm-driven electronic health record notification enhances the detection of Turner syndrome
Alexandrou, E., Cabrera-Salcedo, C., Labilloy, G., Tyzinski, L., Smolarek, T. A., Andrew, M., Huang, Y., Backeljauw, P., & Dauber, A. (2020) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2019.09.023 · Cited by 6
“Our study examines the utility of an electronic health record (EHR) algorithm in identifying patients at high risk for TS.”
BackgroundInfluential
Metadata
- Authors
- Shojania, K. G., Jennings, A., Ramsay, C. R., Grimshaw, J. M., Kwan, J. L., & Lo, L.
- Venue
- Cochrane Database of Systematic Reviews
- Publisher
- Wiley
- Published
- 2009-07-08
- Volume
- 2021
- Issue
- 6
- Pages
- CD001096-CD001096
- ISSN
- 1361-6137 (ISSN-L)
- 1465-1858
- OpenAlex
- W1681426172
- Cited by
- 466
- References
- 331
- FWCI
- 58.60
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.