The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Computerised reminders and feedback in medication management: a systematic review of randomised controlled trials
Abstract
OBJECTIVE: To systematically review randomised controlled trials (RCTs) of computer-generated medication reminders or feedback directed to healthcare providers or patients. DATA SOURCES: Extensive computerised and manual literature searches identified 76 English-language reports of RCTs reported before 1 January 2002. Searches were conducted between June 1998 and April 2002. STUDY SELECTION: 26 papers making 29 comparisons (two papers reported on multiple interventions) of computer-supported medication management to a control group. DATA EXTRACTION: The quality of the RCTs was systematically assessed and scored independently by two reviewers. Rates of compliance with (potential) reminders for the control and intervention groups were extracted. DATA SYNTHESIS: Heterogeneity of studies prevented a meta-analysis. Where possible, rates were calculated using the intention-to-treat principle. The comparisons were grouped into five areas. Reminders to providers in outpatient settings: six of 12 comparisons demonstrated positive effects (relative rates [RRs: intervention rates/control rates], 1.0 to 42.0). Provider feedback in outpatient settings: five of seven comparisons showed improved clinician behaviour (RRs, 1.0 to 2.5). Combined reminders and feedback in outpatient settings: the single comparison found no improvement. Reminders to providers in inpatient settings: three of five comparisons showed improvements (RRs, 1.0 to 2.1). Patient-directed reminders: two of four comparisons showed improvements in patient compliance. CONCLUSION: Reminders are more effective than feedback in modifying physician behaviour related to medication management. Patient-directed reminders can improve medication adherence.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Systematic reviews of electronic and paper-based clinical decision support across a range of clinical domains have demonstrated its effectiveness in changing clinicians' practices such as screening, test ordering and guideline adherence, 5 7-9 11-13 but there is no consistent translation into patient outcomes.11”
From Computerized clinical decision support for prescribing: provision does not guarantee uptake (2010) · cites this paper as [9]
In the citing paper
“Systematic reviews have demonstrated that use of CDSSs for prescribing can reduce toxic drug levels and time to therapeutic control, 5 6 reduce medication errors 7 8 and change prescribing in accordance with guideline recommendations.9”
From Computerized clinical decision support for prescribing: provision does not guarantee uptake (2010) · cites this paper as [9]
Citations
Cites
Institute of Medicine (2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,390
To Err is Human: Building a Safer Health System
Hendee, W. R. (2001) · Journal of Vascular and Interventional Radiology · doi:10.1016/s1051-0443(01)70072-3 · Cited by 10,129
Evidence-Based Medicine: How to Practice and Teach EBM
Sackett, D. L. (2000) · Cited by 5,950
Users' Guides to the Medical Literature
Guyatt, G. H. (1993) · JAMA · doi:10.1001/jama.270.17.2096 · Cited by 3,083
Leape, L. L. (1994) · JAMA · doi:10.1001/jama.272.23.1851 · Cited by 2,329
Leape, L. L. (1994) · PubMed · Cited by 1,961
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308
Meta-Analysis in Clinical Research
L'ABBÉ, K. A., DETSKY, A. S., & O'ROURKE, K. (1987) · Annals of Internal Medicine · doi:10.7326/0003-4819-107-2-224 · Cited by 1,267
Users' Guides to the Medical Literature
Guyatt, G. H. (1993) · JAMA · doi:10.1001/jama.270.21.2598 · Cited by 1,185
Sackett, D. L. (1997) · Seminars in Perinatology · doi:10.1016/s0146-0005(97)80013-4 · Cited by 1,063
Reminders to Physicians from an Introspective Computer Medical Record
McDonald, C. J., Hui, S. L., Smith, D. M., Tierney, W. M., Cohen, S. J., Weinberger, M., & McCabe, G. P. (1984) · Annals of Internal Medicine · doi:10.7326/0003-4819-100-1-130 · Cited by 626
Iatrogenic Illness on a General Medical Service at a University Hospital
Steel, K., Gertman, P. M., Crescenzi, C., & Anderson, J. (1981) · New England Journal of Medicine · doi:10.1056/nejm198103123041104 · Cited by 568
Physician Inpatient Order Writing on Microcomputer Workstations
Tierney, W. M. (1993) · JAMA · doi:10.1001/jama.269.3.379 · Cited by 549
Shea, S., DuMouchel, W., & Bahamonde, L. (1996) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1996.97084513 · Cited by 537
Drug-Related Hospital Admissions
Einarson, T. R. (1993) · Annals of Pharmacotherapy · doi:10.1177/106002809302700702 · Cited by 520
Simon, G. E. (2000) · BMJ · doi:10.1136/bmj.320.7234.550 · Cited by 519
Assessing the Quality of Randomized Controlled Trials:Current Issues and Future Directions
Moher, D., Jadad, A. R., & Tugwell, P. (1996) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300009570 · Cited by 436
The Barriers to Electronic Medical Record Systems and How to Overcome Them
McDonald, C. J. (1997) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1997.0040213 · Cited by 378
A Randomized Trial of "Corollary Orders" to Prevent Errors of Omission
Overhage, J. M., Tierney, W. M., Zhou, X., & McDonald, C. J. (1997) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1997.0040364 · Cited by 375
How to Use an Article About Therapy or Prevention
Guyatt, G. H., Sackett, D. L., & Cook, D. J. (1995) · Cited by 357
Tierney, W. M., Hui, S. L., & McDonald, C. J. (1986) · Medical Care · doi:10.1097/00005650-198608000-00001 · Cited by 337
Effects of feedback of information on clinical practice: a review.
Mugford, M., Banfield, P., & O'Hanlon, M. (1991) · BMJ · doi:10.1136/bmj.303.6799.398 · Cited by 333
Shiffman, R. N., Liaw, Y., Brandt, C., & Corb, G. J. (1999) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1999.0060104 · Cited by 333
Rich, M. W., Gray, D. B., Beckham, V., Wittenberg, C., & Luther, P. (1996) · The American Journal of Medicine · doi:10.1016/s0002-9343(96)00172-6 · Cited by 296
Montgomery, A. A. (2000) · BMJ · doi:10.1136/bmj.320.7236.686 · Cited by 279
Computerized advice on drug dosage to improve prescribing practice
Durieux, P., Trinquart, L., Colombet, I., Niès, J., Walton, R. T., Rajeswaran, A., Rège-Walther, M., Harvey, E., & Burnand, B. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002894.pub2 · Cited by 251
Litzelman, D. K., Dittus, R. S., Miller, M. E., & Tierney, W. M. (1993) · Journal of General Internal Medicine · doi:10.1007/bf02600144 · Cited by 236
Reducing Vancomycin Use Utilizing a Computer Guideline: Results of a Randomized Controlled Trial
Shojania, K. G., Yokoe, D. S., Platt, R. G., Fiskio, J. M., Ma'Luf, N., & Bates, D. W. (1998) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1998.0050554 · Cited by 211
Demakis, J. G. (2000) · JAMA · doi:10.1001/jama.284.11.1411 · Cited by 206
Physician Response to Computer Reminders
McDonald, C. J. (1980) · JAMA · doi:10.1001/jama.1980.03310140037026 · Cited by 184
Use of a Computer to Detect and Respond to Clinical Events: Its Effect on Clinician Behavior
McDonald, C. J. (1976) · Annals of Internal Medicine · doi:10.7326/0003-4819-84-2-162 · Cited by 169
Computer Reminders to Implement Preventive Care Guidelines for Hospitalized Patients
Overhage, J. M. (1996) · Archives of Internal Medicine · doi:10.1001/archinte.1996.00440130095010 · Cited by 156
Effect of physician profiling on utilization
Balas, E. A., Boren, S. A., Brown, G. D., Ewigman, B., Mitchell, J. A., & Perkoff, G. T. (1996) · Journal of General Internal Medicine · doi:10.1007/bf02599025 · Cited by 130
Improving Drug Prescribing in a Primary Care Practice
Gehlbach, S. H., Wilkinson, W. E., Hammond, W. E., Clapp, N. E., Finn, A. L., Taylor, W. J., & Rodell, M. (1984) · Medical Care · doi:10.1097/00005650-198403000-00002 · Cited by 124
Effects of computer generated reminder charts on patients' compliance with drug regimens.
Raynor, D. K., Booth, T. G., & Blenkinsopp, A. (1993) · BMJ · doi:10.1136/bmj.306.6886.1158 · Cited by 119
Christakis, D., Zimmerman, F. J., Wright, J. A., Garrison, M. M., Rivara, F. P., & Davis, R. L. (2001) · PEDIATRICS · doi:10.1542/peds.107.2.e15 · Cited by 118
Irene, H., Jostein, H., & Øystein, K. (1999) · Scandinavian Journal of Primary Health Care · doi:10.1080/028134399750002872 · Cited by 92
Effect of physician reminders on preventive care: meta-analysis of randomized clinical trials.
Austin, S., Balas, E. A., Mitchell, J. A., & Ewigman, B. (1994) · PubMed Central · Cited by 90
McCowan, C. (2001) · Medical Informatics and the Internet in Medicine · doi:10.1080/14639230110067890 · Cited by 90
Implementing Clinical Guidelines in the Treatment of Hypertension in General Practice
HETLEVIK, J. H. I. (1998) · Blood Pressure · doi:10.1080/080370598437114 · Cited by 77
Reduction of polypharmacy by feedback to clinicians
Meyer, T. J., Kooten, D. W. V., Marsh, S., & Prochazka, A. V. (1991) · Journal of General Internal Medicine · doi:10.1007/bf02598309 · Cited by 76
Rollman, B. L., Hanusa, B. H., Gilbert, T., Lowe, H., Kapoor, W. N., & Schulberg, H. C. (2001) · Archives of Internal Medicine · doi:10.1001/archinte.161.2.189 · Cited by 75
A computerized intervention to decrease the use of calcium channel blockers in hypertension
Rossi, R. A., & Every, N. R. (1997) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1997.07140.x · Cited by 74
Influence of Simple Computerized Feedback on Prescription Charges in an Ambulatory Clinic
Hershey, C. O., Porter, D. K., Breslau, D., & Cohen, D. I. (1986) · Medical Care · doi:10.1097/00005650-198606000-00002 · Cited by 68
Cost Effectiveness of Two Interventions for Reducing Outpatient Prescribing Costs
Steele, M. A., Bess, D. T., Franse, V. L., & Gräber, S. E. (1989) · DICP · doi:10.1177/106002808902300612 · Cited by 58
Simkins, C. V., & Wenzloff, N. J. (1986) · Annals of Pharmacotherapy · doi:10.1177/106002808602001017 · Cited by 37
McCartney, P., Macdowall, W. G., & Thorogood, M. (1997) · BMJ · doi:10.1136/bmj.315.7099.35 · Cited by 36
Patient misunderstanding of dosing instructions
Hanchak, N. A., Patel, M., Berlin, J. A., & Strom, B. L. (1996) · Journal of General Internal Medicine · doi:10.1007/bf02600041 · Cited by 35
Physician response to computer reminders
McDonald, C. J. (1980) · JAMA · doi:10.1001/jama.244.14.1579 · Cited by 32
Frances, C. D. (2001) · Western Journal of Medicine · doi:10.1136/ewjm.175.3.165 · Cited by 31
Overhage, J. M. (2002) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1081 · Cited by 23
An Intervention on Discharge Polypharmacy
Smith, D. M., Cox, M. R., Brizendine, E. J., Hui, S. L., Freedman, J. A., Martin, D., & Murray, M. D. (1996) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1996.tb06413.x · Cited by 21
Effectiveness of a computer-supported refill reminder system
Baird, T. K., Broekemeier, R. L., & Anderson, M. W. (1984) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/41.11.2395 · Cited by 14
Research works printed but not linked: 7
- 10.1001/jama.1994.03520230061039 · DOI
- Austin SM, 1994, Proceedings for 18th Annual Symposium on Computer Applications in Medical Care; 1994 November 5–9, 121
- Bennett JW, 1993, Royal Australian College of General Practitioners 7th Computer Conference, 127
- Bennett JW, 1993, Proceedings of the Inaugural Health Informatics Conference; Brisbane, Australia; 1993 August 2–3, 228
- Walton RT, 2001, Cochrane Collaboration on Effective Professional Practice Module of The Cochrane Database of Systematic Reviews [updated March 2001]. Available in The Cochrane Library. The Cochrane Collaboration
- 10.1001/jama.1993.03510210084032 · DOI
- 10.1001/jama.1993.03500030077036 · DOI
Cited by
Sorted by citations
Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159
“However, they have been limited to specific systems, such as computerized provider order entry (96); capabilities, such as computerized re-minders (97, 98); or clinical specialty (99).”
Kawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005) · BMJ · doi:10.1136/bmj.38398.500764.8f · Cited by 2,703
The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview
Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1000387 · Cited by 1,442
“Our final selection of 53 reviews provided the main empirical evidence base in relation to assessing the impact of the selected eHealth technologies (see Table 1 for our critical appraisal of these studies) [15–67], full details of which can be found in Table S2.”
Interventions to improve antibiotic prescribing practices in ambulatory care
Arnold, S. R., & Straus, S. E. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003539.pub2 · Cited by 741
Costs and benefits of health information technology.
Shekelle, P. G., Morton, S. C., & Keeler, E. B. (2006) · doi:10.23970/ahrqepcerta132 · Cited by 501
Metadata
- Authors
- Bennett, J. W., & Glasziou, P. P.
- Affiliations
- The University of Queensland (AU)
- ORCID
- Glasziou, Paul P
- Venue
- Medical Journal of Australia
- Publisher
- AMPCo
- Published
- 2003-03
- Volume
- 178
- Issue
- 5
- Pages
- 217-222
- ISSN
- 0025-729X (ISSN-L)
- 1326-5377
- OpenAlex
- W1548347845
- Cited by
- 146
- References
- 53
- Citations by year
- 2026: 2 · 2025: 1 · 2023: 1 · 2022: 6 · 2021: 6 · 2020: 2 · 2019: 4 · 2018: 4 · 2017: 7 · 2016: 3 · 2015: 6 · 2014: 7 · 2013: 6 · 2012: 13
- FWCI
- 2.34
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- The Medical Journal of Australia (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Family Practice › Medication Adherence and Compliance
- Health Sciences › Medicine › Geriatrics and Gerontology › Pharmaceutical Practices and Patient Outcomes
- Keywords
- provider feedback, medication management, medication adherence, clinician behavior, outpatient settings, inpatient settings
- MeSH terms
- Drug Therapy, Feedback, Humans, Outpatients, Patient Compliance, Practice Patterns, Physicians', Quality Control, Randomized Controlled Trials as Topic, Reminder Systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review