Effect of Patient Reminder/Recall Interventions on Immunization Rates: A Review
The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Abstract
CONTEXT: Immunization rates for children and adults remain below national goals. While experts recommend that health care professionals remind patients of needed immunizations, few practitioners actually use reminders. Little is known about the effectiveness of reminders in different settings or patient populations. OBJECTIVES: To assess the effectiveness of patient reminder systems in improving immunization rates, and to compare the effectiveness of different types of reminders for a variety of patient populations. DATA SOURCES: A search was performed using MEDLINE, EMBASE, PsychINFO, Sociological Abstracts, and CAB Health Abstracts. Relevant articles, as well as published abstracts, conference proceedings, and files of study collaborators, were searched for relevant references. STUDY SELECTION AND DATA EXTRACTION: English-language studies involving patient reminder/recall interventions (using criteria established by the Cochrane Collaboration) were eligible for review if they involved randomized controlled trials, controlled before-after studies, or interrupted time series, and measured immunization rates. Of 109 studies identified, 41 met eligibility criteria. Studies were reviewed independently by 2 reviewers using a standardized checklist. Results of studies are expressed as absolute percentage-point changes in immunization rates and as odds ratios (ORs). Studies with similar characteristics of patients or interventions were pooled (random effects model). DATA SYNTHESIS: Patient reminder systems were effective in improving immunization rates in 33 (80%) of the 41 studies, irrespective of baseline immunization rates, patient age, setting, or vaccination type. Increases in immunization rates due to reminders ranged from 5 to 20 percentage points. Reminders were effective for childhood vaccinations (OR, 2.02; 95% confidence interval [CI], 1.49-2.72), childhood influenza vaccinations (OR, 4. 25; 95% CI, 2.10-8.60), adult pneumococcus or tetanus vaccinations (OR, 5.14; 95% CI, 1.21-21.78), and adult influenza vaccinations (OR, 2.29; 95% CI, 1.69-3.10). While reminders were most effective in academic settings (OR, 3.33; 95% CI, 1.98-5.58), they were also highly effective in private practice settings (OR, 1.79; 95% CI, 1. 45-2.22) and public health clinics (OR, 2.09; 95% CI, 1.42-3.07). All types of reminders were effective (postcards, letters, and telephone or autodialer calls), with telephone reminders being most effective but costliest. CONCLUSIONS: Patient reminder systems in primary care settings are effective in improving immunization rates. Primary care physicians should use patient reminders to improve immunization delivery. JAMA. 2000;284:1820-1827.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Language bias in randomised controlled trials published in English and German
Egger, M., Zellweger-Zähner, T., Schneider, M., Junker, C., Lengeler, C., & Antes, G. (1997) · The Lancet · doi:10.1016/s0140-6736(97)02419-7 · Cited by 1,028
Bero, L. (1995) · JAMA · doi:10.1001/jama.1995.03530240045039 · Cited by 714
Shea, S., DuMouchel, W., & Bahamonde, L. (1996) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1996.97084513 · Cited by 542
Jadad, A. R., Cook, D. J., Jones, A., Klassen, T. P., Tugwell, P., Moher, M., & Moher, D. (1998) · JAMA · doi:10.1001/jama.280.3.278 · Cited by 534
Thompson, S. G., & Pocock, S. J. (1991) · The Lancet · doi:10.1016/0140-6736(91)91975-z · Cited by 487
Meta-analysis of Trials Comparing β-Blockers, Calcium Antagonists, and Nitrates for Stable Angina
Heidenreich, P. A. (1999) · JAMA · doi:10.1001/jama.281.20.1927 · Cited by 355 · cited 1×
“However, such language bias was not noted in other studies.(63) In addition, 9 studies included in the current review were performed outside the United States; all 9 studies found positive effects of reminder/recall systems.”
ResultRandom-Effects Meta-Analyses Are Not Always Conservative
Poole, C., & Greenland, S. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a010035 · Cited by 338
Effect of Blinding and Unmasking on the Quality of Peer Review: A Randomized Trial
van Rooyen, S., Godlee, F., Evans, S., Smith, R., & Black, N. (1998) · JAMA · doi:10.1001/jama.280.3.234 · Cited by 280
Ornstein, S. M., Garr, D. R., Jenkins, R., Rust, P. F., & Arnon, A. (1991) · PubMed · Cited by 238
Minimizing the Three Stages of Publication Bias
Chalmers, T. C. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100104016 · Cited by 238
Improving Immunization Coverage Rates: An Evidence-based Review of the Literature
Shefer, A., Briss, P., Rodewald, L., Bernier, R., Strikas, R., Yusuf, H., Ndiaye, S., Wiliams, S., Pappaioanou, M., & Hinman, A. R. (1999) · Epidemiologic Reviews · doi:10.1093/oxfordjournals.epirev.a017992 · Cited by 178
Self-citationStandards for Pediatric Immunization Practices
Bernier, R. H. (1993) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1993.03500140069038 · Cited by 171
Rodewald, L. E., Szilagyi, P. G., Humiston, S. G., Barth, R., Kraus, R., & Raubertas, R. F. (1999) · Pediatrics · doi:10.1542/peds.103.1.31 · Cited by 136
Self-citationImmunization Practices of Pediatricians and Family Physicians in the United States
Szilagyi, P. G., Hager, J., Roghmann, K. J., Doane, C., Cove, L. A., Rodewald, L. E., Humiston, S. G., Fleming, G. V., & Hall, C. B. (1994) · PEDIATRICS · doi:10.1542/peds.94.4.517 · Cited by 133
Self-citationSzilagyi, P. G., Rodewald, L. E., Savageau, J., Yoos, L., & Doane, C. (1992) · Pediatrics · doi:10.1542/peds.90.6.871 · Cited by 131
Self-citationComparison of three methods of recalling patients for influenza vaccination.
McDowell, I., Newell, C., & Rosser, W. W. (1986) · Europe PMC (PubMed Central) · Cited by 127
The relationship of health beliefs and a postcard reminder to influenza vaccination.
Larson, E. B., Olsen, E., Cole, W. C. C., & Shortell, S. M. (1979) · PubMed · Cited by 116
Evaluation of the effectiveness of immunization delivery methods.
Gyorkos, T. W., Tannenbaum, T. N., Abrahamowicz, M., Bédard, L., Carsley, J., Franco, E. D., Delage, G., Miller, M. A., Lamping, D. L., & Grover, S. A. (1994) · PubMed · Cited by 113
Wood, D., Halfon, N., Donald-Sherbourne, C., Mazel, R. M., Schuster, M., Hamlin, J. S., Pereyra, M., Camp, P., Grabowsky, M., & Duan, N. (1998) · JAMA · doi:10.1001/jama.279.1.29 · Cited by 104
Computer-based vs manual health maintenance tracking. A controlled trial
Frame, P. S. (1994) · Archives of Family Medicine · doi:10.1001/archfami.3.7.581 · Cited by 103
Linkins, R. W. (1994) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.1994.02170090022002 · Cited by 100
A target-based model for increasing influenza immunizations in private practice
Buffington, J., Bell, K., & LaForce, F. M. (1991) · Journal of General Internal Medicine · doi:10.1007/bf02598961 · Cited by 100
Barton, M. B., & Schoenbaum, S. C. (1990) · American Journal of Public Health · doi:10.2105/ajph.80.5.534 · Cited by 98
Use of reminders for preventive procedures in family medicine.
Rosser, W. W., McDowell, I., & Newell, C. (1991) · PubMed Central · Cited by 95
Lieu, T. A., Capra, A. M., Makol, J., Black, S. B., Shinefield, H. R., & for the Immunization Message Study Group (1998) · Pediatrics · doi:10.1542/peds.101.4.e3 · Cited by 95
Improving Preventive Care at a Medical Clinic: How Can the Patient Help?
Becker, D. M., Gomez, E. B., Kaiser, D. L., Yoshihasi, A., & Hodge, R. H. (1989) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(18)31056-0 · Cited by 90
Is Underimmunization a Marker for Insufficient Utilization of Preventive and Primary Care?
Rodewald, L. E. (1995) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.1995.02170160047007 · Cited by 87
Self-citationUse of reminders to increase compliance with tetanus booster vaccination.
Rosser, W. W., Hutchison, B. G., McDowell, I., & Newell, C. (1992) · Europe PMC (PubMed Central) · Cited by 85
Stehr‐Green, P. A., Dini, E. F., Lindegren, M. L., & PATRIARCA, P. A. (1993) · Europe PMC (PubMed Central) · Cited by 76
Influenza Vaccination in Community Elderly: A Controlled Trial of Postcard Reminders
Buchner, D. M., Larson, E. B., & White, R. F. (1987) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1987.tb06354.x · Cited by 68
Fairbrother, G., Friedman, S. M., Dumont, K. A., & Löbach, K. S. (1996) · PEDIATRICS · doi:10.1542/peds.97.6.785 · Cited by 67
Brimberry, R. K. (1988) · PubMed · Cited by 66
DRINKING WATER AND CANCER IN LOUISIANA
GOITLIEB, M. S., CARR, J. K., & CLARKSON, J. R. (1982) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113448 · Cited by 65
Nexøe, J., Kragstrup, J., & Rønne, T. (1997) · Scandinavian Journal of Primary Health Care · doi:10.3109/02813439709018497 · Cited by 60
Computer Reminders Improve On-Time Immunization Rates
ALEMI, F., ALEMAGNO, S. A., GOLDHAGEN, J., ASH, L., FINKELSTEIN, B., LAVIN, A., BUTTS, J., & GHADIRI, A. (1996) · Medical Care · doi:10.1097/00005650-199610003-00005 · Cited by 58
Increasing Influenza Vaccination Adherence Through Voice Mail
Leirer, V. O., Morrow, D. G., Pariante, G., & Doksum, T. (1989) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1989.tb06679.x · Cited by 57
Young, S. A., Halpin, T. J., Johnson, D. A., Irvin, J. J., & Marks, J. S. (1980) · American Journal of Public Health · doi:10.2105/ajph.70.4.422 · Cited by 57
Computer-generated recall letters for underimmunized children: how cost-effective?
Lieu, T. A., BLACK, S. B., Ray, P., SCHWALBE, J. A., Lewis, E. M., Lavetter, A., Morozumi, P. A., & Shinefield, H. R. (1997) · The Pediatric Infectious Disease Journal · doi:10.1097/00006454-199701000-00007 · Cited by 55
Patient-Specific Reminder Letters and Pediatric Well-Child-Care Show Rates
Campbell, J. R., Szilagyi, P. G., Rodewald, L. E., Doane, C., & Roghmann, K. J. (1994) · Clinical Pediatrics · doi:10.1177/000992289403300503 · Cited by 54
Self-citationInfluenza immunization in a managed care organization
Baker, A. M., McCarthy, B. D., Gurley, V. F., & Yood, M. U. (1998) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1998.00136.x · Cited by 50
The flu shot study: Using multiattribute utility theory to design a vaccination intervention
Carter, W. B., Beach, L. R., & Inui, T. S. (1986) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(86)90007-5 · Cited by 50
Margolis, K. L., Nichol, K. L., Wuorenma, J., & Von Sternberg, T. L. (1992) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1992.tb04480.x · Cited by 46
Mullooly, J. P. (1987) · American Journal of Public Health · doi:10.2105/ajph.77.5.626 · Cited by 45
Computer-generated mailed reminders for influenza immunization
Moran, W. P., Nelson, K., Wofford, J. L., & Vélez, R. (1992) · Journal of General Internal Medicine · doi:10.1007/bf02599460 · Cited by 43
Evaluation of a Follow-Up System in a County Health Department’s Immunization Clinic
Tollestrup, K., & Hubbard, B. B. (1991) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(18)30961-9 · Cited by 40
The Impact of Interventions by a Community-Based Organization on Inner-city Vaccination Coverage
LeBaron, C. W., Starnes, D. M., Dini, E. F., Chambliss, J. W., & Chaney, M. (1998) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.152.4.327 · Cited by 39
Satterthwaite, P. (1997) · PubMed · Cited by 39
Influenza immunization: the impact of notifying patients of high-risk status.
Sa, S., & Kugler, J. P. (1991) · PubMed · Cited by 39
School health nurse interventions to increaseimmunisation uptake in school entrants
Ferson, M. J., Fitzsimmons, G., Christie, D., et al. (1995) · Public Health · doi:10.1016/s0033-3506(95)80072-7 · Cited by 36
Massoudi, M. S., Walsh, J., Stokley, S. K., Rosenthal, J., Stevenson, J. F., Miljanović, B., Mann, J., & Dini, E. F. (1999) · PEDIATRICS · doi:10.1542/peds.103.6.1218 · Cited by 33
Hogg, W. E., Bass, M. J., Calonge, N., Crouch, H., & Satenstein, G. (1998) · PubMed Central · Cited by 31
Alto, W. A., Fury, D., Condo, A., Doran, M., & Aduddell, M. (1995) · PubMed · Cited by 30
The effect of patient education on pediatric immunization rates.
Oeffinger, K. C., Roaten, S. P., Hitchcock, M. A., & Oeffinger, P. K. (1992) · PubMed · Cited by 29
Siebers, M. J., & Hunt, V. B. (1985) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1985.tb04888.x · Cited by 29
Goldberg, H. I. (1993) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.1993.02160310019007 · Cited by 27
Early results from the Northland immunisation register.
Soljak, M., & Handford, S. (1987) · PubMed · Cited by 22
Evidence on Office-Based Interventions to Improve Childhood Immunization Delivery
Udovic, S. L., & Lieu, T. A. (1998) · Pediatric Annals · doi:10.3928/0090-4481-19980601-10 · Cited by 21
Postcard reminders from GPs for influenza vaccine: Are they more effective than an ad hoc approach?
Puech, M., Ward, J., & Lajoie, V. (1998) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1467-842x.1998.tb01183.x · Cited by 21
The telephone: an overlooked technology for prevention in family medicine.
Lukasik, M. H., & Pratt, G. (1987) · PubMed Central · Cited by 17
Cited by
Increasing Vaccination: Putting Psychological Science Into Action
Brewer, N. T., Chapman, G. B., Rothman, A. J., Leask, J., & Kempe, A. (2017) · Psychological Science in the Public Interest · doi:10.1177/1529100618760521 · Cited by 1,233
Jemal, A., Simard, E. P., Dorell, C., Noone, A.-M., Markowitz, L. E., Kohler, B., Eheman, C., Saraiya, M., Bandi, P., Saslow, D., et al. (2013) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djs491 · Cited by 993
Using implementation intentions prompts to enhance influenza vaccination rates
Milkman, K. L., Beshears, J., Choi, J. J., Laibson, D., & Madrian, B. C. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1103170108 · Cited by 498
Patient reminder and recall interventions to improve immunization rates
Jacobson Vann, J. C., Jacobson, R. M., Coyne-Beasley, T., Asafu-Adjei, J. K., & Szilagyi, P. G. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003941.pub3 · Cited by 396
Self-citationA systematic review of interventions for reducing parental vaccine refusal and vaccine hesitancy
Sadaf, A., Richards, J. L., Glanz, J., Salmon, D. A., & Omer, S. B. (2013) · Vaccine · doi:10.1016/j.vaccine.2013.07.013 · Cited by 392
Metadata
- Authors
- Szilagyi, P. G., Bordley, C., Vann, J. C., Chelminski, A., Kraus, R. M., Margolis, P. A., & Rodewald, L. E.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2000-10-11
- Volume
- 284
- Issue
- 14
- Pages
- 1820
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W1967872201
- Cited by
- 377
- References
- 60
- FWCI
- 18.27
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.