CoChat

Using Data to Keep Vaccines Cold in Kenya: Remote Temperature Monitoring With Data Review Teams for Vaccine Management

Open access

The DOI matches its Crossref record; 14 of the 15 references it cites were found in a registry or an index; 3 of the 28 sources its claims cite were checked for support.

Abstract

Background: Global vaccination coverage rates have remained around 85% for the past several years. Increasing immunization coverage rates requires an effective cold chain to maintain vaccine potency. Remote temperature monitoring (RTM) technology for vaccine refrigerators has shown promise for improving the ability of supply systems to maintain optimal temperature conditions to ensure potent vaccines reach the end users. Methods: A pilot study of RTM technology and data use teams was implemented in 36 study sites in Kenya. Data were collected at baseline and endline points over a 3-month baseline and 7-month implementation period. Data included 44 qualitative interviews, process logs, meeting minutes from data use team meetings, and quantitative temperature and power data from the RTM devices. Results: The ability of cold chain equipment to maintain World Health Organization-recommended temperatures in study sites improved markedly between the baseline and implementation periods, resulting in an improvement in total time spent in the correct range from 83.9% in the baseline period to 90.9% in the intervention period and an improvement in time spent in the too cold range from 6.5% to 1.5%. Friedman tests revealed that differences in time spent in the correct range and time spent in the too cold range during the course of the study were statistically significant (P<.001 and P=.04, respectively). Qualitative and quantitative data suggest that this improvement was due to a combination of improved responsiveness to temperature excursions at the facility level, resulting from SMS alarms for temperature excursion periods, and improved ability at the management level to recognize and address recurring problems. Conclusion: The combination of using RTM technology with a structured data review process by a management team is a promising approach for improving cold chain outcomes. Future research examining the added value of each of the technological and behavioral components separately is needed.

Overview

CoChat Summary

## TL;DR

This Kenyan intervention combined remote temperature monitoring (RTM) with structured data review teams to improve vaccine cold chain management across 36 sites in 3 counties. The paper reports better temperature performance and stronger problem-solving around recurring equipment and management issues, but it could not separate the effects of RTM from the team-based process.

## Key findings

  • Vaccine refrigerator uptime improved from 83.9% of total time at baseline to 90.9% during the intervention period.
  • Time spent in the combined too cold/freezing ranges fell from 6.5% in the 3-month baseline phase to 1.5% in the final 3 months of implementation; this change was statistically significant (χ²(9)=17.663, P=.04).
  • The average number of monthly freeze alarms decreased from 65.3 during baseline to 21.1 during implementation, while heat alarms declined slightly from 16.3 to 15.3 per month; the alarm changes were not statistically significant (P=.15 for cold alarms, P=.10 for hot alarms).
  • Interviewees said RTM alarms improved awareness and responsiveness, and data use teams helped identify recurring issues like faulty thermostats and led to actions such as replacing a refrigerator.

## Methods

  • Design: Nonrandomized pre- and posttest intervention study combining RTM implementation with a structured data review/team problem-solving approach.
  • Sample / setting: 59 refrigerators in 36 health facilities and subcounty vaccine stores across Isiolo, Kajiado, and Nairobi counties; baseline interviews with 13 health personnel and endline interviews with 31 personnel.
  • Analysis: Quantitative RTM data were analyzed using Friedman tests and pairwise comparisons with Bonferroni correction; qualitative interviews, process logs, and meeting minutes were used to interpret behaviors, data use, and implementation experience.

## Limitations

  • The paper states that limited budgetary allocations reduced the regularity of data use team meetings, which likely limited the intervention’s full behavioral impact.
  • Political election disruptions during baseline affected staffing, meeting attendance, and responsiveness to alarms; the authors say they could not control for this effect in the analysis.
  • Process logs and meeting minutes were not maintained regularly, limiting the ability to cross-check performance patterns with documented actions; this limited the study’s ability to measure the effect of escalation and response processes.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.9745/ghsp-d-19-00157

Cites

14 of 14 references verified0 citation errors · 0 not checkable

Statistics

Figures

FIGURE 1. Mean Percentage of Time Spent in Temperature Bands for Vaccine Refrigerators by Month, Baseline (July–September 2017) vs. Implementation (October 2017–April 2018)
FIGURE 1. Mean Percentage of Time Spent in Temperature Bands for Vaccine Refrigerators by Month, Baseline (July–September 2017) vs. Implementation (October 2017–April 2018)CC BY · PubMed Central
FIGURE 2. Average Number of Freeze Alarms per Month, by County, Baseline (July–September 2017) vs. Implementation (October 2017–April 2018)
FIGURE 2. Average Number of Freeze Alarms per Month, by County, Baseline (July–September 2017) vs. Implementation (October 2017–April 2018)CC BY · PubMed Central
FIGURE 3. Temperature Oscillation of a Refrigerator with a Malfunctioning Thermostat, Dagoretti Subcounty Store, October 2017 to December 2017
FIGURE 3. Temperature Oscillation of a Refrigerator with a Malfunctioning Thermostat, Dagoretti Subcounty Store, October 2017 to December 2017CC BY · PubMed Central
An anonymized screenshot of the remote temperature monitoring dashboard showing equipment performance statistics. © 2019 NexLeaf Analytics
An anonymized screenshot of the remote temperature monitoring dashboard showing equipment performance statistics. © 2019 NexLeaf AnalyticsCC BY · PubMed Central

Verification

Claims the paper makes

3 Valid · 0 Not valid · 11 Not checked · 93 Own results and interpretations

56 more claims

Create a free account to see all 107 claims and to verify the 7 references still open.

See all claims — free account
  • It may state two separate claims as one. 38
  • Probably not a substantial claim. 13

Create a free account to see these claims.

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Consistentχ²(9) = 168.412reported p < .001 · recomputed p < .001

    “χ2(9) = 168.412, p < .001”

  • Consistentχ²(9) = 17.663reported p = .04 · recomputed p = .039

    “χ2(9)=17.663, p = .04”

2 of 2

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Self-check results appear here once an independent check has confirmed them.

Citations

Cites

Show all 14 references

Cited by

See all 17

Metadata

Authors
Lutukai, M., Bunde, E. A., Hatch, B., Mohamed, Z., Yavari, S., Some, E., Chweya, A., Kania, C., Ross, J. C., Keddem, C., & Chandani, Y.
Affiliations
  • John Snow (United States) (US)
  • Nexleaf Analytics (US)
  • Ministry of Health (KE)
Corresponding author
Hatch, Benjamin
Venue
Global Health: Science and Practice
Published
2019-12-18
Volume
7
Issue
4
Pages
585-597
ISSN
2169-575X (ISSN-L)
OpenAlex
W2996295068
Cited by
17
References
15
Citations by year
2026: 3 · 2025: 3 · 2024: 2 · 2023: 6 · 2022: 1 · 2020: 2
FWCI
2.53
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Global Health Science and Practice (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Greater South Information System
Funders
  • Bill and Melinda Gates Foundation
  • Government of the Republic of Kenya
Topics
  • Health Sciences › Health Professions › Medical Laboratory Technology › Quality and Safety in Healthcare
  • Life Sciences › Agricultural and Biological Sciences › Food Science › Food Supply Chain Traceability
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Pharmaceutical Quality and Counterfeiting
Keywords
remote temperature monitoring, vaccine cold chain, vaccine refrigerators, vaccine management, temperature excursions, SMS alerts, vaccination coverage, vaccine potency, health services administration, Kenya
MeSH terms
Drug Stability, Drug Storage, Humans, Kenya, Pilot Projects, Temperature, Vaccines, Remote Sensing Technology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Using Data to Keep Vaccines Cold in Kenya: Remote Temperature Monitoring With Data Review Teams for Vaccine Management. https://app.cochat.ai/papers/10.9745/ghsp-d-19-00157
The paper
Lutukai, M., Bunde, E. A., Hatch, B., Mohamed, Z., Yavari, S., Some, E., Chweya, A., Kania, C., Ross, J. C., Keddem, C., & Chandani, Y. (2019). Using Data to Keep Vaccines Cold in Kenya: Remote Temperature Monitoring With Data Review Teams for Vaccine Management. Global Health: Science and Practice. https://doi.org/10.9745/ghsp-d-19-00157

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.