Demonstration of the Use of Remote Temperature Monitoring Devices in Vaccine Refrigerators in Haiti
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index; 8 of the 20 sources its claims cite were checked for support.
Abstract
After the 2010 earthquake, Haiti committed to introducing 4 new antigens into its routine immunization schedule, which required improving its cold chain (ie, temperature-controlled supply chain) and increasing vaccine storage capacity by installing new refrigerators. We tested the feasibility of using remote temperature monitoring devices (RTMDs) in Haiti in a sample of vaccine refrigerators fueled by solar panels, propane gas, or electricity. We analyzed data from 16 RTMDs monitoring 24 refrigerators in 15 sites from March through August 2014. Although 5 of the 16 RTMDs exhibited intermittent data gaps, we identified typical temperature patterns consistent with refrigerator door opening and closing, propane depletion, thermostat insufficiency, and overstocking. Actual start-up, annual maintenance, and annual electricity costs for using RTMDs were $686, $179, and $9 per refrigerator, respectively. In Haiti, RTMD use was feasible. RTMDs could be prioritized for use with existing refrigerators with high volumes of vaccines and new refrigerators to certify their functionality before use. Vaccine vial monitors could provide additional useful information about cumulative heat exposure and possible vaccine denaturation.
Overview
CoChat Summary
TL;DR
This demonstration found that remote temperature monitoring devices (RTMDs) were feasible for monitoring vaccine refrigerators in Haiti, despite intermittent data gaps in some devices. RTMD data revealed temperature patterns consistent with door opening/closing, propane depletion, thermostat insufficiency, and overstocking, and costs were estimated per refrigerator.
Key findings
- Of 16 RTMDs monitoring 24 refrigerators at 15 sites, 14 devices transmitted consistent data for 21 refrigerators; 5 devices had intermittent data gaps.
- Temperature patterns were consistent with refrigerator door opening and closing, propane depletion, thermostat insufficiency, and overstocking, which reduced air circulation.
- Actual costs per refrigerator in the demonstration were $686 start-up, $179 annual maintenance, and $9 annual electricity; if 1 RTMD monitored 4 or 8 refrigerators, estimated costs fell to $257/$67/$4 and $129/$34/$1, respectively.
- The authors recommend prioritizing RTMDs for high-volume existing refrigerators, new refrigerators needing certification, and spot checks of refrigerators with prior excursions; vaccine vial monitors could supplement cumulative heat exposure information.
Methods
- Test phase: in October 2013, RTMDs were installed in 1 solar and 2 propane refrigerators at 3 health facilities (1 urban, 2 rural) to test data collection and transmission.
- Demonstration phase: from October 2013 through April 2014, 13 additional RTMDs were installed, totaling 16 devices at 15 sites in Ouest and Artibonite departments, monitoring 24 refrigerators (8 propane, 15 solar, 1 electric) at 10 peripheral and 5 intermediate storage locations.
- The FridgeFone RTMD used 4 sensors (2 interior, 1 door jamb, 1 ambient), sampled every 10 minutes, and uploaded data via mobile networks; analysis covered March 1–August 16, 2014, examining excursions, ambient temperature, door status, and costs.
Limitations
- Stated: results cannot be generalized to the nearly 700 vaccine refrigerators in all 10 of Haiti’s departments; the sample size of 16 RTMDs was limited by available funds.
- Stated: the authors did not monitor or evaluate local responses to excursion alarms, and door monitors were prone to falling off or becoming disconnected, causing data gaps.
- Stated: battery electricity costs were excluded because battery recharge frequency was unknown; evident from the text: the demonstration covered only 2 departments over a limited period, and cost estimates relied on manufacturer electricity use and a public government electricity rate.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
5 Valid · 0 Not valid · 10 Not checked · 30 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The data provided by these devices have also been used to document staff member training and financial resource needs (eg, cold-chain equipment fuel, repairs, or replacements) and to advocate for those needs. 18”
What the sources say
- Partly supportedcites [18] 18. Brison M, LeTallec Y. Transforming cold chain performance and management in lower-income countries. Vaccine . 2017; 35(17):2107-2109. sourceExperimental — accuracy not yet measured
Section 3.3 (page not provided) reports that managers in Tanzania used cold-room temperature records to demonstrate inadequate generator-fuel allocations and successfully advocate for more funding. The paper does not say those records came from continuous electronic monitoring devices, or that such data were used to document and advocate for staff training, repairs, or replacements. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In many immunization settings, continuous electronic temperature monitoring devices have been shown to be more useful than stem thermometers, in part because they provide data that can detect cold-chain equipment needing service or replacement. 16,17”
What the sources say
- Partly supportedcites [16] 16. Lloyd J, Lydon P, Ouhichi R, Zaffran M. Reducing the loss of vaccines from accidental freezing in the cold chain: the experience of continuous temperature monitoring in Tunisia. Vaccine . 2015;33(7):902-907. sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Partly supportedcites [17] 17. Lennon P, Atuhaire B, Yavari S, et al. Root cause analysis underscores the importance of understanding, addressing, and communicating cold chain equipment failures to improve equipment performance. Vaccine . 2017;35(17): 2198-2202. sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“even with remote access to data on continuous temperatures, the lack of response to documented excursions has been common, not only in low-resource settings where shortages of propane, transportation, and spare parts are commonplace, but also in high-resource areas. 10,19,20”
What the sources say
- Partly supportedcites [10] 10. Ashok A, Brison M, LeTallec Y. Improving cold chain systems: challenges and solutions. Vaccine . 2017;35(17):2217-2223. sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Partly supportedcites [19] 19. McColloster P, Vallbona C. Graphic-output temperature data loggers for monitoring vaccine refrigeration: implications for pertussis. Am J Public Health . 2011;101(1):46-47. sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Not checked yetcites [20] 20. US Agency for International Development, Material Child Health Integrated Program. Bottlenecks and breakthroughs: lessons learned from new vaccine introductions in lowresource countries, 2008 to 2013. http://www.jsi.com/JSIInter net/Inc/Common/\_download\_pub.cfm?id ¼ 15580&lid ¼ 3. Accessed April 26, 2017.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Nevertheless, many immunization programs worldwide use only stem thermometers. 10,19”
What the sources say
- Partly supportedcites [10] 10. Ashok A, Brison M, LeTallec Y. Improving cold chain systems: challenges and solutions. Vaccine . 2017;35(17):2217-2223. sourceExperimental — accuracy not yet measured
Section 3.3.2 says many cold-chain sites rely on stem thermometers, and section 3.3.3.1 recommends replacing them in many countries. The paper does not establish that entire immunization programs worldwide use only stem thermometers; its statement concerns sites and does not say their use is exclusive. Page numbers are unavailable in our copy. (LLM, conf=0.83)
- Partly supportedcites [19] 19. McColloster P, Vallbona C. Graphic-output temperature data loggers for monitoring vaccine refrigeration: implications for pertussis. Am J Public Health . 2011;101(1):46-47. sourceExperimental — accuracy not yet measured
The Discussion (pp. 46–47) describes twice-daily thermometer readings as the current standard for vaccine storage. It does not specify stem thermometers, say that programs use only those devices, or establish how many programs worldwide do so. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“During the demonstration phase, after propane depletion, interior refrigerator temperatures typically increased to the level of ambient room temperatures during a 12-hour period.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
22 more claims
Create a free account to see all 45 claims and to verify the 7 references still open.
- It may state two separate claims as one. 9
- Probably not a substantial claim. 11
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“these costs would be $4 and $1 per refrigerator if each RTMD were to monitor 4 or 8 refrigerators, respectively (Table). The annual electricity cost was estimated to be $13.50 per RTMD.”
Reported 1 · recomputed 1.6875
Citations
Cites
Improving cold chain systems: Challenges and solutions
Ashok, A., Brison, M., & LeTallec, Y. (2017) · Vaccine · doi:10.1016/j.vaccine.2016.08.045 · Cited by 308
Global Routine Vaccination Coverage, 2015
Casey, R. M., Dumolard, L., Danovaro-Holliday, M. C., Gacic-Dobo, M., Diallo, M. S., Hampton, L. M., & Wallace, A. S. (2016) · MMWR. Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm6545a5 · Cited by 108
Self-citationLloyd, J., Lydon, P., Ouhichi, R., & Zaffran, M. (2015) · Vaccine · doi:10.1016/j.vaccine.2014.10.080 · Cited by 85
McColloster, P., & Vallbona, C. (2011) · American Journal of Public Health · doi:10.2105/ajph.2009.179853 · Cited by 60
Transforming cold chain performance and management in lower-income countries
Brison, M., & LeTallec, Y. (2017) · Vaccine · doi:10.1016/j.vaccine.2016.11.067 · Cited by 44
Lennon, P., Atuhaire, B., Yavari, S., Sampath, V., Mvundura, M., Ramanathan, N., & Robertson, J. (2017) · Vaccine · doi:10.1016/j.vaccine.2016.09.068 · Cited by 41
Research works printed but not linked: 4
- 8. Haitian Ministry of Public Health and Population. Complete Multi-annual Plan for the Expanded Program on Immunization: CMAP EPI, 2011-2015 . Port-au-Prince, Haiti: Haitian Ministry of Public Health and Population; 2011.
- 9. Haitian Ministry of Public Health and Population. Assessment of Haiti's EPI Cold Chain and Logistics System . Port-au-Prince, Haiti: Haitian Ministry of Public Health and Population; 2011.
- 12. Sharma SK, Sharma Y, Kumar S, Sharma E. Vaccine vial monitors (VVMs): applications and challenges. Pharma Innov J . 2017;6(3):1-6.
- 15. Haitian Ministry of Public Health and Population. Physical Inventory of Cold Chain Equipment and Vehicles of the Haitian Health System [in French] . Port-au-Prince, Haiti: Haitian Ministry of Public Health and Population; 2013.
Cited by
Pambudi, N. A., Sarifudin, A., Gandidi, I. M., & Romadhon, R. (2022) · Energy Reports · doi:10.1016/j.egyr.2021.12.039 · Cited by 170
The Development of a Cold-Chain-Packaging Risk Management Model Based on Fuzzy Bayesian Network
Ren, T., Ren, J., & Matellini, D. B. (2024) · Applied Sciences · doi:10.3390/app14114446 · Cited by 7
Conservação de vacinas: o olhar da equipe de enfermagem
Gonçalves, D. T. D. A., Viegas, S. M. D. F., Rennó, H. M. S., Oliveira, V. J., Guimarães, E. A. D. A., Carvalho, H. R. D. J., Montenegro, L. C., & de Oliveira, V. C. (2021) · Avances en Enfermería · doi:10.15446/av.enferm.v39n2.86299 · Cited by 9
Amaral, G. G., de Sousa, L. G., Silva, S. P., Karter, A. L., Silva, B. S., Zacharias, F. C. M., Schönholzer, T. E., Araújo, A. C. D. M., de Oliveira, V. C., & Pinto, I. C. (2024) · Cadernos de Saúde Pública · doi:10.1590/0102-311xpt014924 · Cited by 7
Amaral, G. G., Guimarães, E. A. D. A., Tavares, L. O. D. M., Silva, B. S., Cortez, D. N., & de Oliveira, V. C. (2021) · Epidemiologia e Serviços de Saúde · doi:10.1590/s1679-49742021000300019 · Cited by 9
Metadata
- Authors
- Cavallaro, K. F., Francois, J., Jacques, R., Mentor, D., Yalcouye, I., Wilkins, K., Mueller, N., Turner, R., Wallace, A., & Tohme, R. A.
- Affiliations
- Centers for Disease Control and Prevention (US)
- UNICEF Country Office, Port-au-Prince, Haiti
- Ministère de la Santé Publique et de la Population (HT)
- United Nations Children's Fund (US)
- Expanded Program of Immunization, Ministry of Public Health and Population, Port-au-Prince, Haiti
- ScaleStation, Meridian, ID, USA
- Corresponding author
- Cavallaro, Kathleen F.
- Venue
- Public Health Reports
- Publisher
- SAGE Publications
- Published
- 2017-12-20
- Volume
- 133
- Issue
- 1
- Pages
- 39-44
- ISSN
- 0033-3549 (ISSN-L)
- 1468-2877
- PMC
- PMC5805098
- OpenAlex
- W2778512433
- Cited by
- 13
- References
- 6
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 3 · 2021: 5 · 2020: 1
- FWCI
- 1.34
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Public Health Reports (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- UNICEF
- Topics
- Health Sciences › Health Professions › Medical Laboratory Technology › Quality and Safety in Healthcare
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Pharmaceutical Quality and Counterfeiting
- Life Sciences › Agricultural and Biological Sciences › Food Science › Food Supply Chain Traceability
- Keywords
- vaccine refrigerators, cold chain, vaccine storage, Haiti, 2010 Haiti earthquake, solar-powered refrigerator, vaccine vial monitor
- MeSH terms
- Cold Temperature, Costs and Cost Analysis, Drug Storage, Haiti, Humans, Refrigeration, Vaccines, Remote Sensing Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Demonstration of the Use of Remote Temperature Monitoring Devices in Vaccine Refrigerators in Haiti. https://app.cochat.ai/papers/10.1177/0033354917742119
- The paper
- Cavallaro, K. F., Francois, J., Jacques, R., Mentor, D., Yalcouye, I., Wilkins, K., Mueller, N., Turner, R., Wallace, A., & Tohme, R. A. (2018). Demonstration of the Use of Remote Temperature Monitoring Devices in Vaccine Refrigerators in Haiti. Public Health Reports. https://doi.org/10.1177/0033354917742119
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.