CoChat

System accuracy evaluation of 18 CE-marked current-generation blood glucose monitoring systems based on EN ISO 15197:2015

Open access

The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index; 6 of the 28 sources its claims cite were checked for support.

Abstract

OBJECTIVE: Accuracy of 18 current-generation blood glucose monitoring systems (BGMS) available in Europe was evaluated applying criteria adapted from EN ISO 15197:2015 with one reagent system lot. BGMS were selected based on market research data. RESEARCH DESIGN AND METHODS: The BGMS ABRA, Accu-Chek Guide, AURUM, CareSens Dual, CERA-CHEK 1CODE, ContourNext One, eBsensor, FreeStyle Freedom Lite, GL50 evo, GlucoCheck GOLD, GlucoMen areo 2K, GluNEO, MyStar DoseCoach, OneTouch Verio Flex, Pic GlucoTest, Rightest GM700S, TRUEyou, and WaveSense JAZZ Wireless were tested using capillary blood from 100 different subjects and assessing the percentage of results within ±15 mg/dL (0.83 mmol/L) or 15% of comparison method results for BG concentrations below or above 100 mg/dL (5.55 mmol/L), respectively. In addition, the minimal deviation from comparison method results within which ≥95% of results of the respective BGMS were found was calculated. RESULTS: In total, 14 BGMS had ≥95% of results within ±15 mg/dL (0.83 mmol/L) or ±15% and 3 BGMS had ≥95% of results within ±10 mg/dL (0.55 mmol/L) or ±10% of the results obtained with the comparison method. The smallest deviation from comparison method results within which ≥95% of results were found was ±7.7 mg/dL (0.43 mmol/L) or ±7.7%; the highest deviation was ±19.7 mg/dL (1.09 mmol/L) or ±19.7%. CONCLUSIONS: This accuracy evaluation shows that not all CE-labeled BGMS fulfill accuracy requirements of ISO 15197 reliably and that there is considerable variation even among BGMS fulfilling these criteria. This safety-related information should be taken into account by patients and healthcare professionals when making therapy decisions. TRIAL REGISTRATION NUMBER: NCT03737188.

Overview

CoChat Summary

## TL;DR

This surveillance study tested 18 current-generation CE-marked blood glucose monitoring systems (BGMS) available in Europe using capillary blood from 100 different subjects and ISO 15197-based accuracy criteria. Fourteen systems met the minimum accuracy criterion, while 4 systems (>20%) did not, and accuracy varied substantially even among systems that met the standard.

## Key findings

  • 14 of 18 BGMS (77.8%) met the minimum ISO 15197 accuracy criterion of ≥95% of results within ±15 mg/dL or ±15%; 3 of 18 (16.7%) met the stricter ±10 mg/dL or ±10% criterion.
  • 0 of 18 BGMS achieved ≥95% of results within ±5 mg/dL or ±5%.
  • The minimal deviation from the comparison/reference procedure within which ≥95% of results were found ranged from ±7.7 mg/dL (±7.7%) for ContourNext One to ±19.7 mg/dL (±19.7%) for eBsensor.
  • All BGMS had 100% of results in the clinically acceptable Consensus Error Grid zones A and B for the evaluated reagent lot.

## Methods

  • Design: Independent surveillance study conducted in November and December 2018 in a controlled laboratory setting in Ulm, Germany, using one reagent system lot per BGMS and comparing system results to the respective manufacturer’s reference measurement procedure.
  • Sample/data: 126 subjects were enrolled to obtain 100 evaluable data sets; the study included 44 with type 1 diabetes, 58 with type 2 diabetes, and 24 without diabetes. For each system, 200 data points from at least 100 capillary samples from different subjects were analyzed; 87 subjects contributed to the analysis across all 18 BGMS.
  • Analysis: Accuracy was assessed by the proportion of results within ISO 15197 thresholds (±15 mg/dL/±15%, plus ±10 mg/dL/±10% and ±5 mg/dL/±5%), the minimal deviation needed for ≥95% of results, and Consensus Error Grid analysis; relative bias was calculated using Bland and Altman.

## Limitations

  • The paper states that only one reagent system lot per BGMS was tested, and that lot-to-lot variability is important; it notes that ISO 15197 requires testing of three lots.
  • The paper states that measurements were done in a controlled laboratory environment by trained personnel, which tends to produce more accurate results than lay-user testing.
  • Evident from the text: the study used manufacturer’s reference measurement procedures as comparators, and one system (GluNEO) lacked documented calibration/reference-procedure information in the labeling, so the authors had to make an assumption; this may affect comparability.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1136/bmjdrc-2019-001067

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Difference plots for 18 blood glucose monitoring systems (BGMS) (n=200 for each difference plot) when evaluated against the manufacturer’s reference measurement procedure. Red/green solid lines: system accuracy criterion A in accordance to ISO 15197, ±15 mg/dL (0.83 mmol/L)/±15% (green lines were used if accuracy criterion a was fulfilled, red lines were used if accuracy criterion a was not fulfilled). Gray solid lines: accuracy limits of ±10 mg/dL (0.56 mmol/L)/±10%. Blue dashed lines: minimal deviation from the reference measurement procedure’s results within which ≥95% of results of the respective BGMS were found. For system l, no information about the manufacturer’s reference measurement procedure was available at the time of manuscript submission. Based on literature research19 and the investigator’s experience regarding reliability of measurement results, the hexokinase (HK)-based procedure was assigned as primary reference measurement procedure for system accuracy evaluation. If values were found outside the y-axis limits of ±80 mg/dL, a label was added to the upper or lower left corner of the BGMS’ subgraph and arrows indicate at which concentrations these values were found. GOD, glucose oxidase.
Figure 1 Difference plots for 18 blood glucose monitoring systems (BGMS) (n=200 for each difference plot) when evaluated against the manufacturer’s reference measurement procedure. Red/green solid lines: system accuracy criterion A in accordance to ISO 15197, ±15 mg/dL (0.83 mmol/L)/±15% (green lines were used if accuracy criterion a was fulfilled, red lines were used if accuracy criterion a was not fulfilled). Gray solid lines: accuracy limits of ±10 mg/dL (0.56 mmol/L)/±10%. Blue dashed lines: minimal deviation from the reference measurement procedure’s results within which ≥95% of results of the respective BGMS were found. For system l, no information about the manufacturer’s reference measurement procedure was available at the time of manuscript submission. Based on literature research19 and the investigator’s experience regarding reliability of measurement results, the hexokinase (HK)-based procedure was assigned as primary reference measurement procedure for system accuracy evaluation. If values were found outside the y-axis limits of ±80 mg/dL, a label was added to the upper or lower left corner of the BGMS’ subgraph and arrows indicate at which concentrations these values were found. GOD, glucose oxidase.CC BY · PubMed Central
Figure 2 Minimal deviation of measurement results obtained with the tested blood glucose monitoring system (BGMS) (n=200 for each BGMS) from the respective manufacturer’s reference measurement procedure’s measurement results containing at least 95% of values (blue dashed lines; represented by blue funnels in figure 1A and B). For system l, no information about the manufacturer’s reference measurement procedure was available at the time of manuscript submission. Based on literature research19 and the investigator’s experience regarding reliability of measurement results, the hexokinase (HK)-based procedure was assigned as primary reference measurement procedure for system accuracy evaluation. Green/red solid lines: accuracy limits of ±15 mg/dL (0.83 mmol/L)/±15% (green lines were used if accuracy criterion a was fulfilled, red lines were used if accuracy criterion a was not fulfilled). Gray solid lines: accuracy limits of ±10 mg/dL (0.56 mmol/L)/±10%. BGMS with HK as manufacturer’s reference measurement procedure are marked with a blue open circle on the x-axis.
Figure 2 Minimal deviation of measurement results obtained with the tested blood glucose monitoring system (BGMS) (n=200 for each BGMS) from the respective manufacturer’s reference measurement procedure’s measurement results containing at least 95% of values (blue dashed lines; represented by blue funnels in figure 1A and B). For system l, no information about the manufacturer’s reference measurement procedure was available at the time of manuscript submission. Based on literature research19 and the investigator’s experience regarding reliability of measurement results, the hexokinase (HK)-based procedure was assigned as primary reference measurement procedure for system accuracy evaluation. Green/red solid lines: accuracy limits of ±15 mg/dL (0.83 mmol/L)/±15% (green lines were used if accuracy criterion a was fulfilled, red lines were used if accuracy criterion a was not fulfilled). Gray solid lines: accuracy limits of ±10 mg/dL (0.56 mmol/L)/±10%. BGMS with HK as manufacturer’s reference measurement procedure are marked with a blue open circle on the x-axis.CC BY · PubMed Central

Verification

Claims the paper makes

6 Valid · 0 Not valid · 18 Not checked · 26 Own results and interpretations

19 more claims · 1 with their cited sources checked

Create a free account to see all 50 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 17
  • It may state two separate claims as one. 12

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 40 references

Research works printed but not linked: 2

  1. Rodbard, 2007, American Association of Clinical Endocrinologists medical guidelines for clinical practice for the management of diabetes mellitus, Endocr Pract, 13 Suppl 1, 1
  2. International Organization for Standardization . In vitro diagnostic medical devices—Measurement of quantities in biological samples—Metrological traceability of values assigned to calibrators and control materials; 2003: 2003.

Cited by

See all 63

Metadata

Authors
Pleus, S., Baumstark, A., Jendrike, N., Mende, J., Link, M., Zschornack, E., Haug, C., & Freckmann, G.
Affiliations
Universität Ulm (DE)
Corresponding author
Pleus, Stefan
Venue
BMJ Open Diabetes Research & Care
Publisher
BMJ
Published
2020-01
Volume
8
Issue
1
Pages
e001067
ISSN
2052-4897 (ISSN-L)
OpenAlex
W3000482613
Cited by
63
References
40
Citations by year
2026: 9 · 2025: 13 · 2024: 8 · 2023: 6 · 2022: 11 · 2021: 10 · 2020: 6
FWCI
6.22
Type
journal article
Language
en
Open access
Locations
  • BMJ Open Diabetes Research & Care (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Beurer GmbH, Germany
  • LifeScan Scotland Limited, United Kingdom
  • Ascensia Diabetes Care Deutschland GmbH, Germany
  • Roche Diabetes Care GmbH, Germany
  • AgaMatrix Europe Limited, United Kingdom
  • i-SENS GmbH, Germany
Topics
  • Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Diabetes Management and Research
  • Health Sciences › Health Professions › Medical Laboratory Technology › Clinical Laboratory Practices and Quality Control
  • Physical Sciences › Chemistry › Analytical Chemistry › Electrochemical sensors and biosensors
Keywords
blood glucose monitoring systems, measurement accuracy, CE marking, capillary blood glucose, comparison method, point-of-care glucose testing, regulatory compliance
MeSH terms
Adult, Aged, Aged, 80 and over, Blood Glucose, Diabetes Mellitus, Type 1, Diabetes Mellitus, Type 2, Europe, Female, Follow-Up Studies, Humans, Male, Middle Aged, Patient Acceptance of Health Care, Prognosis, Reference Standards, Research Design, Blood Glucose Self-Monitoring, Reproducibility of Results, Biomarkers, Point-of-Care Systems, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: System accuracy evaluation of 18 CE-marked current-generation blood glucose monitoring systems based on EN ISO 15197:2015. https://app.cochat.ai/papers/10.1136/bmjdrc-2019-001067
The paper
Pleus, S., Baumstark, A., Jendrike, N., Mende, J., Link, M., Zschornack, E., Haug, C., & Freckmann, G. (2020). System accuracy evaluation of 18 CE-marked current-generation blood glucose monitoring systems based on EN ISO 15197:2015. BMJ Open Diabetes Research & Care. https://doi.org/10.1136/bmjdrc-2019-001067

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.