System accuracy evaluation of 18 CE-marked current-generation blood glucose monitoring systems based on EN ISO 15197:2015
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index; 6 of the 28 sources its claims cite were checked for support.
Abstract
OBJECTIVE: Accuracy of 18 current-generation blood glucose monitoring systems (BGMS) available in Europe was evaluated applying criteria adapted from EN ISO 15197:2015 with one reagent system lot. BGMS were selected based on market research data. RESEARCH DESIGN AND METHODS: The BGMS ABRA, Accu-Chek Guide, AURUM, CareSens Dual, CERA-CHEK 1CODE, ContourNext One, eBsensor, FreeStyle Freedom Lite, GL50 evo, GlucoCheck GOLD, GlucoMen areo 2K, GluNEO, MyStar DoseCoach, OneTouch Verio Flex, Pic GlucoTest, Rightest GM700S, TRUEyou, and WaveSense JAZZ Wireless were tested using capillary blood from 100 different subjects and assessing the percentage of results within ±15 mg/dL (0.83 mmol/L) or 15% of comparison method results for BG concentrations below or above 100 mg/dL (5.55 mmol/L), respectively. In addition, the minimal deviation from comparison method results within which ≥95% of results of the respective BGMS were found was calculated. RESULTS: In total, 14 BGMS had ≥95% of results within ±15 mg/dL (0.83 mmol/L) or ±15% and 3 BGMS had ≥95% of results within ±10 mg/dL (0.55 mmol/L) or ±10% of the results obtained with the comparison method. The smallest deviation from comparison method results within which ≥95% of results were found was ±7.7 mg/dL (0.43 mmol/L) or ±7.7%; the highest deviation was ±19.7 mg/dL (1.09 mmol/L) or ±19.7%. CONCLUSIONS: This accuracy evaluation shows that not all CE-labeled BGMS fulfill accuracy requirements of ISO 15197 reliably and that there is considerable variation even among BGMS fulfilling these criteria. This safety-related information should be taken into account by patients and healthcare professionals when making therapy decisions. TRIAL REGISTRATION NUMBER: NCT03737188.
Overview
CoChat Summary
## TL;DR
This surveillance study tested 18 current-generation CE-marked blood glucose monitoring systems (BGMS) available in Europe using capillary blood from 100 different subjects and ISO 15197-based accuracy criteria. Fourteen systems met the minimum accuracy criterion, while 4 systems (>20%) did not, and accuracy varied substantially even among systems that met the standard.
## Key findings
- 14 of 18 BGMS (77.8%) met the minimum ISO 15197 accuracy criterion of ≥95% of results within ±15 mg/dL or ±15%; 3 of 18 (16.7%) met the stricter ±10 mg/dL or ±10% criterion.
- 0 of 18 BGMS achieved ≥95% of results within ±5 mg/dL or ±5%.
- The minimal deviation from the comparison/reference procedure within which ≥95% of results were found ranged from ±7.7 mg/dL (±7.7%) for ContourNext One to ±19.7 mg/dL (±19.7%) for eBsensor.
- All BGMS had 100% of results in the clinically acceptable Consensus Error Grid zones A and B for the evaluated reagent lot.
## Methods
- Design: Independent surveillance study conducted in November and December 2018 in a controlled laboratory setting in Ulm, Germany, using one reagent system lot per BGMS and comparing system results to the respective manufacturer’s reference measurement procedure.
- Sample/data: 126 subjects were enrolled to obtain 100 evaluable data sets; the study included 44 with type 1 diabetes, 58 with type 2 diabetes, and 24 without diabetes. For each system, 200 data points from at least 100 capillary samples from different subjects were analyzed; 87 subjects contributed to the analysis across all 18 BGMS.
- Analysis: Accuracy was assessed by the proportion of results within ISO 15197 thresholds (±15 mg/dL/±15%, plus ±10 mg/dL/±10% and ±5 mg/dL/±5%), the minimal deviation needed for ≥95% of results, and Consensus Error Grid analysis; relative bias was calculated using Bland and Altman.
## Limitations
- The paper states that only one reagent system lot per BGMS was tested, and that lot-to-lot variability is important; it notes that ISO 15197 requires testing of three lots.
- The paper states that measurements were done in a controlled laboratory environment by trained personnel, which tends to produce more accurate results than lay-user testing.
- Evident from the text: the study used manufacturer’s reference measurement procedures as comparators, and one system (GluNEO) lacked documented calibration/reference-procedure information in the labeling, so the authors had to make an assumption; this may affect comparability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
6 Valid · 0 Not valid · 18 Not checked · 26 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“As required by Rili-BÄK,17 the Guideline of the German Medical Association on Quality Assurance in Medical Laboratory Examinations, verification of trueness and precision of both reference measurement procedures was performed during the experimental phase by regular internal and external quality control measurements.”
§ System accuracy evaluation of 18 CE-marked current-generation blood glucose monitoring systems based on EN ISO 15197:2015 > Research design and methods > Reference measurement procedures
What the sources say
- Partly supportedcites [17] 2015, Revision of the “Guideline of the German Medical Association on Quality Assurance in Medical Laboratory Examinations—Rili-BAEK” (unauthorized translation), LaboratoriumsMedizin sourceExperimental — accuracy not yet measured
Section 8, “Internal and external quality assurance” (page not provided), requires internal controls and regular participation in external quality assessment programmes. The guideline also defines trueness and precision, but the cited passages do not require verification of both reference measurement procedures by those controls or document what was done during the citing study’s experimental phase. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Nevertheless, several evaluation or surveillance studies within recent years repeatedly revealed that a non-negligible number of CE-marked BGMS, which do not fulfill the minimum accuracy criteria of ISO 15197, had been or currently still are on sale on the European market.12–14”
- Also stated in: § What is already known about this subject? · plain
“Studies within recent years have shown that there is a considerable number of CE-labeled BGMS on the market which do not fulfill ISO requirements reliably.”
§ System accuracy evaluation of 18 CE-marked current-generation blood glucose monitoring systems based on EN ISO 15197:2015 > Introduction
What the sources say
- Not checked — no full text of the sourcecites [12] source
- Supportedcites [13] Freckmann, 2012, System accuracy evaluation of 43 blood glucose monitoring systems for self-monitoring of blood glucose according to DIN EN ISO 15197, J Diabetes Sci Technol source
The Methods identify the evaluated systems as CE-labeled, and the Introduction says they were available on the market. The Conclusions report that 7 of the 34 fully assessed systems failed the minimum ISO accuracy requirements and state that a CE mark does not guarantee compliance. (LLM, conf=0.92)
- Not checked — no full text of the sourcecites [14] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § What is already known about this subject? · plain
Every source the paper cites for this claim was checked and supports it.
In the paper
“A multicenter accuracy study evaluating one system reagent lot for each of 19 BGMS manufactured in the Asia-Pacific region showed ≈79% (15 out of 19) of BGMS not meeting the accuracy requirements of ISO 15197.”
§ System accuracy evaluation of 18 CE-marked current-generation blood glucose monitoring systems based on EN ISO 15197:2015 > Conclusions
What the sources say
- Supportedcites [30] Yu-Fei, 2017, Accuracy evaluation of 19 blood glucose monitoring systems manufactured in the Asia-Pacific region: a multicenter study, J Diabetes Sci Technol source
The Discussion states that the study used one strip lot for each of the 19 Asia-Pacific BGMs. The Results report that only 4 of 19 met the minimum accuracy requirement of EN ISO 15197:2015 (ISO 15197:2013), so 15 of 19—about 79%—did not. The claim's ISO 15197 figure refers to that newer standard, not ISO 15197:2003. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Furthermore, increasingly inaccurate BGMS results were found to lead to higher glycemic variability when pre-meal and insulin correction boluses were integrated in the model.”
§ System accuracy evaluation of 18 CE-marked current-generation blood glucose monitoring systems based on EN ISO 15197:2015 > Conclusions
What the sources say
- Supportedcites [26] source
The Results section (Experiment 3) states directly that 'a higher SMBG error results in a wider spread of data, indicating higher glucose variability,' with CVGA A+B zone coverage falling from 97% at 5% permitted error to 85% at 20% error and dangerous-zone readings rising fivefold. That experiment's protocol (Methods, Experiment 3) integrates exactly what the claim specifies: a premeal insulin bolus based on an erroneous SMBG reading followed by a postmeal correction bolus based on a second erroneous reading. The Discussion corroborates: 'we expanded the SMBG sequence to encompass both premeal and correction boluses … permitted analysis of the influence of SMBG errors on glucose variability,' and the abstract Results list glucose variability increasing with permitted SMBG error. The only contextual qualifier is that this is an in silico study (1000 simulated T1D subjects), which the citing sentence's phrase 'integrated in the model' preserves. (LLM, conf=0.92)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In addition, most continuous glucose monitoring (CGM) systems are regularly calibrated with BGMS values.27”
§ System accuracy evaluation of 18 CE-marked current-generation blood glucose monitoring systems based on EN ISO 15197:2015 > Conclusions
What the sources say
- Supportedcites [27] Schrangl, 2018, Limits to the evaluation of the accuracy of continuous glucose monitoring systems by clinical trials, Biosensors source
The Introduction (§1.3) says CGM sensors typically require recalibration one to two times a day, usually using finger-prick self-monitoring blood glucose (SMBG) measurements. This supports the claim that most CGM systems are regularly calibrated with blood glucose monitoring values. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
19 more claims · 1 with their cited sources checked
Create a free account to see all 50 claims and to verify the 1 reference still open.
- Probably not a substantial claim. 17
- It may state two separate claims as one. 12
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Newer blood glucose monitors have significantly improved accuracy.11,12”
From Blood glucose monitoring devices: current considerations (2023) · cites this paper as [11]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Moreover, a lack of information on study design, or limitations in published studies for some devices limits critical evaluation of accuracy data, with the result that the reported accuracy of non-iCGM-approved devices might not be replicated in independent studies.33,38”
From Importance of FDA-integrated continuous glucose monitors to ensure accuracy of continuous glucose monitoring (2025) · cites this paper as [38]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In such a study, performed by Klonoff et al. [24], only 33% of the evaluated systems met the accuracy requirements of the International Organization for Standardization (ISO) 15197:2013 standard, whereas in a study by Pleus et al. [25], 77% of the evaluated systems met this standard.”
From Self-Monitoring of Blood Glucose as an Integral Part in the Management of People with Type 2 Diabetes Mellitus (2022) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Independent international studies have shown variable postmarketing accuracy of capillary blood glucose monitors, with up to 50% not meeting current standards.”
From Blood glucose monitoring devices: current considerations (2023) · cites this paper as [11]
Experimental — accuracy not yet measuredIn the citing paper
“Although measurement quality can come close to or equal that of the glucose monitoring systems used by healthcare professionals, several available SMBG systems still do not meet internationally accepted accuracy standards, such as the International Organization for Standardization 15197 standard.”
From Self-Monitoring of Blood Glucose as an Integral Part in the Management of People with Type 2 Diabetes Mellitus (2022) · cites this paper as [25]
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
(1993) · New England Journal of Medicine · doi:10.1056/nejm199309303291401 · Cited by 24,667
International Organization for Standardization
(2011) · SpringerReference · doi:10.1007/springerreference_16847 · Cited by 12,534
Battelino, T., Danne, T., Bergenstal, R. M., Amiel, S. A., Beck, R., Biester, T., Bosi, E., Buckingham, B. A., Cefalu, W. T., Close, K. L., et al. (2019) · Diabetes Care · doi:10.2337/dci19-0028 · Cited by 4,237
(2007) · Endocrine Practice · doi:10.4158/ep.13.s1.1 · Cited by 699
Global guideline for type 2 diabetes: recommendations for standard, comprehensive, and minimal care
IDF Clinical Guidelines Task Force (2006) · Diabetic Medicine · doi:10.1111/j.1464-5491.2006.01918.x · Cited by 433
Polonsky, W. H., Fisher, L., Schikman, C. H., Hinnen, D. A., Parkin, C. G., Jelsovsky, Z., Petersen, B., Schweitzer, M., & Wagner, R. S. (2011) · Diabetes Care · doi:10.2337/dc10-1732 · Cited by 429
The Original Clarke Error Grid Analysis (EGA)
Clarke, W. L. (2005) · Diabetes Technology & Therapeutics · doi:10.1089/dia.2005.7.776 · Cited by 280
Freckmann, G., Schmid, C., Baumstark, A., Pleus, S., Link, M., & Haug, C. (2012) · Journal of Diabetes Science and Technology · doi:10.1177/193229681200600510 · Cited by 237
Self-citationSystem Accuracy Evaluation of 27 Blood Glucose Monitoring Systems According to DIN EN ISO 15197
Freckmann, G., Baumstark, A., Jendrike, N., Zschornack, E., Kocher, S., Tshiananga, J., Heister, F., & Haug, C. (2010) · Diabetes Technology & Therapeutics · doi:10.1089/dia.2009.0128 · Cited by 195
Self-citation
Research works printed but not linked: 2
- Rodbard, 2007, American Association of Clinical Endocrinologists medical guidelines for clinical practice for the management of diabetes mellitus, Endocr Pract, 13 Suppl 1, 1
- International Organization for Standardization . In vitro diagnostic medical devices—Measurement of quantities in biological samples—Metrological traceability of values assigned to calibrators and control materials; 2003: 2003.
Cited by
7. Diabetes Technology: Standards of Care in Diabetes — 2023
ElSayed, N. A., Aleppo, G., Aroda, V. R., Bannuru, R. R., Brown, F. M., Bruemmer, D., Collins, B. S., Hilliard, M. E., Isaacs, D., Johnson, E. L., et al. (2023) · Diabetes Care · doi:10.2337/dc23-s007 · Cited by 301
Pullano, S. A., Greco, M., Bianco, M. G., Foti, D., Brunetti, A., & Fiorillo, A. S. (2022) · Theranostics · doi:10.7150/thno.64035 · Cited by 210
7. Diabetes Technology: Standards of Care in Diabetes—2026
Bajaj, M. S., McCoy, R. G., Balapattabi, K., Bannuru, R. R., Bellini, N. J., Bennett, A. K., Beverly, E. A., Early, K. B., ChallaSivaKanaka, S., Echouffo-Tcheugui, J. B., et al. (2025) · Diabetes Care · doi:10.2337/dc26-s007 · Cited by 279
Standardization process of continuous glucose monitoring: Traceability and performance
Freckmann, G., Nichols, J. H., Hinzmann, R., Klonoff, D. C., Ju, Y., Diem, P., Makris, K., & Slingerland, R. J. (2021) · Clinica Chimica Acta · doi:10.1016/j.cca.2020.12.025 · Cited by 62
Self-citationPleus, S., Freckmann, G., Schauer, S., Heinemann, L., Ziegler, R., Ji, L., Mohan, V., Calliari, L. E., & Hinzmann, R. (2022) · Diabetes Therapy · doi:10.1007/s13300-022-01254-8 · Cited by 55
Self-citation
Metadata
- Authors
- Pleus, S., Baumstark, A., Jendrike, N., Mende, J., Link, M., Zschornack, E., Haug, C., & Freckmann, G.
- Affiliations
- Universität Ulm (DE)
- Corresponding author
- Pleus, Stefan
- Venue
- BMJ Open Diabetes Research & Care
- Publisher
- BMJ
- Published
- 2020-01
- Volume
- 8
- Issue
- 1
- Pages
- e001067
- ISSN
- 2052-4897 (ISSN-L)
- PMC
- PMC7039612
- OpenAlex
- W3000482613
- Cited by
- 63
- References
- 40
- Citations by year
- 2026: 9 · 2025: 13 · 2024: 8 · 2023: 6 · 2022: 11 · 2021: 10 · 2020: 6
- FWCI
- 6.22
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- BMJ Open Diabetes Research & Care (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Beurer GmbH, Germany
- LifeScan Scotland Limited, United Kingdom
- Ascensia Diabetes Care Deutschland GmbH, Germany
- Roche Diabetes Care GmbH, Germany
- AgaMatrix Europe Limited, United Kingdom
- i-SENS GmbH, Germany
- Topics
- Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Diabetes Management and Research
- Health Sciences › Health Professions › Medical Laboratory Technology › Clinical Laboratory Practices and Quality Control
- Physical Sciences › Chemistry › Analytical Chemistry › Electrochemical sensors and biosensors
- Keywords
- blood glucose monitoring systems, measurement accuracy, CE marking, capillary blood glucose, comparison method, point-of-care glucose testing, regulatory compliance
- MeSH terms
- Adult, Aged, Aged, 80 and over, Blood Glucose, Diabetes Mellitus, Type 1, Diabetes Mellitus, Type 2, Europe, Female, Follow-Up Studies, Humans, Male, Middle Aged, Patient Acceptance of Health Care, Prognosis, Reference Standards, Research Design, Blood Glucose Self-Monitoring, Reproducibility of Results, Biomarkers, Point-of-Care Systems, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: System accuracy evaluation of 18 CE-marked current-generation blood glucose monitoring systems based on EN ISO 15197:2015. https://app.cochat.ai/papers/10.1136/bmjdrc-2019-001067
- The paper
- Pleus, S., Baumstark, A., Jendrike, N., Mende, J., Link, M., Zschornack, E., Haug, C., & Freckmann, G. (2020). System accuracy evaluation of 18 CE-marked current-generation blood glucose monitoring systems based on EN ISO 15197:2015. BMJ Open Diabetes Research & Care. https://doi.org/10.1136/bmjdrc-2019-001067
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.