The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index; 6 of the 21 sources its claims cite were checked for support.
Impact of Two Different Reference Measurement Procedures on Apparent System Accuracy of 18 CE-Marked Current-Generation Blood Glucose Monitoring Systems
Open accessAbstract
BACKGROUND: Measurement accuracy has been assessed for many different blood glucose monitoring systems (BGMS) over the years by different study groups. However, the choice of the comparison measurement procedure may impact the apparent level of accuracy found in such studies. MATERIALS AND METHODS: Measurement accuracy of 18 different BGMS was assessed in a setting based on ISO 15197 using two different comparison methods in parallel: a glucose oxidase (GOD)-based and a hexokinase (HK)-based method. Accuracy limits of ISO 15197 were applied, and additional analyses were performed, including bias, linear regression, and mean absolute relative difference (MARD) to assess the impact of possible differences between comparison methods on the apparent level of accuracy. RESULTS: While ≈80% of BGMS met the accuracy criteria of ISO 15197 when compared with the respective manufacturers' reference measurement procedure, only two-thirds did so against both comparison methods. The mean relative bias ranged from -6.6% to +5.7% for the analysis against the GOD-based method and from -11.1% to +1.3% for the analysis against the HK-based method, whereas MARD results ranged from 3.7% to 9.8% and from 2.3% to 10.5%, respectively. Results of regression analysis showed slopes between 0.85 and 1.08 (GOD-based method) and between 0.81 and 1.01 (HK-based method). CONCLUSIONS: The results of this study indicate that there are systematic differences between the reference measurement procedures used for BGMS calibration as well as for system accuracy assessment. Because of the potential impact on therapy of patients with diabetes resulting from these differences, further steps toward harmonization of the measurement procedures' results are important.
Overview
CoChat Summary
TL;DR
In 18 CE-marked current-generation blood glucose monitoring systems, apparent ISO 15197 accuracy depended on whether the comparison measurement procedure was glucose oxidase (GOD)- or hexokinase (HK)-based. The study concludes that systematic differences between reference measurement procedures can affect accuracy assessment and warrant harmonization.
Key findings
- About 80% of BGMS met ISO 15197 accuracy criteria when compared with the respective manufacturers’ reference measurement procedure, but only two-thirds did so against both comparison methods. Specifically, 14/18 systems fulfilled criterion A versus GOD and 12/18 versus HK.
- Mean relative bias ranged from −6.6% to +5.7% versus GOD and from −11.1% to +1.3% versus HK; MARD ranged from 3.7% to 9.8% versus GOD and from 2.3% to 10.5% versus HK.
- Passing-Bablok slopes ranged from 0.85 to 1.08 versus GOD and from 0.81 to 1.01 versus HK. Bias differed by 4.3%–4.5% between methods (except system 7), with HK generally giving higher results than GOD.
- For two BGMS (about 10%), the choice of comparison procedure influenced whether ISO 15197 accuracy criteria were met. CEG analysis showed 100% of results in clinically acceptable zones A and B independent of comparison method.
Methods
- Postmarket surveillance study of 18 CE-marked current-generation BGMS, each evaluated with one reagent system lot, conducted November–December 2018 at IDT, Ulm, Germany; 126 subjects were included to obtain 100 evaluable data sets per BGMS as required by ISO 15197.
- Accuracy was assessed in parallel against two comparison methods: a GOD-based method (YSI 2300 STAT Plus) and an HK-based method (Cobas Integra 400 plus), using capillary plasma samples and duplicate measurements.
- Analyses included ISO 15197 accuracy limits, consensus error grid, Bland-Altman bias with 95% limits of agreement, Passing-Bablok linear regression, and mean absolute relative difference (MARD).
Limitations
- The paper states that without a measurement procedure of higher metrological order (e.g., isotope dilution–gas chromatography–mass spectrometry), it cannot be determined whether the systematic difference is due to the HK-based method, the GOD-based method, or both.
- The paper notes that each BGMS was evaluated with only one reagent system lot, whereas ISO 15197 intends CEG criterion B to be applied to three reagent system lots combined.
- The paper states that no information about the manufacturers’ reference measurement procedures was available at manuscript submission, and the HK-based method was assigned as primary reference based on literature and investigator experience.
- Evident from the text: the study was financially supported by unrestricted grants from six BGMS manufacturers/distributors, and several authors report industry ties, although the authors state the funders had no impact on study procedures or BGMS acquisition.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
5 Valid · 2 Not valid · 6 Not checked · 49 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The current requirement of traceability according to ISO 17511 as stated by ISO 15197, without specifying further requirements or performance goals, might be insufficient in light of the considerable systematic differences between measurement procedures observed in this and other studies.21,33”
What the sources say
- Not checked yetcites [21] Twomey PJ. Plasma glucose measurement with the Yellow Springs Glucose 2300 STAT and the Olympus AU640. J Clin Pathol. 2004;57(7):752-754. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Partly supportedcites [33] Freckmann G, Link M, Schmid C, Pleus S, Baumstark A, Haug C. System accuracy evaluation of different blood glucose monitoring systems following ISO 15197:2013 by using two different comparison methods. Diabetes Technol Ther. 2015;17(9):635-648. [DOI] [PubMed] [Google Scholar] sourceExperimental — accuracy not yet measured
The Discussion (page unavailable) reports measurement differences of up to approximately 8% between the glucose oxidase and hexokinase reference methods and recommends standardizing manufacturers’ reference methods. It does not address ISO 17511 traceability or say that ISO 15197’s traceability requirement lacks performance goals or might be insufficient. (LLM, conf=0.85)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“Regression analysis according to Passing and Bablok 30 showed that slopes between the BGMS and the GOD method ranged from 0.85 to 1.08 and from 0.81 to 1.01 when compared with the HK method.”
What the sources say
- Supportedcites [30] Passing H, Bablok W. A new biometrical procedure for testing the equality of measurements from two different analytical methods. Application of linear regression procedures for method comparison studies in clinical chemistry, Part I. J Clin Chem Clin Biochem. 1983;21(11):709-720. [DOI] [PubMed] [Google Scholar] source
The citation is attached to “according to Passing and Bablok,” identifying the regression method used by the citing study. The source’s “Estimation” section describes estimating the regression slope from pairwise slopes; the BGMS slope ranges are results reported by the citing study, not attributed to this source. (LLM, conf=0.91)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“This is not always the case, as recently published by Bukve et al, 42 so that the POCT12-A3 recommendation to assess the commutability of such material should be acknowledged.”
What the sources say
- Supportedcites [42] Bukve T, Sandberg S, Vie WS, Sølvik U, Christensen NG, Stavelin A. Commutability of a whole-blood external quality assessment material for point-of-care C-reactive protein, glucose, and hemoglobin testing. Clin Chem. 2019;65(6):791-797. [DOI] [PubMed] [Google Scholar] source
The Discussion (page not supplied) reports that the whole-blood EQA material was commutable for CRP and hemoglobin, but for only about half of the glucose point-of-care instruments. It also reports noncommutability at some concentrations, supporting the claim that such material is not always commutable. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The mean relative bias ranged from −6.6% to +5.7% for the analysis against the GOD-based method and from −11.1% to +1.3% for the analysis against the HK-based method”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While ≈80% of BGMS met the accuracy criteria of ISO 15197 when compared with the respective manufacturers’ reference measurement procedure, only two-thirds did so against both comparison methods.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
24 more claims
Create a free account to see all 62 claims and to verify the 5 references still open.
- Probably not a substantial claim. 24
- It may state two separate claims as one. 13
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
(1993) · New England Journal of Medicine · doi:10.1056/nejm199309303291401 · Cited by 24,667
Statistical methods for assessing agreement between two methods of clinical measurement
Bland, J. M., & Altman, D. G. (2010) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2009.10.001 · Cited by 5,220
Scottish Intercollegiate Guidelines Network
Twaddle, S., & Qureshi, S. (2005) · Evidence-based Healthcare and Public Health · doi:10.1016/j.ehbc.2005.09.008 · Cited by 4,084
Passing, H., & Bablok, W. (1983) · cclm · doi:10.1515/cclm.1983.21.11.709 · Cited by 1,513
5. Lifestyle Management:Standards of Medical Care in Diabetes—2019
American Diabetes Association (2019) · Diabetes Care · doi:10.2337/dc19-s005 · Cited by 700
(2007) · Endocrine Practice · doi:10.4158/ep.13.s1.1 · Cited by 699
The Diabetes Control and Complications Trial Research Group (1994) · Retina · doi:10.1097/00006982-199414030-00022 · Cited by 551
Global guideline for type 2 diabetes: recommendations for standard, comprehensive, and minimal care
IDF Clinical Guidelines Task Force (2006) · Diabetic Medicine · doi:10.1111/j.1464-5491.2006.01918.x · Cited by 433
Polonsky, W. H., Fisher, L., Schikman, C. H., Hinnen, D. A., Parkin, C. G., Jelsovsky, Z., Petersen, B., Schweitzer, M., & Wagner, R. S. (2011) · Diabetes Care · doi:10.2337/dc10-1732 · Cited by 429
Research works printed but not linked: 5
- Österreichische Diabetes Gesellschaft, 2012, Wien Klin Wochenschr, 124, 1
- Bundesärztekammer, 2014, Deutsches Ärzteblatt, 111, 1583
- Passing H, 1983, J Clin Chem Clin Biochem, 21, 709
- Freckmann G, 2014, 50th EASD Annual Meeting
- Clinical and Laboratory Standards Institute, 2013, POCT12-A3 - Point-of-Care Blood Glucose Testing in Acute and Chronic Care Facilities
Cited by
Freckmann, G., Eichenlaub, M., Waldenmaier, D., Pleus, S., Wehrstedt, S., Haug, C., Witthauer, L., Jendle, J., Hinzmann, R., Thomas, A., et al. (2023) · Journal of Diabetes Science and Technology · doi:10.1177/19322968231190941 · Cited by 86
Self-citationBoscari, F., & Avogaro, A. (2021) · Reviews in Endocrine and Metabolic Disorders · doi:10.1007/s11154-021-09635-3 · Cited by 80
“Accuracy of devices is crucial not only to correctly manage the disease but also to calibrate CGM; accuracy of BGM could be compared to the reference values of venous blood glucose [85].”
BackgroundImproving the Bias of Comparator Methods in Analytical Performance Assessments Through Recalibration
Pleus, S., Eichenlaub, M., Gerber, T., Eriksson Boija, E., Makris, K., Haug, C., & Freckmann, G. (2024) · Journal of Diabetes Science and Technology · doi:10.1177/19322968221133107 · Cited by 24
“2,3 Therefore the choice of laboratory method could affect the outcome of a CGM performance study.”
MethodSelf-citationFreckmann, G., Pleus, S., Eichenlaub, M., Boija, E. E., Fokkert, M. J., Hinzmann, R., JENDLE, J. H., Klonoff, D. C., Makris, K., Nichols, J. H., et al. (2025) · Journal of Diabetes Science and Technology · doi:10.1177/19322968251336221 · Cited by 23
Self-citationPleus, S., Eichenlaub, M., Boija, E. E., Fokkert, M. J., Hinzmann, R., JENDLE, J. H., Klonoff, D. C., Makris, K., Nichols, J. H., Pemberton, J. S., et al. (2024) · Journal of Diabetes Science and Technology · doi:10.1177/19322968241296097 · Cited by 26
Self-citation
Metadata
- Authors
- Freckmann, G., Baumstark, A., Jendrike, N., Mende, J., Schauer, S., Link, M., Pleus, S., & Haug, C.
- Affiliations
- Universität Ulm (DE)
- Corresponding author
- Pleus, Stefan
- Venue
- Journal of Diabetes Science and Technology
- Publisher
- SAGE Publications
- Published
- 2020-08-19
- Volume
- 16
- Issue
- 5
- Pages
- 1076-1088
- ISSN
- 1932-2968 (ISSN-L)
- PMC
- PMC9445332
- OpenAlex
- W3080454770
- Cited by
- 12
- References
- 38
- Citations by year
- 2025: 4 · 2024: 2 · 2023: 1 · 2022: 3 · 2021: 2
- FWCI
- 0.90
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of Diabetes Science and Technology (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- lifescan
- roche
- i-SENS GmbH
- Institut für Diabetes-Technologie Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm
- Beurer GmbH
- AgaMatrix Europe Limited
- Ascensia Diabetes Care Deutschland GmbH
- Topics
- Health Sciences › Health Professions › Medical Laboratory Technology › Clinical Laboratory Practices and Quality Control
- Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Diabetes Management and Research
- Physical Sciences › Physics and Astronomy › Instrumentation › Scientific Measurement and Uncertainty Evaluation
- Keywords
- blood glucose monitoring systems, reference measurement procedure, measurement accuracy, ISO 15197, glucose oxidase method, hexokinase method, mean absolute relative difference, relative bias, calibration, diabetes management, method harmonization
- MeSH terms
- Blood Glucose, Calibration, Diabetes Mellitus, Glucose Oxidase, Humans, Blood Glucose Self-Monitoring, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Impact of Two Different Reference Measurement Procedures on Apparent System Accuracy of 18 CE-Marked Current-Generation Blood Glucose Monitoring Systems. https://app.cochat.ai/papers/10.1177/1932296820948873
- The paper
- Freckmann, G., Baumstark, A., Jendrike, N., Mende, J., Schauer, S., Link, M., Pleus, S., & Haug, C. (2022). Impact of Two Different Reference Measurement Procedures on Apparent System Accuracy of 18 CE-Marked Current-Generation Blood Glucose Monitoring Systems. Journal of Diabetes Science and Technology. https://doi.org/10.1177/1932296820948873
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.