Assessing the Quality of Publications Evaluating the Accuracy of Blood Glucose Monitoring Systems
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Many studies determine the performance of blood glucose monitoring (BG) systems. Correct evaluation is, however, complex, and apparent contradiction of results creates confusion. This study aimed to provide an overview of frequently made errors and to develop easy-to-use checklists to verify the quality of such studies. Building on the work from Mahoney and Ellison and subsequent re-evaluation, study designs of accuracy studies were assessed, and best practice and internationally accepted norms were determined. Key issues were collated, and two simplified checklists were developed: one for the assessment of analytical accuracy studies and a second for guidance with studies assessing the influence of interferences. The checklists have been used in a feasibility study with 20 representative studies selected from a literature search between 2007 and 2012. This check revealed that limitations in the designs and methods of studies assessing the performance of BG systems are common. The use of the accuracy checklist with the 20 representative studies showed that only 20% were in agreement with most of the issues deemed important and that 40% showed clear nonconcordance with ISO 15197. The use of the interference checklist showed that only 50% of the publications were in good agreement with the quality checks. In agreement with previous studies, which concluded many evaluations are performed poorly and present questionable conclusions, the use of these checklists demonstrated that few publications adhered to international guidelines and recommendations. Taking this into consideration, it becomes obvious that the publications must be examined in more detail to establish their quality and the validity of conclusions drawn.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
System Accuracy Evaluation of 27 Blood Glucose Monitoring Systems According to DIN EN ISO 15197
Freckmann, G., Baumstark, A., Jendrike, N., Zschornack, E., Kocher, S., Tshiananga, J., Heister, F., & Haug, C. (2010) · Diabetes Technology & Therapeutics · doi:10.1089/dia.2009.0128 · Cited by 195
Assessing the quality of glucose monitor studies: a critical evaluation of published reports
Mahoney, J., & Ellison, J. (2007) · Clinical Chemistry · doi:10.1373/clinchem.2006.083493 · Cited by 48
Warner, J. V., Wu, J. Y., Buckingham, N., McLeod, D. S. A., Mottram, B., & Carter, A. C. (2011) · Diabetes Technology & Therapeutics · doi:10.1089/dia.2010.0129 · Cited by 20
Rao, A., Wiley, M., Iyengar, S., Nadeau, D., & Carnevale, J. (2010) · Journal of Diabetes Science and Technology · doi:10.1177/193229681000400118 · Cited by 12
Research works printed but not linked: 24
- 10.1089/dia.2007.0245 · DOI
- 10.1089/dia.2008.0084 · DOI
- 10.1089/dia.2005.7.558 · DOI
- 10.1378/chest.128.4.3084 · DOI
- 10.1089/152091503322526969 · DOI · Paper page
- 10.1515/CCLM.2006.141 · DOI
- 10.1093/clinchem/47.7.1329 · DOI
- 10.1089/dia.2007.0244 · DOI · Paper page
- Mentis N, , Vardarli I, , Tytko A, , Rommel M, , Nauck MA. Klinische Performance durch Messgenauigkeit des Blutzuckermessgeräts mylife Pura in der Steuerung der intensivierten Insulintherapie bei Patienten mit Typ-1-DiabetesDDG abstract A-274-0007-00399/poster P303Poster presentation at the 45th Annual Congress of the German Diabetic Association in Stuttgart, May 12–15, 2010.
- Ng R, , Lock JP. Can glucose meters meet tighter accuracy requirements? [abstract] Diabetologia, 2010; 53,Suppl 1:418.
- 10.1089/dia.2010.0223 · DOI · Paper page
- 10.1089/dia.2011.0035 · DOI
- 10.1089/dia.2011.0170 · DOI · Paper page
- 10.1089/dia.2008.0034 · DOI · Paper page
- 10.1097/POC.0b13e3181a4c4f4 · DOI
- 10.1097/POC.0b013e3181a4c94e · DOI
- 10.1258/acb.2010.009291 · DOI · Paper page
- Pfützner A, , Harzer O, , Musholt PB, , Scherer S, , Löbig M, , Forst T. Performance of blood glucose measurement systems influenced by interfering substances. Diabetes Stoffwechsel Herz, 2009; 18:387–392.
- 10.1177/193229681100500520 · DOI · Paper page
- O'Kane M, , McCloskey M, , Diver-Hall C. How accurate are blood glucose meters used for patient self testing? Poster presentation at the 47th Annual Meeting of the European Society for the Study of Diabetes in Lisbon, September 12–16, 2011.
- 10.1089/dia.2010.0255 · DOI
- Schöndorf T, , Forst T, , Pfützner A. Interferents in glucose determination do not influence the hospital POC glucose meter StatStrip in accuracy and precision of blood glucose measurement [abstract 0966] Clin Chem Lab Med, 2011; 49,Special Suppl:S687.
- 10.1136/jcp.2003.013417 · DOI · Paper page
- 10.1177/193229681000400110 · DOI · Paper page
Cited by
Freckmann, G., Schmid, C., Baumstark, A., Rutschmann, M., Haug, C., & Heinemann, L. (2015) · Journal of Diabetes Science and Technology · doi:10.1177/1932296815580160 · Cited by 70
Freckmann, G., Link, M., Schmid, C., Pleus, S., Baumstark, A., & Haug, C. (2015) · Diabetes Technology & Therapeutics · doi:10.1089/dia.2015.0085 · Cited by 46
Klonoff, D. C., & Reyes, J. S. (2013) · Journal of Diabetes Science and Technology · doi:10.1177/193229681300700432 · Cited by 29
Huang, T.-Y., Chang, H.-W., Tsao, M.-F., Chuang, S.-M., Ni, C.-C., Sue, J.-W., Lin, H.-C., & Hsu, C.-T. (2014) · Clinica Chimica Acta · doi:10.1016/j.cca.2014.02.023 · Cited by 15
Freckmann, G., Baumstark, A., Jendrike, N., Mende, J., Schauer, S., Link, M., Pleus, S., & Haug, C. (2022) · Journal of Diabetes Science and Technology · doi:10.1177/1932296820948873 · Cited by 12
Metadata
- Authors
- Thorpe, G. H.
- Venue
- Diabetes Technology & Therapeutics
- Publisher
- SAGE Publications
- Published
- 2013-03
- Volume
- 15
- Issue
- 3
- Pages
- 253-259
- ISSN
- 1520-9156 (ISSN-L)
- 1557-8593
- OpenAlex
- W2171270164
- Cited by
- 27
- References
- 4
- FWCI
- 5.38
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- creativecommons.org/licenses/by/4.0/ (vor)
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.