CoChat

A systematic review of statistical methodology used to evaluate progression of chronic kidney disease using electronic healthcare records

Open access
Cleary, Faye, Prieto-Merino, David, Nitsch, Dorothea · 2022 · PLOS ONE

The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.

Abstract

Background: Electronic healthcare records (EHRs) are a useful resource to study chronic kidney disease (CKD) progression prior to starting dialysis, but pose methodological challenges as kidney function tests are not done on everybody, nor are tests evenly spaced. We sought to review previous research of CKD progression using renal function tests in EHRs, investigating methodology used and investigators’ recognition of data quality issues. Methods and findings: We searched for studies investigating CKD progression using EHRs in 4 databases (Medline, Embase, Global Health and Web of Science) available as of August 2021. Of 80 articles eligible for review, 59 (74%) were published in the last 5.5 years, mostly using EHRs from the UK, USA and East Asian countries. 33 articles (41%) studied rates of change in eGFR, 23 (29%) studied changes in eGFR from baseline and 15 (19%) studied progression to binary eGFR thresholds. Sample completeness data was available in 44 studies (55%) with analysis populations including less than 75% of the target population in 26 studies (33%). Losses to follow-up went unreported in 62 studies (78%) and 11 studies (14%) defined their cohort based on complete data during follow up. Methods capable of handling data quality issues and other methodological challenges were used in a minority of studies. Conclusions: Studies based on renal function tests in EHRs may have overstated reliability of findings in the presence of informative missingness. Future renal research requires more explicit statements of data completeness and consideration of i) selection bias and representativeness of sample to the intended target population, ii) ascertainment bias where follow-up depends on risk, and iii) the impact of competing mortality. We recommend that renal progression studies should use statistical methods that take into account variability in renal function, informative censoring and population heterogeneity as appropriate to the study question.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0264167

Cites

71 of 71 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig 1 Flow chart of study selection.
Fig 1 Flow chart of study selection.CC BY · PubMed Central
Fig 2 Risk of selection bias (A) and ascertainment bias (B) in individual studies.
Fig 2 Risk of selection bias (A) and ascertainment bias (B) in individual studies.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 6

Metadata

Authors
Cleary, F., Prieto-Merino, D., & Nitsch, D.
Affiliations
London School of Hygiene & Tropical Medicine (GB)
Corresponding author
Cleary, Faye
Venue
PLOS ONE
Published
2022-07-29
Volume
17
Issue
7
Pages
e0264167
ISSN
1932-6203 (ISSN-L)
OpenAlex
W4288692554
Cited by
6
References
71
Citations by year
2025: 2 · 2024: 3 · 2023: 1
FWCI
0.23
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Medical Research Council (MR/N013638/1)
Topics
  • Health Sciences › Medicine › Nephrology › Chronic Kidney Disease and Diabetes
  • Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
Keywords
chronic kidney disease progression, electronic health records, estimated glomerular filtration rate, missing data, informative censoring, loss to follow-up, selection bias, ascertainment bias, competing risk of death, data quality, statistical methodology
MeSH terms
Delivery of Health Care, Electronics, Renal Dialysis, Humans, Reproducibility of Results, Disease Progression, Renal Insufficiency, Chronic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.