Protocol and quality assurance for carotid imaging in 100,000 participants of UK Biobank: development and assessment
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Background Ultrasound imaging is able to quantify carotid arterial wall structure for the assessment of cerebral and cardiovascular disease risks. We describe a protocol and quality assurance process to enable carotid imaging at large scale that has been developed for the UK Biobank Imaging Enhancement Study of 100,000 individuals. Design An imaging protocol was developed to allow measurement of carotid intima-media thickness from the far wall of both common carotid arteries. Six quality assurance criteria were defined and a web-based interface (Intelligent Ultrasound) was developed to facilitate rapid assessment of images against each criterion. Results and conclusions Excellent inter and intra-observer agreements were obtained for image quality evaluations on a test dataset from 100 individuals. The image quality criteria then were applied in the UK Biobank Imaging Enhancement Study. Data from 2560 participants were evaluated. Feedback of results to the imaging team led to improvement in quality assurance, with quality assurance failures falling from 16.2% in the first two-month period examined to 6.4% in the last. Eighty per cent had all carotid intima-media thickness images graded as of acceptable quality, with at least one image acceptable for 98% of participants. Carotid intima-media thickness measures showed expected associations with increasing age and gender. Carotid imaging can be performed consistently, with semi-automated quality assurance of all scans, in a limited timeframe within a large scale multimodality imaging assessment. Routine feedback of quality control metrics to operators can improve the quality of the data collection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
High agreement but low Kappa: I. the problems of two paradoxes
Feinstein, A. R., & Cicchetti, D. V. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90158-l · Cited by 3,034 · cited 1×
“However, Cohen’s kappa and its direct extensions tend to show paradoxical behaviour at the extremes of prevalence (for example, as in our case, if a large majority of images passed QA assessment), with very high agreement between observers sometimes even leading to negative kappas.(16,17) We therefore used Gwet’s firs…”
Computing inter‐rater reliability and its variance in the presence of high agreement
Gwet, K. L. (2008) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711006x126600 · Cited by 2,167 · cited 2×
“However, Cohen’s kappa and its direct extensions tend to show paradoxical behaviour at the extremes of prevalence (for example, as in our case, if a large majority of images passed QA assessment), with very high agreement between observers sometimes even leading to negative kappas.(16,17) We therefore used Gwet’s firs…”
Multimodal population brain imaging in the UK Biobank prospective epidemiological study
Miller, K. L., Alfaro-Almagro, F., Bangerter, N. K., Thomas, D. L., Yacoub, E., Xu, J., Bartsch, A. J., Jbabdi, S., Sotiropoulos, S. N., Andersson, J. L. R., et al. (2016) · Nature Neuroscience · doi:10.1038/nn.4393 · Cited by 2,020 · cited 2×
“Previous publications have described the UK Biobank in general,(1) and the imaging substudies involving cardiac MRI,(2,9) liver MRI(10) and brain MRI.(11) In this article, we describe the carotid ultrasound scanning protocol used within the UK Biobank Imaging Enhancement Study and the development of a QA process.”
UK Biobank's cardiovascular magnetic resonance protocol
Petersen, S. E., Matthews, P. M., Francis, J. M., Robson, M. D., Zemrak, F., Boubertakh, R., Young, A. A., Hudson, S., Weale, P., Garratt, S., et al. (2016) · Journal of Cardiovascular Magnetic Resonance · doi:10.1186/s12968-016-0227-4 · Cited by 481
Self-citationCharacterisation of liver fat in the UK Biobank cohort
Wilman, H. R., Kelly, M., Garratt, S., Matthews, P. M., Milanesi, M., Herlihy, A., Gyngell, M., Neubauer, S., Bell, J. D., Banerjee, R., et al. (2017) · PLOS ONE · doi:10.1371/journal.pone.0172921 · Cited by 159
Self-citation
Cited by
The UK Biobank resource with deep phenotyping and genomic data
Bycroft, C., Freeman, C., Petkova, D., Band, G., Elliott, L. T., Sharp, K., Motyer, A., Vukcevic, D., Delaneau, O., O’Connell, J., et al. (2018) · Nature · doi:10.1038/s41586-018-0579-z · Cited by 8,876
Self-citationLittlejohns, T. J., Holliday, J., Gibson, L. M., Garratt, S., Oesingmann, N., Alfaro-Almagro, F., Bell, J. D., Boultwood, C., Collins, R., Conroy, M. C., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-15948-9 · Cited by 812
Self-citationArtificial Intelligence in Cardiovascular Imaging
Dey, D., Slomka, P. J., Leeson, P., Comaniciu, D., Shrestha, S., Sengupta, P. P., & Marwick, T. H. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.12.054 · Cited by 680
Self-citationArtificial Intelligence in Cardiovascular Medicine
Seetharam, K., Shrestha, S., & Sengupta, P. P. (2019) · Current Treatment Options in Cardiovascular Medicine · doi:10.1007/s11936-019-0728-1 · Cited by 76
Metadata
- Authors
- Coffey, S., Lewandowski, A. J., Garratt, S., Meijer, R., Lynum, S., Bedi, R., Paterson, J., Yaqub, M., Noble, J. A., Neubauer, S., Petersen, S. E., Allen, N., Sudlow, C., Collins, R., Matthews, P. M., & Leeson, P.
- Venue
- European Journal of Preventive Cardiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-09-19
- Volume
- 24
- Issue
- 17
- Pages
- 1799-1806
- ISSN
- 2047-4873 (ISSN-L)
- 2047-4881
- OpenAlex
- W2756379568
- Cited by
- 48
- References
- 5
- FWCI
- 2.36
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Protocol and quality assurance for carotid imaging in 100,000 participants of UK Biobank: development and assessment. https://app.cochat.ai/papers/10.1177/2047487317732273
- The paper
- Coffey, S., Lewandowski, A. J., Garratt, S., Meijer, R., Lynum, S., Bedi, R., Paterson, J., Yaqub, M., Noble, J. A., Neubauer, S., Petersen, S. E., Allen, N., Sudlow, C., Collins, R., Matthews, P. M., & Leeson, P. (2017). Protocol and quality assurance for carotid imaging in 100,000 participants of UK Biobank: development and assessment. European Journal of Preventive Cardiology. https://doi.org/10.1177/2047487317732273
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.