The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Evaluating the Intra- and Interobserver Reliability of Three-Dimensional Ultrasound and Power Doppler Angiography (3D-PDA) for Assessment of Placental Volume and Vascularity in the Second Trimester of Pregnancy
Abstract
Three-dimensional (3-D) power Doppler angiography (3-D-PDA) allows visualisation of Doppler signals within the placenta and their quantification is possible by the generation of vascular indices by the 4-D View software programme. This study aimed to investigate intra- and interobserver reproducibility of 3-D-PDA analysis of stored datasets at varying gestations with the ultimate goal being to develop a tool for predicting placental dysfunction. Women with an uncomplicated, viable singleton pregnancy were scanned at 12, 16 or 20 weeks gestational age groups. 3-D-PDA datasets acquired of the whole placenta were analysed using the VOCAL software processing tool. Each volume was analysed by three observers twice in the A plane. Intra- and interobserver reliability was assessed by intraclass correlation coefficients (ICCs) and Bland Altman plots. At each gestational age group, 20 low risk women were scanned resulting in 60 datasets in total. The ICC demonstrated a high level of measurement reliability at each gestation with intraobserver values >0.90 and interobserver values of >0.6 for the vascular indices. Bland Altman plots also showed high levels of agreement. Systematic bias was seen at 20 weeks in the vascular indices obtained by different observers. This study demonstrates that 3-D-PDA data can be measured reliably by different observers from stored datasets up to 18 weeks gestation. Measurements become less reliable as gestation advances with bias between observers evident at 20 weeks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, manual labelling is highly operator dependent, inter-observer reproducability studies have demonstrated very different intra-class correlation coefficients (ICC; 95% CI)) of 0.59 (0.33–0.80) [7] and 0.81 (0.68–0.91) [8].”
From Fully Automated 3-D Ultrasound Segmentation of the Placenta, Amniotic Fluid, and Fetus for Early Pregnancy Assessment (2021) · cites this paper as [7]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
Research works printed but not linked: 27
- Bartlett, 2008, Reliability, repeatability and reproducibility: Analysis of measurement errors in continuous variables, Ultrasound Obstet Gynecol, 31, 466, 10.1002/uog.5256 · DOI
- Bland, 1995, Comparing methods of measurement: Why plotting difference against standard method is misleading, Lancet, 346, 1085, 10.1016/S0140-6736(95)91748-9 · DOI · Paper page
- Bland, 1999, Measuring agreement in method comparison studies, Stat Methods Med Res, 8, 135, 10.1177/096228029900800204 · DOI · Paper page
- Bland, 2003, Applying the right statistics: Analyses of measurement studies, Ultrasound Obstet Gynecol, 22, 85, 10.1002/uog.122 · DOI
- Bujold, 2009, Reproducibility of first trimester three–dimensional placental measurements in the evaluation of early placental insufficiency, J Obstet Gynaecol Can, 31, 1144, 10.1016/S1701-2163(16)34375-4 · DOI
- Campbell, 2007, Placental vasculature as visualized by 3-D power Doppler angiography and 3-D color Doppler imaging, Ultrasound Obstet Gynecol, 30, 917, 10.1002/uog.5195 · DOI
- de Paula, 2009, Quantitative analysis of placental vasculature by three-dimensional power Doppler ultrasonography in normal pregnancies from 12 to 40 weeks of gestation, Placenta, 30, 142, 10.1016/j.placenta.2008.11.010 · DOI
- Deurloo, 2007, Reproducibility of 3-dimensional sonographic measurements of fetal and placental volume at gestational ages of 11–18 weeks, J Clin Ultrasound, 35, 125, 10.1002/jcu.20306 · DOI
- Fries, 2007, Quality control of an image-scoring method for nuchal translucency ultrasonography, Am J Obstet Gynecol, 196, 272.e1, 10.1016/j.ajog.2006.10.866 · DOI
- Guimarães Filho, 2010, Reproducibility of three-dimensional power Doppler placental vascular indices in pregnancies between 26 and 35 weeks, Arch Gynecol Obstet
- Guiot, 2008, Is three-dimensional power Doppler ultrasound useful in the assessment of placental perfusion in normal and growth-restricted pregnancies?, Ultrasound Obstet Gynecol, 31, 171, 10.1002/uog.5212 · DOI
- Jones, 2009, In vitro dual perfusion of human placental lobules as a flow phantom to investigate the relationship between fetoplacental flow and quantitative 3-D power Doppler angiography, Placenta, 30, 130, 10.1016/j.placenta.2008.11.002 · DOI
- Jones, 2009, Changes in myometrial ‘perfusion’ during normal labor as visualized by three-dimensional power Doppler angiography, Ultrasound Obstet Gynecol, 33, 307, 10.1002/uog.6303 · DOI
- Kaplan, 2008, Gross pathology of the placenta: Weight, shape, size, colour, J Clin Pathol, 61, 1285, 10.1136/jcp.2008.055269 · DOI
- Lai, 2010, Assessment of the reproducibility of regional placental vascularity/perfusion measurement using 3-D power Doppler, Ultrasound Obstet Gynecol, 36, 202, 10.1002/uog.7608 · DOI
- McGraw, 1996, Forming inferences about some intraclass correlation coefficients, Psychol Methods, 1, 30, 10.1037/1082-989X.1.1.30 · DOI · Paper page
- Mercé, 2005, Assessment of placental vascularization by three-dimensional power Doppler “vascular biopsy” in normal pregnancies, Croat Med J, 46, 765
- Mercé, 2009, Intervillous and uteroplacental circulation in normal early pregnancy and early pregnancy loss assessed by 3-dimensional power Doppler angiography, Am J Obstet Gynecol, 200, 315.e1, 10.1016/j.ajog.2008.10.020 · DOI
- Noguchi, 2009, Placental vascular sonobiopsy using three-dimensional power Doppler ultrasound in normal and growth restricted fetuses, Placenta, 30, 391, 10.1016/j.placenta.2009.02.010 · DOI
- Raine-Fenning, 2004, Endometrial and subendometrial perfusion are impaired in women with unexplained subfertility, Hum Reprod, 19, 2605, 10.1093/humrep/deh459 · DOI
- Raine-Fenning, 2004, Quantifying the changes in endometrial vascularity throughout the normal menstrual cycle with three-dimensional power Doppler angiography, Hum Reprod, 19, 330, 10.1093/humrep/deh056 · DOI
- Raine-Fenning, 2004, The interobserver reliability of three-dimensional power Doppler data acquisition within the female pelvis, Ultrasound Obstet Gynecol, 23, 501, 10.1002/uog.1019 · DOI
- Raine-Fenning, 2008, Determining the relationship between three-dimensional power Doppler data and true blood flow characteristics: An in vitro flow phantom experiment, Ultrasound Obstet Gynecol, 32, 540, 10.1002/uog.6110 · DOI
- Raine-Fenning, 2008, Evaluation of the effect of machine settings on quantitative three-dimensional power Doppler angiography: An in vitro flow phantom experiment, Ultrasound Obstet Gynecol, 32, 551, 10.1002/uog.6138 · DOI
- Rankin, 1998, Reliability of assessment tools in rehabilitation: An illustration of appropriate statistical analyses, Clin Rehabil, 12, 187, 10.1191/026921598672178340 · DOI
- Rovas, 2005, Intraobserver and interobserver reproducibility of three-dimensional gray-scale and power Doppler ultrasound examinations of the cervix in pregnant women, Ultrasound Obstet Gynecol, 26, 132, 10.1002/uog.1884 · DOI
- Walter, 1998, Sample size and optimal designs for reliability studies, Stat Med, 17, 101, 10.1002/(SICI)1097-0258(19980115)17:1<101::AID-SIM727>3.0.CO;2-E · DOI
Cited by
Sorted by citations
Looney, P., Yin, Y., Collins, S. L., Nicolaides, K. H., Plasencia, W., Molloholli, M., Natsis, S., & Stevenson, G. N. (2021) · IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control · doi:10.1109/tuffc.2021.3052143 · Cited by 40
Metadata
- Authors
- Jones, N. W., Raine-Fenning, N. J., Mousa, H. A., Bradley, E., & Bugg, G. J.
- Affiliations
- Nottingham University Hospitals NHS Trust (GB)
- Leicester Royal Infirmary (GB)
- Corresponding author
- Jones, Nia W.
- Venue
- Ultrasound in Medicine & Biology
- Publisher
- Elsevier BV
- Published
- 2011-03
- Volume
- 37
- Issue
- 3
- Pages
- 376-385
- ISSN
- 0301-5629 (ISSN-L)
- OpenAlex
- W2014435045
- Cited by
- 32
- References
- 1
- Citations by year
- 2024: 1 · 2023: 1 · 2022: 2 · 2021: 3 · 2020: 1 · 2018: 2 · 2017: 5 · 2016: 3 · 2015: 2 · 2014: 5 · 2013: 5 · 2012: 1
- FWCI
- 4.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Ultrasound in Medicine & Biology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Obstetrics and Gynecology › Pregnancy and preeclampsia studies
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Ultrasound in Clinical Applications
- Health Sciences › Medicine › Pediatrics, Perinatology and Child Health › Prenatal Screening and Diagnostics
- Keywords
- placental volume, placental vascularization, intra-rater reliability, inter-rater reliability, second trimester, observer bias
- MeSH terms
- Adult, Algorithms, Female, Humans, Image Enhancement, Image Interpretation, Computer-Assisted, Organ Size, Placenta, Pregnancy, Pregnancy Trimester, Second, Sensitivity and Specificity, Reproducibility of Results, Observer Variation, Ultrasonography, Doppler, Color, Placental Circulation, Imaging, Three-Dimensional, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review