The DOI matches its Crossref record; 19 of the 20 references it cites were found in a registry or an index; 11 of the 19 sources its claims cite were checked for support.
The External Validation of a Multivariable Prediction Model for Recurrent Pelvic Organ Prolapse After Native Tissue Repair: A Prospective Cohort Study
Open accessAbstract
Background/Objectives: A prediction model for anatomical cystocele recurrence after native tissue repair was developed and internally validated in 2016. This model estimates a patients’ individual risk of recurrence and can be used for counseling. Before implementation in urogynecological clinical practice, external validation is needed. The aim of this study was to assess the external validity of this previously developed prediction model. The secondary aim was to test the performance of this model with a composite and subjective outcome of pelvic organ prolapse (POP) recurrence. Furthermore, the aim was to investigate whether risk factors for POP recurrence were in line with the population in which the original model was developed. Methods: In this prospective multicenter cohort study, 246 patients who underwent anterior colporrhaphy were included. Inclusion criteria were patients scheduled to undergo a primary anterior colporrhaphy (with a POP Quantification (POPQ) stage ≥ 2 cystocele). A combination of a primary anterior colporrhaphy with other POP or incontinence surgery (without the use of vaginal or abdominal mesh material) was permitted. Patients with prolapse or incontinence surgery prior to index surgery could not participate. All patients filled in questionnaires, pelvic floor ultrasound was performed preoperatively, and data from the medical file concerning POPQ stage and obstetric and general history were obtained. Results: Thirty women (12.2%) were lost at follow up. Anatomical cystocele recurrence was present in 107/216 (49.5%), subjective recurrence in 19/208 (9.1%), and 39/219 (17.8%) patients met the criteria for composite outcome. The area under the receiver operating characteristic curves for anatomical, composite, and subjective recurrence were 65.5% (95% CI: 58.7–72.4), 55.8% (95% CI 47.3–64.3%, NS), and 55.1% (95% CI 45.1–65.2%), respectively. In the multivariable analysis, preoperative cystocele stage 3 or 4 and a complete levator defect on ultrasound were independent risk factors for anatomical recurrence. For composite recurrence, younger age and an active employment status were only risk factors in univariable analysis. No significant risk factors for subjective recurrence could be identified. Conclusions: This external validation study showed a moderate performance for a prediction model for anatomical recurrence. The model cannot be used for a composite or subjective outcome prediction because of poor performance. For composite and subjective recurrence, new prediction models need to be developed.
Overview
CoChat Summary
TL;DR
This prospective multicenter external validation found moderate discrimination for the original anatomical cystocele recurrence prediction model after native tissue repair, with an AUC of 65.5%, but poor performance for composite and subjective recurrence. The model systematically underestimated anatomical recurrence risk and required intercept recalibration before use.
Key findings
- Anatomical cystocele recurrence occurred in 107/216 patients (49.5%), subjective recurrence in 19/208 (9.1%), and composite recurrence in 39/219 (17.8%).
- The AUC was 65.5% (95% CI 58.7–72.4) for anatomical recurrence, 55.8% (95% CI 47.3–64.3, NS) for composite recurrence, and 55.1% (95% CI 45.1–65.2) for subjective recurrence.
- The model underestimated anatomical recurrence: average predicted risk was 40.2% versus observed 49.5%; after re-estimating the intercept from −2.35 to −1.89, average predicted risk was 47.6%.
- Independent risk factors for anatomical recurrence were preoperative cystocele POPQ stage 3 or 4 and a complete levator defect on ultrasound; younger age and active employment were univariable risk factors for composite recurrence only, and no significant risk factors were identified for subjective recurrence.
Methods
- Prospective multicenter cohort study in four hospitals (two university, two teaching), with 260 patients enrolled between July 2017 and October 2021; 246 remained after exclusions, with one-year follow-up. Inclusion required primary anterior colporrhaphy with POPQ stage ≥2 cystocele; prior POP or incontinence surgery and mesh use were excluded.
- Data included POPQ staging, questionnaires including the Urogenital Distress Inventory, and preoperative 3D translabial ultrasound for levator defects and hiatal area.
- External validation used the published model formula to calculate individual predicted risks; performance was assessed by AUC and calibration-in-the-large, with recalibration by re-estimating the intercept. Multivariable logistic regression identified independent predictors of recurrence, with missing predictor values imputed.
Limitations
- The authors state that missing values were a weakness, especially ultrasound files with technical failures or volumes lacking adequate reference points, which may have influenced results, particularly for large hiatal areas.
- The authors state that extending follow-up beyond one year could provide deeper insight into long-term risk factors for prolapse recurrence.
- Evident from the text: ultrasound data were available for only 181/246 (73.6%) for levator defects and 171/246 (69.5%) for hiatal area, and composite recurrence could not be assessed in the developmental cohort because only POPQ stages, not individual POPQ points, had been collected.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
10 Valid · 0 Not valid · 7 Not checked · 53 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Very few studies report on risk factors for recurrent POP with composite or subjective outcome measures after native tissue repair [16,17].”
§ The External Validation of a Multivariable Prediction Model for Recurrent Pelvic Organ Prolapse After Native Tissue Repair: A Prospective Cohort Study > 4. Discussion
What the sources say
- Supportedcites [16] Schulten, 2022, Risk factors for pelvic organ prolapse recurrence after sacrospinous hysteropexy or vaginal hysterectomy with uterosacral ligament suspension, Am. J. Obs. Gynecol. source
The Introduction (page not supplied) says most prior studies of POP recurrence risk factors focused on objective recurrence and combined mesh with nonmesh surgeries. That supports the claim that studies using composite or subjective outcomes specifically after native tissue repair were uncommon. (LLM, conf=0.88)
- Supportedcites [17] Siff, 2020, Immediate Postoperative Pelvic Organ Prolapse Quantification Measures and 2-Year Risk of Prolapse Recurrence, Obstet. Gynecol. source
The Introduction and Methods describe an analysis of recurrence after native-tissue prolapse repair using patient-reported bothersome bulge symptoms and a composite surgical-failure outcome. The cited paper is therefore an example of the kind of study the sentence identifies. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We could not confirm the larger hiatal area being a risk factor, but a hiatal area <20 cm2 was a protective factor for anatomical recurrence in the univariable analysis.”
§ The External Validation of a Multivariable Prediction Model for Recurrent Pelvic Organ Prolapse After Native Tissue Repair: A Prospective Cohort Study > 4. Discussion
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Anatomical cystocele recurrence was present in 107/216 (49.5%)”
- Also stated in: § 3. Results · plain
“In the external validation cohort, 107/216 patients (49.5%) had anatomical recurrence, compared to 151/287 patients (52.6%) in the developmental cohort (p = 0.47).”
- Also stated in: § 3. Results · plain
“The actual anatomical recurrence rate was 49.5%.”
§ The External Validation of a Multivariable Prediction Model for Recurrent Pelvic Organ Prolapse After Native Tissue Repair: A Prospective Cohort Study > Abstract
plainn = 216- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 3. Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“subjective recurrence in 19/208 (9.1%)”
- Also stated in: § 3. Results · plain
“In the external validation cohort, 19/208 patients (9.1%) met the criteria for subjective recurrence compared to 28/283 patients (9.9%) in the developmental cohort (p = 0.77).”
§ The External Validation of a Multivariable Prediction Model for Recurrent Pelvic Organ Prolapse After Native Tissue Repair: A Prospective Cohort Study > Abstract
plainn = 208- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 3. Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“39/219 (17.8%) patients met the criteria for composite outcome.”
- Also stated in: § 3. Results · plain
“In 39/219 patients (17.8%) in the external validation cohort, the criteria for composite recurrence were met.”
§ The External Validation of a Multivariable Prediction Model for Recurrent Pelvic Organ Prolapse After Native Tissue Repair: A Prospective Cohort Study > Abstract
plainn = 219- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 3. Results · plain
35 more claims
Create a free account to see all 70 claims and every source verdict.
- Probably not a substantial claim. 16
- It may state two separate claims as one. 19
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The External Validation of a Multivariable Prediction Model for Recurrent Pelvic Organ Prolapse After Native Tissue Repair: A Prospective Cohort Study > 4. Discussion
“In our study, the risk factors for anatomical recurrence appeared to not be significant for the composite outcome, as only a younger age was associated with composite recurrence.”
§ The External Validation of a Multivariable Prediction Model for Recurrent Pelvic Organ Prolapse After Native Tissue Repair: A Prospective Cohort Study > 3. Results
“In the univariable logistic regression analysis, younger age and an active employment status appeared to be a risk factors for composite recurrence, but were non-significant in the multivariable analysis.”
Citations
Cites
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147 · cited 1×
“The TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis) guidelines were used when composing this manuscript [11].”
The standardization of terminology of female pelvic organ prolapse and pelvic floor dysfunction
Bump, R. C., Mattiasson, A., Bø, K., Brubaker, L. P., DeLancey, J. O. L., Klarskov, P., Shull, B. L., & Smith, A. R. B. (1996) · American Journal of Obstetrics and Gynecology · doi:10.1016/s0002-9378(96)70243-0 · Cited by 4,275 · cited 1×
“Preoperatively and one year postoperatively, POP was staged using the POPQ system [7].”
Epidemiology and outcome assessment of pelvic organ prolapse
Barber, M. D., & Maher, C. (2013) · International Urogynecology Journal · doi:10.1007/s00192-013-2169-9 · Cited by 767 · cited 1×
“In recent years, there has been considerable debate on the ideal outcome measure of treatment success or failure after POP surgery [14].”
External validation is necessary in prediction research:
Bleeker, S. E., Moll, H. A., Steyerberg, E. W., Donders, A. R. T., Derksen-Lubsen, G., Grobbee, D. E., & Moons, K. G. M. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00207-5 · Cited by 710 · cited 1×
“The external validation of prediction models is highly important because models tend to perform too optimistically in the developmental sample [12].”
Collins, G. S., Ogundimu, E. O., & Altman, D. G. (2016) · Statistics in Medicine · doi:10.1002/sim.6787 · Cited by 665 · cited 1×
“Collins et al. [10] recommended that externally validating a prognostic model requires a minimum of 100 events and 100 non-events.”
Defining Success After Surgery for Pelvic Organ Prolapse
Barber, M. D., Brubaker, L., Nygaard, I., Wheeler, T. L., Schaffer, J., Chen, Z., & Spino, C. (2009) · Obstetrics & Gynecology · doi:10.1097/aog.0b013e3181b2b1ae · Cited by 515
Minimal criteria for the diagnosis of avulsion of the puborectalis muscle by tomographic ultrasound
Dietz, H. P., Bernardo, M. J., Kirby, A., & Shek, K. L. (2011) · International Urogynecology Journal · doi:10.1007/s00192-010-1329-4 · Cited by 344 · cited 1×
“Leva-tor damage was graded by the classification system developed by Dietz et al. in the three central slices (i.e., the plane of minimal dimensions plus slices 2.5 mm and 5 mm above this plane) [9].”
InfluentialSurgery for women with anterior compartment prolapse
Maher, C., Feiner, B., Baessler, K., Christmann-Schmid, C., Haya, N., & Brown, J. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004014.pub6 · Cited by 266
Schulten, S. F. M., Claas-Quax, M. J., Weemhoff, M., van Eijndhoven, H. W., van Leijsen, S. A., Vergeldt, T. F., IntHout, J., & Kluivers, K. B. (2022) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2022.04.046 · Cited by 245 · cited 2×
“Known risk factors for anatomical POP recurrence are a high preoperative stage (Pelvic Organ Prolapse Quantification (POPQ) stage 3 or 4) and a younger age [3].”
Self-citationRisk factors for prolapse recurrence: systematic review and meta-analysis
Friedman, T., Eslick, G. D., & Dietz, H. P. (2018) · International Urogynecology Journal · doi:10.1007/s00192-017-3475-4 · Cited by 222 · cited 1×
“Furthermore, in the study of Friedman et al. [13], a high preoperative stage and larger hiatal area were associated with recurrence.”
Metadata
- Authors
- Kessels, I., van Kuijk, S., Vergeldt, T., van Gestel, I., Spaans, W., Notten, K., Kruitwagen, R., & Weemhoff, M.
- Affiliations
- Maastricht University Medical Centre (NL)
- Department of Clinical Epidemiology and Medical Technology Assessment (KEMTA), Maastricht University Medical Center (MUMC+), P. Debyelaan 25, Postbus 5800, 6202 AZ Maastricht, The Netherlands
- Gateshead Health NHS Foundation Trust (GB)
- Department of Obstetrics and Gynecology, Viecuri Medical Center, Tegelseweg 210, 5912 BL Venlo, The Netherlands
- Radboud University Medical Center (NL)
- Zuyderland Medisch Centrum (NL)
- Corresponding author
- Kessels, Imke
- Venue
- Journal of Clinical Medicine
- Publisher
- MDPI AG
- Published
- 2025-01-15
- Volume
- 14
- Issue
- 2
- Pages
- 531
- ISSN
- 2077-0383 (ISSN-L)
- PMC
- PMC11765511
- OpenAlex
- W4406420749
- Cited by
- 0
- References
- 20
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Journal of Clinical Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Research Publications (Maastricht University) (submittedVersion, cc-by)
- Topics
- Health Sciences › Medicine › Urology › Pelvic floor disorders treatments
- Health Sciences › Medicine › Obstetrics and Gynecology › Uterine Myomas and Treatments
- Health Sciences › Medicine › Surgery › Hernia repair and management
- Keywords
- cystocele, native tissue repair, anterior colporrhaphy, prediction model, external validation, risk factors, pelvic floor ultrasound, urogynecology, risk counseling, employment status, age, cystocele recurrence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The External Validation of a Multivariable Prediction Model for Recurrent Pelvic Organ Prolapse After Native Tissue Repair: A Prospective Cohort Study. https://app.cochat.ai/papers/10.3390/jcm14020531
- The paper
- Kessels, I., van Kuijk, S., Vergeldt, T., van Gestel, I., Spaans, W., Notten, K., Kruitwagen, R., & Weemhoff, M. (2025). The External Validation of a Multivariable Prediction Model for Recurrent Pelvic Organ Prolapse After Native Tissue Repair: A Prospective Cohort Study. Journal of Clinical Medicine. https://doi.org/10.3390/jcm14020531
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.