Cited by 14Ovarian cancer diagnosis and treatmentBRCA gene mutations in cancerIntraperitoneal and Appendiceal Malignancies

Comparison of the ADNEX and ROMA risk prediction models for the diagnosis of ovarian cancer: a multicentre external validation in patients who underwent surgery

Open access
Landolfo, Chiara, Ceusters, Jolien, Valentin, Lil, Froyman, Wouter, Van Gorp, Toon, Heremans, Ruben, Baert, Thaïs, Wouters, Roxanne, Vankerckhoven, Ann, Van Rompuy, Anne-Sophie, Billen, Jaak, Moro, Francesca, Mascilini, Floriana, Neumann, Adam, Van Holsbeke, Caroline, Chiappa, Valentina, Bourne, Tom, Fischerova, Daniela, Testa, Antonia, Coosemans, An, Timmerman, Dirk, Van Calster, Ben·2024·British Journal of Cancer

Abstract

Background Several diagnostic prediction models to help clinicians discriminate between benign and malignant adnexal masses are available. This study is a head-to-head comparison of the performance of the Assessment of Different NEoplasias in the adneXa (ADNEX) model with that of the Risk of Ovarian Malignancy Algorithm (ROMA).Methods This is a retrospective study based on prospectively included consecutive women with an adnexal tumour scheduled for surgery at five oncology centres and one non-oncology centre in four countries between 2015 and 2019. The reference standard was histology. Model performance for ADNEX and ROMA was evaluated regarding discrimination, calibration, and clinical utility.Results The primary analysis included 894 patients, of whom 434 (49%) had a malignant tumour. The area under the receiver operating characteristic curve (AUC) was 0.92 (95% CI 0.88-0.95) for ADNEX with CA125, 0.90 (0.84-0.94) for ADNEX without CA125, and 0.85 (0.80-0.89) for ROMA. ROMA, and to a lesser extent ADNEX, underestimated the risk of malignancy. Clinical utility was highest for ADNEX. ROMA had no clinical utility at decision thresholds <27%.Conclusions ADNEX had better ability to discriminate between benign and malignant adnexal tumours and higher clinical utility than ROMA.Clinical trial registration clinicaltrials.gov NCT01698632 and NCT02847832.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41416-024-02578-x

Cites

54 of 54 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 14

  1. Moore RG, McMeekin DS, Brown AK, DiSilvestro P, Miller MC, Allard WJ, et al. A novel multiple marker bioassay utilizing HE4 and CA125 for the prediction of ovarian cancer in patients with a pelvic mass. Gynecol Oncol 2009;112:40-6.
  2. Van Calster B, Van Hoorde K, Valentin L, Testa AC, Fischerova D, Van Holsbeke C, et al. Evaluating the risk of ovarian cancer before surgery using the ADNEX model to differentiate between benign, borderline, early and advanced stage invasive, and secondary metastatic tumours: prospective multicentre diagnostic study. BMJ 2014;349:g5920.
  3. Timmerman D, Valentin L, Bourne T, Collins WP, Verrelst H, Vergote I. Terms, definitions and measurements to describe the sonographic features of adnexal tumors: a consensus opinion from the International Ovarian Tumor Analysis (IOTA) group. Ultrasound Obstet Gynecol 2000;16:500-5.
  4. Vergouwe Y, Steyerberg EW, Eijkemans MJ, Habbema JD. Substantial effective sample sizes were required for external validation studies of predictive logistic regression models. J Clin Epidemiol 2005;58:475-83.
  5. Collins GS, Ogundimu EO, Altman DG. Sample size considerations for the external validation of a multivariable prognostic model: a resampling study. Stat Med 2016;35:214-26.
  6. Van Calster B, Nieboer D, Vergouwe Y, De Cock B, Pencina MJ, Steyerberg EW. A calibration hierarchy for risk models was defined: from utopia to empirical data. J Clin Epidemiol 2016;74:167-76.
  7. Riley RD, Debray TP, Collins GS, Archer L, Ensor J, van Smeden M, et al. Minimum sample size for external validation of a clinical prediction model with a binary outcome. Statistics in Medicine 2021, 40(19), 4230-4251.
  8. Van Calster B, Valentin L, Froyman W, Landolfo C, Ceusters J, Testa AC et al. Validation of models to diagnose ovarian cancer in patients managed surgically or conservatively: multicentre cohort study. BMJ 2020;370:m2614.
  9. Kaijser J, Van Gorp T, Van Hoorde K, Van Holsbeke C, Sayasneh A, Vergote I, et al. A comparison between an ultrasound based prediction model (LR2) and the risk of ovarian malignancy algorithm (ROMA) to assess the risk of malignancy in women with an adnexal mass. Gynecol Oncol 2013;129:377-83.
  10. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making 2006;26:565-74.
  11. Vickers AJ, Van Calster B, Steyerberg EW. Net benefit approaches to the evaluation of prediction models, molecular markers, and diagnostic tests. BMJ 2016;352:i6.
  12. Wynants L, Timmerman D, Verbakel JY, Testa A, Savelli L, Fischerova D, et al. Clinical Utility of Risk Models to Refer Patients with Adnexal Masses to Specialized Oncology Care: Multicenter External Validation Using Decision Curve Analysis. Clin Cancer Res 2017;23:5082-90.
  13. Pauker SG, Kassirer JP. Therapeutic decision making: a cost-benefit analysis. New Engl J Med 1975;293:229-34.
  14. van Buuren S, Groothuis-Oudshoorn K. mice: Multivariate Imputation by Chained Equations in R. J Stat Softw 2011;45(3):1-67.

Cited by

Sorted by citations

Authors
Landolfo, C., Ceusters, J., Valentin, L., Froyman, W., Van Gorp, T., Heremans, R., Baert, T., Wouters, R., Vankerckhoven, A., Van Rompuy, A.-S., Billen, J., Moro, F., Mascilini, F., Neumann, A., Van Holsbeke, C., Chiappa, V., Bourne, T., Fischerova, D., Testa, A., Coosemans, A., Timmerman, D., & Van Calster, B.
Affiliations
  • Agostino Gemelli University Polyclinic (IT)
  • KU Leuven (BE)
  • Lund University (SE)
  • Universitair Ziekenhuis Leuven (BE)
  • Oncoinvent (Norway) (NO)
  • Charles University (CZ)
  • Queen Charlotte's and Chelsea Hospital (GB)
Venue
British Journal of Cancer
Published
2024-01-19
Volume
130
Issue
6
Pages
934-940
ISSN
  • 0007-0920 (ISSN-L)
  • 1532-1827
OpenAlex
W4391014881
Cited by
14
References
54
Citations by year
2026: 6 · 2025: 4 · 2024: 4
FWCI
5.52
Type
journal article
Language
en
Open access
Locations
  • British Journal of Cancer (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
  • Lirias (submittedVersion, other-oa)
  • Lund University Publications (Lund University) (submittedVersion)
Funders
  • Fonds Wetenschappelijk Onderzoek (18B2921N)
  • Kom Op Tegen Kanker Internal Funds
  • Linbury Trust Grant
  • Vetenskapsrådet (K2014-99X-22475-01-3)
  • the Malmö General Hospital Foundation for fighting against cancer Avtal om läkarutbildning och forskning (ALF)-medel Landstingsfinansierad Regional Forskning
  • DH | National Institute for Health Research
Topics
  • Health Sciences › Medicine › Reproductive Medicine › Ovarian cancer diagnosis and treatment
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › BRCA gene mutations in cancer
  • Health Sciences › Medicine › Surgery › Intraperitoneal and Appendiceal Malignancies
Keywords
ovarian cancer, ADNEX model, ROMA index, adnexal tumors, risk prediction model, CA125, benign versus malignant differentiation, external validation, model discrimination, model calibration, clinical utility
MeSH terms
Adnexal Diseases, Algorithms, Female, Humans, Ovarian Neoplasms, Retrospective Studies, Sensitivity and Specificity, Ultrasonography, CA-125 Antigen

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review