The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
10-year performance of four models of breast cancer risk: a validation study
Abstract
BACKGROUND Independent validation is essential to justify use of models of breast cancer risk prediction and inform decisions about prevention options and screening. Few independent validations had been done using cohorts for common breast cancer risk prediction models, and those that have been done had small sample sizes and short follow-up periods, and used earlier versions of the prediction tools. We aimed to validate the relative performance of four commonly used models of breast cancer risk and assess the effect of limited data input on each one's performance. METHODS In this validation study, we used the Breast Cancer Prospective Family Study Cohort (ProF-SC), which includes 18 856 women from Australia, Canada, and the USA who did not have breast cancer at recruitment, between March 17, 1992, and June 29, 2011. We selected women from the cohort who were 20-70 years old and had no previous history of bilateral prophylactic mastectomy or ovarian cancer, at least 2 months of follow-up data, and information available about family history of breast cancer. We used this selected cohort to calculate 10-year risk scores and compare four models of breast cancer risk prediction: the Breast and Ovarian Analysis of Disease Incidence and Carrier Estimation Algorithm model (BOADICEA), BRCAPRO, the Breast Cancer Risk Assessment Tool (BCRAT), and the International Breast Cancer Intervention Study model (IBIS). We compared model calibration based on the ratio of the expected number of breast cancer cases to the observed number of breast cancer cases in the cohort, and on the basis of their discriminatory ability to separate those who will and will not have breast cancer diagnosed within 10 years as measured with the concordance statistic (C-statistic). We did subgroup analyses to compare the performance of the models at 10 years in BRCA1 or BRCA2 mutation carriers (ie, BRCA-positive women), tested non-carriers and untested participants (ie, BRCA-negative women), and participants younger than 50 years at recruitment. We also assessed the effect that limited data input (eg, restriction of the amount of family history and non-genetic information included) had on the models' performance. FINDINGS After median follow-up of 11·1 years (IQR 6·0-14·4), 619 (4%) of 15 732 women selected from the ProF-SC cohort study were prospectively diagnosed with breast cancer after recruitment, of whom 519 (84%) had histologically confirmed disease. BOADICEA and IBIS were well calibrated in the overall validation cohort, whereas BRCAPRO and BCRAT underpredicted risk (ratio of expected cases to observed cases 1·05 [95% CI 0·97-1·14] for BOADICEA, 1·03 [0·96-1·12] for IBIS, 0·59 [0·55-0·64] for BRCAPRO, and 0·79 [0·73-0·85] for BRCAT). The estimated C-statistics for the complete validation cohort were 0·70 (95% CI 0·68-0·72) for BOADICEA, 0·71 (0·69-0·73) for IBIS, 0·68 (0·65-0·70) for BRCAPRO, and 0·60 (0·58-0·62) for BCRAT. In subgroup analyses by BRCA mutation status, the ratio of expected to observed cases for BRCA-negative women was 1·02 (95% CI 0·93-1·12) for BOADICEA, 1·00 (0·92-1·10) for IBIS, 0·53 (0·49-0·58) for BRCAPRO, and 0·97 (0·89-1·06) for BCRAT. For BRCA-positive participants, BOADICEA and IBIS were well calibrated, but BRCAPRO underpredicted risk (ratio of expected to observed cases 1·17 [95% CI 0·99-1·38] for BOADICEA, 1·14 [0·96-1·35] for IBIS, and 0·80 [0·68-0·95] for BRCAPRO). We noted similar patterns of calibration for women younger than 50 years at recruitment. Finally, BOADICEA and IBIS predictive scores were not appreciably affected by limiting input data to family history for first-degree and second-degree relatives. INTERPRETATION Our results suggest that models that include multigenerational family history, such as BOADICEA and IBIS, have better ability to predict breast cancer risk, even for women at average or below-average risk of breast cancer. Although BOADICEA and IBIS performed similarly, further improvements in the accuracy of predictions could be possible with hybrid models that incorporate the polygenic risk component of BOADICEA and the non-family-history risk factors included in IBIS. FUNDING US National Institutes of Health, National Cancer Institute, Breast Cancer Research Foundation, Australian National Health and Medical Research Council, Victorian Health Promotion Foundation, Victorian Breast Cancer Research Consortium, Cancer Australia, National Breast Cancer Foundation, Queensland Cancer Fund, Cancer Councils of New South Wales, Victoria, Tasmania, and South Australia, and Cancer Foundation of Western Australia.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gail, M. H., Brinton, L. A., Byar, D. P., Corle, D. K., Green, S. B., Schairer, C., & Mulvihill, J. J. (1989) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/81.24.1879 · Cited by 3,334
A breast cancer prediction model incorporating familial and personal risk factors
Tyrer, J., Duffy, S. W., & Cuzick, J. (2004) · Statistics in Medicine · doi:10.1002/sim.1668 · Cited by 1,345
A calibration hierarchy for risk models was defined: from utopia to empirical data
Van Calster, B., Nieboer, D., Vergouwe, Y., De Cock, B., Pencina, M. J., & Steyerberg, E. W. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.12.005 · Cited by 910
Brentnall, A. R., Harkness, E. F., Astley, S. M., Donnelly, L. S., Stavrinos, P., Sampson, S., Fox, L., Sergeant, J. C., Harvie, M. N., Wilson, M., et al. (2015) · Breast Cancer Research · doi:10.1186/s13058-015-0653-5 · Cited by 252
A spline-based tool to assess and visualize the calibration of multiclass risk predictions
Van Hoorde, K., Van Huffel, S., Timmerman, D., Bourne, T., & Van Calster, B. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.12.016 · Cited by 85
Cited by
Key steps for effective breast cancer prevention
Britt, K. L., Cuzick, J., & Phillips, K.-A. (2020) · Nature Reviews Cancer · doi:10.1038/s41568-020-0266-x · Cited by 992
Self-citationFinnGen, Mars, N., Koskela, J. T., Ripatti, P., Kiiskinen, T. T. J., Havulinna, A. S., Lindbohm, J. V., Ahola-Olli, A., Kurki, M., Karjalainen, J., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0800-0 · Cited by 495
Self-citationPersonalized early detection and prevention of breast cancer: ENVISION consensus statement
Pashayan, N., Antoniou, A. C., Ivanus, U., Esserman, L. J., Easton, D. F., French, D., Sroczynski, G., Hall, P., Cuzick, J., Evans, D. G., et al. (2020) · Nature Reviews Clinical Oncology · doi:10.1038/s41571-020-0388-9 · Cited by 438
Breast Cancer Screening for Women at Higher-Than-Average Risk: Updated Recommendations From the ACR
Monticciolo, D. L., Newell, M. S., Moy, L., Lee, C. S., & Destounis, S. V. (2023) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2023.04.002 · Cited by 290
Explainable artificial intelligence for multi-modal cancer analysis: from genomics to immunology
Zhang, M., & Yin, L. (2026) · Critical Reviews in Oncology/Hematology · doi:10.1016/j.critrevonc.2025.105040 · Cited by 5
Metadata
- Authors
- Terry, M. B., Liao, Y., Whittemore, A. S., Leoce, N., Buchsbaum, R., Zeinomar, N., Dite, G. S., Chung, W. K., Knight, J. A., Southey, M. C., Milne, R. L., Goldgar, D., Giles, G. G., McLachlan, S.-A., Friedlander, M. L., Weideman, P. C., Glendon, G., Nesci, S., Andrulis, I. L., John, E. M., Phillips, K.-A., Daly, M. B., Buys, S. S., Hopper, J. L., & MacInnis, R. J.
- Venue
- The Lancet Oncology
- Publisher
- Elsevier BV
- Published
- 2019-04
- Volume
- 20
- Issue
- 4
- Pages
- 504-517
- ISSN
- 1470-2045 (ISSN-L)
- OpenAlex
- W2916014925
- Cited by
- 170
- References
- 5
- FWCI
- 13.81
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: 10-year performance of four models of breast cancer risk: a validation study. https://app.cochat.ai/papers/10.1016/s1470-2045(18)30902-1
- The paper
- Terry, M. B., Liao, Y., Whittemore, A. S., Leoce, N., Buchsbaum, R., Zeinomar, N., Dite, G. S., Chung, W. K., Knight, J. A., Southey, M. C., Milne, R. L., Goldgar, D., Giles, G. G., McLachlan, S.-A., Friedlander, M. L., Weideman, P. C., Glendon, G., Nesci, S., Andrulis, I. L., . . . MacInnis, R. J. (2019). 10-year performance of four models of breast cancer risk: a validation study. The Lancet Oncology. https://doi.org/10.1016/s1470-2045(18)30902-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.