Comparison of two models predicting IVF success; the effect of time trends on model performance
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
STUDY QUESTION: How well does the recently developed UK model predicting the success rate of IVF treatment (the 2011 Nelson model) perform in comparison with a UK model developed in the early 1990s (the Templeton model)? SUMMARY ANSWER: Both models showed similar performance, after correction for the increasing success rate over time of IVF. WHAT IS KNOWN ALREADY: For counselling couples undergoing IVF treatment it is of paramount importance to be able to predict success. Several prediction models for the chance of success after IVF treatment have been developed. So far, the Templeton model has been recommended as the best approach after having been validated in several independent patient data sets. The Nelson model, developed in 2011 and characterized by the largest development sample containing the most recently treated couples, may well perform better. STUDY DESIGN, SIZE, DURATION: We tested both models in couples that were included in a national cohort study carried out in the Netherlands between the beginning of January 2002 and the end of December 2004. PARTICIPANTS/MATERIALS, SETTING, METHODS: We analysed the IVF cycles of Dutch couples with primary infertility (n = 5176). The chance of success was calculated using the two UK models that had been developed using the information collected in the Human Fertilisation and Embryology Authority database. Women were treated in 1991-1994 (Templeton) or 2003-2007 (Nelson). The outcome of success for both UK models is the occurrence of a live birth after IVF but the outcome in the Dutch data is an ongoing pregnancy. In order to make the outcomes compatible, we used a factor to convert the chance of live birth to ongoing pregnancy and use the overall terms 'success or no success after IVF'. The discriminative ability and the calibration of both models were assessed, the latter before and after adjustment for time trends in IVF success rates. MAIN RESULTS AND THE ROLE OF CHANCE: The two models showed a similarly limited degree of discriminative ability on the tested data (area under the receiver operating characteristic curve 0.597 for the Templeton model and 0.590 for the Nelson model). The Templeton model underestimated the success rate (observed 21% versus predicted 14%); the Nelson model overestimated the success rate (observed 21% versus predicted 29%). When the models were adjusted for the changing success rates over time, the calibration of both models considerably improved (Templeton observed 21% versus predicted 20%; Nelson observed 21% versus predicted 24%). LIMITATIONS, REASONS FOR CAUTION: We could only test the models in couples with primary infertility because detailed information on secondary infertile couples was lacking in the Dutch data. This shortcoming may have negatively influenced the performance of the Nelson model. WIDER IMPLICATIONS OF THE FINDINGS: The changes in success rates over time should be taken into account when assessing prediction models for estimating the success rate of IVF treatment. In patients with primary infertility, the choice to use the Templeton or Nelson model is arbitrary.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evaluating the Yield of Medical Tests
Harrell, F. E. (1982) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1982.03320430047030 · Cited by 3,490
Flexible Imputation of Missing Data
van Buuren, S. (2012) · doi:10.1201/b11826 · Cited by 2,022
Nyboe Andersen, A., Goossens, V., Bhattacharya, S., Ferraretti, A. P., Kupka, M. S., de Mouzon, J., & Nygren, K. G. (2009) · Human Reproduction · doi:10.1093/humrep/dep035 · Cited by 599
Two Further Applications of a Model for Binary Regression
Cox, D. R. (1958) · Biometrika · doi:10.2307/2333203 · Cited by 557
Two further applications of a model for binary regression
COX, D. R. (1958) · Biometrika · doi:10.1093/biomet/45.3-4.562 · Cited by 556
Vergouwe, Y., Moons, K. G. M., & Steyerberg, E. W. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq223 · Cited by 243
Self-citationThe effect of in vitro fertilization on birth rates in western countries
Habbema, J. D. F., Eijkemans, M. J. C., Nargund, G., Beets, G., Leridon, H., & te Velde, E. R. (2009) · Human Reproduction · doi:10.1093/humrep/dep004 · Cited by 78 · cited 1×
“The probability of achieving a spontaneous pregnancy under these conditions may vary from zero to almost normal range (Hunault et al., 2004; Habbema et al., 2009; Brandes et al., 2010).”
BackgroundSelf-citation
Cited by
Calibration: the Achilles heel of predictive analytics
On behalf of Topic Group ‘Evaluating diagnostic tests and prediction models’ of the STRATOS initiative, Van Calster, B., McLernon, D. J., van Smeden, M., Wynants, L., & Steyerberg, E. W. (2019) · BMC Medicine · doi:10.1186/s12916-019-1466-7 · Cited by 2,650
McLernon, D. J., Steyerberg, E. W., te Velde, E. R., Lee, A. J., & Bhattacharya, S. (2016) · BMJ · doi:10.1136/bmj.i5735 · Cited by 259
Self-citationRhenman, A., Berglund, L., Brodin, T., Olovsson, M., Milton, K., Hadziosmanovic, N., & Holte, J. (2015) · Human Reproduction · doi:10.1093/humrep/deu295 · Cited by 79
Leridon, H. (2017) · Population · doi:10.3917/popu.1703.0463 · Cited by 20
Metadata
- Authors
- te Velde, E. R., Nieboer, D., Lintsen, A. M., Braat, D. D. M., Eijkemans, M. J. C., Habbema, J. D. F., & Vergouwe, Y.
- Venue
- Human Reproduction
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-11-15
- Volume
- 29
- Issue
- 1
- Pages
- 57-64
- ISSN
- 0268-1161 (ISSN-L)
- 1460-2350
- OpenAlex
- W2162950674
- Cited by
- 43
- References
- 7
- FWCI
- 4.60
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Comparison of two models predicting IVF success; the effect of time trends on model performance. https://app.cochat.ai/papers/10.1093/humrep/det393
- The paper
- te Velde, E. R., Nieboer, D., Lintsen, A. M., Braat, D. D. M., Eijkemans, M. J. C., Habbema, J. D. F., & Vergouwe, Y. (2014). Comparison of two models predicting IVF success; the effect of time trends on model performance. Human Reproduction. https://doi.org/10.1093/humrep/det393
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.