CoChat

Interpretable, not black-box, artificial intelligence should be used for embryo selection

Open access
Afnan, Michael Anis Mihdi, Liu, Yanhe, Conitzer, Vincent, Rudin, Cynthia, Mishra, Abhishek, Savulescu, Julian, Afnan, Masoud · 2021 · Human Reproduction Open
Cited by 112

The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.

Abstract

Artificial intelligence (AI) techniques are starting to be used in IVF, in particular for selecting which embryos to transfer to the woman. AI has the potential to process complex data sets, to be better at identifying subtle but important patterns, and to be more objective than humans when evaluating embryos. However, a current review of the literature shows much work is still needed before AI can be ethically implemented for this purpose. No randomized controlled trials (RCTs) have been published, and the efficacy studies which exist demonstrate that algorithms can broadly differentiate well between ‘good-’ and ‘poor-’ quality embryos but not necessarily between embryos of similar quality, which is the actual clinical need. Almost universally, the AI models were opaque (‘black-box’) in that at least some part of the process was uninterpretable. This gives rise to a number of epistemic and ethical concerns, including problems with trust, the possibility of using algorithms that generalize poorly to different populations, adverse economic implications for IVF clinics, potential misrepresentation of patient values, broader societal implications, a responsibility gap in the case of poor selection choices and introduction of a more paternalistic decision-making process. Use of interpretable models, which are constrained so that a human can easily understand and explain them, could overcome these concerns. The contribution of AI to IVF is potentially significant, but we recommend that AI models used in this field should be interpretable, and rigorously evaluated with RCTs before implementation. We also recommend long-term follow-up of children born after AI for embryo selection, regulatory oversight for implementation, and public availability of data and code to enable research teams to independently reproduce and validate existing models.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/hropen/hoab040

Cites

12 of 12 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 35

  1. Afnan, 2020, Generating translatable evidence to improve patient care: the contribution of human factors, Reprod Biomed Online, 41, 353, 10.1016/j.rbmo.2020.04.025 · DOI
  2. Agar, 2004, Liberal Eugenics: In Defense of Human Enhancement, 10.1002/9780470775004 · DOI
  3. Blackmer, 2018, EU general data protection regulation, OJEU, 2014, 45
  4. Bronet, 2015, Is there a relationship between time-lapse parameters and embryo sex?, Fertil Steril, 103, 396, 10.1016/j.fertnstert.2014.10.050 · DOI
  5. Buda, 2021, A data set and deep learning algorithm for the detection of masses and architectural distortions in digital breast tomosynthesis images, JAMA Netw Open, 4, e2119100, 10.1001/jamanetworkopen.2021.19100 · DOI
  6. Chavez-Badiola, 2020, Predicting pregnancy test results after embryo transfer by image feature extraction and analysis using machine learning, Sci Rep, 10, 4394, 10.1038/s41598-020-61357-9 · DOI
  7. Curchoe, 2020, Evaluating predictive models in reproductive medicine, Fertil Steril, 114, 921, 10.1016/j.fertnstert.2020.09.159 · DOI
  8. Elwyn, 2003, Shared decision making: developing the OPTION scale for measuring patient involvement, Qual Saf Health Care, 12, 93, 10.1136/qhc.12.2.93 · DOI · Paper page
  9. Fernandez, 2020, Artificial intelligence in the IVF laboratory: overview through the application of different types of algorithms for the classification of reproductive data, J Assist Reprod Genet, 37, 2359, 10.1007/s10815-020-01881-9 · DOI
  10. Gardner, 2000, Blastocyst score affects implantation and pregnancy outcome: towards a single blastocyst transfer, Fertil Steril, 73, 1155, 10.1016/S0015-0282(00)00518-5 · DOI · Paper page
  11. Gardner, 2015, Diagnosis of human preimplantation embryo viability, Hum Reprod Update, 21, 727, 10.1093/humupd/dmu064 · DOI · Paper page
  12. Garvelink, 2019, Decisional conflict scale use over 20 years: the anniversary review, Med Decis Making, 39, 301, 10.1177/0272989X19851345 · DOI · Paper page
  13. Huang, 2019, Is differences in embryo morphokinetic development significantly associated with human embryo sex?, Biol Reprod, 100, 618, 10.1093/biolre/ioy229 · doi:10.1093/biolre/ioy229
  14. Kan-Tor, 2020, Can deep learning automatically predict fetal heart pregnancy with almost perfect accuracy?, Hum Reprod, 35, 1473, 10.1093/humrep/deaa083 · doi:10.1093/humrep/deaa083
  15. Kemper, 2020, Preimplantation genetic testing for aneuploidy: are we examining the correct outcomes?, Hum Reprod, 35, 2408, 10.1093/humrep/deaa224 · DOI
  16. Khosravi, 2019, Deep learning enables robust assessment and selection of human blastocysts after in vitro fertilization, Npj Digit Med, 2, 1, 10.1038/s41746-019-0096-y · DOI · Paper page
  17. Leahy, 2020, Automated measurements of key morphological features of human embryos for IVF, Med Image Comput Comput Assist Interv, 12265, 25
  18. Légaré, 2010, Are you SURE? Assessing patient decisional conflict with a 4-item screening test, Can Fam Physician, 56, e308
  19. Liu, 2016, Time-lapse deselection model for human day 3 in vitro fertilization embryos: the combination of qualitative and quantitative measures of embryo growth, Fertil Steril, 105, 656, 10.1016/j.fertnstert.2015.11.003 · DOI
  20. Liu, 2019, Assessing efficacy of day 3 embryo time-lapse algorithms retrospectively: impacts of dataset type and confounding factors, Hum Fertil (Camb), 22, 182, 10.1080/14647273.2018.1425919 · doi:10.1080/14647273.2018.1425919
  21. Milewski, 2017, How much information about embryo implantation potential is included in morphokinetic data? A prediction model based on artificial neural networks and principal component analysis, Adv Med Sci, 62, 202, 10.1016/j.advms.2017.02.001 · doi:10.1016/j.advms.2017.02.001
  22. Morales, 2008, Bayesian classification for the selection of in vitro human embryos using morphological and clinical data, Comput Methods Programs Biomed, 90, 104, 10.1016/j.cmpb.2007.11.018 · DOI
  23. Parfit, 1984, Reasons and Persons
  24. Raef, 2020, Computational prediction of implantation outcome after embryo transfer, Health Inform J, 26, 1810, 10.1177/1460458219892138 · DOI
  25. Rosenwaks, 2020, Artificial intelligence in reproductive medicine: a fleeting concept or the wave of the future?, Fertil Steril, 114, 905, 10.1016/j.fertnstert.2020.10.002 · doi:10.1016/j.fertnstert.2020.10.002
  26. Savulescu, 2006, Behavioural genetics: why eugenic selection is preferable to enhancement, J Appl Philos, 23, 157, 10.1111/j.1468-5930.2006.00336.x · DOI
  27. Savulescu, 2009, The moral obligation to create children with the best chance of the best life, Bioethics, 23, 274, 10.1111/j.1467-8519.2008.00687.x · DOI · Paper page
  28. Savulescu, 2016, The Oxford Handbook of Reproductive Ethics
  29. Savulescu, 2001, Procreative beneficence: why we should select the best children, Bioethics, 15, 413, 10.1111/1467-8519.00251 · DOI · Paper page
  30. Tarín, 2014, Changes in sex ratio from fertilization to birth in assisted-reproductive-treatment cycles, Reprod Biol Endocrinol, 12, 56, 10.1186/1477-7827-12-56 · DOI
  31. Tran, 2019, Deep learning as a predictive tool for fetal heart pregnancy following time-lapse incubation and blastocyst transfer, Hum Reprod, 34, 1011, 10.1093/humrep/dez064 · DOI · Paper page
  32. Voter, 2021, Diagnostic accuracy and failure mode analysis of a deep learning algorithm for the detection of intracranial hemorrhage, J Am Coll Radiol, 10.1016/j.jacr.2021.03.005 · DOI
  33. Wang, 2018, Euploidy in relation to blastocyst sex and morphology, J Assist Reprod Genet, 35, 1565, 10.1007/s10815-018-1262-x · DOI
  34. Wilkinson, 2019, Do à la carte menus serve infertility patients? The ethics and regulation of in vitro fertility add-ons, Fertil Steril, 112, 973, 10.1016/j.fertnstert.2019.09.028 · DOI
  35. Zmuidinaite, 2021, Current advancements in noninvasive profiling of the embryo culture media secretome, Int J Mol Sci, 22, 1, 10.3390/ijms22052513 · DOI

Cited by

See all 112

Metadata

Authors
Afnan, M. A. M., Liu, Y., Conitzer, V., Rudin, C., Mishra, A., Savulescu, J., & Afnan, M.
Venue
Human Reproduction Open
Published
2021-09-01
Volume
2021
Issue
4
Pages
hoab040-hoab040
ISSN
2399-3529 (ISSN-L)
OpenAlex
W3209259671
Cited by
112
References
12
FWCI
3.68
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.