End-to-end deep learning for recognition of ploidy status using time-lapse videos.

Purpose Our retrospective study is to investigate an end-to-end deep learning model in identifying ploidy status through raw time-lapse video.

By randomly dividing the dataset of time-lapse videos with known outcome of preimplantation genetic testing for aneuploidy (PGT-A), a deep learning model on raw videos was trained by the 80% dataset, and used to test the remaining 20%, by feeding time-lapse videos as input and the PGT-A prediction as output. The performance was measured by an average area under the curve (AUC) of the receiver operating characteristic curve. Result(s) With 690 sets of time-lapse video image, combined with PGT-A results, our deep learning model has achieved an AUC of 0.74 from the test dataset (138 videos), in discriminating between aneuploid embryos (group 1) and others (group 2, including euploid and mosaic embryos).

Our model demonstrated a proof of concept and potential in recognizing the ploidy status of tested embryos. A larger scale and further optimization on the exclusion criteria would be included in our future investigation, as well as prospective approach. Similar content being viewed by others

Gardner DK, Meseguer M, Rubio C, Treff NR. Diagnosis of human preimplantation embryo viability. Hum Reprod Update. 2015;21(6):727–47. Lu L, Lv B, Huang K, Xue Z, Zhu X, Fan G. Recent advances in preimplantation genetic diagnosis and screening. J Assist Reprod Genet. 2016;33(9):1129–34. Ho JR, Arrach N, Rhodes-Long K, Ahmady A, Ingles S, Chung K, et al. Pushing the limits of detection: investigation of cell-free DNA for aneuploidy screening in embryos. Fertil Steril. 2018;110(3):467–475.e2. https://doi.org/10.1016/j.fertnstert.2018.03.036. Rubio C, Rienzi L, Navarro-Sánchez L, Cimadomo D, García-Pascual CM, Albricci L, et al. Embryonic cell-free DNA versus trophectoderm biopsy for aneuploidy testing: concordance rate and clinical implications. Fertil Steril. 2019;112(3):510–9. https://doi.org/10.1016/j.fertnstert.2019.04.038. Brouillet S, Martinez G, Coutton C, Hamamah S. Is cell-free DNA in spent embryo culture medium an alternative to embryo biopsy for preimplantation genetic testing? A systematic review. Reprod BioMed Online. 2020;40(6):779–96. https://doi.org/10.1016/j.rbmo.2020.02.002. Greco E, Litwicka K, Minasi MG, Cursio E, Greco PF, Barillari P. Preimplantation genetic testing: where we are today. Int J Mol Sci. 2020;21(12):4381. Alfarawati S, Fragouli E, Colls P, Stevens J, Gutiérrez-Mateo C, Schoolcraft WB, et al. The relationship between blastocyst morphology, chromosomal abnormality, and embryo gender. Fertil Steril. 2011;95(2):520–4. https://doi.org/10.1016/j.fertnstert.2010.04.003. de Savio Figueira RC, Setti AS, Braga DP, Iaconelli A Jr, Borges E Jr. Blastocyst morphology holds clues concerning the chromosomal status of the embryo. Int J Fertil Steril. 2015;9(2):215–20. https://doi.org/10.22074/ijfs.2015.4242 Epub 2015 Jul 27. PMID: 26246880; PMCID: PMC4518490. Campbell A, Fishel S, Bowman N, Duffy S, Sedler M, Hickman CF. Modelling a risk classification of aneuploidy in human embryos using non-invasive morphokinetics. Reprod BioMed Online. 2013;26(5):477–85. Minasi MG, Colasante A, Riccio T, Ruberti A, Casciani V, Scarselli F, et al. Correlation between aneuploidy, standard morphology evaluation and morphokinetic development in 1730 biopsied blastocysts: a consecutive case series study. Hum Reprod. 2016;31(10):2245–54. Basile N, Nogales Mdel C, Bronet F, Florensa M, Riqueiros M, Rodrigo L, et al. Increasing the probability of selecting chromosomally normal embryos by time-lapse morphokinetics analysis. Fertil Steril. 2014;101(3):699–704. Yang Z, Zhang J, Salem SA, Liu X, Kuang Y, Salem RD, et al. Selection of competent blastocysts for transfer by combining time-lapse monitoring and array CGH testing for patients undergoing preimplantation genetic screening: a prospective study with sibling oocytes. BMC Med Genet. 2014;7:38. Reignier A, Lammers J, Barriere P, Freour T. Can time-lapse parameters predict embryo ploidy? A systematic review. Reprod BioMed Online. 36(4):380–7. Kramer YG, Kofinas JD, Melzer K, Noyes N, McCaffrey C, Buldo-Licciardi J, et al. Assessing morphokinetic parameters via time lapse microscopy (TLM) to predict euploidy: are aneuploidy risk classification models universal? J Assist Reprod Genet. 2014;31(9):1231–42. Kim M, Yun J, Cho Y, Shin K, Jang R, Bae HJ, et al. Deep learning in medical imaging. Neurospine. 2019;16(4):657–68. Tran D, Cooke S, Illingworth PJ, Gardner DK. Deep learning as a predictive tool for fetal heart pregnancy following time-lapse incubation and blastocyst transfer. Hum Reprod. 2019;34(6):1011–8. Khosravi P, Kazemi E, Zhan Q, Malmsten JE, Toschi M, Zisimopoulos P, et al. Deep learning enables robust assessment and selection of human blastocysts after in vitro fertilization. NPJ Digit Med. 2019;2:21. Chavez-Badiola A, Flores-Saiffe-Farías A, Mendizabal-Ruiz G, Drakeley AJ, Cohen J. Embryo Ranking Intelligent Classification Algorithm (ERICA): artificial intelligence clinical assistant predicting embryo ploidy and implantation. Reprod BioMed Online. 2020;5:S1472–6483(20)30373-4. Josue Barnes, Jonas Malmsten, Qiansheng Zhan, Iman Hajirasouliha, Olivier Elemento, Jose Sierra, Nikica Zaninovic, Zev Rosenwaks, Noninvasive detection of blastocyst ploidy (euploid vs. aneuploid) using artificial intelligence (AI) with deep learning methods. 2020; 114:e76 https://doi.org/10.1016/j.fertnstert.2020.08.233 Lee CI, Chen CH, Huang CC, Cheng EH, Chen HH, Ho ST, et al. Embryo morphokinetics is potentially associated with clinical outcomes of single-embryo transfers in preimplantation genetic testing for aneuploidy cycles. Reprod BioMed Online. 2019;39(4):569–79. Chen HH, Huang CC, Cheng EH, Lee TH, Chien LF, Lee MS. Optimal timing of blastocyst vitrification after trophectoderm biopsy for preimplantation genetic screening. PLoS One. 2017;12(10):e0185747. Gardner DK, Lane M, Stevens J, Schlenker T, Schoolcraft WB. Blastocyst score affects implantation and pregnancy outcome: towards a single blastocyst transfer. Fertil Steril. 2000;73(6):1155–8. https://doi.org/10.1016/s0015-0282(00)00518-5. Carreira J, Zisserman A (2017). Quo vadis, action recognition? A new model and the kinetics dataset. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 6299-6308) Loshchilov I, Hutter F (2016). Sgdr: stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983 Shorten C, Khoshgoftaar TM. A survey on image data augmentation for deep learning. J Big Data. 2019;6:60. https://doi.org/10.1186/s40537-019-0197-0. Taylor L, Nitschke G. Improving deep learning with generic data augmentation, 2018 IEEE Symposium Series on Computational Intelligence (SSCI). India: Bangalore; 2018. p. 1542–7. https://doi.org/10.1109/SSCI.2018.8628742. Zach C, Pock T, Bischof H. A duality based approach for real time TV-L1 optical flow: Pattern Recognition; 2007. p. 214–23. Chen T-J, Zheng W-L, Liu C-H, Huang I, Lai H-H, Liu M. Using deep learning with large dataset of microscope images to develop an automated embryo grading system. Fertility & Reproduction. 2019;01(01):51–6. Raudonis V, Paulauskaite-Taraseviciene A, Sutiene K, Jonaitis D. Towards the automation of early-stage human embryo development detection. Biomed Eng Online. 2019;18(1):120. Esfandiari N, Bunnell ME, Casper RF. Human embryo mosaicism: did we drop the ball on chromosomal testing? J Assist Reprod Genet. 2016;33(11):1439–44. Lin PY, Lee CI, Cheng EH, Huang CC, Lee TH, Shih HH, et al. Clinical outcomes of single mosaic embryo transfer: high-level or low-level mosaic embryo, does it matter? J Clin Med. 2020;9(6):1695. VerMilyea M, Hall JMM, Diakiw S, Johnston A, Nguyen T Dakka MA, Lim A, Quangkananurug W, Perugini D, Murphy AP, Perugini M. Camera-agnostic self-annotating artificial intelligence (AI) system for blastocyst evaluation, [Abstract].ESHRE Virtual 36th Annual Meeting, July 7, 2020 Lee CI, Cheng EH, Lee MS, Lin PY, Chen YC, Chen CH, et al. Healthy live births from transfer of low-mosaicism embryos after preimplantation genetic testing for aneuploidy. J Assist Reprod Genet. 2020;37(9):2305–13. https://doi.org/10.1007/s10815-020-01876-6. Author information Authors and Affiliations Corresponding author Ethics declarations Conflict of interest M.L. is co-owners of Binflux, a company created to develop Infans EMR, a laboratory information management system for fertility centers, as well as other artificial intelligence technologies designed for reproductive medicine. Additional information Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. Chun-I Lee and Yan-Ru Su are co-first authors. Rights and permissions About this article Cite this article Lee, CI., Su, YR., Chen, CH. et al. End-to-end deep learning for recognition of ploidy status using time-lapse videos. J Assist Reprod Genet 38, 1655–1663 (2021). https://doi.org/10.1007/s10815-021-02228-8 Received: Accepted: Published: Version of record: Issue date: DOI: https://doi.org/10.1007/s10815-021-02228-8