XAI: Focusing on Fertility Assessment

This chapter analyzes the transformative role of Explainable AI (XAI) in healthcare, with a particular emphasis on reproductive health services. It provides an overview of the stages of XAI, the tools used, and evaluation protocols, supplemented by relevant case studies. These case studies demonstrate the significant potential of XAI in areas such as male fertility prediction, embryo selection, maternal health risk assessment, PCOS diagnosis, and endometriosis management, offering promising avenues to enhance reproductive outcomes and address fertility challenges effectively. The findings highlight the critical need for early detection of fertility issues in both men and women through XAI techniques as a proactive measure to mitigate the rising infertility rates. Besides, IVF success rate prediction is identified as a crucial application of XAI, particularly in addressing the financial and emotional stress associated with the high costs and time demands of IVF treatments. These advancements could encourage broader adoption of AI-driven approaches in reproductive medicine. Additionally, the chapter presents an in-depth exploration of XAI’s broader applications in healthcare, focusing on common conditions like cancer, cardiovascular diseases, and Alzheimer’s. By promoting transparency and informed decision-making, XAI is poised to drive innovation, improve clinical outcomes, and raise the overall standard of care within the medical industry. Access this chapter Tax calculation will be finalised at checkout Purchases are for personal use only Similar content being viewed by others

Lee, C. H., Wang, C., Fan, X., Li, F., & Chen, C. H. (2023). Artificial intelligence-enabled digital transformation in elderly healthcare field: Scoping review. Advanced Engineering Informatics, 55, Article 101874. Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., Chatila, R., & Herrera, F. (2020). Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion, 58, 82–115. Schoonderwoerd, T. A., Jorritsma, W., Neerincx, M. A., & Van Den Bosch, K. (2021). Human-centered XAI: Developing design patterns for explanations of clinical decision support systems. International Journal of Human-Computer Studies, 154, Article 102684. Antoniadi, A. M., Du, Y., Guendouz, Y., Wei, L., Mazo, C., Becker, B. A., & Mooney, C. (2021). Current challenges and future opportunities for XAI in machine learning-based clinical decision support systems: A systematic review. Applied Sciences, 11(11), 5088. Pinto-Coelho, L. (2023). How artificial intelligence is shaping medical imaging technology: A survey of innovations and applications. Bioengineering (Basel, Switzerland), 10(12), 1435. https://doi.org/10.3390/bioengineering10121435 Seo, H., Badiei Khuzani, M., Vasudevan, V., Huang, C., Ren, H., Xiao, R., Jia, X., & Xing, L. (2020). Machine learning techniques for biomedical image segmentation: An overview of technical aspects and introduction to state-of-art applications. Medical Physics, 47(5), e148–e167. https://doi.org/10.1002/mp.13649 Hassija, V., Chamola, V., Mahapatra, A., Singal, A., Goel, D., Huang, K., Scardapane, S., Spinelli, I., Mahmud, M., & Hussain, A. (2024). Interpreting black-box models: A review on explainable artificial intelligence. Cognitive Computation, 16(1), 45–74. Hendrickson, R. G. (1984). A survey of sensitivity analysis methodology. Mienye, I. D., Obaido, G., Jere, N., Mienye, E., Aruleba, K., Emmanuel, I. D., & Ogbuokiri, B. (2024). A survey of explainable artificial intelligence in healthcare: Concepts, applications, and challenges. Informatics in Medicine Unlocked, 101587. Weber, L., Lapuschkin, S., Binder, A., & Samek, W. (2023). Beyond explaining: Opportunities and challenges of XAI-based model improvement. Information Fusion, 92, 154–176. Sadeghi, Z., Alizadehsani, R., CIFCI, M. A., Kausar, S., Rehman, R., Mahanta, P., & Pardalos, P. M., et al. (2024). A review of explainable artificial. In S. Bach, A. Binder, G. Montavon, F. Klauschen, K. R. Müller, & W. Samek, (2015). On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PloS one, 10(7), e0130140. Intelligence in healthcare. Computers and Electrical Engineering, 118, 109370. Linardatos, P., Papastefanopoulos, V., & Kotsiantis, S. (2020). Explainable Ai: A review of machine learning interpretability methods. Entropy, 23(1), 18. Habib, G., & Qureshi, S. (2022). Optimization and acceleration of a review of explainable artificial intelligence in healthcare. Convolutional neural networks: A survey. Journal of King Saud University-Computer and Information Sciences, 34(7), 4244–4268. Floridi, L. (2021). Establishing the rules for building trustworthy AI. Ethics, Governance, and Policies in Artificial Intelligence, 41–45. Shams Khoozani, Z., Sabri, A. Q. M., Seng, W. C., Seera, M., & Eg, K. Y. (2024). Navigating the landscape of concept-supported XAI: Challenges, innovations, and future directions. Multimedia Tools and Applications, 1–51. Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K. R., & Samek, W. (2015). On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLoS ONE, 10(7), Article e0130140. Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017). Grad-cam: Visual explanations from deep networks via gradient-based localization. In Proceedings of the IEEE international conference on computer vision (pp. 618–626). Cirqueira, D., Nedbal, D., Helfert, M., & Bezbradica, M. (2020, August). Scenario-based requirements elicitation for user-centric explainable AI: A case in fraud detection. In International cross-domain conference for machine learning and knowledge extraction (pp. 321–341). Springer International Publishing. Alicioglu, G., & Sun, B. (2022). A survey of visual analytics for explainable artificial intelligence methods. Computers & Graphics, 102, 502–520. Kim, B., Wattenberg, M., Gilmer, J., Cai, C., Wexler, J., & Viegas, F. (2018, July). Interpretability beyond feature attribution: Quantitative testing with concept activation vectors (tcav). In International conference on machine learning (pp. 2668–2677). PMLR. Kamal, M. S., Northcote, A., Chowdhury, L., Dey, N., Crespo, R. G., & Herrera-Viedma, E. (2021). Alzheimer’s patient analysis using image and gene expression data and explainable-AI to present associated genes. IEEE Transactions on Instrumentation and Measurement, 70, 1–7. Biffi, C., Cerrolaza, J. J., Tarroni, G., Bai, W., De Marvao, A., Oktay, O., Ledig, C., Le Folgoc, L., Kamnitsas, K., Doumou, G., Duan, J., Prasad, S. K., Cook, S. A., O’Regan, D. P., & Rueckert, D. (2020). Explainable anatomical shape analysis through deep hierarchical generative models. IEEE Transactions on Medical Imaging, 39(6), 2088–2099. Carson, D. L., & Botha, F. C. (2000). Preliminary analysis of expressed sequence tags for sugarcane. Crop Science, 40(6), 1769–1779. Bellamy, R. K., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Natesan Ramamurthy, K., Richards, J., Saha, D., Sattigeri, P., Singh, M., Varshney, K. R., & Zhang, Y. (2019). AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias. IBM Journal of Research and Development, 63(4/5), 4–1. Wexler, J., Pushkarna, M., Bolukbasi, T., Wattenberg, M., Viégas, F., & Wilson, J. (2019). The what-if tool: Interactive probing of machine learning models. IEEE Transactions on Visualization and Computer Graphics, 26(1), 56–65. Zhang, J. D., Xue, C., Kolachalama, V. B., & Donald, W. A. (2023). Interpretable machine learning on metabolomics data reveals biomarkers for parkinson’s disease. ACS Central Science, 9(5), 1035–1045. Kaplan, A., & Haenlein, M. (2019). Siri, Siri, in my hand: Who’s the fairest in the land? On the interpretations, illustrations, and implications of artificial intelligence. Business Horizons, 62(1), 15–25. Kaur, H., Nori, H., Jenkins, S., Caruana, R., Wallach, H., & Wortman Vaughan, J. (2020, April). Interpreting interpretability: understanding data scientists’ use of interpretability tools for machine learning. In Proceedings of the 2020 CHI conference on human factors in computing systems (pp. 1–14). Kawakura, S., Hirafuji, M., Ninomiya, S., & Shibasaki, R. (2022). Adaptations of explainable artificial intelligence (XAI) to agricultural data models with ELI5, PDPbox, and skater using diverse agricultural worker data. European Journal of Artificial Intelligence and Machine Learning, 1(3), 27–34. Zhang, Y., Tiňo, P., Leonardis, A., & Tang, K. (2021). A survey on neural network interpretability. IEEE Transactions on Emerging Topics in Computational Intelligence, 5(5), 726–742. Coroama, L., & Groza, A. (2022, September). Evaluation metrics in explainable artificial intelligence (XAI). In International conference on advanced research in technologies, information, innovation and sustainability (pp. 401–413). Springer Nature Switzerland. Zhang, P., Ma, C., Song, F., Sun, Y., Feng, Y., He, Y., Zhang, T., & Zhang, G. (2023). D2AFNet: A dual-domain attention cascade network for accurate and interpretable atrial fibrillation detection. Biomedical Signal Processing and Control, 82, 104615. Vazquez, B., Fuentes-Pineda, G., Garcia, F., Borrayo, G., & Prohias, J. (2021). Risk markers by sex for in-hospital mortality in patients with acute coronary syndrome: A machine learning approach. Informatics in Medicine Unlocked, 27, Article 100791. Zhang, O., Ding, C., Pereira, T., Xiao, R., Gadhoumi, K., Meisel, K., Lee, R. J., Chen, Y., & Hu, X. (2021). Explain ability metrics of deep convolutional networks for photo plethysmography quality assessment. IEEE Access, 9, 29736–29745. Sangroya, A., Jain, S., Vig, L., Anantaram, C., Ukil, A., & Khandelwal, S. (2022, May). Generating conceptual explanations for DL based ECG classification model. In The international FLAIRS conference proceedings (vol. 35). Pičulin, M., Smole, T., Žunkovič, B., Kokalj, E., Robnik-Šikonja, M., Kukar, M., Fotiadis, D. I., Pezoulas, V. C., Tachos, N. S., Barlocco, F., Mazzarotto, F., … Bosnić, Z. (2022). Disease progression of hypertrophic cardiomyopathy: modeling using machine learning. JMIR Medical Informatics, 10(2), e30483. Nurmaini, S., Partan, R. U., Bernolian, N., Sapitri, A. I., Tutuko, B., Rachmatullah, M. N., Darmawahyuni, A., Firdaus, F., & Mose, J. C. (2022). Deep learning for improving the effectiveness of routine prenatal screening for major congenital heart diseases. Journal of Clinical Medicine, 11(21), 6454. Decoodt, P., Liang, T. J., Bopardikar, S., Santhanam, H., Eyembe, A., Garcia-Zapirain, B., & Sierra-Sosa, D. (2023). Hybrid classical–quantum transfer learning for cardiomegaly detection in chest x-rays. Journal of Imaging, 9(7), 128. Kukar, M., Kononenko, I., & Grošelj, C. (2011). Modern parameterization and explanation techniques in diagnostic decision support system: A case study in diagnostics of coronary artery disease. Artificial Intelligence in Medicine, 52(2), 77–90. Li, R., Yin, C., Yang, S., Qian, B., & Zhang, P. (2020). Marrying medical domain knowledge with deep learning on electronic health records: A deep visual analytics approach. Journal of Medical Internet Research, 22(9), Article e20645. Kwon, B. C., Choi, M. J., Kim, J. T., Choi, E., Kim, Y. B., Kwon, S., Sun, J., & Choo, J. (2018). Retainvis: Visual analytics with interpretable and interactive recurrent neural networks on electronic medical records. IEEE Transactions on Visualization and Computer Graphics, 25(1), 299–309. Jin, Y., Liu, J., Liu, Y., Qin, C., Li, Z., Xiao, D., Zhao, L., & Liu, C. (2021). A novel interpretable method based on dual-level attentional deep neural network for actual multilabel arrhythmia detection. IEEE Transactions on Instrumentation and Measurement, 71, 1–11. Zhang, X., Qian, B., Li, Y., Yin, C., Wang, X., & Zheng, Q. (2019, November). KnowRisk: An interpretable knowledge-guided model for disease risk prediction. In 2019 IEEE international conference on data mining (ICDM) (pp. 1492–1497). IEEE. Bahrami, N., Retson, T., Blansit, K., Wang, K., & Hsiao, A. (2019). Automated selection of myocardial inversion time with a convolutional neural network: Spatial temporal ensemble myocardium inversion network (STEMI-NET). Magnetic Resonance in Medicine, 81(5), 3283–3291. Pérez-Pelegrí, M., Monmeneu, J. V., López-Lereu, M. P., Pérez-Pelegrí, L., Maceira, A. M., Bodí, V., & Moratal, D. (2021). Automatic left ventricle volume calculation with explainability through a deep learning weak-supervision methodology. Computer Methods and Programs in Biomedicine, 208, Article 106275. Halme, H. L., Ihalainen, T., Suomalainen, O., Loimaala, A., Mätzke, S., Uusitalo, V., Sipila, O., & Hippeläinen, E. (2022). Convolutional neural networks for detection of transthyretin amyloidosis in 2D scintigraphy images. EJNMMI Research, 12(1), 27. Attia, Z. I., Lerman, G., & Friedman, P. A. (2021). Deep neural networks learn by using human-selected electrocardiogram features and novel features. European Heart Journal-Digital Health, 2(3), 446–455. Wong, X. Y., Ang, Y. K., Li, K., Chin, Y. H., Lam, S. S. W., Tan, K. B. K., Chua, M. C. H., Ong, M. E. H., Liu, N., Pourghaderi, A. R., Ho, A. F. W., & PAROS Singapore Investigators. (2022). Development and validation of the SARICA score to predict survival after return of spontaneous circulation in out of hospital cardiac arrest using an interpretable machine learning framework. Resuscitation, 170, 126–133. Sager, S., Bernhardt, F., Kehrle, F., Merkert, M., Potschka, A., Meder, B., Katus, H., & Scholz, E. (2021). Expert-enhanced machine learning for cardiac arrhythmia classification. PLoS ONE, 16(12), Article e0261571. Hur, C., Wi, J., & Kim, Y. (2020). Facilitating the development of deep learning models with visual analytics for electronic health records. International Journal of Environmental Research and Public Health, 17(22), 8303. Jones, Y., Deligianni, F., & Dalton, J. (2020, October). Improving ECG classification interpretability using saliency maps. In 2020 IEEE 20th international conference on bioinformatics and bioengineering (BIBE) (pp. 675–682). IEEE. Meng, J., & Xing, R. (2022). Inside the “black box”: Embedding clinical knowledge in data-driven machine learning for heart disease diagnosis. Cardiovascular Digital Health Journal, 3(6), 276–288. Duffy, G., Jain, I., He, B., & Ouyang, D. (2021). Interpretable deep learning prediction of 3d assessment of cardiac function. In Pacific symposium on biocomputing 2022 (pp. 231–241). Yoo, J., Jun, T. J., & Kim, Y. H. (2021). XECGNet: Fine-tuning attention map within convolutional neural network to improve detection and explainability of concurrent cardiac arrhythmias. Computer Methods and Programs in Biomedicine, 208, Article 106281. Prifti, E., Fall, A., Davogustto, G., Pulini, A., Denjoy, I., Funck-Brentano, C., Khan, Y., Durand-Salmon, A., Badilini, F., Wells, Q. S., Leenhardt, A., … Salem, J. E. (2021). Deep learning analysis of electrocardiogram for risk prediction of drug-induced arrhythmias and diagnosis of long QT syndrome. European Heart Journal, 42(38), 3948–3961. Pham, T. H., Yin, C., Mehta, L., Zhang, X., & Zhang, P. (2023). A fair and interpretable network for clinical risk prediction: A regularized multi-view multi-task learning approach. Knowledge and Information Systems, 65(4), 1487–1521. Kwon, J. M., Kim, K. H., Medina-Inojosa, J., Jeon, K. H., Park, J., & Oh, B. H. (2020). Artificial intelligence for early prediction of pulmonary hypertension using electrocardiography. The Journal of Heart and Lung Transplantation, 39(8), 805–814. Abdullah, T. A., Zahid, M. S. M., Ali, W., & Hassan, S. U. (2023). B-LIME: An improvement of LIME for interpretable deep learning classification of cardiac arrhythmia from ECG signals. Processes, 11(2), 595. Karoui, A., Bendahmane, M., & Zemzemi, N. (2021). Cardiac activation maps reconstruction: A comparative study between data-driven and physics-based methods. Frontiers in Physiology, 12, Article 686136. van der Wall, H. E., Hassing, G. J., Doll, R. J., van Westen, G. J., Cohen, A. F., Selder, J. L., Kemme, M., Burggraaf, M., & Gal, P. (2022). Cardiac age detected by machine learning applied to the surface ECG of healthy subjects: Creation of a benchmark. Journal of Electrocardiology, 72, 49–55. Wang, Y., Chen, W., Tang, T., Xie, W., Jiang, Y., Zhang, H., Zhou, X., & Yuan, K. (2022). Cardiac segmentation method based on domain knowledge. Ultrasonic Imaging, 44(2–3), 105–117. Tsuji, T., Hirata, Y., Kusunose, K., Sata, M., Kumagai, S., Shiraishi, K., & Kotoku, J. I. (2023). Classification of chest X-ray images by incorporation of medical domain knowledge into operation branch networks. BMC Medical Imaging, 23(1), 62. Dakshit, S., Maweu, B. M., Dakshit, S., & Prabhakaran, B. (2022, June). Core-set selection using metrics-based explanations (CSUME) for multiclass ECG. In 2022 IEEE 10th international conference on healthcare informatics (ICHI) (pp. 217–225). IEEE. Kofler, A., Pali, M. C., Schaeffter, T., & Kolbitsch, C. (2023). Deep supervised dictionary learning by algorithm unrolling—Application to fast 2D dynamic MR image reconstruction. Medical Physics, 50(5), 2939–2960. van de Leur, R. R., Taha, K., Bos, M. N., van der Heijden, J. F., Gupta, D., Cramer, M. J., Hassink, R. J., van der Harst, P., Doevendans, P. A., Asselbergs, F. W., & van Es, R. (2021). Discovering and visualizing disease-specific electrocardiogram features using deep learning: Proof-of-concept in phospholamban gene mutation carriers. Circulation: Arrhythmia and Electrophysiology, 14(2), e009056. Mokhtari, M., Tsang, T., Abolmaesumi, P., & Liao, R. (2022, September). EchoGNN: explainable ejection fraction estimation with graph neural networks. In International conference on medical image computing and computer-assisted intervention (pp. 360–369). Springer Nature Switzerland. Tang, Q., Cen, X., & Pan, C. (2022). Explainable and efficient deep early warning system for cardiac arrest prediction from electronic health records. Mathematical Biosciences and Engineering, 19, 9825–9841. Ganeshkumar, M., Ravi, V., Sowmya, V., Gopalakrishnan, E. A., & Soman, K. P. (2021). Explainable deep learning-based approach for multilabel classification of electrocardiogram. IEEE Transactions on Engineering Management, 70(8), 2787–2799. Ogbomo-Harmitt, S., Muffoletto, M., Zeidan, A., Qureshi, A., King, A. P., & Aslanidi, O. (2023). Exploring interpretability in deep learning prediction of successful ablation therapy for atrial fibrillation. Frontiers in Physiology, 14, 1054401. Panicacci, S., Donati, M., Fanucci, L., Bellini, I., Profili, F., & Francesconi, P. (2019, June). Exploring machine learning algorithms to identify heart failure patients: the tuscany region case study. In 2019 IEEE 32nd international symposium on computer-based medical systems (CBMS) (pp. 417–422). IEEE. Clough, J. R., Oksuz, I., Puyol-Antón, E., Ruijsink, B., King, A. P., & Schnabel, J. A. (2019, October). Global and local interpretability for cardiac MRI classification. In International conference on medical image computing and computer-assisted intervention (pp. 656–664). Springer International Publishing. Beetz, M., Corral Acero, J., Banerjee, A., Eitel, I., Zacur, E., Lange, T., Stiermaier, T., Evertz, R., Backhaus, S. J., Thiele, H., Bueno-Orovio, A., Lamata, P., Schuster, A. & Grau, V. (2022). Interpretable cardiac anatomy modeling using variational mesh autoencoders. Frontiers in Cardiovascular Medicine, 9, 983868. Singh, P., & Sharma, A. (2022). Interpretation and classification of arrhythmia using deep convolutional network. IEEE Transactions on Instrumentation and Measurement, 71, 1–12. Le, K. H., Pham, H. H., Nguyen, T. B., Nguyen, T. A., Thanh, T. N., & Do, C. D. (2023). Lightx3ecg: A lightweight and explainable deep learning system for 3-lead electrocardiogram classification. Biomedical Signal Processing and Control, 85, Article 104963. Karri, R., Kawai, A., Thong, Y. J., Ramson, D. M., Perry, L. A., Segal, R., Smith, J. A., & Penny-Dimri, J. C. (2021). Machine learning outperforms existing clinical scoring tools in the prediction of postoperative atrial fibrillation during intensive care unit admission after cardiac surgery. Heart, Lung and Circulation, 30(12), 1929–1937. Sakai, A., Komatsu, M., Komatsu, R., Matsuoka, R., Yasutomi, S., Dozen, A., Shozu, K., Arakaki, T., Machino, H., Asada, K., Kaneko, S., Sekizawa, A., & Hamamoto, R. (2022). Medical professional enhancement using explainable artificial intelligence in fetal cardiac ultrasound screening. Biomedicines, 10(3), 551. Huynh, J., Masoudi, S., Noorbakhsh, A., Mahmoodi, A., Kligerman, S., Yen, A., Jacobs, K., Hahn, L., Hasenstab, K., Pazzani, M., & Hsiao, A. (2022). Deep learning radiographic assessment of pulmonary edema: Optimizing clinical performance, training with serum biomarkers. IEEE Access, 10, 48577–48588. Salih, A. M., Galazzo, I. B., Gkontra, P., Rauseo, E., Lee, A. M., Lekadir, K., Radeva, P., Petersen, S. E., & Menegaz, G. (2024). A review of evaluation approaches for explainable AI with applications in cardiology. Artificial Intelligence Review, 57(9), 240. De Santi, L. A., Pasini, E., Santarelli, M. F., Genovesi, D., & Positano, V. (2023). An explainable convolutional neural network for the early diagnosis of Alzheimer’s disease from 18F-FDG PET. Journal of Digital Imaging, 36(1), 189–203. Shad, H. A., Rahman, Q. A., Asad, N. B., Bakshi, A. Z., Mursalin, S. F., Reza, M. T., & Parvez, M. Z. (2021, December). Exploring Alzheimer's disease prediction with XAI in various neural network models. In TENCON 2021–2021 IEEE region 10 conference (TENCON) (pp. 720–725). IEEE. Sidulova, M., Nehme, N., & Park, C. H. (2021, October). Towards explainable image analysis for Alzheimer's disease and mild cognitive impairment diagnosis. In 2021 IEEE applied imagery pattern recognition workshop (AIPR) (pp. 1–6). IEEE. Ilias, L., & Askounis, D. (2022). Interpretability of deep neural networks used for the diagnosis of Alzheimer’s disease. IEEE Journal of Biomedical and Health Informatics, 26(8), 4153–4164. Duamwan, L. M., & Bird, J. J. (2023, July). Explainable AI for medical image processing: a study on MRI in Alzheimer’s disease. In Proceedings of the 16th international conference on pervasive technologies related to assistive environments (pp. 480–484). El-Sappagh, S., Alonso, J. M., Islam, S. R., Sultan, A. M., & Kwak, K. S. (2021). A multilayer multimodal detection and prediction model based on explainable artificial intelligence for Alzheimer’s disease. Scientific Reports, 11(1), 2660. Bloch, L., Friedrich, C. M., & Alzheimer’s Disease Neuroimaging Initiative. (2021). Data analysis with Shapley values for automatic subject selection in Alzheimer’s disease data sets using interpretable machine learning. Alzheimer's Research & Therapy, 13, 1–30. Hernandez, M., Ramon-Julvez, U., Ferraz, F., & with the ADNI Consortium. (2022). Explainable AI toward understanding the performance of the top three TADPOLE challenge methods in the forecast of Alzheimer’s disease diagnosis. PloS one, 17(5), e0264695. Lai, Y., Lin, X., Lin, C., Lin, X., Chen, Z., & Zhang, L. (2022). Identification of endoplasmic reticulum stress-associated genes and subtypes for prediction of Alzheimer’s disease based on interpretable machine learning. Frontiers in Pharmacology, 13, Article 975774. Bogdanovic, B., Eftimov, T., & Simjanoska, M. (2022). In-depth insights into Alzheimer’s disease by using explainable machine learning approach. Scientific Reports, 12(1), 6508. Chun, M. Y., Park, C. J., Kim, J., Jeong, J. H., Jang, H., Kim, K., & Seo, S. W. (2022). Prediction of conversion to dementia using interpretable machine learning in patients with amnestic mild cognitive impairment. Frontiers in Aging Neuroscience, 14, Article 898940. Xu, X., & Yan, X. (2022, August). A convenient and reliable multi-class classification model based on explainable artificial intelligence for Alzheimer’s disease. In 2022 IEEE international conference on advances in electrical engineering and computer applications (AEECA) (pp. 671–675). IEEE. (101). Salih, A., Galazzo, I. B., Cruciani, F., Brusini, L., & Radeva, P. (2022, October). Investigating explainable artificial intelligence for MRI-based classification of dementia: a new stability criterion for explainable methods. In 2022 IEEE international conference on image processing (ICIP) (pp. 4003–4007). IEEE. Danso, S. O., Zeng, Z., Muniz-Terrera, G., & Ritchie, C. W. (2021). Developing an explainable machine learning-based personalised dementia risk prediction model: A transfer learning approach with ensemble learning algorithms. Frontiers in Big Data, 4, Article 613047. Yilmaz, D. (2023, September). Development and evaluation of an explainable diagnostic AI for Alzheimer's disease. In 2023 international conference on artificial intelligence science and applications in industry and society (CAISAIS) (pp. 1–6). IEEE. Rahim, N., El-Sappagh, S., Ali, S., Muhammad, K., Del Ser, J., & Abuhmed, T. (2023). Prediction of Alzheimer’s progression based on multimodal deep-learning-based fusion and visual explainability of time-series data. Information Fusion, 92, 363–388. Yi, F., Yang, H., Chen, D., Qin, Y., Han, H., Cui, J., Bai, W., Ma, Y., Zhang, R., & Yu, H. (2023). XGBoost-SHAP-based interpretable diagnostic framework for alzheimer’s disease. BMC medical informatics and decision making, 23(1), 137. Loveleen, G., Mohan, B., Shikhar, B. S., Nz, J., Shorfuzzaman, M., & Masud, M. (2023). Explanation-driven HCI model to examine the mini-mental state for Alzheimer’s disease. ACM Transactions on Multimedia Computing, Communications and Applications, 20(2), 1–16. Rashmi, U., Singh T., & Ambesange, S. (2023). MRI image-based ensemble voting classifier for Alzheimers disease classification with explainable AI technique. 2023 IEEE 8th international conference for convergence in technology (I2CT), Lonavla, India, pp. 1–6, https://doi.org/10.1109/I2CT57861.2023.10126269. Viswan, V., Shaffi, N., Mahmud, M., Subramanian, K., & Hajamohideen, F. (2024). Explainable artificial intelligence in Alzheimer’s disease classification: A systematic review. Cognitive Computation, 16(1), 1–44. Hasan Saif, F., Al-Andoli, M. N., & Bejuri, W. M. Y. W. (2024). Explainable AI for Alzheimer detection: A review of current methods and applications. Applied Sciences, 14(22), 10121. Shen, S., Han, S. X., Aberle, D. R., Bui, A. A., & Hsu, W. (2019). An interpretable deep hierarchical semantic convolutional neural network for lung nodule malignancy classification. Expert Systems with Applications, 128, 84–95. Kumar, D., Sankar, V., Clausi, D., Taylor, G. W., & Wong, A. (2019). Sisc: End-to-end interpretable discovery radiomics-driven lung cancer prediction via stacked interpretable sequencing cells. IEEE Access, 7, 145444–145454. Xi, P., Shu, C., & Goubran, R. (2018, June). Abnormality detection in mammography using deep convolutional neural networks. In 2018 IEEE international symposium on medical measurements and applications (MeMeA) (pp. 1–6). IEEE. Windisch, P., Weber, P., Fürweger, C., Ehret, F., Kufeld, M., Zwahlen, D., & Muacevic, A. (2020). Implementation of model explainability for a basic brain tumor detection using convolutional neural networks on MRI slices. Neuroradiology, 62, 1515–1518. Yang, X., Wang, Z., Liu, C., Le, H. M., Chen, J., Cheng, K. T., & Wang, L. (2017). Joint detection and diagnosis of prostate cancer in multi-parametric MRI based on multimodal convolutional neural networks. In Medical image computing and computer assisted intervention− MICCAI 2017: 20th international conference, Quebec City, QC, Canada, September 11–13, 2017, proceedings, Part III 20 (pp. 426–434). Springer International Publishing. Gulum, M. A., Trombley, C. M., & Kantardzic, M. (2021). Multiple interpretations improve deep learning transparency for prostate lesion detection. In Heterogeneous data management, polystores, and analytics for healthcare: VLDB workshops, poly 2020 and DMAH 2020, virtual event, august 31 and September 4, 2020, Revised Selected Papers 6 (pp. 120–137). Springer International Publishing. Venugopal, V. K., Vaidhya, K., Murugavel, M., Chunduru, A., Mahajan, V., Vaidya, S., Mahra, D., Rangasai, A., & Mahajan, H. (2020). Unboxing AI-radiological insights into a deep neural network for lung nodule characterization. Academic Radiology, 27(1), 88–95. Zhen, S. H., Cheng, M., Tao, Y. B., Wang, Y. F., Juengpanich, S., Jiang, Z. Y., Jiang, Y. K., Yan, Y. Y., Lu, W., Lue, J. M., & Cai, X. J. (2020). Deep learning for accurate diagnosis of liver tumor based on magnetic resonance imaging and clinical data. Frontiers in Oncology, 10, 680. Wang, C. J., Hamm, C. A., Savic, L. J., Ferrante, M., Schobert, I., Schlachter, T., Lin, M., Weinreb, J. C., Duncan, J. S., Chapiro, J., & Letzen, B. (2019). Deep learning for liver tumor diagnosis part II: convolutional neural network interpretation using radiologic imaging features. European Radiology, 29, 3348–3357. Papanastasopoulos, Z., Samala, R. K., Chan, H. P., Hadjiiski, L., Paramagul, C., Helvie, M. A., & Neal, C. H. (2020, March). Explainable AI for medical imaging: deep-learning CNN ensemble for classification of estrogen receptor status from breast MRI. In Medical imaging 2020: Computer-aided diagnosis (vol. 11314, pp. 228–235). SPIE. Afshar, P., Plataniotis, K. N., & Mohammadi, A. (2019, September). Capsule networks’ interpretability for brain tumor classification via radiomics analyses. In 2019 IEEE international conference on image processing (ICIP) (pp. 3816–3820). IEEE. LaLonde, R., Torigian, D., & Bagci, U. (2020). Encoding visual attributes in capsules for explainable medical diagnoses. In Medical image computing and computer assisted intervention–MICCAI 2020: 23rd international conference, Lima, Peru, October 4–8, 2020, Proceedings, Part I 23 (pp. 294–304). Springer International Publishing. Pintelas, E., Liaskos, M., Livieris, I. E., Kotsiantis, S., & Pintelas, P. (2020). Explainable machine learning framework for image classification problems: Case study on glioma cancer prediction. Journal of Imaging, 6(6), 37. Blendowski, M., & Heinrich, M. P. (2019, May). Learning interpretable multi-modal features for alignment with supervised iterative descent. In International conference on medical imaging with deep learning (pp. 73–83). PMLR. Munshi, R. M., Cascone, L., Alturki, N., Saidani, O., Alshardan, A., & Umer, M. (2024). A novel approach for breast cancer detection using optimized ensemble learning framework and XAI. Image and Vision Computing, 142, Article 104910. Wani, N. A., Kumar, R., & Bedi, J. (2024). DeepXplainer: An interpretable deep learning based approach for lung cancer detection using explainable artificial intelligence. Computer Methods and Programs in Biomedicine, 243, Article 107879. Silva-Aravena, F., Núñez Delafuente, H., Gutiérrez-Bahamondes, J. H., & Morales, J. (2023). A hybrid algorithm of ML and XAI to prevent breast cancer: A strategy to support decision making. Cancers, 15(9), 2443. Singhal, A., Agrawal, K. K., Quezada, A., Aguiñaga, A. R., Jiménez, S., & Yadav, S. P. (2024). Explainable artificial intelligence (XAI) model for cancer image classification. CMES-Computer Modeling in Engineering & Sciences, 141(1). Khater, T., Hussain, A., Mahmoud, S., & Yasen, S. (2023, December). Explainable AI for breast cancer detection: A LIME-Driven approach. In 2023 16th international conference on developments in eSystems engineering (DeSE) (pp. 540–545). IEEE. Nitha, V. R., & SS, V. C. (2025). An explainable machine learning framework for predicting the impact of pesticide exposure in lung cancer prognosis. Journal of Computational Science, 84, 102476. Cimino, M. G., Campisi, G., Galatolo, F. A., Neri, P., Tozzo, P., Parola, M., ... & Di Fede, O. (2025). Explainable screening of oral cancer via deep learning and case-based reasoning. Smart Health, 100538. Hauser, K., Kurz, A., Haggenmüller, S., Maron, R. C., von Kalle, C., Utikal, J. S., Meier, F., Hobelsberger, S., Gellrich, F. F., Sergon, M., Hauschild, A., … & Brinker, T. J. (2022). Explainable artificial intelligence in skin cancer recognition: A systematic review. European Journal of Cancer, 167, 54–69. Ghasemi, A., Hashtarkhani, S., Schwartz, D. L., & Shaban-Nejad, A. (2024). Explainable artificial intelligence in breast cancer detection and risk prediction: A systematic scoping review. Cancer Innovation, 3(5), Article e136. Karthiga, R., Narasimhan, K., & Amirtharajan, R. (2024). Review of AI & XAI-based breast cancer diagnosis methods using various imaging modalities. Multimedia Tools and Applications, 1–52. GhoshRoy, D., Alvi, P. A., & Santosh, K. C. (2023, March). Unboxing industry-standard AI models for male fertility prediction with SHAP. In Healthcare (vol. 11, No. 7, p. 929). MDPI. GhoshRoy, D., Alvi, P. A., & Santosh, K. C. (2022). Explainable AI to predict male fertility using extreme gradient boosting algorithm with SMOTE. Electronics, 12(1), 15. Xu, F., Ma, Q., Lai, P., Hu, L., Gao, C., Xu, Q., Fang, Y., Guo, Y., Yao, W., & Zhang, C. (2024). An explainable machine learning model based on ultrasound for predicting reproductive outcomes after frozen embryo transfer. Reproductive BioMedicine Online, 104743. Lee, T., Natalwala, J., Chapple, V., & Liu, Y. (2024). A brief history of artificial intelligence embryo selection: From black-box to glass-box. Human Reproduction, 39(2), 285–292. Mohammed, K., & Shehu, A. (2023). A review of artificial intelligence (Ai) challenges and future prospects of explainable AI in major fields: A case study of Nigeria. Open Journal of Physical Science (ISSN: 2734–2123), 4(1), 1–18. Curchoe, C. L., Malmsten, J., Bormann, C., Shafiee, H., Farias, A. F. S., Mendizabal, G., Chavez-Badiola, A., Sigaras, A., Alshubbar, H., Chambost, J., Jacques, C., … Rosenwaks, Z. (2020). Predictive modeling in reproductive medicine: Where will the future of artificial intelligence research take us?. Fertility and Sterility, 114(5), 934–940. Hanassab, S., Nelson, S. M., Akbarov, A., Yeung, A. C., Hramyka, A., Alhamwi, T., Salim, R., Comninos, A. N., Trew, G. H., Kelsey, T. W., Heinis, T., … Abbara, A. (2025). Explainable artificial intelligence to identify follicles that optimize clinical outcomes during assisted conception. Nature Communications, 16(1), 296. Hanassab, S., Nelson, S. M., Akbarov, A., Yeung, A. C., Hramyka, A., Alhamwi, T., Salim, R., Comninos, A. N., Trew, G. H., Kelsey, T. W., Heinis, T., … Abbara, A. (2024). O-219 Explainable artificial intelligence (XAI) to determine the follicle sizes on trigger day that maximize mature oocyte yield. Human Reproduction, 39(Supplement_1), deae108–258. Afnan, M. A. M., Liu, Y., Conitzer, V., Rudin, C., Mishra, A., Savulescu, J., & Afnan, M. (2021). Interpretable, not black-box, artificial intelligence should be used for embryo selection. Human Reproduction Open, 2021(4), hoab040. Sharma, A., Stensen, M. H., Delbarre, E., Haugen, T. B., & Hammer, H. L. (2022, June). Explainable artificial intelligence for human embryo cell cleavage stages analysis. In Proceedings of the 3rd ACM workshop on intelligent cross-data analysis and retrieval (pp. 1–8). Setegn, G. M., & Dejene, B. E. (2024). Explainable artificial intelligence models for predicting pregnancy termination among reproductive-aged women in six east African countries: Machine learning approach. BMC Pregnancy and Childbirth, 24(1), 600. Luong, T. M. T., Ho, N. T., Hwu, Y. M., Lin, S. Y., Ho, J. Y. P., Wang, R. S., Lee, Y. X., Tan, S. J., Lee, Y. R., Huang, Y. L., Hsu, Y. C., … Tzeng, C. R. (2024). Beyond black-box models: explainable AI for embryo ploidy prediction and patient-centric consultation. Journal of Assisted Reproduction and Genetics, 41(9), 2349–2358. Nwokoro, C. O., Inyang, U. G., Eyoh, I. J., Umoh, U. A., Duke, O. A., Nwokoro, K. C., Opara, P. I., Obinachi, C., & Kingsley, J. U. (2023). Enhancing maternal outcome prediction using explainable artificial intelligence for women of childbearing age. Asian Journal of Science and Applied Technology, 12(2), 44–55. Rahman, A., & Alam, M. G. R. (2023, June). Explainable AI based maternal health risk prediction using machine learning and deep learning. In 2023 IEEE World AI IoT Congress (AIIoT) (pp. 0013–0018). IEEE. Valencia, R., Farías, A. F. S., Mendizabal, G., Chavez-Badiola, A., & Gomez, F. J. A. (2022). Towards an explainable artificial intelligence to predict blastocyst formation potential from single oocyte images. Fertility and Sterility, 118(4), e337–e338. Kebede, S. D., Abera, K. M., Abeje, E. T., Bekele Enyew, E., Daba, C., Asmare, L., Demeke Bayou, F., Arefaynie, M., Mohammed, A., Tareke, A. A., Keleb, A., Kebede, N., Tsega, Y., & Endawkie, A. (2024). Explainable machine learning for modeling predictors of unintended pregnancy among married/in-union women in sub-Saharan Africa, a multi-country analysis of MICS 6 survey. Digital Health, 10, 20552076241292976. https://doi.org/10.1177/20552076241292978 Jain, P., Mishra, R. K., Deep, A., & Jain, N. K. (2024). Xplainable AI for deep learning model on PCOD analysis. In XAI Based Intelligent Systems for Society 5.0 (pp. 131–152). Elsevier. Çiçek, İB., Küçükakçalı, Z., & Yağın, F. H. (2021). Detection of risk factors of PCOS patients with local interpretable model-agnostic explanations (LIME) method that an explainable artificial intelligence model. The Journal of Cognitive Systems, 6(2), 59–63. Moral, P., Mustafi, D., & Sahana, S. K. (2024). PODBoost: An explainable AI model for polycystic ovarian syndrome detection using grey wolf-based feature selection approach. Neural Computing and Applications, 36(30), 18627–18644. Khanna, V. V., Chadaga, K., Sampathila, N., Prabhu, S., Bhandage, V., & Hegde, G. K. (2023). A distinctive explainable machine learning framework for detection of polycystic ovary syndrome. Applied System Innovation, 6(2), 32. Dewanjee, S., Muntaha, S., & Uddin, M. N. An XAI-Integrated BiLSTM-GRU-CNN framework for early polycystic ovary syndrome detection. Mahesswari, G. U., & Maheswari, P. U. SmartScanPCOS: A feature-driven approach to cutting-edge prediction of polycystic ovary syndrome using machine learning and explainable artificial intelligence. Elmannai, H., El-Rashidy, N., Mashal, I., Alohali, M. A., Farag, S., El-Sappagh, S., & Saleh, H. (2023). Polycystic ovary syndrome detection machine learning model based on optimized feature selection and explainable artificial intelligence. Diagnostics, 13(8), 1506. Author information Authors and Affiliations Corresponding author Rights and permissions Copyright information © 2026 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. About this chapter Cite this chapter Santosh, K., Roy, D.G. (2026). XAI: Focusing on Fertility Assessment. In: Artificial Intelligence for Human Fertility: Trends, Insights, and Predictions. Studies in Computational Intelligence, vol 1230. Springer, Singapore. https://doi.org/10.1007/978-981-95-1248-5_5 Download citation DOI: https://doi.org/10.1007/978-981-95-1248-5_5 Published: Publisher Name: Springer, Singapore Print ISBN: 978-981-95-1247-8 Online ISBN: 978-981-95-1248-5 eBook Packages: Artificial Intelligence (R0)