A deep learning and graph-based approach to characterise the immunological landscape and spatial architecture of colon cancer tissue
preprint
OA: closed
CC-BY-NC-4.0
Abstract
ABSTRACT Tumour immunity is key for the prognosis and treatment of colon adenocarcinoma, but its characterisation remains cumbersome and expensive, requiring sequencing or other complex assays. Detecting tumour-infiltrating lymphocytes in haematoxylin and eosin (H&E) slides of cancer tissue would provide a cost-effective alternative to support clinicians in treatment decisions, but inter- and intra-observer variability can arise even amongst experienced pathologists. Furthermore, the compounded effect of other cells in the tumour microenvironment is challenging to quantify but could yield useful additional biomarkers. We combined RNA sequencing, digital pathology and deep learning through the InceptionV3 architecture to develop a fully automated computer vision model that detects prognostic tumour immunity levels in H&E slides of colon adenocarcinoma with an area under the curve (AUC) of 82%. Amongst tumour infiltrating T cell subsets, we demonstrate that CD8+ effector memory T cell patterns are most recognisable algorithmically with an average AUC of 83%. We subsequently applied nuclear segmentation and classification via HoVer-Net to derive complex cell-cell interaction graphs, which we queried efficiently through a bespoke Neo4J graph database. This uncovered stromal barriers and lymphocyte triplets that could act as structural hallmarks of low immunity tumours with poor prognosis. Our integrated deep learning and graph-based workflow provides evidence for the feasibility of automated detection of complex immune cytotoxicity patterns within H&E-stained colon cancer slides, which could inform new cellular biomarkers and support treatment management of this disease in the future.
My notes (saved in your browser only)
Citation neighborhood (no data yet)
We don't have any in-corpus citations linked to this paper yet. The paper's references may be in our DB but unresolved to ``paper_id`` (resolution happens at ingest when the cited DOI matches a row we already have). Run the cross-source citation reconcile pass to retry.
References (51)
- doi:10.1007/s11605-015-2759-6 via crossref
- doi:10.1126/science.1129139 via crossref
- doi:10.1016/j.coph.2013.04.006 via crossref
- doi:10.1200/jco.1996.14.5.1690 via crossref
- doi:10.1007/s00262-003-0388-5 via crossref
- doi:10.1002/path.4287 via crossref
- doi:10.1158/1078-0432.ccr-18-1851 via crossref
- doi:10.1200/jco.19.03205 via crossref
- doi:10.1038/modpathol.2017.43 via crossref
- doi:10.1007/s00428-012-1232-0 via crossref
- doi:10.1016/j.jviromet.2015.06.004 via crossref
- doi:10.1016/j.celrep.2018.03.086 via crossref
- doi:10.1038/s41523-020-0154-2 via crossref
- doi:10.1038/s41598-020-60255-4 via crossref
- doi:10.1186/s12964-020-0530-4 via crossref
- doi:10.1038/s41416-020-01172-1 via crossref
- doi:10.1371/journal.pmed.1002730 via crossref
- doi:10.7554/elife.36967 via crossref
- doi:10.1016/j.meomic.2021.100008 via crossref
- doi:10.1098/rsif.2014.1153 via crossref
- doi:10.1093/jnci/djx137 via crossref
- doi:10.1038/s41698-022-00277-5 via crossref
- doi:10.1038/s41591-020-0900-x via crossref
- doi:10.1016/s2589-7500(21)00180-1 via crossref
- doi:10.1038/nmeth.3337 via crossref
- doi:10.1158/0008-5472.can-18-3560 via crossref
- doi:10.1038/s41467-020-17678-4 via crossref
- doi:10.1038/s41568-020-0272-z via crossref
- doi:10.1016/j.ccell.2018.03.010 via crossref
- doi:10.1038/nm.3967 via crossref
- doi:10.1126/science.aaf8399 via crossref
- doi:10.1186/s13073-019-0684-0 via crossref
- doi:10.1053/j.gastro.2009.12.064 via crossref
- doi:10.1038/nri.2015.10 via crossref
- doi:10.1016/j.media.2019.101563 via crossref
- doi:10.1038/s41573-018-0007-y via crossref
- doi:10.1152/ajpgi.00416.2017 via crossref
- doi:10.3389/fimmu.2021.749459 via crossref
- doi:10.1016/j.tranon.2020.100921 via crossref
- doi:10.1158/1078-0432.ccr-20-0071 via crossref
- doi:10.1136/gutjnl-2019-319292 via crossref
- doi:10.1053/j.gastro.2020.06.021 via crossref
- doi:10.1038/s41591-019-0462-y via crossref
- doi:10.1093/annonc/mdt593 via crossref
- doi:10.1186/s12864-021-07581-7 via crossref
- doi:10.1109/isbi.2009.5193250 via crossref
- doi:10.1109/cvpr.2009.5206848 via crossref
- doi:10.1158/0008-5472.can-19-2268 via crossref
- doi:10.1038/s41588-020-0636-z via crossref
- doi:10.1186/s13059-017-1382-0 via crossref
- doi:10.1038/s41592-021-01358-2 via crossref
Source provenance
- crossref
- last seen: 2026-06-01T01:00:41.904240+00:00
- europepmc
- last seen: 2026-05-19T01:45:01.086888+00:00
- unpaywall
- last seen: 2026-05-21T05:10:58.409756+00:00
License: CC-BY-NC-4.0