Transforming Clinical Workflows with Spatial Reasoning AI: A Scoping Review of Real-Time Systems and Architectures

preprint OA: closed CC-BY-4.0
📄 Open PDF Full text JSON View at publisher

Abstract

Abstract Background: Spatial Reasoning AI (SRAI) systems are reshaping clinical practice by enabling real-time interpretation of complex anatomical structures in medical imaging, surgery, and chronic disease management (Lin et al., 2023, Qiao et al., 2021; Song et al., 2024) . Unlike traditional AI approaches that rely on tabular or 2D data, SRAI models incorporate geometric priors, multimodal fusion, and 3D anatomical reasoning to support high-impact tasks such as volumetric segmentation, disease localization, and intraoperative guidance (Milletari et al., 2016; Hatamizadeh et al., 2022; Zhang et al., 2022) . Objective: This scoping review aimed to (1) characterize the emerging landscape of spatial reasoning models in healthcare, (2) evaluate their clinical performance across diagnostic and prognostic applications, and (3) identify architectural trends that underpin successful translation into practice. Methods: Following PRISMA guidelines, we systematically screened PubMed to identify studies that implemented spatially aware AI models with real-time or clinically validated outcomes (Page et al., 2021) . Data extraction captured model architecture, modality, anatomical scope, clinical application, and performance metrics. Results: We identified 124 eligible studies across the clinical domains of oncology, neurology, cardiology, orthopedic surgery, and infectious diseases (Nie et al., 2019; Hao et al., 2020; Tasken et al., 2023) . SRAI systems consistently outperformed conventional methods in segmentation, lesion classification, and risk stratification. (Lin et al., 2023; Qiao et al., 2021; Mahootiha et al., 2024) . A paradigm shift from task-specific CNNs to foundation models that reason across spatial structures has emerged, beginning with adaptations of generalist models such as MedSAM and MedCLIP for zero-shot segmentation and cross-modal retrieval, and NeRF-based reconstruction for anatomically faithful 3D modeling (Ma et al., 2024; Mildenhall et al., 2020; Radford et al., 2021). Beyond technical performance, randomized evidence shows that SRAI systems can improve workflow efficiency without compromising outcomes (Lang et al., 2023) . Conclusion: SRAI models hold promise for enhancing diagnostic accuracy, prognostic precision, and clinical efficiency across diverse applications. Their successful integration will depend on standardized evaluation metrics, robust validation, and interpretable outputs. As foundation models evolve to better encode spatial priors, SRAI is poised to become a cornerstone of personalized and procedural medicine.
Full text 17,330 characters · extracted from preprint-html · click to expand
Spatial Reasoning AI in Clinical Workflows: A Scoping Review of Translational Applications | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Systematic Review Spatial Reasoning AI in Clinical Workflows: A Scoping Review of Translational Applications Bruce C. Xu, Arnold Lee, James Jose, Shant Ayanian, Ray Qian, and 2 more This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-7511758/v2 This work is licensed under a CC BY 4.0 License Status: Posted Version 2 posted You are reading this latest preprint version Show more versions Abstract Background: Spatial Reasoning AI (SRAI) systems are emerging as a transformative class of clinical artificial intelligence, enabling real-time interpretation of complex anatomy in imaging, surgery, and chronic disease management. Unlike traditional AI approaches constrained to tabular or 2D inputs, SRAI models incorporate geometric priors, multimodal fusion, and 3D anatomical reasoning to support high-impact tasks such as volumetric segmentation, lesion localization, intraoperative guidance, and prognostic modeling. Objective: This scoping review aimed to (1) map the emerging landscape of SRAI in healthcare, (2) assess its clinical performance across diagnostic, prognostic, and workflow applications, and (3) identify opportunities and barriers for safe translation into practice. Methods: Following PRISMA 2020 guidelines, we systematically searched PubMed, Springer Nature, and IEEE Xplore (including CVPR, ICCV, ISBI, and EMBC) for original studies implementing spatially aware AI models with clinical validation or workflow relevance. Data extraction captured model architecture, input modality, anatomical scope, application domain, and performance outcomes. Results: We identified eligible studies spanning oncology, neurology, cardiology, surgery, and infectious diseases. SRAI systems consistently outperformed conventional methods in segmentation, lesion classification, and risk stratification. A paradigm shift is underway from task-specific CNNs to foundation-level models, including MedSAM and MedCLIP for zero-shot segmentation and retrieval, and NeRF-based pipelines for anatomically faithful 3D reconstruction. Randomized evidence shows that SRAI can improve workflow efficiency without compromising diagnostic accuracy. Conclusion: SRAI models demonstrate strong potential to advance diagnostic precision, prognostic accuracy, and workflow integration across multiple clinical domains. Their safe adoption will require standardized evaluation metrics, prospective multi-institutional validation, and interpretable outputs. As foundation models evolve to better encode spatial priors, SRAI is poised to become a cornerstone of workflow-integrated precision medicine. Biological sciences/Computational biology and bioinformatics Health sciences/Diseases Health sciences/Health care Physical sciences/Mathematics and computing Health sciences/Medical research Full Text Additional Declarations The authors declare no competing interests. Cite Share Download PDF Status: Posted Version 2 posted You are reading this latest preprint version Show more versions Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-7511758","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Systematic Review","associatedPublications":[],"authors":[{"id":509926485,"identity":"d2e169b3-cebf-4b50-ba30-3aaa6d05d802","order_by":0,"name":"Bruce C. Xu","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAABIUlEQVRIie3RsUrEMBjA8ZSDdgm4fnrc9RUihVzFe5iEg053LoWjkwQKmYQ+gq+gCMeNKYXekgfoIYhdnFxcxMHhUlscJHKODvkPbWjyIyRFyOX6h5HuwT9heoJGwgyh/5wh5Ilh1kpaMY9OhTcQ37z0EeK1IuFEfRF0nMwCTYFvKxbtSnm238YovM1fnlX2NBFBvgELubhJEuC6uqKay/FKAyK1PyNKp5HA9dpGSDOqgflVSlVHpCE+ouM3ybiAJbUTT3aEPxRtT0IZvEPZkfD1F2J24TLhdzDsgmpMewLYSsxZFjHT8wiaNr80BJN6uQalWSRxksb2Gzvff2TmVxaL8nElr6dhvtuAytikCKr7xnbLP8PfI/8vy10ul8tl7QArPmZtZWwqqAAAAABJRU5ErkJggg==","orcid":"","institution":"Stanford University School of Medicine","correspondingAuthor":true,"prefix":"","firstName":"Bruce","middleName":"C.","lastName":"Xu","suffix":""},{"id":509926486,"identity":"0ae5da39-353a-4c94-a870-00e18a3d809f","order_by":1,"name":"Arnold Lee","email":"","orcid":"","institution":"Columbia University Vagelos College of Physicians and Surgeons","correspondingAuthor":false,"prefix":"","firstName":"Arnold","middleName":"","lastName":"Lee","suffix":""},{"id":509926487,"identity":"f2c6e9bb-bccc-4004-bd24-04d7af988dd9","order_by":2,"name":"James Jose","email":"","orcid":"","institution":"Mayo Clinic","correspondingAuthor":false,"prefix":"","firstName":"James","middleName":"","lastName":"Jose","suffix":""},{"id":509926488,"identity":"896da93b-06cd-4a25-847c-23a1d7a52a5c","order_by":3,"name":"Shant Ayanian","email":"","orcid":"","institution":"Mayo Clinic","correspondingAuthor":false,"prefix":"","firstName":"Shant","middleName":"","lastName":"Ayanian","suffix":""},{"id":509926489,"identity":"20cfe38c-7fd2-4fbe-a03a-1d15dd179d39","order_by":4,"name":"Ray Qian","email":"","orcid":"","institution":"Mayo Clinic","correspondingAuthor":false,"prefix":"","firstName":"Ray","middleName":"","lastName":"Qian","suffix":""},{"id":509926490,"identity":"5e7c16cf-e9aa-44c0-9d00-623d53a689ac","order_by":5,"name":"Lan Wu","email":"","orcid":"","institution":"University of California Berkeley","correspondingAuthor":false,"prefix":"","firstName":"Lan","middleName":"","lastName":"Wu","suffix":""},{"id":520743382,"identity":"11e7a612-b685-4eda-b14f-c2a37d7a6042","order_by":6,"name":"Alexander J. Ryu","email":"","orcid":"","institution":"Mayo Clinic","correspondingAuthor":false,"prefix":"","firstName":"Alexander","middleName":"J.","lastName":"Ryu","suffix":""}],"badges":[],"createdAt":"2025-09-01 22:38:10","currentVersionCode":2,"declarations":{"humanSubjects":false,"vertebrateSubjects":false,"conflictsOfInterestStatement":false,"humanSubjectEthicalGuidelines":false,"humanSubjectConsent":false,"humanSubjectClinicalTrial":false,"humanSubjectCaseReport":false,"vertebrateSubjectEthicalGuidelines":false},"doi":"10.21203/rs.3.rs-7511758/v2","doiUrl":"https://doi.org/10.21203/rs.3.rs-7511758/v2","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":92288723,"identity":"5c78ac97-b9ea-4082-bcb8-feb7d9c74c10","added_by":"auto","created_at":"2025-09-26 20:18:35","extension":"docx","order_by":0,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":368879,"visible":true,"origin":"","legend":"","description":"","filename":"TransformingClinicalWorkflowswithSpatialReasoningAIAScopingReviewofRealTimeSystemsandArchitecturesnpjAI.docx","url":"https://assets-eu.researchsquare.com/files/rs-7511758/v2/b73d0a332a0c86f730b3df41.docx"},{"id":92288724,"identity":"2bf50909-7e55-4fe6-b2fd-05c15e5929ea","added_by":"auto","created_at":"2025-09-26 20:18:36","extension":"json","order_by":1,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":7435,"visible":true,"origin":"","legend":"","description":"","filename":"fb550f4966b9403c87eccb416517a10f.json","url":"https://assets-eu.researchsquare.com/files/rs-7511758/v2/84d1561de7088f59cc37c553.json"},{"id":92288721,"identity":"043b1284-b040-4817-9c6e-ae69df44a9a7","added_by":"auto","created_at":"2025-09-26 20:18:35","extension":"xml","order_by":2,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":140832,"visible":true,"origin":"","legend":"","description":"","filename":"fb550f4966b9403c87eccb416517a10f1enriched.xml","url":"https://assets-eu.researchsquare.com/files/rs-7511758/v2/68621a333599c5f6707f7839.xml"},{"id":92288722,"identity":"e855e031-441d-4f4c-9c6f-fd80492f6fe5","added_by":"auto","created_at":"2025-09-26 20:18:35","extension":"png","order_by":4,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":63492,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage1.png","url":"https://assets-eu.researchsquare.com/files/rs-7511758/v2/cff07fed1033e76bea7ca362.png"},{"id":92288726,"identity":"fbd5c5b8-09d5-46ff-b93f-007a5c9ce89a","added_by":"auto","created_at":"2025-09-26 20:18:36","extension":"xml","order_by":5,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":136676,"visible":true,"origin":"","legend":"","description":"","filename":"fb550f4966b9403c87eccb416517a10f1structuring.xml","url":"https://assets-eu.researchsquare.com/files/rs-7511758/v2/26d6a0776b48052ac0722508.xml"},{"id":92288725,"identity":"37ef3e4c-eb03-4dbd-a7ad-0a7b0d40e2a4","added_by":"auto","created_at":"2025-09-26 20:18:36","extension":"html","order_by":6,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":162057,"visible":true,"origin":"","legend":"","description":"","filename":"earlyproof.html","url":"https://assets-eu.researchsquare.com/files/rs-7511758/v2/6de9233bfd321ac744d3a077.html"},{"id":92289092,"identity":"bab835e6-38e5-42b9-a319-4e9cf13047d6","added_by":"auto","created_at":"2025-09-26 20:26:33","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":630131,"visible":true,"origin":"","legend":"","description":"","filename":"SpatialReasoningAIinClinicalWorkflowsAScopingReviewofTranslationalApplicationscorrectVersion.pdf","url":"https://assets-eu.researchsquare.com/files/rs-7511758/v2_covered_7bd01800-15b3-49fc-a2cc-28348c4498cd.pdf"}],"financialInterests":"The authors declare no competing interests.","formattedTitle":"\u003cp\u003eSpatial Reasoning AI in Clinical Workflows: A Scoping Review of Translational Applications\u003c/p\u003e","fulltext":[],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":false,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":true,"hideJournal":true,"highlight":"","institution":"","isAcceptedByJournal":false,"isAuthorSuppliedPdf":true,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":true,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"","lastPublishedDoi":"10.21203/rs.3.rs-7511758/v2","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-7511758/v2","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003eBackground: Spatial Reasoning AI (SRAI) systems are emerging as a transformative class of clinical artificial intelligence, enabling real-time interpretation of complex anatomy in imaging, surgery, and chronic disease management. Unlike traditional AI approaches constrained to tabular or 2D inputs, SRAI models incorporate geometric priors, multimodal fusion, and 3D anatomical reasoning to support high-impact tasks such as volumetric segmentation, lesion localization, intraoperative guidance, and prognostic modeling.\u0026nbsp;\u003c/p\u003e\n\u003cp\u003eObjective: This scoping review aimed to (1) map the emerging landscape of SRAI in healthcare, (2) assess its clinical performance across diagnostic, prognostic, and workflow applications, and (3) identify opportunities and barriers for safe translation into practice.\u0026nbsp;\u003c/p\u003e\n\u003cp\u003eMethods: Following PRISMA 2020 guidelines, we systematically searched PubMed, Springer Nature, and IEEE Xplore (including CVPR, ICCV, ISBI, and EMBC) for original studies implementing spatially aware AI models with clinical validation or workflow relevance. Data extraction captured model architecture, input modality, anatomical scope, application domain, and performance outcomes.\u0026nbsp;\u003c/p\u003e\n\u003cp\u003eResults: We identified eligible studies spanning oncology, neurology, cardiology, surgery, and infectious diseases. SRAI systems consistently outperformed conventional methods in segmentation, lesion classification, and risk stratification. A paradigm shift is underway from task-specific CNNs to foundation-level models, including MedSAM and MedCLIP for zero-shot segmentation and retrieval, and NeRF-based pipelines for anatomically faithful 3D reconstruction. Randomized evidence shows that SRAI can improve workflow efficiency without compromising diagnostic accuracy.\u0026nbsp;\u003c/p\u003e\n\u003cp\u003eConclusion: SRAI models demonstrate strong potential to advance diagnostic precision, prognostic accuracy, and workflow integration across multiple clinical domains. Their safe adoption will require standardized evaluation metrics, prospective multi-institutional validation, and interpretable outputs. As foundation models evolve to better encode spatial priors, SRAI is poised to become a cornerstone of workflow-integrated precision medicine.\u003c/p\u003e","manuscriptTitle":"Spatial Reasoning AI in Clinical Workflows: A Scoping Review of Translational Applications","msid":"","msnumber":"","nonDraftVersions":[{"code":2,"date":"2025-09-26 20:18:28","doi":"10.21203/rs.3.rs-7511758/v2","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}},{"code":1,"date":"2025-09-04 00:19:26","doi":"10.21203/rs.3.rs-7511758/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"2c8bd252-bf00-40b9-8c0d-97e0b9a2d59d","owner":[],"postedDate":"September 26th, 2025","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"posted","subjectAreas":[{"id":55417133,"name":"Biological sciences/Computational biology and bioinformatics"},{"id":55417134,"name":"Health sciences/Diseases"},{"id":55417135,"name":"Health sciences/Health care"},{"id":55417136,"name":"Physical sciences/Mathematics and computing"},{"id":55417137,"name":"Health sciences/Medical research"}],"tags":[],"updatedAt":"2025-09-23T09:38:18+00:00","versionOfRecord":[],"versionCreatedAt":"2025-09-26 20:18:28","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v2","identity":"rs-7511758","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-7511758","identity":"rs-7511758","version":["v2"]},"buildId":"8U1c8b4HqxoKbykW_rLl7","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}

Text is read by the "Ask this paper" AI Q&A widget below. Extraction quality varies by source — PMC NXML preserves structure cleanly, OA-HTML may include some navigation residue, and OA-PDF can have broken hyphenation. The publisher copy (via DOI) is the canonical version.

My notes (saved in your browser only)

Ask this paper AI returns verbatim quotes from the full text · source: preprint-html

Answers must be backed by verbatim quotes from this paper's full text. Hallucinated quotes are dropped automatically; if no verbatim passage answers the question, we say so. How this works

Citation neighborhood (no data yet)

We don't have any in-corpus citations linked to this paper yet. This is a recent paper (2025) — citers typically take a year or two to land, and the OpenAlex reference graph may still be filling in.

Source provenance

europepmc
last seen: 2026-05-20T01:45:00.602351+00:00
unpaywall
last seen: 2026-05-22T02:00:06.705733+00:00
License: CC-BY-4.0