ViSense: An Integrated Multi-Modal AI Framework for Intelligent Video Understanding with Sequential Cognitive Visualization.

preprint OA: closed
Full text JSON View at publisher

Abstract

Abstract This paper presents a sophisticated AI-based and deep learning framework for comprehensive video file analysis, comprising nine separate intelligent agencies integrated with an innovative sequential rendering concept. The proposed system utilizes deep learning model architectures, including convolutional neural networks (CNNs) for visual processing, recurrent neural networks for temporal modeling, and transformer-based models for integrating different media. The key innovation lies in the application of a dual screen rendering strategy that separates detailed textual analysis from graphical visualizations, thereby enhancing user comprehension and depth of analysis. Experimental results demonstrate superior performance in video comprehension tasks, with an average accuracy improvement of 23.7% compared to the latest available methods. Experimental results on benchmark datasets demonstrate superior performance in video comprehension tasks, with an average accuracy improvement of up to 23.7% compared to state-of-the-art methods.
Full text 23,941 characters · extracted from preprint-html · click to expand
ViSense: An Integrated Multi-Modal AI Framework for Intelligent Video Understanding with Sequential Cognitive Visualization. | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Article ViSense: An Integrated Multi-Modal AI Framework for Intelligent Video Understanding with Sequential Cognitive Visualization. A. E. Amin, Shaymaa E. Sorour This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-8521136/v1 This work is licensed under a CC BY 4.0 License Status: Posted Version 1 posted You are reading this latest preprint version Abstract This paper presents a sophisticated AI-based and deep learning framework for comprehensive video file analysis, comprising nine separate intelligent agencies integrated with an innovative sequential rendering concept. The proposed system utilizes deep learning model architectures, including convolutional neural networks (CNNs) for visual processing, recurrent neural networks for temporal modeling, and transformer-based models for integrating different media. The key innovation lies in the application of a dual screen rendering strategy that separates detailed textual analysis from graphical visualizations, thereby enhancing user comprehension and depth of analysis. Experimental results demonstrate superior performance in video comprehension tasks, with an average accuracy improvement of 23.7% compared to the latest available methods. Experimental results on benchmark datasets demonstrate superior performance in video comprehension tasks, with an average accuracy improvement of up to 23.7% compared to state-of-the-art methods. Physical sciences/Engineering Physical sciences/Mathematics and computing Video Analysis Deep Learning Multi-Agent Visualization Paradigm Computer Vision Sequential Presentation Human-Computer Interaction Full Text Additional Declarations No competing interests reported. Supplementary Files CREMADmaster.zip Cite Share Download PDF Status: Posted Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-8521136","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Article","associatedPublications":[],"authors":[{"id":578410252,"identity":"243d9b9e-31f9-4ec5-8e2a-90bc5e9b6b7e","order_by":0,"name":"A. E. Amin","email":"","orcid":"","institution":"Mansoura University","correspondingAuthor":false,"prefix":"","firstName":"A.","middleName":"E.","lastName":"Amin","suffix":""},{"id":578410253,"identity":"d09ecda0-0dea-446f-a43f-aeba95e788ce","order_by":1,"name":"Shaymaa E. Sorour","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAAxUlEQVRIiWNgGAWjYBADOQnmA0CKjQQtxhJsCSRqSZxBtBb5/sPHPnxsu5c+s43HgOFD2WEG+fYD+LUY3EhLnjmzrTh3NhuPAeOMc4cZDM4kENAiwWPMzNuWkDtPvscAyABqYSCgRb7/DFhLuhzQFua/QC3y/Q8IeOZADlhLgjRICyNQC8MNQg4D+gXohQTDmW1sBQd7zqXzGNwgYAswxA4DAypBXuIY88YHP8qs5eT7CdiC6kgg5iFB/SgYBaNgFIwCXAAAw6Y82YE0kfcAAAAASUVORK5CYII=","orcid":"","institution":"King Faisal University","correspondingAuthor":true,"prefix":"","firstName":"Shaymaa","middleName":"E.","lastName":"Sorour","suffix":""}],"badges":[],"createdAt":"2026-01-05 12:08:23","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-8521136/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-8521136/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":100875398,"identity":"7d330b9a-2b4b-4dd2-b094-84e789cc23f4","added_by":"auto","created_at":"2026-01-22 10:11:42","extension":"docx","order_by":0,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":324049,"visible":true,"origin":"","legend":"","description":"","filename":"Finalmainscript1.docx","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/194923702973c90101636ae6.docx"},{"id":100875412,"identity":"0093810f-e476-4898-8d02-1c5d1ea0bd5c","added_by":"auto","created_at":"2026-01-22 10:11:44","extension":"json","order_by":1,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":4342,"visible":true,"origin":"","legend":"","description":"","filename":"c6eb6fb2ffd842eaacf3f66c4506a44a.json","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/e67332965c3811b500c12646.json"},{"id":100875457,"identity":"a501df2d-b40f-471a-a63f-38beb8f1e428","added_by":"auto","created_at":"2026-01-22 10:11:55","extension":"zip","order_by":2,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":23391827,"visible":true,"origin":"","legend":"","description":"","filename":"CREMADmaster.zip","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/587d2bf15e267bdb85052714.zip"},{"id":100875349,"identity":"ab747290-0324-4205-bfd6-726b04b4374f","added_by":"auto","created_at":"2026-01-22 10:11:39","extension":"xml","order_by":3,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":216455,"visible":true,"origin":"","legend":"","description":"","filename":"c6eb6fb2ffd842eaacf3f66c4506a44a1enriched.xml","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/9c5739c856922142838fc719.xml"},{"id":100875426,"identity":"df9902c8-044f-4bf1-8f74-c8943a9376e5","added_by":"auto","created_at":"2026-01-22 10:11:47","extension":"eps","order_by":4,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":760502,"visible":true,"origin":"","legend":"","description":"","filename":"drawingimage1.eps","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/c73532b01ba8aeb67ad318a3.eps"},{"id":100875451,"identity":"78ed32c8-6e24-4684-8163-c3e9a9b44ed3","added_by":"auto","created_at":"2026-01-22 10:11:54","extension":"jpeg","order_by":5,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1074,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage1.jpeg","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/b16d7bf4c48047f07febf994.jpeg"},{"id":100875490,"identity":"25c6d852-1f3b-4721-8562-e551502e017a","added_by":"auto","created_at":"2026-01-22 10:12:14","extension":"png","order_by":6,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":18626,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage10.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/c16eb5f36ca5aaf13e475c12.png"},{"id":100875333,"identity":"4606358f-7175-46e1-8d33-e48a4778a4cd","added_by":"auto","created_at":"2026-01-22 10:11:35","extension":"png","order_by":7,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":35441,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage11.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/7adbe896c83cbf586adccf33.png"},{"id":100875411,"identity":"191a477d-9c48-46d8-b2d1-3fa7e6b55e56","added_by":"auto","created_at":"2026-01-22 10:11:44","extension":"jpeg","order_by":8,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":555728,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage2.jpeg","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/c2244716d23545f912e51533.jpeg"},{"id":100875467,"identity":"e5c69d7f-5a36-4b96-8d82-75b38acaa79f","added_by":"auto","created_at":"2026-01-22 10:11:58","extension":"jpeg","order_by":9,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1074,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage1.jpeg","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/f1ae46ddb9797beeb8682993.jpeg"},{"id":100875427,"identity":"ae50bfd1-3802-4342-b804-262f4f85bb0e","added_by":"auto","created_at":"2026-01-22 10:11:47","extension":"jpeg","order_by":10,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1074,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage1.jpeg","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/88e73820e94ea534e1fcf489.jpeg"},{"id":100875343,"identity":"2fdd4af8-68e2-47bb-a88b-2e66cd65fd80","added_by":"auto","created_at":"2026-01-22 10:11:37","extension":"png","order_by":11,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":31647,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage5.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/db92deb6501c870ab1846681.png"},{"id":100875487,"identity":"cf59d04e-e4ce-4a6c-874a-b10f04715043","added_by":"auto","created_at":"2026-01-22 10:12:12","extension":"png","order_by":12,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":18325,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage6.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/7faba9f6dc9edcbb00a0e241.png"},{"id":100875348,"identity":"f65eb889-1800-4e58-a60a-9875a78bd2b8","added_by":"auto","created_at":"2026-01-22 10:11:38","extension":"png","order_by":13,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":32969,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage7.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/577fd0e10544e254d9e216d2.png"},{"id":100875335,"identity":"e933e554-154c-44cd-9c93-31815d69b326","added_by":"auto","created_at":"2026-01-22 10:11:35","extension":"png","order_by":14,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":18645,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage8.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/328aa80b9a63963423619525.png"},{"id":100875405,"identity":"8b634e3d-2a2a-41d4-a1b8-e558a17c146e","added_by":"auto","created_at":"2026-01-22 10:11:43","extension":"png","order_by":15,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":32705,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage9.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/460ad4b851dda6a315e41070.png"},{"id":100875403,"identity":"40ac5f4e-b0fd-4ce8-a68b-dce31a3639cc","added_by":"auto","created_at":"2026-01-22 10:11:43","extension":"jpeg","order_by":16,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":81844,"visible":true,"origin":"","legend":"","description":"","filename":"groupimage1.jpeg","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/303b0256dee5492a675fbb45.jpeg"},{"id":100875425,"identity":"07806b58-245b-4ebf-bd52-8b3ab638688e","added_by":"auto","created_at":"2026-01-22 10:11:46","extension":"jpeg","order_by":17,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":35617,"visible":true,"origin":"","legend":"","description":"","filename":"groupimage2.jpeg","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/cf6bcde0cf2b6145e0624d6d.jpeg"},{"id":100875420,"identity":"4f52a3d9-9823-47c2-89d4-c453362d2f4b","added_by":"auto","created_at":"2026-01-22 10:11:46","extension":"png","order_by":18,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":935,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage1.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/9ab6ee56106d21bd893d1619.png"},{"id":100875423,"identity":"e03cae98-8523-4e25-b640-c1b92e0b8da4","added_by":"auto","created_at":"2026-01-22 10:11:46","extension":"png","order_by":19,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":8099,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage10.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/a5c3f578a5dd46e972280149.png"},{"id":100950432,"identity":"05abca0b-82c5-46a7-8de6-fed99ec9b61b","added_by":"auto","created_at":"2026-01-23 07:08:09","extension":"png","order_by":20,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":12318,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage11.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/d72a060e958c9469508ee294.png"},{"id":100875331,"identity":"26d44d2d-835e-4c8e-bf49-6db131b96b6f","added_by":"auto","created_at":"2026-01-22 10:11:34","extension":"png","order_by":21,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":123755,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage2.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/c8d99c78302b9c0da6643641.png"},{"id":100875395,"identity":"d506d901-eb13-45a9-a8a1-bbdfcb56fe78","added_by":"auto","created_at":"2026-01-22 10:11:41","extension":"png","order_by":22,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":935,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage1.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/419a8dd36d7270db584b83e3.png"},{"id":100875414,"identity":"5207240e-9cc0-4a48-b5fd-52fca5749735","added_by":"auto","created_at":"2026-01-22 10:11:44","extension":"png","order_by":23,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":935,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage1.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/13e1371c399645c3700a7cb9.png"},{"id":100875374,"identity":"1e1105a8-5957-4554-a56a-24dab32591a5","added_by":"auto","created_at":"2026-01-22 10:11:40","extension":"png","order_by":24,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":11560,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage5.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/48935a92ff085266b066779f.png"},{"id":100875430,"identity":"71d3a757-8fa8-4386-ab2b-b4683d4ef840","added_by":"auto","created_at":"2026-01-22 10:11:47","extension":"png","order_by":25,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":7773,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage6.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/9471d67aa3986f5926b35baf.png"},{"id":100875330,"identity":"22cac37b-895c-46ae-bf2b-f1a2061cc05a","added_by":"auto","created_at":"2026-01-22 10:11:34","extension":"png","order_by":26,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":12193,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage7.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/e2d9152d925a2c1b56ba7d0c.png"},{"id":100875407,"identity":"c8440c85-6c65-418e-961f-0f36c0f25173","added_by":"auto","created_at":"2026-01-22 10:11:44","extension":"png","order_by":27,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":8234,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage8.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/8b094a28fe2f06adb7c5ab18.png"},{"id":100875404,"identity":"514f1a4f-31a7-486c-b896-efd81ed9e544","added_by":"auto","created_at":"2026-01-22 10:11:43","extension":"png","order_by":28,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":12856,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage9.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/7144c5f41d12b8bd61f562d7.png"},{"id":100875350,"identity":"9644021e-a63b-4900-ab0a-87b3bbc838f3","added_by":"auto","created_at":"2026-01-22 10:11:39","extension":"png","order_by":29,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":69189,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinegroupimage1.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/d1a9a9312f3ff6b54df31d63.png"},{"id":100875450,"identity":"3993061f-e14f-464e-b4dc-e09063a67a81","added_by":"auto","created_at":"2026-01-22 10:11:54","extension":"png","order_by":30,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":20384,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinegroupimage2.png","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/d7a21b578b916188780df18c.png"},{"id":100875433,"identity":"0c4c8938-46cb-4e0c-8f76-9b40f597c753","added_by":"auto","created_at":"2026-01-22 10:11:50","extension":"xml","order_by":31,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":213188,"visible":true,"origin":"","legend":"","description":"","filename":"c6eb6fb2ffd842eaacf3f66c4506a44a1structuring.xml","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/31d87d2d6e53ff0168b74f36.xml"},{"id":100875392,"identity":"95da69f5-4deb-4b11-be94-b8fa150a8cb6","added_by":"auto","created_at":"2026-01-22 10:11:41","extension":"html","order_by":32,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":246551,"visible":true,"origin":"","legend":"","description":"","filename":"earlyproof.html","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/52342bc528fca125481776f5.html"},{"id":104686924,"identity":"03bf3d4c-2b93-490a-8cad-83ea15a82b20","added_by":"auto","created_at":"2026-03-16 04:55:49","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":826741,"visible":true,"origin":"","legend":"","description":"","filename":"Finalmainscript1.pdf","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1_covered_fba6afa9-6be5-44be-82a3-8bf9e794acbb.pdf"},{"id":100875454,"identity":"4b014da6-20aa-4da9-834b-40cb11e73b46","added_by":"auto","created_at":"2026-01-22 10:11:55","extension":"zip","order_by":0,"title":"","display":"","copyAsset":false,"role":"supplement","size":23391827,"visible":true,"origin":"","legend":"","description":"","filename":"CREMADmaster.zip","url":"https://assets-eu.researchsquare.com/files/rs-8521136/v1/05faa8afc24907b1246e20c7.zip"}],"financialInterests":"No competing interests reported.","formattedTitle":"ViSense: An Integrated Multi-Modal AI Framework for Intelligent Video Understanding with Sequential Cognitive Visualization.","fulltext":[],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":false,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":true,"highlight":"","institution":"","isAcceptedByJournal":false,"isAuthorSuppliedPdf":true,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":true,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"Video Analysis, Deep Learning, Multi-Agent, Visualization Paradigm, Computer Vision, Sequential Presentation, Human-Computer Interaction","lastPublishedDoi":"10.21203/rs.3.rs-8521136/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-8521136/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003eThis paper presents a sophisticated AI-based and deep learning framework for comprehensive video file analysis, comprising nine separate intelligent agencies integrated with an innovative sequential rendering concept. The proposed system utilizes deep learning model architectures, including convolutional neural networks (CNNs) for visual processing, recurrent neural networks for temporal modeling, and transformer-based models for integrating different media. The key innovation lies in the application of a dual screen rendering strategy that separates detailed textual analysis from graphical visualizations, thereby enhancing user comprehension and depth of analysis. Experimental results demonstrate superior performance in video comprehension tasks, with an average accuracy improvement of 23.7% compared to the latest available methods. Experimental results on benchmark datasets demonstrate superior performance in video comprehension tasks, with an average accuracy improvement of up to 23.7% compared to state-of-the-art methods.\u003c/p\u003e","manuscriptTitle":"ViSense: An Integrated Multi-Modal AI Framework for Intelligent Video Understanding with Sequential Cognitive Visualization.","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2026-01-22 10:09:58","doi":"10.21203/rs.3.rs-8521136/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"31524b8f-e75e-4513-869b-04ad0244da65","owner":[],"postedDate":"January 22nd, 2026","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"posted","subjectAreas":[{"id":61542127,"name":"Physical sciences/Engineering"},{"id":61542128,"name":"Physical sciences/Mathematics and computing"}],"tags":[],"updatedAt":"2026-03-16T04:55:28+00:00","versionOfRecord":[],"versionCreatedAt":"2026-01-22 10:09:58","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-8521136","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-8521136","identity":"rs-8521136","version":["v1"]},"buildId":"XKTyCvWXoU3ODBz1xrDgd","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}

Text is read by the "Ask this paper" AI Q&A widget below. Extraction quality varies by source — PMC NXML preserves structure cleanly, OA-HTML may include some navigation residue, and OA-PDF can have broken hyphenation. The publisher copy (via DOI) is the canonical version.

My notes (saved in your browser only)

Ask this paper AI returns verbatim quotes from the full text · source: preprint-html

Answers must be backed by verbatim quotes from this paper's full text. Hallucinated quotes are dropped automatically; if no verbatim passage answers the question, we say so. How this works

Citation neighborhood (no data yet)

We don't have any in-corpus citations linked to this paper yet. This is a recent paper (2026) — citers typically take a year or two to land, and the OpenAlex reference graph may still be filling in.

Source provenance

europepmc
last seen: 2026-05-20T01:45:00.602351+00:00