Competition of cortical clusters during on-demand visual learning in immersive virtual reality

Competition of cortical clusters during on-demand visual learning in immersive virtual reality | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Article Competition of cortical clusters during on-demand visual learning in immersive virtual reality Balazs Rozsa, Linda Judák, Gergely Dobos, Katalin Ócsai, István Takács, and 7 more This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-3352160/v1 This work is licensed under a CC BY 4.0 License Status: Published Journal Publication published 12 Dec, 2024 Read the published version in Nature Methods → Version 1 posted You are reading this latest preprint version Abstract Neural circuits support rapid visual learning. However, due to technical roadblocks, it is not known how visual circuits represent multiple features or how behaviorally relevant representations are selected for long-term memory. Here we developed Moculus, a head-mounted virtual reality platform for mice that covers the entire visual field, and allows binocular depth perception and full immersion. This controllable environment, combined with fast acousto-optical imaging, affords rapid visual learning and the uncovering of novel circuit substrates: both the control and reinforcement-associated visual cue coding neuronal assemblies are extended transiently to a near-saturating level. They formed partially orthogonal and overlapping clusters centered around hub cells with higher and earlier ramp-like responses, as well as locally increased connectivity. This temporally maximizes computational capability and allows competition between assemblies that encode behaviorally relevant information by stochastic fluctuation from trial-to-trial. The coding competition is driven by reinforcement feedback at the level of individual neurons. Biological sciences/Biological techniques/Behavioural methods Biological sciences/Neuroscience/Visual system Full Text Additional Declarations Yes there is potential Competing Interest. G.D., B.R., and G.Sz. are inventors on patent PCT/HU2020/050029. B.R. is a founder of Femtonics and a member of its scientific advisory board. Table 1 is available in the Supplementary Files section. Supplementary Files Suppl.Movie1.mp4 Vision test using moving eagle in VR environment. Suppl.Movie2.mp4 Retinal projection of Moculus on the enucleated mouse eyeball. JudaketalSupplementaryInformationfinal0912jl.pdf Table1.pdf Cite Share Download PDF Status: Published Journal Publication published 12 Dec, 2024 Read the published version in Nature Methods → Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-3352160","acceptedTermsAndConditions":true,"allowDirectSubmit":false,"archivedVersions":[],"articleType":"Article","associatedPublications":[],"authors":[{"id":239907126,"identity":"6314f159-f72b-46c7-8927-f809de2345d9","order_by":0,"name":"Balazs Rozsa","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAAt0lEQVRIie3LMQrCMBSA4ScFXV7p2tLWMwQCdfMsKQHPIDhYENKlxet0LDyoS8QLOAgFN8FuOgg6i5B0c8g//x+Ay/WvTQpIAgQPBLT2BKNqNGH6Q8CGLMqyvz+bJXJNxC5wzgsTSXS7imotMTsqKQRczSQMRQe+8jA7IW8FkA3Jd8NLbZHv7YmE2FeEzK+4sCPYTeNUHzDUnWSCETeTWdkPt2YzDypJ0WNNqZF8xUb+LpfL5frdG3rzPSiMqD0PAAAAAElFTkSuQmCC","orcid":"https://orcid.org/0000-0003-1427-7003","institution":"Hungarian Academy of Sciences","correspondingAuthor":true,"submittingAuthor":false,"prefix":"","firstName":"Balazs","middleName":"","lastName":"Rozsa","suffix":""},{"id":239907127,"identity":"e8d76bab-fe0b-47e8-96f2-101981bfd2eb","order_by":1,"name":"Linda Judák","email":"","orcid":"","institution":"Institute of Experimental Medicine","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Linda","middleName":"","lastName":"Judák","suffix":""},{"id":239907128,"identity":"cec69818-1336-45f8-af9d-2d547de3a627","order_by":2,"name":"Gergely Dobos","email":"","orcid":"","institution":"Bay Zoltán Nonprofit Ltd. for Applied Research","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Gergely","middleName":"","lastName":"Dobos","suffix":""},{"id":239907129,"identity":"904a5c24-f531-416d-bd14-3ddb63cfb280","order_by":3,"name":"Katalin Ócsai","email":"","orcid":"","institution":"BrainVisionCenter Research Institute and Competence Center","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Katalin","middleName":"","lastName":"Ócsai","suffix":""},{"id":239907130,"identity":"4a428c86-6678-4ce2-beb3-d3682ab8c9b9","order_by":4,"name":"István Takács","email":"","orcid":"","institution":"Institute of Experimental Medicine","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"István","middleName":"","lastName":"Takács","suffix":""},{"id":239907131,"identity":"10ce2abe-dfdf-44e0-b43b-eaa96b2a1b65","order_by":5,"name":"Eszter Báthory","email":"","orcid":"","institution":"BrainVisionCenter Research Institute and Competence Center","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Eszter","middleName":"","lastName":"Báthory","suffix":""},{"id":239907132,"identity":"f9b2f830-ded2-4827-85be-8295524dfa9b","order_by":6,"name":"Balázs Chiovini","email":"","orcid":"","institution":"Institute of Experimental Medicine","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Balázs","middleName":"","lastName":"Chiovini","suffix":""},{"id":239907133,"identity":"8f5cb1bf-712a-4eca-bb2f-39344c7c7033","order_by":7,"name":"Zoltán Szadai","email":"","orcid":"","institution":"Institute of Experimental Medicine","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Zoltán","middleName":"","lastName":"Szadai","suffix":""},{"id":239907134,"identity":"e2374a99-4f2e-4378-86d9-119811c92386","order_by":8,"name":"Pál Maák","email":"","orcid":"","institution":"Budapest University of Technology and Economics","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Pál","middleName":"","lastName":"Maák","suffix":""},{"id":239907135,"identity":"30405eea-d0e0-435a-af80-c51267cd2610","order_by":9,"name":"Áron Szepesi","email":"","orcid":"","institution":"Institute of Experimental Medicine","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Áron","middleName":"","lastName":"Szepesi","suffix":""},{"id":239907136,"identity":"e3e20f15-f5c1-48b7-9e2e-46b815e3234a","order_by":10,"name":"Botond Roska","email":"","orcid":"https://orcid.org/0000-0002-9559-1450","institution":"Institute of Molecular and Clinical Ophthalmology Basel","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Botond","middleName":"","lastName":"Roska","suffix":""},{"id":239907137,"identity":"038c83d6-bde5-4e3f-bb19-e1ee100f5be4","order_by":11,"name":"Gergely Szalay","email":"","orcid":"","institution":"Institute of Experimental Medicine","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Gergely","middleName":"","lastName":"Szalay","suffix":""}],"badges":[],"createdAt":"2023-09-13 13:11:37","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-3352160/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-3352160/v1","draftVersion":[],"editorialEvents":[{"content":"https://doi.org/10.1038/s41592-024-02554-6","type":"published","date":"2024-12-12T05:00:00+00:00"}],"editorialNote":"","failedWorkflow":false,"files":[{"id":71313247,"identity":"71123514-238d-4a43-b5e0-42602a59b6ae","added_by":"auto","created_at":"2024-12-13 08:05:53","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":2157247,"visible":true,"origin":"","legend":"","description":"","filename":"JudaketalManuscripthivatkozasfrissites0911jl.pdf","url":"https://assets-eu.researchsquare.com/files/rs-3352160/v1_covered_48d3368a-2a3c-47ff-81e6-6b64ef1e8dba.pdf"},{"id":44659644,"identity":"b1729af4-6fa2-4d60-a764-a6a715c1d47c","added_by":"auto","created_at":"2023-10-16 01:39:28","extension":"mp4","order_by":1,"title":"","display":"","copyAsset":false,"role":"supplement","size":9013627,"visible":true,"origin":"","legend":"\u003cp\u003eVision test using moving eagle in VR environment.\u003c/p\u003e","description":"","filename":"Suppl.Movie1.mp4","url":"https://assets-eu.researchsquare.com/files/rs-3352160/v1/a39e5f97e9977c60e44c6769.mp4"},{"id":44659645,"identity":"ab458242-8361-4f35-aea0-eb11da3c1b98","added_by":"auto","created_at":"2023-10-16 01:39:30","extension":"mp4","order_by":2,"title":"","display":"","copyAsset":false,"role":"supplement","size":87785177,"visible":true,"origin":"","legend":"\u003cp\u003eRetinal projection of Moculus on the enucleated mouse eyeball.\u003c/p\u003e","description":"","filename":"Suppl.Movie2.mp4","url":"https://assets-eu.researchsquare.com/files/rs-3352160/v1/1348b012a1b1270e9cf1ba9c.mp4"},{"id":44659643,"identity":"1dcbda45-e960-49d2-8342-8f2172cc2fa6","added_by":"auto","created_at":"2023-10-16 01:39:28","extension":"pdf","order_by":3,"title":"","display":"","copyAsset":false,"role":"supplement","size":5925455,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cbr\u003e\u003c/p\u003e","description":"","filename":"JudaketalSupplementaryInformationfinal0912jl.pdf","url":"https://assets-eu.researchsquare.com/files/rs-3352160/v1/09697e35887d46f37bb9ed32.pdf"},{"id":44659642,"identity":"a9bfc01a-7893-4b13-9c3d-2a8c8a4b41dd","added_by":"auto","created_at":"2023-10-16 01:39:28","extension":"pdf","order_by":4,"title":"","display":"","copyAsset":false,"role":"supplement","size":176315,"visible":true,"origin":"","legend":"","description":"","filename":"Table1.pdf","url":"https://assets-eu.researchsquare.com/files/rs-3352160/v1/fb44f18ccf5bfc702312e64f.pdf"}],"financialInterests":"\u003cp\u003e\u003cstrong\u003eYes\u003c/strong\u003e there is potential Competing Interest. G.D., B.R., and G.Sz. are inventors on patent PCT/HU2020/050029. B.R. is a founder of Femtonics and a member of its scientific advisory board.\u003c/p\u003e\n\u003cp\u003eTable 1 is available in the Supplementary Files section.\u003c/p\u003e","formattedTitle":"Competition of cortical clusters during on-demand visual learning in immersive virtual reality","fulltext":[],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":false,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":true,"hideJournal":false,"highlight":"","institution":"","isAcceptedByJournal":true,"isAuthorSuppliedPdf":true,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":true,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"nature-portfolio","isNatureJournal":true,"hasQc":false,"allowDirectSubmit":false,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"","title":"Nature Portfolio","twitterHandle":"","acdcEnabled":false,"dfaEnabled":false,"editorialSystem":"ejp","reportingPortfolio":"","inReviewEnabled":true,"inReviewRevisionsEnabled":false},"keywords":"","lastPublishedDoi":"10.21203/rs.3.rs-3352160/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-3352160/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"Neural circuits support rapid visual learning. However, due to technical roadblocks, it is not known how visual circuits represent multiple features or how behaviorally relevant representations are selected for long-term memory. Here we developed Moculus, a head-mounted virtual reality platform for mice that covers the entire visual field, and allows binocular depth perception and full immersion. This controllable environment, combined with fast acousto-optical imaging, affords rapid visual learning and the uncovering of novel circuit substrates: both the control and reinforcement-associated visual cue coding neuronal assemblies are extended transiently to a near-saturating level. They formed partially orthogonal and overlapping clusters centered around hub cells with higher and earlier ramp-like responses, as well as locally increased connectivity. This temporally maximizes computational capability and allows competition between assemblies that encode behaviorally relevant information by stochastic fluctuation from trial-to-trial. The coding competition is driven by reinforcement feedback at the level of individual neurons.","manuscriptTitle":"Competition of cortical clusters during on-demand visual learning in immersive virtual reality","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2023-10-16 01:39:23","doi":"10.21203/rs.3.rs-3352160/v1","editorialEvents":[],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"nature-methods","isNatureJournal":true,"hasQc":false,"allowDirectSubmit":false,"externalIdentity":"nmeth","sideBox":"Learn more about [Nature Methods](http://www.nature.com/nmeth)","snPcode":"","submissionUrl":"","title":"Nature Methods","twitterHandle":"","acdcEnabled":true,"dfaEnabled":true,"editorialSystem":"ejp","reportingPortfolio":"Nature Research","inReviewEnabled":true,"inReviewRevisionsEnabled":false}}],"origin":"","ownerIdentity":"00a1ccca-41f1-4c02-9cd7-6c72266ccf97","owner":[],"postedDate":"October 16th, 2023","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"published-in-journal","subjectAreas":[{"id":25363340,"name":"Biological sciences/Biological techniques/Behavioural methods"},{"id":25363341,"name":"Biological sciences/Neuroscience/Visual system"}],"tags":[],"updatedAt":"2024-12-13T08:05:44+00:00","versionOfRecord":{"articleIdentity":"rs-3352160","link":"https://doi.org/10.1038/s41592-024-02554-6","journal":{"identity":"nature-methods","isVorOnly":false,"title":"Nature Methods"},"publishedOn":"2024-12-12 05:00:00","publishedOnDateReadable":"December 12th, 2024"},"versionCreatedAt":"2023-10-16 01:39:23","video":"","vorDoi":"10.1038/s41592-024-02554-6","vorDoiUrl":"https://doi.org/10.1038/s41592-024-02554-6","workflowStages":[]},"version":"v1","identity":"rs-3352160","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-3352160","identity":"rs-3352160","version":["v1"]},"buildId":"-HB7Z8yhvgn0wM9Nzuekk","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}