Distinct dopaminergic spike-timing-dependent plasticity rules are suited to different functional roles

preprint OA: closed CC-BY-4.0
📄 Open PDF Full text JSON View at publisher

Abstract

Abstract Various mathematical models have been formulated to describe the changes in synaptic strengths resulting from spike-timing-dependent plasticity (STDP). A subset of these models include a third factor, dopamine, which interacts with spike timing to contribute to plasticity at specific synapses, notably those from cortex to striatum at the input layer of the basal ganglia. Theoretical work to analyze these plasticity models has largely focused on abstract issues, such as the conditions under which they may promote synchronization and the weight distributions induced by inputs with simple correlation structures, rather than on scenarios associated with specific tasks, and has generally not considered dopamine-dependent forms of STDP. In this paper we introduce forms of dopamine-modulated STDP adapted from previously proposed plasticity rules. We then analyze, mathematically and with simulations, their performance in two biologically relevant scenarios. We test the ability of each of the three models to complete simple value estimation and action selection tasks, studying the learned weight distributions and corresponding task performance in each setting. Interestingly, we find that each plasticity rule is well suited to a subset of the scenarios studied but falls short in others. Different tasks may therefore require different forms of synaptic plasticity, yielding the prediction that the precise form of the STDP mechanism present may vary across regions of the striatum, and other brain areas impacted by dopamine, that are involved in distinct computational functions.
Full text 32,640 characters · extracted from preprint-html · click to expand
Distinct dopaminergic spike-timing-dependent plasticity rules are suited to different functional roles | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article Distinct dopaminergic spike-timing-dependent plasticity rules are suited to different functional roles Baram Sosis, Jonathan E. Rubin This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-7456628/v1 This work is licensed under a CC BY 4.0 License Status: Under Review Version 1 posted 9 You are reading this latest preprint version Abstract Various mathematical models have been formulated to describe the changes in synaptic strengths resulting from spike-timing-dependent plasticity (STDP). A subset of these models include a third factor, dopamine, which interacts with spike timing to contribute to plasticity at specific synapses, notably those from cortex to striatum at the input layer of the basal ganglia. Theoretical work to analyze these plasticity models has largely focused on abstract issues, such as the conditions under which they may promote synchronization and the weight distributions induced by inputs with simple correlation structures, rather than on scenarios associated with specific tasks, and has generally not considered dopamine-dependent forms of STDP. In this paper we introduce forms of dopamine-modulated STDP adapted from previously proposed plasticity rules. We then analyze, mathematically and with simulations, their performance in two biologically relevant scenarios. We test the ability of each of the three models to complete simple value estimation and action selection tasks, studying the learned weight distributions and corresponding task performance in each setting. Interestingly, we find that each plasticity rule is well suited to a subset of the scenarios studied but falls short in others. Different tasks may therefore require different forms of synaptic plasticity, yielding the prediction that the precise form of the STDP mechanism present may vary across regions of the striatum, and other brain areas impacted by dopamine, that are involved in distinct computational functions. Dopamine Synaptic plasticity STDP Basal ganglia Reward prediction Value estimation Action selection Full Text Additional Declarations No competing interests reported. Cite Share Download PDF Status: Under Review Version 1 posted Editorial decision: Revision requested 27 Oct, 2025 Reviews received at journal 24 Oct, 2025 Reviews received at journal 09 Oct, 2025 Reviewers agreed at journal 29 Sep, 2025 Reviewers agreed at journal 18 Sep, 2025 Reviewers invited by journal 17 Sep, 2025 Editor assigned by journal 28 Aug, 2025 Submission checks completed at journal 27 Aug, 2025 First submitted to journal 25 Aug, 2025 You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-7456628","acceptedTermsAndConditions":true,"allowDirectSubmit":false,"archivedVersions":[],"articleType":"Research Article","associatedPublications":[],"authors":[{"id":517009602,"identity":"8717999f-3daf-467e-be85-b4848b8f8b25","order_by":0,"name":"Baram Sosis","email":"","orcid":"","institution":"University of Pittsburgh","correspondingAuthor":false,"prefix":"","firstName":"Baram","middleName":"","lastName":"Sosis","suffix":""},{"id":517009603,"identity":"28838aca-8715-4ef5-b513-ad384a7073cd","order_by":1,"name":"Jonathan E. Rubin","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAAuklEQVRIiWNgGAWjYBACxgYwIcHAD2FCSaK0SDYwNjYcIEYLXJ/BASBFlBbm9t5jn3l3WOQZ325uf/yBwUZ2wwFCFvScS57Ne0ai2OzOQZDD0owJa5mRY8zM2yaRuO1GIkjL4UTitWyeAdbynwQtGyTAWg4QoaXnjDHj3DMSiTOAfplxxiDZeCYhLYbtPcYMb3fUJfbPbn/woaLCTraPoJYGGEsCRBgQUA4C8nCWBBGqR8EoGAWjYGQCAMXdSlwsIa18AAAAAElFTkSuQmCC","orcid":"","institution":"University of Pittsburgh","correspondingAuthor":true,"prefix":"","firstName":"Jonathan","middleName":"E.","lastName":"Rubin","suffix":""}],"badges":[],"createdAt":"2025-08-25 19:38:16","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-7456628/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-7456628/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":92221661,"identity":"7af88b1f-6b62-4ca0-a83b-2ee7658762ca","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"json","order_by":0,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":4508,"visible":true,"origin":"","legend":"","description":"","filename":"869613fc797a4e23bfcba4c79cc7632f.json","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/3d214ba6fa9eae37b1922ec8.json"},{"id":92223152,"identity":"d52b5fe0-e3d2-4645-a454-8ecae45a8086","added_by":"auto","created_at":"2025-09-26 03:42:25","extension":"png","order_by":1,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1181076,"visible":true,"origin":"","legend":"","description":"","filename":"ActionSelectionPhasePlanesalphaDensity.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/c90be3f1eabb77d2ff082cd4.png"},{"id":92221663,"identity":"1a095a6e-e656-417e-a5d3-a21efd6c8442","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"png","order_by":2,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":278053,"visible":true,"origin":"","legend":"","description":"","filename":"ActionSelectionPhasePlanesgammaDensitysingletrace.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/3f59dff0f5fb8ef152f3706a.png"},{"id":92221662,"identity":"5e1b020c-01d7-4c5b-9850-97abf6b2880a","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"png","order_by":3,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":241061,"visible":true,"origin":"","legend":"","description":"","filename":"ActionSelectionWeightLimitsDelay.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/f044ac739e22dda712c41e17.png"},{"id":92221664,"identity":"d1454087-5753-4cae-b2d2-0af66c63ca38","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"png","order_by":4,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1434771,"visible":true,"origin":"","legend":"","description":"","filename":"ActionSelectionWeightsOverTime2Dalpha.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/efbf09cf5999eb43790776fe.png"},{"id":92221665,"identity":"b0b9f979-81bc-4a6d-908a-c835fe16219c","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"png","order_by":5,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1861368,"visible":true,"origin":"","legend":"","description":"","filename":"ActionSelectionWeightsOverTimeContingencySwitchingalpha.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/08a5929451ac567eb642a367.png"},{"id":92223151,"identity":"943949ff-ac60-48e4-8c93-d18cfebdbe3a","added_by":"auto","created_at":"2025-09-26 03:42:25","extension":"png","order_by":6,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1944051,"visible":true,"origin":"","legend":"","description":"","filename":"ActionSelectionWeightsOverTimeContingencySwitchinggammasingletrace.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/6a8597c1ce859abe8bf16fc9.png"},{"id":92223408,"identity":"6797ef43-4858-4c19-be16-3658a8ff797c","added_by":"auto","created_at":"2025-09-26 03:50:25","extension":"pdf","order_by":7,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":225329,"visible":true,"origin":"","legend":"","description":"","filename":"DAPcoverletterv3.pdf","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/31f6c0ee8333a58883703c0d.pdf"},{"id":92223154,"identity":"ee847abc-5175-4d7b-8fc0-cc21b4466d79","added_by":"auto","created_at":"2025-09-26 03:42:25","extension":"png","order_by":8,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":417897,"visible":true,"origin":"","legend":"","description":"","filename":"Plasticitydiagramcombined.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/433d42d991d8cc9be823da31.png"},{"id":92221688,"identity":"36504d8a-b54c-49ba-b5d2-306a8743ec1d","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"pdf","order_by":9,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":14725470,"visible":true,"origin":"","legend":"","description":"","filename":"PlasticityPaperv3SECOND.pdf","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/bc4f110a3aa9a344f94d2e82.pdf"},{"id":92221668,"identity":"ed7f65a1-0721-4fff-a5bc-39b58955a26b","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"png","order_by":10,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":51567,"visible":true,"origin":"","legend":"","description":"","filename":"Timingplot.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/15596dfda21d577d5a2935b4.png"},{"id":92221689,"identity":"b5d694bb-e177-4c10-bf25-41d2aafd28d7","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"png","order_by":11,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":862424,"visible":true,"origin":"","legend":"","description":"","filename":"ValueEstimationDensityVaryingwinit.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/e0f5c268a8dcb6b0c86e4257.png"},{"id":92221702,"identity":"ce7ae9fc-70b9-411c-8eb2-e893535ba220","added_by":"auto","created_at":"2025-09-26 03:34:26","extension":"png","order_by":12,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":789467,"visible":true,"origin":"","legend":"","description":"","filename":"ValueEstimationDensity.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/746416c7c8bd8f8b977e26d0.png"},{"id":92223410,"identity":"a6877e3e-8ca9-4251-9528-3958a5a9f105","added_by":"auto","created_at":"2025-09-26 03:50:26","extension":"png","order_by":13,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":304967,"visible":true,"origin":"","legend":"","description":"","filename":"ValueEstimationInstantaneousDriftTdelwinit.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/305632026670989b4e1beb4e.png"},{"id":92223155,"identity":"ffa4589d-6574-4733-a643-e375e18f70c9","added_by":"auto","created_at":"2025-09-26 03:42:25","extension":"png","order_by":14,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":309624,"visible":true,"origin":"","legend":"","description":"","filename":"ValueEstimationInstantaneousDriftepswinit.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/c3229df7ab16d2aab504c642.png"},{"id":92221673,"identity":"79a52770-bf95-464b-9fed-f5b4c09350d4","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"png","order_by":15,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1006544,"visible":true,"origin":"","legend":"","description":"","filename":"ValueEstimationPhasePlanesalphaDensity.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/a093fb0141f78c5fe7f2e6ca.png"},{"id":92221680,"identity":"bdfadc8d-5b94-416f-a787-f5009019da9a","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"png","order_by":16,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":283996,"visible":true,"origin":"","legend":"","description":"","filename":"ValueEstimationPhasePlanesgammaDensitysingletrace.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/d7ce03951fd713ac0eebb6ac.png"},{"id":92221683,"identity":"26e9546f-ca76-4ec0-968f-ee3600c7ab71","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"png","order_by":17,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1462206,"visible":true,"origin":"","legend":"","description":"","filename":"ValueEstimationWeightsOverTimeContingencySwitchingalpha.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/bc6ccd6b771b8d2436d10977.png"},{"id":92221671,"identity":"4e8fd854-da82-4865-a664-dae6f1a73cfb","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"png","order_by":18,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1617963,"visible":true,"origin":"","legend":"","description":"","filename":"ValueEstimationWeightsOverTimeContingencySwitchinggammasingletrace.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/8afc77f0df7b9336c8b8508a.png"},{"id":92221686,"identity":"fe78ac82-c16d-4f8c-810e-af21556f18b0","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"bst","order_by":19,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":146013,"visible":true,"origin":"","legend":"","description":"","filename":"snapacite.bst","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/7df0fcebb5a7b1197809cacf.bst"},{"id":92221699,"identity":"1aa56d19-54ad-4ae6-abc8-9d1d2e28d392","added_by":"auto","created_at":"2025-09-26 03:34:26","extension":"bst","order_by":20,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":29828,"visible":true,"origin":"","legend":"","description":"","filename":"snaps.bst","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/f73710cd69cd676afa0733a9.bst"},{"id":92221698,"identity":"20500d68-3e0f-44b4-8f1b-0b430d207c48","added_by":"auto","created_at":"2025-09-26 03:34:26","extension":"bst","order_by":21,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":35515,"visible":true,"origin":"","legend":"","description":"","filename":"snbasic.bst","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/3fe2a376c64c6279dad2a56b.bst"},{"id":92223156,"identity":"d2d67aef-4c27-4375-abab-217a873c451c","added_by":"auto","created_at":"2025-09-26 03:42:25","extension":"bst","order_by":22,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":33968,"visible":true,"origin":"","legend":"","description":"","filename":"snchicago.bst","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/48215727c578f2c281b76490.bst"},{"id":92223157,"identity":"6381064e-14cb-44e4-b090-f30ccd8e1c96","added_by":"auto","created_at":"2025-09-26 03:42:25","extension":"cls","order_by":23,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":55857,"visible":true,"origin":"","legend":"","description":"","filename":"snjnl.cls","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/456d6254d50ac79a8976084b.cls"},{"id":92221679,"identity":"3ce3a9a9-1fc6-44ac-bdbd-ded4ecc4e13a","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"bst","order_by":24,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":64023,"visible":true,"origin":"","legend":"","description":"","filename":"snmathphysay.bst","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/403f6660b5961cf725b0139f.bst"},{"id":92223158,"identity":"fd05defd-0727-4742-8164-b12f276602e1","added_by":"auto","created_at":"2025-09-26 03:42:25","extension":"bst","order_by":25,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":64166,"visible":true,"origin":"","legend":"","description":"","filename":"snmathphysnum.bst","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/2fb68d8cfd2f4854e1cf1c74.bst"},{"id":92221674,"identity":"1b26d207-f230-46ec-b950-54be49753bc2","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"bst","order_by":26,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":37333,"visible":true,"origin":"","legend":"","description":"","filename":"snnature.bst","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/b994ac704d2b085bab9dc222.bst"},{"id":92221682,"identity":"f6231987-2143-498c-8825-3a803d3df24f","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"bst","order_by":27,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":39951,"visible":true,"origin":"","legend":"","description":"","filename":"snvancouveray.bst","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/a7653242924bcee13488301d.bst"},{"id":92221666,"identity":"47068d2b-07fb-4ae0-a8a0-14f0670f0627","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"bst","order_by":28,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":40758,"visible":true,"origin":"","legend":"","description":"","filename":"snvancouvernum.bst","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/09feb97fa767dc09b7c82a82.bst"},{"id":92221678,"identity":"918de7c1-f166-44ab-ad80-fd07c6663303","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"bst","order_by":29,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":41304,"visible":true,"origin":"","legend":"","description":"","filename":"snvancouver.bst","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/f9bd162eb491349eaa2b444a.bst"},{"id":92221691,"identity":"e6d7bdfb-5cb3-4401-9c0d-5c9f9ed0a69a","added_by":"auto","created_at":"2025-09-26 03:34:26","extension":"png","order_by":30,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1025524,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineActionSelectionPhasePlanesalphaDensity.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/1d24f6cf1448084da11c160e.png"},{"id":92223160,"identity":"a7d5e0ed-5541-4901-bb73-e24aa76c8ecb","added_by":"auto","created_at":"2025-09-26 03:42:26","extension":"png","order_by":31,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":233804,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineActionSelectionPhasePlanesgammaDensitysingletrace.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/64d4acfa35cc61f1411f70b8.png"},{"id":92221706,"identity":"60235fca-3d70-4a9e-bf2d-9364df47c2d7","added_by":"auto","created_at":"2025-09-26 03:34:26","extension":"png","order_by":32,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":208343,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineActionSelectionWeightLimitsDelay.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/a3a5ee23395f320233b1ed91.png"},{"id":92221695,"identity":"11ad82a5-3b69-421b-8d08-c82389fdd884","added_by":"auto","created_at":"2025-09-26 03:34:26","extension":"png","order_by":33,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1266582,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineActionSelectionWeightsOverTime2Dalpha.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/0197d028e7a30e94870678f8.png"},{"id":92221707,"identity":"be7623ac-af8c-4b98-b7e6-d2a70d8f50c1","added_by":"auto","created_at":"2025-09-26 03:34:26","extension":"png","order_by":34,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1652296,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineActionSelectionWeightsOverTimeContingencySwitchingalpha.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/f6a1650ba72b4c3ba4a16897.png"},{"id":92221684,"identity":"0eabefbb-4b12-4dd5-add0-e9fe942abb2b","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"png","order_by":35,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1728081,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineActionSelectionWeightsOverTimeContingencySwitchinggammasingletrace.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/5c98b034e4e2b98616a7334a.png"},{"id":92221687,"identity":"9e148c9e-c521-4f62-a57f-fd2d8fcfb573","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"png","order_by":36,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":415865,"visible":true,"origin":"","legend":"","description":"","filename":"OnlinePlasticitydiagramcombined.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/c308930488277f28ae0b31e1.png"},{"id":92221676,"identity":"bd7384ad-dd04-409c-9552-2f19c0925082","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"png","order_by":37,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":42352,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineTimingplot.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/9b1168041eb700d2030d1e99.png"},{"id":92221705,"identity":"8d83b90f-82b8-4ce3-8af5-ea451c8370f7","added_by":"auto","created_at":"2025-09-26 03:34:26","extension":"png","order_by":38,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":754693,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineValueEstimationDensityVaryingwinit.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/6b395ef3c93410ac70d85d94.png"},{"id":92223161,"identity":"12a60427-ebb5-4490-87e4-b8a073eca9b8","added_by":"auto","created_at":"2025-09-26 03:42:26","extension":"png","order_by":39,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":689787,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineValueEstimationDensity.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/52d6b94e01d0f178a625a202.png"},{"id":92221696,"identity":"29e63f8f-1e39-4d4d-9a2e-21634fc51b5b","added_by":"auto","created_at":"2025-09-26 03:34:26","extension":"png","order_by":40,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":263414,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineValueEstimationInstantaneousDriftTdelwinit.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/afa963c7c77c0e833d344c13.png"},{"id":92223162,"identity":"6945c3eb-427e-495b-aa0d-3d020ed9f321","added_by":"auto","created_at":"2025-09-26 03:42:26","extension":"png","order_by":41,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":267407,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineValueEstimationInstantaneousDriftepswinit.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/d63b58f1bf993e28c3668c17.png"},{"id":92223163,"identity":"c019e2ff-0a55-4e29-8d77-3856e239defc","added_by":"auto","created_at":"2025-09-26 03:42:27","extension":"png","order_by":42,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":869014,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineValueEstimationPhasePlanesalphaDensity.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/a22c10dca68d696757bf0191.png"},{"id":92221703,"identity":"74cd74f8-5d31-40e6-a885-5d04a621344b","added_by":"auto","created_at":"2025-09-26 03:34:26","extension":"png","order_by":43,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":239595,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineValueEstimationPhasePlanesgammaDensitysingletrace.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/78b8259e1c4422fc7b6c65ed.png"},{"id":92221685,"identity":"b8d69c15-c622-4b73-8b25-f730d7eb60e3","added_by":"auto","created_at":"2025-09-26 03:34:25","extension":"png","order_by":44,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1303388,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineValueEstimationWeightsOverTimeContingencySwitchingalpha.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/d27d8d56538f0a591385608b.png"},{"id":92223159,"identity":"550d0818-e58c-4089-b07c-c2cc93abd78f","added_by":"auto","created_at":"2025-09-26 03:42:26","extension":"png","order_by":45,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1443790,"visible":true,"origin":"","legend":"","description":"","filename":"OnlineValueEstimationWeightsOverTimeContingencySwitchinggammasingletrace.png","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/9d8d14978d016fdf9682931b.png"},{"id":92221690,"identity":"2422118b-50c8-44a0-9bc9-679c3a28cdfe","added_by":"auto","created_at":"2025-09-26 03:34:26","extension":"xml","order_by":46,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":228244,"visible":true,"origin":"","legend":"","description":"","filename":"869613fc797a4e23bfcba4c79cc7632f1structuring.xml","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1/11e95d6ad13f9253eeefebe5.xml"},{"id":92224000,"identity":"2621aae9-5d7b-46f5-919c-321f69a20fb3","added_by":"auto","created_at":"2025-09-26 03:58:52","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":10096640,"visible":true,"origin":"","legend":"","description":"","filename":"PlasticityPaperv3SECOND.pdf","url":"https://assets-eu.researchsquare.com/files/rs-7456628/v1_covered_339b6049-5010-4c92-b7fc-b09dc59e0b29.pdf"}],"financialInterests":"No competing interests reported.","formattedTitle":"Distinct dopaminergic spike-timing-dependent plasticity rules are suited to different functional roles","fulltext":[],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":false,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":false,"highlight":"","institution":"","isAcceptedByJournal":true,"isAuthorSuppliedPdf":true,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":true,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"biological-cybernetics","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"bicy","sideBox":"Learn more about [Biological Cybernetics](http://link.springer.com/journal/422)","snPcode":"422","submissionUrl":"https://submission.nature.com/new-submission/422/3","title":"Biological Cybernetics","twitterHandle":"","acdcEnabled":true,"dfaEnabled":true,"editorialSystem":"em","reportingPortfolio":"Springer Hybrid","inReviewEnabled":true,"inReviewRevisionsEnabled":false},"keywords":"Dopamine, Synaptic plasticity, STDP, Basal ganglia, Reward prediction, Value estimation, Action selection","lastPublishedDoi":"10.21203/rs.3.rs-7456628/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-7456628/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"Various mathematical models have been formulated to describe the changes in synaptic strengths resulting from spike-timing-dependent plasticity (STDP). \nA subset of these models include a third factor, dopamine, which interacts with spike timing to contribute to plasticity at specific synapses, notably those from cortex to striatum at the input layer of the basal ganglia.\nTheoretical work to analyze these plasticity models has largely focused on abstract issues, such as the conditions under which they may promote synchronization and the weight distributions induced by inputs with simple correlation structures, rather than on scenarios associated with specific tasks, and has generally not considered dopamine-dependent forms of STDP.\nIn this paper we introduce forms of dopamine-modulated STDP adapted from previously proposed plasticity rules. We then analyze, mathematically and with simulations, their performance in two biologically relevant scenarios.\nWe test the ability of each of the three models to complete simple value estimation and action selection tasks, studying the learned weight distributions and corresponding task performance in each setting.\nInterestingly, we find that each plasticity rule is well suited to a subset of the scenarios studied but falls short in others. \nDifferent tasks may therefore require different forms of synaptic plasticity, yielding the prediction that the precise form of the STDP mechanism present may vary across regions of the striatum, and other brain areas impacted by dopamine, that are involved in distinct computational functions.","manuscriptTitle":"Distinct dopaminergic spike-timing-dependent plasticity rules are suited to different functional roles","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2025-09-26 03:34:20","doi":"10.21203/rs.3.rs-7456628/v1","editorialEvents":[{"type":"communityComments","content":0},{"type":"decision","content":"Revision requested","date":"2025-10-27T10:57:48+00:00","index":"","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2025-10-24T12:20:01+00:00","index":"hide","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2025-10-09T16:02:15+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"135062386458940602651092925182667116326","date":"2025-09-29T06:43:15+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"325845756836879340007746585695459582780","date":"2025-09-18T10:06:55+00:00","index":"hide","fulltext":""},{"type":"reviewersInvited","content":"","date":"2025-09-17T12:33:15+00:00","index":"","fulltext":""},{"type":"editorAssigned","content":"","date":"2025-08-28T08:08:45+00:00","index":"","fulltext":""},{"type":"checksComplete","content":"","date":"2025-08-27T07:26:09+00:00","index":"","fulltext":""},{"type":"submitted","content":"Biological Cybernetics","date":"2025-08-25T19:31:31+00:00","index":"","fulltext":""}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"biological-cybernetics","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"bicy","sideBox":"Learn more about [Biological Cybernetics](http://link.springer.com/journal/422)","snPcode":"422","submissionUrl":"https://submission.nature.com/new-submission/422/3","title":"Biological Cybernetics","twitterHandle":"","acdcEnabled":true,"dfaEnabled":true,"editorialSystem":"em","reportingPortfolio":"Springer Hybrid","inReviewEnabled":true,"inReviewRevisionsEnabled":false}}],"origin":"","ownerIdentity":"50276903-2cc4-4e38-a8b3-ed294c1657c6","owner":[],"postedDate":"September 26th, 2025","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"under-review","subjectAreas":[],"tags":[],"updatedAt":"2025-12-19T08:24:25+00:00","versionOfRecord":[],"versionCreatedAt":"2025-09-26 03:34:20","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-7456628","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-7456628","identity":"rs-7456628","version":["v1"]},"buildId":"8U1c8b4HqxoKbykW_rLl7","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}

Text is read by the "Ask this paper" AI Q&A widget below. Extraction quality varies by source — PMC NXML preserves structure cleanly, OA-HTML may include some navigation residue, and OA-PDF can have broken hyphenation. The publisher copy (via DOI) is the canonical version.

My notes (saved in your browser only)

Ask this paper AI returns verbatim quotes from the full text · source: preprint-html

Answers must be backed by verbatim quotes from this paper's full text. Hallucinated quotes are dropped automatically; if no verbatim passage answers the question, we say so. How this works

Citation neighborhood (no data yet)

We don't have any in-corpus citations linked to this paper yet. This is a recent paper (2025) — citers typically take a year or two to land, and the OpenAlex reference graph may still be filling in.

Source provenance

europepmc
last seen: 2026-05-20T01:45:00.602351+00:00
unpaywall
last seen: 2026-05-22T02:00:06.705733+00:00
License: CC-BY-4.0