Bayesian optimization for parameter estimation of a local particle filter

Bayesian optimization for parameter estimation of a local particle filter | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Article Bayesian optimization for parameter estimation of a local particle filter Shoichi AKAMI, Keiichi KONDO, Hiroshi L. TANAKA, Mizuo KAJINO This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-7334001/v1 This work is licensed under a CC BY 4.0 License Status: Under Revision Version 1 posted 9 You are reading this latest preprint version Abstract Particle filter (PF) is a powerful data assimilation method that does not assume the linearity in the time evolution of errors or Gaussian error distributions. However, the number of particles required increases exponentially with the dimensions of the dynamical system, which is a bottleneck when applying the PF to numerical weather prediction (NWP) models. Local particle filter (LPF) realizes the PF in high-dimensional systems by the localization, but it has high parameter sensitivity and is challenging to operate stably. On the other hand, when using a nonlinear observation operator, it is possible to estimate the analysis with higher accuracy than the local ensemble transformation Kalman filter (LETKF) by setting the weight inflation factor, which smooths the weights among particles, and the localization scale, to the optima. Therefore, an efficient parameter estimation method is required. Bayesian optimization (BO) is a method for efficiently solving optimization problems of black box functions with high computational costs, and is used for parameter optimization of neural networks. Therefore, we estimated the weight inflation factor and localization scale that minimize the root mean square error between the observations and the forecasts (RMSE(o vs. f)) in the LPF using the BO in the Lorenz-96 40-variable model (L96). As a result, the BO was able to model the response surface with high accuracy and estimate the weight inflation factor and localization scale with accuracy equal to or better than random sampling (RS). In addition, this result was robust to changes in the observation set. However, as the number of parameters to be estimated increased, the BO did not always obtain estimations close to the optima, depending on the observation set. This study has clarified that the BO contributes to improving the practicality of the LPF, and it has also provided suggestions on how the BO should be developed in the future. Since the LPF can estimate high-precision analysis even in strongly nonlinear phenomena, the development of the technology in this study is expected to improve the accuracy of heavy rainfall prediction in the future. The BO will be helpful in atmospheric model experiments for the practical application of the LPF. Local particle filter Parameter estimation Bayesian optimization Gaussian process regression Full Text Additional Declarations No competing interests reported. Cite Share Download PDF Status: Under Revision Version 1 posted Editorial decision: Revision requested 17 Sep, 2025 Reviews received at journal 16 Sep, 2025 Reviews received at journal 09 Sep, 2025 Reviewers agreed at journal 17 Aug, 2025 Reviewers agreed at journal 12 Aug, 2025 Reviewers invited by journal 12 Aug, 2025 Editor assigned by journal 11 Aug, 2025 Submission checks completed at journal 11 Aug, 2025 First submitted to journal 09 Aug, 2025 You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-7334001","acceptedTermsAndConditions":true,"allowDirectSubmit":false,"archivedVersions":[],"articleType":"Article","associatedPublications":[],"authors":[{"id":501397872,"identity":"0b9a20e3-e7a9-49e2-90f4-c8dc185804ec","order_by":0,"name":"Shoichi AKAMI","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAA00lEQVRIiWNgGAWjYDACHiBOqGBgYANSUKEDxGg5Q7IWxjZS3MXfc/jphofztuXzMTA83fCDoVaOgfEsfmskzraZ3UjcdtsSaFHazR6G48YMDOcS8GphOM8A1mLAJv8g7QYPw7HEBoYzBnh1yJ9n/3YjcQ5QC8iWP8RoMTjbA7SlAaLlNg9DDWEthmfOlN1IOAbVImNwwJiNkF/kzqRvu/mj5raBfANP2s03FXVy/BIEQgwJ8AANNzjMwCZxhlgdDOwgw+tAUUW0llEwCkbBKBgZAACsXEtrbO69AAAAAABJRU5ErkJggg==","orcid":"","institution":"University of Tsukuba","correspondingAuthor":true,"prefix":"","firstName":"Shoichi","middleName":"","lastName":"AKAMI","suffix":""},{"id":501397873,"identity":"750d1bd4-08db-4cdd-a6f4-ad5537b34141","order_by":1,"name":"Keiichi KONDO","email":"","orcid":"","institution":"Meteorological Research Institute, Japan Meteorological Agency","correspondingAuthor":false,"prefix":"","firstName":"Keiichi","middleName":"","lastName":"KONDO","suffix":""},{"id":501397874,"identity":"64deae48-eede-4385-8a66-311f83a21032","order_by":2,"name":"Hiroshi L. TANAKA","email":"","orcid":"","institution":"Organization of Volcanic Disaster Mitigation","correspondingAuthor":false,"prefix":"","firstName":"Hiroshi","middleName":"L.","lastName":"TANAKA","suffix":""},{"id":501397875,"identity":"65e58168-af5b-4e5e-ab6e-e02c2f88e5c9","order_by":3,"name":"Mizuo KAJINO","email":"","orcid":"","institution":"Meteorological Research Institute, Japan Meteorological Agency","correspondingAuthor":false,"prefix":"","firstName":"Mizuo","middleName":"","lastName":"KAJINO","suffix":""}],"badges":[],"createdAt":"2025-08-09 12:53:19","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-7334001/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-7334001/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":89551630,"identity":"9a3ada3d-b163-4655-b440-c4addf92be9c","added_by":"auto","created_at":"2025-08-21 08:31:06","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":1534445,"visible":true,"origin":"","legend":"","description":"","filename":"Bayesianoptimizationforparameterestimationofalocalparticlefilter20250809.pdf","url":"https://assets-eu.researchsquare.com/files/rs-7334001/v1_covered_43d79eeb-4a72-4ab2-9ed0-2113b0590b41.pdf"}],"financialInterests":"No competing interests reported.","formattedTitle":"Bayesian optimization for parameter estimation of a local particle filter","fulltext":[],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":false,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":false,"highlight":"","institution":"","isAcceptedByJournal":false,"isAuthorSuppliedPdf":true,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":true,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"journal-of-the-meteorological-society-of-japan","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"","sideBox":"","snPcode":"44394","submissionUrl":"https://submission.springernature.com/new-submission/44394/3","title":"Journal of the Meteorological Society of Japan","twitterHandle":"","acdcEnabled":true,"dfaEnabled":true,"editorialSystem":"stoa","reportingPortfolio":"Springer Open","inReviewEnabled":true,"inReviewRevisionsEnabled":true},"keywords":"Local particle filter, Parameter estimation, Bayesian optimization, Gaussian process regression","lastPublishedDoi":"10.21203/rs.3.rs-7334001/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-7334001/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003eParticle filter (PF) is a powerful data assimilation method that does not assume the linearity in the time evolution of errors or Gaussian error distributions. However, the number of particles required increases exponentially with the dimensions of the dynamical system, which is a bottleneck when applying the PF to numerical weather prediction (NWP) models. Local particle filter (LPF) realizes the PF in high-dimensional systems by the localization, but it has high parameter sensitivity and is challenging to operate stably. On the other hand, when using a nonlinear observation operator, it is possible to estimate the analysis with higher accuracy than the local ensemble transformation Kalman filter (LETKF) by setting the weight inflation factor, which smooths the weights among particles, and the localization scale, to the optima. Therefore, an efficient parameter estimation method is required.\u003c/p\u003e\u003cp\u003eBayesian optimization (BO) is a method for efficiently solving optimization problems of black box functions with high computational costs, and is used for parameter optimization of neural networks. Therefore, we estimated the weight inflation factor and localization scale that minimize the root mean square error between the observations and the forecasts (RMSE(o vs. f)) in the LPF using the BO in the Lorenz-96 40-variable model (L96). As a result, the BO was able to model the response surface with high accuracy and estimate the weight inflation factor and localization scale with accuracy equal to or better than random sampling (RS). In addition, this result was robust to changes in the observation set. However, as the number of parameters to be estimated increased, the BO did not always obtain estimations close to the optima, depending on the observation set.\u003c/p\u003e\u003cp\u003eThis study has clarified that the BO contributes to improving the practicality of the LPF, and it has also provided suggestions on how the BO should be developed in the future. Since the LPF can estimate high-precision analysis even in strongly nonlinear phenomena, the development of the technology in this study is expected to improve the accuracy of heavy rainfall prediction in the future. The BO will be helpful in atmospheric model experiments for the practical application of the LPF.\u003c/p\u003e","manuscriptTitle":"Bayesian optimization for parameter estimation of a local particle filter","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2025-08-21 07:58:56","doi":"10.21203/rs.3.rs-7334001/v1","editorialEvents":[{"type":"communityComments","content":0},{"type":"decision","content":"Revision requested","date":"2025-09-18T01:44:21+00:00","index":"","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2025-09-16T22:54:07+00:00","index":"hide","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2025-09-09T22:33:58+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"49221436058835431712226943148015883302","date":"2025-08-17T04:18:13+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"169188085752668282504834880235959471958","date":"2025-08-13T01:28:33+00:00","index":"hide","fulltext":""},{"type":"reviewersInvited","content":"","date":"2025-08-12T23:59:55+00:00","index":"","fulltext":""},{"type":"editorAssigned","content":"","date":"2025-08-12T03:53:01+00:00","index":"","fulltext":""},{"type":"checksComplete","content":"","date":"2025-08-12T03:51:46+00:00","index":"","fulltext":""},{"type":"submitted","content":"Journal of the Meteorological Society of Japan","date":"2025-08-09T12:46:36+00:00","index":"","fulltext":""}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"journal-of-the-meteorological-society-of-japan","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"","sideBox":"","snPcode":"44394","submissionUrl":"https://submission.springernature.com/new-submission/44394/3","title":"Journal of the Meteorological Society of Japan","twitterHandle":"","acdcEnabled":true,"dfaEnabled":true,"editorialSystem":"stoa","reportingPortfolio":"Springer Open","inReviewEnabled":true,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"995c0095-9d57-4643-b511-e1394b04a5a1","owner":[],"postedDate":"August 21st, 2025","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"in-revision","subjectAreas":[],"tags":[],"updatedAt":"2025-12-02T03:38:13+00:00","versionOfRecord":[],"versionCreatedAt":"2025-08-21 07:58:56","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-7334001","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-7334001","identity":"rs-7334001","version":["v1"]},"buildId":"8U1c8b4HqxoKbykW_rLl7","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}