Abstract
The convergence of multi-modal sensing and constrained computing on personal devices demands efficient algorithmic frameworks for fusing heterogeneous data streams-visual, depth, inertial, and biometric-under stringent latency, memory, and power constraints. This paper presents a unified mathematical framework for on-device multi-modal fusion, grounded in constrained convex optimization and operator splitting theory. We formulate the fusion problem as minimization of a composite objective function, coupling modality-specific loss terms through linear consensus constraints, regularized by structured sparsity and low-rank priors. The central contribution is a Preconditioned Asynchronously Parallel Alternating Direction Method of Multipliers (PAP-ADMM), tailored for architectures with heterogeneous computational loads across modalities. We derive closed-form solutions for proximal operators associated with logistic regression, group lasso, and nuclear norm regularization, which are ubiquitous in personalization and security tasks. Convergence analysis establishes a non-asymptotic rate of O(1/k) under bounded delay conditions. Extensive experiments on synthetic benchmarks and a concrete application-fusing RGB and depth features for contactless palm-print authentication-validate the framework's efficacy. The proposed solver achieves up to 3.5x speedup over synchronous ADMM and reduces memory footprint by 45% on embedded hardware, while maintaining or improving accuracy. This work provides both theoretical foundations and practical tools for developing efficient, private, and robust on-device intelligent systems.
Full text
6,786 characters
· extracted from
preprint-html
· click to expand
Efficient Multi-Modal Fusion via Preconditioned and Asynchronously Parallel ADMM for On-Device Personalization and Security | Authorea try { document.documentElement.classList.add('js'); } catch (e) { } var _gaq = _gaq || []; _gaq.push(['_setAccount', 'G-8VDV14Y67G']); _gaq.push(['_trackPageview']); (function() { var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true; ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js'; var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s); })(); Skip to main content Preprints Collections Wiley Open Research IET Open Research Ecological Society of Japan All Collections About About Authorea FAQs Contact Us Quick Search anywhere Search for preprint articles, keywords, etc. Search Search ADVANCED SEARCH SCROLL This is a preprint and has not been peer reviewed. Data may be preliminary. 2 March 2026 V1 Latest version Share on Efficient Multi-Modal Fusion via Preconditioned and Asynchronously Parallel ADMM for On-Device Personalization and Security Authors : Li Wei Ming 0009-0004-3442-8416 [email protected] and Aarav Sharma Authors Info & Affiliations https://doi.org/10.22541/au.177247871.19351740/v1 103 views 60 downloads Contents Abstract Supplementary Material Information & Authors Metrics & Citations View Options References Figures Tables Media Share Abstract The convergence of multi-modal sensing and constrained computing on personal devices demands efficient algorithmic frameworks for fusing heterogeneous data streams-visual, depth, inertial, and biometric-under stringent latency, memory, and power constraints. This paper presents a unified mathematical framework for on-device multi-modal fusion, grounded in constrained convex optimization and operator splitting theory. We formulate the fusion problem as minimization of a composite objective function, coupling modality-specific loss terms through linear consensus constraints, regularized by structured sparsity and low-rank priors. The central contribution is a Preconditioned Asynchronously Parallel Alternating Direction Method of Multipliers (PAP-ADMM), tailored for architectures with heterogeneous computational loads across modalities. We derive closed-form solutions for proximal operators associated with logistic regression, group lasso, and nuclear norm regularization, which are ubiquitous in personalization and security tasks. Convergence analysis establishes a non-asymptotic rate of O(1/k) under bounded delay conditions. Extensive experiments on synthetic benchmarks and a concrete application-fusing RGB and depth features for contactless palm-print authentication-validate the framework's efficacy. The proposed solver achieves up to 3.5x speedup over synchronous ADMM and reduces memory footprint by 45% on embedded hardware, while maintaining or improving accuracy. This work provides both theoretical foundations and practical tools for developing efficient, private, and robust on-device intelligent systems. Supplementary Material File (efficient_multi_modal_fusion.pdf) Download 525.09 KB Information & Authors Information Version history V1 Version 1 02 March 2026 Copyright This work is licensed under a Creative Commons Attribution 4.0 International License Keywords admm biometrics convex optimization edge computing multi-modal fusion Authors Affiliations Li Wei Ming 0009-0004-3442-8416 [email protected] View all articles by this author Aarav Sharma Nippon Institute of Technology View all articles by this author Metrics & Citations Metrics Article Usage 103 views 60 downloads .FvxKWukQNSOunydq8rnd { width: 100px; } Citations Download citation Li Wei Ming, Aarav Sharma. Efficient Multi-Modal Fusion via Preconditioned and Asynchronously Parallel ADMM for On-Device Personalization and Security. Authorea . 02 March 2026. DOI: https://doi.org/10.22541/au.177247871.19351740/v1 If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download. For more information or tips please see 'Downloading to a citation manager' in the Help menu . Format Please select one from the list RIS (ProCite, Reference Manager) EndNote BibTex Medlars RefWorks Direct import Tips for downloading citations document.getElementById('citMgrHelpLink').addEventListener('click', function() { popupHelp(this.href); return false; }); $(".js__slcInclude").on("change", function(e){ if ($(this).val() == 'refworks') $('#direct').prop("checked", false); $('#direct').prop("disabled", ($(this).val() == 'refworks')); }); View Options View options PDF View PDF Figures Tables Media Share Share Share article link Copy Link Copied! Copying failed. Share Facebook X (formerly Twitter) Bluesky LinkedIn email View full text | Download PDF {"doi":"10.22541/au.177247871.19351740/v1","type":"Article"} Now Reading: Share Figures Tables Close figure viewer Back to article Figure title goes here Change zoom level Go to figure location within the article Download figure Toggle share panel Toggle share panel Share Toggle information panel Toggle information panel Go to previous graphic Go to next graphic Go to previous table Go to next table All figures All tables View all material View all material xrefBack.goTo xrefBack.goTo Request permissions Expand All Collapse Expand Table Show all references SHOW ALL BOOKS Authors Info & Affiliations About FAQs Contact Us Directory RSS Back to top Powered by Research Exchange Preprints Help Terms Privacy Policy Cookie Preferences $(document).ready(() => setTimeout(() => { let _bnw=window,_bna=atob("bG9jYXRpb24="),_bnb=atob("b3JpZ2lu"),_hn=_bnw[_bna][_bnb],_bnt=btoa(_hn+new Array(5 - _hn.length % 4).join(" ")); $.get("/resource/lodash?t="+_bnt); },4000)); (function(){function c(){var b=a.contentDocument||a.contentWindow.document;if(b){var d=b.createElement('script');d.innerHTML="window.__CF$cv$params={r:'9fe1b7a0bea941e2',t:'MTc3OTE3OTE5Mg=='};var a=document.createElement('script');a.src='/cdn-cgi/challenge-platform/scripts/jsd/main.js';document.getElementsByTagName('head')[0].appendChild(a);";b.getElementsByTagName('head')[0].appendChild(d)}}if(document.body){var a=document.createElement('iframe');a.height=1;a.width=1;a.style.position='absolute';a.style.top=0;a.style.left=0;a.style.border='none';a.style.visibility='hidden';document.body.appendChild(a);if('loading'!==document.readyState)c();else if(window.addEventListener)document.addEventListener('DOMContentLoaded',c);else{var e=document.onreadystatechange||function(){};document.onreadystatechange=function(b){e(b);'loading'!==document.readyState&&(document.onreadystatechange=e,c())}}}})();
Text is read by the "Ask this paper" AI Q&A widget below.
Extraction quality varies by source — PMC NXML preserves structure
cleanly, OA-HTML may include some navigation residue, and OA-PDF can
have broken hyphenation. The publisher copy
(via DOI)
is the canonical version.