Occluded Person Re-ID Based on Dual Attention Mask Guidance

Occluded Person Re-ID Based on Dual Attention Mask Guidance | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article Occluded Person Re-ID Based on Dual Attention Mask Guidance Kaiyang Liao, Jie Lin, Yuanlin Zheng, Haiwen Liu, Yunfei Tan, and 1 more This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-4629127/v1 This work is licensed under a CC BY 4.0 License Status: Posted Version 1 posted You are reading this latest preprint version Abstract Occluded person re-identification aims to match occluded pedestrian with pedestrian images from nonintersecting cameras. For dealing with the task of Occluded Person Re-ID, existing methods focus only on tackling the pedestrian occlusion issue. Yet they all ignore the fact that salient nonhuman body parts such as hats, bags, and jewelry can provide more discriminatory informational cues. In this regard, this paper proposed an Occluded Person Re-ID algorithm based on Dual Attention Mask (DAM) guidance, which simultaneously solves the problems of pedestrian occlusion and significant non-human body part features that are easily ignored. Specifically, DAM consists of Pose Attention (PA) and Saliency Attention (SA). PA utilizes human pose key points to generate heatmap, and the produced heatmap indicates whether a specific body part is occluded or not, as well as guides the model to focus on the non-occluded region. SA then locates dropped salient non-human body part features through spatial attention and channel attention, and generates a saliency attention heat map to direct the model focus on the salient non-human body part features. Accordingly, DAM not only highlights the visible body parts while suppressing the occluded parts, but also localizes the prominent non-human body parts in the background. Finally, extensive experiments on three occlusion datasets demonstrate the effectiveness of our proposed method. Person Re-ID Pose-Guided Saliency attention human posture mask Full Text Additional Declarations No competing interests reported. Cite Share Download PDF Status: Posted Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-4629127","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Research Article","associatedPublications":[],"authors":[{"id":320693083,"identity":"7b2084ae-7412-4189-8781-dd2c32d6ca61","order_by":0,"name":"Kaiyang Liao","email":"","orcid":"","institution":"Xi'an University of Technology","correspondingAuthor":false,"prefix":"","firstName":"Kaiyang","middleName":"","lastName":"Liao","suffix":""},{"id":320693085,"identity":"8f0e84ec-2fd5-4bbb-ab8e-50be4224b66c","order_by":1,"name":"Jie Lin","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAAxUlEQVRIiWNgGAWjYBACNvnDBx8kGEjIybM3HyBOC58EW7LBgwoLY8OeYwnEaZGT4DGTfHCmIrHhRo4BkQ6TbjA2SGyTMGbsOfPxxhsGOzndBkJaZA4kPgBqkWNn791sOYch2djsACEtDAmHobac3SbNw3AgcRthLUD1IAT0yzMitUgks0kknAFrYSNSC88xZoOECglQIBtbzjEgwi/y7f0fH/4wqANF5cMbbyrs5AhqQQESPERGDbIWUnWMglEwCkbBiAAAHNZDJl0zBXYAAAAASUVORK5CYII=","orcid":"","institution":"Xi'an University of Technology","correspondingAuthor":true,"prefix":"","firstName":"Jie","middleName":"","lastName":"Lin","suffix":""},{"id":320693086,"identity":"c083e398-bce5-4b76-bbe7-dfc71aac586d","order_by":2,"name":"Yuanlin Zheng","email":"","orcid":"","institution":"Xi'an University of Technology","correspondingAuthor":false,"prefix":"","firstName":"Yuanlin","middleName":"","lastName":"Zheng","suffix":""},{"id":320693088,"identity":"a47b6a6c-e09c-44f5-90da-5837f5852066","order_by":3,"name":"Haiwen Liu","email":"","orcid":"","institution":"Xi'an University of Technology","correspondingAuthor":false,"prefix":"","firstName":"Haiwen","middleName":"","lastName":"Liu","suffix":""},{"id":320693089,"identity":"5c184f4a-4eb6-42e3-994f-f6c9edd282ed","order_by":4,"name":"Yunfei Tan","email":"","orcid":"","institution":"Xi'an University of Technology","correspondingAuthor":false,"prefix":"","firstName":"Yunfei","middleName":"","lastName":"Tan","suffix":""},{"id":320693092,"identity":"c800a039-aeaf-4d62-8f1e-5c817efba230","order_by":5,"name":"Wen Feng","email":"","orcid":"","institution":"Xi'an University of Technology","correspondingAuthor":false,"prefix":"","firstName":"Wen","middleName":"","lastName":"Feng","suffix":""}],"badges":[],"createdAt":"2024-06-24 09:39:30","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-4629127/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-4629127/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":68732070,"identity":"49f6e35c-d4d9-4cd9-8b56-292aaba0968e","added_by":"auto","created_at":"2024-11-11 12:39:04","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":650280,"visible":true,"origin":"","legend":"","description":"","filename":"OccludedPersonReIDBasedonDualAttentionMaskGuidance.pdf","url":"https://assets-eu.researchsquare.com/files/rs-4629127/v1_covered_9f519312-cd1a-49d3-850d-23b746525dbd.pdf"}],"financialInterests":"No competing interests reported.","formattedTitle":"Occluded Person Re-ID Based on Dual Attention Mask Guidance","fulltext":[],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":false,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":true,"highlight":"","institution":"","isAcceptedByJournal":false,"isAuthorSuppliedPdf":true,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":true,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"Person Re-ID, Pose-Guided, Saliency attention, human posture mask","lastPublishedDoi":"10.21203/rs.3.rs-4629127/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-4629127/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003eOccluded person re-identification aims to match occluded pedestrian with pedestrian images from nonintersecting cameras. For dealing with the task of Occluded Person Re-ID, existing methods focus only on tackling the pedestrian occlusion issue. Yet they all ignore the fact that salient nonhuman body parts such as hats, bags, and jewelry can provide more discriminatory informational cues. In this regard, this paper proposed an Occluded Person Re-ID algorithm based on Dual Attention Mask (DAM) guidance, which simultaneously solves the problems of pedestrian occlusion and significant non-human body part features that are easily ignored. Specifically, DAM consists of Pose Attention (PA) and Saliency Attention (SA). PA utilizes human pose key points to generate heatmap, and the produced heatmap indicates whether a specific body part is occluded or not, as well as guides the model to focus on the non-occluded region. SA then locates dropped salient non-human body part features through spatial attention and channel attention, and generates a saliency attention heat map to direct the model focus on the salient non-human body part features. Accordingly, DAM not only highlights the visible body parts while suppressing the occluded parts, but also localizes the prominent non-human body parts in the background. Finally, extensive experiments on three occlusion datasets demonstrate the effectiveness of our proposed method.\u003c/p\u003e","manuscriptTitle":"Occluded Person Re-ID Based on Dual Attention Mask Guidance","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2024-07-24 08:41:19","doi":"10.21203/rs.3.rs-4629127/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"086881a3-b3a4-4608-9f37-e4a513f46271","owner":[],"postedDate":"July 24th, 2024","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"posted","subjectAreas":[],"tags":[],"updatedAt":"2024-11-11T12:38:25+00:00","versionOfRecord":[],"versionCreatedAt":"2024-07-24 08:41:19","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-4629127","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-4629127","identity":"rs-4629127","version":["v1"]},"buildId":"qtupq5eGEP_6zYnWcrvyt","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}