Toward Robust Human Pose Estimation under Real-World Image Degradations and Restoration Scenarios

Toward Robust Human Pose Estimation under Real-World Image Degradations and Restoration Scenarios | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article Toward Robust Human Pose Estimation under Real-World Image Degradations and Restoration Scenarios Nada E. Elshami, Ahmad Salah, Amr Abdellatif, Heba Mohsen This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-6535912/v1 This work is licensed under a CC BY 4.0 License Status: Posted Version 1 posted You are reading this latest preprint version Abstract Human Pose Estimation (HPE) models have varied applications and represent a cutting-edge branch of study, whose systems such as MediaPipe (MP) and OpenPose (OP) showing marked success. One of these areas, however, that is inadequately researched is the impact of image degradation on the accuracy of HPE models. Image degradation refers to images whose visual quality has been purposefully diminished by means of techniques like brightness adjustments- which can lead to an increase or a decrease in the intensity levels-, geometric rotations, or resolution downscaling. The study of how these types of degradation impact the functionality of HPE models is a virtually unexplored area. In addition, current methods of improving degraded images to a high quality have not been well examined in relation to improving HPE models. In this study, we clearly demonstrate a drop in the precision of the HPE model when image quality is degraded. Our qualitative and quantitative measurements identify a wide difference in performance in identifying landmarks as images undergo changes in brightness, rotations, or reductions in resolution. Additionally, we have tested a variety of existing image enhancement methods in an attempt to enhance their capability in restoring low quality images, hence supporting improved functionality of HPE. Interestingly, for rotated images, using Pillow of OpenCV improves landmark recognition precision drastically, nearly restoring it to levels we see in high-quality images. In instances of brightness variation and in low-quality images, however, existing methods of enhancement fail to yield the improvements anticipated, highlighting a large direction of study that calls for additional research. In this regard, we proposed a wide-ranging system for classifying different types of image degradation systematically and for selecting appropriate algorithms for image restoration, in an effort to restore image quality. In a relative study of current methods, the Tuned RotNet model surpass official RotNet model in predicting rotation degree of images, where the accuracy of official RotNet and Tuned RotNet classifier were of 61.59% and 92.04%, respectively. Besides, in an effort to make it easier for other studies, we provide a new dataset of reference images and corresponding degenerated images, since currently there is a lack of controlled comparatives. Cloudinary Degraded Image FSRCNN HPE MediaPipe MobileNet MPII OpenCV OpenPose and RotNet Full Text Additional Declarations No competing interests reported. Cite Share Download PDF Status: Posted Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-6535912","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Research Article","associatedPublications":[],"authors":[{"id":451801989,"identity":"98abbf35-889a-421c-91d7-ffc4ec74ffbc","order_by":0,"name":"Nada E. Elshami","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAABKklEQVRIie3Rv0rEMBzA8V8odIpmrVT0FXIUSsF6fZWUQl0qCEJxcLipU9G1t/kIPQTnSOC6hLs10OVucXLo2OXE1sPDoS2Ogv1OTciH/CnA2NgfjHKg+y+hcV65gPcjvZ84B1Ik/jYLf0HcA5HSsnD4PT9ECrGo4O7l/Fgx23TZ9BSIpFDFAgh56iS2DG8NkOVkrlhoRixoDiYpylYCTrJNN+ERNVBSolyxpXldcwwopdpRIoAq3kms9btVo4/Sy5WfmA5riIaptmuI10MmKrINNCv9XArNgpboDUHtLmTWQ95ihy3LYF4kaJs2d9GxfvOarq6wobpfjK6DZ1Xdl5cPglS8ZlOPELHY1PHFGXnsPthX7Oeg/SPtWgwG61g7HBnYZWxsbOw/9Qme5maz4yloewAAAABJRU5ErkJggg==","orcid":"","institution":"Zagazig University","correspondingAuthor":true,"prefix":"","firstName":"Nada","middleName":"E.","lastName":"Elshami","suffix":""},{"id":451801990,"identity":"670468fd-6705-4f60-931b-c53ac0647569","order_by":1,"name":"Ahmad Salah","email":"","orcid":"","institution":"University of Technology and Applied Sciences","correspondingAuthor":false,"prefix":"","firstName":"Ahmad","middleName":"","lastName":"Salah","suffix":""},{"id":451801991,"identity":"f45af750-529b-4ef6-b568-9ad6cc8048cd","order_by":2,"name":"Amr Abdellatif","email":"","orcid":"","institution":"Zagazig University","correspondingAuthor":false,"prefix":"","firstName":"Amr","middleName":"","lastName":"Abdellatif","suffix":""},{"id":451801992,"identity":"b404ed37-f19a-4ea0-866e-e232cef15abc","order_by":3,"name":"Heba Mohsen","email":"","orcid":"","institution":"Future University in Egypt","correspondingAuthor":false,"prefix":"","firstName":"Heba","middleName":"","lastName":"Mohsen","suffix":""}],"badges":[],"createdAt":"2025-04-26 15:38:04","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-6535912/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-6535912/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":85855331,"identity":"fe589b16-0475-4251-abbb-9475c35a7eb8","added_by":"auto","created_at":"2025-07-02 11:17:11","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":16133260,"visible":true,"origin":"","legend":"","description":"","filename":"NadasSecondPaper7.pdf","url":"https://assets-eu.researchsquare.com/files/rs-6535912/v1_covered_df497c2b-bcc2-4e70-8b2d-0fb2bab09a90.pdf"}],"financialInterests":"No competing interests reported.","formattedTitle":"Toward Robust Human Pose Estimation under Real-World Image Degradations and Restoration Scenarios","fulltext":[],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":false,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":true,"highlight":"","institution":"","isAcceptedByJournal":false,"isAuthorSuppliedPdf":true,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":true,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"Cloudinary, Degraded Image, FSRCNN, HPE, MediaPipe, MobileNet, MPII, OpenCV, OpenPose and RotNet","lastPublishedDoi":"10.21203/rs.3.rs-6535912/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-6535912/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"Human Pose Estimation (HPE) models have varied applications and represent a cutting-edge branch of study, whose systems such as MediaPipe (MP) and OpenPose (OP) showing marked success. One of these areas, however, that is inadequately researched is the impact of image degradation on the accuracy of HPE models. Image degradation refers to images whose visual quality has been purposefully diminished by means of techniques like brightness adjustments- which can lead to an increase or a decrease in the intensity levels-, geometric rotations, or resolution downscaling. The study of how these types of degradation impact the functionality of HPE models is a virtually unexplored area. In addition, current methods of improving degraded images to a high quality have not been well examined in relation to improving HPE models. In this study, we clearly demonstrate a drop in the precision of the HPE model when image quality is degraded. Our qualitative and quantitative measurements identify a wide difference in performance in identifying landmarks as images undergo changes in brightness, rotations, or reductions in resolution. Additionally, we have tested a variety of existing image enhancement methods in an attempt to enhance their capability in restoring low quality images, hence supporting improved functionality of HPE. Interestingly, for rotated images, using Pillow of OpenCV improves landmark recognition precision drastically, nearly restoring it to levels we see in high-quality images. In instances of brightness variation and in low-quality images, however, existing methods of enhancement fail to yield the improvements anticipated, highlighting a large direction of study that calls for additional research. In this regard, we proposed a wide-ranging system for classifying different types of image degradation systematically and for selecting appropriate algorithms for image restoration, in an effort to restore image quality. In a relative study of current methods, the Tuned RotNet model surpass official RotNet model in predicting rotation degree of images, where the accuracy of official RotNet and Tuned RotNet classifier were of 61.59\\% and 92.04\\%, respectively. Besides, in an effort to make it easier for other studies, we provide a new dataset of reference images and corresponding degenerated images, since currently there is a lack of controlled comparatives.","manuscriptTitle":"Toward Robust Human Pose Estimation under Real-World Image Degradations and Restoration Scenarios","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2025-05-07 03:55:07","doi":"10.21203/rs.3.rs-6535912/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"4f4ffa47-fb75-49e0-add7-6409d2141472","owner":[],"postedDate":"May 7th, 2025","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"posted","subjectAreas":[],"tags":[],"updatedAt":"2025-07-02T11:09:02+00:00","versionOfRecord":[],"versionCreatedAt":"2025-05-07 03:55:07","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-6535912","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-6535912","identity":"rs-6535912","version":["v1"]},"buildId":"8U1c8b4HqxoKbykW_rLl7","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}