SkillAR: Omnipresent In-Situ Feedback for Motor Skill Training using AR

SkillAR: Omnipresent In-Situ Feedback for Motor Skill Training using AR | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article SkillAR: Omnipresent In-Situ Feedback for Motor Skill Training using AR Florian Diller, Nico Henkel, Gerik Scheuermann, Alexander Wiebel This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-4841183/v1 This work is licensed under a CC BY 4.0 License Status: Published Journal Publication published 04 Feb, 2025 Read the published version in Virtual Reality → Version 1 posted You are reading this latest preprint version Abstract We present a novel technique called SkillAR to display augmented reality feedback for motor skill learning on a head-mounted display (HMD). SkillAR allows the user to consider movement corrections independent of the head position. Therefore, the user can receive motor feedback comfortably without risking an incorrect exercise performance. Head-mounted displays represent versatile technologies for providing motor feedback regarding skill training. In contrast to room-mounted displays, HMDs are easily portable and wearable. That allows for in-situ feedback in many situations where this would otherwise not be possible. However, the spatial positioning of the 3D feedback is not trivial. On the one hand, the user needs to understand the relation between the body and suggested correction in space. On the other hand, certain exercises demand a specific head positioning to minimize errors and injuries. Depending on the exercise and the type of feedback, these two aspects can be highly conflicting. The paper at hand presents a solution for augmented reality headsets, that provides continuous and omnipresent motor feedback comfortably while facilitating a correct exercise performance. In a user study we verify that SkillAR, given the apparent major advantages for user health and usability, is not disadvantageous compared to conventional feedback methods found in the literature regarding identification and execution time as well as identification accuracy. Furthermore, we found that the users could identify the feedback on the HMD more accurately. Augmented Reality Motor Feedback Head Mounted Display Skill Training Full Text Additional Declarations No competing interests reported. Supplementary Files SupplementalMaterial.mp4 Cite Share Download PDF Status: Published Journal Publication published 04 Feb, 2025 Read the published version in Virtual Reality → Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-4841183","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Research Article","associatedPublications":[],"authors":[{"id":340215327,"identity":"f4b29d9f-4a1a-4768-a66c-715fa1b4c491","order_by":0,"name":"Florian Diller","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAAyElEQVRIiWNgGAWjYDCCw8yNBxgYbBIQIgcIamFsAKpJI0XLAbCWwyRo4TsO1PJxz/k8+QYew8eVOXVAkQb8WiSBDjs449ntYoMDPMaGZ7cdZpA8Q8AaA6CWwzwHbidukH+7TbJx2wEGgxsJRGj5c+Bc4vwGXpCWOgaD+w+I0MJw4EBiwwGwFmagLfh1QPzScyA5ccMB/s+GjdsO80ieIeAwvvOHDz74ccAO6DC2xIdAh8nxHT9AwBp0wEOi+lEwCkbBKBgF2AAANoRRbY8uffwAAAAASUVORK5CYII=","orcid":"","institution":"Hochschule Worms","correspondingAuthor":true,"prefix":"","firstName":"Florian","middleName":"","lastName":"Diller","suffix":""},{"id":340215328,"identity":"99773595-fdaa-4471-9ad9-f1164528466d","order_by":1,"name":"Nico Henkel","email":"","orcid":"","institution":"Hochschule Worms","correspondingAuthor":false,"prefix":"","firstName":"Nico","middleName":"","lastName":"Henkel","suffix":""},{"id":340215329,"identity":"7a38ad4e-d256-453b-9d3d-99862978d8ff","order_by":2,"name":"Gerik Scheuermann","email":"","orcid":"","institution":"Universität Leipzig","correspondingAuthor":false,"prefix":"","firstName":"Gerik","middleName":"","lastName":"Scheuermann","suffix":""},{"id":340215330,"identity":"ce15c9e9-3545-4fd5-9a9b-c575ea82a562","order_by":3,"name":"Alexander Wiebel","email":"","orcid":"","institution":"Hochschule Worms","correspondingAuthor":false,"prefix":"","firstName":"Alexander","middleName":"","lastName":"Wiebel","suffix":""}],"badges":[],"createdAt":"2024-08-01 09:53:28","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-4841183/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-4841183/v1","draftVersion":[],"editorialEvents":[{"content":"https://doi.org/10.1007/s10055-025-01108-1","type":"published","date":"2025-02-04T15:57:12+00:00"}],"editorialNote":"","failedWorkflow":false,"files":[{"id":75932352,"identity":"d9fe160c-6dc8-4a19-b66c-c8aac5f75d21","added_by":"auto","created_at":"2025-02-10 16:17:59","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":2602264,"visible":true,"origin":"","legend":"","description":"","filename":"OmnipresentARFeedbackforMotorSkillLearning.pdf","url":"https://assets-eu.researchsquare.com/files/rs-4841183/v1_covered_c86fd987-7d0e-438b-a6ac-9fe8935228cb.pdf"},{"id":63438840,"identity":"101df1c5-a864-4ecb-9f1a-c2d2b582ad33","added_by":"auto","created_at":"2024-08-28 06:58:07","extension":"mp4","order_by":0,"title":"","display":"","copyAsset":false,"role":"supplement","size":35396817,"visible":true,"origin":"","legend":"","description":"","filename":"SupplementalMaterial.mp4","url":"https://assets-eu.researchsquare.com/files/rs-4841183/v1/9a5cc6ff07f13ed475c953fd.mp4"}],"financialInterests":"No competing interests reported.","formattedTitle":"SkillAR: Omnipresent In-Situ Feedback for Motor Skill Training using AR","fulltext":[],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":false,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":true,"highlight":"","institution":"","isAcceptedByJournal":true,"isAuthorSuppliedPdf":true,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":true,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"Augmented Reality, Motor Feedback, Head Mounted Display, Skill Training","lastPublishedDoi":"10.21203/rs.3.rs-4841183/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-4841183/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"We present a novel technique called SkillAR to display augmented reality feedback for motor skill learning on a head-mounted display (HMD). SkillAR allows the user to consider movement corrections independent of the head position. Therefore, the user can receive motor feedback comfortably without risking an incorrect exercise performance.\nHead-mounted displays represent versatile technologies for providing motor feedback regarding skill training. In contrast to room-mounted displays, HMDs are easily portable and wearable. That allows for in-situ feedback in many situations where this would otherwise not be possible. However, the spatial positioning of the 3D feedback is not trivial. On the one hand, the user needs to understand the relation between the body and suggested correction in space. On the other hand, certain exercises demand a specific head positioning to minimize errors and injuries. Depending on the exercise and the type of feedback, these two aspects can be highly conflicting. The paper at hand presents a solution for augmented reality headsets, that provides continuous and omnipresent motor feedback comfortably while facilitating a correct exercise performance.\nIn a user study we verify that SkillAR, given the apparent major advantages for user health and usability, is not disadvantageous compared to conventional feedback methods found in the literature regarding identification and execution time as well as identification accuracy. Furthermore, we found that the users could identify the feedback on the HMD more accurately.\n\n\n","manuscriptTitle":"SkillAR: Omnipresent In-Situ Feedback for Motor Skill Training using AR","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2024-08-28 06:58:01","doi":"10.21203/rs.3.rs-4841183/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"e6589072-51b2-48ec-a47b-5cca102317b3","owner":[],"postedDate":"August 28th, 2024","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"posted","subjectAreas":[],"tags":[],"updatedAt":"2025-02-10T16:00:25+00:00","versionOfRecord":{"articleIdentity":"rs-4841183","link":"https://doi.org/10.1007/s10055-025-01108-1","journal":{"identity":"virtual-reality","isVorOnly":false,"title":"Virtual Reality"},"publishedOn":"2025-02-04 15:57:12","publishedOnDateReadable":"February 4th, 2025"},"versionCreatedAt":"2024-08-28 06:58:01","video":"","vorDoi":"10.1007/s10055-025-01108-1","vorDoiUrl":"https://doi.org/10.1007/s10055-025-01108-1","workflowStages":[]},"version":"v1","identity":"rs-4841183","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-4841183","identity":"rs-4841183","version":["v1"]},"buildId":"qtupq5eGEP_6zYnWcrvyt","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}