Agreement, reliability and feasibility of two protocols assessing horses’ musculoskeletal and rostral oral health

Agreement, reliability and feasibility of two protocols assessing horses’ musculoskeletal and rostral oral health | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article Agreement, reliability and feasibility of two protocols assessing horses’ musculoskeletal and rostral oral health Marie Roig-Pons, Clémence Pérot, Sabrina Briefer-Freymond This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-5038160/v1 This work is licensed under a CC BY 4.0 License Status: Posted Version 1 posted You are reading this latest preprint version Abstract Slow-feeders, a type of hay dispenser, are becoming increasingly popular among horse keepers, yet there is limited knowledge about their effects on horses’ oral and musculoskeletal health. Existing studies on this topic use varied protocols, complicating comparisons and replication. Thus, validated protocols are essential, ensuring consistent intra- and inter-rater agreement and reliability over time, while also being feasible for implementation in research. In this work, we designed a protocol for the assessment of musculoskeletal health (MSH) and adapted an existing protocol for the assessment of rostral oral cavity (incisors and gums; ROC). We evaluated the agreement between raters obtained with the two protocols, tested their intra- and inter-rater reliability using Kappa and Gwet indices, investigated their feasibility of implementation, and discussed their validity in the context of previous findings. The MSH protocol demonstrates promising inter-observer reliability and substantial intra-rater reliability, indicating consistent use by various practitioners over time. While improvements could enhance its accuracy, the protocol is accessible to those with limited experience, quick to implement, and applicable to all horse types. Preliminary results suggest that this protocol may be a valid tool for assessing MSH in horses. The ROC protocol, with the exception of one item, showed substantial to almost perfect inter- and intra-rater reliability. It has been successfully employed in two studies, yielding consistent findings on the prevalence and severity of dental abnormalities. This protocol demonstrates potential as a non-invasive method for assessing the condition of the rostral oral cavity in horses. Rater training was identified as crucial for the reliability of both protocols. Notably, the Kappa and Gwet indices produced considerably different results, suggesting careful consideration is needed when using the Kappa index to assess protocol reliability. Further research should focus on refining these protocols and exploring their broader applications to enhance their accuracy and ease of use. This study contributes significantly to the field by providing reliable, non-invasive methods for assessing key aspects of equine health, ultimately aiming to improve horse welfare. The findings emphasize the need for standardized protocols to facilitate consistent and accurate evaluations, benefiting both scientific research and practical care in the equine industry. Animal Science Animal Behavior validation rater horse health incisors gingiva muscular tensions Full Text Additional Declarations The authors declare no competing interests. Supplementary Files PaperRepetPreprintSupplementalMaterial.pdf Appendix - Agreement, reliability and feasibility of two protocols assessing horses’ musculoskeletal and rostral oral health Cite Share Download PDF Status: Posted Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-5038160","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Research Article","associatedPublications":[],"authors":[{"id":350015708,"identity":"011a5a81-86f1-4c2a-9f9a-20845d50ad5e","order_by":0,"name":"Marie Roig-Pons","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAABQUlEQVRIie2RP0sDMRTAXzlIl9SsKQfXTyCkHHTRD5MuveUqQhcHKTddF6FrxcUvINjNzZTATZVbgxbpLXWtS6nQwdyfItEijg75DY+E5JeX9x6AxfJPEXlA1cYzjiiwIv6q+H9SDLqRqXzFPcejp0ys4dU7Irdo+f4wDMbjuyzbXp6eEXCyZ3W+AHJjPNOZB2w2gYGP6LLevp7L/kS9+T5OeoNmhPyTkK2ALoShiB5IDLwb03TjNmLRj1SC3Foku/cCOm7IJDDKDSVdgdwVikBaGQYtrTQ/tPIo6puDitJZIFdIlCsOZ2mMaCPPAvhwFrWC2RXjuhbQtcSyPVXIKWqhEg90LRJT9e1jPWe9veBeayx0x+Jhy0uTWtmx0Wj6Eu6kRyaGUlLMi1fTrL7BwSn3+Of9CiLQflEpFovFYin5BHQ7d8Puy3R4AAAAAElFTkSuQmCC","orcid":"https://orcid.org/0009-0005-0326-1454","institution":"University of Bern, VPHI, Animal Welfare Division","correspondingAuthor":true,"prefix":"","firstName":"Marie","middleName":"","lastName":"Roig-Pons","suffix":""},{"id":350015709,"identity":"ce6b5224-198a-4d26-8a2a-ee5442577add","order_by":1,"name":"Clémence Pérot","email":"","orcid":"","institution":"","correspondingAuthor":false,"prefix":"","firstName":"Clémence","middleName":"","lastName":"Pérot","suffix":""},{"id":350015710,"identity":"427513c1-71b7-440e-a0ad-677005f4f0a6","order_by":2,"name":"Sabrina Briefer-Freymond","email":"","orcid":"https://orcid.org/0000-0002-7988-6929","institution":"Agroscope, Swiss national stud farm","correspondingAuthor":false,"prefix":"","firstName":"Sabrina","middleName":"","lastName":"Briefer-Freymond","suffix":""}],"badges":[],"createdAt":"2024-09-05 12:29:24","currentVersionCode":1,"declarations":{"humanSubjects":false,"vertebrateSubjects":true,"conflictsOfInterestStatement":false,"humanSubjectEthicalGuidelines":false,"humanSubjectConsent":false,"humanSubjectClinicalTrial":false,"humanSubjectCaseReport":false,"vertebrateSubjectEthicalGuidelines":true},"doi":"10.21203/rs.3.rs-5038160/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-5038160/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":64063578,"identity":"d8b3c57f-a7cf-4f03-b41a-9d611d80bd7b","added_by":"auto","created_at":"2024-09-06 03:04:55","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":905277,"visible":true,"origin":"","legend":"","description":"","filename":"PaperRepetPreprint.pdf","url":"https://assets-eu.researchsquare.com/files/rs-5038160/v1_covered_454ad2a1-c725-43a9-b7b3-ef060d7710ef.pdf"},{"id":64063381,"identity":"86994415-08dd-47ce-90f3-91bc0dc13fb9","added_by":"auto","created_at":"2024-09-06 02:56:53","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"supplement","size":741041,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cstrong\u003eAppendix - Agreement, reliability and feasibility of two protocols assessing horses’ musculoskeletal and rostral oral health\u003c/strong\u003e\u003c/p\u003e","description":"","filename":"PaperRepetPreprintSupplementalMaterial.pdf","url":"https://assets-eu.researchsquare.com/files/rs-5038160/v1/e21de3153a4936073ca1a704.pdf"}],"financialInterests":"The authors declare no competing interests.","formattedTitle":"\u003cp\u003e\u003cstrong\u003eAgreement, reliability and feasibility of two protocols assessing horses’ musculoskeletal and rostral oral health\u003c/strong\u003e\u003c/p\u003e","fulltext":[],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":false,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":true,"hideJournal":true,"highlight":"","institution":"University of Bern","isAcceptedByJournal":false,"isAuthorSuppliedPdf":true,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":true,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"validation, rater, horse health, incisors, gingiva, muscular tensions","lastPublishedDoi":"10.21203/rs.3.rs-5038160/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-5038160/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003eSlow-feeders, a type of hay dispenser, are becoming increasingly popular among horse keepers, yet there is limited knowledge about their effects on horses’ oral and musculoskeletal health. Existing studies on this topic use varied protocols, complicating comparisons and replication. Thus, validated protocols are essential, ensuring consistent intra- and inter-rater agreement and reliability over time, while also being feasible for implementation in research. In this work, we designed a protocol for the assessment of musculoskeletal health (MSH) and adapted an existing protocol for the assessment of rostral oral cavity (incisors and gums; ROC). We evaluated the agreement between raters obtained with the two protocols, tested their intra- and inter-rater reliability using Kappa and Gwet indices, investigated their feasibility of implementation, and discussed their validity in the context of previous findings. The MSH protocol demonstrates promising inter-observer reliability and substantial intra-rater reliability, indicating consistent use by various practitioners over time. While improvements could enhance its accuracy, the protocol is accessible to those with limited experience, quick to implement, and applicable to all horse types. Preliminary results suggest that this protocol may be a valid tool for assessing MSH in horses. The ROC protocol, with the exception of one item, showed substantial to almost perfect inter- and intra-rater reliability. It has been successfully employed in two studies, yielding consistent findings on the prevalence and severity of dental abnormalities. This protocol demonstrates potential as a non-invasive method for assessing the condition of the rostral oral cavity in horses. Rater training was identified as crucial for the reliability of both protocols. Notably, the Kappa and Gwet indices produced considerably different results, suggesting careful consideration is needed when using the Kappa index to assess protocol reliability. Further research should focus on refining these protocols and exploring their broader applications to enhance their accuracy and ease of use. This study contributes significantly to the field by providing reliable, non-invasive methods for assessing key aspects of equine health, ultimately aiming to improve horse welfare. The findings emphasize the need for standardized protocols to facilitate consistent and accurate evaluations, benefiting both scientific research and practical care in the equine industry.\u003c/p\u003e","manuscriptTitle":"Agreement, reliability and feasibility of two protocols assessing horses’ musculoskeletal and rostral oral health","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2024-09-06 02:56:48","doi":"10.21203/rs.3.rs-5038160/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"3a039a0e-ca42-48b5-a6cc-dcdd14362afd","owner":[],"postedDate":"September 6th, 2024","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"posted","subjectAreas":[{"id":37153306,"name":"Animal Science"},{"id":37153307,"name":"Animal Behavior"}],"tags":[],"updatedAt":"2024-09-06T02:56:48+00:00","versionOfRecord":[],"versionCreatedAt":"2024-09-06 02:56:48","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-5038160","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-5038160","identity":"rs-5038160","version":["v1"]},"buildId":"qtupq5eGEP_6zYnWcrvyt","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}