Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement

preprint OA: closed
Full text JSON View at publisher

Abstract

BackgroundThe objective was to summarize the methodology used to develop the international minimum data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement. This is a recommended list of elements to be collected and reported when conducting injury surveillance research in military settings.MethodsA Delphi methodology was employed to reach consensus. Preliminary steps included conducting a literature review and surveying a convenience sample of military stakeholders to 1) identify barriers and facilitators of military musculoskeletal injury (MSKI) prevention programs, 2) identify relevant knowledge gaps, and 3) establish future research priorities. A sequential three-round Delphi consensus survey followed, including relevant stakeholders from militaries around the world, using results to conduct an asynchronous knowledge user meeting (mixture of in-person and live video conference and recording) to explore the level of agreement among subject matter experts. Knowledge users, including former and current military service members, civilian practitioners working in military health networks, and international subject matter experts having experience with policy, execution, or clinical investigation of MSKI mitigation programs, MSKI diagnoses, and MSKI risk factors in military settings. For each round, participants scored questions on a Likert scale of 1-5. Scores ranged from No Importance (1) to Strong Importance (5).ResultsLiterature review and surveys helped inform the scope of potential variables. Three rounds were necessary to reach minimum consensus. Ninety-five, 65, and 42 respondents participated in the first, second and third rounds, respectively.ConclusionsAchieving consensus across relevant knowledge users representing military organizations globally can be challenging. This paper details the methodology employed to reach consensus for a core minimum data elements checklist for conducting MSKI research in military settings and improve data harmonization and scalability efforts. These methods can be used as a resource to assist in future consensus endeavors of similar nature.
Full text 236,556 characters · extracted from preprint-html · click to expand
Methodology used to develop the minimum common data... | F1000Research "use strict";function _typeof(t){return(_typeof="function"==typeof Symbol&&"symbol"==typeof Symbol.iterator?function(t){return typeof t}:function(t){return t&&"function"==typeof Symbol&&t.constructor===Symbol&&t!==Symbol.prototype?"symbol":typeof t})(t)}!function(){var t=function(){var t,e,o=[],n=window,r=n;for(;r;){try{if(r.frames.__tcfapiLocator){t=r;break}}catch(t){}if(r===n.top)break;r=r.parent}t||(!function t(){var e=n.document,o=!!n.frames.__tcfapiLocator;if(!o)if(e.body){var r=e.createElement("iframe");r.style.cssText="display:none",r.name="__tcfapiLocator",e.body.appendChild(r)}else setTimeout(t,5);return!o}(),n.__tcfapi=function(){for(var t=arguments.length,n=new Array(t),r=0;r 3&&2===parseInt(n[1],10)&&"boolean"==typeof n[3]&&(e=n[3],"function"==typeof n[2]&&n[2]("set",!0)):"ping"===n[0]?"function"==typeof n[2]&&n[2]({gdprApplies:e,cmpLoaded:!1,cmpStatus:"stub"}):o.push(n)},n.addEventListener("message",(function(t){var e="string"==typeof t.data,o={};if(e)try{o=JSON.parse(t.data)}catch(t){}else o=t.data;var n="object"===_typeof(o)&&null!==o?o.__tcfapiCall:null;n&&window.__tcfapi(n.command,n.version,(function(o,r){var a={__tcfapiReturn:{returnValue:o,success:r,callId:n.callId}};t&&t.source&&t.source.postMessage&&t.source.postMessage(e?JSON.stringify(a):a,"*")}),n.parameter)}),!1))};"undefined"!=typeof module?module.exports=t:t()}(); dataLayer = dataLayer || []; // Standard GTM initialization - Google Consent Mode handles consent automatically (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start': new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0], j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src= 'https://www.googletagmanager.com/gtm.js?id='+i+dl+ '>m_auth=hzk0Vc3qFsQYhCrIoHz68A>m_preview=env-1>m_cookies_win=x';f.parentNode.insertBefore(j,f); })(window,document,'script','dataLayer','GTM-MWFK8L5J'); ;window.NREUM||(NREUM={});NREUM.init={distributed_tracing:{enabled:true},privacy:{cookies_enabled:true},ajax:{deny_list:["bam.nr-data.net"]}}; ;NREUM.loader_config={accountID:"438030",trustKey:"438030",agentID:"772317073",licenseKey:"97f8f67f26",applicationID:"772317073"} ;NREUM.info={beacon:"bam.nr-data.net",errorBeacon:"bam.nr-data.net",licenseKey:"97f8f67f26",applicationID:"772317073",sa:1} ;/*! For license information please see nr-loader-spa-1.236.0.min.js.LICENSE.txt */ (()=>{"use strict";var e,t,r={5763:(e,t,r)=>{r.d(t,{P_:()=>l,Mt:()=>g,C5:()=>s,DL:()=>v,OP:()=>T,lF:()=>D,Yu:()=>y,Dg:()=>h,CX:()=>c,GE:()=>b,sU:()=>_});var n=r(8632),i=r(9567);const o={beacon:n.ce.beacon,errorBeacon:n.ce.errorBeacon,licenseKey:void 0,applicationID:void 0,sa:void 0,queueTime:void 0,applicationTime:void 0,ttGuid:void 0,user:void 0,account:void 0,product:void 0,extra:void 0,jsAttributes:{},userAttributes:void 0,atts:void 0,transactionName:void 0,tNamePlain:void 0},a={};function s(e){if(!e)throw new Error("All info objects require an agent identifier!");if(!a[e])throw new Error("Info for ".concat(e," was never set"));return a[e]}function c(e,t){if(!e)throw new Error("All info objects require an agent identifier!");a[e]=(0,i.D)(t,o),(0,n.Qy)(e,a[e],"info")}var u=r(7056);const d=()=>{const e={blockSelector:"[data-nr-block]",maskInputOptions:{password:!0}};return{allow_bfcache:!0,privacy:{cookies_enabled:!0},ajax:{deny_list:void 0,enabled:!0,harvestTimeSeconds:10},distributed_tracing:{enabled:void 0,exclude_newrelic_header:void 0,cors_use_newrelic_header:void 0,cors_use_tracecontext_headers:void 0,allowed_origins:void 0},session:{domain:void 0,expiresMs:u.oD,inactiveMs:u.Hb},ssl:void 0,obfuscate:void 0,jserrors:{enabled:!0,harvestTimeSeconds:10},metrics:{enabled:!0},page_action:{enabled:!0,harvestTimeSeconds:30},page_view_event:{enabled:!0},page_view_timing:{enabled:!0,harvestTimeSeconds:30,long_task:!1},session_trace:{enabled:!0,harvestTimeSeconds:10},harvest:{tooManyRequestsDelay:60},session_replay:{enabled:!1,harvestTimeSeconds:60,sampleRate:.1,errorSampleRate:.1,maskTextSelector:"*",maskAllInputs:!0,get blockClass(){return"nr-block"},get ignoreClass(){return"nr-ignore"},get maskTextClass(){return"nr-mask"},get blockSelector(){return e.blockSelector},set blockSelector(t){e.blockSelector+=",".concat(t)},get maskInputOptions(){return e.maskInputOptions},set maskInputOptions(t){e.maskInputOptions={...t,password:!0}}},spa:{enabled:!0,harvestTimeSeconds:10}}},f={};function l(e){if(!e)throw new Error("All configuration objects require an agent identifier!");if(!f[e])throw new Error("Configuration for ".concat(e," was never set"));return f[e]}function h(e,t){if(!e)throw new Error("All configuration objects require an agent identifier!");f[e]=(0,i.D)(t,d()),(0,n.Qy)(e,f[e],"config")}function g(e,t){if(!e)throw new Error("All configuration objects require an agent identifier!");var r=l(e);if(r){for(var n=t.split("."),i=0;i {r.d(t,{D:()=>i});var n=r(50);function i(e,t){try{if(!e||"object"!=typeof e)return(0,n.Z)("Setting a Configurable requires an object as input");if(!t||"object"!=typeof t)return(0,n.Z)("Setting a Configurable requires a model to set its initial properties");const r=Object.create(Object.getPrototypeOf(t),Object.getOwnPropertyDescriptors(t)),o=0===Object.keys(r).length?e:r;for(let a in o)if(void 0!==e[a])try{"object"==typeof e[a]&&"object"==typeof t[a]?r[a]=i(e[a],t[a]):r[a]=e[a]}catch(e){(0,n.Z)("An error occurred while setting a property of a Configurable",e)}return r}catch(e){(0,n.Z)("An error occured while setting a Configurable",e)}}},6818:(e,t,r)=>{r.d(t,{Re:()=>i,gF:()=>o,q4:()=>n});const n="1.236.0",i="PROD",o="CDN"},385:(e,t,r)=>{r.d(t,{FN:()=>a,IF:()=>u,Nk:()=>f,Tt:()=>s,_A:()=>o,il:()=>n,pL:()=>c,v6:()=>i,w1:()=>d});const n="undefined"!=typeof window&&!!window.document,i="undefined"!=typeof WorkerGlobalScope&&("undefined"!=typeof self&&self instanceof WorkerGlobalScope&&self.navigator instanceof WorkerNavigator||"undefined"!=typeof globalThis&&globalThis instanceof WorkerGlobalScope&&globalThis.navigator instanceof WorkerNavigator),o=n?window:"undefined"!=typeof WorkerGlobalScope&&("undefined"!=typeof self&&self instanceof WorkerGlobalScope&&self||"undefined"!=typeof globalThis&&globalThis instanceof WorkerGlobalScope&&globalThis),a=""+o?.location,s=/iPad|iPhone|iPod/.test(navigator.userAgent),c=s&&"undefined"==typeof SharedWorker,u=(()=>{const e=navigator.userAgent.match(/Firefox[/\s](\d+\.\d+)/);return Array.isArray(e)&&e.length>=2?+e[1]:0})(),d=Boolean(n&&window.document.documentMode),f=!!navigator.sendBeacon},1117:(e,t,r)=>{r.d(t,{w:()=>o});var n=r(50);const i={agentIdentifier:"",ee:void 0};class o{constructor(e){try{if("object"!=typeof e)return(0,n.Z)("shared context requires an object as input");this.sharedContext={},Object.assign(this.sharedContext,i),Object.entries(e).forEach((e=>{let[t,r]=e;Object.keys(i).includes(t)&&(this.sharedContext[t]=r)}))}catch(e){(0,n.Z)("An error occured while setting SharedContext",e)}}}},8e3:(e,t,r)=>{r.d(t,{L:()=>d,R:()=>c});var n=r(2177),i=r(1284),o=r(4322),a=r(3325);const s={};function c(e,t){const r={staged:!1,priority:a.p[t]||0};u(e),s[e].get(t)||s[e].set(t,r)}function u(e){e&&(s[e]||(s[e]=new Map))}function d(){let e=arguments.length>0&&void 0!==arguments[0]?arguments[0]:"",t=arguments.length>1&&void 0!==arguments[1]?arguments[1]:"feature";if(u(e),!e||!s[e].get(t))return a(t);s[e].get(t).staged=!0;const r=[...s[e]];function a(t){const r=e?n.ee.get(e):n.ee,a=o.X.handlers;if(r.backlog&&a){var s=r.backlog[t],c=a[t];if(c){for(var u=0;s&&u {let[t,r]=e;return r.staged}))&&(r.sort(((e,t)=>e[1].priority-t[1].priority)),r.forEach((e=>{let[t]=e;a(t)})))}function f(e,t){var r=e[1];(0,i.D)(t[r],(function(t,r){var n=e[0];if(r[0]===n){var i=r[1],o=e[3],a=e[2];i.apply(o,a)}}))}},2177:(e,t,r)=>{r.d(t,{c:()=>f,ee:()=>u});var n=r(8632),i=r(2210),o=r(1284),a=r(5763),s="nr@context";let c=(0,n.fP)();var u;function d(){}function f(e){return(0,i.X)(e,s,l)}function l(){return new d}function h(){u.aborted=!0,u.backlog={}}c.ee?u=c.ee:(u=function e(t,r){var n={},c={},f={},g=!1;try{g=16===r.length&&(0,a.OP)(r).isolatedBacklog}catch(e){}var p={on:b,addEventListener:b,removeEventListener:y,emit:v,get:x,listeners:w,context:m,buffer:A,abort:h,aborted:!1,isBuffering:E,debugId:r,backlog:g?{}:t&&"object"==typeof t.backlog?t.backlog:{}};return p;function m(e){return e&&e instanceof d?e:e?(0,i.X)(e,s,l):l()}function v(e,r,n,i,o){if(!1!==o&&(o=!0),!u.aborted||i){t&&o&&t.emit(e,r,n);for(var a=m(n),s=w(e),d=s.length,f=0;fn,p:()=>i});var n=r(2177).ee.get("handle");function i(e,t,r,i,o){o?(o.buffer([e],i),o.emit(e,t,r)):(n.buffer([e],i),n.emit(e,t,r))}},4322:(e,t,r)=>{r.d(t,{X:()=>o});var n=r(5546);o.on=a;var i=o.handlers={};function o(e,t,r,o){a(o||n.E,i,e,t,r)}function a(e,t,r,i,o){o||(o="feature"),e||(e=n.E);var a=t[o]=t[o]||{};(a[r]=a[r]||[]).push([e,i])}},3239:(e,t,r)=>{r.d(t,{bP:()=>s,iz:()=>c,m$:()=>a});var n=r(385);let i=!1,o=!1;try{const e={get passive(){return i=!0,!1},get signal(){return o=!0,!1}};n._A.addEventListener("test",null,e),n._A.removeEventListener("test",null,e)}catch(e){}function a(e,t){return i||o?{capture:!!e,passive:i,signal:t}:!!e}function s(e,t){let r=arguments.length>2&&void 0!==arguments[2]&&arguments[2],n=arguments.length>3?arguments[3]:void 0;window.addEventListener(e,t,a(r,n))}function c(e,t){let r=arguments.length>2&&void 0!==arguments[2]&&arguments[2],n=arguments.length>3?arguments[3]:void 0;document.addEventListener(e,t,a(r,n))}},4402:(e,t,r)=>{r.d(t,{Ht:()=>u,M:()=>c,Rl:()=>a,ky:()=>s});var n=r(385);const i="xxxxxxxx-xxxx-4xxx-yxxx-xxxxxxxxxxxx";function o(e,t){return e?15&e[t]:16*Math.random()|0}function a(){const e=n._A?.crypto||n._A?.msCrypto;let t,r=0;return e&&e.getRandomValues&&(t=e.getRandomValues(new Uint8Array(31))),i.split("").map((e=>"x"===e?o(t,++r).toString(16):"y"===e?(3&o()|8).toString(16):e)).join("")}function s(e){const t=n._A?.crypto||n._A?.msCrypto;let r,i=0;t&&t.getRandomValues&&(r=t.getRandomValues(new Uint8Array(31)));const a=[];for(var s=0;s {r.d(t,{Bq:()=>n,Hb:()=>o,oD:()=>i});const n="NRBA",i=144e5,o=18e5},7894:(e,t,r)=>{function n(){return Math.round(performance.now())}r.d(t,{z:()=>n})},7243:(e,t,r)=>{r.d(t,{e:()=>o});var n=r(385),i={};function o(e){if(e in i)return i[e];if(0===(e||"").indexOf("data:"))return{protocol:"data"};let t;var r=n._A?.location,o={};if(n.il)t=document.createElement("a"),t.href=e;else try{t=new URL(e,r.href)}catch(e){return o}o.port=t.port;var a=t.href.split("://");!o.port&&a[1]&&(o.port=a[1].split("/")[0].split("@").pop().split(":")[1]),o.port&&"0"!==o.port||(o.port="https"===a[0]?"443":"80"),o.hostname=t.hostname||r.hostname,o.pathname=t.pathname,o.protocol=a[0],"/"!==o.pathname.charAt(0)&&(o.pathname="/"+o.pathname);var s=!t.protocol||":"===t.protocol||t.protocol===r.protocol,c=t.hostname===r.hostname&&t.port===r.port;return o.sameOrigin=s&&(!t.hostname||c),"/"===o.pathname&&(i[e]=o),o}},50:(e,t,r)=>{function n(e,t){"function"==typeof console.warn&&(console.warn("New Relic: ".concat(e)),t&&console.warn(t))}r.d(t,{Z:()=>n})},2587:(e,t,r)=>{r.d(t,{N:()=>c,T:()=>u});var n=r(2177),i=r(5546),o=r(8e3),a=r(3325);const s={stn:[a.D.sessionTrace],err:[a.D.jserrors,a.D.metrics],ins:[a.D.pageAction],spa:[a.D.spa],sr:[a.D.sessionReplay,a.D.sessionTrace]};function c(e,t){const r=n.ee.get(t);e&&"object"==typeof e&&(Object.entries(e).forEach((e=>{let[t,n]=e;void 0===u[t]&&(s[t]?s[t].forEach((e=>{n?(0,i.p)("feat-"+t,[],void 0,e,r):(0,i.p)("block-"+t,[],void 0,e,r),(0,i.p)("rumresp-"+t,[Boolean(n)],void 0,e,r)})):n&&(0,i.p)("feat-"+t,[],void 0,void 0,r),u[t]=Boolean(n))})),Object.keys(s).forEach((e=>{void 0===u[e]&&(s[e]?.forEach((t=>(0,i.p)("rumresp-"+e,[!1],void 0,t,r))),u[e]=!1)})),(0,o.L)(t,a.D.pageViewEvent))}const u={}},2210:(e,t,r)=>{r.d(t,{X:()=>i});var n=Object.prototype.hasOwnProperty;function i(e,t,r){if(n.call(e,t))return e[t];var i=r();if(Object.defineProperty&&Object.keys)try{return Object.defineProperty(e,t,{value:i,writable:!0,enumerable:!1}),i}catch(e){}return e[t]=i,i}},1284:(e,t,r)=>{r.d(t,{D:()=>n});const n=(e,t)=>Object.entries(e||{}).map((e=>{let[r,n]=e;return t(r,n)}))},4351:(e,t,r)=>{r.d(t,{P:()=>o});var n=r(2177);const i=()=>{const e=new WeakSet;return(t,r)=>{if("object"==typeof r&&null!==r){if(e.has(r))return;e.add(r)}return r}};function o(e){try{return JSON.stringify(e,i())}catch(e){try{n.ee.emit("internal-error",[e])}catch(e){}}}},3960:(e,t,r)=>{r.d(t,{K:()=>a,b:()=>o});var n=r(3239);function i(){return"undefined"==typeof document||"complete"===document.readyState}function o(e,t){if(i())return e();(0,n.bP)("load",e,t)}function a(e){if(i())return e();(0,n.iz)("DOMContentLoaded",e)}},8632:(e,t,r)=>{r.d(t,{EZ:()=>u,Qy:()=>c,ce:()=>o,fP:()=>a,gG:()=>d,mF:()=>s});var n=r(7894),i=r(385);const o={beacon:"bam.nr-data.net",errorBeacon:"bam.nr-data.net"};function a(){return i._A.NREUM||(i._A.NREUM={}),void 0===i._A.newrelic&&(i._A.newrelic=i._A.NREUM),i._A.NREUM}function s(){let e=a();return e.o||(e.o={ST:i._A.setTimeout,SI:i._A.setImmediate,CT:i._A.clearTimeout,XHR:i._A.XMLHttpRequest,REQ:i._A.Request,EV:i._A.Event,PR:i._A.Promise,MO:i._A.MutationObserver,FETCH:i._A.fetch}),e}function c(e,t,r){let i=a();const o=i.initializedAgents||{},s=o[e]||{};return Object.keys(s).length||(s.initializedAt={ms:(0,n.z)(),date:new Date}),i.initializedAgents={...o,[e]:{...s,[r]:t}},i}function u(e,t){a()[e]=t}function d(){return function(){let e=a();const t=e.info||{};e.info={beacon:o.beacon,errorBeacon:o.errorBeacon,...t}}(),function(){let e=a();const t=e.init||{};e.init={...t}}(),s(),function(){let e=a();const t=e.loader_config||{};e.loader_config={...t}}(),a()}},7956:(e,t,r)=>{r.d(t,{N:()=>i});var n=r(3239);function i(e){let t=arguments.length>1&&void 0!==arguments[1]&&arguments[1],r=arguments.length>2?arguments[2]:void 0,i=arguments.length>3?arguments[3]:void 0;return void(0,n.iz)("visibilitychange",(function(){if(t)return void("hidden"==document.visibilityState&&e());e(document.visibilityState)}),r,i)}},1214:(e,t,r)=>{r.d(t,{em:()=>v,u5:()=>N,QU:()=>S,_L:()=>I,Gm:()=>L,Lg:()=>M,gy:()=>U,BV:()=>Q,Kf:()=>ee});var n=r(2177);const i="nr@original";var o=Object.prototype.hasOwnProperty,a=!1;function s(e,t){return e||(e=n.ee),r.inPlace=function(e,t,n,i,o){n||(n="");var a,s,c,u="-"===n.charAt(0);for(c=0;c 2?n-2:0),o=2;o {r(A[T],e,w),r(E[T],e,w)})),r(l._A,"fetch",y),t.on(y+"end",(function(e,r){var n=this;if(r){var i=r.headers.get("content-length");null!==i&&(n.rxSize=i),t.emit(y+"done",[null,r],n)}else t.emit(y+"done",[e],n)})),t}const O={},j=["pushState","replaceState"];function S(e){const t=function(e){return(e||n.ee).get("history")}(e);return!l.il||O[t.debugId]++||(O[t.debugId]=1,s(t).inPlace(window.history,j,"-")),t}var P=r(3239);const C={},R=["appendChild","insertBefore","replaceChild"];function I(e){const t=function(e){return(e||n.ee).get("jsonp")}(e);if(!l.il||C[t.debugId])return t;C[t.debugId]=!0;var r=s(t),i=/[?&](?:callback|cb)=([^&#]+)/,o=/(.*)\.([^.]+)/,a=/^(\w+)(\.|$)(.*)$/;function c(e,t){var r=e.match(a),n=r[1],i=r[3];return i?c(i,t[n]):t[n]}return r.inPlace(Node.prototype,R,"dom-"),t.on("dom-start",(function(e){!function(e){if(!e||"string"!=typeof e.nodeName||"script"!==e.nodeName.toLowerCase())return;if("function"!=typeof e.addEventListener)return;var n=(a=e.src,s=a.match(i),s?s[1]:null);var a,s;if(!n)return;var u=function(e){var t=e.match(o);if(t&&t.length>=3)return{key:t[2],parent:c(t[1],window)};return{key:e,parent:window}}(n);if("function"!=typeof u.parent[u.key])return;var d={};function f(){t.emit("jsonp-end",[],d),e.removeEventListener("load",f,(0,P.m$)(!1)),e.removeEventListener("error",l,(0,P.m$)(!1))}function l(){t.emit("jsonp-error",[],d),t.emit("jsonp-end",[],d),e.removeEventListener("load",f,(0,P.m$)(!1)),e.removeEventListener("error",l,(0,P.m$)(!1))}r.inPlace(u.parent,[u.key],"cb-",d),e.addEventListener("load",f,(0,P.m$)(!1)),e.addEventListener("error",l,(0,P.m$)(!1)),t.emit("new-jsonp",[e.src],d)}(e[0])})),t}var k=r(5763);const H={};function L(e){const t=function(e){return(e||n.ee).get("mutation")}(e);if(!l.il||H[t.debugId])return t;H[t.debugId]=!0;var r=s(t),i=k.Yu.MO;return i&&(window.MutationObserver=function(e){return this instanceof i?new i(r(e,"fn-")):i.apply(this,arguments)},MutationObserver.prototype=i.prototype),t}const z={};function M(e){const t=function(e){return(e||n.ee).get("promise")}(e);if(z[t.debugId])return t;z[t.debugId]=!0;var r=n.c,o=s(t),a=k.Yu.PR;return a&&function(){function e(r){var n=t.context(),i=o(r,"executor-",n,null,!1);const s=Reflect.construct(a,[i],e);return t.context(s).getCtx=function(){return n},s}l._A.Promise=e,Object.defineProperty(e,"name",{value:"Promise"}),e.toString=function(){return a.toString()},Object.setPrototypeOf(e,a),["all","race"].forEach((function(r){const n=a[r];e[r]=function(e){let i=!1;[...e||[]].forEach((e=>{this.resolve(e).then(a("all"===r),a(!1))}));const o=n.apply(this,arguments);return o;function a(e){return function(){t.emit("propagate",[null,!i],o,!1,!1),i=i||!e}}}})),["resolve","reject"].forEach((function(r){const n=a[r];e[r]=function(e){const r=n.apply(this,arguments);return e!==r&&t.emit("propagate",[e,!0],r,!1,!1),r}})),e.prototype=a.prototype;const n=a.prototype.then;a.prototype.then=function(){var e=this,i=r(e);i.promise=e;for(var a=arguments.length,s=new Array(a),c=0;c e())),t};function m(e,t){i.inPlace(t,["onreadystatechange"],"fn-",E)}function b(){var e=this,t=r.context(e);e.readyState>3&&!t.resolved&&(t.resolved=!0,r.emit("xhr-resolved",[],e)),i.inPlace(e,f,"fn-",E)}if(function(e,t){for(var r in e)t[r]=e[r]}(o,p),p.prototype=o.prototype,i.inPlace(p.prototype,J,"-xhr-",E),r.on("send-xhr-start",(function(e,t){m(e,t),function(e){h.push(e),a&&(y?y.then(A):u?u(A):(w=-w,x.data=w))}(t)})),r.on("open-xhr-start",m),a){var y=c&&c.resolve();if(!u&&!c){var w=1,x=document.createTextNode(w);new a(A).observe(x,{characterData:!0})}}else t.on("fn-end",(function(e){e[0]&&e[0].type===d||A()}));function A(){for(var e=0;e {r.d(t,{t:()=>n});const n=r(3325).D.ajax},6660:(e,t,r)=>{r.d(t,{A:()=>i,t:()=>n});const n=r(3325).D.jserrors,i="nr@seenError"},3081:(e,t,r)=>{r.d(t,{gF:()=>o,mY:()=>i,t9:()=>n,vz:()=>s,xS:()=>a});const n=r(3325).D.metrics,i="sm",o="cm",a="storeSupportabilityMetrics",s="storeEventMetrics"},4649:(e,t,r)=>{r.d(t,{t:()=>n});const n=r(3325).D.pageAction},7633:(e,t,r)=>{r.d(t,{Dz:()=>i,OJ:()=>a,qw:()=>o,t9:()=>n});const n=r(3325).D.pageViewEvent,i="firstbyte",o="domcontent",a="windowload"},9251:(e,t,r)=>{r.d(t,{t:()=>n});const n=r(3325).D.pageViewTiming},3614:(e,t,r)=>{r.d(t,{BST_RESOURCE:()=>i,END:()=>s,FEATURE_NAME:()=>n,FN_END:()=>u,FN_START:()=>c,PUSH_STATE:()=>d,RESOURCE:()=>o,START:()=>a});const n=r(3325).D.sessionTrace,i="bstResource",o="resource",a="-start",s="-end",c="fn"+a,u="fn"+s,d="pushState"},7836:(e,t,r)=>{r.d(t,{BODY:()=>A,CB_END:()=>E,CB_START:()=>u,END:()=>x,FEATURE_NAME:()=>i,FETCH:()=>_,FETCH_BODY:()=>v,FETCH_DONE:()=>m,FETCH_START:()=>p,FN_END:()=>c,FN_START:()=>s,INTERACTION:()=>l,INTERACTION_API:()=>d,INTERACTION_EVENTS:()=>o,JSONP_END:()=>b,JSONP_NODE:()=>g,JS_TIME:()=>T,MAX_TIMER_BUDGET:()=>a,REMAINING:()=>f,SPA_NODE:()=>h,START:()=>w,originalSetTimeout:()=>y});var n=r(5763);const i=r(3325).D.spa,o=["click","submit","keypress","keydown","keyup","change"],a=999,s="fn-start",c="fn-end",u="cb-start",d="api-ixn-",f="remaining",l="interaction",h="spaNode",g="jsonpNode",p="fetch-start",m="fetch-done",v="fetch-body-",b="jsonp-end",y=n.Yu.ST,w="-start",x="-end",A="-body",E="cb"+x,T="jsTime",_="fetch"},5938:(e,t,r)=>{r.d(t,{W:()=>o});var n=r(5763),i=r(2177);class o{constructor(e,t,r){this.agentIdentifier=e,this.aggregator=t,this.ee=i.ee.get(e,(0,n.OP)(this.agentIdentifier).isolatedBacklog),this.featureName=r,this.blocked=!1}}},9144:(e,t,r)=>{r.d(t,{j:()=>m});var n=r(3325),i=r(5763),o=r(5546),a=r(2177),s=r(7894),c=r(8e3),u=r(3960),d=r(385),f=r(50),l=r(3081),h=r(8632);function g(){const e=(0,h.gG)();["setErrorHandler","finished","addToTrace","inlineHit","addRelease","addPageAction","setCurrentRouteName","setPageViewName","setCustomAttribute","interaction","noticeError","setUserId"].forEach((t=>{e[t]=function(){for(var r=arguments.length,n=new Array(r),i=0;i 1?r-1:0),i=1;i {e.exposed&&e.api[t]&&o.push(e.api[t](...n))})),o.length>1?o:o[0]}(t,...n)}}))}var p=r(2587);function m(e){let t=arguments.length>1&&void 0!==arguments[1]?arguments[1]:{},m=arguments.length>2?arguments[2]:void 0,v=arguments.length>3?arguments[3]:void 0,{init:b,info:y,loader_config:w,runtime:x={loaderType:m},exposed:A=!0}=t;const E=(0,h.gG)();y||(b=E.init,y=E.info,w=E.loader_config),(0,i.Dg)(e,b||{}),(0,i.GE)(e,w||{}),(0,i.sU)(e,x),y.jsAttributes??={},d.v6&&(y.jsAttributes.isWorker=!0),(0,i.CX)(e,y),g();const T=function(e,t){t||(0,c.R)(e,"api");const h={};var g=a.ee.get(e),p=g.get("tracer"),m="api-",v=m+"ixn-";function b(t,r,n,o){const a=(0,i.C5)(e);return null===r?delete a.jsAttributes[t]:(0,i.CX)(e,{...a,jsAttributes:{...a.jsAttributes,[t]:r}}),x(m,n,!0,o||null===r?"session":void 0)(t,r)}function y(){}["setErrorHandler","finished","addToTrace","inlineHit","addRelease"].forEach((e=>h[e]=x(m,e,!0,"api"))),h.addPageAction=x(m,"addPageAction",!0,n.D.pageAction),h.setCurrentRouteName=x(m,"routeName",!0,n.D.spa),h.setPageViewName=function(t,r){if("string"==typeof t)return"/"!==t.charAt(0)&&(t="/"+t),(0,i.OP)(e).customTransaction=(r||"http://custom.transaction")+t,x(m,"setPageViewName",!0)()},h.setCustomAttribute=function(e,t){let r=arguments.length>2&&void 0!==arguments[2]&&arguments[2];if("string"==typeof e){if(["string","number"].includes(typeof t)||null===t)return b(e,t,"setCustomAttribute",r);(0,f.Z)("Failed to execute setCustomAttribute.\nNon-null value must be a string or number type, but a type of was provided."))}else(0,f.Z)("Failed to execute setCustomAttribute.\nName must be a string type, but a type of was provided."))},h.setUserId=function(e){if("string"==typeof e||null===e)return b("enduser.id",e,"setUserId",!0);(0,f.Z)("Failed to execute setUserId.\nNon-null value must be a string type, but a type of was provided."))},h.interaction=function(){return(new y).get()};var w=y.prototype={createTracer:function(e,t){var r={},i=this,a="function"==typeof t;return(0,o.p)(v+"tracer",[(0,s.z)(),e,r],i,n.D.spa,g),function(){if(p.emit((a?"":"no-")+"fn-start",[(0,s.z)(),i,a],r),a)try{return t.apply(this,arguments)}catch(e){throw p.emit("fn-err",[arguments,this,"string"==typeof e?new Error(e):e],r),e}finally{p.emit("fn-end",[(0,s.z)()],r)}}}};function x(e,t,r,i){return function(){return(0,o.p)(l.xS,["API/"+t+"/called"],void 0,n.D.metrics,g),i&&(0,o.p)(e+t,[(0,s.z)(),...arguments],r?null:this,i,g),r?void 0:this}}function A(){r.e(439).then(r.bind(r,7438)).then((t=>{let{setAPI:r}=t;r(e),(0,c.L)(e,"api")})).catch((()=>(0,f.Z)("Downloading runtime APIs failed...")))}return["actionText","setName","setAttribute","save","ignore","onEnd","getContext","end","get"].forEach((e=>{w[e]=x(v,e,void 0,n.D.spa)})),h.noticeError=function(e,t){"string"==typeof e&&(e=new Error(e)),(0,o.p)(l.xS,["API/noticeError/called"],void 0,n.D.metrics,g),(0,o.p)("err",[e,(0,s.z)(),!1,t],void 0,n.D.jserrors,g)},d.il?(0,u.b)((()=>A()),!0):A(),h}(e,v);return(0,h.Qy)(e,T,"api"),(0,h.Qy)(e,A,"exposed"),(0,h.EZ)("activatedFeatures",p.T),T}},3325:(e,t,r)=>{r.d(t,{D:()=>n,p:()=>i});const n={ajax:"ajax",jserrors:"jserrors",metrics:"metrics",pageAction:"page_action",pageViewEvent:"page_view_event",pageViewTiming:"page_view_timing",sessionReplay:"session_replay",sessionTrace:"session_trace",spa:"spa"},i={[n.pageViewEvent]:1,[n.pageViewTiming]:2,[n.metrics]:3,[n.jserrors]:4,[n.ajax]:5,[n.sessionTrace]:6,[n.pageAction]:7,[n.spa]:8,[n.sessionReplay]:9}}},n={};function i(e){var t=n[e];if(void 0!==t)return t.exports;var o=n[e]={exports:{}};return r[e](o,o.exports,i),o.exports}i.m=r,i.d=(e,t)=>{for(var r in t)i.o(t,r)&&!i.o(e,r)&&Object.defineProperty(e,r,{enumerable:!0,get:t[r]})},i.f={},i.e=e=>Promise.all(Object.keys(i.f).reduce(((t,r)=>(i.f[r](e,t),t)),[])),i.u=e=>(({78:"page_action-aggregate",147:"metrics-aggregate",242:"session-manager",317:"jserrors-aggregate",348:"page_view_timing-aggregate",412:"lazy-feature-loader",439:"async-api",538:"recorder",590:"session_replay-aggregate",675:"compressor",733:"session_trace-aggregate",786:"page_view_event-aggregate",873:"spa-aggregate",898:"ajax-aggregate"}[e]||e)+"."+{78:"ac76d497",147:"3dc53903",148:"1a20d5fe",242:"2a64278a",317:"49e41428",348:"bd6de33a",412:"2f55ce66",439:"30bd804e",538:"1b18459f",590:"cf0efb30",675:"ae9f91a8",733:"83105561",786:"06482edd",860:"03a8b7a5",873:"e6b09d52",898:"998ef92b"}[e]+"-1.236.0.min.js"),i.o=(e,t)=>Object.prototype.hasOwnProperty.call(e,t),e={},t="NRBA:",i.l=(r,n,o,a)=>{if(e[r])e[r].push(n);else{var s,c;if(void 0!==o)for(var u=document.getElementsByTagName("script"),d=0;d {s.onerror=s.onload=null,clearTimeout(h);var i=e[r];if(delete e[r],s.parentNode&&s.parentNode.removeChild(s),i&&i.forEach((e=>e(n))),t)return t(n)},h=setTimeout(l.bind(null,void 0,{type:"timeout",target:s}),12e4);s.onerror=l.bind(null,s.onerror),s.onload=l.bind(null,s.onload),c&&document.head.appendChild(s)}},i.r=e=>{"undefined"!=typeof Symbol&&Symbol.toStringTag&&Object.defineProperty(e,Symbol.toStringTag,{value:"Module"}),Object.defineProperty(e,"__esModule",{value:!0})},i.j=364,i.p="https://js-agent.newrelic.com/",(()=>{var e={364:0,953:0};i.f.j=(t,r)=>{var n=i.o(e,t)?e[t]:void 0;if(0!==n)if(n)r.push(n[2]);else{var o=new Promise(((r,i)=>n=e[t]=[r,i]));r.push(n[2]=o);var a=i.p+i.u(t),s=new Error;i.l(a,(r=>{if(i.o(e,t)&&(0!==(n=e[t])&&(e[t]=void 0),n)){var o=r&&("load"===r.type?"missing":r.type),a=r&&r.target&&r.target.src;s.message="Loading chunk "+t+" failed.\n("+o+": "+a+")",s.name="ChunkLoadError",s.type=o,s.request=a,n[1](s)}}),"chunk-"+t,t)}};var t=(t,r)=>{var n,o,[a,s,c]=r,u=0;if(a.some((t=>0!==e[t]))){for(n in s)i.o(s,n)&&(i.m[n]=s[n]);if(c)c(i)}for(t&&t(r);u {i.r(o);var e=i(3325),t=i(5763);const r=Object.values(e.D);function n(e){const n={};return r.forEach((r=>{n[r]=function(e,r){return!1!==(0,t.Mt)(r,"".concat(e,".enabled"))}(r,e)})),n}var a=i(9144);var s=i(5546),c=i(385),u=i(8e3),d=i(5938),f=i(3960),l=i(50);class h extends d.W{constructor(e,t,r){let n=!(arguments.length>3&&void 0!==arguments[3])||arguments[3];super(e,t,r),this.auto=n,this.abortHandler,this.featAggregate,this.onAggregateImported,n&&(0,u.R)(e,r)}importAggregator(){let e=arguments.length>0&&void 0!==arguments[0]?arguments[0]:{};if(this.featAggregate||!this.auto)return;const r=c.il&&!0===(0,t.Mt)(this.agentIdentifier,"privacy.cookies_enabled");let n;this.onAggregateImported=new Promise((e=>{n=e}));const o=async()=>{let t;try{if(r){const{setupAgentSession:e}=await Promise.all([i.e(860),i.e(242)]).then(i.bind(i,3228));t=e(this.agentIdentifier)}}catch(e){(0,l.Z)("A problem occurred when starting up session manager. This page will not start or extend any session.",e)}try{if(!this.shouldImportAgg(this.featureName,t))return void(0,u.L)(this.agentIdentifier,this.featureName);const{lazyFeatureLoader:r}=await i.e(412).then(i.bind(i,8582)),{Aggregate:o}=await r(this.featureName,"aggregate");this.featAggregate=new o(this.agentIdentifier,this.aggregator,e),n(!0)}catch(e){(0,l.Z)("Downloading and initializing ".concat(this.featureName," failed..."),e),this.abortHandler?.(),n(!1)}};c.il?(0,f.b)((()=>o()),!0):o()}shouldImportAgg(r,n){return r!==e.D.sessionReplay||!1!==(0,t.Mt)(this.agentIdentifier,"session_trace.enabled")&&(!!n?.isNew||!!n?.state.sessionReplay)}}var g=i(7633),p=i(7894);class m extends h{static featureName=g.t9;constructor(r,n){let i=!(arguments.length>2&&void 0!==arguments[2])||arguments[2];if(super(r,n,g.t9,i),("undefined"==typeof PerformanceNavigationTiming||c.Tt)&&"undefined"!=typeof PerformanceTiming){const n=(0,t.OP)(r);n[g.Dz]=Math.max(Date.now()-n.offset,0),(0,f.K)((()=>n[g.qw]=Math.max((0,p.z)()-n[g.Dz],0))),(0,f.b)((()=>{const t=(0,p.z)();n[g.OJ]=Math.max(t-n[g.Dz],0),(0,s.p)("timing",["load",t],void 0,e.D.pageViewTiming,this.ee)}))}this.importAggregator()}}var v=i(1117),b=i(1284);class y extends v.w{constructor(e){super(e),this.aggregatedData={}}store(e,t,r,n,i){var o=this.getBucket(e,t,r,i);return o.metrics=function(e,t){t||(t={count:0});return t.count+=1,(0,b.D)(e,(function(e,r){t[e]=w(r,t[e])})),t}(n,o.metrics),o}merge(e,t,r,n,i){var o=this.getBucket(e,t,n,i);if(o.metrics){var a=o.metrics;a.count+=r.count,(0,b.D)(r,(function(e,t){if("count"!==e){var n=a[e],i=r[e];i&&!i.c?a[e]=w(i.t,n):a[e]=function(e,t){if(!t)return e;t.c||(t=x(t.t));return t.min=Math.min(e.min,t.min),t.max=Math.max(e.max,t.max),t.t+=e.t,t.sos+=e.sos,t.c+=e.c,t}(i,a[e])}}))}else o.metrics=r}storeMetric(e,t,r,n){var i=this.getBucket(e,t,r);return i.stats=w(n,i.stats),i}getBucket(e,t,r,n){this.aggregatedData[e]||(this.aggregatedData[e]={});var i=this.aggregatedData[e][t];return i||(i=this.aggregatedData[e][t]={params:r||{}},n&&(i.custom=n)),i}get(e,t){return t?this.aggregatedData[e]&&this.aggregatedData[e][t]:this.aggregatedData[e]}take(e){for(var t={},r="",n=!1,i=0;i t.max&&(t.max=e),e 2&&void 0!==arguments[2])||arguments[2];super(e,r,j.t,n),c.il&&((0,t.OP)(e).initHidden=Boolean("hidden"===document.visibilityState),(0,N.N)((()=>(0,s.p)("docHidden",[(0,p.z)()],void 0,j.t,this.ee)),!0),(0,O.bP)("pagehide",(()=>(0,s.p)("winPagehide",[(0,p.z)()],void 0,j.t,this.ee))),this.importAggregator())}}var P=i(3081);class C extends h{static featureName=P.t9;constructor(e,t){let r=!(arguments.length>2&&void 0!==arguments[2])||arguments[2];super(e,t,P.t9,r),this.importAggregator()}}var R,I=i(2210),k=i(1214),H=i(2177),L={};try{R=localStorage.getItem("__nr_flags").split(","),console&&"function"==typeof console.log&&(L.console=!0,-1!==R.indexOf("dev")&&(L.dev=!0),-1!==R.indexOf("nr_dev")&&(L.nrDev=!0))}catch(e){}function z(e){try{L.console&&z(e)}catch(e){}}L.nrDev&&H.ee.on("internal-error",(function(e){z(e.stack)})),L.dev&&H.ee.on("fn-err",(function(e,t,r){z(r.stack)})),L.dev&&(z("NR AGENT IN DEVELOPMENT MODE"),z("flags: "+(0,b.D)(L,(function(e,t){return e})).join(", ")));var M=i(6660);class B extends h{static featureName=M.t;constructor(r,n){let i=!(arguments.length>2&&void 0!==arguments[2])||arguments[2];super(r,n,M.t,i),this.skipNext=0;try{this.removeOnAbort=new AbortController}catch(e){}const o=this;o.ee.on("fn-start",(function(e,t,r){o.abortHandler&&(o.skipNext+=1)})),o.ee.on("fn-err",(function(t,r,n){o.abortHandler&&!n[M.A]&&((0,I.X)(n,M.A,(function(){return!0})),this.thrown=!0,(0,s.p)("err",[n,(0,p.z)()],void 0,e.D.jserrors,o.ee))})),o.ee.on("fn-end",(function(){o.abortHandler&&!this.thrown&&o.skipNext>0&&(o.skipNext-=1)})),o.ee.on("internal-error",(function(t){(0,s.p)("ierr",[t,(0,p.z)(),!0],void 0,e.D.jserrors,o.ee)})),this.origOnerror=c._A.onerror,c._A.onerror=this.onerrorHandler.bind(this),c._A.addEventListener("unhandledrejection",(t=>{const r=function(e){let t="Unhandled Promise Rejection: ";if(e instanceof Error)try{return e.message=t+e.message,e}catch(t){return e}if(void 0===e)return new Error(t);try{return new Error(t+(0,D.P)(e))}catch(e){return new Error(t)}}(t.reason);(0,s.p)("err",[r,(0,p.z)(),!1,{unhandledPromiseRejection:1}],void 0,e.D.jserrors,this.ee)}),(0,O.m$)(!1,this.removeOnAbort?.signal)),(0,k.gy)(this.ee),(0,k.BV)(this.ee),(0,k.em)(this.ee),(0,t.OP)(r).xhrWrappable&&(0,k.Kf)(this.ee),this.abortHandler=this.#e,this.importAggregator()}#e(){this.removeOnAbort?.abort(),this.abortHandler=void 0}onerrorHandler(t,r,n,i,o){"function"==typeof this.origOnerror&&this.origOnerror(...arguments);try{this.skipNext?this.skipNext-=1:(0,s.p)("err",[o||new F(t,r,n),(0,p.z)()],void 0,e.D.jserrors,this.ee)}catch(t){try{(0,s.p)("ierr",[t,(0,p.z)(),!0],void 0,e.D.jserrors,this.ee)}catch(e){}}return!1}}function F(e,t,r){this.message=e||"Uncaught error with no additional information",this.sourceURL=t,this.line=r}let U=1;const q="nr@id";function G(e){const t=typeof e;return!e||"object"!==t&&"function"!==t?-1:e===c._A?0:(0,I.X)(e,q,(function(){return U++}))}function V(e){if("string"==typeof e&&e.length)return e.length;if("object"==typeof e){if("undefined"!=typeof ArrayBuffer&&e instanceof ArrayBuffer&&e.byteLength)return e.byteLength;if("undefined"!=typeof Blob&&e instanceof Blob&&e.size)return e.size;if(!("undefined"!=typeof FormData&&e instanceof FormData))try{return(0,D.P)(e).length}catch(e){return}}}var X=i(7243);class W{constructor(e){this.agentIdentifier=e,this.generateTracePayload=this.generateTracePayload.bind(this),this.shouldGenerateTrace=this.shouldGenerateTrace.bind(this)}generateTracePayload(e){if(!this.shouldGenerateTrace(e))return null;var r=(0,t.DL)(this.agentIdentifier);if(!r)return null;var n=(r.accountID||"").toString()||null,i=(r.agentID||"").toString()||null,o=(r.trustKey||"").toString()||null;if(!n||!i)return null;var a=(0,_.M)(),s=(0,_.Ht)(),c=Date.now(),u={spanId:a,traceId:s,timestamp:c};return(e.sameOrigin||this.isAllowedOrigin(e)&&this.useTraceContextHeadersForCors())&&(u.traceContextParentHeader=this.generateTraceContextParentHeader(a,s),u.traceContextStateHeader=this.generateTraceContextStateHeader(a,c,n,i,o)),(e.sameOrigin&&!this.excludeNewrelicHeader()||!e.sameOrigin&&this.isAllowedOrigin(e)&&this.useNewrelicHeaderForCors())&&(u.newrelicHeader=this.generateTraceHeader(a,s,c,n,i,o)),u}generateTraceContextParentHeader(e,t){return"00-"+t+"-"+e+"-01"}generateTraceContextStateHeader(e,t,r,n,i){return i+"@nr=0-1-"+r+"-"+n+"-"+e+"----"+t}generateTraceHeader(e,t,r,n,i,o){if(!("function"==typeof c._A?.btoa))return null;var a={v:[0,1],d:{ty:"Browser",ac:n,ap:i,id:e,tr:t,ti:r}};return o&&n!==o&&(a.d.tk=o),btoa((0,D.P)(a))}shouldGenerateTrace(e){return this.isDtEnabled()&&this.isAllowedOrigin(e)}isAllowedOrigin(e){var r=!1,n={};if((0,t.Mt)(this.agentIdentifier,"distributed_tracing")&&(n=(0,t.P_)(this.agentIdentifier).distributed_tracing),e.sameOrigin)r=!0;else if(n.allowed_origins instanceof Array)for(var i=0;i 2&&void 0!==arguments[2])||arguments[2];super(r,n,Z.t,i),(0,t.OP)(r).xhrWrappable&&(this.dt=new W(r),this.handler=(e,t,r,n)=>(0,s.p)(e,t,r,n,this.ee),(0,k.u5)(this.ee),(0,k.Kf)(this.ee),function(r,n,i,o){function a(e){var t=this;t.totalCbs=0,t.called=0,t.cbTime=0,t.end=E,t.ended=!1,t.xhrGuids={},t.lastSize=null,t.loadCaptureCalled=!1,t.params=this.params||{},t.metrics=this.metrics||{},e.addEventListener("load",(function(r){_(t,e)}),(0,O.m$)(!1)),c.IF||e.addEventListener("progress",(function(e){t.lastSize=e.loaded}),(0,O.m$)(!1))}function s(e){this.params={method:e[0]},T(this,e[1]),this.metrics={}}function u(e,n){var i=(0,t.DL)(r);i.xpid&&this.sameOrigin&&n.setRequestHeader("X-NewRelic-ID",i.xpid);var a=o.generateTracePayload(this.parsedOrigin);if(a){var s=!1;a.newrelicHeader&&(n.setRequestHeader("newrelic",a.newrelicHeader),s=!0),a.traceContextParentHeader&&(n.setRequestHeader("traceparent",a.traceContextParentHeader),a.traceContextStateHeader&&n.setRequestHeader("tracestate",a.traceContextStateHeader),s=!0),s&&(this.dt=a)}}function d(e,t){var r=this.metrics,i=e[0],o=this;if(r&&i){var a=V(i);a&&(r.txSize=a)}this.startTime=(0,p.z)(),this.listener=function(e){try{"abort"!==e.type||o.loadCaptureCalled||(o.params.aborted=!0),("load"!==e.type||o.called===o.totalCbs&&(o.onloadCalled||"function"!=typeof t.onload)&&"function"==typeof o.end)&&o.end(t)}catch(e){try{n.emit("internal-error",[e])}catch(e){}}};for(var s=0;s 1?e[1]=i:e.push(i)}else e[0]&&e[0].headers&&s(e[0].headers,n)&&(this.dt=n);function s(e,t){var r=!1;return t.newrelicHeader&&(e.set("newrelic",t.newrelicHeader),r=!0),t.traceContextParentHeader&&(e.set("traceparent",t.traceContextParentHeader),t.traceContextStateHeader&&e.set("tracestate",t.traceContextStateHeader),r=!0),r}}function x(e,t){this.params={},this.metrics={},this.startTime=(0,p.z)(),this.dt=t,e.length>=1&&(this.target=e[0]),e.length>=2&&(this.opts=e[1]);var r,n=this.opts||{},i=this.target;"string"==typeof i?r=i:"object"==typeof i&&i instanceof Y?r=i.url:c._A?.URL&&"object"==typeof i&&i instanceof URL&&(r=i.href),T(this,r);var o=(""+(i&&i instanceof Y&&i.method||n.method||"GET")).toUpperCase();this.params.method=o,this.txSize=V(n.body)||0}function A(t,r){var n;this.endTime=(0,p.z)(),this.params||(this.params={}),this.params.status=r?r.status:0,"string"==typeof this.rxSize&&this.rxSize.length>0&&(n=+this.rxSize);var o={txSize:this.txSize,rxSize:n,duration:(0,p.z)()-this.startTime};i("xhr",[this.params,o,this.startTime,this.endTime,"fetch"],this,e.D.ajax)}function E(t){var r=this.params,n=this.metrics;if(!this.ended){this.ended=!0;for(var o=0;o 2&&void 0!==arguments[2])||arguments[2];super(e,t,we.t,r),this.importAggregator()}}new class{constructor(e){let t=arguments.length>1&&void 0!==arguments[1]?arguments[1]:(0,_.ky)(16);c._A?(this.agentIdentifier=t,this.sharedAggregator=new y({agentIdentifier:this.agentIdentifier}),this.features={},this.desiredFeatures=new Set(e.features||[]),this.desiredFeatures.add(m),Object.assign(this,(0,a.j)(this.agentIdentifier,e,e.loaderType||"agent")),this.start()):(0,l.Z)("Failed to initial the agent. Could not determine the runtime environment.")}get config(){return{info:(0,t.C5)(this.agentIdentifier),init:(0,t.P_)(this.agentIdentifier),loader_config:(0,t.DL)(this.agentIdentifier),runtime:(0,t.OP)(this.agentIdentifier)}}start(){const t="features";try{const r=n(this.agentIdentifier),i=[...this.desiredFeatures];i.sort(((t,r)=>e.p[t.featureName]-e.p[r.featureName])),i.forEach((t=>{if(r[t.featureName]||t.featureName===e.D.pageViewEvent){const n=function(t){switch(t){case e.D.ajax:return[e.D.jserrors];case e.D.sessionTrace:return[e.D.ajax,e.D.pageViewEvent];case e.D.sessionReplay:return[e.D.sessionTrace];case e.D.pageViewTiming:return[e.D.pageViewEvent];default:return[]}}(t.featureName);n.every((e=>r[e]))||(0,l.Z)("".concat(t.featureName," is enabled but one or more dependent features has been disabled (").concat((0,D.P)(n),"). This may cause unintended consequences or missing data...")),this.features[t.featureName]=new t(this.agentIdentifier,this.sharedAggregator)}})),(0,T.Qy)(this.agentIdentifier,this.features,t)}catch(e){(0,l.Z)("Failed to initialize all enabled instrument classes (agent aborted) -",e);for(const e in this.features)this.features[e].abortHandler?.();const r=(0,T.fP)();return delete r.initializedAgents[this.agentIdentifier]?.api,delete r.initializedAgents[this.agentIdentifier]?.[t],delete this.sharedAggregator,r.ee?.abort(),delete r.ee?.get(this.agentIdentifier),!1}}}({features:[J,m,S,class extends h{static featureName=oe;constructor(t,r){if(super(t,r,oe,!(arguments.length>2&&void 0!==arguments[2])||arguments[2]),!c.il)return;const n=this.ee;let i;(0,k.QU)(n),this.eventsEE=(0,k.em)(n),this.eventsEE.on(se,(function(e,t){this.bstStart=(0,p.z)()})),this.eventsEE.on(ae,(function(t,r){(0,s.p)("bst",[t[0],r,this.bstStart,(0,p.z)()],void 0,e.D.sessionTrace,n)})),n.on(ce+ne,(function(e){this.time=(0,p.z)(),this.startPath=location.pathname+location.hash})),n.on(ce+ie,(function(t){(0,s.p)("bstHist",[location.pathname+location.hash,this.startPath,this.time],void 0,e.D.sessionTrace,n)}));try{i=new PerformanceObserver((t=>{const r=t.getEntries();(0,s.p)(te,[r],void 0,e.D.sessionTrace,n)})),i.observe({type:re,buffered:!0})}catch(e){}this.importAggregator({resourceObserver:i})}},C,xe,B,class extends h{static featureName=de;constructor(e,r){if(super(e,r,de,!(arguments.length>2&&void 0!==arguments[2])||arguments[2]),!c.il)return;if(!(0,t.OP)(e).xhrWrappable)return;try{this.removeOnAbort=new AbortController}catch(e){}let n,i=0;const o=this.ee.get("tracer"),a=(0,k._L)(this.ee),s=(0,k.Lg)(this.ee),u=(0,k.BV)(this.ee),d=(0,k.Kf)(this.ee),f=this.ee.get("events"),l=(0,k.u5)(this.ee),h=(0,k.QU)(this.ee),g=(0,k.Gm)(this.ee);function m(e,t){h.emit("newURL",[""+window.location,t])}function v(){i++,n=window.location.hash,this[ve]=(0,p.z)()}function b(){i--,window.location.hash!==n&&m(0,!0);var e=(0,p.z)();this[pe]=~~this[pe]+e-this[ve],this[ye]=e}function y(e,t){e.on(t,(function(){this[t]=(0,p.z)()}))}this.ee.on(ve,v),s.on(be,v),a.on(be,v),this.ee.on(ye,b),s.on(ge,b),a.on(ge,b),this.ee.buffer([ve,ye,"xhr-resolved"],this.featureName),f.buffer([ve],this.featureName),u.buffer(["setTimeout"+le,"clearTimeout"+fe,ve],this.featureName),d.buffer([ve,"new-xhr","send-xhr"+fe],this.featureName),l.buffer([me+fe,me+"-done",me+he+fe,me+he+le],this.featureName),h.buffer(["newURL"],this.featureName),g.buffer([ve],this.featureName),s.buffer(["propagate",be,ge,"executor-err","resolve"+fe],this.featureName),o.buffer([ve,"no-"+ve],this.featureName),a.buffer(["new-jsonp","cb-start","jsonp-error","jsonp-end"],this.featureName),y(l,me+fe),y(l,me+"-done"),y(a,"new-jsonp"),y(a,"jsonp-end"),y(a,"cb-start"),h.on("pushState-end",m),h.on("replaceState-end",m),window.addEventListener("hashchange",m,(0,O.m$)(!0,this.removeOnAbort?.signal)),window.addEventListener("load",m,(0,O.m$)(!0,this.removeOnAbort?.signal)),window.addEventListener("popstate",(function(){m(0,i>1)}),(0,O.m$)(!0,this.removeOnAbort?.signal)),this.abortHandler=this.#e,this.importAggregator()}#e(){this.removeOnAbort?.abort(),this.abortHandler=void 0}}],loaderType:"spa"})})(),window.NRBA=o})(); window.jQuery || document.write(' ') CKEDITOR_BASEPATH='https://f1000research.com/js/vendor/ckeditor/' window.reactTheme = 'research'; window.MathJax = { CommonHTML: { linebreaks: { automatic: true } }, 'HTML-CSS': { linebreaks: { automatic: true } }, SVG: { linebreaks: { automatic: true } }, AuthorInit: function() { MathJax.Hub.Register.MessageHook('End Process', function () { let timeout = false; // holder for timeout id const delay = 250; // delay after event is "complete" to run callback const reflowMath = function() { const dispFormulas = document.querySelectorAll('.disp-formula.panel'); if (!dispFormulas) { return; } for (const dispFormula of dispFormulas) { const child = dispFormula.querySelector('.MathJax_Preview').nextSibling.firstChild; const isMultiline = MathJax.Hub.getAllJax(dispFormula)[0].root.isMultiline; if (dispFormula.offsetWidth < child.offsetWidth || isMultiline) { MathJax.Hub.Queue(['Rerender', MathJax.Hub, dispFormula]); } } }; window.addEventListener('resize', function() { clearTimeout(timeout); // clear the timeout timeout = setTimeout(reflowMath, delay); // start timing for event "completion" }); }); }, }; if (window.location.hash == '#_=_'){ window.location = window.location.href.split('#')[0] } !function(f,b,e,v,n,t,s){if(f.fbq)return;n=f.fbq=function() {n.callMethod? n.callMethod.apply(n,arguments):n.queue.push(arguments)} ;if(!f._fbq)f._fbq=n; n.push=n;n.loaded=!0;n.version='2.0';n.queue=[];t=b.createElement(e);t.async=!0; t.src=v;s=b.getElementsByTagName(e)[0];s.parentNode.insertBefore(t,s)}(window, document,'script','https://connect.facebook.net/en_US/fbevents.js'); fbq('init', '1641728616063202'); fbq('track', "PixelInitialized", {}); (function(h,o,t,j,a,r){ h.hj=h.hj||function(){(h.hj.q=h.hj.q||[]).push(arguments)}; h._hjSettings={hjid:2318163,hjsv:6}; a=o.getElementsByTagName('head')[0]; r=o.createElement('script');r.async=1; r.src=t+h._hjSettings.hjid+j+h._hjSettings.hjsv; a.appendChild(r); })(window,document,'https://static.hotjar.com/c/hotjar-','.js?sv='); search file_upload Submit your research search menu close search Browse Gateways & Collections How to Publish Submit your Research My Submissions Article Guidelines Article Guidelines (New Versions) Open Data, Software and Code Guidelines Open Data and Accessible Source Materials Guidelines (HSS) Open Data, Software and Code Guidelines (PSE) Prepublication Checks Production Process Posters and Slides Guidelines Document Guidelines Article Processing Charges Peer Review Finding Article Reviewers About How it Works For Reviewers Our Advisors Policies Glossary FAQs For Developers Newsroom Contact My Research Submissions Content and Tracking Alerts My Details Sign In file_upload Submit your research { "@context": "https://schema.org", "@type": "ScholarlyArticle", "mainEntityOfPage": { "@type": "WebPage", "@id": "https://f1000research.com/articles/13-1044" }, "headline": "Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal...", "datePublished": "2024-09-11T11:44:35", "dateModified": "2025-04-03T18:02:14", "author": [ { "@type": "Person", "name": "Garrett S. Bullock" }, { "@type": "Person", "name": "Joanne L. Fallowfield" }, { "@type": "Person", "name": "Sarah J. de la Motte" }, { "@type": "Person", "name": "Nigel Arden" }, { "@type": "Person", "name": "Ben Fisher" }, { "@type": "Person", "name": "Adam Dooley" }, { "@type": "Person", "name": "Neil Forrest" }, { "@type": "Person", "name": "John J. Fraser" }, { "@type": "Person", "name": "Alysia Gourlay" }, { "@type": "Person", "name": "Ben R. Hando" }, { "@type": "Person", "name": "Katherine Harrison" }, { "@type": "Person", "name": "Debra Hayhurst" }, { "@type": "Person", "name": "Joseph M. Molloy" }, { "@type": "Person", "name": "Phillip M. Newman" }, { "@type": "Person", "name": "Eric Robitaille" }, { "@type": "Person", "name": "Deydre S. Teyhen" }, { "@type": "Person", "name": "Jeffrey M. Tiede" }, { "@type": "Person", "name": "Emma Williams" }, { "@type": "Person", "name": "Sandra Williams" }, { "@type": "Person", "name": "Damien Van Tiggelen" }, { "@type": "Person", "name": "Joshua J. Van Wyngaarden" }, { "@type": "Person", "name": "Richard B. Westrick" }, { "@type": "Person", "name": "Carolyn A. Emery" }, { "@type": "Person", "name": "Gary S. Collins" }, { "@type": "Person", "name": "Daniel I. Rhon" } ], "publisher": { "@type": "Organization", "name": "F1000Research", "logo": { "@type": "ImageObject", "url": "https://f1000research.com/img/AMP/F1000Research_image.png", "height": 480, "width": 60 } }, "image": { "@type": "ImageObject", "url": "https://f1000research.com/img/AMP/F1000Research_image.png", "height": 1200, "width": 150 }, "description": " Background The objective was to summarize the methodology used to develop the international minimum data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement. This is a recommended list of elements to be collected and reported when conducting injury surveillance research in military settings. Methods A Delphi methodology was employed to reach consensus. Preliminary steps included conducting a literature review and surveying a convenience sample of military stakeholders to 1) identify barriers and facilitators of military musculoskeletal injury (MSKI) prevention programs, 2) identify relevant knowledge gaps, and 3) establish future research priorities. A sequential three-round Delphi consensus survey followed, including relevant stakeholders from militaries around the world, using results to conduct an asynchronous knowledge user meeting (mixture of in-person and live video conference and recording) to explore the level of agreement among subject matter experts. Knowledge users, including former and current military service members, civilian practitioners working in military health networks, and international subject matter experts having experience with policy, execution, or clinical investigation of MSKI mitigation programs, MSKI diagnoses, and MSKI risk factors in military settings. For each round, participants scored questions on a Likert scale of 1-5. Scores ranged from No Importance (1) to Strong Importance (5). Results Literature review and surveys helped inform the scope of potential variables. Three rounds were necessary to reach minimum consensus. Ninety-five, 65, and 42 respondents participated in the first, second and third rounds, respectively. Conclusions Achieving consensus across relevant knowledge users representing military organizations globally can be challenging. This paper details the methodology employed to reach consensus for a core minimum data elements checklist for conducting MSKI research in military settings and improve data harmonization and scalability efforts. These methods can be used as a resource to assist in future consensus endeavors of similar nature. " } { "@context": "http://schema.org", "@type": "BreadcrumbList", "itemListElement": [ { "@type": "ListItem", "position": "1", "item": { "@id": "https://f1000research.com/", "name": "Home" } }, { "@type": "ListItem", "position": "2", "item": { "@id": "https://f1000research.com/browse/articles", "name": "Browse" } }, { "@type": "ListItem", "position": "3", "item": { "@id": "https://f1000research.com/articles/13-1044/v2", "name": "Methodology used to develop the minimum common data elements for surveillance..." } } ] } Home Browse Methodology used to develop the minimum common data elements for surveillance... ALL Metrics - Views Downloads Get PDF Get XML Cite How to cite this article Bullock GS, Fallowfield JL, de la Motte SJ et al. Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.12688/f1000research.152514.2 ) NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article. Close Copy Citation Details Export Export Citation Sciwheel EndNote Ref. Manager Bibtex ProCite Sente EXPORT Select a format first Track Share ▬ ✚ Method Article Revised Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] Garrett S. Bullock 1-3 , Joanne L. Fallowfield 4 , Sarah J. de la Motte https://orcid.org/0000-0002-4101-3313 5,6 , [...] Nigel Arden 1,7 , Ben Fisher https://orcid.org/0000-0001-8547-7278 8,9 , Adam Dooley https://orcid.org/0009-0007-9168-2842 10 , Neil Forrest 9 , John J. Fraser https://orcid.org/0000-0001-9697-3795 6,11 , Alysia Gourlay 12 , Ben R. Hando https://orcid.org/0000-0002-7054-8958 13,14 , Katherine Harrison 15,16 , Debra Hayhurst 17 , Joseph M. Molloy https://orcid.org/0000-0002-6992-0732 18 , Phillip M. Newman https://orcid.org/0000-0001-5999-4001 19 , Eric Robitaille 20,21 , Deydre S. Teyhen 22 , Jeffrey M. Tiede 14 , Emma Williams 23 , Sandra Williams 24 , Damien Van Tiggelen 25 , Joshua J. Van Wyngaarden 13,26 , Richard B. Westrick 27 , Carolyn A. Emery 28 , Gary S. Collins https://orcid.org/0000-0002-2772-2316 29 , Daniel I. Rhon https://orcid.org/0000-0002-4320-990X 6,14 Garrett S. Bullock 1-3 , Joanne L. Fallowfield 4 , [...] Sarah J. de la Motte https://orcid.org/0000-0002-4101-3313 5,6 , Nigel Arden 1,7 , Ben Fisher https://orcid.org/0000-0001-8547-7278 8,9 , Adam Dooley https://orcid.org/0009-0007-9168-2842 10 , Neil Forrest 9 , John J. Fraser https://orcid.org/0000-0001-9697-3795 6,11 , Alysia Gourlay 12 , Ben R. Hando https://orcid.org/0000-0002-7054-8958 13,14 , Katherine Harrison 15,16 , Debra Hayhurst 17 , Joseph M. Molloy https://orcid.org/0000-0002-6992-0732 18 , Phillip M. Newman https://orcid.org/0000-0001-5999-4001 19 , Eric Robitaille 20,21 , Deydre S. Teyhen 22 , Jeffrey M. Tiede 14 , Emma Williams 23 , Sandra Williams 24 , Damien Van Tiggelen 25 , Joshua J. Van Wyngaarden 13,26 , Richard B. Westrick 27 , Carolyn A. Emery 28 , Gary S. Collins https://orcid.org/0000-0002-2772-2316 29 , Daniel I. Rhon https://orcid.org/0000-0002-4320-990X 6,14 PUBLISHED 03 Apr 2025 Author details Author details 1 Centre for Sport, Exercise, and Osteoarthritis, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, England, UK 2 Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA 3 Department of Orthopaedic Surgery & Rehabilitation, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA 4 Institute of Naval Medicine, Directorate of People and Training, Royal Navy, Hampshire, UK 5 Consortium for Health and Military Performance, Department of Military and Emergency Medicine, F. Edward Hébert School of Medicine, Uniformed Services University, Bethesda, MD, USA 6 Department of Physical Medicine & Rehabilitation, F. Edward Hébert School of Medicine, Uniformed Services University, Bethesda, Maryland, USA 7 Medical Research Council (MRC), Environmental Epidemiology Unit, University of Southampton, Southampton, England, UK 8 Defence Primary Healthcare, Headquarters Surgeon General, London, UK 9 Army Health, Army Headquarters, London, UK 10 Human Sciences Programme, Defence Science & Technology, New Zealand Defence Force, Auckland, New Zealand 11 Operational Readiness and Health Directorate, Naval Health Research Center, San Diego, CA, USA 12 Joint Health Command, Department of Defence, Australian Capital Territory, Australia 13 Army-Baylor University, Waco, Texas, USA 14 Department of Rehabilitation Medicine, Brooke Army Medical Center, Fort Sam Houston, Texas, USA 15 Defense Statistics Health, Ministry of Defence, London, UK 16 Director General, Finance, Ministry of Defence, London, UK 17 Headquarters Defence Medical Services, Strategic Command, Ministry of Defence, London, UK 18 Formerly at the Physical Performance Service Line, Office of the Army Surgeon General, Falls Church, Virginia, USA 19 Research Institute for Sport and Exercise, University of Canberra, Canberra, Australian Capital Territory, Australia 20 Teaching Stream Department of Physical Therapy, Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada 21 31 CF H Svcs C Detachment, Department of National Defence, Meaford, Canada 22 Defense Health Network, National Capital Region, Defense Health Agency, Bethesda, MD, USA 23 Second Health Brigade, Australian Army, Sydney, Australia 24 Defence Rehabilitation, Ministry of Defence, London, UK 25 Belgium Armed Forces, Brussels, Belgium 26 59th Medical Wing, Joint Base San Antonio - Wilford Hall Ambulatory Surgical Center, Lackland AFB, Texas, USA 27 Military Performance Division, US Army Research Institute of Environmental Medicine, Natick, Massachusetts, USA 28 Sport Injury Prevention Research Centre, Faculty of Kinesiology, University of Calgary, Calgary, Alberta, Canada 29 Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, England, UK Garrett S. Bullock Roles: Conceptualization, Data Curation, Formal Analysis, Investigation, Methodology, Software, Visualization, Writing – Original Draft Preparation, Writing – Review & Editing Joanne L. Fallowfield Roles: Conceptualization, Investigation, Methodology, Supervision, Writing – Review & Editing Sarah J. de la Motte Roles: Conceptualization, Investigation, Methodology, Writing – Original Draft Preparation, Writing – Review & Editing Nigel Arden Roles: Conceptualization, Investigation, Methodology, Supervision, Writing – Review & Editing Ben Fisher Roles: Investigation, Methodology, Writing – Review & Editing Adam Dooley Roles: Validation, Writing – Review & Editing Neil Forrest Roles: Validation, Writing – Review & Editing John J. Fraser Roles: Validation, Writing – Review & Editing Alysia Gourlay Roles: Validation, Writing – Review & Editing Ben R. Hando Roles: Validation, Writing – Review & Editing Katherine Harrison Roles: Validation, Writing – Review & Editing Debra Hayhurst Roles: Validation, Writing – Review & Editing Joseph M. Molloy Roles: Validation, Writing – Review & Editing Phillip M. Newman Roles: Validation, Writing – Review & Editing Eric Robitaille Roles: Validation, Writing – Review & Editing Deydre S. Teyhen Roles: Validation, Writing – Review & Editing Jeffrey M. Tiede Roles: Validation, Writing – Review & Editing Emma Williams Roles: Validation, Writing – Review & Editing Sandra Williams Roles: Validation, Writing – Review & Editing Damien Van Tiggelen Roles: Validation, Writing – Review & Editing Joshua J. Van Wyngaarden Roles: Validation, Writing – Review & Editing Richard B. Westrick Roles: Validation, Writing – Review & Editing Carolyn A. Emery Roles: Supervision, Validation, Writing – Review & Editing Gary S. Collins Roles: Supervision, Validation, Writing – Review & Editing Daniel I. Rhon Roles: Conceptualization, Data Curation, Funding Acquisition, Investigation, Methodology, Resources, Supervision, Validation, Writing – Original Draft Preparation, Writing – Review & Editing OPEN PEER REVIEW DETAILS REVIEWER STATUS Abstract Background The objective was to summarize the methodology used to develop the international minimum data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement. This is a recommended list of elements to be collected and reported when conducting injury surveillance research in military settings. Methods A Delphi methodology was employed to reach consensus. Preliminary steps included conducting a literature review and surveying a convenience sample of military stakeholders to 1) identify barriers and facilitators of military musculoskeletal injury (MSKI) prevention programs, 2) identify relevant knowledge gaps, and 3) establish future research priorities. A sequential three-round Delphi consensus survey followed, including relevant stakeholders from militaries around the world, using results to conduct an asynchronous knowledge user meeting (mixture of in-person and live video conference and recording) to explore the level of agreement among subject matter experts. Knowledge users, including former and current military service members, civilian practitioners working in military health networks, and international subject matter experts having experience with policy, execution, or clinical investigation of MSKI mitigation programs, MSKI diagnoses, and MSKI risk factors in military settings. For each round, participants scored questions on a Likert scale of 1-5. Scores ranged from No Importance (1) to Strong Importance (5). Results Literature review and surveys helped inform the scope of potential variables. Three rounds were necessary to reach minimum consensus. Ninety-five, 65, and 42 respondents participated in the first, second and third rounds, respectively. Conclusions Achieving consensus across relevant knowledge users representing military organizations globally can be challenging. This paper details the methodology employed to reach consensus for a core minimum data elements checklist for conducting MSKI research in military settings and improve data harmonization and scalability efforts. These methods can be used as a resource to assist in future consensus endeavors of similar nature. READ ALL READ LESS Keywords Implementation Science, Consensus, Delphi, Military, Sports Medicine, Military Medicine, Wounds and Injuries, Investigative Techniques Corresponding Author(s) Daniel I. Rhon ( [email protected] ) Close Corresponding author: Daniel I. Rhon Competing interests: No competing interests were disclosed. Grant information: This work was sponsored by the Musculoskeletal Injury Rehabilitation Research for Operational Readiness organization (Department of Physical Medicine and Rehabilitation), Center for Health Services Research, and Consortium for Health and Military Performance at the Uniformed Services University (Award: HU00012320034) and the US Department of Defense. Additional funding was provided by United Kingdom Defence Primary Healthcare, HQ Surgeon General, and Institute of Naval Medicine, Navy Command, United Kingdom. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Copyright: © 2025 Bullock GS et al . This is an open access article distributed under the terms of the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. How to cite: Bullock GS, Fallowfield JL, de la Motte SJ et al. Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.12688/f1000research.152514.2 ) First published: 11 Sep 2024, 13 :1044 ( https://doi.org/10.12688/f1000research.152514.1 ) Latest published: 03 Apr 2025, 13 :1044 ( https://doi.org/10.12688/f1000research.152514.2 ) Revised Amendments from Version 1 This revision includes minor issues recommended by the reviewers, to include some minor grammatical issues and then primarily related to further clarification of certain aspects of the approach, which included: - Clarifying who the civilian practitioners were - Explaining what a knowledge user consisted of - Description of asynchronous meetings This revision includes minor issues recommended by the reviewers, to include some minor grammatical issues and then primarily related to further clarification of certain aspects of the approach, which included: - Clarifying who the civilian practitioners were - Explaining what a knowledge user consisted of - Description of asynchronous meetings See the authors' detailed response to the review by Chris M. Edwards See the authors' detailed response to the review by Kenton R. Kaufman See the authors' detailed response to the review by Oliver O'Sullivan READ REVIEWER RESPONSES Introduction Collection, surveillance, and reporting of injury data is an important and ubiquitous aspect of musculoskeletal (MSK) care within systems seeking to evaluate and improve injury prevention and care models. This is particularly true across military performance and medical settings. 1 – 3 Often the data are inadequately powered (individual clinics or small sample sizes), requiring merging of data to properly compare patient subgroups, generalize results across different populations, and potentially answer clinically important questions. 4 , 5 However, merging of these data is often hampered by high heterogeneity in data elements, outcomes, and definitions. 1 Thus, there have been many recommendations to standardize data collection elements and practices to improve harmonization of data within a specific discipline or setting. 5 – 7 Data collection procedures are highly variable across and even within military organizations world-wide, without a universal standard operating procedure. 1 For example, in a systematic review assessing musculoskeletal injury (MSKI) risk factors in military populations, high variability in exposure, outcome, and predictor collection and reporting from 170 studies limited the ability to effectively compare risk factors and injury risk across service member groups. 1 In a scoping review of 132 articles investigating military MSKI mitigation programs, heterogeneity in data and outcomes hindered the ability to calculate service member injury burden. 8 This variability in the collection and reporting of data elements may prevent clinicians, military leaders, and researchers from answering pertinent operational and clinical questions. One method to improve consistency of standardized data collection and reporting across studies is through the development of a recommended list of core minimum data elements that everyone should collect and report. 5 , 7 Consensus for core minimum data elements has occurred across biomedicine fields (e.g. geriatrics, 7 pediatrics 5 ) and for specific conditions (e.g. traumatic injuries, 9 osteoarthritis, 10 pain 6 ). A common list of standardized data elements enables a systematic approach to data collection and focused analysis, allowing the specific study question to be addressed, but also facilitating aggregation and meta-analysis across studies. 4 This standardized practice ultimately leads to greater potential for increased cohort size and ultimately inference power. 4 Recently a group of knowledge users (person who contributed to knowledge creation and have input equal to the scientific community) consisting of clinicians, researchers, policymakers and leaders in military settings world-wide collaborated to identify/recommend the minimum elements for collection and reporting in any study assessing MSKI in military populations. The project followed a Delphi consensus methodology to engage many relevant stakeholders world-wide. This paper summarizes the details and methodology used to develop the Minimum Data Elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement. Methods Process The ROMMIL project was informed by the guidance for developers of health research guidelines. 11 Consensus reporting was informed by the ACcurate COnsensus Reporting Document (ACCORD) reporting guidelines. 12 Further methods and details, and respective protocols are available on Open Science Framework ( https://osf.io/2wqbr/ ). Figure 1 displays the consensus process. This project adhered to all ethical principles of the Declaration of Helsinki. It was determined to not be human subjects research by the Institutional Review Board at Wake Forest University, School of Medicine (# IRB00115873), and therefore formal consent was not necessary. All participants were made aware that the data and collected information would be used to formulate a consensus statement, with the intent to publish the results, and all participants were invited to participate in the full process as authors. Figure 1. Consensus process. Strategy A core group of six members (GB, NA, JF, SdlM, BF, DR) identified the need for a standardized list of minimum core data elements for collection and reporting when conducting MSKI research. They pursued a balance in expertise across clinical and research disciplines, countries, and military branches while conducting a literature synthesis via scoping review, knowledge user survey, Delphi study and consensus meeting to achieve the ROMMIL consensus statement. Bias Reduction Measures to reduce bias included having steering group members not being able participate in the small group conversations and only contribute to the full group discussions during the consensus meetings when invited. Steering group members were not allowed to initiate remarks. If invited to speak, steering group members were only allowed to provide clarification or guidance when appropriate. An independent experienced external moderator lead all group discussions to reduce the risk of dominant personalities and also reduce steering group bias. Finally, all meetings were open for in person, video, and viewing at a later date, with an open period to comment, to allow for inclusion of voices that could not make the meetings. Stage 1: Literature synthesis A scoping review was performed to (1) identify barriers to and facilitators of military MSKI prevention programs, (2) identify relevant knowledge/information gaps and (3) establish future research priorities. This scoping review has been published separately. 8 Databases included MEDLINE and the Defense Technical Information Center (DTIC). The results from the scoping review were merged with recommendations provided by the entire author group. The group created a preliminary list of all possible data elements and principles, based on the results of the scoping review. A knowledge user meeting, consisting of 45 participants, was then convened to further evaluate the list, which then received final approval by the steering committee (GB, NA, JF, SdlM, BF, DR). Stage 2: Survey The authors recruited a cross-sectional convenience sample the Total Force Fitness MSK Health conference attendees, then used a snowball recruitment method to gather knowledge user feedback concerning military MSKI mitigation program barriers and facilitators. The detailed results from this survey were reported elsewhere. 13 The reported barriers and facilitators were used to help guide the framework questions for the consensus exercise. Knowledge user involvement (Patient and public involvement) Knowledge users (including former and current military service members, civil practitioners that work in military health networks, and international subject matter experts having experience with policy, execution, or clinical investigation of MSKI mitigation programs, MSKI diagnoses, and military MSKI risk factors) were included in the development of the research question. A working group evolved from a sample of the knowledge users after the initial meetings. Knowledge users sought to improve the overarching question while accounting for research implications and facilitate knowledge translations. The knowledge user group included active-duty service members, veterans, military leaders, medical professionals that work in military settings (both military and civilian, that include athletic trainers, physical therapists, and physicians), scientists that work in military settings, and exercise physiologists from the United Kingdom and United States. Delphi study Study design A sequential three round Delphi survey was performed. An asynchronous knowledge user meeting was performed to explore level of agreement among subject matter experts. Recruitment Experts were identified through the closeness continuum. 13 The closeness continuum identifies inclusive experts with subjective, mandated, and objective closeness to the topic of interest. 13 , 14 Military service members having sustained MSKI across their careers had subjective closeness. Clinicians treating service members for MSKI had mandated closeness. Researchers and scientific experts investigating military MSKI had objective closeness. Recruitment entailed an email identifying an individual as a military MSKI expert and requesting that they participate in a Delphi consensus project, via a series of planned meetings. A follow-up email with an encrypted link was sent to those who wanted to participate, in order to answer a series of questions concerning injury surveillance and reporting in military settings (see extended data). 15 Participants were told that their answers would help inform the consensus project, and that all responses would remain anonymous. Delphi rounds and scoring Participants scored each question on a Likert scale of 1-5 for each round. Each question followed one of two formats shown in Table 1 . Table 1. Likert survey question format. Please refer to the scale below to rate how important you think each data point is to include in military musculoskeletal injury research: No importance Minimal importance Some importance Strong importance Extreme importance Please refer to the scale below to rate how important you think each injury classification system or metric is to define military musculoskeletal injury: Extremely inappropriate Somewhat inappropriate Neither appropriate nor inappropriate Somewhat appropriate Extremely appropriate Following round 1, a synchronous knowledge user virtual meeting was held to discuss outlying scores, express and document disagreement or dissent concerning any statement, and propose alterations to variables and/or verbiage. In round 2, participants had access to their previous scoring for each question. Changes in scoring were documented. A third round of scoring was unnecessary if the knowledge user group reached consensus on a given question during the second round. Consensus criteria are defined a priori ( Table 2 ). Table 2. Criteria for consensus for inclusion, consensus for exclusion, and non-consensus. Criteria Definition Implication Threshold for consensus that variable should be included in a minimum data set for musculoskeletal injury in military populations (Consensus for inclusion). ≥ 80% of participants assign a score of ≥ 4 OR Median score of ≥4 in two consecutive rounds. Variable does not proceed to the next round. Threshold for consensus that variable should not be included in a minimum data set for musculoskeletal injury in military populations (Consensus for exclusion). ≥ 50% of participants assign a score of ≤ 2 OR Median score of ≤2 in two consecutive rounds. Variable does not proceed to the next round. Threshold for non-consensus. Median score of 3 in two consecutive rounds OR Median score decreases by ≥ 1 point in a round compared to the previous round. Variable does not proceed to the next round, consensus for exclusion. Median score increases by ≥ 1 point in a round compared to the previous round. Variable proceeds to the next round. Statistical analyses Missing data were assessed prior to analyses. A complete case analysis was performed for the Delphi study. Participant data were reported as mean (standard deviation) for continuous data and count (%) for nominal and ordinal data. All analyses were performed in R 4.2.1 (R Core Team (2023). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/ ). The dplyr package was used for cleaning and analyses, and the ggplot2 package was used for data visualization. The raw data available from each round are available in an open-source repository. 16 Stage 3: Consensus meeting After completing the Delphi rounds, a final consensus meeting was held on 13 September 2023 at the International Congress on Soldier’s Physical Performance, in London, United Kingdom. All participants were invited to attend. The meeting was recorded for people who could not join the meeting in person to view at a later date. The purpose of the meeting was to (1) discuss the literature synthesis, survey, and Delphi survey results and (2) obtain advisory input on the final set of recommended minimum data elements for MSKI research in military settings. Fifty international participants (including military MSKI knowledge users, clinicians, and research experts) were present. The meeting was facilitated by the ROMMIL steering committee (GB, NA, JF, SdlM, BF, DR). Participants discussed and sought to achieve consensus on each data element during the meeting. Stage 4: Consensus revision After the consensus meeting, the steering committee (GB, NA, JF, SdlM, BF, DR) reviewed the results and revised the consensus statement based on pertinent feedback. The format and wording of each data element were reviewed and agreed upon, taking into consideration the survey, Delphi study, and consensus meeting results and discussions. A 6-week open comment period was held for anyone to comment on the document. The electronic link was made available through the Musculoskeletal Injury Rehabilitation Research for Operational Readiness (MIRROR) website ( https://mirrorusuhs.org/ ) and emailed to individuals who had participated in preliminary meetings and activities. The draft consensus was then circulated again among consensus participants to (1) confirm accurate representation of the group consensus or (2) determine if further clarification was needed. Results Ninety-five, 65 and 42 respondents participated in the first, second and third rounds of the Delphi, respectively ( Table 3 ). The process used a Delphi methodology, which is an acceptable and preferred method for validating consensus experiments. 16 , 17 Table 3. Delphi participant descriptive statistics. Variable Round one participants (n = 95) Round two participants (n = 65) Round three participants (n = 45) Primary Role Administrative Leadership 10 (11%) 4 (6%) 4 (9%) Clinician/Practitioner 25 (26%) 23 (35%) 11 (24%) Command/Leadership 5 (5%) 1 (2%) 3 (7%) Implementing Human Performance Programs 4 (4%) 3 (5%) 4 (9%) Implementing Injury Prevention Programs 9 (9%) 8 (12%) 3 (7%) Researcher 41 (43%) 24 (37%) 20 (44%) Secondary Role Administrative Leadership 11 (12%) 6 (9%) 3 (7%) Clinician/Practitioner 23 (24%) 13 (20%) 12 (28%) Command/Leadership 3 (3%) 2 (3%) 2 (4%) Implementing Human Performance Programs 10 (11%) 9 (14%) 7 (16%) Implementing Injury Prevention Programs 20 (21%) 18 (28%) 7 (16%) Physical Training Instructor 3 (3%) 1 (2%) 0 (0%) Researcher 13 (14%) 8 (12%) 7 (16%) Country Australia 14 (15%) Belgium 2 (2%) Canada 7 (7%) New Zealand 2 (2%) United Kingdom 23 (24%) United States 47 (49%) * Blank cells denote information was not disclosed Round one Eleven data elements reached consensus after round one ( Table 4 ). Twenty-six data elements did not reach consensus after round one ( Table 5 ); 66 data elements were excluded after round one ( Table 6 ). Table 4. Data elements with consensus after round one. Data element Median score (IQR) Agree percent Unique Individual Identifier (i.e., ID) 5 (1) 81% Age 5 (1) 92% Sex 5 (1) 96% Service Member is in Initial Military Training 5 (1) 96% Body Part/Region 5 (1) 97% Mechanism of Injury 5 (1) 90% Presentation (i.e., sudden or gradual) 5 (1) 94% Activity during injury 5 (1) 90% Overuse Injuries 5 (1) 99% Acute Injuries 5 (1) 99% Traumatic Injuries 5 (1) 99% Table 5. Data elements with no consensus after round one. Data element Median score (IQR) Percent agree Height 4 67% Weight 4 79% Military Branch (e.g., Army, Navy, Air Force) 4 64% Position, Duty or Occupational Specialty 4 76% Years Working in the Military 4 64% Terms of Service 4 58% Previous Orthopaedic Surgery 4 73% Body Part and/or Joint of Previous Orthopaedic Surgery 4 74% How Long Ago Was Previous Orthopaedic Surgery 4 73% What Type of Injury Was Past Injury (location, etc.) 4 78% How Long Ago Was Previous Musculoskeletal Injury 4 72% Percent Perceived Return to Function Following Previous Musculoskeletal Injury 4 69% Tobacco Products Consumption 4 73% Service Member is Attending Formal Military Training Course 4 69% Service Member is in Special Operations 4 79% Individual Exposure 4 76% Exposure in Hours 4 52% Exposure in Days 4 66% Clinical Diagnosis of the Injury 4 71% Days from Injury to Seeking Medical Care 4 64% Days from Injury to Physical Therapy for Injury 4 59% Duty Time Lost in Days from Injury 4.5 78% Table 6. Data elements excluded after round 1. Data element Median score (IQR) Percent agree Waist Circumference 2 (1) 13% Hip to Waist Ratio 2 (1) 6% Body Fat Percentage 2.5 (1) 16% Body Mass Index 2 (1) 7% Race/Ethnicity 2 (1) 10% Marital Status 1 (1) 6% Physical Fitness Test Exemptions (e.g., “can do everything except running”) 2.5 (1) 24% Previous Sport/Exercise Experience 2.5 (1) 18% Historical Physical Fitness Test Scores 2.5 (1) 14% Aerobic Fitness 2.5 (1) 27% Rank 2 (1) 10% Officer versus Ordinary Rank (i.e., Enlisted) 2 (1) 17% Highest Level of Education Achieved 2 (1) 2% Base or Post (i.e., where currently stationed) 2 (1) 9% Unit 2 (1) 14% Deployment History 2 (1) 15% Number of Deployments 2 (1) 6% Length of Most Recent Redeployment (months) 2 (1) 5% Time Since Last Deployment (months/years) 2 (2) 6% Menstrual Cycle/Amenorrhea 2.5 (1) 16% Use of Oral Contraceptives 2.5 (1) 8% Number of Pregnancies 2 (1) 8% Number of Live Births 2 (2) 7% Live Birth Complications History 2 (2) 5% Time Since Last Live Birth 2 (1) 10% Previous Time Loss from Injury (i.e., on profile, limited duty, light duty) Occurrences 2.5 (1) 32% Previous Number of Days of Time Loss from Injury (i.e., on profile, limited duty, light duty) 2.5 (1) 33% Treatment Interventions Used for Past Injury 2.5 (1) 17% How Many Months Since Individual Passed Service Required Physical Fitness Test 2.5 (1) 16% Joint Hypermobility 2 (1) 3% Previously Seen a Mental Health Provider for a Mental Health/Behavioral Health Condition (and how long ago) 2.5 (1) 13% Diagnosed Previous Sleep Disorders 2 (1) 9% Previous History of Relative Energy Deficiency (RED-S) 2.5 (1) 15% Previous History of Female Athlete Triad 2.5 (1) 19% Self-Perceived Health 2 (1) 16% Self-Perceived Fitness 2 (1) 16% Recreational Physical Activity (e.g., per day, per week) 2.5 (1) 23% Nutrition Habits 2.5 (1) 21% Alcohol Consumption 2.5 (1) 16% Contact and Collision Sport Involvement (and how long ago)? 2 (1) 13% Childcare Responsibilities 2 (1) 6% Social Support 2 (1) 13% Emotional Stress 2.5 (1) 19% Hours of Sleep 2.5 (2) 31% Quality of Sleep 2.5 (1) 22% Unit/Platoon Exposure 2.5 (1) 19% Exposure in Minutes 2 (2) 6% Number of Times/Activities Occurrences 2.5 (1) 22% Work (exercise) Intensity 2.5 (1) 25% Time Spent in Specific Activities of Varied Intensity 2.5 (1) 16% Cumulative Loading Over Military Career 2.5 (1) 23% Cumulative Loading Over Specified Period of Time (e.g., training exercise; deployment period) 2.5 (1) 31% Laterality of Injury 2.5 (1) 20% Amount of Pain from Injury 2 (1) 11% Days from Initial Complaint Until Injury Became Time-Loss 2.5 (1) 13% Time of Injury 2 (1) 11% SNOMED CT Coding System 2 (1) 5% Tissue 2.5 (2) 32% Care-Seeking Injury 2.5 (2) 31% Time Since They Previously Had That Injury If Prior History (months/years) 2.5 (1) 28% Round two In round two, 16 more data elements reached consensus ( Table 7 ); four data elements were combined with data elements that had already reached consensus ( Table 8 ). Six data elements did not reach consensus after round two ( Table 9 ). Table 7. Included data elements after round two. Data element Median score (IQR) Percent agree Height 4 (1) 66% Weight 4 (2) 74% Military Branch 4 (1) 57% Position Duty or Occupational Specialty 4 (2) 72% Previous Orthopaedic Surgery 4 (2) 66% Previous Musculoskeletal Injury 4 (2) 82% Time Since Previous Musculoskeletal Injury 4 (2) 57% Military Role (Combat, Support, Special Operations) 4 (1) 69% Exposure in Days 4 (1) 60% Clinical Diagnosis of Injury 4 (1) 77% Days from Injury to Seeking Medical Care 4 (1) 52% Duty Time Lost in Days from Injury 4 (1) 75% Type of Injury (Primary, Subsequent, Recurrent, or Exacerbation Injury) 4 (1) 79% Time Loss of Injury in Days 4 (1) 75% Prior History of that Specific Injury 4 (1) 71% Date of Injury 4 (1) 54% Table 8. Data elements combined with other elements (already with consensus) after round two. Data element Median score (IQR) Percent agree Combined with Terms of Service 3 (2) 43% Military Role Exposure in Hours 3 (2) 48% Exposure in Days Days from Injury to Physical Therapy 3 (1) 42% Days to Seeking Medical Attention Surveillance Days Until Injury 3 (2) 45% Days Until Injury Table 9. No consensus after round two. Data element Median score (IQR) Percent agree Tobacco or Nicotine Use 3 (1) 45% Terrain Where Injury Occurred 3 (1) 39% Equipment Worn at the Time of Injury 3 (1) 40% Years Working in Military 3 (2) 45% Setting of training 3 (1) 46% Formal Military Course 3 (1) 46% Round three Two more data elements reached consensus in round three. The other three data elements did not reach consensus ( Table 10 ). Table 10. Round three. Data element Median score (IQR) Percent agree Tobacco or Nicotine Use 4 (3) 26% Terrain Where Injury Occurred 3 (1) 22% Equipment Worn at the Time of Injury 3 (1) 24% Years Working in Military 3 (2) 21% Setting of training 4 (2) 33% Discussion An integrated and scalable process for collecting and reporting MSKI data is necessary to successfully evaluate MSKI interventions in military populations. The methodology, supporting results, and decisions made during the ROMMIL development are provided in this report. The process included a literature synthesis, knowledge user survey, Delphi study, consensus meeting, and electronic consensus open meeting for further review. This process incorporated a broad range of supporting literature, relevant data, and direct input from knowledge users having wide-ranging MSKI-related experiences and expertise. The steering committee included members with wide-ranging viewpoints and areas of expertise; military MSKI surveillance and research occur world-wide, encompassing varying levels of institutional support, environments, and cultures. Multiple knowledge user meetings were held across the research process. The closeness continuum, 13 identifying different types of experts, was used to inform and identify knowledge users for inclusion in the consensus process. The ROMMIL consensus statement was presented in person, on an open science platform, and through an open, freely accessible electronic link to mitigate or eliminate travel or institutional support barriers. Feedback was received through multiple interfaces, allowing for comprehensive input. Forms of feedback included verbal, free text, and quantitative scores, increasing the depth and richness of feedback. Potential limitations While international input was emphasized, most knowledge user feedback came from participants living in English speaking countries (i.e. North America, Europe, former British Commonwealth countries), with the steering committee living in the United States and the United Kingdom. Military organizations with differing levels of institutional support may have differing (1) MSKI-related needs and (2) abilities to collect and report specific data elements. Further enquiry is needed to evaluate the ROMMIL checklist in these military populations. Only one conference was attended to help inform the original data elements list, as knowledge users from different backgrounds could attend other conferences across the globe, there may be selection bias limitations in the original proposed elements list. There was attrition in the Delphi survey, potentially decreasing the strength of recommendations. The ROMMIL steering committee screened data elements throughout the process, ensuring a manageable and feasible number of data elements was included for collection and reporting. Continual screening was necessary, given the wide-ranging (1) body of MSKI-related literature, (2) knowledge user suggestions, and (3) responses from the knowledge user survey and Delphi study. The steering committee might have selected data elements that differed from individual knowledge users’ selections. To mitigate this potential bias, the steering committee conducted multiple knowledge user meetings and encouraged maximal input/feedback from all members throughout the process. The primary report summarizing the ROMMIL consensus checklist for minimum data elements to collect and report when conducting injury surveillance research will be published separately. Conclusions Achieving consensus with knowledge users representing global-wide military organizations is challenging. This paper details the methodology established to reach consensus, while enabling all participants to provide input (including dissenting opinions). The ROMMIL consensus provides a core minimum data elements checklist for military MSKI scientists to improve data harmonization and scalability efforts. These methods can be used as a resource to assist future consensus endeavors in similar populations. Ethics and consent This project was determined to not be human subjects research by the Institutional Review Board at Wake Forest University, School of Medicine (# IRB00115873, determination made 1 July 2024). Individuals consented to be involved by participating in the meetings and voting process, a determination that was approved by the Institutional Review Board. All participants were made aware up front that the results and conclusions would be summarized into a consensus statement that would be published and shared with the greater scientific community. Data were anonymous and not linked to individual participants. Disclaimer The view(s) expressed herein are those of the author(s) and do not necessarily reflect the official policy or position of the Uniformed Services University, the US Defense Health Agency, the US Department of Defense, the U.K. Department of Defense, nor the U.S. or U.K. Governments. Author information The following authors are military service members (either past or present): JJF, BRH, JMM, DST, JMT, EW, SW, DVT, JJV, RBW, DIR. Data availability Underlying data OSF: Supplementary Data for Project: Minimum Common Data Elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL); DOI 10.17605/OSF.IO/2WQBR . 15 URL: https://osf.io/2wqbr/ , 15 This project contains the following underlying data: This is a description of methodology and not a full report of the actual Delphi study, the results of which will be reported elsewhere. Delphi data • DataDictionary.csv • Round1.csv • Round2.csv • Round3.csv Data are available under the terms of the CC0 1.0 Universal license applied. Extended data OSF: Supplementary Data for Project: Minimum Common Data Elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL); DOI 10.17605/OSF.IO/2WQBR . 15 URL: https://osf.io/2wqbr/ , 15 This project contains the following extended data: Initial questions • Appendix_Delphi_Initial_Tables.docx Recruitment email • Delphi_Email.docx Data are available under the terms of the CC0 1.0 Universal license applied. References 1. Rhon DI, Molloy JM, Monnier A, et al. : Much work remains to reach consensus on musculoskeletal injury risk in military service members: a systematic review with meta-analysis. Eur. J. Sport Sci. 2022; 22 (1): 16–34. PubMed Abstract | Publisher Full Text 2. Mauntel TC, Tenan MS, Freedman BA, et al. : The military orthopedics tracking injuries and outcomes network: a solution for improving musculoskeletal care in the military health system. Mil. Med. 2022; 187 (3-4): e282–e289. PubMed Abstract | Publisher Full Text 3. Jones BH, Canham-Chervak M, Canada S, et al. : Medical surveillance of injuries in the US military: descriptive epidemiology and recommendations for improvement. Am. J. Prev. Med. 2010; 38 (1): S42–S60. Publisher Full Text 4. Kush RD, Warzel D, Kush MA, et al. : FAIR data sharing: the roles of common data elements and harmonization. J. Biomed. Inform. 2020; 107 : 103421. PubMed Abstract | Publisher Full Text 5. McCann LJ, Pilkington CA, Huber AM, et al. : Development of a consensus core dataset in juvenile dermatomyositis for clinical use to inform research. Ann. Rheum. Dis. 2018; 77 (2): 241–250. PubMed Abstract | Publisher Full Text | Free Full Text 6. Dworkin RH, Turk DC, Farrar JT, et al. : Core outcome measures for chronic pain clinical trials: IMMPACT recommendations. Pain. 2005; 113 (1): 9–19. PubMed Abstract | Publisher Full Text 7. Welch C, Wilson D, Sayer AA, et al. : Development of a UK core dataset for geriatric medicine research: a position statement and results from a Delphi consensus process. BMC Geriatr. 2023; 23 (1): 168. PubMed Abstract | Publisher Full Text | Free Full Text 8. Bullock GS, Dartt CE, Ricker EA, et al. : Barriers and facilitators to implementation of musculoskeletal injury mitigation programmes for military service members around the world: a scoping review. Inj. Prev. 2023; 29 : 461–473. PubMed Abstract | Publisher Full Text | Free Full Text 9. Ringdal KG, Lossius HM, Jones JM, et al. : Collecting core data in severely injured patients using a consensus trauma template: an international multicentre study. Crit. Care. 2011; 15 : 1–11. 10. Leyland K, Gates L, Nevitt M, et al. : Harmonising measures of knee and hip osteoarthritis in population-based cohort studies: an international study. Osteoarthr. Cartil. 2018; 26 (7): 872–879. PubMed Abstract | Publisher Full Text | Free Full Text 11. Moher D, Schulz KF, Simera I, et al. : Guidance for developers of health research reporting guidelines. PLoS Med. 2010; 7 (2): e1000217. PubMed Abstract | Publisher Full Text | Free Full Text 12. Gattrell WT, Logullo P, van Zuuren EJ , et al. : ACCORD (ACcurate COnsensus Reporting Document): A reporting guideline for consensus methods in biomedicine developed via a modified Delphi. medRxiv. 2023. 2023.08.22.23294261. 13. Needham RD, de Loë RC : The policy Delphi: purpose, structure, and application. Canadian Geographer/Le Géographe Canadien. 1990; 34 (2): 133–142. Publisher Full Text 14. Donohoe HM, Needham RD: Moving best practice forward: Delphi characteristics, advantages, potential problems, and solutions. Int. J. Tour. Res. 2009; 11 (5): 415–437. Publisher Full Text 15. Supplementary Data for Project: Minimum Common Data Elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) Open Science Framework. DOI: 10.17605/OSF.IO/2WQBR. http 16. Landeta J: Current validity of the Delphi method in social sciences. Technol. Forecast. Soc. Chang. 2006; 73 (5): 467–482. Publisher Full Text 17. Nasa P, Jain R, Juneja D: Delphi methodology in healthcare research: How to decide its appropriateness. World J Methodol. Jul 20 2021; 11 (4): 116–129. PubMed Abstract | Publisher Full Text | Free Full Text Comments on this article Comments (0) Version 2 VERSION 2 PUBLISHED 11 Sep 2024 ADD YOUR COMMENT Comment Author details Author details 1 Centre for Sport, Exercise, and Osteoarthritis, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, England, UK 2 Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA 3 Department of Orthopaedic Surgery & Rehabilitation, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA 4 Institute of Naval Medicine, Directorate of People and Training, Royal Navy, Hampshire, UK 5 Consortium for Health and Military Performance, Department of Military and Emergency Medicine, F. Edward Hébert School of Medicine, Uniformed Services University, Bethesda, MD, USA 6 Department of Physical Medicine & Rehabilitation, F. Edward Hébert School of Medicine, Uniformed Services University, Bethesda, Maryland, USA 7 Medical Research Council (MRC), Environmental Epidemiology Unit, University of Southampton, Southampton, England, UK 8 Defence Primary Healthcare, Headquarters Surgeon General, London, UK 9 Army Health, Army Headquarters, London, UK 10 Human Sciences Programme, Defence Science & Technology, New Zealand Defence Force, Auckland, New Zealand 11 Operational Readiness and Health Directorate, Naval Health Research Center, San Diego, CA, USA 12 Joint Health Command, Department of Defence, Australian Capital Territory, Australia 13 Army-Baylor University, Waco, Texas, USA 14 Department of Rehabilitation Medicine, Brooke Army Medical Center, Fort Sam Houston, Texas, USA 15 Defense Statistics Health, Ministry of Defence, London, UK 16 Director General, Finance, Ministry of Defence, London, UK 17 Headquarters Defence Medical Services, Strategic Command, Ministry of Defence, London, UK 18 Formerly at the Physical Performance Service Line, Office of the Army Surgeon General, Falls Church, Virginia, USA 19 Research Institute for Sport and Exercise, University of Canberra, Canberra, Australian Capital Territory, Australia 20 Teaching Stream Department of Physical Therapy, Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada 21 31 CF H Svcs C Detachment, Department of National Defence, Meaford, Canada 22 Defense Health Network, National Capital Region, Defense Health Agency, Bethesda, MD, USA 23 Second Health Brigade, Australian Army, Sydney, Australia 24 Defence Rehabilitation, Ministry of Defence, London, UK 25 Belgium Armed Forces, Brussels, Belgium 26 59th Medical Wing, Joint Base San Antonio - Wilford Hall Ambulatory Surgical Center, Lackland AFB, Texas, USA 27 Military Performance Division, US Army Research Institute of Environmental Medicine, Natick, Massachusetts, USA 28 Sport Injury Prevention Research Centre, Faculty of Kinesiology, University of Calgary, Calgary, Alberta, Canada 29 Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, England, UK Garrett S. Bullock Roles: Conceptualization, Data Curation, Formal Analysis, Investigation, Methodology, Software, Visualization, Writing – Original Draft Preparation, Writing – Review & Editing Joanne L. Fallowfield Roles: Conceptualization, Investigation, Methodology, Supervision, Writing – Review & Editing Sarah J. de la Motte Roles: Conceptualization, Investigation, Methodology, Writing – Original Draft Preparation, Writing – Review & Editing Nigel Arden Roles: Conceptualization, Investigation, Methodology, Supervision, Writing – Review & Editing Ben Fisher Roles: Investigation, Methodology, Writing – Review & Editing Adam Dooley Roles: Validation, Writing – Review & Editing Neil Forrest Roles: Validation, Writing – Review & Editing John J. Fraser Roles: Validation, Writing – Review & Editing Alysia Gourlay Roles: Validation, Writing – Review & Editing Ben R. Hando Roles: Validation, Writing – Review & Editing Katherine Harrison Roles: Validation, Writing – Review & Editing Debra Hayhurst Roles: Validation, Writing – Review & Editing Joseph M. Molloy Roles: Validation, Writing – Review & Editing Phillip M. Newman Roles: Validation, Writing – Review & Editing Eric Robitaille Roles: Validation, Writing – Review & Editing Deydre S. Teyhen Roles: Validation, Writing – Review & Editing Jeffrey M. Tiede Roles: Validation, Writing – Review & Editing Emma Williams Roles: Validation, Writing – Review & Editing Sandra Williams Roles: Validation, Writing – Review & Editing Damien Van Tiggelen Roles: Validation, Writing – Review & Editing Joshua J. Van Wyngaarden Roles: Validation, Writing – Review & Editing Richard B. Westrick Roles: Validation, Writing – Review & Editing Carolyn A. Emery Roles: Supervision, Validation, Writing – Review & Editing Gary S. Collins Roles: Supervision, Validation, Writing – Review & Editing Daniel I. Rhon Roles: Conceptualization, Data Curation, Funding Acquisition, Investigation, Methodology, Resources, Supervision, Validation, Writing – Original Draft Preparation, Writing – Review & Editing Competing interests No competing interests were disclosed. Grant information This work was sponsored by the Musculoskeletal Injury Rehabilitation Research for Operational Readiness organization (Department of Physical Medicine and Rehabilitation), Center for Health Services Research, and Consortium for Health and Military Performance at the Uniformed Services University (Award: HU00012320034) and the US Department of Defense. Additional funding was provided by United Kingdom Defence Primary Healthcare, HQ Surgeon General, and Institute of Naval Medicine, Navy Command, United Kingdom. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Article Versions (2) version 2 Revised Published: 03 Apr 2025, 13:1044 https://doi.org/10.12688/f1000research.152514.2 version 1 Published: 11 Sep 2024, 13:1044 https://doi.org/10.12688/f1000research.152514.1 Copyright © 2025 Bullock GS et al . This is an open access article distributed under the terms of the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Download Export To Sciwheel Bibtex EndNote ProCite Ref. Manager (RIS) Sente metrics Views Downloads F1000Research - - PubMed Central info_outline Data from PMC are received and updated monthly. - - Citations open_in_new 0 open_in_new 0 open_in_new SEE MORE DETAILS CITE how to cite this article Bullock GS, Fallowfield JL, de la Motte SJ et al. Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.12688/f1000research.152514.2 ) NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article. COPY CITATION DETAILS track receive updates on this article Track an article to receive email alerts on any updates to this article. TRACK THIS ARTICLE Share Open Peer Review Current Reviewer Status: ? Key to Reviewer Statuses VIEW HIDE Approved The paper is scientifically sound in its current form and only minor, if any, improvements are suggested Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit. Not approved Fundamental flaws in the paper seriously undermine the findings and conclusions Version 2 VERSION 2 PUBLISHED 03 Apr 2025 Revised Views 0 Cite How to cite this report: O'Sullivan O. Reviewer Report For: Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.5256/f1000research.179630.r375434 ) The direct URL for this report is: https://f1000research.com/articles/13-1044/v2#referee-response-375434 NOTE: it is important to ensure the information in square brackets after the title is included in this citation. Close Copy Citation Details Reviewer Report 16 Apr 2025 Oliver O'Sullivan , University of Nottingham, Nottingham, England, UK Approved VIEWS 0 https://doi.org/10.5256/f1000research.179630.r375434 Dear authors, thank you for taking on board all the recommendations from the peer reviewers. I think the manuscript reads well, is clear and has an important message - as far as I am concerned, it is ready. Best wishes ... Continue reading READ ALL Dear authors, thank you for taking on board all the recommendations from the peer reviewers. I think the manuscript reads well, is clear and has an important message - as far as I am concerned, it is ready. Best wishes and well done. Competing Interests: No competing interests were disclosed. Reviewer Expertise: Sports and exercise medicine, rehabilitation, military medicine I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard. Close READ LESS CITE CITE HOW TO CITE THIS REPORT O'Sullivan O. Reviewer Report For: Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.5256/f1000research.179630.r375434 ) The direct URL for this report is: https://f1000research.com/articles/13-1044/v2#referee-response-375434 NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article. COPY CITATION DETAILS Report a concern Respond or Comment COMMENT ON THIS REPORT Version 1 VERSION 1 PUBLISHED 11 Sep 2024 Views 0 Cite How to cite this report: Kaufman KR. Reviewer Report For: Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.5256/f1000research.167283.r339134 ) The direct URL for this report is: https://f1000research.com/articles/13-1044/v1#referee-response-339134 NOTE: it is important to ensure the information in square brackets after the title is included in this citation. Close Copy Citation Details Reviewer Report 05 Dec 2024 Kenton R. Kaufman , Mayo Clinic, Rochester, USA Approved with Reservations VIEWS 0 https://doi.org/10.5256/f1000research.167283.r339134 Abstract: Please define a “mixed knowledge user”. Please describe how the “asynchronous mixed knowledge user meeting” was conducted, or is this a typographical error? Please see comment in Methods section below. Recommend ... Continue reading READ ALL Abstract: Please define a “mixed knowledge user”. Please describe how the “asynchronous mixed knowledge user meeting” was conducted, or is this a typographical error? Please see comment in Methods section below. Recommend describing “civil servant practitioners” as a “civilian practitioner”. Introduction Please define a definition of “knowledge user”. Methods When the core group pursued “a balance in expertise”, what expertise was being balanced? What criteria were used to know when this goal had been achieved? Stage 2: What was the military MSKI conference that was used to collect the convenience sample? How was this conference selected? How was the stated goal to sample “global-wide subject matter experts” met? The methods state that a “synchronous mixed knowledge user meeting” was performed. The abstract states that an “asynchronous mixed knowledge user meeting” was conducted. Is there a typographic error in the abstract? Recommend describing “civil servant practitioners” as a “civilian practitioner”. Results There was a >50% decrease in Administrative Leadership, Command Leadership, and Physical Training Instructor between Round 1 and Round 2 of the Delphi Study. Was there any concern about this significant decrease in participation from these groups? Discussion This study provides an important list of data elements to be used for surveillance and reporting of musculoskeletal injuries that occur during military training. A weakness is that no data dictionary was created in this process and there is no indication that plans are in place to accomplish this task soon. Is the rationale for developing the new method (or application) clearly explained? Yes Is the description of the method technically sound? Yes Are sufficient details provided to allow replication of the method development and its use by others? Yes If any results are presented, are all the source data underlying the results available to ensure full reproducibility? Yes Are the conclusions about the method and its performance adequately supported by the findings presented in the article? Yes Competing Interests: No competing interests were disclosed. Reviewer Expertise: Musculoskeletal injury, Orthopedics, Registries, Outcomes Measurement I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above. Close READ LESS CITE CITE HOW TO CITE THIS REPORT Kaufman KR. Reviewer Report For: Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.5256/f1000research.167283.r339134 ) The direct URL for this report is: https://f1000research.com/articles/13-1044/v1#referee-response-339134 NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article. COPY CITATION DETAILS Report a concern Author Response 03 Apr 2025 Daniel Rhon , Department of Rehabilitation Medicine, Brooke Army Medical Center, Fort Sam Houston, USA 03 Apr 2025 Author Response Thank you Dr. Kaufman for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For ... Continue reading Thank you Dr. Kaufman for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Thank you to the authors for their tremendous effort in addressing MSKI in military populations. The methods described for the development of the Minimum Data Elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement will be an important reference for future publications and work in this field. Overall, the article is clear, concise and well written. A few minor changes RESPONSE: Thank you for the positive sentiment towards our work. Introduction: -Well written, intention and purpose are clearly described. RESPONSE: Thank you. Methods: -(Minor change): “ Military service members having sustained MSKI across their careers had subjective closeness. Clinicians treating service members for MSKI had mandated closeness. Researchers and scientific experts investigating military MSKI had objective closeness.” For individuals who qualified for more than 1 category, how were they assessed/allocated? RESPONSE: Thank you for this question. If a knowledge user was allocated to more than one group, they were included in both. We tried to create a balance between all three groups, and also have knowledge users in each group that were only in one group and were in multiple groups. -(Minor change):Please include a brief discussion on what measures were taken to mitigate biases. RESPONSE: Measures to reduce bias included having steering group members not being able participate in the small group conversations and only contributed to the full group discussions during the consensus meetings when invited. Steering group members were not allowed to initiate remarks. If invited to speak, steering group members were only allowed to provide clarification or guidance when appropriate. An independent experienced external moderator lead all group discussions to reduce the risk of dominant personalities and also reduce steering group bias. Finally, all meetings were open for in person, video, and viewing at a later date, with an open period to comment, to allow for inclusion of voices that could not make the meetings. This has been clarified within the methods. -(Minor change):Please describe dataset limitations within this section. RESPONSE: Data limitations have been added to the manuscript. “Only one conference was attended to help inform the original data elements list, as knowledge users from different backgrounds could attend other conferences across the globe, there may be selection bias limitations in the original proposed elements list. There was attrition in the Delphi survey, potentially decreasing the strength of recommendations.” Results: -The results are presented clearly. No recommended changes. RESPONSE: Thank you for this comment. Discussion/Conclusion: -(Minor change): Please provide a participant demographic breakdown, including profession. Given the challenges faced in achieving consensus, this information is relevant. RESPONSE: This is provided in Table 3, and also within the supplement. -(Minor change): It would also be helpful if other limitations were explored that could have contributed to the consensus challenges. RESPONSE: Further limitations have been added, as discussed above. “Only one conference was attended to help inform the original data elements list, as knowledge users from different backgrounds could attend other conferences across the globe, there may be selection bias limitations in the original proposed elements list. There was attrition in the Delphi survey, potentially decreasing the strength of recommendations.” -(Minor change): Please reframe the Discussion, or at least identify within the limitations, and amend the Conclusion to reflect this Delphi describes the United States and United Kingdom perspective, as indicated in the Methods section. RESPONSE: Further detail is included in the limitations. Supplementary Files: -Thank you for including the Initial Tables file, it provides contexts and allows transparency around data bias. RESPONSE: You are welcome. Thank you Dr. Kaufman for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Thank you to the authors for their tremendous effort in addressing MSKI in military populations. The methods described for the development of the Minimum Data Elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement will be an important reference for future publications and work in this field. Overall, the article is clear, concise and well written. A few minor changes RESPONSE: Thank you for the positive sentiment towards our work. Introduction: -Well written, intention and purpose are clearly described. RESPONSE: Thank you. Methods: -(Minor change): “ Military service members having sustained MSKI across their careers had subjective closeness. Clinicians treating service members for MSKI had mandated closeness. Researchers and scientific experts investigating military MSKI had objective closeness.” For individuals who qualified for more than 1 category, how were they assessed/allocated? RESPONSE: Thank you for this question. If a knowledge user was allocated to more than one group, they were included in both. We tried to create a balance between all three groups, and also have knowledge users in each group that were only in one group and were in multiple groups. -(Minor change):Please include a brief discussion on what measures were taken to mitigate biases. RESPONSE: Measures to reduce bias included having steering group members not being able participate in the small group conversations and only contributed to the full group discussions during the consensus meetings when invited. Steering group members were not allowed to initiate remarks. If invited to speak, steering group members were only allowed to provide clarification or guidance when appropriate. An independent experienced external moderator lead all group discussions to reduce the risk of dominant personalities and also reduce steering group bias. Finally, all meetings were open for in person, video, and viewing at a later date, with an open period to comment, to allow for inclusion of voices that could not make the meetings. This has been clarified within the methods. -(Minor change):Please describe dataset limitations within this section. RESPONSE: Data limitations have been added to the manuscript. “Only one conference was attended to help inform the original data elements list, as knowledge users from different backgrounds could attend other conferences across the globe, there may be selection bias limitations in the original proposed elements list. There was attrition in the Delphi survey, potentially decreasing the strength of recommendations.” Results: -The results are presented clearly. No recommended changes. RESPONSE: Thank you for this comment. Discussion/Conclusion: -(Minor change): Please provide a participant demographic breakdown, including profession. Given the challenges faced in achieving consensus, this information is relevant. RESPONSE: This is provided in Table 3, and also within the supplement. -(Minor change): It would also be helpful if other limitations were explored that could have contributed to the consensus challenges. RESPONSE: Further limitations have been added, as discussed above. “Only one conference was attended to help inform the original data elements list, as knowledge users from different backgrounds could attend other conferences across the globe, there may be selection bias limitations in the original proposed elements list. There was attrition in the Delphi survey, potentially decreasing the strength of recommendations.” -(Minor change): Please reframe the Discussion, or at least identify within the limitations, and amend the Conclusion to reflect this Delphi describes the United States and United Kingdom perspective, as indicated in the Methods section. RESPONSE: Further detail is included in the limitations. Supplementary Files: -Thank you for including the Initial Tables file, it provides contexts and allows transparency around data bias. RESPONSE: You are welcome. Competing Interests: No competing interests Close Report a concern Respond or Comment COMMENTS ON THIS REPORT Author Response 03 Apr 2025 Daniel Rhon , Department of Rehabilitation Medicine, Brooke Army Medical Center, Fort Sam Houston, USA 03 Apr 2025 Author Response Thank you Dr. Kaufman for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For ... Continue reading Thank you Dr. Kaufman for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Thank you to the authors for their tremendous effort in addressing MSKI in military populations. The methods described for the development of the Minimum Data Elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement will be an important reference for future publications and work in this field. Overall, the article is clear, concise and well written. A few minor changes RESPONSE: Thank you for the positive sentiment towards our work. Introduction: -Well written, intention and purpose are clearly described. RESPONSE: Thank you. Methods: -(Minor change): “ Military service members having sustained MSKI across their careers had subjective closeness. Clinicians treating service members for MSKI had mandated closeness. Researchers and scientific experts investigating military MSKI had objective closeness.” For individuals who qualified for more than 1 category, how were they assessed/allocated? RESPONSE: Thank you for this question. If a knowledge user was allocated to more than one group, they were included in both. We tried to create a balance between all three groups, and also have knowledge users in each group that were only in one group and were in multiple groups. -(Minor change):Please include a brief discussion on what measures were taken to mitigate biases. RESPONSE: Measures to reduce bias included having steering group members not being able participate in the small group conversations and only contributed to the full group discussions during the consensus meetings when invited. Steering group members were not allowed to initiate remarks. If invited to speak, steering group members were only allowed to provide clarification or guidance when appropriate. An independent experienced external moderator lead all group discussions to reduce the risk of dominant personalities and also reduce steering group bias. Finally, all meetings were open for in person, video, and viewing at a later date, with an open period to comment, to allow for inclusion of voices that could not make the meetings. This has been clarified within the methods. -(Minor change):Please describe dataset limitations within this section. RESPONSE: Data limitations have been added to the manuscript. “Only one conference was attended to help inform the original data elements list, as knowledge users from different backgrounds could attend other conferences across the globe, there may be selection bias limitations in the original proposed elements list. There was attrition in the Delphi survey, potentially decreasing the strength of recommendations.” Results: -The results are presented clearly. No recommended changes. RESPONSE: Thank you for this comment. Discussion/Conclusion: -(Minor change): Please provide a participant demographic breakdown, including profession. Given the challenges faced in achieving consensus, this information is relevant. RESPONSE: This is provided in Table 3, and also within the supplement. -(Minor change): It would also be helpful if other limitations were explored that could have contributed to the consensus challenges. RESPONSE: Further limitations have been added, as discussed above. “Only one conference was attended to help inform the original data elements list, as knowledge users from different backgrounds could attend other conferences across the globe, there may be selection bias limitations in the original proposed elements list. There was attrition in the Delphi survey, potentially decreasing the strength of recommendations.” -(Minor change): Please reframe the Discussion, or at least identify within the limitations, and amend the Conclusion to reflect this Delphi describes the United States and United Kingdom perspective, as indicated in the Methods section. RESPONSE: Further detail is included in the limitations. Supplementary Files: -Thank you for including the Initial Tables file, it provides contexts and allows transparency around data bias. RESPONSE: You are welcome. Thank you Dr. Kaufman for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Thank you to the authors for their tremendous effort in addressing MSKI in military populations. The methods described for the development of the Minimum Data Elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement will be an important reference for future publications and work in this field. Overall, the article is clear, concise and well written. A few minor changes RESPONSE: Thank you for the positive sentiment towards our work. Introduction: -Well written, intention and purpose are clearly described. RESPONSE: Thank you. Methods: -(Minor change): “ Military service members having sustained MSKI across their careers had subjective closeness. Clinicians treating service members for MSKI had mandated closeness. Researchers and scientific experts investigating military MSKI had objective closeness.” For individuals who qualified for more than 1 category, how were they assessed/allocated? RESPONSE: Thank you for this question. If a knowledge user was allocated to more than one group, they were included in both. We tried to create a balance between all three groups, and also have knowledge users in each group that were only in one group and were in multiple groups. -(Minor change):Please include a brief discussion on what measures were taken to mitigate biases. RESPONSE: Measures to reduce bias included having steering group members not being able participate in the small group conversations and only contributed to the full group discussions during the consensus meetings when invited. Steering group members were not allowed to initiate remarks. If invited to speak, steering group members were only allowed to provide clarification or guidance when appropriate. An independent experienced external moderator lead all group discussions to reduce the risk of dominant personalities and also reduce steering group bias. Finally, all meetings were open for in person, video, and viewing at a later date, with an open period to comment, to allow for inclusion of voices that could not make the meetings. This has been clarified within the methods. -(Minor change):Please describe dataset limitations within this section. RESPONSE: Data limitations have been added to the manuscript. “Only one conference was attended to help inform the original data elements list, as knowledge users from different backgrounds could attend other conferences across the globe, there may be selection bias limitations in the original proposed elements list. There was attrition in the Delphi survey, potentially decreasing the strength of recommendations.” Results: -The results are presented clearly. No recommended changes. RESPONSE: Thank you for this comment. Discussion/Conclusion: -(Minor change): Please provide a participant demographic breakdown, including profession. Given the challenges faced in achieving consensus, this information is relevant. RESPONSE: This is provided in Table 3, and also within the supplement. -(Minor change): It would also be helpful if other limitations were explored that could have contributed to the consensus challenges. RESPONSE: Further limitations have been added, as discussed above. “Only one conference was attended to help inform the original data elements list, as knowledge users from different backgrounds could attend other conferences across the globe, there may be selection bias limitations in the original proposed elements list. There was attrition in the Delphi survey, potentially decreasing the strength of recommendations.” -(Minor change): Please reframe the Discussion, or at least identify within the limitations, and amend the Conclusion to reflect this Delphi describes the United States and United Kingdom perspective, as indicated in the Methods section. RESPONSE: Further detail is included in the limitations. Supplementary Files: -Thank you for including the Initial Tables file, it provides contexts and allows transparency around data bias. RESPONSE: You are welcome. Competing Interests: No competing interests Close Report a concern COMMENT ON THIS REPORT Views 0 Cite How to cite this report: Edwards CM. Reviewer Report For: Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.5256/f1000research.167283.r339129 ) The direct URL for this report is: https://f1000research.com/articles/13-1044/v1#referee-response-339129 NOTE: it is important to ensure the information in square brackets after the title is included in this citation. Close Copy Citation Details Reviewer Report 27 Nov 2024 Chris M. Edwards , University of Sherbrooke, Sherbrooke, Québec, Canada Approved VIEWS 0 https://doi.org/10.5256/f1000research.167283.r339129 Thank you to the authors for their tremendous effort in addressing MSKI in military populations. The methods described for the development of the Minimum Data Elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement will be ... Continue reading READ ALL Thank you to the authors for their tremendous effort in addressing MSKI in military populations. The methods described for the development of the Minimum Data Elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement will be an important reference for future publications and work in this field. Overall, the article is clear, concise and well written. A few minor changes Introduction: -Well written, intention and purpose are clearly described. Methods: -(Minor change): “ Military service members having sustained MSKI across their careers had subjective closeness. Clinicians treating service members for MSKI had mandated closeness. Researchers and scientific experts investigating military MSKI had objective closeness.” For individuals who qualified for more than 1 category, how were they assessed/allocated? -(Minor change):Please include a brief discussion on what measures were taken to mitigate biases. -(Minor change):Please describe dataset limitations within this section. Results: -The results are presented clearly. No recommended changes. Discussion/Conclusion: -(Minor change): Please provide a participant demographic breakdown, including profession. Given the challenges faced in achieving consensus, this information is relevant. -(Minor change): It would also be helpful if other limitations were explored that could have contributed to the consensus challenges. -(Minor change): Please reframe the Discussion, or at least identify within the limitations, and amend the Conclusion to reflect this Delphi describes the United States and United Kingdom perspective, as indicated in the Methods section. Supplementary Files: -Thank you for including the Initial Tables file, it provides contexts and allows transparency around data bias. Is the rationale for developing the new method (or application) clearly explained? Yes Is the description of the method technically sound? Yes Are sufficient details provided to allow replication of the method development and its use by others? Yes If any results are presented, are all the source data underlying the results available to ensure full reproducibility? Yes Are the conclusions about the method and its performance adequately supported by the findings presented in the article? Partly Competing Interests: No competing interests were disclosed. Reviewer Expertise: Musculoskeletal injuries in military and emergency response personnel, female health in military and emergency response personnel, physical performance in military and emergency response personnel, mental health in military and emergency response personnel. I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard. Close READ LESS CITE CITE HOW TO CITE THIS REPORT Edwards CM. Reviewer Report For: Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.5256/f1000research.167283.r339129 ) The direct URL for this report is: https://f1000research.com/articles/13-1044/v1#referee-response-339129 NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article. COPY CITATION DETAILS Report a concern Author Response 20 Mar 2025 Daniel Rhon , Department of Rehabilitation Medicine, Brooke Army Medical Center, Fort Sam Houston, USA 20 Mar 2025 Author Response Thank you Dr. Edwards for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For ... Continue reading Thank you Dr. Edwards for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Abstract Please define a “mixed knowledge user”. RESPONSE: A mixed knowledge user is denoting multiple groups in one meeting. As discussed in reviewer 1, the authors felt that this term should be deleted to provide clarity. Please describe how the “asynchronous mixed knowledge user meeting” was conducted, or is this a typographical error? Please see comment in Methods section below. RESPONSE: Mixed knowledge user was deleted from the manuscript. However, asynchronous knowledge user meeting is denoting meeting that have a mixture of live video conferencing and the ability of other knowledge users to watch the video later and give comments. This has been further clarified within the methods. Recommend describing “civil servant practitioners” as a “civilian practitioner”. REPSONSE: this has been edited per the reviewer’s suggestion. Introduction Please define a definition of “knowledge user”. RESPONSE: A knowledge user is a person who contributes as an active knowledge creator, who construct meaning in their own settings, and have input that is equal to those of the scientific community. Bullock GS, Fallowfield J, Fisher B, Whittaker JL, Gafari O, Bilzon JL. Prioritizing Knowledge User Engagement: Engaging Patients and the Public in Creating Enduring Musculoskeletal Rehabilitation Research. journal of orthopaedic & sports physical therapy. 2024 Dec;54(12):743-7. This has been further clarified within the introduction. Methods When the core group pursued “a balance in expertise”, what expertise was being balanced? What criteria were used to know when this goal had been achieved? RESPONSE: Expertise balance was focused on subjective, mandated and objective closeness. Subjective is lived experience in MSKI within the military, mandated is practioner/performance/physiology and methods in MSKI, and objective is specific research in military MSKI. Stage 2: What was the military MSKI conference that was used to collect the convenience sample? How was this conference selected? How was the stated goal to sample “global-wide subject matter experts” met? RESPONSE: The conference was Total Force Fitness MSK Health conference addressing human performance optimization and MSKI mitigation and treatment in service members. This was an international conference, across different professions in the military. This has been clarified within the methods. The methods state that a “synchronous mixed knowledge user meeting” was performed. The abstract states that an “asynchronous mixed knowledge user meeting” was conducted. Is there a typographic error in the abstract? RESPONSE: Thank you for bringing this to our attention. This was an asynchronous meeting. This has been edited. Recommend describing “civil servant practitioners” as a “civilian practitioner”. RESPONSE: This has been edited per the reviewer’s suggestion. Results There was a >50% decrease in Administrative Leadership, Command Leadership, and Physical Training Instructor between Round 1 and Round 2 of the Delphi Study. Was there any concern about this significant decrease in participation from these groups? RESPONSE: It is true that there was attrition over time. Participants represent busy military leaders and clinicians, who travel often. We attempted to provide as large of a window as possible for responses to be submitted for those who could not attend; however, our hypothesis is that many individuals provided their input on the variables they felt of most importance in the very beginning. Those variables with consensus across the board did pass through to final stages. Individuals were reminded multiple times that this was their opportunity to provide additional feedback, especially if they felt strongly about any remaining variable inclusion/exclusion. It is possible that attrition was due to more ambivalence by some individuals towards the remaining variables. This has also been highlighted in the limitations section. Discussion This study provides an important list of data elements to be used for surveillance and reporting of musculoskeletal injuries that occur during military training. A weakness is that no data dictionary was created in this process and there is no indication that plans are in place to accomplish this task soon. RESPONSE: Thank you for this comment. The publication reporting the final publication does indeed provide guidance and examples to guide reporting of the recommended elements. Thank you Dr. Edwards for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Abstract Please define a “mixed knowledge user”. RESPONSE: A mixed knowledge user is denoting multiple groups in one meeting. As discussed in reviewer 1, the authors felt that this term should be deleted to provide clarity. Please describe how the “asynchronous mixed knowledge user meeting” was conducted, or is this a typographical error? Please see comment in Methods section below. RESPONSE: Mixed knowledge user was deleted from the manuscript. However, asynchronous knowledge user meeting is denoting meeting that have a mixture of live video conferencing and the ability of other knowledge users to watch the video later and give comments. This has been further clarified within the methods. Recommend describing “civil servant practitioners” as a “civilian practitioner”. REPSONSE: this has been edited per the reviewer’s suggestion. Introduction Please define a definition of “knowledge user”. RESPONSE: A knowledge user is a person who contributes as an active knowledge creator, who construct meaning in their own settings, and have input that is equal to those of the scientific community. Bullock GS, Fallowfield J, Fisher B, Whittaker JL, Gafari O, Bilzon JL. Prioritizing Knowledge User Engagement: Engaging Patients and the Public in Creating Enduring Musculoskeletal Rehabilitation Research. journal of orthopaedic & sports physical therapy. 2024 Dec;54(12):743-7. This has been further clarified within the introduction. Methods When the core group pursued “a balance in expertise”, what expertise was being balanced? What criteria were used to know when this goal had been achieved? RESPONSE: Expertise balance was focused on subjective, mandated and objective closeness. Subjective is lived experience in MSKI within the military, mandated is practioner/performance/physiology and methods in MSKI, and objective is specific research in military MSKI. Stage 2: What was the military MSKI conference that was used to collect the convenience sample? How was this conference selected? How was the stated goal to sample “global-wide subject matter experts” met? RESPONSE: The conference was Total Force Fitness MSK Health conference addressing human performance optimization and MSKI mitigation and treatment in service members. This was an international conference, across different professions in the military. This has been clarified within the methods. The methods state that a “synchronous mixed knowledge user meeting” was performed. The abstract states that an “asynchronous mixed knowledge user meeting” was conducted. Is there a typographic error in the abstract? RESPONSE: Thank you for bringing this to our attention. This was an asynchronous meeting. This has been edited. Recommend describing “civil servant practitioners” as a “civilian practitioner”. RESPONSE: This has been edited per the reviewer’s suggestion. Results There was a >50% decrease in Administrative Leadership, Command Leadership, and Physical Training Instructor between Round 1 and Round 2 of the Delphi Study. Was there any concern about this significant decrease in participation from these groups? RESPONSE: It is true that there was attrition over time. Participants represent busy military leaders and clinicians, who travel often. We attempted to provide as large of a window as possible for responses to be submitted for those who could not attend; however, our hypothesis is that many individuals provided their input on the variables they felt of most importance in the very beginning. Those variables with consensus across the board did pass through to final stages. Individuals were reminded multiple times that this was their opportunity to provide additional feedback, especially if they felt strongly about any remaining variable inclusion/exclusion. It is possible that attrition was due to more ambivalence by some individuals towards the remaining variables. This has also been highlighted in the limitations section. Discussion This study provides an important list of data elements to be used for surveillance and reporting of musculoskeletal injuries that occur during military training. A weakness is that no data dictionary was created in this process and there is no indication that plans are in place to accomplish this task soon. RESPONSE: Thank you for this comment. The publication reporting the final publication does indeed provide guidance and examples to guide reporting of the recommended elements. Competing Interests: No competing interests Close Report a concern Respond or Comment COMMENTS ON THIS REPORT Author Response 20 Mar 2025 Daniel Rhon , Department of Rehabilitation Medicine, Brooke Army Medical Center, Fort Sam Houston, USA 20 Mar 2025 Author Response Thank you Dr. Edwards for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For ... Continue reading Thank you Dr. Edwards for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Abstract Please define a “mixed knowledge user”. RESPONSE: A mixed knowledge user is denoting multiple groups in one meeting. As discussed in reviewer 1, the authors felt that this term should be deleted to provide clarity. Please describe how the “asynchronous mixed knowledge user meeting” was conducted, or is this a typographical error? Please see comment in Methods section below. RESPONSE: Mixed knowledge user was deleted from the manuscript. However, asynchronous knowledge user meeting is denoting meeting that have a mixture of live video conferencing and the ability of other knowledge users to watch the video later and give comments. This has been further clarified within the methods. Recommend describing “civil servant practitioners” as a “civilian practitioner”. REPSONSE: this has been edited per the reviewer’s suggestion. Introduction Please define a definition of “knowledge user”. RESPONSE: A knowledge user is a person who contributes as an active knowledge creator, who construct meaning in their own settings, and have input that is equal to those of the scientific community. Bullock GS, Fallowfield J, Fisher B, Whittaker JL, Gafari O, Bilzon JL. Prioritizing Knowledge User Engagement: Engaging Patients and the Public in Creating Enduring Musculoskeletal Rehabilitation Research. journal of orthopaedic & sports physical therapy. 2024 Dec;54(12):743-7. This has been further clarified within the introduction. Methods When the core group pursued “a balance in expertise”, what expertise was being balanced? What criteria were used to know when this goal had been achieved? RESPONSE: Expertise balance was focused on subjective, mandated and objective closeness. Subjective is lived experience in MSKI within the military, mandated is practioner/performance/physiology and methods in MSKI, and objective is specific research in military MSKI. Stage 2: What was the military MSKI conference that was used to collect the convenience sample? How was this conference selected? How was the stated goal to sample “global-wide subject matter experts” met? RESPONSE: The conference was Total Force Fitness MSK Health conference addressing human performance optimization and MSKI mitigation and treatment in service members. This was an international conference, across different professions in the military. This has been clarified within the methods. The methods state that a “synchronous mixed knowledge user meeting” was performed. The abstract states that an “asynchronous mixed knowledge user meeting” was conducted. Is there a typographic error in the abstract? RESPONSE: Thank you for bringing this to our attention. This was an asynchronous meeting. This has been edited. Recommend describing “civil servant practitioners” as a “civilian practitioner”. RESPONSE: This has been edited per the reviewer’s suggestion. Results There was a >50% decrease in Administrative Leadership, Command Leadership, and Physical Training Instructor between Round 1 and Round 2 of the Delphi Study. Was there any concern about this significant decrease in participation from these groups? RESPONSE: It is true that there was attrition over time. Participants represent busy military leaders and clinicians, who travel often. We attempted to provide as large of a window as possible for responses to be submitted for those who could not attend; however, our hypothesis is that many individuals provided their input on the variables they felt of most importance in the very beginning. Those variables with consensus across the board did pass through to final stages. Individuals were reminded multiple times that this was their opportunity to provide additional feedback, especially if they felt strongly about any remaining variable inclusion/exclusion. It is possible that attrition was due to more ambivalence by some individuals towards the remaining variables. This has also been highlighted in the limitations section. Discussion This study provides an important list of data elements to be used for surveillance and reporting of musculoskeletal injuries that occur during military training. A weakness is that no data dictionary was created in this process and there is no indication that plans are in place to accomplish this task soon. RESPONSE: Thank you for this comment. The publication reporting the final publication does indeed provide guidance and examples to guide reporting of the recommended elements. Thank you Dr. Edwards for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Abstract Please define a “mixed knowledge user”. RESPONSE: A mixed knowledge user is denoting multiple groups in one meeting. As discussed in reviewer 1, the authors felt that this term should be deleted to provide clarity. Please describe how the “asynchronous mixed knowledge user meeting” was conducted, or is this a typographical error? Please see comment in Methods section below. RESPONSE: Mixed knowledge user was deleted from the manuscript. However, asynchronous knowledge user meeting is denoting meeting that have a mixture of live video conferencing and the ability of other knowledge users to watch the video later and give comments. This has been further clarified within the methods. Recommend describing “civil servant practitioners” as a “civilian practitioner”. REPSONSE: this has been edited per the reviewer’s suggestion. Introduction Please define a definition of “knowledge user”. RESPONSE: A knowledge user is a person who contributes as an active knowledge creator, who construct meaning in their own settings, and have input that is equal to those of the scientific community. Bullock GS, Fallowfield J, Fisher B, Whittaker JL, Gafari O, Bilzon JL. Prioritizing Knowledge User Engagement: Engaging Patients and the Public in Creating Enduring Musculoskeletal Rehabilitation Research. journal of orthopaedic & sports physical therapy. 2024 Dec;54(12):743-7. This has been further clarified within the introduction. Methods When the core group pursued “a balance in expertise”, what expertise was being balanced? What criteria were used to know when this goal had been achieved? RESPONSE: Expertise balance was focused on subjective, mandated and objective closeness. Subjective is lived experience in MSKI within the military, mandated is practioner/performance/physiology and methods in MSKI, and objective is specific research in military MSKI. Stage 2: What was the military MSKI conference that was used to collect the convenience sample? How was this conference selected? How was the stated goal to sample “global-wide subject matter experts” met? RESPONSE: The conference was Total Force Fitness MSK Health conference addressing human performance optimization and MSKI mitigation and treatment in service members. This was an international conference, across different professions in the military. This has been clarified within the methods. The methods state that a “synchronous mixed knowledge user meeting” was performed. The abstract states that an “asynchronous mixed knowledge user meeting” was conducted. Is there a typographic error in the abstract? RESPONSE: Thank you for bringing this to our attention. This was an asynchronous meeting. This has been edited. Recommend describing “civil servant practitioners” as a “civilian practitioner”. RESPONSE: This has been edited per the reviewer’s suggestion. Results There was a >50% decrease in Administrative Leadership, Command Leadership, and Physical Training Instructor between Round 1 and Round 2 of the Delphi Study. Was there any concern about this significant decrease in participation from these groups? RESPONSE: It is true that there was attrition over time. Participants represent busy military leaders and clinicians, who travel often. We attempted to provide as large of a window as possible for responses to be submitted for those who could not attend; however, our hypothesis is that many individuals provided their input on the variables they felt of most importance in the very beginning. Those variables with consensus across the board did pass through to final stages. Individuals were reminded multiple times that this was their opportunity to provide additional feedback, especially if they felt strongly about any remaining variable inclusion/exclusion. It is possible that attrition was due to more ambivalence by some individuals towards the remaining variables. This has also been highlighted in the limitations section. Discussion This study provides an important list of data elements to be used for surveillance and reporting of musculoskeletal injuries that occur during military training. A weakness is that no data dictionary was created in this process and there is no indication that plans are in place to accomplish this task soon. RESPONSE: Thank you for this comment. The publication reporting the final publication does indeed provide guidance and examples to guide reporting of the recommended elements. Competing Interests: No competing interests Close Report a concern COMMENT ON THIS REPORT Views 0 Cite How to cite this report: O'Sullivan O. Reviewer Report For: Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.5256/f1000research.167283.r323555 ) The direct URL for this report is: https://f1000research.com/articles/13-1044/v1#referee-response-323555 NOTE: it is important to ensure the information in square brackets after the title is included in this citation. Close Copy Citation Details Reviewer Report 04 Oct 2024 Oliver O'Sullivan , University of Nottingham, Nottingham, England, UK Approved with Reservations VIEWS 0 https://doi.org/10.5256/f1000research.167283.r323555 Dear Colleagues, Thank you for asking me to review Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement, which is a description of methodological approach taken ... Continue reading READ ALL Dear Colleagues, Thank you for asking me to review Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement, which is a description of methodological approach taken to develop minimum data elements for Musculoskeletal injuries. This is an important area of work and much needed - you all should be applauding for grasping the nettle on this. I felt the manuscript was well written overall, but could be refined by addressing some of the points below. The most pressing is the use (and possible over-use) of the phrase Knowledge User - the definition seemed to shift and it wasn't clear by the end who you were actually talking about. However, the area of concern I have is with regard to the results of Delphi. They are partly presented in the results and in Table 4-10; however, you report that the full results will be published elsewhere. This seems to me to be a little bit odd - would it not be better to present them in full in this manuscript, or to remove the partial presentation from this manuscript to avoid double reporting/duplicate publications? I wish the authors Good luck with the next version Minor Revisions - In your abstract, you capitalise Minimum Data Elements in the background, but then don't in the results/conclusions - could I suggest a consistent approach please? In abstract methods, you use a phrase 'civil servant practitioners' - do you think, given the international authorship and readership, that this term would translate? You could consider 'civilian' as a simpler alternative. The last sentence in the strategy section is exactly the same at the last sentence in the background section - suggest removing one of those. The fourth and fifth sentences in the Stage 1 paragraph appear to be saying 95% the same thing, but with a subtle difference. Do you require both? If so, suggest rephrasing for clarity. Your 'knowledge user' groups appear to change between the 'knowledge user involvement' and 'patient public involvement' sections. Either remove one of the elements in parenthesis if these phrases relate to the same people or please articulate the different knowledge user groups. In fact, you appear to change the knowledge user group composition in the PPI section (which is again different to above!) - please can you review this? If these are all different groups, composed of different individuals for a bespoke reason, please can you give the groups different names? Also, as an extension to above, please can you explain what you mean by 'mixed knowledge user'? Is that an amalgam of the three groups above, or something else? In stage 3 & 4, you refer to the steering committee. Are these the six individuals noted in the Strategy section? If so, please can you overtly make that point? The second sentence of Results sounds decidedly like an intro or methods sentence - please could you consider its inclusion? The second paragraph in the limitation appears repetitive - please could this be reviewed? You mention dissenting opinions in the conclusion, but I am struggling to see where these have been described or presented - please can you clarify this? In Table 3, the nationality for Round 2/3 'not disclosed' might be better in the title line, not in the same line as New Zealand Table 4 - 10 - please consider the implications of including these data if there is a plan for a further publication presenting said findings Is the rationale for developing the new method (or application) clearly explained? Yes Is the description of the method technically sound? Yes Are sufficient details provided to allow replication of the method development and its use by others? Yes If any results are presented, are all the source data underlying the results available to ensure full reproducibility? Yes Are the conclusions about the method and its performance adequately supported by the findings presented in the article? Yes Competing Interests: No competing interests were disclosed. Reviewer Expertise: Sports and exercise medicine, rehabilitation, military medicine I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above. Close READ LESS CITE CITE HOW TO CITE THIS REPORT O'Sullivan O. Reviewer Report For: Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.5256/f1000research.167283.r323555 ) The direct URL for this report is: https://f1000research.com/articles/13-1044/v1#referee-response-323555 NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article. COPY CITATION DETAILS Report a concern Author Response 21 Mar 2025 Daniel Rhon , Department of Rehabilitation Medicine, Brooke Army Medical Center, Fort Sam Houston, USA 21 Mar 2025 Author Response Thank you Dr. O’Sullivan for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For ... Continue reading Thank you Dr. O’Sullivan for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Dear Colleagues, Thank you for asking me to review Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement, which is a description of methodological approach taken to develop minimum data elements for Musculoskeletal injuries. This is an important area of work and much needed - you all should be applauding for grasping the nettle on this. I felt the manuscript was well written overall, but could be refined by addressing some of the points below. The most pressing is the use (and possible over-use) of the phrase Knowledge User - the definition seemed to shift and it wasn't clear by the end who you were actually talking about. However, the area of concern I have is with regard to the results of Delphi. They are partly presented in the results and in Table 4-10; however, you report that the full results will be published elsewhere. This seems to me to be a little bit odd - would it not be better to present them in full in this manuscript, or to remove the partial presentation from this manuscript to avoid double reporting/duplicate publications? I wish the authors good luck with the next version RESPONSE: Thank you for these additional points. We have reviewed and considered them all carefully, to include addressing the “knowledge user” term. We have also reviewed the tables (4-10) and wish to provide some further context. There is another publication that will report on the final checklist. However, the space constraints prohibit many of the details that expand on how we were able to reach the final consensus. This manuscript in F1000 provides much more granular details about the iterative steps taken to reach the final checklist. Therefore, we focused on methodology in this manuscript. If we provided the final checklist here, then there would also be copyright concerns to address when publishing it again in the final publication. The publication with the completed checklist refers back to this manuscript, to provide readers with further details about the process. Minor Revisions - In your abstract, you capitalise Minimum Data Elements in the background, but then don't in the results/conclusions - could I suggest a consistent approach please? RESPONSE: Thank you for this comment. ‘Minimum Data Elements’ within the abstract background has been edited to lower case. In abstract methods, you use a phrase 'civil servant practitioners' - do you think, given the international authorship and readership, that this term would translate? You could consider 'civilian' as a simpler alternative. RESPONSE: Yes, thank you. That is a great suggestion and we have made that change. The last sentence in the strategy section is exactly the same at the last sentence in the background section - suggest removing one of those. RESPONSE: Thank you, we have removed the redundancy from the background section. The fourth and fifth sentences in the Stage 1 paragraph appear to be saying 95% the same thing, but with a subtle difference. Do you require both? If so, suggest rephrasing for clarity. RESPONSE: Thank you, this has been consolidated to improve clarity. Your 'knowledge user' groups appear to change between the 'knowledge user involvement' and 'patient public involvement' sections. Either remove one of the elements in parenthesis if these phrases relate to the same people or please articulate the different knowledge user groups. In fact, you appear to change the knowledge user group composition in the PPI section (which is again different to above!) - please can you review this? If these are all different groups, composed of different individuals for a bespoke reason, please can you give the groups different names? RESPONSE: Thank you for bringing this to our attention. The patient and public involvement section has been deleted, and the knowledge user group section has been updated for one paragraph. Also, as an extension to above, please can you explain what you mean by 'mixed knowledge user'? Is that an amalgam of the three groups above, or something else? RESPONSE: Mixed knowledge user details knowledge users from across different groups. The term ‘mixed’ has been deleted from the manuscript as the authors felt this decreased the clarity in the methods. In stage 3 & 4, you refer to the steering committee. Are these the six individuals noted in the Strategy section? If so, please can you overtly make that point? RESPONSE: Yes, the steering committee are the six individuals in the strategy section. This has been clarified. The second sentence of Results sounds decidedly like an intro or methods sentence - please could you consider its inclusion? RESPONSE: This sentence has been moved to the methods section, under the statistical analyses subheading. The second paragraph in the limitation appears repetitive - please could this be reviewed? RESPONSE: The second limitations sentence has been edited. You mention dissenting opinions in the conclusion, but I am struggling to see where these have been described or presented - please can you clarify this? RESPONSE: The dissenting opinions will be published for full transparency in the supplementary appendix of the manuscript reporting the final checklist. In Table 3, the nationality for Round 2/3 'not disclosed' might be better in the title line, not in the same line as New Zealand RESPONSE: This has been edited with a foot note stating that a blank cell denotes that the information was not disclosed. Table 4 - 10 - please consider the implications of including these data if there is a plan for a further publication presenting said findings RESPONSE: Thank you for this discussion. As discussed in the first response, there is another publication that will report on the final checklist. However, the space constraints prohibit many of the details that expand on how we were able to reach the final consensus. This manuscript in F1000 provides much more granular details about the iterative steps taken to reach the final checklist. Therefore, we focused on methodology in this manuscript. If we provided the final checklist here, then there would also be copyright concerns to address when publishing it again in the final publication. The publication with the completed checklist will refer back to this manuscript, to provide readers with further details about the process. Thank you Dr. O’Sullivan for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Dear Colleagues, Thank you for asking me to review Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement, which is a description of methodological approach taken to develop minimum data elements for Musculoskeletal injuries. This is an important area of work and much needed - you all should be applauding for grasping the nettle on this. I felt the manuscript was well written overall, but could be refined by addressing some of the points below. The most pressing is the use (and possible over-use) of the phrase Knowledge User - the definition seemed to shift and it wasn't clear by the end who you were actually talking about. However, the area of concern I have is with regard to the results of Delphi. They are partly presented in the results and in Table 4-10; however, you report that the full results will be published elsewhere. This seems to me to be a little bit odd - would it not be better to present them in full in this manuscript, or to remove the partial presentation from this manuscript to avoid double reporting/duplicate publications? I wish the authors good luck with the next version RESPONSE: Thank you for these additional points. We have reviewed and considered them all carefully, to include addressing the “knowledge user” term. We have also reviewed the tables (4-10) and wish to provide some further context. There is another publication that will report on the final checklist. However, the space constraints prohibit many of the details that expand on how we were able to reach the final consensus. This manuscript in F1000 provides much more granular details about the iterative steps taken to reach the final checklist. Therefore, we focused on methodology in this manuscript. If we provided the final checklist here, then there would also be copyright concerns to address when publishing it again in the final publication. The publication with the completed checklist refers back to this manuscript, to provide readers with further details about the process. Minor Revisions - In your abstract, you capitalise Minimum Data Elements in the background, but then don't in the results/conclusions - could I suggest a consistent approach please? RESPONSE: Thank you for this comment. ‘Minimum Data Elements’ within the abstract background has been edited to lower case. In abstract methods, you use a phrase 'civil servant practitioners' - do you think, given the international authorship and readership, that this term would translate? You could consider 'civilian' as a simpler alternative. RESPONSE: Yes, thank you. That is a great suggestion and we have made that change. The last sentence in the strategy section is exactly the same at the last sentence in the background section - suggest removing one of those. RESPONSE: Thank you, we have removed the redundancy from the background section. The fourth and fifth sentences in the Stage 1 paragraph appear to be saying 95% the same thing, but with a subtle difference. Do you require both? If so, suggest rephrasing for clarity. RESPONSE: Thank you, this has been consolidated to improve clarity. Your 'knowledge user' groups appear to change between the 'knowledge user involvement' and 'patient public involvement' sections. Either remove one of the elements in parenthesis if these phrases relate to the same people or please articulate the different knowledge user groups. In fact, you appear to change the knowledge user group composition in the PPI section (which is again different to above!) - please can you review this? If these are all different groups, composed of different individuals for a bespoke reason, please can you give the groups different names? RESPONSE: Thank you for bringing this to our attention. The patient and public involvement section has been deleted, and the knowledge user group section has been updated for one paragraph. Also, as an extension to above, please can you explain what you mean by 'mixed knowledge user'? Is that an amalgam of the three groups above, or something else? RESPONSE: Mixed knowledge user details knowledge users from across different groups. The term ‘mixed’ has been deleted from the manuscript as the authors felt this decreased the clarity in the methods. In stage 3 & 4, you refer to the steering committee. Are these the six individuals noted in the Strategy section? If so, please can you overtly make that point? RESPONSE: Yes, the steering committee are the six individuals in the strategy section. This has been clarified. The second sentence of Results sounds decidedly like an intro or methods sentence - please could you consider its inclusion? RESPONSE: This sentence has been moved to the methods section, under the statistical analyses subheading. The second paragraph in the limitation appears repetitive - please could this be reviewed? RESPONSE: The second limitations sentence has been edited. You mention dissenting opinions in the conclusion, but I am struggling to see where these have been described or presented - please can you clarify this? RESPONSE: The dissenting opinions will be published for full transparency in the supplementary appendix of the manuscript reporting the final checklist. In Table 3, the nationality for Round 2/3 'not disclosed' might be better in the title line, not in the same line as New Zealand RESPONSE: This has been edited with a foot note stating that a blank cell denotes that the information was not disclosed. Table 4 - 10 - please consider the implications of including these data if there is a plan for a further publication presenting said findings RESPONSE: Thank you for this discussion. As discussed in the first response, there is another publication that will report on the final checklist. However, the space constraints prohibit many of the details that expand on how we were able to reach the final consensus. This manuscript in F1000 provides much more granular details about the iterative steps taken to reach the final checklist. Therefore, we focused on methodology in this manuscript. If we provided the final checklist here, then there would also be copyright concerns to address when publishing it again in the final publication. The publication with the completed checklist will refer back to this manuscript, to provide readers with further details about the process. Competing Interests: No competing interests Close Report a concern Respond or Comment COMMENTS ON THIS REPORT Author Response 21 Mar 2025 Daniel Rhon , Department of Rehabilitation Medicine, Brooke Army Medical Center, Fort Sam Houston, USA 21 Mar 2025 Author Response Thank you Dr. O’Sullivan for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For ... Continue reading Thank you Dr. O’Sullivan for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Dear Colleagues, Thank you for asking me to review Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement, which is a description of methodological approach taken to develop minimum data elements for Musculoskeletal injuries. This is an important area of work and much needed - you all should be applauding for grasping the nettle on this. I felt the manuscript was well written overall, but could be refined by addressing some of the points below. The most pressing is the use (and possible over-use) of the phrase Knowledge User - the definition seemed to shift and it wasn't clear by the end who you were actually talking about. However, the area of concern I have is with regard to the results of Delphi. They are partly presented in the results and in Table 4-10; however, you report that the full results will be published elsewhere. This seems to me to be a little bit odd - would it not be better to present them in full in this manuscript, or to remove the partial presentation from this manuscript to avoid double reporting/duplicate publications? I wish the authors good luck with the next version RESPONSE: Thank you for these additional points. We have reviewed and considered them all carefully, to include addressing the “knowledge user” term. We have also reviewed the tables (4-10) and wish to provide some further context. There is another publication that will report on the final checklist. However, the space constraints prohibit many of the details that expand on how we were able to reach the final consensus. This manuscript in F1000 provides much more granular details about the iterative steps taken to reach the final checklist. Therefore, we focused on methodology in this manuscript. If we provided the final checklist here, then there would also be copyright concerns to address when publishing it again in the final publication. The publication with the completed checklist refers back to this manuscript, to provide readers with further details about the process. Minor Revisions - In your abstract, you capitalise Minimum Data Elements in the background, but then don't in the results/conclusions - could I suggest a consistent approach please? RESPONSE: Thank you for this comment. ‘Minimum Data Elements’ within the abstract background has been edited to lower case. In abstract methods, you use a phrase 'civil servant practitioners' - do you think, given the international authorship and readership, that this term would translate? You could consider 'civilian' as a simpler alternative. RESPONSE: Yes, thank you. That is a great suggestion and we have made that change. The last sentence in the strategy section is exactly the same at the last sentence in the background section - suggest removing one of those. RESPONSE: Thank you, we have removed the redundancy from the background section. The fourth and fifth sentences in the Stage 1 paragraph appear to be saying 95% the same thing, but with a subtle difference. Do you require both? If so, suggest rephrasing for clarity. RESPONSE: Thank you, this has been consolidated to improve clarity. Your 'knowledge user' groups appear to change between the 'knowledge user involvement' and 'patient public involvement' sections. Either remove one of the elements in parenthesis if these phrases relate to the same people or please articulate the different knowledge user groups. In fact, you appear to change the knowledge user group composition in the PPI section (which is again different to above!) - please can you review this? If these are all different groups, composed of different individuals for a bespoke reason, please can you give the groups different names? RESPONSE: Thank you for bringing this to our attention. The patient and public involvement section has been deleted, and the knowledge user group section has been updated for one paragraph. Also, as an extension to above, please can you explain what you mean by 'mixed knowledge user'? Is that an amalgam of the three groups above, or something else? RESPONSE: Mixed knowledge user details knowledge users from across different groups. The term ‘mixed’ has been deleted from the manuscript as the authors felt this decreased the clarity in the methods. In stage 3 & 4, you refer to the steering committee. Are these the six individuals noted in the Strategy section? If so, please can you overtly make that point? RESPONSE: Yes, the steering committee are the six individuals in the strategy section. This has been clarified. The second sentence of Results sounds decidedly like an intro or methods sentence - please could you consider its inclusion? RESPONSE: This sentence has been moved to the methods section, under the statistical analyses subheading. The second paragraph in the limitation appears repetitive - please could this be reviewed? RESPONSE: The second limitations sentence has been edited. You mention dissenting opinions in the conclusion, but I am struggling to see where these have been described or presented - please can you clarify this? RESPONSE: The dissenting opinions will be published for full transparency in the supplementary appendix of the manuscript reporting the final checklist. In Table 3, the nationality for Round 2/3 'not disclosed' might be better in the title line, not in the same line as New Zealand RESPONSE: This has been edited with a foot note stating that a blank cell denotes that the information was not disclosed. Table 4 - 10 - please consider the implications of including these data if there is a plan for a further publication presenting said findings RESPONSE: Thank you for this discussion. As discussed in the first response, there is another publication that will report on the final checklist. However, the space constraints prohibit many of the details that expand on how we were able to reach the final consensus. This manuscript in F1000 provides much more granular details about the iterative steps taken to reach the final checklist. Therefore, we focused on methodology in this manuscript. If we provided the final checklist here, then there would also be copyright concerns to address when publishing it again in the final publication. The publication with the completed checklist will refer back to this manuscript, to provide readers with further details about the process. Thank you Dr. O’Sullivan for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Dear Colleagues, Thank you for asking me to review Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement, which is a description of methodological approach taken to develop minimum data elements for Musculoskeletal injuries. This is an important area of work and much needed - you all should be applauding for grasping the nettle on this. I felt the manuscript was well written overall, but could be refined by addressing some of the points below. The most pressing is the use (and possible over-use) of the phrase Knowledge User - the definition seemed to shift and it wasn't clear by the end who you were actually talking about. However, the area of concern I have is with regard to the results of Delphi. They are partly presented in the results and in Table 4-10; however, you report that the full results will be published elsewhere. This seems to me to be a little bit odd - would it not be better to present them in full in this manuscript, or to remove the partial presentation from this manuscript to avoid double reporting/duplicate publications? I wish the authors good luck with the next version RESPONSE: Thank you for these additional points. We have reviewed and considered them all carefully, to include addressing the “knowledge user” term. We have also reviewed the tables (4-10) and wish to provide some further context. There is another publication that will report on the final checklist. However, the space constraints prohibit many of the details that expand on how we were able to reach the final consensus. This manuscript in F1000 provides much more granular details about the iterative steps taken to reach the final checklist. Therefore, we focused on methodology in this manuscript. If we provided the final checklist here, then there would also be copyright concerns to address when publishing it again in the final publication. The publication with the completed checklist refers back to this manuscript, to provide readers with further details about the process. Minor Revisions - In your abstract, you capitalise Minimum Data Elements in the background, but then don't in the results/conclusions - could I suggest a consistent approach please? RESPONSE: Thank you for this comment. ‘Minimum Data Elements’ within the abstract background has been edited to lower case. In abstract methods, you use a phrase 'civil servant practitioners' - do you think, given the international authorship and readership, that this term would translate? You could consider 'civilian' as a simpler alternative. RESPONSE: Yes, thank you. That is a great suggestion and we have made that change. The last sentence in the strategy section is exactly the same at the last sentence in the background section - suggest removing one of those. RESPONSE: Thank you, we have removed the redundancy from the background section. The fourth and fifth sentences in the Stage 1 paragraph appear to be saying 95% the same thing, but with a subtle difference. Do you require both? If so, suggest rephrasing for clarity. RESPONSE: Thank you, this has been consolidated to improve clarity. Your 'knowledge user' groups appear to change between the 'knowledge user involvement' and 'patient public involvement' sections. Either remove one of the elements in parenthesis if these phrases relate to the same people or please articulate the different knowledge user groups. In fact, you appear to change the knowledge user group composition in the PPI section (which is again different to above!) - please can you review this? If these are all different groups, composed of different individuals for a bespoke reason, please can you give the groups different names? RESPONSE: Thank you for bringing this to our attention. The patient and public involvement section has been deleted, and the knowledge user group section has been updated for one paragraph. Also, as an extension to above, please can you explain what you mean by 'mixed knowledge user'? Is that an amalgam of the three groups above, or something else? RESPONSE: Mixed knowledge user details knowledge users from across different groups. The term ‘mixed’ has been deleted from the manuscript as the authors felt this decreased the clarity in the methods. In stage 3 & 4, you refer to the steering committee. Are these the six individuals noted in the Strategy section? If so, please can you overtly make that point? RESPONSE: Yes, the steering committee are the six individuals in the strategy section. This has been clarified. The second sentence of Results sounds decidedly like an intro or methods sentence - please could you consider its inclusion? RESPONSE: This sentence has been moved to the methods section, under the statistical analyses subheading. The second paragraph in the limitation appears repetitive - please could this be reviewed? RESPONSE: The second limitations sentence has been edited. You mention dissenting opinions in the conclusion, but I am struggling to see where these have been described or presented - please can you clarify this? RESPONSE: The dissenting opinions will be published for full transparency in the supplementary appendix of the manuscript reporting the final checklist. In Table 3, the nationality for Round 2/3 'not disclosed' might be better in the title line, not in the same line as New Zealand RESPONSE: This has been edited with a foot note stating that a blank cell denotes that the information was not disclosed. Table 4 - 10 - please consider the implications of including these data if there is a plan for a further publication presenting said findings RESPONSE: Thank you for this discussion. As discussed in the first response, there is another publication that will report on the final checklist. However, the space constraints prohibit many of the details that expand on how we were able to reach the final consensus. This manuscript in F1000 provides much more granular details about the iterative steps taken to reach the final checklist. Therefore, we focused on methodology in this manuscript. If we provided the final checklist here, then there would also be copyright concerns to address when publishing it again in the final publication. The publication with the completed checklist will refer back to this manuscript, to provide readers with further details about the process. Competing Interests: No competing interests Close Report a concern COMMENT ON THIS REPORT Comments on this article Comments (0) Version 2 VERSION 2 PUBLISHED 11 Sep 2024 ADD YOUR COMMENT Comment keyboard_arrow_left keyboard_arrow_right Open Peer Review Reviewer Status info_outline Alongside their report, reviewers assign a status to the article: Approved The paper is scientifically sound in its current form and only minor, if any, improvements are suggested Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit. Not approved Fundamental flaws in the paper seriously undermine the findings and conclusions Reviewer Reports Invited Reviewers 1 2 3 Version 2 (revision) 03 Apr 25 read Version 1 11 Sep 24 read read read Oliver O'Sullivan , University of Nottingham, Nottingham, UK Chris M. Edwards , University of Sherbrooke, Sherbrooke, Canada Kenton R. Kaufman , Mayo Clinic, Rochester, USA Comments on this article All Comments (0) Add a comment Sign up for content alerts Sign Up You are now signed up to receive this alert Browse by related subjects keyboard_arrow_left Back to all reports Reviewer Report 0 Views copyright © 2025 O'Sullivan O. This is an open access peer review report distributed under the terms of the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. 16 Apr 2025 | for Version 2 Oliver O'Sullivan , University of Nottingham, Nottingham, England, UK 0 Views copyright © 2025 O'Sullivan O. This is an open access peer review report distributed under the terms of the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. format_quote Cite this report speaker_notes Responses (0) Approved info_outline Alongside their report, reviewers assign a status to the article: Approved The paper is scientifically sound in its current form and only minor, if any, improvements are suggested Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit. Not approved Fundamental flaws in the paper seriously undermine the findings and conclusions Dear authors, thank you for taking on board all the recommendations from the peer reviewers. I think the manuscript reads well, is clear and has an important message - as far as I am concerned, it is ready. Best wishes and well done. Competing Interests No competing interests were disclosed. Reviewer Expertise Sports and exercise medicine, rehabilitation, military medicine I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard. reply Respond to this report Responses (0) O'Sullivan O. Peer Review Report For: Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.5256/f1000research.179630.r375434) NOTE: it is important to ensure the information in square brackets after the title is included in this citation. The direct URL for this report is: https://f1000research.com/articles/13-1044/v2#referee-response-375434 keyboard_arrow_left Back to all reports Reviewer Report 0 Views copyright © 2024 Kaufman K. This is an open access peer review report distributed under the terms of the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. 05 Dec 2024 | for Version 1 Kenton R. Kaufman , Mayo Clinic, Rochester, USA 0 Views copyright © 2024 Kaufman K. This is an open access peer review report distributed under the terms of the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. format_quote Cite this report speaker_notes Responses (1) Approved With Reservations info_outline Alongside their report, reviewers assign a status to the article: Approved The paper is scientifically sound in its current form and only minor, if any, improvements are suggested Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit. Not approved Fundamental flaws in the paper seriously undermine the findings and conclusions Abstract: Please define a “mixed knowledge user”. Please describe how the “asynchronous mixed knowledge user meeting” was conducted, or is this a typographical error? Please see comment in Methods section below. Recommend describing “civil servant practitioners” as a “civilian practitioner”. Introduction Please define a definition of “knowledge user”. Methods When the core group pursued “a balance in expertise”, what expertise was being balanced? What criteria were used to know when this goal had been achieved? Stage 2: What was the military MSKI conference that was used to collect the convenience sample? How was this conference selected? How was the stated goal to sample “global-wide subject matter experts” met? The methods state that a “synchronous mixed knowledge user meeting” was performed. The abstract states that an “asynchronous mixed knowledge user meeting” was conducted. Is there a typographic error in the abstract? Recommend describing “civil servant practitioners” as a “civilian practitioner”. Results There was a >50% decrease in Administrative Leadership, Command Leadership, and Physical Training Instructor between Round 1 and Round 2 of the Delphi Study. Was there any concern about this significant decrease in participation from these groups? Discussion This study provides an important list of data elements to be used for surveillance and reporting of musculoskeletal injuries that occur during military training. A weakness is that no data dictionary was created in this process and there is no indication that plans are in place to accomplish this task soon. Is the rationale for developing the new method (or application) clearly explained? Yes Is the description of the method technically sound? Yes Are sufficient details provided to allow replication of the method development and its use by others? Yes If any results are presented, are all the source data underlying the results available to ensure full reproducibility? Yes Are the conclusions about the method and its performance adequately supported by the findings presented in the article? Yes Competing Interests No competing interests were disclosed. Reviewer Expertise Musculoskeletal injury, Orthopedics, Registries, Outcomes Measurement I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above. reply Respond to this report Responses (1) Author Response 03 Apr 2025 Daniel Rhon, Department of Rehabilitation Medicine, Brooke Army Medical Center, Fort Sam Houston, USA Thank you Dr. Kaufman for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Thank you to the authors for their tremendous effort in addressing MSKI in military populations. The methods described for the development of the Minimum Data Elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement will be an important reference for future publications and work in this field. Overall, the article is clear, concise and well written. A few minor changes RESPONSE: Thank you for the positive sentiment towards our work. Introduction: -Well written, intention and purpose are clearly described. RESPONSE: Thank you. Methods: -(Minor change): “ Military service members having sustained MSKI across their careers had subjective closeness. Clinicians treating service members for MSKI had mandated closeness. Researchers and scientific experts investigating military MSKI had objective closeness.” For individuals who qualified for more than 1 category, how were they assessed/allocated? RESPONSE: Thank you for this question. If a knowledge user was allocated to more than one group, they were included in both. We tried to create a balance between all three groups, and also have knowledge users in each group that were only in one group and were in multiple groups. -(Minor change):Please include a brief discussion on what measures were taken to mitigate biases. RESPONSE: Measures to reduce bias included having steering group members not being able participate in the small group conversations and only contributed to the full group discussions during the consensus meetings when invited. Steering group members were not allowed to initiate remarks. If invited to speak, steering group members were only allowed to provide clarification or guidance when appropriate. An independent experienced external moderator lead all group discussions to reduce the risk of dominant personalities and also reduce steering group bias. Finally, all meetings were open for in person, video, and viewing at a later date, with an open period to comment, to allow for inclusion of voices that could not make the meetings. This has been clarified within the methods. -(Minor change):Please describe dataset limitations within this section. RESPONSE: Data limitations have been added to the manuscript. “Only one conference was attended to help inform the original data elements list, as knowledge users from different backgrounds could attend other conferences across the globe, there may be selection bias limitations in the original proposed elements list. There was attrition in the Delphi survey, potentially decreasing the strength of recommendations.” Results: -The results are presented clearly. No recommended changes. RESPONSE: Thank you for this comment. Discussion/Conclusion: -(Minor change): Please provide a participant demographic breakdown, including profession. Given the challenges faced in achieving consensus, this information is relevant. RESPONSE: This is provided in Table 3, and also within the supplement. -(Minor change): It would also be helpful if other limitations were explored that could have contributed to the consensus challenges. RESPONSE: Further limitations have been added, as discussed above. “Only one conference was attended to help inform the original data elements list, as knowledge users from different backgrounds could attend other conferences across the globe, there may be selection bias limitations in the original proposed elements list. There was attrition in the Delphi survey, potentially decreasing the strength of recommendations.” -(Minor change): Please reframe the Discussion, or at least identify within the limitations, and amend the Conclusion to reflect this Delphi describes the United States and United Kingdom perspective, as indicated in the Methods section. RESPONSE: Further detail is included in the limitations. Supplementary Files: -Thank you for including the Initial Tables file, it provides contexts and allows transparency around data bias. RESPONSE: You are welcome. View more View less Competing Interests No competing interests reply Respond Report a concern Kaufman KR. Peer Review Report For: Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.5256/f1000research.167283.r339134) NOTE: it is important to ensure the information in square brackets after the title is included in this citation. The direct URL for this report is: https://f1000research.com/articles/13-1044/v1#referee-response-339134 keyboard_arrow_left Back to all reports Reviewer Report 0 Views copyright © 2024 Edwards C. This is an open access peer review report distributed under the terms of the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. 27 Nov 2024 | for Version 1 Chris M. Edwards , University of Sherbrooke, Sherbrooke, Québec, Canada 0 Views copyright © 2024 Edwards C. This is an open access peer review report distributed under the terms of the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. format_quote Cite this report speaker_notes Responses (1) Approved info_outline Alongside their report, reviewers assign a status to the article: Approved The paper is scientifically sound in its current form and only minor, if any, improvements are suggested Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit. Not approved Fundamental flaws in the paper seriously undermine the findings and conclusions Thank you to the authors for their tremendous effort in addressing MSKI in military populations. The methods described for the development of the Minimum Data Elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement will be an important reference for future publications and work in this field. Overall, the article is clear, concise and well written. A few minor changes Introduction: -Well written, intention and purpose are clearly described. Methods: -(Minor change): “ Military service members having sustained MSKI across their careers had subjective closeness. Clinicians treating service members for MSKI had mandated closeness. Researchers and scientific experts investigating military MSKI had objective closeness.” For individuals who qualified for more than 1 category, how were they assessed/allocated? -(Minor change):Please include a brief discussion on what measures were taken to mitigate biases. -(Minor change):Please describe dataset limitations within this section. Results: -The results are presented clearly. No recommended changes. Discussion/Conclusion: -(Minor change): Please provide a participant demographic breakdown, including profession. Given the challenges faced in achieving consensus, this information is relevant. -(Minor change): It would also be helpful if other limitations were explored that could have contributed to the consensus challenges. -(Minor change): Please reframe the Discussion, or at least identify within the limitations, and amend the Conclusion to reflect this Delphi describes the United States and United Kingdom perspective, as indicated in the Methods section. Supplementary Files: -Thank you for including the Initial Tables file, it provides contexts and allows transparency around data bias. Is the rationale for developing the new method (or application) clearly explained? Yes Is the description of the method technically sound? Yes Are sufficient details provided to allow replication of the method development and its use by others? Yes If any results are presented, are all the source data underlying the results available to ensure full reproducibility? Yes Are the conclusions about the method and its performance adequately supported by the findings presented in the article? Partly Competing Interests No competing interests were disclosed. Reviewer Expertise Musculoskeletal injuries in military and emergency response personnel, female health in military and emergency response personnel, physical performance in military and emergency response personnel, mental health in military and emergency response personnel. I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard. reply Respond to this report Responses (1) Author Response 20 Mar 2025 Daniel Rhon, Department of Rehabilitation Medicine, Brooke Army Medical Center, Fort Sam Houston, USA Thank you Dr. Edwards for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Abstract Please define a “mixed knowledge user”. RESPONSE: A mixed knowledge user is denoting multiple groups in one meeting. As discussed in reviewer 1, the authors felt that this term should be deleted to provide clarity. Please describe how the “asynchronous mixed knowledge user meeting” was conducted, or is this a typographical error? Please see comment in Methods section below. RESPONSE: Mixed knowledge user was deleted from the manuscript. However, asynchronous knowledge user meeting is denoting meeting that have a mixture of live video conferencing and the ability of other knowledge users to watch the video later and give comments. This has been further clarified within the methods. Recommend describing “civil servant practitioners” as a “civilian practitioner”. REPSONSE: this has been edited per the reviewer’s suggestion. Introduction Please define a definition of “knowledge user”. RESPONSE: A knowledge user is a person who contributes as an active knowledge creator, who construct meaning in their own settings, and have input that is equal to those of the scientific community. Bullock GS, Fallowfield J, Fisher B, Whittaker JL, Gafari O, Bilzon JL. Prioritizing Knowledge User Engagement: Engaging Patients and the Public in Creating Enduring Musculoskeletal Rehabilitation Research. journal of orthopaedic & sports physical therapy. 2024 Dec;54(12):743-7. This has been further clarified within the introduction. Methods When the core group pursued “a balance in expertise”, what expertise was being balanced? What criteria were used to know when this goal had been achieved? RESPONSE: Expertise balance was focused on subjective, mandated and objective closeness. Subjective is lived experience in MSKI within the military, mandated is practioner/performance/physiology and methods in MSKI, and objective is specific research in military MSKI. Stage 2: What was the military MSKI conference that was used to collect the convenience sample? How was this conference selected? How was the stated goal to sample “global-wide subject matter experts” met? RESPONSE: The conference was Total Force Fitness MSK Health conference addressing human performance optimization and MSKI mitigation and treatment in service members. This was an international conference, across different professions in the military. This has been clarified within the methods. The methods state that a “synchronous mixed knowledge user meeting” was performed. The abstract states that an “asynchronous mixed knowledge user meeting” was conducted. Is there a typographic error in the abstract? RESPONSE: Thank you for bringing this to our attention. This was an asynchronous meeting. This has been edited. Recommend describing “civil servant practitioners” as a “civilian practitioner”. RESPONSE: This has been edited per the reviewer’s suggestion. Results There was a >50% decrease in Administrative Leadership, Command Leadership, and Physical Training Instructor between Round 1 and Round 2 of the Delphi Study. Was there any concern about this significant decrease in participation from these groups? RESPONSE: It is true that there was attrition over time. Participants represent busy military leaders and clinicians, who travel often. We attempted to provide as large of a window as possible for responses to be submitted for those who could not attend; however, our hypothesis is that many individuals provided their input on the variables they felt of most importance in the very beginning. Those variables with consensus across the board did pass through to final stages. Individuals were reminded multiple times that this was their opportunity to provide additional feedback, especially if they felt strongly about any remaining variable inclusion/exclusion. It is possible that attrition was due to more ambivalence by some individuals towards the remaining variables. This has also been highlighted in the limitations section. Discussion This study provides an important list of data elements to be used for surveillance and reporting of musculoskeletal injuries that occur during military training. A weakness is that no data dictionary was created in this process and there is no indication that plans are in place to accomplish this task soon. RESPONSE: Thank you for this comment. The publication reporting the final publication does indeed provide guidance and examples to guide reporting of the recommended elements. View more View less Competing Interests No competing interests reply Respond Report a concern Edwards CM. Peer Review Report For: Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.5256/f1000research.167283.r339129) NOTE: it is important to ensure the information in square brackets after the title is included in this citation. The direct URL for this report is: https://f1000research.com/articles/13-1044/v1#referee-response-339129 keyboard_arrow_left Back to all reports Reviewer Report 0 Views copyright © 2024 O'Sullivan O. This is an open access peer review report distributed under the terms of the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. 04 Oct 2024 | for Version 1 Oliver O'Sullivan , University of Nottingham, Nottingham, England, UK 0 Views copyright © 2024 O'Sullivan O. This is an open access peer review report distributed under the terms of the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. format_quote Cite this report speaker_notes Responses (1) Approved With Reservations info_outline Alongside their report, reviewers assign a status to the article: Approved The paper is scientifically sound in its current form and only minor, if any, improvements are suggested Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit. Not approved Fundamental flaws in the paper seriously undermine the findings and conclusions Dear Colleagues, Thank you for asking me to review Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement, which is a description of methodological approach taken to develop minimum data elements for Musculoskeletal injuries. This is an important area of work and much needed - you all should be applauding for grasping the nettle on this. I felt the manuscript was well written overall, but could be refined by addressing some of the points below. The most pressing is the use (and possible over-use) of the phrase Knowledge User - the definition seemed to shift and it wasn't clear by the end who you were actually talking about. However, the area of concern I have is with regard to the results of Delphi. They are partly presented in the results and in Table 4-10; however, you report that the full results will be published elsewhere. This seems to me to be a little bit odd - would it not be better to present them in full in this manuscript, or to remove the partial presentation from this manuscript to avoid double reporting/duplicate publications? I wish the authors Good luck with the next version Minor Revisions - In your abstract, you capitalise Minimum Data Elements in the background, but then don't in the results/conclusions - could I suggest a consistent approach please? In abstract methods, you use a phrase 'civil servant practitioners' - do you think, given the international authorship and readership, that this term would translate? You could consider 'civilian' as a simpler alternative. The last sentence in the strategy section is exactly the same at the last sentence in the background section - suggest removing one of those. The fourth and fifth sentences in the Stage 1 paragraph appear to be saying 95% the same thing, but with a subtle difference. Do you require both? If so, suggest rephrasing for clarity. Your 'knowledge user' groups appear to change between the 'knowledge user involvement' and 'patient public involvement' sections. Either remove one of the elements in parenthesis if these phrases relate to the same people or please articulate the different knowledge user groups. In fact, you appear to change the knowledge user group composition in the PPI section (which is again different to above!) - please can you review this? If these are all different groups, composed of different individuals for a bespoke reason, please can you give the groups different names? Also, as an extension to above, please can you explain what you mean by 'mixed knowledge user'? Is that an amalgam of the three groups above, or something else? In stage 3 & 4, you refer to the steering committee. Are these the six individuals noted in the Strategy section? If so, please can you overtly make that point? The second sentence of Results sounds decidedly like an intro or methods sentence - please could you consider its inclusion? The second paragraph in the limitation appears repetitive - please could this be reviewed? You mention dissenting opinions in the conclusion, but I am struggling to see where these have been described or presented - please can you clarify this? In Table 3, the nationality for Round 2/3 'not disclosed' might be better in the title line, not in the same line as New Zealand Table 4 - 10 - please consider the implications of including these data if there is a plan for a further publication presenting said findings Is the rationale for developing the new method (or application) clearly explained? Yes Is the description of the method technically sound? Yes Are sufficient details provided to allow replication of the method development and its use by others? Yes If any results are presented, are all the source data underlying the results available to ensure full reproducibility? Yes Are the conclusions about the method and its performance adequately supported by the findings presented in the article? Yes Competing Interests No competing interests were disclosed. Reviewer Expertise Sports and exercise medicine, rehabilitation, military medicine I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above. reply Respond to this report Responses (1) Author Response 21 Mar 2025 Daniel Rhon, Department of Rehabilitation Medicine, Brooke Army Medical Center, Fort Sam Houston, USA Thank you Dr. O’Sullivan for your valuable time and interest for reviewing this work and for the detailed feedback and recommendations for improving this manuscript. They are greatly appreciated. For clarity, we have copied your original remarks below and then provided a point-by-point response to each one. Dear Colleagues, Thank you for asking me to review Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement, which is a description of methodological approach taken to develop minimum data elements for Musculoskeletal injuries. This is an important area of work and much needed - you all should be applauding for grasping the nettle on this. I felt the manuscript was well written overall, but could be refined by addressing some of the points below. The most pressing is the use (and possible over-use) of the phrase Knowledge User - the definition seemed to shift and it wasn't clear by the end who you were actually talking about. However, the area of concern I have is with regard to the results of Delphi. They are partly presented in the results and in Table 4-10; however, you report that the full results will be published elsewhere. This seems to me to be a little bit odd - would it not be better to present them in full in this manuscript, or to remove the partial presentation from this manuscript to avoid double reporting/duplicate publications? I wish the authors good luck with the next version RESPONSE: Thank you for these additional points. We have reviewed and considered them all carefully, to include addressing the “knowledge user” term. We have also reviewed the tables (4-10) and wish to provide some further context. There is another publication that will report on the final checklist. However, the space constraints prohibit many of the details that expand on how we were able to reach the final consensus. This manuscript in F1000 provides much more granular details about the iterative steps taken to reach the final checklist. Therefore, we focused on methodology in this manuscript. If we provided the final checklist here, then there would also be copyright concerns to address when publishing it again in the final publication. The publication with the completed checklist refers back to this manuscript, to provide readers with further details about the process. Minor Revisions - In your abstract, you capitalise Minimum Data Elements in the background, but then don't in the results/conclusions - could I suggest a consistent approach please? RESPONSE: Thank you for this comment. ‘Minimum Data Elements’ within the abstract background has been edited to lower case. In abstract methods, you use a phrase 'civil servant practitioners' - do you think, given the international authorship and readership, that this term would translate? You could consider 'civilian' as a simpler alternative. RESPONSE: Yes, thank you. That is a great suggestion and we have made that change. The last sentence in the strategy section is exactly the same at the last sentence in the background section - suggest removing one of those. RESPONSE: Thank you, we have removed the redundancy from the background section. The fourth and fifth sentences in the Stage 1 paragraph appear to be saying 95% the same thing, but with a subtle difference. Do you require both? If so, suggest rephrasing for clarity. RESPONSE: Thank you, this has been consolidated to improve clarity. Your 'knowledge user' groups appear to change between the 'knowledge user involvement' and 'patient public involvement' sections. Either remove one of the elements in parenthesis if these phrases relate to the same people or please articulate the different knowledge user groups. In fact, you appear to change the knowledge user group composition in the PPI section (which is again different to above!) - please can you review this? If these are all different groups, composed of different individuals for a bespoke reason, please can you give the groups different names? RESPONSE: Thank you for bringing this to our attention. The patient and public involvement section has been deleted, and the knowledge user group section has been updated for one paragraph. Also, as an extension to above, please can you explain what you mean by 'mixed knowledge user'? Is that an amalgam of the three groups above, or something else? RESPONSE: Mixed knowledge user details knowledge users from across different groups. The term ‘mixed’ has been deleted from the manuscript as the authors felt this decreased the clarity in the methods. In stage 3 & 4, you refer to the steering committee. Are these the six individuals noted in the Strategy section? If so, please can you overtly make that point? RESPONSE: Yes, the steering committee are the six individuals in the strategy section. This has been clarified. The second sentence of Results sounds decidedly like an intro or methods sentence - please could you consider its inclusion? RESPONSE: This sentence has been moved to the methods section, under the statistical analyses subheading. The second paragraph in the limitation appears repetitive - please could this be reviewed? RESPONSE: The second limitations sentence has been edited. You mention dissenting opinions in the conclusion, but I am struggling to see where these have been described or presented - please can you clarify this? RESPONSE: The dissenting opinions will be published for full transparency in the supplementary appendix of the manuscript reporting the final checklist. In Table 3, the nationality for Round 2/3 'not disclosed' might be better in the title line, not in the same line as New Zealand RESPONSE: This has been edited with a foot note stating that a blank cell denotes that the information was not disclosed. Table 4 - 10 - please consider the implications of including these data if there is a plan for a further publication presenting said findings RESPONSE: Thank you for this discussion. As discussed in the first response, there is another publication that will report on the final checklist. However, the space constraints prohibit many of the details that expand on how we were able to reach the final consensus. This manuscript in F1000 provides much more granular details about the iterative steps taken to reach the final checklist. Therefore, we focused on methodology in this manuscript. If we provided the final checklist here, then there would also be copyright concerns to address when publishing it again in the final publication. The publication with the completed checklist will refer back to this manuscript, to provide readers with further details about the process. View more View less Competing Interests No competing interests reply Respond Report a concern O'Sullivan O. Peer Review Report For: Methodology used to develop the minimum common data elements for surveillance and Reporting of Musculoskeletal Injuries in the MILitary (ROMMIL) statement [version 2; peer review: 2 approved, 1 approved with reservations] . F1000Research 2025, 13 :1044 ( https://doi.org/10.5256/f1000research.167283.r323555) NOTE: it is important to ensure the information in square brackets after the title is included in this citation. The direct URL for this report is: https://f1000research.com/articles/13-1044/v1#referee-response-323555 Alongside their report, reviewers assign a status to the article: Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit. Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions Adjust parameters to alter display View on desktop for interactive features Includes Interactive Elements View on desktop for interactive features Competing Interests Policy Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list: Examples of 'Non-Financial Competing Interests' Within the past 4 years, you have held joint grants, published or collaborated with any of the authors of the selected paper. You have a close personal relationship (e.g. parent, spouse, sibling, or domestic partner) with any of the authors. You are a close professional associate of any of the authors (e.g. scientific mentor, recent student). You work at the same institute as any of the authors. You hope/expect to benefit (e.g. favour or employment) as a result of your submission. You are an Editor for the journal in which the article is published. Examples of 'Financial Competing Interests' You expect to receive, or in the past 4 years have received, any of the following from any commercial organisation that may gain financially from your submission: a salary, fees, funding, reimbursements. You expect to receive, or in the past 4 years have received, shared grant support or other funding with any of the authors. You hold, or are currently applying for, any patents or significant stocks/shares relating to the subject matter of the paper you are commenting on. Stay Updated Sign up for content alerts and receive a weekly or monthly email with all newly published articles Register with F1000Research Already registered? Sign in Not now, thanks close PLEASE NOTE If you are an AUTHOR of this article, please check that you signed in with the account associated with this article otherwise we cannot automatically identify your role as an author and your comment will be labelled as a “User Comment”. If you are a REVIEWER of this article, please check that you have signed in with the account associated with this article and then go to your account to submit your report, please do not post your review here. If you do not have access to your original account, please contact us . All commenters must hold a formal affiliation as per our Policies . The information that you give us will be displayed next to your comment. User comments must be in English, comprehensible and relevant to the article under discussion. We reserve the right to remove any comments that we consider to be inappropriate, offensive or otherwise in breach of the User Comment Terms and Conditions . Commenters must not use a comment for personal attacks. When criticisms of the article are based on unpublished data, the data should be made available. I accept the User Comment Terms and Conditions Please confirm that you accept the User Comment Terms and Conditions. Affiliation ✕ refresh Please enter your institution. Note: To add your institution or organisation, start typing the name and then select the correct name from the list. Where applicable, the name will appear in both the original language and in English. Do not paste in the name. If the name does not appear in the drop-down list, we will display the information you have entered. ✕ refresh Country/Region * USA UK Canada China France Germany Afghanistan Aland Islands Albania Algeria American Samoa Andorra Angola Anguilla Antarctica Antigua and Barbuda Argentina Armenia Aruba Australia Austria Azerbaijan Bahamas Bahrain Bangladesh Barbados Belarus Belgium Belize Benin Bermuda Bhutan Bolivia Bosnia and Herzegovina Botswana Bouvet Island Brazil British Indian Ocean Territory British Virgin Islands Brunei Bulgaria Burkina Faso Burundi Cambodia Cameroon Canada Cape Verde Cayman Islands Central African Republic Chad Chile China Christmas Island Cocos (Keeling) Islands Colombia Comoros Congo Cook Islands Costa Rica Cote d'Ivoire Croatia Cuba Cyprus Czech Republic Democratic Republic of the Congo Denmark Djibouti Dominica Dominican Republic Ecuador Egypt El Salvador Equatorial Guinea Eritrea Estonia Ethiopia Falkland Islands Faroe Islands Federated States of Micronesia Fiji Finland France French Guiana French Polynesia French Southern Territories Gabon Georgia Germany Ghana Gibraltar Greece Greenland Grenada Guadeloupe Guam Guatemala Guernsey Guinea Guinea-Bissau Guyana Haiti Heard Island and Mcdonald Islands Holy See (Vatican City State) Honduras Hong Kong Hungary Iceland India Indonesia Iran Iraq Ireland Israel Italy Jamaica Japan Jersey Jordan Kazakhstan Kenya Kiribati Kosovo (Serbia and Montenegro) Kuwait Kyrgyzstan Lao People's Democratic Republic Latvia Lebanon Lesotho Liberia Libya Liechtenstein Lithuania Luxembourg Macao Madagascar Malawi Malaysia Maldives Mali Malta Marshall Islands Martinique Mauritania Mauritius Mayotte Mexico Minor Outlying Islands of the United States Moldova Monaco Mongolia Montenegro Montserrat Morocco Mozambique Myanmar Namibia Nauru Nepal Netherlands Antilles New Caledonia New Zealand Nicaragua Niger Nigeria Niue Norfolk Island North Korea North Macedonia Northern Mariana Islands Norway Oman Pakistan Palau Palestinian Territory Panama Papua New Guinea Paraguay Peru Philippines Pitcairn Poland Portugal Puerto Rico Qatar Reunion Romania Russian Federation Rwanda Saint Helena Saint Kitts and Nevis Saint Lucia Saint Pierre and Miquelon Saint Vincent and the Grenadines Samoa San Marino Sao Tome and Principe Saudi Arabia Senegal Serbia Seychelles Sierra Leone Singapore Slovakia Slovenia Solomon Islands Somalia South Africa South Georgia and the South Sandwich Is South Korea South Sudan Spain Sri Lanka Sudan Suriname Svalbard and Jan Mayen Swaziland Sweden Switzerland Syria Taiwan Tajikistan Tanzania Thailand The Gambia The Netherlands Timor-Leste Togo Tokelau Tonga Trinidad and Tobago Tunisia Turkey Turkmenistan Turks and Caicos Islands Tuvalu UK USA Uganda Ukraine United Arab Emirates United States Virgin Islands Uruguay Uzbekistan Vanuatu Venezuela Vietnam Wallis and Futuna West Bank and Gaza Strip Western Sahara Yemen Zambia Zimbabwe Please select your country/region. You must enter a comment. Competing Interests Please disclose any competing interests that might be construed to influence your judgment of the article's or peer review report's validity or importance. Competing Interests Policy Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list: Examples of 'Non-Financial Competing Interests' Within the past 4 years, you have held joint grants, published or collaborated with any of the authors of the selected paper. You have a close personal relationship (e.g. parent, spouse, sibling, or domestic partner) with any of the authors. You are a close professional associate of any of the authors (e.g. scientific mentor, recent student). You work at the same institute as any of the authors. You hope/expect to benefit (e.g. favour or employment) as a result of your submission. You are an Editor for the journal in which the article is published. Examples of 'Financial Competing Interests' You expect to receive, or in the past 4 years have received, any of the following from any commercial organisation that may gain financially from your submission: a salary, fees, funding, reimbursements. You expect to receive, or in the past 4 years have received, shared grant support or other funding with any of the authors. You hold, or are currently applying for, any patents or significant stocks/shares relating to the subject matter of the paper you are commenting on. Please state your competing interests The comment has been saved. An error has occurred. Please try again. Cancel Post var lTitle = "Methodology used to develop the minimum common...".replace("'", ''); var linkedInUrl = "http://www.linkedin.com/shareArticle?url=https://f1000research.com/articles/13-1044/v2" + "&title=" + encodeURIComponent(lTitle) + "&summary=" + encodeURIComponent('Read the article by '); var deliciousUrl = "https://del.icio.us/post?url=https://f1000research.com/articles/13-1044/v2&title=" + encodeURIComponent(lTitle); var redditUrl = "http://reddit.com/submit?url=https://f1000research.com/articles/13-1044/v2" + "&title=" + encodeURIComponent(lTitle); linkedInUrl += encodeURIComponent('Bullock GS et al.'); var offsetTop = /chrome/i.test( navigator.userAgent ) ? 4 : -10; var addthis_config = { ui_offset_top: offsetTop, services_compact : "facebook,twitter,www.linkedin.com,www.mendeley.com,reddit.com", services_expanded : "facebook,twitter,www.linkedin.com,www.mendeley.com,reddit.com", services_custom : [ { name: "LinkedIn", url: linkedInUrl, icon:"/img/icon/at_linkedin.svg" }, { name: "Mendeley", url: "http://www.mendeley.com/import/?url=https://f1000research.com/articles/13-1044/v2/mendeley", icon:"/img/icon/at_mendeley.svg" }, { name: "Reddit", url: redditUrl, icon:"/img/icon/at_reddit.svg" }, ] }; var addthis_share = { url: "https://f1000research.com/articles/13-1044", templates : { twitter : "Methodology used to develop the minimum common data elements.... Bullock GS et al., published by " + "@F1000Research" + ", https://f1000research.com/articles/13-1044/v2" } }; if (typeof(addthis) != "undefined"){ addthis.addEventListener('addthis.ready', checkCount); addthis.addEventListener('addthis.menu.share', checkCount); } $(".f1r-shares-twitter").attr("href", "https://twitter.com/intent/tweet?text=" + addthis_share.templates.twitter); $(".f1r-shares-facebook").attr("href", "https://www.facebook.com/sharer/sharer.php?u=" + addthis_share.url); $(".f1r-shares-linkedin").attr("href", addthis_config.services_custom[0].url); $(".f1r-shares-reddit").attr("href", addthis_config.services_custom[2].url); $(".f1r-shares-mendelay").attr("href", addthis_config.services_custom[1].url); function checkCount(){ setTimeout(function(){ $(".addthis_button_expanded").each(function(){ var count = $(this).text(); if (count !== "" && count != "0") $(this).removeClass("is-hidden"); else $(this).addClass("is-hidden"); }); }, 1000); } close How to cite this report {{reportCitation}} Cancel Copy Citation Details $(function(){R.ui.buttonDropdowns('.dropdown-for-downloads');}); $(function(){R.ui.toolbarDropdowns('.toolbar-dropdown-for-downloads');}); $.get("/articles/acj/152514/179630") new F1000.Clipboard(); new F1000.ThesaurusTermsDisplay("articles", "article", "179630"); $(document).ready(function() { $( "#frame1" ).on('load', function() { var mydiv = $(this).contents().find("div"); var h = mydiv.height(); console.log(h) }); var tooltipLivingFigure = jQuery(".interactive-living-figure-label .icon-more-info"), titleLivingFigure = tooltipLivingFigure.attr("title"); tooltipLivingFigure.simpletip({ fixed: true, position: ["-115", "30"], baseClass: 'small-tooltip', content:titleLivingFigure + " " }); tooltipLivingFigure.removeAttr("title"); $("body").on("click", ".cite-living-figure", function(e) { e.preventDefault(); var ref = $(this).attr("data-ref"); $(this).closest(".living-figure-list-container").find("#" + ref).fadeIn(200); }); $("body").on("click", ".close-cite-living-figure", function(e) { e.preventDefault(); $(this).closest(".popup-window-wrapper").fadeOut(200); }); $(document).on("mouseup", function(e) { var metricsContainer = $(".article-metrics-popover-wrapper"); if (!metricsContainer.is(e.target) && metricsContainer.has(e.target).length === 0) { $(".article-metrics-close-button").click(); } }); var articleId = $('#articleId').val(); if($("#main-article-count-box").attachArticleMetrics) { $("#main-article-count-box").attachArticleMetrics(articleId, { articleMetricsView: true }); } }); var figshareWidget = $(".new_figshare_widget"); if (figshareWidget.length > 0) { window.figshare.load("f1000", function(Widget) { // Select a tag/tags defined in your page. In this tag we will place the widget. _.map(figshareWidget, function(el){ var widget = new Widget({ articleId: $(el).attr("figshare_articleId") //height:300 // this is the height of the viewer part. [Default: 550] }); widget.initialize(); // initialize the widget widget.mount(el); // mount it in a tag that's on your page // this will save the widget on the global scope for later use from // your JS scripts. This line is optional. //window.widget = widget; }); }); } close Error Close Add Reset F1000.MICROSERVICES.AFFILIATION = ''; $(document).ready(function () { $('.js-affiliations-form').each((index, form) => { new AffiliationForm({ formId: form.id, institutionErrorSelector: '.comment-enter-institution', departmentErrorSelector: '.comment-enter-department', placeSelector: '.js-add-comment-place', stateSelector: '.js-add-comment-state', zipCodeSelector: '.js-add-comment-zipcode', countrySelector: '.js-add-comment-country', countryErrorSelector: '.comment-enter-country', }); }); }); $(document).ready(function () { var reportIds = { "375433": 0, "375435": 0, "375434": 5, "329749": 0, "329748": 0, "329751": 0, "329750": 0, "329747": 0, "329756": 0, "329753": 0, "329752": 0, "329755": 0, "329754": 0, "336485": 0, "323556": 0, "323557": 0, "336487": 0, "323558": 0, "336486": 0, "323553": 0, "323554": 0, "323555": 14, "336493": 0, "336492": 0, "336494": 0, "336489": 0, "336488": 0, "336491": 0, "336490": 0, "339125": 0, "339127": 0, "339126": 0, "339133": 0, "339132": 0, "339134": 11, "339129": 13, "339128": 0, "339131": 0, "339130": 0, }; $(".referee-response-container,.js-referee-report").each(function(index, el) { var reportId = $(el).attr("data-reportid"), reportCount = reportIds[reportId] || 0; $(el).find(".comments-count-container,.js-referee-report-views").html(reportCount); }); var uuidInput = $("#article_uuid"), oldUUId = uuidInput.val(), newUUId = "af86f9d8-691e-405d-831c-3ce17e3956df"; uuidInput.val(newUUId); $("a[href*='article_uuid=']").each(function(index, el) { var newHref = $(el).attr("href").replace(oldUUId, newUUId); $(el).attr("href", newHref); }); }); An innovative open access publishing platform offering rapid publication and open peer review, whilst supporting data deposition and sharing. Browse Gateways Collections How it Works Contact For Developers Cookie Notice Privacy Notice RSS Submit Your Research Follow us © 2012-2026 F1000 Research Ltd. ISSN 2046-1402 | Legal | Partner of Research4Life • CrossRef • ORCID • FAIRSharing R.templateTests.simpleTemplate = R.template(' $text $text $text $text $text '); R.templateTests.runTests(); var F1000platform = new F1000.Platform({ name: "f1000research", displayName: "F1000Research", hostName: "f1000research.com", id: "1", editorialEmail: "[email protected]", infoEmail: "[email protected]", usePmcStats: true }); $(function(){R.ui.dropdowns('.dropdown-for-authors, .dropdown-for-about, .dropdown-for-myresearch');}); // $(function(){R.ui.dropdowns('.dropdown-for-referees');}); $(document).ready(function () { if ($(".cookie-warning").is(":visible")) { $(".sticky").css("margin-bottom", "35px"); $(".devices").addClass("devices-and-cookie-warning"); } $(".cookie-warning .close-button").click(function (e) { $(".devices").removeClass("devices-and-cookie-warning"); $(".sticky").css("margin-bottom", "0"); }); $("#tweeter-feed .tweet-message").each(function (i, message) { var self = $(message); self.html(linkify(self.html())); }); $(".partner").on("mouseenter mouseleave", function() { $(this).find(".gray-scale, .colour").toggleClass("is-hidden"); }); }); Sign In Remember me Forgotten your password? Sign In Cancel Email or password not correct. Please try again Please wait... $(function(){ // Note: All the setup needs to run against a name attribute and *not* the id due the clonish // nature of facebox... $("a[id=googleSignInButton]").click(function(event){ event.preventDefault(); $("input[id=oAuthSystem]").val("GOOGLE"); $("form[id=oAuthForm]").submit(); }); $("a[id=facebookSignInButton]").click(function(event){ event.preventDefault(); $("input[id=oAuthSystem]").val("FACEBOOK"); $("form[id=oAuthForm]").submit(); }); $("a[id=orcidSignInButton]").click(function(event){ event.preventDefault(); $("input[id=oAuthSystem]").val("ORCID"); $("form[id=oAuthForm]").submit(); }); }); If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password. The email address should be the one you originally registered with F1000. Email address not valid, please try again You registered with F1000 via Google, so we cannot reset your password. To sign in, please click here . If you still need help with your Google account password, please click here . You registered with F1000 via Facebook, so we cannot reset your password. To sign in, please click here . If you still need help with your Facebook account password, please click here . Code not correct, please try again Reset password Cancel Email us for further assistance. Server error, please try again. If your email address is registered with us, we will email you instructions to reset your password. If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance. Please wait... Register $(document).ready(function () { signIn.createSignInAsRow($("#sign-in-form-gfb-popup")); $(".target-field").each(function () { var uris = $(this).val().split("/"); if (uris.pop() === "login") { $(this).val(uris.toString().replace(",","/")); } }); });

Text is read by the "Ask this paper" AI Q&A widget below. Extraction quality varies by source — PMC NXML preserves structure cleanly, OA-HTML may include some navigation residue, and OA-PDF can have broken hyphenation. The publisher copy (via DOI) is the canonical version.

My notes (saved in your browser only)

Ask this paper AI returns verbatim quotes from the full text · source: preprint-html

Answers must be backed by verbatim quotes from this paper's full text. Hallucinated quotes are dropped automatically; if no verbatim passage answers the question, we say so. How this works

Citation neighborhood (no data yet)

We don't have any in-corpus citations linked to this paper yet. This is a recent paper (2025) — citers typically take a year or two to land, and the OpenAlex reference graph may still be filling in.

Source provenance

europepmc
last seen: 2026-05-20T01:45:00.602351+00:00