Standardized administration and scoring guidelines for the Spinal Cord Independence Measure Version 3.0 (SCIM-III)

Standardized administration and scoring guidelines for the Spinal Cord Independence Measure Version 3.0 (SCIM-III) | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Article Standardized administration and scoring guidelines for the Spinal Cord Independence Measure Version 3.0 (SCIM-III) Rachel Kim, Christina Calhoun Thielen, Giulia Heydeman, Mary Jane (MJ) Mulcahey This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-2277985/v1 This work is licensed under a CC BY 4.0 License Status: Published Journal Publication published 25 Mar, 2023 Read the published version in Spinal Cord → Version 1 posted 7 You are reading this latest preprint version Abstract Study Design: Qualitative studies Objective : To develop clear and specific administration and scoring procedures for the Spinal Cord Independence Measure Version 3.0 as a performance-based and interview assessment. Setting: Research lab Methods : Modified Delphi Technique survey methods were used in this study. Previously developed SCIM-III administration and scoring procedures for performance-based and interview versions were presented to clinicians experienced in SCI and SCIM-III using the Qualtrix (Qualtrics, Provo, UT) online survey platform. Summary and descriptive statistics were used to assess the percent agreement survey responses. Results : Three survey rounds were necessary to achieve 80% agreement or above for the performance-based version. Two survey rounds were necessary to achieve 80% agreement or above on the interview version. Conclusions : This study describes the development of standardized administration and scoring procedures for the self-care and mobility sub scales of the SCIM-III as a performance-based and interview version. Health sciences/Medical research/Outcomes research Health sciences/Health care Figures Figure 1 Introduction The Spinal Cord Independence Measure (SCIM-III) evaluates the level of independence and ability of individuals with spinal cord injury (SCI) to perform routine daily tasks [ 1 , 2 ]. It is comprised of 19 items in three domains: self-care (6 items), respiration and sphincter management (4 items), and mobility (9 items) [ 3 ]. Each domain is scored on an ordinal scale based on the clinical relevance and importance for individuals with SCI [ 3 , 4 ]. Scoring accounts for the amount of assistance provided by another person and use of adaptive equipment by assigning higher scores for less assistance or aids [ 5 ]. Since its introduction in 1997, the SCIM-III has been frequently used in SCI clinical trials. Three large-scale adult studies [ 6 , 7 , 8 ] evaluated the validity and reliability of the SCIM-III as a functional recovery instrument and established moderate-to-strong reliability and validity. Additional work examined clinically important differences in SCIM-III scores [ 9 ], established target values for SCIM-III for neurological levels in complete SCI [ 10 ], and developed and validated a self-report version [ 11 ]. Most recently, scores from the ISNCSCI motor examination [ 12 ] and SCIM-III scores from select items have been used to develop the Spinal Cord Ability Ruler (SCAR) to enable longitudinal assessment of volitional performance on a linear metric from the time of injury [ 12 ]. Despite its widespread use, standardized guidelines for administering and scoring the SCIM-III were never developed, which has led to variability in interpretation of scores [ 13 ] and feedback that administration and scoring descriptions are incomplete and unclear [ 14 ]. Variability in administering and scoring standardized clinical outcome assessments, such as the SCIM-III [ 14 ], has implications for clinical practice and clinical trials. Reimbursement, length of stay, and potential for over-estimating or under-estimating function are at risk. For clinical trials, variability in administration and scoring poses a threat to reliability within a single trial and limits the opportunity for comparison of outcomes and pooling of data across several trials. Lack of standardization can also impact test results and measurement properties [ 14 ]. For performance-based measures, such as the SCIM-III, reliance on human raters to translate human motor performance into a metric underscores the importance for clear administration and scoring procedures. Performance-based assessments involve having the participant perform certain movements or tasks, which allow for a direct assessment of the participant’s abilities. Although performance-based assessments may be more objective and potentially less biased than self-report and interview-based assessments, they are time-consuming and may not be feasible within all practice environments and clinical trial settings due to limited time and resources, such as equipment and appropriate environments for observation [ 15 , 16 ], and transportation challenges associated with returning to the clinical setting. Reliability of SCIM-III scores when obtained through self-report and interview are acceptable, and these modes of administration require less time (10–15 minutes for interview compared to 30–45 minutes by observation), allow for rapid data collection, and can be utilized across multiple settings [ 16 , 17 ]. Similarly, administration of the SCIM-III by interview may mitigate the amount of missing data in longitudinal studies. When administrating the SCIM-III as a performance-based measure and as an interview, it is important to have guidelines that standardize administration and scoring of each item. Standardized guidelines would provide a safeguard for variability in item set-up, execution, scoring (performance-based administration), and in the structure and content of questions for each item (interview administration). Previous studies have recognized the need for better training in and standardization of administration and scoring of the SCIM-III [ 8 , 15 ]. In response to the need for standardization in administration and scoring of the SCIM-III, and in recognition of the serious limitations in SCI clinical outcome measures, we engaged experts in SCI practice and research to create standardized procedures for the SCIM-III when administered and scored as a performance-based measure and standardized procedures for the SCIM-III when administered and scored by interview. Purpose The purpose of this study was to develop standardized administration and scoring procedures for the SCIM-III items when administered as a performance-based assessment and by interview. We sought to develop clearly written administration procedures that aligned with the intent of SCIM-III items and that were feasible to implement in practice environments and clinical trial settings. We also sought to develop procedures to aid in accurate scoring of SCIM-III items when administered as a performance-based measure and interview. Methods The Modified Delphi Technique is an iterative process that uses a systematic progression of repeated rounds of surveys to allow for feedback and revisions as a way to build consensus among experts in areas and for purposes where knowledge is complex, incomplete or poorly understood [ 18 , 19 ]. The defining feature of the Modified Delphi is that the collated responses from previous questionnaires are integrated into each new questionnaire, and the experts being questioned are able to reconsider their previous judgments, revising and responding as appropriate [ 20 ]. In health care, the Modified Delphi Method has been used for a variety of purposes including the development of clinical practice guidelines. In this study, we used the Modified Delphi to engage SCI clinicians and researchers for the purposes of developing standardized administration and scoring procedures for the SCIM-III. As shown in Fig. 1 , a multi-stage iterative process [ 19 , 21 , 22 ] (Fig. 1 ) was used to create initial administration and scoring procedures for each SCIM-III item, garner feedback on clarity of wording of administration and scoring guidelines and on feasibility of administering SCIM-III performance-based items as specified and to reach consensus (80% agreement) among the experts that the administration and scoring were clearly written, aided in administration and scoring, and were feasible to execute. Two independent Modified Delphi processes were implemented. The first Modified Delphi focused on the developing guidelines for the SCIM-III for administration and scoring as a performance-based measure (March 2020-May 2020), and the second Modified Delphi process was undertaken to develop guidelines for the SCIM-III for administration by interview (February 2021-March 2021). The two-staged approach was used to mitigate confusion about mode of administration. As shown in Fig. 1 , an initial set of administration and scoring guidelines were established based on the SCIM-III literature and SCIM-III experience and were used as the basis for the first survey. Survey Development As a starting point, initial administration and scoring procedures for each SCIM-III mobility and self-care item were developed for performance-based standardization. These procedures were slightly revised for SCIM-III mobility and self-care items for interview, and initial procedures for respiration and sphincter were created (we did not include respiration or sphincter in the performance-based guidelines) (Fig. 1 ). Specifically, for each SCIM-III mobility and self-care item, an explicit administration and scoring procedure was provided followed by four “yes/no” questions: 1. Are the (administration) instructions clear? 2. Could you replicate this in your clinic? 3. Are the scoring instructions clear? 4. Would you be able to determine a SCIM-III score? This resulted in a total of 60 questions for the first survey for the Modified Delphi Process for performance-based standardization (15 SCIM-III mobility\self-care items X 4 “yes/no questions per item). Only two “yes/no” questions were asked for each SCIM-III item for interview standardization: 1. Are the interview prompts clear? 2. Could you replicate this in your clinic? Thus, for the first survey for the Modified Delphi process for interview standardization, there were 38 questions (19 SCIM-III items X 2 “yes/no” questions per item). Survey respondents were asked to answer each yes\no question, provide a rationale for a response of “no”, and suggest alternatives to the content or wording to improve clarity, consistency, and standardization. Consistent with Modified Delphi Methodology, subsequent surveys contained revised procedure guidelines based on expert input and the same “yes/no” questions. Surveys were completed anonymously and remained open for two-weeks for each iterative round, with an e-mail reminder after one week to boost response rate. A statement of consent was provided in the email invitation. Survey Respondents Purposeful [ 23 ] and snowball [ 24 ] sampling were used to recruit survey participants. Purposeful sampling was done by e-mailing an invitation to content experts known to the principal investigator with a description of the study purpose and a link to the survey. Content experts were asked to forward the e-mail invitation to their colleagues who work with the SCI population (snowball sampling). Data Analysis Summary and descriptive statistics were used to assess percent agreement of survey responses. For yes-no questions that had at least 80% response rate of “yes”, procedures were considered clearly written and feasible to implement in usual practice and clinical trial environments. For yes-no questions that did not reach 80% response rate of “yes”, procedures were revised based on respondents’ feedback and exposed to subsequent survey rounds until 80% agreement was achieved. Once 80% agreement was obtained for each question for each SCIM-III item, administration and scoring guidelines for performance-based administration and for administration by interview were formatted and prepared for widespread dissemination. This study was approved by the Institutional Review Board. Results As shown in Table 1, the majority of respondents were physical and occupational therapists, had over 10 years of SCI experience, and used the SCIM-III, primarily in rehabilitation and research settings. The majority of respondents reported administering the SCIM-III using a combination of observing performance and interview. Three iterative rounds of the performance-based survey were required to reach 80% agreement for each of the four questions for each SCIM-III self-care and mobility items (Table 2). Two iterative rounds of the interview survey were required to reach 80% agreement for all items (Table 3). Modified Delphi Process for Standardization of Procedures for Administration and Scoring by Performance-based Measure Table 2 shows the response rate of “Yes” to each of the four questions asked for the mobility and self-care items in the Modified Delphi process for standardization for the performance-based measure. As shown in the first survey, the response of “yes” for the administration procedures for 6 items and for the scoring procedures for 8 items was obtained in at least 80% of respondents. For the remaining questions (n = 36) that did not reach 80% response of “yes”, feedback from respondents (Table 4) was used to revise the administration and scoring procedures, and these items were exposed to expert opinion and feedback in survey. As shown in Table 2, with the exception of the two questions asked for scoring procedures for one item (Mobility in Bed and Action to Prevent Pressure Injuries), survey 2 obtained at least an 80% response rate of “yes” for every question for each item. Respondent feedback was used to revise the scoring procedures for the Mobility in Bed and Action to Prevent Pressure Injuries (Table 4), and the item was again exposed to expert opinion and feedback in a third survey. Modified Delphi Process for Standardization of Procedures for Administration and Scoring by Interview Table 3 shows the response rate of “Yes” for each of the two questions asked for each of the SCIM IIII items in the Modified Delphi process for standardization for interview. As shown in the first survey, the response rate of “yes” for the questions, “are the interview prompts clear?” and “could you replicate this in your clinic?”, were at least 80% for 13 items and for 16 items, respectively. For the items that did not reach 80% response rate for either question, feedback from survey 1 (Table 4) was used to revise the administration and scoring procedures, which were exposed to expert review in the second survey. Of note, although the 80% threshold was reached for two items (use of toilet; transfer from wheelchair to toilet/tub), administration and scoring were revised based on survey 1 feedback (Table 4) and included in the second survey. As shown in Table 3, an 80% or greater response rate of yes was obtained for each SCIM-III item. Discussion In this study, a Modified Delphi Technique was used to iteratively obtain feedback and establish consensus among experts on the standardization of administration and scoring procedures for the SCIM-III when administered as a performance-based measure and as an interview. Owing to the widespread use of the SCIM-III in practice and research and the concerns about the lack of available standardized procedures for administration and scoring, we established procedural guidelines that are clear, mitigate variability, accessible, and that are feasible to implement in practice and research settings. The inherent lack of guidance of the existing SCIM-III leaves it open to interpretation and variability. Given the potential variability in performance-based outcome measures, it is important to establish fidelity in administration and scoring to assess whether or not an individual implements an evaluation as intended [ 25 , 26 ]. In a clinical trial setting, when administering outcome measures with different administration and scoring procedures, fidelity is essential to prevent “rater drift and contamination” [ 27 ]. This is significant considering the reliability and validity of a measure are “dependent on the consistency with which it can be administered, scored, and interpreted” [ 28 ]. Moreover, because users of clinical outcome measures frequently do not read clinical outcome measures users’ manuals [ 29 ], we created scoring flow diagrams that are intuitive and allow for low burden and accurate scoring. While we did not collect information on geographical location of the respondents, purposeful sampling included distribution of the email invitation to international experts. One plausible reason for not reaching the 80% threshold in the first surveys is due to regional variations in English lexicon. Certain terms such as “electric aide”, “durable medical equipment” and “tick” seemed to be relevant for some regions and not for others. Medical jargon and use of abbreviations also likely contributed to responses of “no” for some items. Specifically, the definitions for durable medical equipment, adaptive devices, specific setting, total partial assistance, and partial assistance were created, as respondents identified these terms as being too complex or “technical” for use in SCIM-III interview. As such, the procedure manuals include an abbreviation list and glossary of terms with definitions to decrease areas of potential confusion and to make the measure easier to use for those with limited experience with SCIM-III. Gender-specific pronouns were removed to be more inclusive of all gender identities. Survey responses and feedback led to revision of administration and scoring procedures for the SCIM-III items, resulting in standardized and clearly written administration and scoring procedures for the SCIM-III. The methodology did not alter any established SCIM-III item or scoring criteria [ 1 , 3 , 5 , 6 ]. Our intent was to maintain the SCIM-III as it was developed and make no changes to items or scoring. Several respondents reported concerns with the inconsistent scoring scale; meaning sometimes scoring is 0–2 while for other items it is 0–8. It was important to state that the scoring is directly from the original SCIM-III, and our team did not feel it within the scope of our work to revise the scoring structure. Our work focused entirely on providing clear and specific instructions for administering and scoring SCIM-III items via performance-based measure and individual interview, with the goal to provide the field with a resource to assess endpoints of usual care and clinical trials. Performance-Based Version An introduction and general instructions for the survey and SCIM-III performance-based procedures were necessary to provide background information and decrease administrator burden when completing the survey and administering this version of the SCIM-III. Respondents of the performance-based survey were instructed to review both the written instructions and scoring flowsheets prior to answering survey questions since these were developed to be used in conjunction with each other for each SCIM-III item. In both versions, the starting prompt of each flowsheet was moved towards the top-left corner and the final scores, which were made rectangular and blue to differentiate from the rest of the flowsheet, were organized in numerical order and placed on either the right or bottom of the flowsheet. Administration and scoring procedures were not developed for the respiration and sphincter management subscale of the SCIM-III. This portion was excluded in the performance-based procedures because of the inability to adequately demonstrate and assess respiratory elements with a performance measure. Additionally, having participants demonstrate their bowel and bladder program would be an undue burden. In contrast, the self-care and mobility portions were included because clinical trials are more focused on mobility and upper extremity function, which are more directly related to those sections. Moreover, in the rehabilitation setting, it is frequently the occupational and physical therapists who use the SCIM-III; therefore, if transformed into a performance measure, the self-care and mobility portions would be assessed be an occupational or physical therapist. Initial administration procedures gave examples of items that could be used or tasks to perform. However, survey respondents reported that the initial examples were not specific enough and the expectation was still unclear. For example, the administration procedures for the dressing item included “raise arms”. In round 2, it was revised to “touch the back of your head”. This created clear expectations for both the participant and administrator. We further needed to develop a list of recommended materials to be used for each item, adding to the standardization of our manual. This list included items such as an 8oz sandwich container, 12oz plastic cup, and a reusable metal knife and fork. When standardizing administration procedures for dressing and bathing items, only a few specific tasks were selected to reduce time and participant and administrator burden. For example, for bathing, two body parts were selected to mimic upper body (non-dominant arm and low back) and lower body bathing (perineal area and dominant lower leg). The parts of the task that were selected were ones that incorporated most of the task or the more challenging aspects of the task. It was necessary to limit the task in this manner for the sake of time and clinical usability. Lastly, modifications were made to all scoring procedures to increase flow and clarity. Although many of the scoring procedures obtained above 80% agreement in round 1, it was determined that it would be beneficial to apply the changes made to those with below 80% agreement to all flowsheets. The flowsheets were simplified and made as consistent as possible to ease administrator burden. They were then re-submitted in round 2 for review. After round 2, only 1 item required further revisions. This item was revised per the respondent’s comments and submitted into a third and final round. Interview Version An introduction was provided at the start of the round 2 survey to address some of the feedback provided in round 1. Participants provided comments that aligned with many of the limitations of the original SCIM-III such as the vagueness of core tasks, use of medical jargon and abbreviations, and the overall lack of accessibility of the measure to the patient population. The original SCIM-III is not inclusive of all scenarios that individuals with SCI may participate in. To clarify the intent to retain fidelity to the original SCIM-III in terms of content, a general statement was made that: “Not every case/scenario may be captured in these flowsheets… Despite being an appropriate consideration for persons with SCI, some conditions and situations were not represented in the interview flowsheets in order to adhere to the original SCIM-III guidelines.” One respondent emphasized that a person could perform a pressure relief in a wheelchair in more ways than just “doing push-ups in wheelchair,” which is the only consideration in the original SCIM-III scoring criteria. These comments were reasoned to be issues and limitations with the original SCIM-III form and not necessarily with the interview flowsheets. In developing the interview version, participants in round 1 provided feedback that the flowsheets were not intuitively organized and therefore the decision was made to alter the formatting and change the colors and shapes shown on the flowsheets. The shape of the initial prompt was changed to a circle and moved to the top of each flowsheet, making it apparent for administrators where to begin the sequence of prompts. The shape change also set the initial prompt apart from the subsequent diamond-shaped prompts. A sample flowsheet with these changes was provided in the beginning of the round 2 survey with instructions on how to navigate the flowsheets. Instead of focusing on the positioning of the individual during the bathing and dressing items, the prompts in the flowsheets were altered to be more consistent with the scoring guidelines which emphasize level of assistance provided, use of adaptive devices, and/or the use of specific settings to facilitate completion. In many cases, small modifications to prompts resulted in less prompts on the flowsheets overall, reducing the complexity of scoring and increasing ease of use of the interview format compared to the original SCIM-III. As indicated by 80% agreement on all the SCIM-III flowsheets in the round 2 survey, structural changes allowed for a conciseness of language in subsequent prompts and a clearer path through the flowsheets, decreasing the burden of administration and scoring. Standardizing the interview prompts while retaining fidelity to the original SCIM-III form makes the SCIM-III more accessible not only to those administering the assessment, but also to the individuals. Limitations A limitation in this study is our sampling methods. By utilizing purposeful and snowball sampling with health professionals and researchers known the principal investigator, we may have limited the experience, practice settings, and familiarity with up-to-date practice recommendations of the participant pool. Moreover, the content experts selected are heavily involved in the SCI community, actively participate in SCI associations and their annual meetings, and engage in research and other educational opportunities. It is important to note that there are many health professionals and researchers who work with SCI populations but may not be included because they are not known to our PI. Moreover, because responses were not forced, not all survey participants responded to every question. Dropout was evident in the interview survey between round 1 and round 2 where the response rate decreased by 15 total participants. Round 2 of the interview survey had fewer questions (N = 26) (9 SCIM-III items X 2 “yes/no” questions per item; 5 demographic questions; 3 SCIM-III-related questions) than round 1 (N = 38). There are a few factors that may have caused dropout. One possible reason is over-sampling. Despite the year gap between surveys, by using the same participant pool, individuals may have felt burdened by completing multiple surveys. Another reason may have been technical issues with accessing the survey link. Future Directions In the performance-based survey, the questions regarding respondents’ level of experience with the SCIM-III revealed that while majority had experience with the SCIM-III (65–75%), about 6.5–14.7% used the SCIM-III as a performance measure alone. Most respondents reported using the SCIM-III as a combination of both the performance and interview/self-report (56–67%). In the interview survey, 58.3–75.0% of participants were familiar with the SCIM-III. Of those individuals, 11.1–25.0% reported they use the SCIM-III as interview in their practice and 22.2–41.7% used the SCIM-III as performance measure alone. Approximately 33.3–66.7% reported to using the SCIM-III as a combination of a performance measure and interview/self-report. Based on these findings, it may be beneficial to compare the two distinct measures developed here to the original SCIM-III for accuracy and reliability. Conclusion Standardized administration and scoring procedures for both the performance-based and interview formats of the SCIM-III have been developed, and consensus on their clarity and feasibility established, and may be a useful resource for clinical trial programs and practice environments. They are available for download at no cost from the Jefferson College of Rehabilitation Sciences Center for Outcomes and Measurement website ( https://www.jefferson.edu/university/rehabilitation-sciences/departments/outcomes-measurement/measures-assessments/spinal-cord-independence-measure-version-iii-administration-and-scoring-guidelines.html ). Abbreviations SCIM-III Spinal Cord Independence Measure Version 3.0 SCI spinal cord injury Declarations Acknowledgements We acknowledge Isa A. McClure, MAPT, Kessler Institute for Rehabilitation and Rebecca Martin, OTD, Kennedy Krieger Institute, Johns Hopkins University School of Medicine for their contributions in the development of the standardized administration and scoring procedures. We further acknowledge our study respondents who participated in the surveys unnamed. Their expertise greatly informed the development of the SCIM-III standardized administration and scoring procedures. Data Availability Statement All data generated or analyzed during this study are included in this published article [and its supplementary information files]. As stated in our conclusions, the completed guidelines resulting from this study are available on the Center for Outcomes and Measurement website, https://www.jefferson.edu/academics/colleges-schools-institutes/rehabilitation-sciences/departments/outcomes-measurement/measures-assessments/spinal-corde-independence-measure-v3.html. Author Contribution Statement RYK was responsible for leading data collection and analysis of Delphi for SCIM performance-based assessment, developing Delphi surveys for interview assessment, and leading the writing of the manuscript. CCT contributed by assisting in developing Delphi surveys for performance-based and interview assessment, collecting and analyzing data, and writing the manuscript. GH led the data collection and analysis of Delphi for SCIM interview assessment and assisted with writing the interview assessment portions of the manuscript. MJM was responsible for the conceptual design of the study, leading the development of the Delphi surveys, assisting in data analysis, and an equal in writing of the manuscript. Funding This study was funded by departmental funds from the Department of Occupational Therapist in the Jefferson College of Rehabilitation Sciences in Thomas Jefferson University. Ethical Approval This study was reviewed and approved by the Institutional Review Board (IRB), “Spinal Cord Independence Measure, Version III (SCIM-III) Procedure Development: A Modified Delphi Survey” (Departmental)Control #20E.150. We certify that all applicable institutional and governmental regulations concerning the ethical use of human volunteers/animals were followed during the course of this research. Competing Interests The authors declare that there is no conflict of interest. References Catz, A, Itzkovich, M, Steinberg, F, Philo, O, Ring, H, Ronen, J, et al. The Catz-Itzkovich SCIM: a revised version of the spinal cord independence measure. Disabil Rehabil. 2001; 23:263–268. De Almeida, C, Coelho, JN, Riberto, M. Applicability, validation and reproducibility of the spinal cord independence measure version III (SCIM III) in patients with non-traumatic spinal cord lesions. Disabil Rehabil. 2016; 38(22):2229–2234. Catz, A, Itzkovich, M, Agranov, E, Ring, H, Tamir, A. SCIM-spinal cord independence measure: a new disability scale for patients with spinal cord lesions. Spinal Cord. 1997; 35(12):850–856. Ackerman, P, Morrison, SA, McDowell, S, Vazquez, L. Using the spinal cord independence measure III to measure functional recovery in a post-acute spinal cord injury program. Spinal Cord. 2010; 48:380–387. Catz, A, Itzkovich, M, Tesio, L, Biering-Sorenson, F, Weeks, C, Laramee, MT, et al. A multi-center international study on the spinal cord independence measure, version III: Rasch psychometric validation. Spinal Cord. 2007; 45:275–291. Itzkovich, M, Gelernter, I, Biering-Sorenson, F, Weeks, C, Laramee, MT, Craven, BC, et al. The spinal cord independence measure (SCIM) version III: reliability and validity in a multi-center international study. Disabil Rehabil. 2007; 29(24):1926–1933. Bluvshtein, V, Front, L, Itzkovich, M, Aidinoff, E, Gelernter, I, Hart, J, et al. SCIM III is reliable and valid in a separate analysis for traumatic spinal cord lesions. Spinal Cord. 2011; 49(2):292–296. Anderson, KD, Acuff, ME, Arp, BG, Backus, D, Chun, S, Fisher, K, et al. United States (US) multi-center study to assess the validity and reliability of the spinal cord independence measure (SCIM III). Spinal Cord. 2011; 49:88–885. Scivolette, G, Tamburella, F, Laurenza, L, Molinari, M. The spinal cord independence measure: how much change is clinically significant for spinal cord injury subjects. Disabil Rehabil. 2013; 35(21):1808–1813. Aidinoff, E, Front, L, Itzkovich, M, Bluvshtein, V, Gelernter, I, Hart, J, et al. Expected spinal cord independence measure, third version, scores for various neurological levels after complete spinal cord lesions. Spinal Cord. 2011; 49(8):893–896. Fekete, C, Eriks-Hoogland, I, Baumberger, M, Catz, A, Itzkovich, M, Luthi, H, et al. Development and validation of a self-report version of the spinal independence measure (SCIM III). Spinal Cord. 2013; 51:40–47. Reed, R, Mehra, M, Kirshblum, S, Maier, D, Lammertse, D, Blight, A, et al. Spinal cord ability ruler: an interval scale to measure volitional performance after spinal cord injury. Spinal Cord. 2017; 55:730–38. Anderson, K, Aito, S, Atkins, M, Biering-Sorenson, F, Charlifue, S, Curt, A, et al. Functional recovery measures for spinal cord injury: an evidence based review for clinical practice and research. J Spinal Cord Med. 2008; 31:133–144. Macdermid JC, Law M, Michlovitz SL. Outcome measurement in evidence based rehabilitation. In: Law M, Macdermid J (eds). Evidence based Rehabilitation: A guide to practice (3rd edition). Slack Incorporated; 2014. pp. 65–104. Saberi, H, Vosoughi, F, Derakhshanrad, N, Yekaninejad, M, Khan, ZH, Kohan, AH, et al. Development of Persian version of the spinal cord independence measure III assessed by interview: a psychometric study. Spinal Cord. 2018; 56(10):980–986. Itzkovich, M, Shefler, H, Front, L, Gur-Pollack, R, Elkayam, K, Bluvshtein, V, et al. SCIM III (Spinal Cord Independence Measure version III): reliability of assessment by interview and comparison with assessment by observation. Spinal Cord. 2017; 56(1):46–51. Itzkovich, M, Tamir, A, Philo, O, Steinberg, F, Ronen, J, Spasser, R, et al. Reliability of the Catz-Itzkovich spinal cord independence measure assessment by interview and comparison with observation. Am J Phys Med Rehabil. 2003; 82(4):267–272. Hasson, F, Keeney, S, Mckenna, H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000; 32(4):1008–1015. Meshkat, B, Cowman, S, Gethin, G, Ryan, K, Wiley, M, Brick, A, et al. Using an e-Delphi technique in achieving consensus across disciplines for developing bets practice in a day surgery in Ireland. J Hosp Adm. 2014; 3(4):1–8. Niederberger, M, Spranger, J. Delphi technique in health sciences: a map. Frontiers in Public Health. 2020; https://doi.org/10.3389/fpubh.2020.00457 . Murphy, MK, Black, NA, Lamping, DL, McKee, CM, Sanderson, CF, Askham J, et al. Consensus development methods, and their use in clinical guideline development. Health Technology Assessment. 1998; 2(3):i-iv, 1–88. Green, B, Jones, M, Hughes, D, Willimas, A. Applying the Delphi technique in a study of GP's information requirements. Health Soc Care Community. 1999; 7(3):198–205. Emmel, N. Purposeful sampling. In: Sampling and choosing cases in qualitative research: a realist approach. SAGE Publications Ltd; 2013. pp 33–44. Morgan, D. Snowball sampling. In: Given L, (ed). The SAGE Encyclopedia of Qualitative Research Methods. SAGE Publications Inc., Thousand Oaks; 2008. pp 816–817. Mowbray, CT, Holter, MC, Teague, GB, Bybee, D. Fidelity criteria: Development, measurement, and validation. Am J Eval. 2003; 24(4):315–340. Walton, H, Spector, A, Williamson, M, Tombar, I, Michie, S. Developing quality fidelity and engagement measures for complex health interventions. Br J Health Psychol. 2020; 25(1):39–60. Spell, LA, Richardson, JD, Basilakos, A, Stark, BC, Teklehaimanot, A, Hillis, AE, et al. Developing, implementing, and improving assessment and treatment fidelity in clinical aphasia research. Am J Speech-Lang Pathol. 2020; 29:286–298. Reed, DK, Sturges, KM. An examination of assessment fidelity in the administration and interpretation of reading tests. Remedial Spec Educ. 2012; 34(5):259–268. Novick, DG, Ward, K. Why don’t people read the manual. Departmental Papers. 2006; 15. Tables Tables 1 to 4 are available in the Supplementary Files section. Additional Declarations There is no duality of interest Supplementary Files SCIMIIIPaperSpinalCordTable1.xlsx SCIMIIIPaperSpinalCordTable2.xlsx SCIMIIIPaperSpinalCordTable3.xlsx SCIMIIIPaperSpinalCordTable4.xlsx Cite Share Download PDF Status: Published Journal Publication published 25 Mar, 2023 Read the published version in Spinal Cord → Version 1 posted Editorial decision: revise 30 Jan, 2023 Review # 1 received at journal 26 Jan, 2023 Reviewer # 1 agreed at journal 26 Jan, 2023 Reviewers invited by journal 25 Jan, 2023 Submission checks completed at journal 16 Nov, 2022 Editor assigned by journal 15 Nov, 2022 First submitted to journal 15 Nov, 2022 You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-2277985","acceptedTermsAndConditions":true,"allowDirectSubmit":false,"archivedVersions":[],"articleType":"Article","associatedPublications":[],"authors":[{"id":170745933,"identity":"6023639b-9940-49cb-8be1-f6f452158c01","order_by":0,"name":"Rachel Kim","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAA60lEQVRIie3NMUsDMRjG8fd4IFkiXXMg+BVyizoc9bOEg0ziUpAbcyivY1e/hos4WgKZTl2FDha6ujgKN2iHdszdKJj/9BKeHyHK5f5kgsLQ1iCsNvsnM0aKjeodSDSH5SiBOboNNJ2c3TunS/8mZwLFth3qK5I3jzpFjvsYdfW0RslA9cJuQSpeJ4mWd6xtv4b5WMay88F6fXmaJpCsV/yKiwj57YdfcvI5QiSHquNnGAFReLH7RY0QFe2W+gY6AmXHzrJyi/Mk0c4EaufNjFF8+aG2Sxke3lNkX3O4xJT5rvnUYS6Xy/3DfgAruURY415NbAAAAABJRU5ErkJggg==","orcid":"","institution":"Thomas Jefferson University","correspondingAuthor":true,"submittingAuthor":false,"prefix":"","firstName":"Rachel","middleName":"","lastName":"Kim","suffix":""},{"id":170745934,"identity":"b73f8d80-7ace-48e9-b4de-8ba88d2b2faf","order_by":1,"name":"Christina Calhoun Thielen","email":"","orcid":"","institution":"Thomas Jefferson University","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Christina","middleName":"Calhoun","lastName":"Thielen","suffix":""},{"id":170745935,"identity":"0d023c91-7cd7-4880-b73e-884544c39ad8","order_by":2,"name":"Giulia Heydeman","email":"","orcid":"","institution":"","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Giulia","middleName":"","lastName":"Heydeman","suffix":""},{"id":170745936,"identity":"e26dfbbc-f37a-48b3-a2b0-43b89ff93b91","order_by":3,"name":"Mary Jane (MJ) Mulcahey","email":"","orcid":"https://orcid.org/0000-0002-0837-714X","institution":"Thomas Jefferson University","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Mary","middleName":"Jane (MJ)","lastName":"Mulcahey","suffix":""}],"badges":[],"createdAt":"2022-11-15 22:36:12","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-2277985/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-2277985/v1","draftVersion":[],"editorialEvents":[{"content":"https://doi.org/10.1038/s41393-023-00891-5","type":"published","date":"2023-03-25T04:00:00+00:00"}],"editorialNote":"","failedWorkflow":false,"files":[{"id":32215528,"identity":"64a2093f-d566-4d8d-9dff-ef033335f9f1","added_by":"auto","created_at":"2023-01-30 15:42:26","extension":"png","order_by":1,"title":"Figure 1","display":"","copyAsset":false,"role":"figure","size":67131,"visible":true,"origin":"","legend":"\u003cp\u003eSCIM-III development of standardized administration and scoring procedures for observation by performance and interview versions\u003c/p\u003e","description":"","filename":"Figure1SCIMMethodsFigure.png","url":"https://assets-eu.researchsquare.com/files/rs-2277985/v1/2fa4c93a627a5bd538c46f25.png"},{"id":34821522,"identity":"bc44142a-cb33-4fe4-84d4-35058df93c2c","added_by":"auto","created_at":"2023-03-26 07:08:36","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":533107,"visible":true,"origin":"","legend":"","description":"","filename":"manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-2277985/v1/5ced1c67-8c2d-402b-8d4f-ab660d1b2ee5.pdf"},{"id":32216535,"identity":"ff365c88-aa14-4b82-b9e8-ca585ce5f8fe","added_by":"auto","created_at":"2023-01-30 15:50:26","extension":"xlsx","order_by":1,"title":"","display":"","copyAsset":false,"role":"supplement","size":14456,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cbr\u003e\u003c/p\u003e","description":"","filename":"SCIMIIIPaperSpinalCordTable1.xlsx","url":"https://assets-eu.researchsquare.com/files/rs-2277985/v1/a3604fdb4098fe61ad5def68.xlsx"},{"id":32215529,"identity":"b40b2d69-fcd9-483b-97b0-376042d19f59","added_by":"auto","created_at":"2023-01-30 15:42:26","extension":"xlsx","order_by":2,"title":"","display":"","copyAsset":false,"role":"supplement","size":11395,"visible":true,"origin":"","legend":"","description":"","filename":"SCIMIIIPaperSpinalCordTable2.xlsx","url":"https://assets-eu.researchsquare.com/files/rs-2277985/v1/c791907829c74990dca49909.xlsx"},{"id":32215530,"identity":"5424ee17-1b06-49ac-a6df-f252663830b7","added_by":"auto","created_at":"2023-01-30 15:42:26","extension":"xlsx","order_by":3,"title":"","display":"","copyAsset":false,"role":"supplement","size":10381,"visible":true,"origin":"","legend":"","description":"","filename":"SCIMIIIPaperSpinalCordTable3.xlsx","url":"https://assets-eu.researchsquare.com/files/rs-2277985/v1/bb54bcfb46a8396769b9f8d8.xlsx"},{"id":32215526,"identity":"ab74c146-6d8b-4fb8-9d4a-5df7bb7394d6","added_by":"auto","created_at":"2023-01-30 15:42:26","extension":"xlsx","order_by":4,"title":"","display":"","copyAsset":false,"role":"supplement","size":20583,"visible":true,"origin":"","legend":"","description":"","filename":"SCIMIIIPaperSpinalCordTable4.xlsx","url":"https://assets-eu.researchsquare.com/files/rs-2277985/v1/06c3d6376375de6c75a2051c.xlsx"}],"financialInterests":"There is no duality of interest","formattedTitle":"Standardized administration and scoring guidelines for the Spinal Cord Independence Measure Version 3.0 (SCIM-III)","fulltext":[{"header":"Introduction","content":"\u003cp\u003eThe Spinal Cord Independence Measure (SCIM-III) evaluates the level of independence and ability of individuals with spinal cord injury (SCI) to perform routine daily tasks [\u003cspan citationid=\"CR1\" class=\"CitationRef\"\u003e1\u003c/span\u003e, \u003cspan citationid=\"CR2\" class=\"CitationRef\"\u003e2\u003c/span\u003e]. It is comprised of 19 items in three domains: self-care (6 items), respiration and sphincter management (4 items), and mobility (9 items) [\u003cspan citationid=\"CR3\" class=\"CitationRef\"\u003e3\u003c/span\u003e]. Each domain is scored on an ordinal scale based on the clinical relevance and importance for individuals with SCI [\u003cspan citationid=\"CR3\" class=\"CitationRef\"\u003e3\u003c/span\u003e, \u003cspan citationid=\"CR4\" class=\"CitationRef\"\u003e4\u003c/span\u003e]. Scoring accounts for the amount of assistance provided by another person and use of adaptive equipment by assigning higher scores for less assistance or aids [\u003cspan citationid=\"CR5\" class=\"CitationRef\"\u003e5\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eSince its introduction in 1997, the SCIM-III has been frequently used in SCI clinical trials. Three large-scale adult studies [\u003cspan citationid=\"CR6\" class=\"CitationRef\"\u003e6\u003c/span\u003e, \u003cspan citationid=\"CR7\" class=\"CitationRef\"\u003e7\u003c/span\u003e, \u003cspan citationid=\"CR8\" class=\"CitationRef\"\u003e8\u003c/span\u003e] evaluated the validity and reliability of the SCIM-III as a functional recovery instrument and established moderate-to-strong reliability and validity. Additional work examined clinically important differences in SCIM-III scores [\u003cspan citationid=\"CR9\" class=\"CitationRef\"\u003e9\u003c/span\u003e], established target values for SCIM-III for neurological levels in complete SCI [\u003cspan citationid=\"CR10\" class=\"CitationRef\"\u003e10\u003c/span\u003e], and developed and validated a self-report version [\u003cspan citationid=\"CR11\" class=\"CitationRef\"\u003e11\u003c/span\u003e]. Most recently, scores from the ISNCSCI motor examination [\u003cspan citationid=\"CR12\" class=\"CitationRef\"\u003e12\u003c/span\u003e] and SCIM-III scores from select items have been used to develop the Spinal Cord Ability Ruler (SCAR) to enable longitudinal assessment of volitional performance on a linear metric from the time of injury [\u003cspan citationid=\"CR12\" class=\"CitationRef\"\u003e12\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eDespite its widespread use, standardized guidelines for administering and scoring the SCIM-III were never developed, which has led to variability in interpretation of scores [\u003cspan citationid=\"CR13\" class=\"CitationRef\"\u003e13\u003c/span\u003e] and feedback that administration and scoring descriptions are incomplete and unclear [\u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e]. Variability in administering and scoring standardized clinical outcome assessments, such as the SCIM-III [\u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e], has implications for clinical practice and clinical trials. Reimbursement, length of stay, and potential for over-estimating or under-estimating function are at risk. For clinical trials, variability in administration and scoring poses a threat to reliability within a single trial and limits the opportunity for comparison of outcomes and pooling of data across several trials. Lack of standardization can also impact test results and measurement properties [\u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e]. For performance-based measures, such as the SCIM-III, reliance on human raters to translate human motor performance into a metric underscores the importance for clear administration and scoring procedures.\u003c/p\u003e \u003cp\u003e Performance-based assessments involve having the participant perform certain movements or tasks, which allow for a direct assessment of the participant\u0026rsquo;s abilities. Although performance-based assessments may be more objective and potentially less biased than self-report and interview-based assessments, they are time-consuming and may not be feasible within all practice environments and clinical trial settings due to limited time and resources, such as equipment and appropriate environments for observation [\u003cspan citationid=\"CR15\" class=\"CitationRef\"\u003e15\u003c/span\u003e, \u003cspan citationid=\"CR16\" class=\"CitationRef\"\u003e16\u003c/span\u003e], and transportation challenges associated with returning to the clinical setting. Reliability of SCIM-III scores when obtained through self-report and interview are acceptable, and these modes of administration require less time (10\u0026ndash;15 minutes for interview compared to 30\u0026ndash;45 minutes by observation), allow for rapid data collection, and can be utilized across multiple settings [\u003cspan citationid=\"CR16\" class=\"CitationRef\"\u003e16\u003c/span\u003e, \u003cspan citationid=\"CR17\" class=\"CitationRef\"\u003e17\u003c/span\u003e]. Similarly, administration of the SCIM-III by interview may mitigate the amount of missing data in longitudinal studies.\u003c/p\u003e \u003cp\u003e When administrating the SCIM-III as a performance-based measure and as an interview, it is important to have guidelines that standardize administration and scoring of each item. Standardized guidelines would provide a safeguard for variability in item set-up, execution, scoring (performance-based administration), and in the structure and content of questions for each item (interview administration). Previous studies have recognized the need for better training in and standardization of administration and scoring of the SCIM-III [\u003cspan citationid=\"CR8\" class=\"CitationRef\"\u003e8\u003c/span\u003e, \u003cspan citationid=\"CR15\" class=\"CitationRef\"\u003e15\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eIn response to the need for standardization in administration and scoring of the SCIM-III, and in recognition of the serious limitations in SCI clinical outcome measures, we engaged experts in SCI practice and research to create standardized procedures for the SCIM-III when administered and scored as a performance-based measure and standardized procedures for the SCIM-III when administered and scored by interview.\u003c/p\u003e"},{"header":"Purpose","content":"\u003cp\u003eThe purpose of this study was to develop standardized administration and scoring procedures for the SCIM-III items when administered as a performance-based assessment and by interview. We sought to develop clearly written administration procedures that aligned with the intent of SCIM-III items and that were feasible to implement in practice environments and clinical trial settings. We also sought to develop procedures to aid in accurate scoring of SCIM-III items when administered as a performance-based measure and interview.\u003c/p\u003e"},{"header":"Methods","content":"\u003cp\u003eThe Modified Delphi Technique is an iterative process that uses a systematic progression of repeated rounds of surveys to allow for feedback and revisions as a way to build consensus among experts in areas and for purposes where knowledge is complex, incomplete or poorly understood [\u003cspan citationid=\"CR18\" class=\"CitationRef\"\u003e18\u003c/span\u003e, \u003cspan citationid=\"CR19\" class=\"CitationRef\"\u003e19\u003c/span\u003e]. The defining feature of the Modified Delphi is that the collated responses from previous questionnaires are integrated into each new questionnaire, and the experts being questioned are able to reconsider their previous judgments, revising and responding as appropriate [\u003cspan citationid=\"CR20\" class=\"CitationRef\"\u003e20\u003c/span\u003e]. In health care, the Modified Delphi Method has been used for a variety of purposes including the development of clinical practice guidelines. In this study, we used the Modified Delphi to engage SCI clinicians and researchers for the purposes of developing standardized administration and scoring procedures for the SCIM-III.\u003c/p\u003e \u003cp\u003eAs shown in Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e, a multi-stage iterative process [\u003cspan citationid=\"CR19\" class=\"CitationRef\"\u003e19\u003c/span\u003e, \u003cspan citationid=\"CR21\" class=\"CitationRef\"\u003e21\u003c/span\u003e, \u003cspan citationid=\"CR22\" class=\"CitationRef\"\u003e22\u003c/span\u003e] (Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e) was used to create initial administration and scoring procedures for each SCIM-III item, garner feedback on clarity of wording of administration and scoring guidelines and on feasibility of administering SCIM-III performance-based items as specified and to reach consensus (80% agreement) among the experts that the administration and scoring were clearly written, aided in administration and scoring, and were feasible to execute. Two independent Modified Delphi processes were implemented. The first Modified Delphi focused on the developing guidelines for the SCIM-III for administration and scoring as a performance-based measure (March 2020-May 2020), and the second Modified Delphi process was undertaken to develop guidelines for the SCIM-III for administration by interview (February 2021-March 2021). The two-staged approach was used to mitigate confusion about mode of administration.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003eAs shown in Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e, an initial set of administration and scoring guidelines were established based on the SCIM-III literature and SCIM-III experience and were used as the basis for the first survey.\u003c/p\u003e \u003cdiv id=\"Sec4\" class=\"Section2\"\u003e \u003ch2\u003eSurvey Development\u003c/h2\u003e \u003cp\u003eAs a starting point, initial administration and scoring procedures for each SCIM-III mobility and self-care item were developed for performance-based standardization. These procedures were slightly revised for SCIM-III mobility and self-care items for interview, and initial procedures for respiration and sphincter were created (we did not include respiration or sphincter in the performance-based guidelines) (Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e).\u003c/p\u003e \u003cp\u003eSpecifically, for each SCIM-III mobility and self-care item, an explicit administration and scoring procedure was provided followed by four \u0026ldquo;yes/no\u0026rdquo; questions: 1. Are the (administration) instructions clear? 2. Could you replicate this in your clinic? 3. Are the scoring instructions clear? 4. Would you be able to determine a SCIM-III score? This resulted in a total of 60 questions for the first survey for the Modified Delphi Process for performance-based standardization (15 SCIM-III mobility\\self-care items X 4 \u0026ldquo;yes/no questions per item). Only two \u0026ldquo;yes/no\u0026rdquo; questions were asked for each SCIM-III item for interview standardization: 1. Are the interview prompts clear? 2. Could you replicate this in your clinic? Thus, for the first survey for the Modified Delphi process for interview standardization, there were 38 questions (19 SCIM-III items X 2 \u0026ldquo;yes/no\u0026rdquo; questions per item). Survey respondents were asked to answer each yes\\no question, provide a rationale for a response of \u0026ldquo;no\u0026rdquo;, and suggest alternatives to the content or wording to improve clarity, consistency, and standardization.\u003c/p\u003e \u003cp\u003e Consistent with Modified Delphi Methodology, subsequent surveys contained revised procedure guidelines based on expert input and the same \u0026ldquo;yes/no\u0026rdquo; questions. Surveys were completed anonymously and remained open for two-weeks for each iterative round, with an e-mail reminder after one week to boost response rate. A statement of consent was provided in the email invitation.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec5\" class=\"Section2\"\u003e \u003ch2\u003eSurvey Respondents\u003c/h2\u003e \u003cp\u003ePurposeful [\u003cspan citationid=\"CR23\" class=\"CitationRef\"\u003e23\u003c/span\u003e] and snowball [\u003cspan citationid=\"CR24\" class=\"CitationRef\"\u003e24\u003c/span\u003e] sampling were used to recruit survey participants. Purposeful sampling was done by e-mailing an invitation to content experts known to the principal investigator with a description of the study purpose and a link to the survey. Content experts were asked to forward the e-mail invitation to their colleagues who work with the SCI population (snowball sampling).\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec6\" class=\"Section2\"\u003e \u003ch2\u003eData Analysis\u003c/h2\u003e \u003cp\u003eSummary and descriptive statistics were used to assess percent agreement of survey responses. For yes-no questions that had at least 80% response rate of \u0026ldquo;yes\u0026rdquo;, procedures were considered clearly written and feasible to implement in usual practice and clinical trial environments. For yes-no questions that did not reach 80% response rate of \u0026ldquo;yes\u0026rdquo;, procedures were revised based on respondents\u0026rsquo; feedback and exposed to subsequent survey rounds until 80% agreement was achieved. Once 80% agreement was obtained for each question for each SCIM-III item, administration and scoring guidelines for performance-based administration and for administration by interview were formatted and prepared for widespread dissemination.\u003c/p\u003e \u003cp\u003e This study was approved by the Institutional Review Board.\u003c/p\u003e \u003c/div\u003e"},{"header":"Results","content":"\u003cp\u003eAs shown in Table\u0026nbsp;1, the majority of respondents were physical and occupational therapists, had over 10 years of SCI experience, and used the SCIM-III, primarily in rehabilitation and research settings. The majority of respondents reported administering the SCIM-III using a combination of observing performance and interview.\u003c/p\u003e \u003cp\u003eThree iterative rounds of the performance-based survey were required to reach 80% agreement for each of the four questions for each SCIM-III self-care and mobility items (Table\u0026nbsp;2). Two iterative rounds of the interview survey were required to reach 80% agreement for all items (Table\u0026nbsp;3).\u003c/p\u003e \u003cdiv id=\"Sec8\" class=\"Section2\"\u003e \u003ch2\u003eModified Delphi Process for Standardization of Procedures for Administration and Scoring by Performance-based Measure\u003c/h2\u003e \u003cp\u003eTable\u0026nbsp;2 shows the response rate of \u0026ldquo;Yes\u0026rdquo; to each of the four questions asked for the mobility and self-care items in the Modified Delphi process for standardization for the performance-based measure. As shown in the first survey, the response of \u0026ldquo;yes\u0026rdquo; for the administration procedures for 6 items and for the scoring procedures for 8 items was obtained in at least 80% of respondents. For the remaining questions (n\u0026thinsp;=\u0026thinsp;36) that did not reach 80% response of \u0026ldquo;yes\u0026rdquo;, feedback from respondents (Table\u0026nbsp;4) was used to revise the administration and scoring procedures, and these items were exposed to expert opinion and feedback in survey. As shown in Table\u0026nbsp;2, with the exception of the two questions asked for scoring procedures for one item (Mobility in Bed and Action to Prevent Pressure Injuries), survey 2 obtained at least an 80% response rate of \u0026ldquo;yes\u0026rdquo; for every question for each item. Respondent feedback was used to revise the scoring procedures for the Mobility in Bed and Action to Prevent Pressure Injuries (Table\u0026nbsp;4), and the item was again exposed to expert opinion and feedback in a third survey.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec9\" class=\"Section2\"\u003e \u003ch2\u003eModified Delphi Process for Standardization of Procedures for Administration and Scoring by Interview\u003c/h2\u003e \u003cp\u003eTable\u0026nbsp;3 shows the response rate of \u0026ldquo;Yes\u0026rdquo; for each of the two questions asked for each of the SCIM IIII items in the Modified Delphi process for standardization for interview. As shown in the first survey, the response rate of \u0026ldquo;yes\u0026rdquo; for the questions, \u0026ldquo;are the interview prompts clear?\u0026rdquo; and \u0026ldquo;could you replicate this in your clinic?\u0026rdquo;, were at least 80% for 13 items and for 16 items, respectively. For the items that did not reach 80% response rate for either question, feedback from survey 1 (Table\u0026nbsp;4) was used to revise the administration and scoring procedures, which were exposed to expert review in the second survey. Of note, although the 80% threshold was reached for two items (use of toilet; transfer from wheelchair to toilet/tub), administration and scoring were revised based on survey 1 feedback (Table\u0026nbsp;4) and included in the second survey. As shown in Table\u0026nbsp;3, an 80% or greater response rate of yes was obtained for each SCIM-III item.\u003c/p\u003e \u003c/div\u003e"},{"header":"Discussion","content":"\u003cp\u003eIn this study, a Modified Delphi Technique was used to iteratively obtain feedback and establish consensus among experts on the standardization of administration and scoring procedures for the SCIM-III when administered as a performance-based measure and as an interview. Owing to the widespread use of the SCIM-III in practice and research and the concerns about the lack of available standardized procedures for administration and scoring, we established procedural guidelines that are clear, mitigate variability, accessible, and that are feasible to implement in practice and research settings.\u003c/p\u003e \u003cp\u003eThe inherent lack of guidance of the existing SCIM-III leaves it open to interpretation and variability. Given the potential variability in performance-based outcome measures, it is important to establish fidelity in administration and scoring to assess whether or not an individual implements an evaluation as intended [\u003cspan citationid=\"CR25\" class=\"CitationRef\"\u003e25\u003c/span\u003e, \u003cspan citationid=\"CR26\" class=\"CitationRef\"\u003e26\u003c/span\u003e]. In a clinical trial setting, when administering outcome measures with different administration and scoring procedures, fidelity is essential to prevent \u0026ldquo;rater drift and contamination\u0026rdquo; [\u003cspan citationid=\"CR27\" class=\"CitationRef\"\u003e27\u003c/span\u003e]. This is significant considering the reliability and validity of a measure are \u0026ldquo;dependent on the consistency with which it can be administered, scored, and interpreted\u0026rdquo; [\u003cspan citationid=\"CR28\" class=\"CitationRef\"\u003e28\u003c/span\u003e]. Moreover, because users of clinical outcome measures frequently do not read clinical outcome measures users\u0026rsquo; manuals [\u003cspan citationid=\"CR29\" class=\"CitationRef\"\u003e29\u003c/span\u003e], we created scoring flow diagrams that are intuitive and allow for low burden and accurate scoring.\u003c/p\u003e \u003cp\u003eWhile we did not collect information on geographical location of the respondents, purposeful sampling included distribution of the email invitation to international experts. One plausible reason for not reaching the 80% threshold in the first surveys is due to regional variations in English lexicon. Certain terms such as \u0026ldquo;electric aide\u0026rdquo;, \u0026ldquo;durable medical equipment\u0026rdquo; and \u0026ldquo;tick\u0026rdquo; seemed to be relevant for some regions and not for others. Medical jargon and use of abbreviations also likely contributed to responses of \u0026ldquo;no\u0026rdquo; for some items. Specifically, the definitions for durable medical equipment, adaptive devices, specific setting, total partial assistance, and partial assistance were created, as respondents identified these terms as being too complex or \u0026ldquo;technical\u0026rdquo; for use in SCIM-III interview. As such, the procedure manuals include an abbreviation list and glossary of terms with definitions to decrease areas of potential confusion and to make the measure easier to use for those with limited experience with SCIM-III. Gender-specific pronouns were removed to be more inclusive of all gender identities.\u003c/p\u003e \u003cp\u003eSurvey responses and feedback led to revision of administration and scoring procedures for the SCIM-III items, resulting in standardized and clearly written administration and scoring procedures for the SCIM-III. The methodology did not alter any established SCIM-III item or scoring criteria [\u003cspan citationid=\"CR1\" class=\"CitationRef\"\u003e1\u003c/span\u003e, \u003cspan citationid=\"CR3\" class=\"CitationRef\"\u003e3\u003c/span\u003e, \u003cspan citationid=\"CR5\" class=\"CitationRef\"\u003e5\u003c/span\u003e, \u003cspan citationid=\"CR6\" class=\"CitationRef\"\u003e6\u003c/span\u003e]. Our intent was to maintain the SCIM-III as it was developed and make no changes to items or scoring. Several respondents reported concerns with the inconsistent scoring scale; meaning sometimes scoring is 0\u0026ndash;2 while for other items it is 0\u0026ndash;8. It was important to state that the scoring is directly from the original SCIM-III, and our team did not feel it within the scope of our work to revise the scoring structure. Our work focused entirely on providing clear and specific instructions for administering and scoring SCIM-III items via performance-based measure and individual interview, with the goal to provide the field with a resource to assess endpoints of usual care and clinical trials.\u003c/p\u003e \u003cdiv id=\"Sec11\" class=\"Section2\"\u003e \u003ch2\u003ePerformance-Based Version\u003c/h2\u003e \u003cp\u003eAn introduction and general instructions for the survey and SCIM-III performance-based procedures were necessary to provide background information and decrease administrator burden when completing the survey and administering this version of the SCIM-III. Respondents of the performance-based survey were instructed to review both the written instructions and scoring flowsheets prior to answering survey questions since these were developed to be used in conjunction with each other for each SCIM-III item. In both versions, the starting prompt of each flowsheet was moved towards the top-left corner and the final scores, which were made rectangular and blue to differentiate from the rest of the flowsheet, were organized in numerical order and placed on either the right or bottom of the flowsheet.\u003c/p\u003e \u003cp\u003eAdministration and scoring procedures were not developed for the respiration and sphincter management subscale of the SCIM-III. This portion was excluded in the performance-based procedures because of the inability to adequately demonstrate and assess respiratory elements with a performance measure. Additionally, having participants demonstrate their bowel and bladder program would be an undue burden. In contrast, the self-care and mobility portions were included because clinical trials are more focused on mobility and upper extremity function, which are more directly related to those sections. Moreover, in the rehabilitation setting, it is frequently the occupational and physical therapists who use the SCIM-III; therefore, if transformed into a performance measure, the self-care and mobility portions would be assessed be an occupational or physical therapist.\u003c/p\u003e \u003cp\u003eInitial administration procedures gave examples of items that could be used or tasks to perform. However, survey respondents reported that the initial examples were not specific enough and the expectation was still unclear. For example, the administration procedures for the dressing item included \u0026ldquo;raise arms\u0026rdquo;. In round 2, it was revised to \u0026ldquo;touch the back of your head\u0026rdquo;. This created clear expectations for both the participant and administrator. We further needed to develop a list of recommended materials to be used for each item, adding to the standardization of our manual. This list included items such as an 8oz sandwich container, 12oz plastic cup, and a reusable metal knife and fork.\u003c/p\u003e \u003cp\u003eWhen standardizing administration procedures for dressing and bathing items, only a few specific tasks were selected to reduce time and participant and administrator burden. For example, for bathing, two body parts were selected to mimic upper body (non-dominant arm and low back) and lower body bathing (perineal area and dominant lower leg). The parts of the task that were selected were ones that incorporated most of the task or the more challenging aspects of the task. It was necessary to limit the task in this manner for the sake of time and clinical usability.\u003c/p\u003e \u003cp\u003eLastly, modifications were made to all scoring procedures to increase flow and clarity. Although many of the scoring procedures obtained above 80% agreement in round 1, it was determined that it would be beneficial to apply the changes made to those with below 80% agreement to all flowsheets. The flowsheets were simplified and made as consistent as possible to ease administrator burden. They were then re-submitted in round 2 for review. After round 2, only 1 item required further revisions. This item was revised per the respondent\u0026rsquo;s comments and submitted into a third and final round.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec12\" class=\"Section2\"\u003e \u003ch2\u003eInterview Version\u003c/h2\u003e \u003cp\u003eAn introduction was provided at the start of the round 2 survey to address some of the feedback provided in round 1. Participants provided comments that aligned with many of the limitations of the original SCIM-III such as the vagueness of core tasks, use of medical jargon and abbreviations, and the overall lack of accessibility of the measure to the patient population.\u003c/p\u003e \u003cp\u003eThe original SCIM-III is not inclusive of all scenarios that individuals with SCI may participate in. To clarify the intent to retain fidelity to the original SCIM-III in terms of content, a general statement was made that: \u0026ldquo;Not every case/scenario may be captured in these flowsheets\u0026hellip; Despite being an appropriate consideration for persons with SCI, some conditions and situations were not represented in the interview flowsheets in order to adhere to the original SCIM-III guidelines.\u0026rdquo; One respondent emphasized that a person could perform a pressure relief in a wheelchair in more ways than just \u0026ldquo;doing push-ups in wheelchair,\u0026rdquo; which is the only consideration in the original SCIM-III scoring criteria. These comments were reasoned to be issues and limitations with the original SCIM-III form and not necessarily with the interview flowsheets.\u003c/p\u003e \u003cp\u003eIn developing the interview version, participants in round 1 provided feedback that the flowsheets were not intuitively organized and therefore the decision was made to alter the formatting and change the colors and shapes shown on the flowsheets. The shape of the initial prompt was changed to a circle and moved to the top of each flowsheet, making it apparent for administrators where to begin the sequence of prompts. The shape change also set the initial prompt apart from the subsequent diamond-shaped prompts. A sample flowsheet with these changes was provided in the beginning of the round 2 survey with instructions on how to navigate the flowsheets.\u003c/p\u003e \u003cp\u003e Instead of focusing on the positioning of the individual during the bathing and dressing items, the prompts in the flowsheets were altered to be more consistent with the scoring guidelines which emphasize level of assistance provided, use of adaptive devices, and/or the use of specific settings to facilitate completion. In many cases, small modifications to prompts resulted in less prompts on the flowsheets overall, reducing the complexity of scoring and increasing ease of use of the interview format compared to the original SCIM-III. As indicated by 80% agreement on all the SCIM-III flowsheets in the round 2 survey, structural changes allowed for a conciseness of language in subsequent prompts and a clearer path through the flowsheets, decreasing the burden of administration and scoring. Standardizing the interview prompts while retaining fidelity to the original SCIM-III form makes the SCIM-III more accessible not only to those administering the assessment, but also to the individuals.\u003c/p\u003e \u003c/div\u003e"},{"header":"Limitations","content":"\u003cp\u003eA limitation in this study is our sampling methods. By utilizing purposeful and snowball sampling with health professionals and researchers known the principal investigator, we may have limited the experience, practice settings, and familiarity with up-to-date practice recommendations of the participant pool. Moreover, the content experts selected are heavily involved in the SCI community, actively participate in SCI associations and their annual meetings, and engage in research and other educational opportunities. It is important to note that there are many health professionals and researchers who work with SCI populations but may not be included because they are not known to our PI. Moreover, because responses were not forced, not all survey participants responded to every question.\u003c/p\u003e \u003cp\u003eDropout was evident in the interview survey between round 1 and round 2 where the response rate decreased by 15 total participants. Round 2 of the interview survey had fewer questions (N\u0026thinsp;=\u0026thinsp;26) (9 SCIM-III items X 2 \u0026ldquo;yes/no\u0026rdquo; questions per item; 5 demographic questions; 3 SCIM-III-related questions) than round 1 (N\u0026thinsp;=\u0026thinsp;38). There are a few factors that may have caused dropout. One possible reason is over-sampling. Despite the year gap between surveys, by using the same participant pool, individuals may have felt burdened by completing multiple surveys. Another reason may have been technical issues with accessing the survey link.\u003c/p\u003e"},{"header":"Future Directions","content":"\u003cp\u003eIn the performance-based survey, the questions regarding respondents\u0026rsquo; level of experience with the SCIM-III revealed that while majority had experience with the SCIM-III (65\u0026ndash;75%), about 6.5\u0026ndash;14.7% used the SCIM-III as a performance measure alone. Most respondents reported using the SCIM-III as a combination of both the performance and interview/self-report (56\u0026ndash;67%). In the interview survey, 58.3\u0026ndash;75.0% of participants were familiar with the SCIM-III. Of those individuals, 11.1\u0026ndash;25.0% reported they use the SCIM-III as interview in their practice and 22.2\u0026ndash;41.7% used the SCIM-III as performance measure alone. Approximately 33.3\u0026ndash;66.7% reported to using the SCIM-III as a combination of a performance measure and interview/self-report. Based on these findings, it may be beneficial to compare the two distinct measures developed here to the original SCIM-III for accuracy and reliability.\u003c/p\u003e"},{"header":"Conclusion","content":"\u003cp\u003eStandardized administration and scoring procedures for both the performance-based and interview formats of the SCIM-III have been developed, and consensus on their clarity and feasibility established, and may be a useful resource for clinical trial programs and practice environments. They are available for download at no cost from the Jefferson College of Rehabilitation Sciences Center for Outcomes and Measurement website (\u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://www.jefferson.edu/university/rehabilitation-sciences/departments/outcomes-measurement/measures-assessments/spinal-cord-independence-measure-version-iii-administration-and-scoring-guidelines.html\u003c/span\u003e\u003cspan address=\"https://www.jefferson.edu/university/rehabilitation-sciences/departments/outcomes-measurement/measures-assessments/spinal-cord-independence-measure-version-iii-administration-and-scoring-guidelines.html\" targettype=\"URL\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e).\u003c/p\u003e"},{"header":"Abbreviations","content":"\u003cp\u003eSCIM-III\u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;\u0026nbsp;Spinal Cord Independence Measure Version 3.0\u003c/p\u003e\n\u003cp\u003eSCI \u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp; \u0026nbsp;spinal cord injury\u003c/p\u003e"},{"header":"Declarations","content":"\u003cp\u003e\u003cstrong\u003eAcknowledgements\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eWe acknowledge Isa A. McClure, MAPT, Kessler Institute for Rehabilitation and Rebecca Martin, OTD, Kennedy Krieger Institute, Johns Hopkins University School of Medicine for their contributions in the development of the standardized administration and scoring procedures. We further acknowledge our study respondents who participated in the surveys unnamed. Their expertise greatly informed the development of the SCIM-III standardized administration and scoring procedures.\u0026nbsp;\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eData Availability Statement\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eAll data generated or analyzed during this study are included in this published article [and its supplementary information files]. As stated in our conclusions, the completed guidelines resulting from this study are available on the Center for Outcomes and Measurement website, https://www.jefferson.edu/academics/colleges-schools-institutes/rehabilitation-sciences/departments/outcomes-measurement/measures-assessments/spinal-corde-independence-measure-v3.html.\u0026nbsp;\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003e\u003cbr\u003e\u0026nbsp;Author Contribution Statement\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eRYK was responsible for leading data collection and analysis of Delphi for SCIM performance-based assessment, developing Delphi surveys for interview assessment, and leading the writing of the manuscript.\u0026nbsp;\u003c/p\u003e\n\u003cp\u003eCCT contributed by assisting in developing Delphi surveys for performance-based and interview assessment, collecting and analyzing data, and writing the manuscript.\u003c/p\u003e\n\u003cp\u003eGH led the data collection and analysis of Delphi for SCIM interview assessment and assisted with writing the interview assessment portions of the manuscript.\u003c/p\u003e\n\u003cp\u003eMJM was responsible for the conceptual design of the study, leading the development of the Delphi surveys, assisting in data analysis, and an equal in writing of the manuscript.\u0026nbsp;\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eFunding\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThis study was funded by departmental funds from the Department of Occupational Therapist in the Jefferson College of Rehabilitation Sciences in Thomas Jefferson University.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eEthical Approval\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThis study was reviewed and approved by the Institutional Review Board (IRB),\u0026nbsp;\u003c/p\u003e\n\u003cp\u003e\u0026ldquo;Spinal Cord Independence Measure, Version III (SCIM-III) Procedure Development: A Modified Delphi Survey\u0026rdquo; (Departmental)Control #20E.150.\u0026nbsp;We certify that all applicable institutional and governmental regulations concerning the ethical use of human volunteers/animals were followed during the course of this research.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eCompeting Interests\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThe authors declare that there is no conflict of interest.\u003c/p\u003e"},{"header":"References","content":"\u003col\u003e\u003cli\u003e\u003cspan\u003eCatz, A, Itzkovich, M, Steinberg, F, Philo, O, Ring, H, Ronen, J, et al. The Catz-Itzkovich SCIM: a revised version of the spinal cord independence measure. Disabil Rehabil. 2001; 23:263\u0026ndash;268.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eDe Almeida, C, Coelho, JN, Riberto, M. Applicability, validation and reproducibility of the spinal cord independence measure version III (SCIM III) in patients with non-traumatic spinal cord lesions. Disabil Rehabil. 2016; 38(22):2229\u0026ndash;2234.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eCatz, A, Itzkovich, M, Agranov, E, Ring, H, Tamir, A. SCIM-spinal cord independence measure: a new disability scale for patients with spinal cord lesions. Spinal Cord. 1997; 35(12):850\u0026ndash;856.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAckerman, P, Morrison, SA, McDowell, S, Vazquez, L. Using the spinal cord independence measure III to measure functional recovery in a post-acute spinal cord injury program. Spinal Cord. 2010; 48:380\u0026ndash;387.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eCatz, A, Itzkovich, M, Tesio, L, Biering-Sorenson, F, Weeks, C, Laramee, MT, et al. A multi-center international study on the spinal cord independence measure, version III: Rasch psychometric validation. Spinal Cord. 2007; 45:275\u0026ndash;291.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eItzkovich, M, Gelernter, I, Biering-Sorenson, F, Weeks, C, Laramee, MT, Craven, BC, et al. The spinal cord independence measure (SCIM) version III: reliability and validity in a multi-center international study. Disabil Rehabil. 2007; 29(24):1926\u0026ndash;1933.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eBluvshtein, V, Front, L, Itzkovich, M, Aidinoff, E, Gelernter, I, Hart, J, et al. SCIM III is reliable and valid in a separate analysis for traumatic spinal cord lesions. Spinal Cord. 2011; 49(2):292\u0026ndash;296.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAnderson, KD, Acuff, ME, Arp, BG, Backus, D, Chun, S, Fisher, K, et al. United States (US) multi-center study to assess the validity and reliability of the spinal cord independence measure (SCIM III). Spinal Cord. 2011; 49:88\u0026ndash;885.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eScivolette, G, Tamburella, F, Laurenza, L, Molinari, M. The spinal cord independence measure: how much change is clinically significant for spinal cord injury subjects. Disabil Rehabil. 2013; 35(21):1808\u0026ndash;1813.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAidinoff, E, Front, L, Itzkovich, M, Bluvshtein, V, Gelernter, I, Hart, J, et al. Expected spinal cord independence measure, third version, scores for various neurological levels after complete spinal cord lesions. Spinal Cord. 2011; 49(8):893\u0026ndash;896.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eFekete, C, Eriks-Hoogland, I, Baumberger, M, Catz, A, Itzkovich, M, Luthi, H, et al. Development and validation of a self-report version of the spinal independence measure (SCIM III). Spinal Cord. 2013; 51:40\u0026ndash;47.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eReed, R, Mehra, M, Kirshblum, S, Maier, D, Lammertse, D, Blight, A, et al. Spinal cord ability ruler: an interval scale to measure volitional performance after spinal cord injury. Spinal Cord. 2017; 55:730\u0026ndash;38.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAnderson, K, Aito, S, Atkins, M, Biering-Sorenson, F, Charlifue, S, Curt, A, et al. Functional recovery measures for spinal cord injury: an evidence based review for clinical practice and research. J Spinal Cord Med. 2008; 31:133\u0026ndash;144.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eMacdermid JC, Law M, Michlovitz SL. Outcome measurement in evidence based rehabilitation. In: Law M, Macdermid J (eds). Evidence based Rehabilitation: A guide to practice (3rd edition). Slack Incorporated; 2014. pp.\u0026nbsp;65\u0026ndash;104.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eSaberi, H, Vosoughi, F, Derakhshanrad, N, Yekaninejad, M, Khan, ZH, Kohan, AH, et al. Development of Persian version of the spinal cord independence measure III assessed by interview: a psychometric study. Spinal Cord. 2018; 56(10):980\u0026ndash;986.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eItzkovich, M, Shefler, H, Front, L, Gur-Pollack, R, Elkayam, K, Bluvshtein, V, et al. SCIM III (Spinal Cord Independence Measure version III): reliability of assessment by interview and comparison with assessment by observation. Spinal Cord. 2017; 56(1):46\u0026ndash;51.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eItzkovich, M, Tamir, A, Philo, O, Steinberg, F, Ronen, J, Spasser, R, et al. Reliability of the Catz-Itzkovich spinal cord independence measure assessment by interview and comparison with observation. Am J Phys Med Rehabil. 2003; 82(4):267\u0026ndash;272.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHasson, F, Keeney, S, Mckenna, H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000; 32(4):1008\u0026ndash;1015.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eMeshkat, B, Cowman, S, Gethin, G, Ryan, K, Wiley, M, Brick, A, et al. Using an e-Delphi technique in achieving consensus across disciplines for developing bets practice in a day surgery in Ireland. J Hosp Adm. 2014; 3(4):1\u0026ndash;8.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eNiederberger, M, Spranger, J. Delphi technique in health sciences: a map. Frontiers in Public Health. 2020; \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://doi.org/10.3389/fpubh.2020.00457\u003c/span\u003e\u003cspan address=\"10.3389/fpubh.2020.00457\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eMurphy, MK, Black, NA, Lamping, DL, McKee, CM, Sanderson, CF, Askham J, et al. Consensus development methods, and their use in clinical guideline development. Health Technology Assessment. 1998; 2(3):i-iv, 1\u0026ndash;88.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eGreen, B, Jones, M, Hughes, D, Willimas, A. Applying the Delphi technique in a study of GP's information requirements. Health Soc Care Community. 1999; 7(3):198\u0026ndash;205.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eEmmel, N. Purposeful sampling. In: Sampling and choosing cases in qualitative research: a realist approach. SAGE Publications Ltd; 2013. pp\u0026nbsp;33\u0026ndash;44.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eMorgan, D. Snowball sampling. In: Given L, (ed). The SAGE Encyclopedia of Qualitative Research Methods. SAGE Publications Inc., Thousand Oaks; 2008. pp\u0026nbsp;816\u0026ndash;817.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eMowbray, CT, Holter, MC, Teague, GB, Bybee, D. Fidelity criteria: Development, measurement, and validation. Am J Eval. 2003; 24(4):315\u0026ndash;340.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eWalton, H, Spector, A, Williamson, M, Tombar, I, Michie, S. Developing quality fidelity and engagement measures for complex health interventions. Br J Health Psychol. 2020; 25(1):39\u0026ndash;60.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eSpell, LA, Richardson, JD, Basilakos, A, Stark, BC, Teklehaimanot, A, Hillis, AE, et al. Developing, implementing, and improving assessment and treatment fidelity in clinical aphasia research. Am J Speech-Lang Pathol. 2020; 29:286\u0026ndash;298.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eReed, DK, Sturges, KM. An examination of assessment fidelity in the administration and interpretation of reading tests. Remedial Spec Educ. 2012; 34(5):259\u0026ndash;268.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eNovick, DG, Ward, K. Why don\u0026rsquo;t people read the manual. Departmental Papers. 2006; 15.\u003c/span\u003e\u003c/li\u003e\u003c/ol\u003e"},{"header":"Tables","content":"\u003cp\u003eTables 1 to 4 are available in the Supplementary Files section.\u003c/p\u003e\n"}],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":true,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":false,"highlight":"","institution":"","isAcceptedByJournal":true,"isAuthorSuppliedPdf":false,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":false,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"spinal-cord","isNatureJournal":false,"hasQc":false,"allowDirectSubmit":false,"externalIdentity":"sc","sideBox":"Learn more about [Spinal Cord](http://www.nature.com/sc/)","snPcode":"41393","submissionUrl":"https://mts-sc.nature.com/cgi-bin/main.plex","title":"Spinal Cord","twitterHandle":"@journalsci","acdcEnabled":true,"dfaEnabled":true,"editorialSystem":"ejp","reportingPortfolio":"Nature AJ","inReviewEnabled":true,"inReviewRevisionsEnabled":false},"keywords":"","lastPublishedDoi":"10.21203/rs.3.rs-2277985/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-2277985/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003e\u003cem\u003eStudy Design: \u003c/em\u003eQualitative studies\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eObjective\u003c/em\u003e: To develop clear and specific administration and scoring procedures for the Spinal Cord Independence Measure Version 3.0 as a performance-based and interview assessment.\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eSetting: \u003c/em\u003eResearch lab\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eMethods\u003c/em\u003e: Modified Delphi Technique survey methods were used in this study. Previously developed SCIM-III administration and scoring procedures for performance-based and interview versions were presented to clinicians experienced in SCI and SCIM-III using the Qualtrix (Qualtrics, Provo, UT) online survey platform. Summary and descriptive statistics were used to assess the percent agreement survey responses.\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eResults\u003c/em\u003e: Three survey rounds were necessary to achieve 80% agreement or above for the performance-based version. Two survey rounds were necessary to achieve 80% agreement or above on the interview version.\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eConclusions\u003c/em\u003e: This study describes the development of standardized administration and scoring procedures for the self-care and mobility sub scales of the SCIM-III as a performance-based and interview version.\u003c/p\u003e","manuscriptTitle":"Standardized administration and scoring guidelines for the Spinal Cord Independence Measure Version 3.0 (SCIM-III)","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2023-01-30 15:42:21","doi":"10.21203/rs.3.rs-2277985/v1","editorialEvents":[{"type":"communityComments","content":0},{"type":"decision","content":"revise","date":"2023-01-30T11:07:08+00:00","index":"","fulltext":""},{"type":"editorInvitedReview","content":"This content is not available.","date":"2023-01-26T16:40:02+00:00","index":1,"fulltext":"This content is not available."},{"type":"reviewerAgreed","content":"This content is not available.","date":"2023-01-26T15:41:56+00:00","index":1,"fulltext":"This content is not available."},{"type":"reviewersInvited","content":"","date":"2023-01-25T21:03:58+00:00","index":"","fulltext":""},{"type":"checksComplete","content":"","date":"2022-11-16T14:19:32+00:00","index":"","fulltext":""},{"type":"editorAssigned","content":"","date":"2022-11-15T22:34:50+00:00","index":"","fulltext":""},{"type":"submitted","content":"Spinal Cord","date":"2022-11-15T22:34:49+00:00","index":"","fulltext":""}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"spinal-cord","isNatureJournal":false,"hasQc":false,"allowDirectSubmit":false,"externalIdentity":"sc","sideBox":"Learn more about [Spinal Cord](http://www.nature.com/sc/)","snPcode":"41393","submissionUrl":"https://mts-sc.nature.com/cgi-bin/main.plex","title":"Spinal Cord","twitterHandle":"@journalsci","acdcEnabled":true,"dfaEnabled":true,"editorialSystem":"ejp","reportingPortfolio":"Nature AJ","inReviewEnabled":true,"inReviewRevisionsEnabled":false}}],"origin":"","ownerIdentity":"5eb4622b-1a76-4087-9934-719ff99ce982","owner":[],"postedDate":"January 30th, 2023","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"published-in-journal","subjectAreas":[{"id":18706279,"name":"Health sciences/Medical research/Outcomes research"},{"id":18706280,"name":"Health sciences/Health care"}],"tags":[],"updatedAt":"2023-03-26T07:08:31+00:00","versionOfRecord":{"articleIdentity":"rs-2277985","link":"https://doi.org/10.1038/s41393-023-00891-5","journal":{"identity":"spinal-cord","isVorOnly":false,"title":"Spinal Cord"},"publishedOn":"2023-03-25 04:00:00","publishedOnDateReadable":"March 25th, 2023"},"versionCreatedAt":"2023-01-30 15:42:21","video":"","vorDoi":"10.1038/s41393-023-00891-5","vorDoiUrl":"https://doi.org/10.1038/s41393-023-00891-5","workflowStages":[]},"version":"v1","identity":"rs-2277985","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-2277985","identity":"rs-2277985","version":["v1"]},"buildId":"WrCJVZZCHTDjtuVLN7oU0","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}