Barriers and Facilitators to High-Volume Evidence-Based Innovation and Implementation in a Large, Community-Based Learning Health System

Barriers and Facilitators to High-Volume Evidence-Based Innovation and Implementation in a Large, Community-Based Learning Health System | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article Barriers and Facilitators to High-Volume Evidence-Based Innovation and Implementation in a Large, Community-Based Learning Health System Cimone Durojaiye, Stephanie Prausnitz, Jennifer L. Schneider, and 6 more This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-4618789/v1 This work is licensed under a CC BY 4.0 License Status: Published Journal Publication published 21 Nov, 2024 Read the published version in BMC Health Services Research → Version 1 posted 4 You are reading this latest preprint version Abstract Background Broad-scale, rapid health care change is critically needed to improve value-based, effective health care. Health care providers and systems need to address common barriers and facilitators across the evidence to implementation pathway, across diverse specialties. However, most evidence translation / implementation research evaluates single topic areas, and may be of limited value for informing comprehensive efforts. This project’s objective was to identify, characterize, and illustrate common trans-topic facilitators and barriers of translating new health care evidence results to clinical implementation across multiple medical specialties. Methods This study was an evaluation of all evidence-based innovation projects completed during 2019–2021. Each project was created with medical group clinical leaders and was intended to inform clinical care. The evaluation took place in a large community-based integrated health care system, and an embedded delivery science and applied research program. Clinical investigators, scientific investigators, and clinical operational leaders received structured questionnaires regarding barriers and facilitators for the operational implementation of new research findings for each project. Responses were mapped to the Consolidated Framework for Implementation Research to identify perceived implementation barriers and facilitators. Results All 48 projects completed between 2019–2021 were evaluated; responses were received for 45 (94%) and 34 had comments mappable to framework domains. Potential barriers and facilitators to clinical implementation of new research results were identified across all five framework domains and, within these, the 38 constructs or sub-constructs. Among 245 total comments, the most commonly cited facilitators were how the new research evidence generated compelled change (n = 29), specialty communication networks for disseminating results and initiating change (n = 20), leadership engagement in the project (n = 19), and the innovation’s relative advantage over existing practices (n = 11). The most commonly cited barriers were inadequate resource commitment for next-step implementation (n = 15), insufficient learning/implementation culture (n = 5), and insufficient individual-level willingness/ability for change (n = 5). Conclusions A novel large-scale evaluation of barriers and facilitators across the evidence to implementation pathway identified common factors across multiple topic areas and specialties. These common potentially replicable facilitators and modifiable barriers can focus health systems and leaders pursuing large-volume evidence-to-implementation initiatives on those areas with the likely greatest benefit-for-effort, for accelerating health care change. Implementation CFIR Learning Health System Barriers Facilitators Figures Figure 1 Figure 2 Figure 3 BACKGROUND The expeditious translation of evidence into clinical practice poses a substantial challenge to the United States health care system. 1 Broad-scale, rapid health care change is critical for improving value-based, effective health care and for enabling the evidence-to-implementation-to-evaluation continuum for large numbers of projects across multiple disciplines. 2 However, creating the infrastructure and systems to address this need, conceptualized by the Institute of Medicine’s seminal evidence-based medicine workshop, requires understanding which facilitators and barriers commonly impact this continuum across diverse health topics, specialties, and settings. 1, 3 National trends towards more integrated healthcare systems, including the development of Accountable Care Organizations, offers great potential for achieving this goal. 4 However, few studies of common facilitators and barriers of the evidence-to-implementation continuum across many topic types exist to inform such cross-cutting systems for high-volume, rapid change. Most in-depth implementation research is topic-based rather than system-based across multiple topics. Implementation research seeks to “adopt and integrate evidence-based health interventions into clinical and community settings for the improvement of patient outcomes and patient/provider experiences that benefit population health.” 5 Yet, traditional implementation studies usually provide an in-depth focus on a single subject in a specific setting or specialty. 6–10 While useful for the question of interest, single-topic studies may not identify systemic issues. 11 In contrast, evaluating themes across multiple projects, specialties, and medical centers can inform potentially replicable and generalizable changes across a learning health system. To address these evidence gaps, we evaluated barriers and facilitators to implementation across the research-to-implementation continuum among numerous, diverse projects within a delivery science and applied research program in a large, multi-center, community-based health system, using the Consolidated Framework for Implementation Research (CFIR). METHODS Setting and Population This evaluation was conducted within The Permanente Medical Group’s Delivery Science and Applied Research (DARE) program at Kaiser Permanente Northern California, an integrated health care system with approximately 4.6 million members, 9500 physicians, and 21 medical centers. 12, 13 The setting provides care for a racially, ethnically, and socioeconomically diverse population which closely reflects the region’s underlying census population, including by insurance type (commercial, Medicare, etc.). 14, 15 The DARE program 16 provides personnel and funding to support clinicians in answering actionable, high priority questions to address evidence gaps and inform evidence-based changes in clinical care across all medical and surgical specialties. Each project is a collaboration between a clinical and a scientific co-principal investigator. Projects are identified, developed, and completed in consultation with medical group executives who lead clinical operations. The program utilizes evidence-based implementation methods 17 throughout each project’s cycle. Project Survey Targets and Content During the study period of 2019–2021, there were 86 ongoing or completed DARE projects; all 48 projects completed during this interval were included for survey (Fig. 1 ). Surveys were fielded to each project’s lead scientific investigator and to regional operational and clinical leaders within the project’s specialty area, who were encouraged to forward it to other relevant leaders (Table 1 ). The goal was to understand the end-user’s knowledge of the project’s findings and to identify barriers and facilitators to next-step implementation by both project team leaders and the specialty’s end-users (i.e., clinical leaders). For each project, responses were considered “received” if there was at least one response for the project. Responses received were included for analyses if the results indicated a logical next step for implementation and if there were specific comments mappable to the framework domains (see below). Table 1 Participant characteristics a n (%) b n (%) Participant’s Clinical Title Clinician Investigator 42 (51.9) 32 (47.8) Regional Chair of Chiefs 21 (25.9) 17 (25.4) Associate Executive Director 1 (1.2) 1 (1.5) Other 3 (3.7) 3 (4.5) Dual (Clinician Investigator/Clinical Leader) 5 (6.2) 5 (7.5) No response 9 (11.1) 9 (13.4) Total 81 67 a Survey respondents for eligible projects (45 projects were eligible for evaluation) b Survey respondents for evaluated projects (34 projects were evaluated) Potential participants received an emailed survey with fifteen structured quantitative and qualitative questions regarding the study’s perceived effectiveness, the dissemination of research findings, and facilitators or barriers that impacted potential operational implementation of findings for clinical change (Appendix A). Questions utilized plain language to minimize unfamiliar jargon and had separate queries for implementation facilitators and barriers. They incorporated both quantitative (using Likert scales) and open-ended response questions unconstrained, given the clinical audience, by unfamiliar constructs or terminology. Survey domains included: dissemination practices; target audiences and communication methods; specific clinical or operational changes informed by the project’s results; facilitators and barriers of translating the results to implementation; any additional perceived benefits of the project for the individual or specialty, such as development of investigative experience or career paths; and recommendations for program improvement, including for translating project research results to implementation. The KPNC Research Determination Committee determined the project did not meet the regulatory definition of research involving human subjects requiring institutional board approval. Analysis The analysis aimed to ( 1 ) identify perceived project-specific facilitators and barriers of research implementation, ( 2 ) map concepts from participant’s comments to the CFIR constructs, and ( 3 ) identify facilitators and barriers common across multiple projects. 18 CFIR is a widely accepted framework for assessing barriers and facilitators of implementation. 7, 10, 19–26 Its creation involved reviews of several hundred publications across multiple scientific disciplines followed by the combination of different constructs into a single framework. 26 The current project utilized the full core CFIR framework, without a recently proposed six-element addendum regarding anticipated vs. actual outcomes. 22 The core framework includes five domains: innovation, outer setting, inner setting, individuals, and implementation process. These domains then divide into 26 constructs and, for three constructs with subconstructs, 15 sub-constructs (Appendix B). Participant responses were downloaded into matrices, grouped by project. Three reviewers (CD, SP, and DAC) independently assessed qualitative survey responses for each project, mapped each response to the applicable CFIR domains, constructs, and sub-constructs, and designated each response as a potential barrier or a facilitator to the relevant constructs or sub-constructs. Compound comments that included both barrier and facilitator components could have each comment element assigned separately to a different category. Consistent with qualitative analytic methods, 27, 28 initial assignments were then re-reviewed for consistency and, where there was discordance, discussed for final consensus assignment (CD and SP). We used the SQUIRE checklist when writing our report [Ogrinc G, Davies L, Goodman D, Batalden P, Davidoff F, Stevens D. SQUIRE 2.0 (Standards for QUality Improvement Reporting Excellence): revised publication guidelines from a detailed consensus process.]. RESULTS Eighty-one survey responses were received across 45 of the 48 completed projects (94%); these included respondents from 21 different medical specialties. Eleven projects were excluded given no specific described next-step implementation relevant for the study’s results or because the comments lacked sufficient detail for construct mapping, resulting in 34 projects for the final analysis (Fig. 1 , Table 1 ). Comments mapped to more than one construct or that included both facilitator and barrier attributes were counted multiple times. Among 245 total comments abstracted from analyzed projects, potential barriers or facilitators of implementation were identified across all five CFIR domains and across 32 of 38 domain constructs and/or subconstructs., Table 2 includes selected illustrative comments, among constructs coded with ≥ 3 comments. Table 2 Selected Examples of Participant Feedback Mapped to CFIR Construct a Domain/Construct/Subconstruct Facilitator Barrier I. Innovation a. Evidence strength and quality Dermoscopy use for teledermatology was strongly recommended as the standard of care by the specialty when primary care referring for skin lesions. b. Relative advantage Acceptance of the concept of "regionalization" for cancer care, and acceptance that laparoscopic surgery (MIS = minimally invasive surgery) was superior to open surgery. c. Complexity We need a standardized approach to coding to identify patients with eating disorders and their treatment courses. II. Inner Setting a. Networks & communications Early relationships with ED and cardiology chairs; iterative process of improving the tool and giving feedback on preliminary results along the way. b. Readiness f or implementation i. Leadership engagement I think having regional leads and physicians as part of the study brought forth the value of the order set as well understanding how it was implemented. ii. Available resources Need to have ongoing data support from Region to continue to implement change in practice. iii. Access to knowledge & information Firstly, having clear and undeniable data that showed the superiority of the new regionalized MIS approach vs the traditional approach to care. Frequent updates by lead (ST) to Surgery Chiefs at their meetings to continually socialize the project and to explain the "why" behind the needed changes (based on the data) to our regional organization of gastric cancer care. c. Culture Some medical centers wanted to stick with their current workflow out of ease rather than effectiveness and cost-savings. d. Structural characteristics Communication and complexity of our very large medical group. Education and adoption are difficult without some automation to make work of implementation easier for very busy AFM docs with little time e. Implementation Climate i. Tension for change Because it is NOT a clinical trial, and given the dogmatic nature of surgeons, the specialty leadership has decided (a priori) that specific changes would not be implemented, but this information would inform our practice patterns and patient-level discussions. ii. Compatibility Developed program from the ground up for population level identification of] FH [familial hypercholesterolemia] and management of FH. Implemented a fully integrated pathway from patient identification to care in FH specialty Clinic in a purpose-built accountable Health Connect FH ecosystem. III. Outer Setting a. Peer pressure Many patients discontinued immunosuppressive therapy during the pandemic. These data reinforced societal guidelines, with data, that they should continue and that steroids should be minimized where possible. IV. characteristics of individuals A. individual stage of change Interpersonal conflict and competition between [clinicians] in the … group has been a huge barrier in changing regional practice to this new standard V. Process a. engaging I. key stakeholders From the outset key stakeholders/thought leaders in DOR-RAU [Rapid Analytics Unit] and … [TPMG] Consulting came together to work with PI and others to define primary goals or project and develop system wide approach to identify patients and take action to address the care gap, with periodic meeting to monitor progress and change course as needed. a Selected comments displayed for constructs mapped > 3 times. Facilitators were most commonly mapped to the inner setting (n = 51 comments) and the innovation characteristics (n = 40) domains. Barriers were reported in the inner setting (n = 29), individual characteristics (n = 5), and innovation characteristics (n = 4) domains. Innovation Characteristics Facilitators The innovation domain’s evidence strength and quality construct was a facilitator for 29 out of 45 (64%) projects (Fig. 2 ). This construct reflects the stakeholder’s perception that the available evidence supports the belief that the innovation will likely achieve its desired outcomes. The relative advantage of the new evidence-based innovation was also frequently cited (n = 11). This construct incorporates the stakeholder’s perceived advantage of the studied topic vs. an alternative approach. For example, one clinician investigator noted that, for rapid delivery of clot-dissolving medications for stroke care, the project’s data supported implementation and that, “since implementation we have used the data collected to continue to [further] improve performance to where we are currently treating over 80% of patients in < 30 minutes, a target that was considered unachievable when we started. [These data supported] expansion to 24x7 and two shifts of tele-neurologists to maintain this performance.” Another project, which found a commonly performed surgical procedure to have no clear benefit, informed de-implementation, allowing “elimination of the routine placement of jejunostomy tubes pre-chemotherapy or intraoperatively [for patients undergoing certain gastrointestinal cancer surgeries]. No one in the nation was doing this yet.” Evaluation of a coordinated care team approach for patients with gastric cancer provided “clear and undeniable data that showed the superiority of the new regionalized … approach vs the traditional approach to care...and [provided] the "why" behind the needed changes (based on the data) to our regional [re-] organization of gastric cancer care.” This project demonstrated this approach markedly decreased time to guideline-concordant chemotherapy, post-operative complications, and total post-operative hospital stay. 29 Barriers Within the innovation domain, innovation complexity was a commonly reported barrier to implementation (n = 4) (Fig. 3 ). This construct relates to the innovation’s perceived difficulty for implementation, including scope, intricacy, duration, and disruptiveness. For example, “a standardized approach to coding” was needed to identify patients with eating disorders for an intervention. However, the difficulty, accuracy, and complexity of creating such an accurate standardized electronic approach impaired broader next-step implementation. Inner Setting Facilitators Within the inner setting domain, the networks and communications (n = 20) construct and, within the readiness for implementation construct, the leadership engagement (n = 19) subconstruct had the most frequent facilitator comments. The network and communications construct describes availability of developed formal and informal communications and social networks for communications within an organization. The leadership engagement subconstruct includes the perceived involvement of relevant leaders for innovation implementation. For example, a respondent for a project that evaluated the safety of a new clinical decision support tool for patients with pulmonary embolism illustrated the interplay between networks, communications, and leadership engagement: “These study results allowed us to expand tool access to non-study [emergency departments] across KPNC and teach physicians in these departments why and how the application can improve patient care… [this was facilitated by] prior relationships with the [emergency department] chiefs’ group that helped open the door for the expansion of tool access to non-study [emergency departments] across KPNC.”​ 30 Barriers Several inner setting constructs were perceived barriers to implementation, particularly resources and the need for a greater learning/change culture. Within the readiness for implementation construct, the a vailable resources subconstruct, defined as sufficient dedicated organizational resources for both implementation and ongoing operations, was the most cited barrier (n = 15). Data support, programmers, and automation were among the most commonly resources needed. A project assessing an integrated, multidisciplinary head and neck cancer care program identified the “need to have ongoing data support from the region to continue to implement change in practice,” as a barrier to ongoing multidisciplinary tumor boards. A respondent for a study on decreased prostate cancer screening following the 2012 USPSTF guidance stated, “Education and adoption is difficult without [creating] some automation to make work of implementation easier for very busy … docs with little time; [successful implementation also needs] … a shared decision aid for screening within [the electronic medical record] and access to [medical record] programmers … so we can make changes faster.” Within the inner setting domain’s implementation climate construct, several barriers were identified. Five projects cited need for an expanded learning climate or learning culture as a barrier, this subconstruct is related to the organization’s norms, values, and basic assumptions. One project, for example, stated that “some medical centers wanted to stick with their current workflow out of ease rather than effectiveness and cost-savings.” A project evaluating a new surgical method that would require centers of excellence stated that next-step broader implementation was “strongly opposed by the group…as compared to traditional … approaches [that were familiar to those surgeons],” reflecting the teams’ cultural hesitancy for adopting new paradigms. An additional common barrier was the tension for change (n = 4), a sub-construct reflecting stakeholders’ perceptions whether the current status needs change. Finally, barriers were noted within the inner setting domain’s structural characteristics (n = 4) construct, which reflect perceptions regarding the organization’s architecture, maturity, and size for implementing change. Outer Setting Facilitators Within the outer setting domain, the peer pressure construct was a commonly noted implementation facilitator (n = 6). This construct includes competitive pressure, where other organizations have either already implemented an innovation or there is a desire to implement it first, to gain a relative competitive advantage to the external organizations. For one care integration effort, a physician investigator noted, for example: “This effort… lays groundwork needed to bring at least 6 different surgical service lines together to work on a specific issue that will help bring our Surgery Services to the next level in providing in-house complex cancer care which previously [needed to be] referred out to [external tertiary university medical centers].” External policies and incentives were also identified as a facilitator. Two projects, one in prostate cancer screening and one regarding colorectal cancer polyp surveillance, stated that the combination of internal evidence development and relevant external care guidelines, together, compelled the implementation of practice change. Characteristics of Individuals Barriers Within the characteristics of individuals domain, the individual stage of change (n = 5) construct was a commonly cited barrier to implementation. This construct refers to relevant individuals’ skilled, progressive, and sustained implementation of the evidence-based innovation. For example, one project identified “conflict and competition between [individual] surgeons in the [specific specialty surgical] group has been a huge barrier in changing regional practice to this new standard” and another project evaluating effectiveness and potential harms of a large-scale initiative changing from an inpatient to outpatient procedural workflow, identified “[clinician] reticence to change” as a key individual characteristic impeding spread and more universal implementation. 31 Process Facilitators Within the process domain, the engaging construct, especially the key stakeholder engagement (n = 4) subconstruct, was the most cited facilitator to implementation. This included the investigators themselves being embedded operational leaders. For example, one project evaluating optimal surveillance strategies for hepatocellular carcinoma included regional clinical leads for the surveillance program as co-investigators; these leaders could then directly implement the evidence-based results. 32 Another project evaluating the electronic identification of patients with familial hypercholesterolemia closely incorporated both an engaged regional clinical topic-specific clinician and technological leaders for rapid deployment of a next-step population management program. 33 Discussion This study evaluated, for the first time to our knowledge, barriers and facilitators of new evidence-to-implementation cycles that are common across large numbers of specialties and project topics, using standardized data collection and a well-established conceptual framework. Across projects, the most common facilitators of implementation were the strength of the new evidence for informing clinical change, specialty communication networks for disseminating knowledge, leadership engagement, and the innovation’s relative advantage over existing practices. The main barriers were limited system-level resources (especially technological methods and personnel), need for greater embracement of a culture for learning and change, variable individual-level motivation for change, insufficient tension for change, and innovation complexity. These potentially replicable facilitators and modifiable barriers can focus, among the numerous topics within conceptual implementation frameworks, those with the likely greatest benefit-for-effort for health systems pursuing large-volume evidence-to-implementation initiatives. These findings markedly extend the current literature regarding barriers and facilitators of evidence-to-implementation continuum. To accomplish rapid-cycle, high-volume change, healthcare systems require the systematic translation of evidence-based research to practice across many topics and specialties. 34 However, most current implementation literature evaluates a single topic, a certain medical specialty setting, or, when characterizing multiple projects, may summarize disparate already-published single-topic data collected using different methods. 35, 36,37,38,20,25,39 While useful for specific efforts, this approach may not identify the common and generalizable domains attainable from using a consistent, prospective approach to data collection and mapping across multiple projects. In contrast, identifying common potentially modifiable implementation facilitators and barriers across many project topics can enumerate the likely highest-yield systems-level topic areas relevant for strategic development of learning health systems. 40 The “engaging” process, for example, was identified as an important cross-topic facilitator. It includes specific efforts frequently not done, such as social marketing of the innovation, user education, training, role modeling, etc., that can accelerate the transition to implementation across multiple topics areas. Within KPNC, such strategies were effectively used by only some groups; this study’s results are now informing and replicating their broad use. The current study has several strengths. First, it evaluated potential translation-to-implementation barriers and facilitators across many research studies using a common data collection instrument. The identification of common themes increases the likelihood that the findings are generalizable to diverse settings and topics. Second, it utilized a common framework, the Consolidated Framework for Implementation Research. CFIR’s framework can evaluate implementation before, during, or after project completion. 18, 19, 24 Thus, the results use theories, constructs, and language that are readily comparable to other settings or investigations. 18,23 Finally, complementing studies from academic university centers, the current study’s community-based, multi- medical center setting that includes approximately 1% of people in the United States and 40% of the region’s underlying population provides common facilitators and barriers where most people receive care – community-based health care delivery systems. Study limitations include the limited data for each project evaluated. Given the large number of projects, common format for data collection, need for understandable language without jargon, and limited time availability of clinicians and operational leaders, a structured questionnaire was used rather than expansive formative or semi-structured interviews. The evaluation is within a not-for-profit integrated care setting, which, while being generally comparable to how many patients in the United States are currently treated within Accountable Care Organizations, differs from some other settings. 4 The results may be less relevant for settings with multiple distinct care delivery structures between inpatient, outpatient, and specialty care or for systems with different incentive systems, such as fee-for-service; these factors may create different barriers and facilitators of implementation. The projects evaluated were also within a specific delivery science and applied research program; although the structures for innovation programs may differ, the high level of concordance across projects in this setting suggest these are likely facilitators and barriers more common to topics than to a single program. Future multi-topic evaluations in different settings will be useful to evaluate areas of concordance and discordance. Conclusions In conclusion, the current analysis evaluated numerous evidence-to-implementation projects for potential implementation facilitators and barriers, utilized an established implementation framework to classify elements across projects, and described the most common themes, with examples. These findings can inform and focus, among the large number of potential topics described within conceptual frameworks, those areas with the likely greatest benefit-for-effort to address within multi-faceted health systems pursuing large-volume evidence-to-implementation initiatives to accelerate evidence-based care. Declarations Ethics approval and consent to participate: The KPNC Research Determination Committee determined the project did not meet the regulatory definition of research involving human subjects requiring institutional board approval. Consent for publication: Not applicable. Availability of data and materials: The datasets generated and/or analyzed during the current study are not publicly available due to the qualitative nature of the data derivation and mapping, but relevant data and approaches are available from the corresponding author on reasonable request. Competing interests: All authors are employees of The Permanente Medical Group. The authors have no other relationships or conflicts of interest to declare. Funding: This study was funded by The Permanente Medical Group via its Delivery Science and Applied Research (DARE) Program. Authors' contributions: CD participated in the design and distribution of the survey tool, evaluation conceptualization, synthesis and interpretation of data, and drafting of the manuscript. SP participated in obtaining regulatory approval, synthesis and interpretation of data, and drafting of the manuscript. JLS participated in the design and distribution of the survey tool and drafting of the manuscript. TL, JAS, SR, YC and KL participated in drafting of the manuscript. DAC participated in the study design, conceptualization synthesis and interpretation of data, and drafting of the manuscript. Acknowledgements: We appreciate Michael Hartmann for assisting with the presentation of data for figures two and three. References Lengnick-Hall R, Proctor EK, Bunger AC, Gerke DR. Ten years of implementation outcome research: a scoping review protocol. BMJ Open . 2021;11(6):e049339. doi:10.1136/bmjopen-2021-049339 Institute of Medicine Roundtable on Evidence-Based M. In: Olsen L, Aisner D, McGinnis JM, eds. The Learning Healthcare System: Workshop Summary . National Academies Press (US) Copyright © 2007, National Academy of Sciences.; 2007. Morris ZS, Wooding S, Grant J. The answer is 17 years, what is the question: understanding time lags in translational research. J R Soc Med . Dec 2011;104(12):510-20. doi:10.1258/jrsm.2011.110180 Tu T, Muhlestein, David, Kocot, S. Lawrence and White, Ross The Impact of Accountable Care: Origins and Future of Accountable Care Organzations . Report. 2015. 2015. Accessed 18 Apr 2024. https://www.brookings.edu/wp-content/uploads/2016/06/impact-of-accountable-careorigins-052015.pdf Smith JD, Hasan M. Quantitative approaches for the evaluation of implementation research studies. Psychiatry Res . Jan 2020;283:112521. doi:10.1016/j.psychres.2019.112521 Lau R, Stevenson F, Ong BN, Dziedzic K, Treweek S, Eldridge S, Everitt H, Kennedy A, Qureshi N, Rogers A, Peacock R, Murray E. Achieving change in primary care--causes of the evidence to practice gap: systematic reviews of reviews. Implement Sci . Mar 22 2016;11:40. doi:10.1186/s13012-016-0396-4 Karabukayeva A, Hearld LR, Kelly R, Hall A, Singh J. Association between the number of adopted implementation strategies and contextual determinants: a mixed-methods study. BMC Health Serv Res . Dec 13 2022;22(1):1518. doi:10.1186/s12913-022-08736-2 Marufu TR, Bower RR, Hendron E, Manning JR. Nursing interventions to reduce medication errors in paediatrics and neonates: Systematic review and meta-analysis. J Pediatr Nurs . Jan-Feb 2022;62:e139-e147. doi:10.1016/j.pedn.2021.08.024 Pollock A, Campbell P, Cheyne J, Cowie J, Davis B, McCallum J, McGill K, Elders A, Hagen S, McClurg D, Torrens C, Maxwell M. Interventions to support the resilience and mental health of frontline health and social care professionals during and after a disease outbreak, epidemic or pandemic: a mixed methods systematic review. Cochrane Database Syst Rev . Nov 5 2020;11(11):Cd013779. doi:10.1002/14651858.Cd013779 Weir NM, Newham R, Dunlop E, Bennie M. Factors influencing national implementation of innovations within community pharmacy: a systematic review applying the Consolidated Framework for Implementation Research. Implement Sci . Mar 4 2019;14(1):21. doi:10.1186/s13012-019-0867-5 Glasgow RE, Chambers D. Developing Robust, Sustainable, Implementation Systems Using Rigorous, Rapid and Relevant Science. Clinical and Translational Science . 2012;5(1):48-55. doi:10.1111/j.1752-8062.2011.00383.x Lieu TA, Madvig PR. Strategies for Building Delivery Science in an Integrated Health Care System. J Gen Intern Med . Jun 2019;34(6):1043-1047. doi:10.1007/s11606-018-4797-8 Corley DA, Kilbourne A. The Learning Health System: The Tools Are Here-Why Aren't We Moving Forward? Gastroenterology . Dec 2021;161(6):1747-1750. doi:10.1053/j.gastro.2021.07.047 Davis AC, Voelkel JL, Remmers CL, Adams JL, McGlynn EA. Comparing Kaiser Permanente Members to the General Population: Implications for Generalizability of Research. Perm J . Jun 15 2023;27(2):87-98. doi:10.7812/tpp/22.172 Gordon NP. How Does the Adult Kaiser Permanente Membership in Northern California Compare with the Larger Community? . Kaiser Permanente Northern California Division of Research Accessed Dec 19, 2023. https://memberhealthsurvey.kaiser.org/Documents/comparison_kaiser_vs_nonKaiser_adults_kpnc.pdf Delivery Science and Applied Research. The Permanente Medical Group. Accessed 18 Apr 2024, kp.org/dare Prausnitz S, Altschuler A, Herrinton LJ, Avins AL, Corley DA. The implementation checklist: A pragmatic instrument for accelerating research-to-implementation cycles. Learn Health Syst . Jul 2023;7(3):e10359. doi:10.1002/lrh2.10359 Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Science . 2009;4(1):50. doi:10.1186/1748-5908-4-50 Ahmed S, Zidarov D, Eilayyan O, Visca R. Prospective application of implementation science theories and frameworks to inform use of PROMs in routine clinical care within an integrated pain network. Qual Life Res . Nov 2021;30(11):3035-3047. doi:10.1007/s11136-020-02600-8 Atkins E, Birmpili P, Glidewell L, Li Q, Johal AS, Waton S, Boyle JR, Pherwani AD, Chetter I, Cromwell DA. Effectiveness of quality improvement collaboratives in UK surgical settings and barriers and facilitators influencing their implementation: a systematic review and evidence synthesis. BMJ Open Qual . Apr 2023;12(2)doi:10.1136/bmjoq-2022-002241 Breimaier HE, Heckemann B, Halfens RJG, Lohrmann C. The Consolidated Framework for Implementation Research (CFIR): a useful theoretical framework for guiding and evaluating a guideline implementation process in a hospital-based nursing practice. BMC Nursing . 2015;14(1)doi:10.1186/s12912-015-0088-4 Damschroder LJ, Reardon CM, Opra Widerquist MA, Lowery J. Conceptualizing outcomes for use with the Consolidated Framework for Implementation Research (CFIR): the CFIR Outcomes Addendum. Implement Sci . Jan 22 2022;17(1):7. doi:10.1186/s13012-021-01181-5 Keith RE, Crosson JC, O’Malley AS, Cromp D, Taylor EF. Using the Consolidated Framework for Implementation Research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation. Implementation Science . 2017;12(1)doi:10.1186/s13012-017-0550-7 Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the Consolidated Framework for Implementation Research. Implement Sci . May 17 2016;11:72. doi:10.1186/s13012-016-0437-z Li W, Su M, Zhang W, Fan X, Li R, Gao Y, Wei X. Barriers and facilitators of implementing electronic monitors to improve adherence and health outcomes in tuberculosis patients: protocol for a systematic review based on the Consolidated Framework for Implementation Research. Health Res Policy Syst . Nov 1 2023;21(1):115. doi:10.1186/s12961-023-01054-x Research CRT-CfCM. Consolidated Framework for Implementation Research. Accessed Dec 19, 2023. https://cfirguide.org/ Huynh AK, Hamilton AB, Farmer MM, Bean-Mayberry B, Stirman SW, Moin T, Finley EP. A Pragmatic Approach to Guide Implementation Evaluation Research: Strategy Mapping for Complex Interventions. Front Public Health . 2018;6:134. doi:10.3389/fpubh.2018.00134 Morse JM. Critical Analysis of Strategies for Determining Rigor in Qualitative Inquiry. Qual Health Res . Sep 2015;25(9):1212-22. doi:10.1177/1049732315588501 Teh SH, Shiraga S, Kellem AM, Li RA, Le DM, Arsalane SP, Khayat FS, Li Y, Gong I-Y, Lee JM. A Path to High-Value Gastric Cancer Surgery Care Delivery. Annals of Surgery Open . 2024;5(2):e408. doi:10.1097/as9.0000000000000408 Vinson DR, Casey SD, Vuong PL, Huang J, Ballard DW, Reed ME. Sustainability of a Clinical Decision Support Intervention for Outpatient Care for Emergency Department Patients With Acute Pulmonary Embolism. JAMA Netw Open . May 2 2022;5(5):e2212340. doi:10.1001/jamanetworkopen.2022.12340 Vuong B, Graff-Baker AN, Yanagisawa M, Chang SB, Mentakis M, Shim V, Knox M, Romero L, Kuehner G. Implementation of a Post-mastectomy Home Recovery Program in a Large, Integrated Health Care Delivery System. Ann Surg Oncol . Oct 2019;26(10):3178-3184. doi:10.1245/s10434-019-07551-0 Lam JO, Hurley LB, Lai JB, Saxena V, Seo S, Chamberland S, Quesenberry CP, Jr., Champsi JH, Ready J, Chiao EY, Marcus JL, Silverberg MJ. Cancer in People with and without Hepatitis C Virus Infection: Comparison of Risk Before and After Introduction of Direct-Acting Antivirals. Cancer Epidemiol Biomarkers Prev . Dec 2021;30(12):2188-2196. doi:10.1158/1055-9965.Epi-21-0742 Birnbaum RA, Horton BH, Gidding SS, Brenman LM, Macapinlac BA, Avins AL. Closing the gap: Identification and management of familial hypercholesterolemia in an integrated healthcare delivery system. J Clin Lipidol . Mar-Apr 2021;15(2):347-357. doi:10.1016/j.jacl.2021.01.008 Kanani N, Hahn EE, Gould MK, Brunisholz KD, Savitz LA, Holve EC. AcademyHealth's Delivery System Science Fellowship: Training Embedded Researchers to Design, Implement, and Evaluate New Models of Care. Journal of Hospital Medicine . 2017;12(7):570-574. doi:10.12788/jhm.2776 Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients' care. Lancet . Oct 11 2003;362(9391):1225-30. doi:10.1016/s0140-6736(03)14546-1 Zhou S, Ma J, Dong X, Li N, Duan Y, Wang Z, Gao L, Han L, Tu S, Liang Z, Liu F, Labresh KA, Smith SC, Jin Y, Zheng Z-J. Barriers and enablers in the implementation of a quality improvement program for acute coronary syndromes in hospitals: a qualitative analysis using the consolidated framework for implementation research. Implementation Science . 2022;17(1)doi:10.1186/s13012-022-01207-6 Westafer LM, Jessen E, Zampi M, Boccio E, Casey SD, Lindenauer PK, Vinson DR. Barriers and Facilitators to the Outpatient Management of Low-risk Pulmonary Embolism From the Emergency Department. Ann Emerg Med . Sep 2023;82(3):381-393. doi:10.1016/j.annemergmed.2023.02.021 de Moel-Mandel C, Lynch C, Issaka A, Braver J, Zisis G, Carrington MJ, Oldenburg B. Optimising the implementation of digital-supported interventions for the secondary prevention of heart disease: a systematic review using the RE-AIM planning and evaluation framework. BMC Health Serv Res . Dec 4 2023;23(1):1347. doi:10.1186/s12913-023-10361-6 Tikellis G, Hoffman M, Mellerick C, Burge AT, Holland AE. Barriers to and facilitators of the use of oxygen therapy in people living with an interstitial lung disease: a systematic review of qualitative evidence. Eur Respir Rev . Sep 30 2023;32(169)doi:10.1183/16000617.0066-2023 CREST Network Web page. The Permanente Medical Group. Accessed Dec 20, 2023. https://deliveryscience-appliedresearch.kaiserpermanente.org/specialty-research-networks/crest-network Additional Declarations Competing interest reported. All authors are employees of The Permanente Medical Group which funded this survey evaluation. The authors have no other relationships or conflicts of interest to declare. Supplementary Files AppendixA.SurveyQuestionsFinal.docx AppendixB.CFIRDomainsandConstructsFinal.docx Cite Share Download PDF Status: Published Journal Publication published 21 Nov, 2024 Read the published version in BMC Health Services Research → Version 1 posted Editorial decision: Revision requested 10 Jul, 2024 Editor assigned by journal 09 Jul, 2024 Submission checks completed at journal 09 Jul, 2024 First submitted to journal 21 Jun, 2024 You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-4618789","acceptedTermsAndConditions":true,"allowDirectSubmit":false,"archivedVersions":[],"articleType":"Research Article","associatedPublications":[],"authors":[{"id":325005754,"identity":"7911e968-7258-4bfe-805f-c3d5e3995785","order_by":0,"name":"Cimone Durojaiye","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAABFklEQVRIiWNgGAWjYBAC/mY4MwGIeYCQgfkwXi0SCGm4FrZkvFoMHFC0gAGPMX4t7NyJjwsqGOQY2HPMPnyQsZMxON7z2biAwSZf3gGHFmbezcYzzjAYM/C8MZ45gyeZx+DM2c3JMxjSLDcewKllmzRvG0Nig0SOMTMPDzOPwY3czYd5GA4bGDbg0/KPoR6qpZ7H4P6bx/i1OIO0NAD9DtFyGGgLD3MySIs8Du9LHAb6heeYhGEbz7Nixhk8x3kkz6QZG88wSDMwwKGFv//sxsc8NTby/OzJmxk+9lTb8x0//Fi6oMLGQB6Hw2CWMbCBKMYeBgaFA8D4ZwBaYXAArxYY+MHAADKcGcQmYMsoGAWjYBSMHAAA7XJL5j69VkcAAAAASUVORK5CYII=","orcid":"","institution":"Kaiser Permanente Northern California","correspondingAuthor":true,"submittingAuthor":false,"prefix":"","firstName":"Cimone","middleName":"","lastName":"Durojaiye","suffix":""},{"id":325005755,"identity":"c8922763-f14e-466b-bad7-24d4ab335d97","order_by":1,"name":"Stephanie Prausnitz","email":"","orcid":"","institution":"Kaiser Permanente Northern California","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Stephanie","middleName":"","lastName":"Prausnitz","suffix":""},{"id":325005756,"identity":"4d7c9881-6b31-476d-b4d9-0b15c255cdc9","order_by":2,"name":"Jennifer L. Schneider","email":"","orcid":"","institution":"Kaiser Permanente Northern California","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Jennifer","middleName":"L.","lastName":"Schneider","suffix":""},{"id":325005757,"identity":"5b588b5e-de44-40cd-b587-14fc93a2dd15","order_by":3,"name":"Tracy A. Lieu","email":"","orcid":"","institution":"Kaiser Permanente Northern California","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Tracy","middleName":"A.","lastName":"Lieu","suffix":""},{"id":325005758,"identity":"1b44c114-818a-44db-b3d4-b9d8d634d320","order_by":4,"name":"Julie A. Schmittdiel","email":"","orcid":"","institution":"Kaiser Permanente Northern California","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Julie","middleName":"A.","lastName":"Schmittdiel","suffix":""},{"id":325005759,"identity":"ea7dbf39-afd9-4187-a3f4-70298aa4cddf","order_by":5,"name":"Smita Rouillard","email":"","orcid":"","institution":"The Permanente Medical Group","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Smita","middleName":"","lastName":"Rouillard","suffix":""},{"id":325005760,"identity":"464bfda3-cf88-4d48-a8f0-112d1047bab0","order_by":6,"name":"Yi-Fen Chen","email":"","orcid":"","institution":"The Permanente Medical Group","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Yi-Fen","middleName":"","lastName":"Chen","suffix":""},{"id":325005761,"identity":"c974a1ee-ece8-4bd7-bea3-1033fa832792","order_by":7,"name":"Kristine Lee","email":"","orcid":"","institution":"The Permanente Medical Group","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Kristine","middleName":"","lastName":"Lee","suffix":""},{"id":325005762,"identity":"37ccfad0-f3c6-4466-b7bc-ebb6a89e18e9","order_by":8,"name":"Douglas A. Corley","email":"","orcid":"","institution":"Kaiser Permanente Northern California","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Douglas","middleName":"A.","lastName":"Corley","suffix":""}],"badges":[],"createdAt":"2024-06-21 17:42:16","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-4618789/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-4618789/v1","draftVersion":[],"editorialEvents":[{"content":"https://doi.org/10.1186/s12913-024-11803-5","type":"published","date":"2024-11-21T15:57:17+00:00"}],"editorialNote":"","failedWorkflow":false,"files":[{"id":62153377,"identity":"32e95c0b-2504-445d-bcbb-7694e5b7b8f0","added_by":"auto","created_at":"2024-08-09 20:53:19","extension":"png","order_by":1,"title":"Figure 1","display":"","copyAsset":false,"role":"figure","size":200632,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cstrong\u003eDARE Projects Included in the Survey\u003c/strong\u003e\u003c/p\u003e","description":"","filename":"floatimage1.png","url":"https://assets-eu.researchsquare.com/files/rs-4618789/v1/b21bf64a1dc4b5209ccded0d.png"},{"id":62154901,"identity":"25de12fd-8ad8-463d-8613-fa408b53f391","added_by":"auto","created_at":"2024-08-09 21:01:19","extension":"png","order_by":2,"title":"Figure 2","display":"","copyAsset":false,"role":"figure","size":226382,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cstrong\u003eImplementation Facilitators Mapped to CFIR Constructs \u003c/strong\u003e\u003csup\u003e\u003cstrong\u003ea\u003c/strong\u003e\u003c/sup\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003ea \u003c/strong\u003eDisplaying constructs mapped as facilitators \u0026gt;3 times.\u003c/p\u003e","description":"","filename":"floatimage2.png","url":"https://assets-eu.researchsquare.com/files/rs-4618789/v1/3b4cac110785b54d4b06129f.png"},{"id":62153382,"identity":"8d052b04-7dbb-4950-8841-8615c437f1e2","added_by":"auto","created_at":"2024-08-09 20:53:19","extension":"png","order_by":3,"title":"Figure 3","display":"","copyAsset":false,"role":"figure","size":107210,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cstrong\u003eImplementation Barriers Mapped to CFIR Constructs\u003c/strong\u003e \u003csup\u003ea\u003c/sup\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003ea \u003c/strong\u003eDisplaying constructs mapped as barriers \u0026gt;3 times.\u003c/p\u003e","description":"","filename":"floatimage3.png","url":"https://assets-eu.researchsquare.com/files/rs-4618789/v1/1984b0e2778a9e8dc06e1120.png"},{"id":69834851,"identity":"58c9f7dc-e678-4dd7-92ab-ae1ee7503a6d","added_by":"auto","created_at":"2024-11-25 16:09:33","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":1116607,"visible":true,"origin":"","legend":"","description":"","filename":"manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-4618789/v1/119a309e-447a-46aa-b7ed-06daa71d28fb.pdf"},{"id":62153380,"identity":"8642259b-2f27-4da3-99e0-70e7c5683abf","added_by":"auto","created_at":"2024-08-09 20:53:19","extension":"docx","order_by":1,"title":"","display":"","copyAsset":false,"role":"supplement","size":28320,"visible":true,"origin":"","legend":"","description":"","filename":"AppendixA.SurveyQuestionsFinal.docx","url":"https://assets-eu.researchsquare.com/files/rs-4618789/v1/89ef990f5a734df4c768b9bf.docx"},{"id":62153379,"identity":"27e1011d-bcef-4dcd-9cda-b9add3466e82","added_by":"auto","created_at":"2024-08-09 20:53:19","extension":"docx","order_by":2,"title":"","display":"","copyAsset":false,"role":"supplement","size":26889,"visible":true,"origin":"","legend":"","description":"","filename":"AppendixB.CFIRDomainsandConstructsFinal.docx","url":"https://assets-eu.researchsquare.com/files/rs-4618789/v1/6e03e45e6e261f330a0fbfab.docx"}],"financialInterests":"Competing interest reported. All authors are employees of The Permanente Medical Group which funded this survey evaluation. The authors have no other relationships or conflicts of interest to declare.","formattedTitle":"Barriers and Facilitators to High-Volume Evidence-Based Innovation and Implementation in a Large, Community-Based Learning Health System","fulltext":[{"header":"BACKGROUND","content":"\u003cp\u003eThe expeditious translation of evidence into clinical practice poses a substantial challenge to the United States health care system.\u003csup\u003e1\u003c/sup\u003e Broad-scale, rapid health care change is critical for improving value-based, effective health care and for enabling the evidence-to-implementation-to-evaluation continuum for large numbers of projects across multiple disciplines.\u003csup\u003e2\u003c/sup\u003e However, creating the infrastructure and systems to address this need, conceptualized by the Institute of Medicine\u0026rsquo;s seminal evidence-based medicine workshop, requires understanding which facilitators and barriers commonly impact this continuum across diverse health topics, specialties, and settings.\u003csup\u003e1, 3\u003c/sup\u003e National trends towards more integrated healthcare systems, including the development of Accountable Care Organizations, offers great potential for achieving this goal.\u003csup\u003e4\u003c/sup\u003e However, few studies of common facilitators and barriers of the evidence-to-implementation continuum across many topic types exist to inform such cross-cutting systems for high-volume, rapid change.\u003c/p\u003e \u003cp\u003eMost in-depth implementation research is topic-based rather than system-based across multiple topics. Implementation research seeks to \u0026ldquo;adopt and integrate evidence-based health interventions into clinical and community settings for the improvement of patient outcomes and patient/provider experiences that benefit population health.\u0026rdquo;\u003csup\u003e5\u003c/sup\u003e Yet, traditional implementation studies usually provide an in-depth focus on a single subject in a specific setting or specialty.\u003csup\u003e6\u0026ndash;10\u003c/sup\u003e While useful for the question of interest, single-topic studies may not identify systemic issues.\u003csup\u003e11\u003c/sup\u003e In contrast, evaluating themes across multiple projects, specialties, and medical centers can inform potentially replicable and generalizable changes across a learning health system.\u003c/p\u003e \u003cp\u003eTo address these evidence gaps, we evaluated barriers and facilitators to implementation across the research-to-implementation continuum among numerous, diverse projects within a delivery science and applied research program in a large, multi-center, community-based health system, using the Consolidated Framework for Implementation Research (CFIR).\u003c/p\u003e"},{"header":"METHODS","content":"\u003cp\u003eSetting and Population\u003c/p\u003e \u003cp\u003eThis evaluation was conducted within The Permanente Medical Group\u0026rsquo;s Delivery Science and Applied Research (DARE) program at Kaiser Permanente Northern California, an integrated health care system with approximately 4.6\u0026nbsp;million members, 9500 physicians, and 21 medical centers.\u003csup\u003e12, 13\u003c/sup\u003e The setting provides care for a racially, ethnically, and socioeconomically diverse population which closely reflects the region\u0026rsquo;s underlying census population, including by insurance type (commercial, Medicare, etc.).\u003csup\u003e14, 15\u003c/sup\u003e\u003c/p\u003e \u003cp\u003eThe DARE program\u003csup\u003e16\u003c/sup\u003e provides personnel and funding to support clinicians in answering actionable, high priority questions to address evidence gaps and inform evidence-based changes in clinical care across all medical and surgical specialties. Each project is a collaboration between a clinical and a scientific co-principal investigator. Projects are identified, developed, and completed in consultation with medical group executives who lead clinical operations. The program utilizes evidence-based implementation methods\u003csup\u003e17\u003c/sup\u003e throughout each project\u0026rsquo;s cycle.\u003c/p\u003e \u003cp\u003eProject Survey Targets and Content\u003c/p\u003e \u003cp\u003eDuring the study period of 2019\u0026ndash;2021, there were 86 ongoing or completed DARE projects; all 48 projects completed during this interval were included for survey (Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e). Surveys were fielded to each project\u0026rsquo;s lead scientific investigator and to regional operational and clinical leaders within the project\u0026rsquo;s specialty area, who were encouraged to forward it to other relevant leaders (Table\u0026nbsp;\u003cspan refid=\"Tab1\" class=\"InternalRef\"\u003e1\u003c/span\u003e). The goal was to understand the end-user\u0026rsquo;s knowledge of the project\u0026rsquo;s findings and to identify barriers and facilitators to next-step implementation by both project team leaders and the specialty\u0026rsquo;s end-users (i.e., clinical leaders). For each project, responses were considered \u0026ldquo;received\u0026rdquo; if there was at least one response for the project. Responses received were included for analyses if the results indicated a logical next step for implementation and if there were specific comments mappable to the framework domains (see below).\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab1\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 1\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eParticipant characteristics\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"3\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e\u0026nbsp;\u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003csup\u003ea\u003c/sup\u003e n (%)\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003e\u003csup\u003eb\u003c/sup\u003e n (%)\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003eParticipant\u0026rsquo;s Clinical Title\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e\u0026nbsp;\u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eClinician Investigator\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e42 (51.9)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e32 (47.8)\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eRegional Chair of Chiefs\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e21 (25.9)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e17 (25.4)\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eAssociate Executive Director\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e1 (1.2)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e1 (1.5)\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eOther\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e3 (3.7)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e3 (4.5)\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eDual (Clinician Investigator/Clinical Leader)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e5 (6.2)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e5 (7.5)\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eNo response\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e9 (11.1)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e9 (13.4)\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eTotal\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cb\u003e81\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e\u003cb\u003e67\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003ctfoot\u003e \u003ctr\u003e\u003ctd colspan=\"3\"\u003e\u003csup\u003ea\u003c/sup\u003e Survey respondents for eligible projects (45 projects were eligible for evaluation)\u003c/td\u003e\u003c/tr\u003e \u003ctr\u003e\u003ctd colspan=\"3\"\u003e\u003csup\u003eb\u003c/sup\u003e Survey respondents for evaluated projects (34 projects were evaluated)\u003c/td\u003e\u003c/tr\u003e \u003c/tfoot\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003ePotential participants received an emailed survey with fifteen structured quantitative and qualitative questions regarding the study\u0026rsquo;s perceived effectiveness, the dissemination of research findings, and facilitators or barriers that impacted potential operational implementation of findings for clinical change (Appendix A). Questions utilized plain language to minimize unfamiliar jargon and had separate queries for implementation facilitators and barriers. They incorporated both quantitative (using Likert scales) and open-ended response questions unconstrained, given the clinical audience, by unfamiliar constructs or terminology. Survey domains included: dissemination practices; target audiences and communication methods; specific clinical or operational changes informed by the project\u0026rsquo;s results; facilitators and barriers of translating the results to implementation; any additional perceived benefits of the project for the individual or specialty, such as development of investigative experience or career paths; and recommendations for program improvement, including for translating project research results to implementation.\u003c/p\u003e \u003cp\u003eThe KPNC Research Determination Committee determined the project did not meet the regulatory definition of research involving human subjects requiring institutional board approval.\u003c/p\u003e \u003cp\u003eAnalysis\u003c/p\u003e \u003cp\u003eThe analysis aimed to (\u003cspan citationid=\"CR1\" class=\"CitationRef\"\u003e1\u003c/span\u003e) identify perceived project-specific facilitators and barriers of research implementation, (\u003cspan citationid=\"CR2\" class=\"CitationRef\"\u003e2\u003c/span\u003e) map concepts from participant\u0026rsquo;s comments to the CFIR constructs, and (\u003cspan citationid=\"CR3\" class=\"CitationRef\"\u003e3\u003c/span\u003e) identify facilitators and barriers common across multiple projects.\u003csup\u003e18\u003c/sup\u003e\u003c/p\u003e \u003cp\u003eCFIR is a widely accepted framework for assessing barriers and facilitators of implementation.\u003csup\u003e7, 10, 19\u0026ndash;26\u003c/sup\u003e Its creation involved reviews of several hundred publications across multiple scientific disciplines followed by the combination of different constructs into a single framework.\u003csup\u003e26\u003c/sup\u003e The current project utilized the full core CFIR framework, without a recently proposed six-element addendum regarding anticipated vs. actual outcomes.\u003csup\u003e22\u003c/sup\u003e The core framework includes five domains: innovation, outer setting, inner setting, individuals, and implementation process. These domains then divide into 26 constructs and, for three constructs with subconstructs, 15 sub-constructs (Appendix B).\u003c/p\u003e \u003cp\u003eParticipant responses were downloaded into matrices, grouped by project. Three reviewers (CD, SP, and DAC) independently assessed qualitative survey responses for each project, mapped each response to the applicable CFIR domains, constructs, and sub-constructs, and designated each response as a potential barrier or a facilitator to the relevant constructs or sub-constructs. Compound comments that included both barrier and facilitator components could have each comment element assigned separately to a different category. Consistent with qualitative analytic methods,\u003csup\u003e27, 28\u003c/sup\u003e initial assignments were then re-reviewed for consistency and, where there was discordance, discussed for final consensus assignment (CD and SP).\u003c/p\u003e \u003cp\u003e We used the SQUIRE checklist when writing our report [Ogrinc G, Davies L, Goodman D, Batalden P, Davidoff F, Stevens D. SQUIRE 2.0 (Standards for QUality Improvement Reporting Excellence): revised publication guidelines from a detailed consensus process.].\u003c/p\u003e"},{"header":"RESULTS","content":"\u003cp\u003eEighty-one survey responses were received across 45 of the 48 completed projects (94%); these included respondents from 21 different medical specialties. Eleven projects were excluded given no specific described next-step implementation relevant for the study\u0026rsquo;s results or because the comments lacked sufficient detail for construct mapping, resulting in 34 projects for the final analysis (Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e, Table\u0026nbsp;\u003cspan refid=\"Tab1\" class=\"InternalRef\"\u003e1\u003c/span\u003e). Comments mapped to more than one construct or that included both facilitator and barrier attributes were counted multiple times. Among 245 total comments abstracted from analyzed projects, potential barriers or facilitators of implementation were identified across all five CFIR domains and across 32 of 38 domain constructs and/or subconstructs., Table\u0026nbsp;\u003cspan refid=\"Tab2\" class=\"InternalRef\"\u003e2\u003c/span\u003e includes selected illustrative comments, among constructs coded with \u0026ge;\u0026thinsp;3 comments.\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab2\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 2\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eSelected Examples of Participant Feedback Mapped to CFIR Construct \u003csup\u003ea\u003c/sup\u003e\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"5\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c4\" colnum=\"4\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c5\" colnum=\"5\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003eDomain/Construct/Subconstruct\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colspan=\"2\" nameend=\"c3\" namest=\"c2\"\u003e \u003cp\u003eFacilitator\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e \u003cp\u003eBarrier\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eI. Innovation\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ea. Evidence strength and quality\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cem\u003eDermoscopy use for teledermatology was strongly recommended as the standard of care by the specialty when primary care referring for skin lesions.\u003c/em\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eb. Relative advantage\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cem\u003eAcceptance of the concept of \"regionalization\" for cancer care, and acceptance that laparoscopic surgery (MIS\u0026thinsp;=\u0026thinsp;minimally invasive surgery) was superior to open surgery.\u003c/em\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ec. Complexity\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e \u003cp\u003e\u003cem\u003eWe need a standardized approach to coding to identify patients with eating disorders and their treatment courses.\u003c/em\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eII. Inner Setting\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ea. Networks \u0026amp; communications\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cem\u003eEarly relationships with ED and cardiology chairs; iterative process of improving the tool and giving feedback on preliminary results along the way.\u003c/em\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eb. Readiness f or implementation\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ei. Leadership engagement\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cem\u003eI think having regional leads and physicians as part of the study brought forth the value of the order set as well understanding how it was implemented.\u003c/em\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eii. Available resources\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e \u003cp\u003e\u003cem\u003eNeed to have ongoing data support from Region to continue to implement change in practice.\u003c/em\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eiii. Access to knowledge \u0026amp; information\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cem\u003eFirstly, having clear and undeniable data that showed the superiority of the new regionalized MIS approach vs the traditional approach to care. Frequent updates by lead (ST) to Surgery Chiefs at their meetings to continually socialize the project and to explain the \"why\" behind the needed changes (based on the data) to our regional organization of gastric cancer care.\u003c/em\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ec. Culture\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e \u003cp\u003e\u003cem\u003eSome medical centers wanted to stick with their current workflow out of ease rather than effectiveness and cost-savings.\u003c/em\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ed. Structural characteristics\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e \u003cp\u003e\u003cem\u003eCommunication and complexity of our very large medical group. Education and adoption are difficult without some automation to make work of implementation easier for very busy AFM docs with little time\u003c/em\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c2\" namest=\"c1\"\u003e \u003cp\u003ee. Implementation Climate\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c5\" namest=\"c4\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c2\" namest=\"c1\"\u003e \u003cp\u003ei. Tension for change\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c5\" namest=\"c4\"\u003e \u003cp\u003e\u003cem\u003eBecause it is NOT a clinical trial, and given the dogmatic nature of surgeons, the specialty leadership has decided (a priori) that specific changes would not be implemented, but this information would inform our practice patterns and patient-level discussions.\u003c/em\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c2\" namest=\"c1\"\u003e \u003cp\u003eii. Compatibility\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e\u003cem\u003eDeveloped program from the ground up for population level identification of] FH [familial hypercholesterolemia] and management of FH. Implemented a fully integrated pathway from patient identification to care in FH specialty Clinic in a purpose-built accountable Health Connect FH ecosystem.\u003c/em\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c5\" namest=\"c4\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eIII. Outer Setting\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ea. Peer pressure\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cem\u003eMany patients discontinued immunosuppressive therapy during the pandemic. These data reinforced societal guidelines, with data, that they should continue and that steroids should be minimized where possible.\u003c/em\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eIV. characteristics of individuals\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eA. individual stage of change\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e \u003cp\u003e\u003cem\u003eInterpersonal conflict and competition between [clinicians] in the \u0026hellip; group has been a huge barrier in changing regional practice to this new standard\u003c/em\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eV. Process\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ea. engaging\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eI. key stakeholders\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cem\u003eFrom the outset key stakeholders/thought leaders in DOR-RAU [Rapid Analytics Unit] and \u0026hellip; [TPMG] Consulting came together to work with PI and others to define primary goals or project and develop system wide approach to identify patients and take action to address the care gap, with periodic meeting to monitor progress and change course as needed.\u003c/em\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c4\" namest=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"1\" nameend=\"c5\" namest=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003ctfoot\u003e \u003ctr\u003e\u003ctd colspan=\"5\"\u003e\u003csup\u003ea\u003c/sup\u003e Selected comments displayed for constructs mapped\u0026thinsp;\u0026gt;\u0026thinsp;3 times.\u003c/td\u003e\u003c/tr\u003e \u003c/tfoot\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003eFacilitators were most commonly mapped to the inner setting (n\u0026thinsp;=\u0026thinsp;51 comments) and the innovation characteristics (n\u0026thinsp;=\u0026thinsp;40) domains. Barriers were reported in the inner setting (n\u0026thinsp;=\u0026thinsp;29), individual characteristics (n\u0026thinsp;=\u0026thinsp;5), and innovation characteristics (n\u0026thinsp;=\u0026thinsp;4) domains.\u003c/p\u003e \u003cdiv id=\"Sec4\" class=\"Section2\"\u003e \u003ch2\u003eInnovation Characteristics\u003c/h2\u003e \u003cdiv id=\"Sec5\" class=\"Section3\"\u003e \u003ch2\u003eFacilitators\u003c/h2\u003e \u003cp\u003eThe innovation domain\u0026rsquo;s \u003cem\u003eevidence strength and quality\u003c/em\u003e construct was a facilitator for 29 out of 45 (64%) projects (Fig.\u0026nbsp;\u003cspan refid=\"Fig2\" class=\"InternalRef\"\u003e2\u003c/span\u003e). This construct reflects the stakeholder\u0026rsquo;s perception that the available evidence supports the belief that the innovation will likely achieve its desired outcomes. The \u003cem\u003erelative advantage\u003c/em\u003e of the new evidence-based innovation was also frequently cited (n\u0026thinsp;=\u0026thinsp;11). This construct incorporates the stakeholder\u0026rsquo;s perceived advantage of the studied topic vs. an alternative approach. For example, one clinician investigator noted that, for rapid delivery of clot-dissolving medications for stroke care, the project\u0026rsquo;s data supported implementation and that, \u0026ldquo;since implementation we have used the data collected to continue to [further] improve performance to where we are currently treating over 80% of patients in \u0026lt;\u0026thinsp;30 minutes, a target that was considered unachievable when we started. [These data supported] expansion to 24x7 and two shifts of tele-neurologists to maintain this performance.\u0026rdquo; Another project, which found a commonly performed surgical procedure to have no clear benefit, informed de-implementation, allowing \u0026ldquo;elimination of the routine placement of jejunostomy tubes pre-chemotherapy or intraoperatively [for patients undergoing certain gastrointestinal cancer surgeries]. No one in the nation was doing this yet.\u0026rdquo; Evaluation of a coordinated care team approach for patients with gastric cancer provided \u0026ldquo;clear and undeniable data that showed the superiority of the new regionalized \u0026hellip; approach vs the traditional approach to care...and [provided] the \"why\" behind the needed changes (based on the data) to our regional [re-] organization of gastric cancer care.\u0026rdquo; This project demonstrated this approach markedly decreased time to guideline-concordant chemotherapy, post-operative complications, and total post-operative hospital stay.\u003csup\u003e29\u003c/sup\u003e\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003c/div\u003e \u003c/div\u003e \u003cdiv id=\"Sec6\" class=\"Section2\"\u003e \u003ch2\u003eBarriers\u003c/h2\u003e \u003cp\u003eWithin the innovation domain, innovation \u003cem\u003ecomplexity\u003c/em\u003e was a commonly reported barrier to implementation (n\u0026thinsp;=\u0026thinsp;4) (Fig.\u0026nbsp;\u003cspan refid=\"Fig3\" class=\"InternalRef\"\u003e3\u003c/span\u003e). This construct relates to the innovation\u0026rsquo;s perceived difficulty for implementation, including scope, intricacy, duration, and disruptiveness. For example, \u0026ldquo;a standardized approach to coding\u0026rdquo; was needed to identify patients with eating disorders for an intervention. However, the difficulty, accuracy, and complexity of creating such an accurate standardized electronic approach impaired broader next-step implementation.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec7\" class=\"Section2\"\u003e \u003ch2\u003eInner Setting\u003c/h2\u003e \u003cdiv id=\"Sec8\" class=\"Section3\"\u003e \u003ch2\u003eFacilitators\u003c/h2\u003e \u003cp\u003eWithin the inner setting domain, the \u003cem\u003enetworks and communications\u003c/em\u003e (n\u0026thinsp;=\u0026thinsp;20) construct and, within the \u003cem\u003ereadiness for implementation\u003c/em\u003e construct, the \u003cem\u003eleadership engagement\u003c/em\u003e (n\u0026thinsp;=\u0026thinsp;19) subconstruct had the most frequent facilitator comments. The network and communications construct describes availability of developed formal and informal communications and social networks for communications within an organization. The leadership engagement subconstruct includes the perceived involvement of relevant leaders for innovation implementation. For example, a respondent for a project that evaluated the safety of a new clinical decision support tool for patients with pulmonary embolism illustrated the interplay between networks, communications, and leadership engagement: \u0026ldquo;These study results allowed us to expand tool access to non-study [emergency departments] across KPNC and teach physicians in these departments why and how the application can improve patient care\u0026hellip; [this was facilitated by] prior relationships with the [emergency department] chiefs\u0026rsquo; group that helped open the door for the expansion of tool access to non-study [emergency departments] across KPNC.\u0026rdquo;​\u003csup\u003e30\u003c/sup\u003e\u003c/p\u003e \u003c/div\u003e \u003c/div\u003e \u003cdiv id=\"Sec9\" class=\"Section2\"\u003e \u003ch2\u003eBarriers\u003c/h2\u003e \u003cp\u003eSeveral inner setting constructs were perceived barriers to implementation, particularly resources and the need for a greater learning/change culture. Within the \u003cem\u003ereadiness for implementation\u003c/em\u003e construct, the a\u003cem\u003evailable resources\u003c/em\u003e subconstruct, defined as sufficient dedicated organizational resources for both implementation and ongoing operations, was the most cited barrier (n\u0026thinsp;=\u0026thinsp;15). Data support, programmers, and automation were among the most commonly resources needed. A project assessing an integrated, multidisciplinary head and neck cancer care program identified the \u0026ldquo;need to have ongoing data support from the region to continue to implement change in practice,\u0026rdquo; as a barrier to ongoing multidisciplinary tumor boards. A respondent for a study on decreased prostate cancer screening following the 2012 USPSTF guidance stated, \u0026ldquo;Education and adoption is difficult without [creating] some automation to make work of implementation easier for very busy \u0026hellip; docs with little time; [successful implementation also needs] \u0026hellip; a shared decision aid for screening within [the electronic medical record] and access to [medical record] programmers \u0026hellip; so we can make changes faster.\u0026rdquo;\u003c/p\u003e \u003cp\u003eWithin the inner setting domain\u0026rsquo;s \u003cem\u003eimplementation climate\u003c/em\u003e construct, several barriers were identified. Five projects cited need for an expanded \u003cem\u003elearning climate\u003c/em\u003e or learning culture as a barrier, this subconstruct is related to the organization\u0026rsquo;s norms, values, and basic assumptions. One project, for example, stated that \u0026ldquo;some medical centers wanted to stick with their current workflow out of ease rather than effectiveness and cost-savings.\u0026rdquo; A project evaluating a new surgical method that would require centers of excellence stated that next-step broader implementation was \u0026ldquo;strongly opposed by the group\u0026hellip;as compared to traditional \u0026hellip; approaches [that were familiar to those surgeons],\u0026rdquo; reflecting the teams\u0026rsquo; cultural hesitancy for adopting new paradigms. An additional common barrier was the \u003cem\u003etension for change\u003c/em\u003e (n\u0026thinsp;=\u0026thinsp;4), a sub-construct reflecting stakeholders\u0026rsquo; perceptions whether the current status needs change. Finally, barriers were noted within the inner setting domain\u0026rsquo;s \u003cem\u003estructural characteristics\u003c/em\u003e (n\u0026thinsp;=\u0026thinsp;4) construct, which reflect perceptions regarding the organization\u0026rsquo;s architecture, maturity, and size for implementing change.\u003c/p\u003e \u003cdiv id=\"Sec10\" class=\"Section3\"\u003e \u003ch2\u003eOuter Setting\u003c/h2\u003e \u003cdiv id=\"Sec11\" class=\"Section4\"\u003e \u003ch2\u003eFacilitators\u003c/h2\u003e \u003cp\u003eWithin the \u003cem\u003eouter setting\u003c/em\u003e domain, the \u003cem\u003epeer pressure\u003c/em\u003e construct was a commonly noted implementation facilitator (n\u0026thinsp;=\u0026thinsp;6). This construct includes competitive pressure, where other organizations have either already implemented an innovation or there is a desire to implement it first, to gain a relative competitive advantage to the external organizations. For one care integration effort, a physician investigator noted, for example: \u0026ldquo;This effort\u0026hellip; lays groundwork needed to bring at least 6 different surgical service lines together to work on a specific issue that will help bring our Surgery Services to the next level in providing in-house complex cancer care which previously [needed to be] referred out to [external tertiary university medical centers].\u0026rdquo; External policies and incentives were also identified as a facilitator. Two projects, one in prostate cancer screening and one regarding colorectal cancer polyp surveillance, stated that the combination of internal evidence development and relevant external care guidelines, together, compelled the implementation of practice change.\u003c/p\u003e \u003c/div\u003e \u003c/div\u003e \u003c/div\u003e \u003cdiv id=\"Sec12\" class=\"Section2\"\u003e \u003ch2\u003eCharacteristics of Individuals\u003c/h2\u003e \u003cdiv id=\"Sec13\" class=\"Section3\"\u003e \u003ch2\u003eBarriers\u003c/h2\u003e \u003cp\u003eWithin the \u003cem\u003echaracteristics of individuals\u003c/em\u003e domain, the \u003cem\u003eindividual stage of change\u003c/em\u003e (n\u0026thinsp;=\u0026thinsp;5) construct was a commonly cited barrier to implementation. This construct refers to relevant individuals\u0026rsquo; skilled, progressive, and sustained implementation of the evidence-based innovation. For example, one project identified \u0026ldquo;conflict and competition between [individual] surgeons in the [specific specialty surgical] group has been a huge barrier in changing regional practice to this new standard\u0026rdquo; and another project evaluating effectiveness and potential harms of a large-scale initiative changing from an inpatient to outpatient procedural workflow, identified \u0026ldquo;[clinician] reticence to change\u0026rdquo; as a key individual characteristic impeding spread and more universal implementation.\u003csup\u003e\u003cem\u003e31\u003c/em\u003e\u003c/sup\u003e\u003c/p\u003e \u003c/div\u003e \u003c/div\u003e \u003cdiv id=\"Sec14\" class=\"Section2\"\u003e \u003ch2\u003eProcess\u003c/h2\u003e \u003cdiv id=\"Sec15\" class=\"Section3\"\u003e \u003ch2\u003eFacilitators\u003c/h2\u003e \u003cp\u003eWithin the \u003cem\u003eprocess\u003c/em\u003e domain, the \u003cem\u003eengaging\u003c/em\u003e construct, especially the \u003cem\u003ekey stakeholder\u003c/em\u003e engagement (n\u0026thinsp;=\u0026thinsp;4) subconstruct, was the most cited facilitator to implementation. This included the investigators themselves being embedded operational leaders. For example, one project evaluating optimal surveillance strategies for hepatocellular carcinoma included regional clinical leads for the surveillance program as co-investigators; these leaders could then directly implement the evidence-based results.\u003csup\u003e32\u003c/sup\u003e Another project evaluating the electronic identification of patients with familial hypercholesterolemia closely incorporated both an engaged regional clinical topic-specific clinician and technological leaders for rapid deployment of a next-step population management program.\u003csup\u003e33\u003c/sup\u003e\u003c/p\u003e \u003c/div\u003e \u003c/div\u003e"},{"header":"Discussion","content":"\u003cp\u003eThis study evaluated, for the first time to our knowledge, barriers and facilitators of new evidence-to-implementation cycles that are common across large numbers of specialties and project topics, using standardized data collection and a well-established conceptual framework. Across projects, the most common facilitators of implementation were the strength of the new evidence for informing clinical change, specialty communication networks for disseminating knowledge, leadership engagement, and the innovation\u0026rsquo;s relative advantage over existing practices. The main barriers were limited system-level resources (especially technological methods and personnel), need for greater embracement of a culture for learning and change, variable individual-level motivation for change, insufficient tension for change, and innovation complexity. These potentially replicable facilitators and modifiable barriers can focus, among the numerous topics within conceptual implementation frameworks, those with the likely greatest benefit-for-effort for health systems pursuing large-volume evidence-to-implementation initiatives.\u003c/p\u003e \u003cp\u003eThese findings markedly extend the current literature regarding barriers and facilitators of evidence-to-implementation continuum. To accomplish rapid-cycle, high-volume change, healthcare systems require the systematic translation of evidence-based research to practice across many topics and specialties.\u003csup\u003e34\u003c/sup\u003e However, most current implementation literature evaluates a single topic, a certain medical specialty setting, or, when characterizing multiple projects, may summarize disparate already-published single-topic data collected using different methods.\u003csup\u003e35, 36,37,38,20,25,39\u003c/sup\u003e While useful for specific efforts, this approach may not identify the common and generalizable domains attainable from using a consistent, prospective approach to data collection and mapping across multiple projects. In contrast, identifying common potentially modifiable implementation facilitators and barriers across many project topics can enumerate the likely highest-yield systems-level topic areas relevant for strategic development of learning health systems.\u003csup\u003e40\u003c/sup\u003e The \u0026ldquo;engaging\u0026rdquo; process, for example, was identified as an important cross-topic facilitator. It includes specific efforts frequently not done, such as social marketing of the innovation, user education, training, role modeling, etc., that can accelerate the transition to implementation across multiple topics areas. Within KPNC, such strategies were effectively used by only some groups; this study\u0026rsquo;s results are now informing and replicating their broad use.\u003c/p\u003e \u003cp\u003eThe current study has several strengths. First, it evaluated potential translation-to-implementation barriers and facilitators across many research studies using a common data collection instrument. The identification of common themes increases the likelihood that the findings are generalizable to diverse settings and topics. Second, it utilized a common framework, the Consolidated Framework for Implementation Research. CFIR\u0026rsquo;s framework can evaluate implementation before, during, or after project completion.\u003csup\u003e18, 19, 24\u003c/sup\u003e Thus, the results use theories, constructs, and language that are readily comparable to other settings or investigations.\u003csup\u003e18,23\u003c/sup\u003e Finally, complementing studies from academic university centers, the current study\u0026rsquo;s community-based, multi- medical center setting that includes approximately 1% of people in the United States and 40% of the region\u0026rsquo;s underlying population provides common facilitators and barriers where most people receive care \u0026ndash; community-based health care delivery systems.\u003c/p\u003e \u003cp\u003eStudy limitations include the limited data for each project evaluated. Given the large number of projects, common format for data collection, need for understandable language without jargon, and limited time availability of clinicians and operational leaders, a structured questionnaire was used rather than expansive formative or semi-structured interviews. The evaluation is within a not-for-profit integrated care setting, which, while being generally comparable to how many patients in the United States are currently treated within Accountable Care Organizations, differs from some other settings.\u003csup\u003e4\u003c/sup\u003e The results may be less relevant for settings with multiple distinct care delivery structures between inpatient, outpatient, and specialty care or for systems with different incentive systems, such as fee-for-service; these factors may create different barriers and facilitators of implementation. The projects evaluated were also within a specific delivery science and applied research program; although the structures for innovation programs may differ, the high level of concordance across projects in this setting suggest these are likely facilitators and barriers more common to topics than to a single program. Future multi-topic evaluations in different settings will be useful to evaluate areas of concordance and discordance.\u003c/p\u003e"},{"header":"Conclusions","content":"\u003cp\u003eIn conclusion, the current analysis evaluated numerous evidence-to-implementation projects for potential implementation facilitators and barriers, utilized an established implementation framework to classify elements across projects, and described the most common themes, with examples. These findings can inform and focus, among the large number of potential topics described within conceptual frameworks, those areas with the likely greatest benefit-for-effort to address within multi-faceted health systems pursuing large-volume evidence-to-implementation initiatives to accelerate evidence-based care.\u003c/p\u003e"},{"header":"Declarations","content":"\n\u003cp\u003e\u003cu\u003eEthics approval and consent to participate:\u003c/u\u003e The KPNC Research Determination Committee determined the project did not meet the regulatory definition of research involving human subjects requiring institutional board approval.\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eConsent for publication:\u003c/u\u003e Not applicable.\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eAvailability of data and materials:\u003c/u\u003e The datasets generated and/or analyzed during the current study are not publicly available due to the qualitative nature of the data derivation and mapping, but relevant data and approaches are available from the corresponding author on reasonable request.\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eCompeting interests:\u003c/u\u003e All authors are employees of The Permanente Medical Group. The authors have no other relationships or conflicts of interest to declare.\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eFunding:\u003c/u\u003e This study was funded by The Permanente Medical Group via its Delivery Science and Applied Research (DARE) Program.\u0026nbsp;\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eAuthors\u0026apos; contributions:\u003c/u\u003e CD participated in the design and distribution of the survey tool, evaluation conceptualization, synthesis and interpretation of data, and drafting of the manuscript. SP participated in obtaining regulatory approval, synthesis and interpretation of data, and drafting of the manuscript. JLS participated in the design and distribution of the survey tool and drafting of the manuscript. TL, JAS, SR, YC and KL participated in drafting of the manuscript. DAC participated in the study design, conceptualization synthesis and interpretation of data, and drafting of the manuscript.\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eAcknowledgements:\u003c/u\u003e We appreciate Michael Hartmann for assisting with the presentation of data for figures two and three.\u0026nbsp;\u003c/p\u003e"},{"header":"References","content":"\u003col\u003e\n\u003cli\u003eLengnick-Hall R, Proctor EK, Bunger AC, Gerke DR. Ten years of implementation outcome research: a scoping review protocol. \u003cem\u003eBMJ Open\u003c/em\u003e. 2021;11(6):e049339. doi:10.1136/bmjopen-2021-049339\u003c/li\u003e\n\u003cli\u003eInstitute of Medicine Roundtable on Evidence-Based M. In: Olsen L, Aisner D, McGinnis JM, eds. \u003cem\u003eThe Learning Healthcare System: Workshop Summary\u003c/em\u003e. National Academies Press (US) Copyright \u0026copy; 2007, National Academy of Sciences.; 2007.\u003c/li\u003e\n\u003cli\u003eMorris ZS, Wooding S, Grant J. The answer is 17 years, what is the question: understanding time lags in translational research. \u003cem\u003eJ R Soc Med\u003c/em\u003e. Dec 2011;104(12):510-20. doi:10.1258/jrsm.2011.110180\u003c/li\u003e\n\u003cli\u003eTu T, Muhlestein, David, Kocot, S. Lawrence and White, Ross \u003cem\u003eThe Impact of Accountable Care: Origins and Future of Accountable Care Organzations\u003c/em\u003e. Report. 2015. 2015. Accessed 18 Apr 2024. https://www.brookings.edu/wp-content/uploads/2016/06/impact-of-accountable-careorigins-052015.pdf\u003c/li\u003e\n\u003cli\u003eSmith JD, Hasan M. Quantitative approaches for the evaluation of implementation research studies. \u003cem\u003ePsychiatry Res\u003c/em\u003e. Jan 2020;283:112521. doi:10.1016/j.psychres.2019.112521\u003c/li\u003e\n\u003cli\u003eLau R, Stevenson F, Ong BN, Dziedzic K, Treweek S, Eldridge S, Everitt H, Kennedy A, Qureshi N, Rogers A, Peacock R, Murray E. Achieving change in primary care--causes of the evidence to practice gap: systematic reviews of reviews. \u003cem\u003eImplement Sci\u003c/em\u003e. Mar 22 2016;11:40. doi:10.1186/s13012-016-0396-4\u003c/li\u003e\n\u003cli\u003eKarabukayeva A, Hearld LR, Kelly R, Hall A, Singh J. Association between the number of adopted implementation strategies and contextual determinants: a mixed-methods study. \u003cem\u003eBMC Health Serv Res\u003c/em\u003e. Dec 13 2022;22(1):1518. doi:10.1186/s12913-022-08736-2\u003c/li\u003e\n\u003cli\u003eMarufu TR, Bower RR, Hendron E, Manning JR. Nursing interventions to reduce medication errors in paediatrics and neonates: Systematic review and meta-analysis. \u003cem\u003eJ Pediatr Nurs\u003c/em\u003e. Jan-Feb 2022;62:e139-e147. doi:10.1016/j.pedn.2021.08.024\u003c/li\u003e\n\u003cli\u003ePollock A, Campbell P, Cheyne J, Cowie J, Davis B, McCallum J, McGill K, Elders A, Hagen S, McClurg D, Torrens C, Maxwell M. Interventions to support the resilience and mental health of frontline health and social care professionals during and after a disease outbreak, epidemic or pandemic: a mixed methods systematic review. \u003cem\u003eCochrane Database Syst Rev\u003c/em\u003e. Nov 5 2020;11(11):Cd013779. doi:10.1002/14651858.Cd013779\u003c/li\u003e\n\u003cli\u003eWeir NM, Newham R, Dunlop E, Bennie M. Factors influencing national implementation of innovations within community pharmacy: a systematic review applying the Consolidated Framework for Implementation Research. \u003cem\u003eImplement Sci\u003c/em\u003e. Mar 4 2019;14(1):21. doi:10.1186/s13012-019-0867-5\u003c/li\u003e\n\u003cli\u003eGlasgow RE, Chambers D. Developing Robust, Sustainable, Implementation Systems Using Rigorous, Rapid and Relevant Science. \u003cem\u003eClinical and Translational Science\u003c/em\u003e. 2012;5(1):48-55. doi:10.1111/j.1752-8062.2011.00383.x\u003c/li\u003e\n\u003cli\u003eLieu TA, Madvig PR. Strategies for Building Delivery Science in an Integrated Health Care System. \u003cem\u003eJ Gen Intern Med\u003c/em\u003e. Jun 2019;34(6):1043-1047. doi:10.1007/s11606-018-4797-8\u003c/li\u003e\n\u003cli\u003eCorley DA, Kilbourne A. The Learning Health System: The Tools Are Here-Why Aren\u0026apos;t We Moving Forward? \u003cem\u003eGastroenterology\u003c/em\u003e. Dec 2021;161(6):1747-1750. doi:10.1053/j.gastro.2021.07.047\u003c/li\u003e\n\u003cli\u003eDavis AC, Voelkel JL, Remmers CL, Adams JL, McGlynn EA. Comparing Kaiser Permanente Members to the General Population: Implications for Generalizability of Research. \u003cem\u003ePerm J\u003c/em\u003e. Jun 15 2023;27(2):87-98. doi:10.7812/tpp/22.172\u003c/li\u003e\n\u003cli\u003eGordon NP. How Does the Adult Kaiser Permanente Membership in Northern California Compare with the Larger Community? . Kaiser Permanente Northern California Division of Research Accessed Dec 19, 2023. https://memberhealthsurvey.kaiser.org/Documents/comparison_kaiser_vs_nonKaiser_adults_kpnc.pdf\u003c/li\u003e\n\u003cli\u003eDelivery Science and Applied Research. The Permanente Medical Group. Accessed 18 Apr 2024, kp.org/dare\u003c/li\u003e\n\u003cli\u003ePrausnitz S, Altschuler A, Herrinton LJ, Avins AL, Corley DA. The implementation checklist: A pragmatic instrument for accelerating research-to-implementation cycles. \u003cem\u003eLearn Health Syst\u003c/em\u003e. Jul 2023;7(3):e10359. doi:10.1002/lrh2.10359\u003c/li\u003e\n\u003cli\u003eDamschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. \u003cem\u003eImplementation Science\u003c/em\u003e. 2009;4(1):50. doi:10.1186/1748-5908-4-50\u003c/li\u003e\n\u003cli\u003eAhmed S, Zidarov D, Eilayyan O, Visca R. Prospective application of implementation science theories and frameworks to inform use of PROMs in routine clinical care within an integrated pain network. \u003cem\u003eQual Life Res\u003c/em\u003e. Nov 2021;30(11):3035-3047. doi:10.1007/s11136-020-02600-8\u003c/li\u003e\n\u003cli\u003eAtkins E, Birmpili P, Glidewell L, Li Q, Johal AS, Waton S, Boyle JR, Pherwani AD, Chetter I, Cromwell DA. Effectiveness of quality improvement collaboratives in UK surgical settings and barriers and facilitators influencing their implementation: a systematic review and evidence synthesis. \u003cem\u003eBMJ Open Qual\u003c/em\u003e. Apr 2023;12(2)doi:10.1136/bmjoq-2022-002241\u003c/li\u003e\n\u003cli\u003eBreimaier HE, Heckemann B, Halfens RJG, Lohrmann C. The Consolidated Framework for Implementation Research (CFIR): a useful theoretical framework for guiding and evaluating a guideline implementation process in a hospital-based nursing practice. \u003cem\u003eBMC Nursing\u003c/em\u003e. 2015;14(1)doi:10.1186/s12912-015-0088-4\u003c/li\u003e\n\u003cli\u003eDamschroder LJ, Reardon CM, Opra Widerquist MA, Lowery J. Conceptualizing outcomes for use with the Consolidated Framework for Implementation Research (CFIR): the CFIR Outcomes Addendum. \u003cem\u003eImplement Sci\u003c/em\u003e. Jan 22 2022;17(1):7. doi:10.1186/s13012-021-01181-5\u003c/li\u003e\n\u003cli\u003eKeith RE, Crosson JC, O\u0026rsquo;Malley AS, Cromp D, Taylor EF. Using the Consolidated Framework for Implementation Research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation. \u003cem\u003eImplementation Science\u003c/em\u003e. 2017;12(1)doi:10.1186/s13012-017-0550-7\u003c/li\u003e\n\u003cli\u003eKirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the Consolidated Framework for Implementation Research. \u003cem\u003eImplement Sci\u003c/em\u003e. May 17 2016;11:72. doi:10.1186/s13012-016-0437-z\u003c/li\u003e\n\u003cli\u003eLi W, Su M, Zhang W, Fan X, Li R, Gao Y, Wei X. Barriers and facilitators of implementing electronic monitors to improve adherence and health outcomes in tuberculosis patients: protocol for a systematic review based on the Consolidated Framework for Implementation Research. \u003cem\u003eHealth Res Policy Syst\u003c/em\u003e. Nov 1 2023;21(1):115. doi:10.1186/s12961-023-01054-x\u003c/li\u003e\n\u003cli\u003eResearch CRT-CfCM. Consolidated Framework for Implementation Research. Accessed Dec 19, 2023. https://cfirguide.org/\u003c/li\u003e\n\u003cli\u003eHuynh AK, Hamilton AB, Farmer MM, Bean-Mayberry B, Stirman SW, Moin T, Finley EP. A Pragmatic Approach to Guide Implementation Evaluation Research: Strategy Mapping for Complex Interventions. \u003cem\u003eFront Public Health\u003c/em\u003e. 2018;6:134. doi:10.3389/fpubh.2018.00134\u003c/li\u003e\n\u003cli\u003eMorse JM. Critical Analysis of Strategies for Determining Rigor in Qualitative Inquiry. \u003cem\u003eQual Health Res\u003c/em\u003e. Sep 2015;25(9):1212-22. doi:10.1177/1049732315588501\u003c/li\u003e\n\u003cli\u003eTeh SH, Shiraga S, Kellem AM, Li RA, Le DM, Arsalane SP, Khayat FS, Li Y, Gong I-Y, Lee JM. A Path to High-Value Gastric Cancer Surgery Care Delivery. \u003cem\u003eAnnals of Surgery Open\u003c/em\u003e. 2024;5(2):e408. doi:10.1097/as9.0000000000000408\u003c/li\u003e\n\u003cli\u003eVinson DR, Casey SD, Vuong PL, Huang J, Ballard DW, Reed ME. Sustainability of a Clinical Decision Support Intervention for Outpatient Care for Emergency Department Patients With Acute Pulmonary Embolism. \u003cem\u003eJAMA Netw Open\u003c/em\u003e. May 2 2022;5(5):e2212340. doi:10.1001/jamanetworkopen.2022.12340\u003c/li\u003e\n\u003cli\u003eVuong B, Graff-Baker AN, Yanagisawa M, Chang SB, Mentakis M, Shim V, Knox M, Romero L, Kuehner G. Implementation of a Post-mastectomy Home Recovery Program in a Large, Integrated Health Care Delivery System. \u003cem\u003eAnn Surg Oncol\u003c/em\u003e. Oct 2019;26(10):3178-3184. doi:10.1245/s10434-019-07551-0\u003c/li\u003e\n\u003cli\u003eLam JO, Hurley LB, Lai JB, Saxena V, Seo S, Chamberland S, Quesenberry CP, Jr., Champsi JH, Ready J, Chiao EY, Marcus JL, Silverberg MJ. Cancer in People with and without Hepatitis C Virus Infection: Comparison of Risk Before and After Introduction of Direct-Acting Antivirals. \u003cem\u003eCancer Epidemiol Biomarkers Prev\u003c/em\u003e. Dec 2021;30(12):2188-2196. doi:10.1158/1055-9965.Epi-21-0742\u003c/li\u003e\n\u003cli\u003eBirnbaum RA, Horton BH, Gidding SS, Brenman LM, Macapinlac BA, Avins AL. Closing the gap: Identification and management of familial hypercholesterolemia in an integrated healthcare delivery system. \u003cem\u003eJ Clin Lipidol\u003c/em\u003e. Mar-Apr 2021;15(2):347-357. doi:10.1016/j.jacl.2021.01.008\u003c/li\u003e\n\u003cli\u003eKanani N, Hahn EE, Gould MK, Brunisholz KD, Savitz LA, Holve EC. AcademyHealth\u0026apos;s Delivery System Science Fellowship: Training Embedded Researchers to Design, Implement, and Evaluate New Models of Care. \u003cem\u003eJournal of Hospital Medicine\u003c/em\u003e. 2017;12(7):570-574. doi:10.12788/jhm.2776\u003c/li\u003e\n\u003cli\u003eGrol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients\u0026apos; care. \u003cem\u003eLancet\u003c/em\u003e. Oct 11 2003;362(9391):1225-30. doi:10.1016/s0140-6736(03)14546-1\u003c/li\u003e\n\u003cli\u003eZhou S, Ma J, Dong X, Li N, Duan Y, Wang Z, Gao L, Han L, Tu S, Liang Z, Liu F, Labresh KA, Smith SC, Jin Y, Zheng Z-J. Barriers and enablers in the implementation of a quality improvement program for acute coronary syndromes in hospitals: a qualitative analysis using the consolidated framework for implementation research. \u003cem\u003eImplementation Science\u003c/em\u003e. 2022;17(1)doi:10.1186/s13012-022-01207-6\u003c/li\u003e\n\u003cli\u003eWestafer LM, Jessen E, Zampi M, Boccio E, Casey SD, Lindenauer PK, Vinson DR. Barriers and Facilitators to the Outpatient Management of Low-risk Pulmonary Embolism From the Emergency Department. \u003cem\u003eAnn Emerg Med\u003c/em\u003e. Sep 2023;82(3):381-393. doi:10.1016/j.annemergmed.2023.02.021\u003c/li\u003e\n\u003cli\u003ede Moel-Mandel C, Lynch C, Issaka A, Braver J, Zisis G, Carrington MJ, Oldenburg B. Optimising the implementation of digital-supported interventions for the secondary prevention of heart disease: a systematic review using the RE-AIM planning and evaluation framework. \u003cem\u003eBMC Health Serv Res\u003c/em\u003e. Dec 4 2023;23(1):1347. doi:10.1186/s12913-023-10361-6\u003c/li\u003e\n\u003cli\u003eTikellis G, Hoffman M, Mellerick C, Burge AT, Holland AE. Barriers to and facilitators of the use of oxygen therapy in people living with an interstitial lung disease: a systematic review of qualitative evidence. \u003cem\u003eEur Respir Rev\u003c/em\u003e. Sep 30 2023;32(169)doi:10.1183/16000617.0066-2023\u003c/li\u003e\n\u003cli\u003eCREST Network Web page. The Permanente Medical Group. Accessed Dec 20, 2023. https://deliveryscience-appliedresearch.kaiserpermanente.org/specialty-research-networks/crest-network\u003c/li\u003e\n\u003c/ol\u003e"}],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":true,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":false,"highlight":"","institution":"","isAcceptedByJournal":true,"isAuthorSuppliedPdf":false,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":false,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"bmc-health-services-research","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"bhsr","sideBox":"Learn more about [BMC Health Services Research](http://bmchealthservres.biomedcentral.com/)","snPcode":"","submissionUrl":"https://www.editorialmanager.com/BHSR/default.aspx","title":"BMC Health Services Research","twitterHandle":"BMC_series","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"em","reportingPortfolio":"BMC Series","inReviewEnabled":true,"inReviewRevisionsEnabled":true},"keywords":"Implementation, CFIR, Learning Health System, Barriers, Facilitators","lastPublishedDoi":"10.21203/rs.3.rs-4618789/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-4618789/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003ch2\u003eBackground\u003c/h2\u003e \u003cp\u003eBroad-scale, rapid health care change is critically needed to improve value-based, effective health care. Health care providers and systems need to address common barriers and facilitators across the evidence to implementation pathway, across diverse specialties. However, most evidence translation / implementation research evaluates single topic areas, and may be of limited value for informing comprehensive efforts. This project\u0026rsquo;s objective was to identify, characterize, and illustrate common trans-topic facilitators and barriers of translating new health care evidence results to clinical implementation across multiple medical specialties.\u003c/p\u003e\u003ch2\u003eMethods\u003c/h2\u003e \u003cp\u003eThis study was an evaluation of all evidence-based innovation projects completed during 2019\u0026ndash;2021. Each project was created with medical group clinical leaders and was intended to inform clinical care. The evaluation took place in a large community-based integrated health care system, and an embedded delivery science and applied research program. Clinical investigators, scientific investigators, and clinical operational leaders received structured questionnaires regarding barriers and facilitators for the operational implementation of new research findings for each project. Responses were mapped to the Consolidated Framework for Implementation Research to identify perceived implementation barriers and facilitators.\u003c/p\u003e\u003ch2\u003eResults\u003c/h2\u003e \u003cp\u003eAll 48 projects completed between 2019\u0026ndash;2021 were evaluated; responses were received for 45 (94%) and 34 had comments mappable to framework domains. Potential barriers and facilitators to clinical implementation of new research results were identified across all five framework domains and, within these, the 38 constructs or sub-constructs. Among 245 total comments, the most commonly cited facilitators were how the new research evidence generated compelled change (n\u0026thinsp;=\u0026thinsp;29), specialty communication networks for disseminating results and initiating change (n\u0026thinsp;=\u0026thinsp;20), leadership engagement in the project (n\u0026thinsp;=\u0026thinsp;19), and the innovation\u0026rsquo;s relative advantage over existing practices (n\u0026thinsp;=\u0026thinsp;11). The most commonly cited barriers were inadequate resource commitment for next-step implementation (n\u0026thinsp;=\u0026thinsp;15), insufficient learning/implementation culture (n\u0026thinsp;=\u0026thinsp;5), and insufficient individual-level willingness/ability for change (n\u0026thinsp;=\u0026thinsp;5).\u003c/p\u003e\u003ch2\u003eConclusions\u003c/h2\u003e \u003cp\u003eA novel large-scale evaluation of barriers and facilitators across the evidence to implementation pathway identified common factors across multiple topic areas and specialties. These common potentially replicable facilitators and modifiable barriers can focus health systems and leaders pursuing large-volume evidence-to-implementation initiatives on those areas with the likely greatest benefit-for-effort, for accelerating health care change.\u003c/p\u003e","manuscriptTitle":"Barriers and Facilitators to High-Volume Evidence-Based Innovation and Implementation in a Large, Community-Based Learning Health System","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2024-08-09 20:53:15","doi":"10.21203/rs.3.rs-4618789/v1","editorialEvents":[{"type":"communityComments","content":0},{"type":"decision","content":"Revision requested","date":"2024-07-10T05:41:38+00:00","index":"","fulltext":""},{"type":"editorAssigned","content":"","date":"2024-07-09T10:18:31+00:00","index":"","fulltext":""},{"type":"checksComplete","content":"","date":"2024-07-09T10:17:13+00:00","index":"","fulltext":""},{"type":"submitted","content":"BMC Health Services Research","date":"2024-06-21T17:40:02+00:00","index":"","fulltext":""}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"bmc-health-services-research","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"bhsr","sideBox":"Learn more about [BMC Health Services Research](http://bmchealthservres.biomedcentral.com/)","snPcode":"","submissionUrl":"https://www.editorialmanager.com/BHSR/default.aspx","title":"BMC Health Services Research","twitterHandle":"BMC_series","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"em","reportingPortfolio":"BMC Series","inReviewEnabled":true,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"9756532f-1814-43bf-a83c-9307f317f397","owner":[],"postedDate":"August 9th, 2024","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"published-in-journal","subjectAreas":[],"tags":[],"updatedAt":"2024-11-25T16:00:54+00:00","versionOfRecord":{"articleIdentity":"rs-4618789","link":"https://doi.org/10.1186/s12913-024-11803-5","journal":{"identity":"bmc-health-services-research","isVorOnly":false,"title":"BMC Health Services Research"},"publishedOn":"2024-11-21 15:57:17","publishedOnDateReadable":"November 21st, 2024"},"versionCreatedAt":"2024-08-09 20:53:15","video":"","vorDoi":"10.1186/s12913-024-11803-5","vorDoiUrl":"https://doi.org/10.1186/s12913-024-11803-5","workflowStages":[]},"version":"v1","identity":"rs-4618789","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-4618789","identity":"rs-4618789","version":["v1"]},"buildId":"7rjqhiLT3MXkJMwkYKINL","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}