What Influences the Outcome of Active Disinvestment Processes in Healthcare? A Qualitative Interview Study on five Recent Cases of Active Disinvestment

What Influences the Outcome of Active Disinvestment Processes in Healthcare? A Qualitative Interview Study on five Recent Cases of Active Disinvestment | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research article What Influences the Outcome of Active Disinvestment Processes in Healthcare? A Qualitative Interview Study on five Recent Cases of Active Disinvestment Adriënne Henderika Rotteveel, Mattijs S. Lambooij, Joline J.A. van de Rijt, and 3 more This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-59485/v1 This work is licensed under a CC BY 4.0 License Status: Published Journal Publication published 01 Apr, 2021 Read the published version in BMC Health Services Research → Version 1 posted 11 You are reading this latest preprint version Abstract Background : Recent attempts of active disinvestment (i.e. withdrawal of reimbursement by means of a policy decision) of reimbursed healthcare interventions in the Netherlands have differed in their outcome: some were successful, with interventions actually being disinvested, while others were terminated at some point, implying continuation of reimbursement. This study aimed to obtain insight into recent active disinvestment processes, and to explore what aspects affect their outcome. Methods : Semi-structured interviews were conducted from January to December 2018 with stakeholders (e.g. patients, policymakers, physicians) who were involved in the policy process of five cases for which the full or partial withdrawal of reimbursement was considered in the Netherlands between 2007 and 2017: benzodiazepines, medication for Fabry disease, quit smoking programme, psychoanalytic therapy and maternity care assistance. These cases covered both interventions that were eventually disinvested and interventions for which reimbursement was maintained after consideration. Interviews were transcribed verbatim, double coded and analyzed using thematic analysis. Results : The 37 interviews showed that support for disinvestment from stakeholders, especially from healthcare providers and policymakers, strongly affected the outcome of the disinvestment process. Furthermore, the institutional role of stakeholders as legitimized by the Dutch health insurance system, their financial interests in maintaining or discontinuing reimbursement, and the possibility to relieve the consequences of disinvestment for current patients affected the outcome of the disinvestment process as well. No evidence was found of a consistent role of the formal Dutch package criteria (i.e. effectiveness, cost-effectiveness, necessity and feasibility) in active disinvestment processes. Conclusions: Contextual factors as well as the possibility to relieve the consequences of disinvestment for current patients are important determinants of the outcome of active disinvestment processes. These results provide insight into active disinvestment processes and their determinants, and provide guidance to policymakers for a potentially more successful approach for future active disinvestment processes. Health Economics & Outcomes Research Health Policy Health Law Health technology reassessment policy process agenda-setting policy formulation decision-making determinants qualitative research 1. Background Over the last decades, OECD countries have spent an increasing proportion of their gross domestic product (GDP) on healthcare [ 1 – 3 ]. It is expected that healthcare expenditures will keep growing faster than the GDP due to demographic changes and the introduction of technological innovations, increasing the pressure on public financing [ 3 , 4 ]. To limit this increase in healthcare spending, governments worldwide have introduced cost-saving policy initiatives, such as lean thinking and retracting inefficient processes [ 5 ]. Furthermore, proposals for disinvestment (i.e. withdrawal, restriction, retraction or replacement [ 6 , 7 ]) of healthcare interventions and services have been made [ 5 , 8 , 9 ]. Reasons for disinvestment may be, among others, ineffectiveness, unsafety or a lack of value for money [ 10 , 11 ]. Furthermore, disinvestment can either be passive (i.e. not dependent upon direct policy intervention) or active (i.e. requiring direct policy intervention, such as a reimbursement decision) [ 12 ]. In the Netherlands, adults are obliged to buy individual private health insurance. Although this health insurance is provided on a competitive health insurance market, the coverage (i.e. the basic benefits package) is similar for everyone [ 13 ]. Most types of curative care are automatically included in the basic benefits package, except for outpatient pharmaceutical care and expensive inpatient pharmaceutical care. For these two types of care, assessment and appraisal by the National Healthcare Institute ( Zorginstituut Nederland ; ZiNL) and a subsequent positive decision by the Minister of Health, Welfare and Sports (hereafter referred to as ‘the Minister’) are a prerequisite for health insurance coverage. ZiNL uses four package criteria for its formal assessment, i.e. effectiveness, cost-effectiveness (i.e. do the effects outweigh the costs), necessity (i.e. do disease severity and the costs per patient justify coverage), and feasibility (i.e. is coverage feasible), with effectiveness being a knockout criterion [ 14 – 16 ]. For interventions that are covered by the basic benefits package, it is assumed that if they do not meet the package criteria anymore (e.g. because of new evidence or because of new alternatives becoming available), they will no longer be delivered by healthcare providers (passive disinvestment), so that explicit exclusion of these interventions (active disinvestment) is not necessary [ 14 ]. However, in recent years, the Minister has taken several decisions to exclude specific interventions from the basic benefits package, indicating that the assumption that existing interventions not meeting the package criteria anymore will automatically be (passively) disinvested may not always hold [ 17 , 18 ]. Hence, active disinvestment may be needed. Active disinvestment may also be necessary in the case of conditional reimbursement (also called: coverage with evidence development). In the Netherlands, it is possible to conditionally reimburse promising healthcare interventions that do not (yet) meet the package criteria in a special arrangement that is targeted at collecting evidence on the effectiveness and cost-effectiveness of these interventions. In such an arrangement, healthcare interventions will be temporarily reimbursed, provided that additional research will be conducted. After a predetermined time, usually 4 years, the reimbursement of the intervention will be reassessed using the findings from this additional research, which may result in a disinvestment decision [ 19 , 20 ]. In the international literature, active disinvestment has been described as a very difficult process [ 21 ], hampered by contextual aspects such as political barriers [ 22 , 23 ], a lack of dedicated resources [ 22 ], and disinvestment being considered counter-cultural [ 24 ]. Furthermore, it has been suggested that, in order to obtain more insight into this difficult process, qualitative studies are needed [ 23 ]. Active disinvestment processes in the Netherlands have clearly differed in their outcome. While some cases resulted in actual disinvestment, others were terminated at some point, implying continuation of reimbursement. Currently, not much is known about active disinvestment processes in the Netherlands and what aspects (package criteria versus other considerations and contextual aspects) determine their outcome. Therefore, here, we aimed to obtain more insight into active disinvestment processes and to explore what aspects determine their outcome. We used a qualitative approach consisting of semi-structured interviews, which enabled us to obtain in-depth insight in the factors influencing the outcome of active disinvestment processes. 2. Methods This study focused on policy processes in which the active disinvestment of healthcare interventions or services, which have previously been (conditionally) reimbursed to patients through the basic health insurance, was considered. Active disinvestment includes the full withdrawal, restriction, retraction or substitution of the reimbursement of healthcare interventions or services by means of a policy decision [ 6 , 12 ]. In policy making, several stages can be distinguished (i.e. the policy cycle): 1) agenda-setting, 2) policy formulation, 3) decision-making, 4) policy implementation and 5) policy evaluation [ 25 ]. As the aim of this study was to assess the outcome of active disinvestment processes (i.e. what decision was made with regards to disinvestment), this study mainly focused on the agenda-setting, policy formulation, and decision-making stages of active disinvestment processes. 2.1 Theoretical framework We have used the three essential elements in policy making - actors, ideas and structures [ 25 ] - to select distinct cases (see Sect. 2.2), to inform data collection (i.e. to inform the interview guide, see Sect. 2.3) and to structure data analysis (i.e. to structure the coding tree, see Sect. 2.4). Actors are people or organizations who either 1) try to influence policy to advance their interests or 2) are being influenced by policy. The ideas actors have, can range from particular points of view to a widely held, sustained belief system. Arguments are expressions of these ideas. The structures in which actors operate are arenas in which policy processes take place and that affect the role that actors and their ideas can play in policy-making [ 25 ]. In addition, we have used the model of the organization of the Dutch Healthcare system [ 26 ] to guide data collection (i.e. identify categories of actors that may have been involved in the cases studies) and structure data analysis (i.e. to determine actor codes). 2.2 Selection of cases This study focused on five distinct cases to study active disinvestment processes. Possible cases were interventions for which disinvestment was formally and actively considered in the period 2007–2017. This includes interventions that have eventually been actively disinvested, either fully or partially, and interventions for which reimbursement has been maintained. Through screening of policy documents from ZINL and the Ministry of Health, Welfare and Sports (hereafter referred to as ‘the Ministry’) that were found on the websites of ZiNL and the Ministry using specific search terms (e.g. stopping reimbursement, disinvestment), 34 possible cases for which active disinvestment was considered, were identified (see Additional file A). From these 34 possible cases, 5 were selected that were expected to be distinct in 1) the actors, ideas (i.e. reasons for considering disinvestment) or structures involved, and 2) the outcome of the disinvestment process (fully or partially disinvested or reimbursement maintained). Cases were (year of decision in brackets): Benzodiazepines (that are mainly used for anxiety and sleeping disorders; 2007, 2008), Medication for Fabry disease (2012), Quit smoking program (2009, 2011, 2012), Psychoanalytic therapy (2010), and Maternity care assistance (in Dutch: Kraamzorg; 2015). See Additional file B for a description of the selected cases. 2.3 Data collection Semi-structured interviews were conducted with actors who were involved in the disinvestment process for the selected cases. Involved actors were identified from policy documents, through media coverage of the case and through interviews with other actors, and approached through e-mail. New respondents were included for each case until 1) no new information regarding the case emerged from the interviews (i.e. informational redundancy/data saturation was reached for the case [ 27 ]), 2) all eligible actors for the case were interviewed (i.e. no other actors were involved), or 3) there were no eligible actors left who were willing to participate. The interview topic list was developed for this study and covered actors, ideas, and structures involved in the agenda-setting, policy formulation, and decision-making stage of the disinvestment process. Besides, if relevant, we asked participants to reflect on differences and similarities between the disinvestment process for the case discussed and other reimbursement processes (both investment and disinvestment) they were involved in (if any). The semi-structured interview guide is included in Additional file C. Interviews were audio-recorded and transcribed verbatim. 2.3.1 Ethical considerations Written informed consent was obtained at the start of the interview. Respondents were explained that only the research team would have access to the audio recordings and transcripts of their interviews, and that they would handle this information confidentially. Furthermore, respondents were explained that, with regards to publications on this study, no names of persons and/or organizations (apart from ZiNL and the Ministry), nor any specific information which would reveal the identity of respondents would be reported. Quotes that were used in this paper were approved by respondents, without them having the possibility to change anything regarding the findings. This research project has been assessed by the Centre for Clinical Expertise (CCE) at the RIVM. The CCE concluded that the research project is exempted from further review by a medical ethics committee as it does not fulfill the specific conditions as stated in the Dutch Medical Research Involving Human Subjects Act (WMO; Wet Medisch-wetenschappelijk Onderzoek met mensen) . 2.4 Data analysis Interview transcripts were analyzed using thematic content analysis [ 28 ]. Transcripts were coded by AR, using a combination of deductive and inductive coding. Text segments from the transcripts were coded using the essential elements in policy making (actors, ideas and structures; see Sect. 2.1). The part of the coding tree for the essential element ‘ideas’ was derived from the Dutch package criteria and the review of Kleinhout-Vliek et al. [ 14 , 29 , 30 ]. The complete coding tree is displayed in Additional file D. Coding was conducted using MAXQDA 2019 [ 31 ]. A subset of 15 interviews was also coded by JvdR to assess the reliability of data analysis [ 32 ]. This subset was purposively selected to include three interviews on each case and to include interviews with different types of respondents. Within this subset of 15 interviews, there was sufficient consensus between both coders on the text fragments coded and the codes used to code these fragments. Therefore, double coding of the remaining interviews was deemed unnecessary (i.e. remaining interviews were only coded by AR). To facilitate the analysis, coded text segments were aggregated in three matrices (one for actors, one for ideas and one for structures), with the rows in these matrices displaying the codes and the columns displaying the cases, arranged from most disinvested (i.e. reimbursement fully stopped) to least disinvested (i.e. decision to continue reimbursement). The cells in the matrices contained a short summary of the information in the text segments coded under the respective code for each case. The matrices were inspected by AR, ML and GdW for recurring themes and trends on the disinvestment process itself and aspects determining the outcome of this process. To this end, the authors focused on the differences and commonalities between the studied cases, especially between the cases with similar or very different outcomes. The final main themes were determined through discussion between AR, ML and GdW, focusing on aspects that appeared to have had the largest (or a surprisingly small) impact on the outcome of the disinvestment process in the studied cases. The final themes were checked for plausibility and approved by the second coder based on his/her knowledge of the data from coding a subset of the interviews. 3. Results In total, 37 interviews with 37 respondents and an average duration of 53 minutes were conducted between January and December 2018. Of the 37 interviews, 32 were held with one respondent, four with two respondents, and one with four respondents. Of the 37 respondents, 5 were interviewed on multiple cases (counted as separate interviews). Most interviews were administered by one interviewer (AR). In four interviews, a second interviewer joined (GdW or N.J.E. van Vooren) because of the number of respondents taking part in the interviews. A timeline displaying the reimbursement status and the policy reports published on the case was brought to the interviews to stimulate remembrance and to support the conversation (see Additional file E). Table 1 shows the number of interviews that was conducted per case and per respondent group. In four out of five cases, either data saturation was reached and/or all eligible actors were interviewed. In the quit smoking program case, not all eligible actors were interviewed as we did not succeed to include a politician who was involved. Table 1 Number of interviews conducted per case and per respondent group Case Respondent group Total number per case Patients Healthcare providers 1 Health insurers National Healthcare Institute (ZINL) Ministry of health, welfare and sports Other Benzodiazepines 1 2 1 2 2 1 2 9 Medication for Fabry disease 1 1 1 1 1 1 3 6 Quit smoking program 1 0 4 1 1 1 3 5 7 Psychoanalytic therapy 1 3 6 1 1 NA 7 1 2 7 Maternity care assistance 1 3 8 1 1 2 0 8 Total over all cases 5 9 5 6 6 6 37 1 The respondent group healthcare providers includes both (leading) individual healthcare providers as well as healthcare provider organizations (e.g. physician associations) 2 i.e. knowledge institute 3 i.e. pharmaceutical company 4 In this case, several interviewees are from interest groups that represent both patients and healthcare providers as well (i.e. different actor groups are united in one organization). Therefore, the healthcare provider perspective has been covered in the other interviews. 5 i.e. interest groups + advisor of interest groups 6 In this case, in the first interview with a healthcare provider, we identified two even more involved healthcare providers. Therefore, in total, three interviews with healthcare providers were necessary for this case. 7 Disinvestment decisions based on (lack of evidence of) effectiveness can be taken by the National Healthcare Institute and do not need involvement by the Ministry. For this reason, the Ministry was not involved in the disinvestment decision regarding psychoanalytic therapy, and was, hence, not interviewed. 8 Several healthcare provider organizations are involved in maternity care assistance. Therefore, we needed three interviews with healthcare providers to interview all relevant healthcare provider organizations. The remaining part of the results section is structured around the five main aspects influencing the outcome of disinvestment processes, as identified in our analysis. Here, the differences and similarities of these themes between cases are discussed. Additional file F contains a description of these themes for each case, separately. 3.1 Theme 1: Support for active disinvestment and pressure exerted In our interviews, respondents described that the degree of support for disinvestment from actors, including the public, was important for the outcome of the disinvestment process. However, the importance of support differed between actors and cases (see Additional file F and the sections below). Respondents from all cases described that the degree of support for disinvestment was related to actors’ views on the case (i.e. health problem and intervention/service concerned), and in some cases to the attention for and framing of the case in the media. Respondents described that for them, as well as for other actors, the degree of support influenced the actions undertaken, and, subsequently, the amount of pressure exerted. From a comparison of the interview data from the studied cases, we found that the pressure exerted had a large effect on the outcome of the disinvestment process: limited pressure was exerted in the cases that were actually disinvested, while much pressure was exerted in the cases for which reimbursement was maintained. In the following quote, a healthcare provider describes the effect of societal pressure on the outcome of the disinvestment process. Healthcare provider, case D, reimbursement maintained: “Yes, I believe that the social pressure, especially all media attention, including emotional arguments, helped a lot to reach this conclusion [not to stop reimbursement] in the end.” 3.1.1 Support from healthcare providers Respondents described that especially the support from healthcare providers was important for the outcome of the disinvestment process (i.e. has an important effect on the decision that policymakers make): Interest group, case C, first disinvested, later reimbursed again: “Respondent: And [the minister] actually had less of a say in that, I think. I think that the social pressure, particularly on this item from the healthcare sector, which she ultimately needs much more, also for the rest of her policy, that it is higher. Interviewer: In that respect, surely the lobby and the calls from the healthcare sector were very important in this? Respondent: To reverse it [the decision], yes, definitely.” By comparing the interview data from the studied cases, we found that the cases where healthcare providers successfully exerted pressure against disinvestment were not-disinvested, while cases where healthcare providers did not exert pressure or were unsuccessful in exerting pressure were disinvested. According to respondents, whether healthcare providers were successful in exerting pressure depended on 1) their willingness to exert pressure, subject to a) their level of support for disinvestment of the case, b) whether they feel it fits their role (e.g. whether they feel they have an advisory role which does not comply with exerting pressure) and c) their (financial) interests, and 2) the possibility they had to exert pressure, subject to a) their awareness on how to exert pressure and b) the opportunities provided to them to do so. In the first quote below, a healthcare provider from case B explains that they did not exert pressure because of their believe that disinvestment would improve healthcare delivery (i.e. other healthcare providers would better follow guidelines), suggesting their support for disinvestment. In the second quote a healthcare provider from case A describes his/her difficulty in convincing other actors to join forces (i.e. being successful) in exerting pressure. Healthcare provider, case B, partially disinvested: “And, and so in that, up to that point we were like yes, if it actually helps to have it paid for [by patients], […] and if that helps them [other health care providers] to follow our guideline better, and to give less [of the treatment], yes, then it is fine of course.” Healthcare provider, case A, fully disinvested: “ Interviewer: Was there any party that you managed to get on board? Respondent: No, not really. They did [...] I can tell it like it is. At least people paid lip service to this whole story. People understood and supported the arguments. But to say that [name] who was then president of [organization] was like 'will you state once and for all that [case] is indispensable in the Netherlands and at any cost... ', [name] never did that.” 3.1.2 Support from governmental institutions From our comparison of the interviews, we found that the opportunity provided to actors, including healthcare providers, to exert pressure seemed to depend for a large part on the opportunity actors were given by governmental institutions, who are in charge of disinvestment processes, to be involved in the policy process. We observed large differences between cases in the opportunity respondents were provided to be involved in the policy process, which seemed to depend on the support from governmental institutions for the case at hand. This is illustrated by the quotes below describing the opportunity respondents felt they were provided to be involved in case E, where policymakers described they were not in favor of disinvestment, and case A, where respondents suggested that policymakers were in favor of disinvestment. Healthcare provider, case E, reimbursement maintained: “Interviewer: But they [ZiNL] were willing to listen to you in any case? Respondent: Definitely. Interviewer: And did they also accept them, um, did they agree with the arguments you put forward? Respondent: Yes, they did. But I can still remember that they, and it's of course very good that they always wanted to investigate for themselves, were like “okay, we can't accept everything just like that”.” Patient organization, case A, fully disinvested: “And well, they [ZiNL] are always going to mention in their advice that they have spoken with – for example, right – in our case [organization name] with so and so. Yes, I can put that into perspective. Those five minutes that it took for us to quickly hand over a box of signatures, well, yes, even if it was a bit longer, that's not really a conversation, is it? There's no way you have really heard us.” From our comparison of the interview data between cases, we found that the support from governmental institutions also seemed to affect the use of the formal assessment framework in the cases studied. We observed differences between cases in respondents’ descriptions of the criteria that were used in the disinvestment process, how these criteria were interpreted, and how these criteria were weighted against one another. For instance, as is illustrated by the quotes below, in case A, where respondents suggested policymakers were in favor of disinvestment, the focus was mainly on whether the treatment was evidence-based, while in case E, where policymakers described they were not in favor of disinvestment, more considerations than strictly related to the four package criteria were taken into account in the policy process. Healthcare provider, case A, fully disinvested: “The motive was: we only reimburse things that are evidence-based. Well, a lot of what's in the package just isn't evidence-based so that's kind of a weird reasoning.” Policymakers from ZiNL, case E, reimbursement maintained: “You could say it was a very heterogeneous set of effect measures and because of that diversity and heterogeneity, well, it is sort of, it is kind of a multi-factor analysis, right, of all those factors. Are they pointing in the same direction? Do they all contribute to the goal that you want to achieve with [the case]? Well, and that answer was yes in the end.” 3.1.3 Support from patients Respondents from cases A and B, which were actually disinvested, described that patients in these cases were very vulnerable due to their disease and the societal problems associated with it. Because of this, according to respondents, patients were poorly organized, which made it difficult to get a large group of patients to exert pressure against disinvestment, as is illustrated by the quote below. This lack of pressure exerted may have facilitated disinvestment in these cases. Patient organization, case A, fully disinvested: “Yes, for most people it is a taboo, a long-term [treatment] like that. Especially when you're still in the middle of it. So, it was difficult to reach the patients. […] It was almost impossible, it was a real taboo, there is so much going on when you get such a long-term [treatment].” 3.2 Theme 2: Compassion for current users Respondents described that the degree of support from actors for disinvestment was affected by whether measures could be taken to ease the effect of disinvestment for patients currently using the intervention at hand. This is illustrated by the quotes from policymakers below in which they describe that they consider disinvestment much more difficult than not to start reimbursement in the first place, especially if disinvestment results in current patients having to stop their treatment or switch to another treatment Civil servant from the Ministry, case D, reimbursement maintained: “But you know, you are dealing with people who have been under treatment for years, um, and who are confronted with a new reality overnight. So, that also played a role, also for the Ministry. Like "yeah, you know, what is wisdom, you can't stop people’s treatment just like that".” Policymaker ZiNL, case A, fully disinvested: “And we said, "People should be allowed to finish their treatment." That was actually, there was some discussion about that. What were the arguments? I don't know. I think, I don't know how explicit that was but, yes, a reliable government, you started [the treatment] after all, yes.” Respondents described that if measures could be taken to relieve the effect of disinvestment on current patients, such as stopping reimbursement only for new patients or only restricting reimbursement, they considered disinvestment much more acceptable. This indicates that the possibility to take such mitigating measures impacts the support for disinvestment from actors and, subsequently, the outcome of the disinvestment process. 3.3 Theme 3: Role in the health insurance system From the interviews, we observed that the role appointed to actors by the Dutch health insurance system also affected the outcome of the disinvestment process. In the Dutch health insurance system, two groups of policy makers do advice the Minister on reimbursement (policy formulation): ZiNL is involved with reimbursement aspects with regards to content, while policy makers of the Ministry itself both focus at the content and context of reimbursement. Once the Minister decides on reimbursement, health insurers subsequently implement these reimbursement decisions, and patients/healthcare providers are both consulted in reimbursement decisions and in the implementation of these decisions. Every actor can be involved in agenda-setting, although policymakers often have the most distinct role in this phase. In our interviews, respondents described that for the cases studied, actors acted in accordance with the role they have in the system. They described that actors tended to stay away from pursuing actions that they considered to be beyond their formal role. For instance, in the quote below, a health insurer explains that they generally refrained from trying to influence policy formulation and decision-making on reimbursement, as they only consider the implementation of reimbursement decisions to be part of their role. Health insurer, case D, reimbursement maintained: “Actually, over the years, we've had less and less of an opinion about this sort of thing. Because we feel, you know, everyone has their part to play in the system.” Although this finding was most distinct for health insurers, other respondents also regularly discussed their tendency to stick to their formal role. As was described in the interviews, if actors felt that exerting pressure was beyond their formal role, they generally refrained from this. Hence, the formal role of actors affected the pressure that was exerted by these actors in the cases studied and, subsequently, the outcome of disinvestment processes. 3.4 Theme 4: Financial interest in disinvestment From the interviews, we observed that the actions actors took and, subsequently, the outcome of the disinvestment process were also affected by the financial interest of actors in the outcome of the disinvestment process. Respondents described that actors who had a financial interest in maintaining reimbursement were more likely to take action and exert pressure against disinvestment, than actors who did not have a financial interest in maintaining reimbursement, as is demonstrated by the quote below: Healthcare provider, case B, partially disinvested: “No, because all those [case intervention] were no longer, there wasn't a patent on them anymore, so they were... It wasn't in those manufacturers interest anymore to interfere. Otherwise it would probably not have been possible [to stop reimbursement]. Then they would have pulled out all the stops, to undo that.” 3.5 Theme 5: Role of the formal package criteria From our interviews, no consistent pattern of the influence of the formal Dutch package criteria (i.e. effectiveness, cost-effectiveness, necessity and feasibility) on the outcome of the disinvestment process was observed. This finding is illustrated by the fact that our study included two cases (i.e. case A and D) that, based on what respondents shared with us during the interviews, seemed to score similarly on the formal package criteria, while having a very different outcome (fully disinvested versus maintained), a different outcome that cannot be explained by the cases scoring differently on any other criterion as well. 4. Discussion To our knowledge, this is the first study to describe the agenda-setting, policy-formulation and decision-making stages of the active disinvestment process, and to explore aspects influencing its outcome. By using a qualitative approach, we were able to study the reasoning behind the choices made in the active disinvestment process of the five cases studied in-depth and to collect information that has not been included in the formal policy reports written about these cases. Moreover, through interviewing different actors, we were able to look at the disinvestment process from different perspectives, in addition to the formal perspective of policymakers obtained from policy reports. Our findings indicate that it is more likely for active disinvestment processes to result in a disinvestment decision if 1) there is sufficient support for disinvestment from actors, especially from policymakers and healthcare providers, 2) it is possible to ease the effect of disinvestment for patients currently using the intervention, 3) actors do not have a financial interest in maintaining reimbursement, and 4) actors are not inclined to exert pressure against disinvestment beyond their formal role. Furthermore, we found that the effect of the formal Dutch package criteria on the outcome of the disinvestment process differed between cases. 4.1 Comparison with previous studies Our finding that support, especially from healthcare providers and policymakers, is an important determinant of the outcome of the disinvestment process also has been described by previous studies in which support, especially from clinical leaders, but from the general public as well, was found to be essential for the success of the disinvestment process [ 6 , 33 , 34 ]. Furthermore, a lack of support from decision-makers has been described as a barrier to the implementation of disinvestment [ 17 ]. However, it has also been described in previous studies that obtaining support for disinvestment is very difficult as stakeholders often lack the will to support disinvestment because of limited perceived value of disinvestment, which may take some time to realize, and their resistance to immediately “losing” therapy options [ 12 , 35 ]. Hence, to make actors, especially healthcare providers and policymakers, aware of the value of disinvestment (e.g. quality improvements, reducing displacement) may be essential in order to obtain support and, subsequently, to ensure that a decision to disinvest an intervention is taken and implemented. A review from 2008 focusing on reimbursement decisions for new medicines also found healthcare providers and administrators (i.e. policymakers) to be most influential in reimbursement decisions [ 36 ], indicating that this aspect may be similar in investment and in disinvestment decisions. In our study, we found that limiting the effect of disinvestment on current patients increased support for disinvestment and, subsequently, facilitated actual disinvestment, as actors were reluctant to disrupt treatment of current patients. This has also been found in two previous studies in which citizens and policymakers expressed a reluctance to disrupt treatments because of the negative effect this may have on current patients, e.g. anxiety because of losing the current treatment option and side-effects of stopping/changing treatments [ 6 , 37 ]. Hence, when considering the disinvestment of healthcare interventions, it is important to consider if and how the treatment of current patients could be (partially) continued. This consideration may be less relevant in the context of investment as, in the investment context, patients are not yet receiving the appraised intervention, and hence, no treatment will be disrupted if a decision not to reimburse the intervention is taken. This indicates that different considerations may be relevant in the context of disinvestment compared to the context of investment. In this study, we found that actors’ financial interests influence the outcome of the active disinvestment process through the actions actors undertake. Similar findings have been described by previous studies on the disinvestment/de-implementation of low value care. For instance, van Egmond et al. found that financial incentives influence the de-implementation of low-value care by healthcare providers [ 38 ]. Furthermore, Haas et al. and Robinson et al. describe that there is a lack of financial incentives for healthcare providers to engage in disinvestment [ 24 , 39 ]. Further research is needed to determine how changing financial incentives may facilitate disinvestment. To our knowledge, our finding that actors’ inclination to exert pressure because of the role appointed to them by the health insurance system influences the outcome of active disinvestment processes has not been found by previous studies on the disinvestment of healthcare interventions. In the Netherlands, a formal assessment framework is in place for the appraisal of new healthcare interventions for reimbursement. However, in this study we found that the formal criteria from this assessment framework for new additions to the basic benefits package (i.e. effectiveness, cost-effectiveness, necessity and feasibility) have been inconsistently applied in disinvestment decisions. This finding may be problematic as a structured, evidence-based process has been described in a review from 2015 as a facilitator for (the implementation of) disinvestment [ 17 ]. Furthermore, consistency in the rationale underlying decisions has been described as an important requirement for decision-making to be considered fair [ 40 ]. Therefore, it is important for policymakers to ensure that the criteria underlying disinvestment decisions are consistently applied. Such a consistent assessment framework may also facilitate the selection of the potentially most successful (i.e. most likely to result in actual disinvestment) cases for active disinvestment processes. Previous studies have described that, although broad stakeholder engagement is considered essential for the success of disinvestment, it is considered very difficult to sufficiently organize this [ 17 , 22 , 24 ]. Although this aspect has not been specifically addressed in the current study, we did find that the possibility for stakeholders to be involved in the disinvestment process differed between cases, depending on the support from policymakers for disinvestment. Furthermore, we found that the engagement of patients was difficult, especially in cases where the patient group was in a vulnerable situation and, because of this, poorly organized. 4.2 Strengths and limitations In this study, we have used a qualitative approach which enabled us to obtain in-depth insight into the factors that influence disinvestment processes and their outcomes. Furthermore, by interviewing many different actors who have perceived the disinvestment process from different perspectives, we were able to obtain a comprehensive view of the disinvestment processes studied. Moreover, as a sample (40%) of the interview transcripts was double coded, and the matrices were checked for recurring themes by three researchers, we ensured the reliability of data analysis [ 32 ]. In addition, as the disinvestment process of the studied cases took place several years ago, it may have been perceived as a closed chapter by respondents, making elaborating on the cases less sensitive and reflecting on it easier. However, our study also has some limitations. Firstly, we have selected 5 cases from a list of 34 identified cases. Although we aimed to select 5 distinctive cases from this list, we may have missed aspects determining the outcome of the disinvestment process that may have been more pronounced in the non-selected cases. Furthermore, as we identified the 34 possible cases from policy documents, we may have introduced bias, as we could only select cases that made it to the stage of a policy document. Because of this, we may have missed cases for which the disinvestment process was terminated at a very early stage, before any policy document was written. However, even though it is clear that some information may have been omitted due to case selection, we did include a distinct selection of cases to maximize the transferability of our findings to other cases. Secondly, although we tried our best to have all the relevant topics discussed during the interviews, it may be that respondents (intentionally or unintentionally) left some relevant information out. Especially one of the five cases studied (i.e. case D) still appeared to be sensitive to respondents, indicating that it may be more prone to information omission. We tried to overcome this limitation by including multiple respondents for each case. No conflicting information was obtained from the interviews with the different respondents, indicating that there are no clear signs of information omission. Furthermore, the older cases may have also been more prone to information omission because respondents may have had trouble remembering the relevant information. We tried to overcome this by showing respondents a timeline displaying policy reports and the reimbursement status to stimulate remembrance. In the interviews, this timeline appeared to be helpful for respondents in remembering the disinvestment process. Thirdly, in the quit smoking program case we were not able to interview all eligible actors because we did not succeed in including a politician who was involved in this case. As politicians played a major role in this case, it would have been informative to interview a politician. However, as the political process was extensively discussed in the remaining interviews on the case, we expect the information omission by not including politicians to be limited. Finally, this study has been conducted in a Dutch setting. As disinvestment processes are often context-specific [ 21 ], one should take the differences between healthcare systems and other contextual factors into account when considering the implications of this study for other healthcare systems. For instance, in other healthcare systems, the roles may be differently divided between the different actors than is the case in the Dutch healthcare system. Moreover, actors may have a different tendency to stick to these roles. This may affect the importance of this aspect for the outcome of disinvestment processes in other healthcare systems. 4.3 Implications The results of this study may have implications for future active disinvestment processes. If policymakers are interested in selecting candidate interventions for which the disinvestment process is more likely to result in a disinvestment decision, they are recommended to select interventions for which there is support for disinvestment from actors, especially from healthcare providers. Furthermore, interventions for which support can be easily obtained, for instance because of the possibility to ease the consequences of disinvestment for current patients, are suitable candidate interventions as well. Moreover, also interventions for which actors do not have (strong) financial interests in maintaining reimbursement are suitable candidates for disinvestment. After having selected candidate interventions for disinvestment, policymakers are recommended to increase support for disinvestment to facilitate the disinvestment process. As support from healthcare providers appeared to be important, policymakers are recommended to start with increasing support among this actor group. To this end, healthcare providers who are not aware of all the potential merits of disinvestment should be made aware of these merits in addition to the possible disadvantages they may already be aware of (i.e. losing therapy options for new patients and disrupting treatment of current patients). In order to make these healthcare providers aware of the merits, the scientific literature suggests that the emphasis of disinvestment processes should be on safety, and quality improvements such as avoiding side effects of ineffective care, instead of cost savings as this makes disinvestment more acceptable to healthcare providers [ 18 , 41 ]. Furthermore, it is important to make these healthcare providers aware of the opportunity costs of providing the intervention that will be disinvested. For instance, healthcare providers should be explained that, by disinvesting the intervention, their time and efforts can be devoted to interventions that generate more health outcomes. Moreover, healthcare providers should be made aware of the displacement taking place in the healthcare system because of the reimbursement and usage of interventions that are unsafe or not (cost-)effective. In addition, as easing the consequences of disinvestment on current patients appeared to increase support, it is recommended to explore the opportunities to do so for candidate interventions for disinvestment. In order to facilitate disinvestment, policymakers are also recommended to explore the financial interests that actors have with regards to disinvesting or maintaining reimbursement of the intervention and the mechanisms underlying these financial interests. By being aware of this, policymakers can better anticipate on the pressure that will be exerted by actors because of these financial interests. It is important for policymakers to be aware of the fact that different considerations may be relevant in the disinvestment context compared to the investment context. For instance, the reluctance to disrupt treatment for current patients may be highly relevant with regards to disinvestment decisions, while not being relevant in the investment context. As consistency and transparency in the rationale underlying disinvestment decisions is an important requirement for the policy process to be considered fair [ 40 ], we recommend policymakers to develop, consistently apply and transparently communicate on an assessment framework for disinvestment decisions, taking into account considerations that are specifically relevant in the disinvestment context. 4.3.1 Implications for conditional reimbursement Conditional reimbursement, or coverage with evidence development is the reimbursement of (new) healthcare interventions under a specific condition, often the requirement of collecting real-world (cost-)effectiveness data. It has been proposed as a policy-tool to delay the final reimbursement decision, decreasing the uncertainty on the (cost-)effectiveness and/or budget-impact of new interventions, while making these interventions available to patients at an early stage [ 42 , 43 ]. However, conditional reimbursement has also been described as creating a wedge effect, i.e. giving suppliers a “foot in the door” while creating challenges for decision-makers when the reversal of (conditional) reimbursement is warranted [ 12 ]. As the intervention has already been provided to patients, reversal of reimbursement implies the withdrawal of treatment, which has been described in the scientific literature as far less acceptable to actors than withholding treatment [ 42 , 44 ]. However, the specific nature of conditional reimbursement processes, provides policymakers with opportunities to address the aspects influencing the likelihood of an active disinvestment process to result in a disinvestment decision, as identified in our study. For instance, conditional reimbursement has the advantage that support for disinvestment can be ensured before starting reimbursement. Therefore, to ensure support, policymakers are recommended to make agreements with actors, before starting reimbursement, on the criteria the intervention should meet to maintain reimbursement after the evaluation period. Furthermore, we recommend policymakers to change the default outcome of conditional reimbursement from ‘reimbursement is maintained if the intervention meets the criteria’ to ‘reimbursement is reversed, unless the intervention meets the criteria’. Although this difference may seem trivial, it has shown to be important psychologically [ 45 , 46 ]. Subsequently, policymakers are recommended to make sure that actors understand and agree that if the intervention does not meet the agreed upon criteria at the end of the reimbursement period, it will be disinvested. In this way, policymakers ensure that actors know that care is only provided under the precondition that it can be withdrawn later on, which makes withdrawing treatment similar to withholding treatment from a psychological point of view [ 42 , 44 ]. 5. Conclusions In conclusion, this study indicates that contextual aspects such as support, institutional structures and financial interests are important determinants of the outcome of active disinvestment processes. Furthermore, the possibility to relieve the consequences of disinvestment for current patients appeared to be important to increase the acceptability of disinvestment. These results provide researchers and policymakers with insight into disinvestment processes in the Netherlands. Furthermore, the results can be used by policymakers in the selection of future candidate interventions for disinvestment and in future disinvestment processes to increase the likelihood of the disinvestment process to result in an actual disinvestment decision. Moreover, the results can be used by policymakers to prevent some of the challenges inherent in reversing reimbursement after a period of conditional reimbursement. Abbreviations CCE: Centre for Clinical Expertise GDP: Gross Domestic Product OECD: Organisation for Economic Cooperation and Development ZINL: Dutch National Healthcare Institute Declarations Ethics approval and consent to participate Written informed consent was obtained at the start of the interview. This research project has been assessed by the Centre for Clinical Expertise (CCE) at the RIVM and concluded that the research project is exempted from further review by a medical ethics committee as it does not fulfill the specific conditions as stated in the Dutch Medical Research Involving Human Subjects Act (WMO; Wet Medisch-wetenschappelijk Onderzoek met mensen) . Consent for publication Quotes that were used in this paper were approved by respondents. Availability of data and materials The interviews analyzed during the current study are not publicly available due to concerns for respondents’ privacy. However, a summary of the interview data on each theme for each case is included in additional file F. Competing interests The authors declare that they have no competing interests. Funding This research was funded by the strategic research programme RIVM (S/133005), a research fund from the National Institute of Public Health and the Environment, the Netherlands. Funders had no role in the design of the study, its conduct, and the analysis and interpretation of the results and were not involved in manuscript preparation or submission. Authors contribution AR designed and conducted the study, coded and analyzed interview data and wrote the manuscript. ML designed the study, performed data analysis and contributed to the manuscript. JvdR coded and analyzed interview data and contributed to the manuscript. NvE and KM were involved in the design of the study and contributed to the manuscript. GdW designed the study, performed data collection and analysis and contributed to the manuscript. All authors read and approved the final manuscript. Acknowledgements The authors would like to thank the respondents for their participation in this study. Furthermore, the authors would like to thank Natascha van Vooren for her help with conducting the interviews and the valuable suggestion of bringing a timeline to the interviews to support the conversation. References Organisation for Economic Co-operation and Development: OECD Health Statistics 2019 . In., November 2019 edn; 2019. Getzen TE, Okunade AA: Symposium Introduction : Papers on ‘ Modeling National Health Expenditures ’. Health Econ 2016. de la Maisonneuve C, Martins JO. The future of health and long-term care spending. OECD journal: Economic studies. 2015;2014(1):61–96. van der Horst A, van Erp F, de Jong J: Trends in gezondheid en zorg . In: CPB policy brief. vol. 2011/11: Centraal planbureau; 2011. Donaldson C, Bate A, Mitton C, Dionne F, Ruta D. Rational disinvestment. QJM: An International Journal of Medicine. 2010;103(10):801–7. Daniels T, Williams I, Robinson S, Spence K. Tackling disinvestment in health care services: The views of resource allocators in the English NHS. Journal of Health Organisation Management. 2013;27(6):762–80. Williams I, Robinson S, Dickinson H. Rationing in health care: the theory and practice of priority setting. Bristol: The policy press; 2012. Brody H. From an ethics of rationing to an ethics of waste avoidance. N Engl J Med. 2012;366(21):1949–51. Calabro GE, La Torre G, de Waure C, Villari P, Federici A, Ricciardi W, Specchia ML. Disinvestment in healthcare: an overview of HTA agencies and organizations activities at European level. BMC Health Serv Res. 2018;18(1):148. Harris C, Allen K, King R, Ramsey W, Kelly C, Thiagarajan M. Sustainability in Health care by Allocating Resources Effectively (SHARE) 2: identifying opportunities for disinvestment in a local healthcare setting. BMC Health Serv Res. 2017;17(1):328. "I won't call it rationing… An ethnographic study of healthcare disinvestment in theory and practice . Soc Sci Med 2015, 128 :273–281. Parkinson B, Sermet C, Clement F, Crausaz S, Godman B, Garner S, Choudhury M, Pearson SA, Viney R, Lopert R, et al. Disinvestment and Value-Based Purchasing Strategies for Pharmaceuticals: An International Review. Pharmacoeconomics. 2015;33(9):905–24. van de Ven WPMM, Schut FT. Universal mandatory health insurance in the Netherlands: A model for the United States? Health Aff (Millwood). 2008;27(3):771–81. Couwenbergh BTLE, van der Meer M, Weghaus-Reus SE, Schelleman H, Zwaap J: Pakketbeheer in de praktijk ( deel 3 ) [ Package management in practice ( part 3 )]. In.: College voor Zorgverzekeringen; 2013. Zwaap J: Package advice in practice - Deliberations for arriving at a fair package . In. Diemen: National Healthcare Institute; 2017. Ministry of Health Welfare and Sports: Besluit van 23 april . 2018, houdende wijziging van het Besluit zorgverzekering in verband met regels voor de toelating van geneesmiddelen tot het basispakket [ in Dutch] . In., vol. 131; 2018. Mayer J, Nachtnebel A. Disinvesting from ineffective technologies: Lessons learned from current programs. Int J Technol Assess Health Care. 2015;31(6):355–62. van Dulmen S, Heus P, Kool T, Verkerk E: Doen of laten in de gezondheidszorg . Een onderzoek naar de mogelijkheden van terugdringen van niet - gepaste zorg . [ To do or not to do in healthcare . A study after the possibilities to reduce low - value care .]. In. Nijmegen: Scientific Center for Quality of Healthcare (IQ healthcare); 2019. Schelleman H: Voorwaardelijke toelating tot het basispakket 2019 . In.: Zorginstituut Nederland; 2018. Makady A, van Veelen A, de Boer A, Hillege H, Klungel OH, Goettsch W. Implementing managed entry agreements in practice: The Dutch reality check. Health Policy. 2019;123(3):267–74. MacKean G, Noseworthy T, Elshaug AG, Leggett L, Littlejohns P, Berezanski J, Clement F. Health Technology Reassessment: The art of the possible. Int J Technol Assess Health Care. 2013;29(4):418–23. Leggett L, Mackean G, Noseworthy TW, Sutherland L, Clement F. Current status of health technology reassessment of non-drug technologies: survey and key informant interviews. Health research policy systems. 2012;10:38. Polisena J, Trunk G, Gutierrez-Ibarluzea I, Joppi R. Disinvestment Activities and Candidates in the Health Technology Assessment Community: An Online Survey. Int J Technol Assess Health Care. 2019;35(3):189–94. Robinson S, Williams I, Dickinson H, Freeman T, Rumbold B. Priority-setting and rationing in healthcare: Evidence from the English experience. Soc Sci Med. 2012;75(12):2386–93. Howlett M, Ramesh M, Perl A. Studying public policy: policy cycles & policy sybsystems. 3rd ed. Ontario: Oxford University Press; 2009. Mossialos E, Djordjevic A, Osborn R, Sarnak D. International Profiles of Health Care Systems. In. New York: The Commonwealth Fund; 2017. Saunders B, Sim J, Kingstone T, Baker S, Waterfield J, Bartlam B, Burroughs H, Jinks CJQ. Quantity: Saturation in qualitative research: exploring its conceptualization and operationalization . 2018, 52(4):1893–1907. Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology. 2006;3(2):77–101. Kleinhout-Vliek T, de Bont A, Boer B. The bare necessities? A realist review of necessity argumentations used in health care coverage decisions. Health Policy. 2017;121(7):731–44. Zwaap J, Knies S, van der Meijden C, Staal P, van der Heiden L: Cost - effectiveness in practice . In. Diemen: National Health Care Institute; 2015. Software VERBI. MAXQDA 2019 . In. Berlin: VERBI Software; 2019. Mays N, Pope C. Qualitative Research: Rigour and qualitative research. BMJ. 1995;311(6997):109–12. Hodgetts K, Elshaug AG, Hiller JE. What counts and how to count it: Physicians’ constructions of evidence in a disinvestment context. Soc Sci Med. 2012;75(12):2191–9. Garpenby P. Formal priority setting in health care: the Swedish experience. Journal of Health Organization Management. 2016;30(6):891–907. Maloney MA, Schwartz L, O'Reilly D, Levine M. Drug disinvestment frameworks: Components, challenges, and solutions. Int J Technol Assess Health Care. 2017;33(2):261–9. Vuorenkoski L, Toiviainen H, Hemminki E. Decision-making in priority setting for medicines—A review of empirical studies. Health Policy. 2008;86(1):1–9. Costa S, Bentley C, Regier DA, McTaggart-Cowan H, Mitton C, Burgess MM, Peacock SJ. Public perspectives on disinvestments in drug funding: results from a Canadian deliberative public engagement event on cancer drugs. BMC Public Health. 2019;19(1):977. van Egmond S, Wakkee M, van Rengen A, Bastiaens MT, Nijsten T, Lugtenberg M. Factors influencing current low-value follow-up care after basal cell carcinoma and suggested strategies for de-adoption: a qualitative study. Br J Dermatol. 2019;180(6):1420–9. Haas M, Hall J, Viney R, Gallego G. Breaking up is hard to do: Why disinvestment in medical technology is harder than investment. Aust Health Rev. 2012;36(2):148–52. Daniels N, Sabin J. Setting limits fairly - Learning to share resources for health. 2nd ed. New York: Oxford University Press, Inc.; 2008. Harris C, Allen K, Waller C, Green S, King R, Ramsey W, Kelly C, Thiagarajan M. Sustainability in Health care by Allocating Resources Effectively (SHARE) 5: developing a model for evidence-driven resource allocation in a local healthcare setting. BMC Health Serv Res. 2017;17(1):342. van de Wetering EJ, van Exel NJA, Brouwer WBF. The Challenge of Conditional Reimbursement: Stopping Reimbursement Can Be More Difficult Than Not Starting in the First Place! Value Health. 2017;20(1):118–25. Makady A, van Acker S, Nijmeijer H, de Boer A, Hillege H, Klungel OH, Goettsch W. Conditional Financing of Drugs in the Netherlands: Past, Present, and Future—Results From Stakeholder Interviews. Value Health. 2019;22(4):399–407. Sandman L, Liliemark J. Withholding and withdrawing treatment for cost-effectiveness reasons: Are they ethically on par? Bioethics. 2019;33(2):278–86. Fryer RG Jr, Levitt SD, List J, Sadoff S: Enhancing the Efficacy of Teacher Incentives through Framing : A Field Experiment [ working paper] . In.: Harvard; 2018. Remmerswaal M, Boone J, Bijlsma M, Douven R. Cost-Sharing Design Matters: A Comparison of the Rebate and Deductible in Healthcare. In. The Hague: CPB Netherlands Bureau for Economic Policy Analysis; 2019. Supplementary Files Additionalfilespaperdisinvestmentprocesses.docx Cite Share Download PDF Status: Published Journal Publication published 01 Apr, 2021 Read the published version in BMC Health Services Research → Version 1 posted Editorial decision: Major revision 03 Feb, 2021 Review # 3 received at journal 24 Jan, 2021 Reviewer # 3 agreed at journal 07 Jan, 2021 Review # 2 received at journal 18 Nov, 2020 Reviewer # 2 agreed at journal 14 Nov, 2020 Review # 1 received at journal 04 Oct, 2020 Editor assigned by journal 21 Sep, 2020 Reviewers invited by journal 21 Sep, 2020 Reviewer # 1 agreed at journal 21 Sep, 2020 Submission checks completed at journal 17 Sep, 2020 Editor invited by journal 15 Sep, 2020 You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-59485","acceptedTermsAndConditions":true,"allowDirectSubmit":false,"archivedVersions":[],"articleType":"Research article","associatedPublications":[],"authors":[{"id":2462992,"identity":"54045b2a-224b-473e-a396-dfd028658a6c","order_by":0,"name":"Adriënne Henderika Rotteveel","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAABAklEQVRIie3PMUvEMBTA8VcCdUmv64nQfoWUDiLch0mWbO4dhAsUcpN7/RbCgbiZ8sAu+QBCXY7CudZFdFC0V29QTF1vyH96eeQHCYDPd5BxMD8XR8R8LYfhfxKo3URCPhLiJvv2hLLx7CDx6nxjnm8fEzjBpusLTGJCX/qNvoFTB5nbJ1Zf2W0OMymUsZgfl9G6ErqFs9LxrgcJGGkUitJM1VqKa4zWwG0LDP8W6UDeNS5H8iGXd0i7ScIGEmjksCNqwRmhBHjhJpndQn2pMdM0FJW9X2QVhvlAqIskjST9m8Y0psT0xcU8jVdlF7yyNmGNcvz/u/D3gk7f9/l8Pt9Unz5KYPqui4a8AAAAAElFTkSuQmCC","orcid":"https://orcid.org/0000-0002-3395-0147","institution":"National Institute for Public Health and the Environment (RIVM)","correspondingAuthor":true,"submittingAuthor":false,"prefix":"","firstName":"Adriënne","middleName":"Henderika","lastName":"Rotteveel","suffix":""},{"id":2462993,"identity":"73431cd5-42c9-4387-b695-c2b7fc0e0d43","order_by":1,"name":"Mattijs S. Lambooij","email":"","orcid":"","institution":"Rijksinstituut voor Volksgezondheid en Milieu","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Mattijs","middleName":"S.","lastName":"Lambooij","suffix":""},{"id":2462994,"identity":"4b40510a-276f-4e4b-8767-553602b71a7f","order_by":2,"name":"Joline J.A. van de Rijt","email":"","orcid":"","institution":"Erasmus Universiteit Rotterdam","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Joline","middleName":"J.A. van","lastName":"de Rijt","suffix":""},{"id":2462995,"identity":"02118903-edee-487a-847b-3f33ba7df160","order_by":3,"name":"N.J.A. van Exel","email":"","orcid":"","institution":"Erasmus Universiteit Rotterdam","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"N.J.A.","middleName":"van","lastName":"Exel","suffix":""},{"id":2462996,"identity":"fff82805-0958-4f7a-bcf8-9756253e9534","order_by":4,"name":"Karel G.M. Moons","email":"","orcid":"","institution":"Universitair Medisch Centrum Utrecht","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Karel","middleName":"G.M.","lastName":"Moons","suffix":""},{"id":2462997,"identity":"66bfe596-5480-4149-8757-b05afd7c8ace","order_by":5,"name":"G.A. de Wit","email":"","orcid":"","institution":"Rijksinstituut voor Volksgezondheid en Milieu","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"G.A.","middleName":"","lastName":"de Wit","suffix":""}],"badges":[],"createdAt":"2020-08-14 11:02:45","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-59485/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-59485/v1","draftVersion":[],"editorialEvents":[{"content":"https://doi.org/10.1186/s12913-021-06298-3","type":"published","date":"2021-04-01T19:03:24+00:00"}],"editorialNote":"","failedWorkflow":false,"files":[{"id":13594466,"identity":"03028b09-2cd5-4163-b67d-ea69c21280cb","added_by":"auto","created_at":"2021-09-17 05:20:31","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":700276,"visible":true,"origin":"","legend":"","description":"","filename":"manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-59485/v1/3cc17cec-0caf-4937-8325-6954e78895ff.pdf"},{"id":2515191,"identity":"613838f0-41e2-4fd0-a85e-7962e063692a","added_by":"auto","created_at":"2020-09-21 15:20:29","extension":"docx","order_by":1,"title":"","display":"","copyAsset":false,"role":"supplement","size":309569,"visible":true,"origin":"","legend":"","description":"","filename":"Additionalfilespaperdisinvestmentprocesses.docx","url":"https://assets-eu.researchsquare.com/files/rs-59485/v1/Additionalfilespaperdisinvestmentprocesses.docx"}],"financialInterests":"","formattedTitle":"\u003cp\u003eWhat Influences the Outcome of Active Disinvestment Processes in Healthcare? A Qualitative Interview Study on five Recent Cases of Active Disinvestment\u003c/p\u003e","fulltext":[{"header":"1. Background","content":" \u003cp\u003eOver the last decades, OECD countries have spent an increasing proportion of their gross domestic product (GDP) on healthcare [\u003cspan additionalcitationids=\"CR2\" citationid=\"CR1\" class=\"CitationRef\"\u003e1\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR3\" class=\"CitationRef\"\u003e3\u003c/span\u003e]. It is expected that healthcare expenditures will keep growing faster than the GDP due to demographic changes and the introduction of technological innovations, increasing the pressure on public financing [\u003cspan citationid=\"CR3\" class=\"CitationRef\"\u003e3\u003c/span\u003e, \u003cspan citationid=\"CR4\" class=\"CitationRef\"\u003e4\u003c/span\u003e]. To limit this increase in healthcare spending, governments worldwide have introduced cost-saving policy initiatives, such as lean thinking and retracting inefficient processes [\u003cspan citationid=\"CR5\" class=\"CitationRef\"\u003e5\u003c/span\u003e]. Furthermore, proposals for disinvestment (i.e. withdrawal, restriction, retraction or replacement [\u003cspan citationid=\"CR6\" class=\"CitationRef\"\u003e6\u003c/span\u003e, \u003cspan citationid=\"CR7\" class=\"CitationRef\"\u003e7\u003c/span\u003e]) of healthcare interventions and services have been made [\u003cspan citationid=\"CR5\" class=\"CitationRef\"\u003e5\u003c/span\u003e, \u003cspan citationid=\"CR8\" class=\"CitationRef\"\u003e8\u003c/span\u003e, \u003cspan citationid=\"CR9\" class=\"CitationRef\"\u003e9\u003c/span\u003e]. Reasons for disinvestment may be, among others, ineffectiveness, unsafety or a lack of value for money [\u003cspan citationid=\"CR10\" class=\"CitationRef\"\u003e10\u003c/span\u003e, \u003cspan citationid=\"CR11\" class=\"CitationRef\"\u003e11\u003c/span\u003e]. Furthermore, disinvestment can either be passive (i.e. not dependent upon direct policy intervention) or active (i.e. requiring direct policy intervention, such as a reimbursement decision) [\u003cspan citationid=\"CR12\" class=\"CitationRef\"\u003e12\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eIn the Netherlands, adults are obliged to buy individual private health insurance. Although this health insurance is provided on a competitive health insurance market, the coverage (i.e. the basic benefits package) is similar for everyone [\u003cspan citationid=\"CR13\" class=\"CitationRef\"\u003e13\u003c/span\u003e]. Most types of curative care are automatically included in the basic benefits package, except for outpatient pharmaceutical care and expensive inpatient pharmaceutical care. For these two types of care, assessment and appraisal by the National Healthcare Institute (\u003cem\u003eZorginstituut Nederland\u003c/em\u003e; ZiNL) and a subsequent positive decision by the Minister of Health, Welfare and Sports (hereafter referred to as \u0026lsquo;the Minister\u0026rsquo;) are a prerequisite for health insurance coverage. ZiNL uses four package criteria for its formal assessment, i.e. effectiveness, cost-effectiveness (i.e. do the effects outweigh the costs), necessity (i.e. do disease severity and the costs per patient justify coverage), and feasibility (i.e. is coverage feasible), with effectiveness being a knockout criterion [\u003cspan additionalcitationids=\"CR15\" citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR16\" class=\"CitationRef\"\u003e16\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eFor interventions that are covered by the basic benefits package, it is assumed that if they do not meet the package criteria anymore (e.g. because of new evidence or because of new alternatives becoming available), they will no longer be delivered by healthcare providers (passive disinvestment), so that explicit exclusion of these interventions (active disinvestment) is not necessary [\u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e]. However, in recent years, the Minister has taken several decisions to exclude specific interventions from the basic benefits package, indicating that the assumption that existing interventions not meeting the package criteria anymore will automatically be (passively) disinvested may not always hold [\u003cspan citationid=\"CR17\" class=\"CitationRef\"\u003e17\u003c/span\u003e, \u003cspan citationid=\"CR18\" class=\"CitationRef\"\u003e18\u003c/span\u003e]. Hence, active disinvestment may be needed.\u003c/p\u003e \u003cp\u003eActive disinvestment may also be necessary in the case of conditional reimbursement (also called: coverage with evidence development). In the Netherlands, it is possible to conditionally reimburse promising healthcare interventions that do not (yet) meet the package criteria in a special arrangement that is targeted at collecting evidence on the effectiveness and cost-effectiveness of these interventions. In such an arrangement, healthcare interventions will be temporarily reimbursed, provided that additional research will be conducted. After a predetermined time, usually 4 years, the reimbursement of the intervention will be reassessed using the findings from this additional research, which may result in a disinvestment decision [\u003cspan citationid=\"CR19\" class=\"CitationRef\"\u003e19\u003c/span\u003e, \u003cspan citationid=\"CR20\" class=\"CitationRef\"\u003e20\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eIn the international literature, active disinvestment has been described as a very difficult process [\u003cspan citationid=\"CR21\" class=\"CitationRef\"\u003e21\u003c/span\u003e], hampered by contextual aspects such as political barriers [\u003cspan citationid=\"CR22\" class=\"CitationRef\"\u003e22\u003c/span\u003e, \u003cspan citationid=\"CR23\" class=\"CitationRef\"\u003e23\u003c/span\u003e], a lack of dedicated resources [\u003cspan citationid=\"CR22\" class=\"CitationRef\"\u003e22\u003c/span\u003e], and disinvestment being considered counter-cultural [\u003cspan citationid=\"CR24\" class=\"CitationRef\"\u003e24\u003c/span\u003e]. Furthermore, it has been suggested that, in order to obtain more insight into this difficult process, qualitative studies are needed [\u003cspan citationid=\"CR23\" class=\"CitationRef\"\u003e23\u003c/span\u003e]. Active disinvestment processes in the Netherlands have clearly differed in their outcome. While some cases resulted in actual disinvestment, others were terminated at some point, implying continuation of reimbursement. Currently, not much is known about active disinvestment processes in the Netherlands and what aspects (package criteria versus other considerations and contextual aspects) determine their outcome. Therefore, here, we aimed to obtain more insight into active disinvestment processes and to explore what aspects determine their outcome. We used a qualitative approach consisting of semi-structured interviews, which enabled us to obtain in-depth insight in the factors influencing the outcome of active disinvestment processes.\u003c/p\u003e "},{"header":"2. Methods","content":" \u003cp\u003eThis study focused on policy processes in which the active disinvestment of healthcare interventions or services, which have previously been (conditionally) reimbursed to patients through the basic health insurance, was considered. Active disinvestment includes the full withdrawal, restriction, retraction or substitution of the reimbursement of healthcare interventions or services by means of a policy decision [\u003cspan citationid=\"CR6\" class=\"CitationRef\"\u003e6\u003c/span\u003e, \u003cspan citationid=\"CR12\" class=\"CitationRef\"\u003e12\u003c/span\u003e]. In policy making, several stages can be distinguished (i.e. the policy cycle): 1) agenda-setting, 2) policy formulation, 3) decision-making, 4) policy implementation and 5) policy evaluation [\u003cspan citationid=\"CR25\" class=\"CitationRef\"\u003e25\u003c/span\u003e]. As the aim of this study was to assess the outcome of active disinvestment processes (i.e. what decision was made with regards to disinvestment), this study mainly focused on the agenda-setting, policy formulation, and decision-making stages of active disinvestment processes.\u003c/p\u003e \u003cdiv id=\"Sec3\" class=\"Section2\"\u003e \u003ch2\u003e2.1 Theoretical framework\u003c/h2\u003e \u003cp\u003eWe have used the three essential elements in policy making - actors, ideas and structures [\u003cspan citationid=\"CR25\" class=\"CitationRef\"\u003e25\u003c/span\u003e] - to select distinct cases (see Sect.\u0026nbsp;2.2), to inform data collection (i.e. to inform the interview guide, see Sect.\u0026nbsp;2.3) and to structure data analysis (i.e. to structure the coding tree, see Sect.\u0026nbsp;2.4). \u003cem\u003eActors\u003c/em\u003e are people or organizations who either 1) try to influence policy to advance their interests or 2) are being influenced by policy. The \u003cem\u003eideas\u003c/em\u003e actors have, can range from particular points of view to a widely held, sustained belief system. Arguments are expressions of these ideas. The \u003cem\u003estructures\u003c/em\u003e in which actors operate are arenas in which policy processes take place and that affect the role that actors and their ideas can play in policy-making [\u003cspan citationid=\"CR25\" class=\"CitationRef\"\u003e25\u003c/span\u003e]. In addition, we have used the model of the organization of the Dutch Healthcare system [\u003cspan citationid=\"CR26\" class=\"CitationRef\"\u003e26\u003c/span\u003e] to guide data collection (i.e. identify categories of actors that may have been involved in the cases studies) and structure data analysis (i.e. to determine actor codes).\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec4\" class=\"Section2\"\u003e \u003ch2\u003e2.2 Selection of cases\u003c/h2\u003e \u003cp\u003eThis study focused on five distinct cases to study active disinvestment processes. Possible cases were interventions for which disinvestment was formally and actively considered in the period 2007\u0026ndash;2017. This includes interventions that have eventually been actively disinvested, either fully or partially, and interventions for which reimbursement has been maintained. Through screening of policy documents from ZINL and the Ministry of Health, Welfare and Sports (hereafter referred to as \u0026lsquo;the Ministry\u0026rsquo;) that were found on the websites of ZiNL and the Ministry using specific search terms (e.g. stopping reimbursement, disinvestment), 34 possible cases for which active disinvestment was considered, were identified (see Additional file A). From these 34 possible cases, 5 were selected that were expected to be distinct in 1) the actors, ideas (i.e. reasons for considering disinvestment) or structures involved, and 2) the outcome of the disinvestment process (fully or partially disinvested or reimbursement maintained). Cases were (year of decision in brackets): Benzodiazepines (that are mainly used for anxiety and sleeping disorders; 2007, 2008), Medication for Fabry disease (2012), Quit smoking program (2009, 2011, 2012), Psychoanalytic therapy (2010), and Maternity care assistance (in Dutch: Kraamzorg; 2015). See Additional file B for a description of the selected cases.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec5\" class=\"Section2\"\u003e \u003ch2\u003e2.3 Data collection\u003c/h2\u003e \u003cp\u003eSemi-structured interviews were conducted with actors who were involved in the disinvestment process for the selected cases. Involved actors were identified from policy documents, through media coverage of the case and through interviews with other actors, and approached through e-mail. New respondents were included for each case until 1) no new information regarding the case emerged from the interviews (i.e. informational redundancy/data saturation was reached for the case [\u003cspan citationid=\"CR27\" class=\"CitationRef\"\u003e27\u003c/span\u003e]), 2) all eligible actors for the case were interviewed (i.e. no other actors were involved), or 3) there were no eligible actors left who were willing to participate.\u003c/p\u003e \u003cp\u003eThe interview topic list was developed for this study and covered actors, ideas, and structures involved in the agenda-setting, policy formulation, and decision-making stage of the disinvestment process. Besides, if relevant, we asked participants to reflect on differences and similarities between the disinvestment process for the case discussed and other reimbursement processes (both investment and disinvestment) they were involved in (if any). The semi-structured interview guide is included in Additional file C. Interviews were audio-recorded and transcribed verbatim.\u003c/p\u003e \u003cdiv id=\"Sec6\" class=\"Section3\"\u003e \u003ch2\u003e2.3.1 Ethical considerations\u003c/h2\u003e \u003cp\u003eWritten informed consent was obtained at the start of the interview. Respondents were explained that only the research team would have access to the audio recordings and transcripts of their interviews, and that they would handle this information confidentially. Furthermore, respondents were explained that, with regards to publications on this study, no names of persons and/or organizations (apart from ZiNL and the Ministry), nor any specific information which would reveal the identity of respondents would be reported. Quotes that were used in this paper were approved by respondents, without them having the possibility to change anything regarding the findings. This research project has been assessed by the Centre for Clinical Expertise (CCE) at the RIVM. The CCE concluded that the research project is exempted from further review by a medical ethics committee as it does not fulfill the specific conditions as stated in the Dutch Medical Research Involving Human Subjects Act (WMO; \u003cem\u003eWet Medisch-wetenschappelijk Onderzoek met mensen)\u003c/em\u003e.\u003c/p\u003e \u003c/div\u003e \u003c/div\u003e \u003cdiv id=\"Sec7\" class=\"Section2\"\u003e \u003ch2\u003e2.4 Data analysis\u003c/h2\u003e \u003cp\u003eInterview transcripts were analyzed using thematic content analysis [\u003cspan citationid=\"CR28\" class=\"CitationRef\"\u003e28\u003c/span\u003e]. Transcripts were coded by AR, using a combination of deductive and inductive coding. Text segments from the transcripts were coded using the essential elements in policy making (actors, ideas and structures; see Sect.\u0026nbsp;2.1). The part of the coding tree for the essential element \u0026lsquo;ideas\u0026rsquo; was derived from the Dutch package criteria and the review of Kleinhout-Vliek et al. [\u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e, \u003cspan citationid=\"CR29\" class=\"CitationRef\"\u003e29\u003c/span\u003e, \u003cspan citationid=\"CR30\" class=\"CitationRef\"\u003e30\u003c/span\u003e]. The complete coding tree is displayed in Additional file D. Coding was conducted using MAXQDA 2019 [\u003cspan citationid=\"CR31\" class=\"CitationRef\"\u003e31\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eA subset of 15 interviews was also coded by JvdR to assess the reliability of data analysis [\u003cspan citationid=\"CR32\" class=\"CitationRef\"\u003e32\u003c/span\u003e]. This subset was purposively selected to include three interviews on each case and to include interviews with different types of respondents. Within this subset of 15 interviews, there was sufficient consensus between both coders on the text fragments coded and the codes used to code these fragments. Therefore, double coding of the remaining interviews was deemed unnecessary (i.e. remaining interviews were only coded by AR).\u003c/p\u003e \u003cp\u003eTo facilitate the analysis, coded text segments were aggregated in three matrices (one for actors, one for ideas and one for structures), with the rows in these matrices displaying the codes and the columns displaying the cases, arranged from most disinvested (i.e. reimbursement fully stopped) to least disinvested (i.e. decision to continue reimbursement). The cells in the matrices contained a short summary of the information in the text segments coded under the respective code for each case. The matrices were inspected by AR, ML and GdW for recurring themes and trends on the disinvestment process itself and aspects determining the outcome of this process. To this end, the authors focused on the differences and commonalities between the studied cases, especially between the cases with similar or very different outcomes. The final main themes were determined through discussion between AR, ML and GdW, focusing on aspects that appeared to have had the largest (or a surprisingly small) impact on the outcome of the disinvestment process in the studied cases. The final themes were checked for plausibility and approved by the second coder based on his/her knowledge of the data from coding a subset of the interviews.\u003c/p\u003e \u003c/div\u003e "},{"header":"3. Results","content":"\u003cp\u003eIn total, 37 interviews with 37 respondents and an average duration of 53 minutes were conducted between January and December 2018. Of the 37 interviews, 32 were held with one respondent, four with two respondents, and one with four respondents. Of the 37 respondents, 5 were interviewed on multiple cases (counted as separate interviews). Most interviews were administered by one interviewer (AR). In four interviews, a second interviewer joined (GdW or N.J.E. van Vooren) because of the number of respondents taking part in the interviews. A timeline displaying the reimbursement status and the policy reports published on the case was brought to the interviews to stimulate remembrance and to support the conversation (see Additional file E). Table 1 shows the number of interviews that was conducted per case and per respondent group. In four out of five cases, either data saturation was reached and/or all eligible actors were interviewed. In the quit smoking program case, not all eligible actors were interviewed as we did not succeed to include a politician who was involved.\u003c/p\u003e\n\u003cdiv class=\"gridtable\"\u003e\n\u003ctable id=\"Tab1\" border=\"1\"\u003e\u003ccaption\u003e\n\u003cdiv class=\"CaptionNumber\"\u003eTable 1\u003c/div\u003e\n\u003cdiv class=\"CaptionContent\"\u003e\n\u003cp\u003eNumber of interviews conducted per case and per respondent group\u003c/p\u003e\n\u003c/div\u003e\n\u003c/caption\u003e\n\u003ctbody\u003e\n\u003ctr\u003e\n\u003ctd rowspan=\"2\"\u003e\n\u003cp\u003e\u003cstrong\u003eCase\u003c/strong\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd colspan=\"6\"\u003e\n\u003cp\u003e\u003cstrong\u003eRespondent group\u003c/strong\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd rowspan=\"2\"\u003e\n\u003cp\u003e\u003cstrong\u003eTotal number per case\u003c/strong\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003e\n\u003cp\u003e\u003cstrong\u003ePatients\u003c/strong\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e\u003cstrong\u003eHealthcare providers\u003csup\u003e1\u003c/sup\u003e\u003c/strong\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e\u003cstrong\u003eHealth insurers\u003c/strong\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e\u003cstrong\u003eNational Healthcare Institute (ZINL)\u003c/strong\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e\u003cstrong\u003eMinistry of health, welfare and sports\u003c/strong\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e\u003cstrong\u003eOther\u003c/strong\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003e\n\u003cp\u003eBenzodiazepines\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e2\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e2\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e2\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003csup\u003e2\u003c/sup\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e9\u003c/p\u003e\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003e\n\u003cp\u003eMedication for Fabry disease\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003csup\u003e3\u003c/sup\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e6\u003c/p\u003e\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003e\n\u003cp\u003eQuit smoking program\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e0\u003csup\u003e4\u003c/sup\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e3\u003csup\u003e5\u003c/sup\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e7\u003c/p\u003e\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003e\n\u003cp\u003ePsychoanalytic therapy\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e3\u003csup\u003e6\u003c/sup\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003eNA\u003csup\u003e7\u003c/sup\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003csup\u003e2\u003c/sup\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e7\u003c/p\u003e\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003e\n\u003cp\u003eMaternity care assistance\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e3\u003csup\u003e8\u003c/sup\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e1\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e2\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e0\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e8\u003c/p\u003e\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003e\n\u003cp\u003e\u003cstrong\u003eTotal over all cases\u003c/strong\u003e\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e5\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e9\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e5\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e6\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e6\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e6\u003c/p\u003e\n\u003c/td\u003e\n\u003ctd\u003e\n\u003cp\u003e37\u003c/p\u003e\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n\u003ctd colspan=\"8\"\u003e\n\u003cp\u003e\u003csup\u003e1\u003c/sup\u003eThe respondent group healthcare providers includes both (leading) individual healthcare providers as well as healthcare provider organizations (e.g. physician associations)\u0026nbsp;\u003c/p\u003e\n\u003cp\u003e\u003csup\u003e2\u003c/sup\u003ei.e. knowledge institute\u003c/p\u003e\n\u003cp\u003e\u003csup\u003e3\u003c/sup\u003e i.e. pharmaceutical company\u003c/p\u003e\n\u003cp\u003e\u003csup\u003e4\u003c/sup\u003e In this case, several interviewees are from interest groups that represent both patients and healthcare providers as well (i.e. different actor groups are united in one organization). Therefore, the healthcare provider perspective has been covered in the other interviews.\u003c/p\u003e\n\u003cp\u003e\u003csup\u003e5 \u003c/sup\u003ei.e. interest groups + advisor of interest groups\u003c/p\u003e\n\u003cp\u003e\u003csup\u003e6\u003c/sup\u003e In this case, in the first interview with a healthcare provider, we identified two even more involved healthcare providers. Therefore, in total, three interviews with healthcare providers were necessary for this case.\u003c/p\u003e\n\u003cp\u003e\u003csup\u003e7\u003c/sup\u003e Disinvestment decisions based on (lack of evidence of) effectiveness can be taken by the National Healthcare Institute and do not need involvement by the Ministry. For this reason, the Ministry was not involved in the disinvestment decision regarding psychoanalytic therapy, and was, hence, not interviewed.\u003c/p\u003e\n\u003cp\u003e\u003csup\u003e8\u003c/sup\u003e Several healthcare provider organizations are involved in maternity care assistance. Therefore, we needed three interviews with healthcare providers to interview all relevant healthcare provider organizations.\u003c/p\u003e\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/tbody\u003e\n\u003c/table\u003e\n\u003cp\u003e\u0026nbsp;\u003c/p\u003e\n\u003cp\u003eThe remaining part of the results section is structured around the five main aspects influencing the outcome of disinvestment processes, as identified in our analysis. Here, the differences and similarities of these themes between cases are discussed. Additional file F contains a description of these themes for each case, separately.\u003c/p\u003e\n\u003ch2\u003e3.1 Theme 1: Support for active disinvestment and pressure exerted\u003c/h2\u003e\n\u003cp\u003eIn our interviews, respondents described that the degree of support for disinvestment from actors, including the public, was important for the outcome of the disinvestment process. However, the importance of support differed between actors and cases (see Additional file F and the sections below). Respondents from all cases described that the degree of support for disinvestment was related to actors\u0026rsquo; views on the case (i.e. health problem and intervention/service concerned), and in some cases to the attention for and framing of the case in the media. Respondents described that for them, as well as for other actors, the degree of support influenced the actions undertaken, and, subsequently, the amount of pressure exerted. From a comparison of the interview data from the studied cases, we found that the pressure exerted had a large effect on the outcome of the disinvestment process: limited pressure was exerted in the cases that were actually disinvested, while much pressure was exerted in the cases for which reimbursement was maintained. In the following quote, a healthcare provider describes the effect of societal pressure on the outcome of the disinvestment process.\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eHealthcare provider, case D, reimbursement maintained:\u003c/u\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003e\u0026ldquo;Yes, I believe that the social pressure, especially all media attention, including emotional arguments, helped a lot to reach this conclusion [not to stop reimbursement] in the end.\u0026rdquo;\u003c/em\u003e\u003c/p\u003e\n\u003ch3\u003e3.1.1 Support from healthcare providers\u003c/h3\u003e\n\u003cp\u003eRespondents described that especially the support from healthcare providers was important for the outcome of the disinvestment process (i.e. has an important effect on the decision that policymakers make):\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eInterest group, case C, first disinvested, later reimbursed again:\u003c/u\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003e\u0026ldquo;Respondent: And [the minister] actually had less of a say in that, I think. I think that the social pressure, particularly on this item from the healthcare sector, which she ultimately needs much more, also for the rest of her policy, that it is higher.\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eInterviewer: In that respect, surely the lobby and the calls from the healthcare sector were very important in this?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eRespondent: To reverse it [the decision], yes, definitely.\u0026rdquo;\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003eBy comparing the interview data from the studied cases, we found that the cases where healthcare providers successfully exerted pressure against disinvestment were not-disinvested, while cases where healthcare providers did not exert pressure or were unsuccessful in exerting pressure were disinvested. According to respondents, whether healthcare providers were successful in exerting pressure depended on 1) their willingness to exert pressure, subject to a) their level of support for disinvestment of the case, b) whether they feel it fits their role (e.g. whether they feel they have an advisory role which does not comply with exerting pressure) and c) their (financial) interests, and 2) the possibility they had to exert pressure, subject to a) their awareness on how to exert pressure and b) the opportunities provided to them to do so. In the first quote below, a healthcare provider from case B explains that they did not exert pressure because of their believe that disinvestment would improve healthcare delivery (i.e. other healthcare providers would better follow guidelines), suggesting their support for disinvestment. In the second quote a healthcare provider from case A describes his/her difficulty in convincing other actors to join forces (i.e. being successful) in exerting pressure.\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eHealthcare provider, case B, partially disinvested:\u003c/u\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003e\u0026ldquo;And, and so in that, up to that point we were like yes, if it actually helps to have it paid for [by patients], [\u0026hellip;] and if that helps them [other health care providers] to follow our guideline better, and to give less [of the treatment], yes, then it is fine of course.\u0026rdquo;\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eHealthcare provider, case A, fully disinvested:\u003c/u\u003e\u003c/p\u003e\n\u003cp\u003e\u0026ldquo;\u003cem\u003eInterviewer: Was there any party that you managed to get on board?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eRespondent: No, not really. They did [...] I can tell it like it is. At least people paid lip service to this whole story. People understood and supported the arguments. But to say that [name] who was then president of [organization] was like 'will you state once and for all that [case] is indispensable in the Netherlands and at any cost... ', [name] never did that.\u0026rdquo;\u003c/em\u003e\u003c/p\u003e\n\u003ch3\u003e3.1.2 Support from governmental institutions\u003c/h3\u003e\n\u003cp\u003eFrom our comparison of the interviews, we found that the opportunity provided to actors, including healthcare providers, to exert pressure seemed to depend for a large part on the opportunity actors were given by governmental institutions, who are in charge of disinvestment processes, to be involved in the policy process. We observed large differences between cases in the opportunity respondents were provided to be involved in the policy process, which seemed to depend on the support from governmental institutions for the case at hand. This is illustrated by the quotes below describing the opportunity respondents felt they were provided to be involved in case E, where policymakers described they were not in favor of disinvestment, and case A, where respondents suggested that policymakers were in favor of disinvestment.\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eHealthcare provider, case E, reimbursement maintained:\u003c/u\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003e\u0026ldquo;Interviewer: But they [ZiNL] were willing to listen to you in any case?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eRespondent: Definitely.\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eInterviewer: And did they also accept them, um, did they agree with the arguments you put forward?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eRespondent: Yes, they did. But I can still remember that they, and it's of course very good that they always wanted to investigate for themselves, were like \u0026ldquo;okay, we can't accept everything just like that\u0026rdquo;.\u0026rdquo;\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cu\u003ePatient organization, case A, fully disinvested:\u003c/u\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003e\u0026ldquo;And well, they [ZiNL] are always going to mention in their advice that they have spoken with \u0026ndash; for example, right \u0026ndash; in our case [organization name] with so and so. Yes, I can put that into perspective. Those five minutes that it took for us to quickly hand over a box of signatures, well, yes, even if it was a bit longer, that's not really a conversation, is it? There's no way you have really heard us.\u0026rdquo;\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003eFrom our comparison of the interview data between cases, we found that the support from governmental institutions also seemed to affect the use of the formal assessment framework in the cases studied. We observed differences between cases in respondents\u0026rsquo; descriptions of the criteria that were used in the disinvestment process, how these criteria were interpreted, and how these criteria were weighted against one another. For instance, as is illustrated by the quotes below, in case A, where respondents suggested policymakers were in favor of disinvestment, the focus was mainly on whether the treatment was evidence-based, while in case E, where policymakers described they were not in favor of disinvestment, more considerations than strictly related to the four package criteria were taken into account in the policy process.\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eHealthcare provider, case A, fully disinvested:\u003c/u\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003e\u0026ldquo;The motive was: we only reimburse things that are evidence-based. Well, a lot of what's in the package just isn't evidence-based so that's kind of a weird reasoning.\u0026rdquo;\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cu\u003ePolicymakers from ZiNL, case E, reimbursement maintained:\u003c/u\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003e\u0026ldquo;You could say it was a very heterogeneous set of effect measures and because of that diversity and heterogeneity, well, it is sort of, it is kind of a multi-factor analysis, right, of all those factors. Are they pointing in the same direction? Do they all contribute to the goal that you want to achieve with [the case]? Well, and that answer was yes in the end.\u0026rdquo;\u003c/em\u003e\u003c/p\u003e\n\u003ch3\u003e3.1.3 Support from patients\u003c/h3\u003e\n\u003cp\u003eRespondents from cases A and B, which were actually disinvested, described that patients in these cases were very vulnerable due to their disease and the societal problems associated with it. Because of this, according to respondents, patients were poorly organized, which made it difficult to get a large group of patients to exert pressure against disinvestment, as is illustrated by the quote below. This lack of pressure exerted may have facilitated disinvestment in these cases.\u003c/p\u003e\n\u003cp\u003e\u003cu\u003ePatient organization, case A, fully disinvested:\u003c/u\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003e\u0026ldquo;Yes, for most people it is a taboo, a long-term [treatment] like that. Especially when you're still in the middle of it. So, it was difficult to reach the patients. [\u0026hellip;] It was almost impossible, it was a real taboo, there is so much going on when you get such a long-term [treatment].\u0026rdquo;\u003c/em\u003e\u003c/p\u003e\n\u003ch2\u003e3.2 Theme 2: Compassion for current users\u003c/h2\u003e\n\u003cp\u003eRespondents described that the degree of support from actors for disinvestment was affected by whether measures could be taken to ease the effect of disinvestment for patients currently using the intervention at hand. This is illustrated by the quotes from policymakers below in which they describe that they consider disinvestment much more difficult than not to start reimbursement in the first place, especially if disinvestment results in current patients having to stop their treatment or switch to another treatment\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eCivil servant from the Ministry, case D, reimbursement maintained:\u003c/u\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003e\u0026ldquo;But you know, you are dealing with people who have been under treatment for years, um, and who are confronted with a new reality overnight. So, that also played a role, also for the Ministry. Like \"yeah, you know, what is wisdom, you can't stop people\u0026rsquo;s treatment just like that\".\u0026rdquo;\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cu\u003ePolicymaker ZiNL, case A, fully disinvested:\u003c/u\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003e\u0026ldquo;And we said, \"People should be allowed to finish their treatment.\" That was actually, there was some discussion about that. What were the arguments? I don't know. I think, I don't know how explicit that was but, yes, a reliable government, you started [the treatment] after all, yes.\u0026rdquo;\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003eRespondents described that if measures could be taken to relieve the effect of disinvestment on current patients, such as stopping reimbursement only for new patients or only restricting reimbursement, they considered disinvestment much more acceptable. This indicates that the possibility to take such mitigating measures impacts the support for disinvestment from actors and, subsequently, the outcome of the disinvestment process.\u003c/p\u003e\n\u003ch2\u003e3.3 Theme 3: Role in the health insurance system\u003c/h2\u003e\n\u003cp\u003eFrom the interviews, we observed that the role appointed to actors by the Dutch health insurance system also affected the outcome of the disinvestment process. In the Dutch health insurance system, two groups of policy makers do advice the Minister on reimbursement (policy formulation): ZiNL is involved with reimbursement aspects with regards to content, while policy makers of the Ministry itself both focus at the content and context of reimbursement. Once the Minister decides on reimbursement, health insurers subsequently implement these reimbursement decisions, and patients/healthcare providers are both consulted in reimbursement decisions and in the implementation of these decisions. Every actor can be involved in agenda-setting, although policymakers often have the most distinct role in this phase. In our interviews, respondents described that for the cases studied, actors acted in accordance with the role they have in the system. They described that actors tended to stay away from pursuing actions that they considered to be beyond their formal role. For instance, in the quote below, a health insurer explains that they generally refrained from trying to influence policy formulation and decision-making on reimbursement, as they only consider the implementation of reimbursement decisions to be part of their role.\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eHealth insurer, case D, reimbursement maintained:\u003c/u\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003e\u0026ldquo;Actually, over the years, we've had less and less of an opinion about this sort of thing. Because we feel, you know, everyone has their part to play in the system.\u0026rdquo;\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003eAlthough this finding was most distinct for health insurers, other respondents also regularly discussed their tendency to stick to their formal role. As was described in the interviews, if actors felt that exerting pressure was beyond their formal role, they generally refrained from this. Hence, the formal role of actors affected the pressure that was exerted by these actors in the cases studied and, subsequently, the outcome of disinvestment processes.\u003c/p\u003e\n\u003ch2\u003e3.4 Theme 4: Financial interest in disinvestment\u003c/h2\u003e\n\u003cp\u003eFrom the interviews, we observed that the actions actors took and, subsequently, the outcome of the disinvestment process were also affected by the financial interest of actors in the outcome of the disinvestment process. Respondents described that actors who had a financial interest in maintaining reimbursement were more likely to take action and exert pressure against disinvestment, than actors who did not have a financial interest in maintaining reimbursement, as is demonstrated by the quote below:\u003c/p\u003e\n\u003cp\u003e\u003cu\u003eHealthcare provider, case B, partially disinvested:\u003c/u\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003e\u0026ldquo;No, because all those [case intervention] were no longer, there wasn't a patent on them anymore, so they were... It wasn't in those manufacturers interest anymore to interfere. Otherwise it would probably not have been possible [to stop reimbursement]. Then they would have pulled out all the stops, to undo that.\u0026rdquo;\u003c/em\u003e\u003c/p\u003e\n\u003ch2\u003e3.5 Theme 5: Role of the formal package criteria\u003c/h2\u003e\n\u003cp\u003eFrom our interviews, no consistent pattern of the influence of the formal Dutch package criteria (i.e. effectiveness, cost-effectiveness, necessity and feasibility) on the outcome of the disinvestment process was observed. This finding is illustrated by the fact that our study included two cases (i.e. case A and D) that, based on what respondents shared with us during the interviews, seemed to score similarly on the formal package criteria, while having a very different outcome (fully disinvested versus maintained), a different outcome that cannot be explained by the cases scoring differently on any other criterion as well.\u003c/p\u003e\n\u003c/div\u003e"},{"header":"4. Discussion","content":" \u003cp\u003eTo our knowledge, this is the first study to describe the agenda-setting, policy-formulation and decision-making stages of the active disinvestment process, and to explore aspects influencing its outcome. By using a qualitative approach, we were able to study the reasoning behind the choices made in the active disinvestment process of the five cases studied in-depth and to collect information that has not been included in the formal policy reports written about these cases. Moreover, through interviewing different actors, we were able to look at the disinvestment process from different perspectives, in addition to the formal perspective of policymakers obtained from policy reports.\u003c/p\u003e \u003cp\u003eOur findings indicate that it is more likely for active disinvestment processes to result in a disinvestment decision if 1) there is sufficient support for disinvestment from actors, especially from policymakers and healthcare providers, 2) it is possible to ease the effect of disinvestment for patients currently using the intervention, 3) actors do not have a financial interest in maintaining reimbursement, and 4) actors are not inclined to exert pressure against disinvestment beyond their formal role. Furthermore, we found that the effect of the formal Dutch package criteria on the outcome of the disinvestment process differed between cases.\u003c/p\u003e \u003cdiv id=\"Sec14\" class=\"Section2\"\u003e \u003ch2\u003e4.1 Comparison with previous studies\u003c/h2\u003e \u003cp\u003eOur finding that support, especially from healthcare providers and policymakers, is an important determinant of the outcome of the disinvestment process also has been described by previous studies in which support, especially from clinical leaders, but from the general public as well, was found to be essential for the success of the disinvestment process [\u003cspan citationid=\"CR6\" class=\"CitationRef\"\u003e6\u003c/span\u003e, \u003cspan citationid=\"CR33\" class=\"CitationRef\"\u003e33\u003c/span\u003e, \u003cspan citationid=\"CR34\" class=\"CitationRef\"\u003e34\u003c/span\u003e]. Furthermore, a lack of support from decision-makers has been described as a barrier to the implementation of disinvestment [\u003cspan citationid=\"CR17\" class=\"CitationRef\"\u003e17\u003c/span\u003e]. However, it has also been described in previous studies that obtaining support for disinvestment is very difficult as stakeholders often lack the will to support disinvestment because of limited perceived value of disinvestment, which may take some time to realize, and their resistance to immediately \u0026ldquo;losing\u0026rdquo; therapy options [\u003cspan citationid=\"CR12\" class=\"CitationRef\"\u003e12\u003c/span\u003e, \u003cspan citationid=\"CR35\" class=\"CitationRef\"\u003e35\u003c/span\u003e]. Hence, to make actors, especially healthcare providers and policymakers, aware of the value of disinvestment (e.g. quality improvements, reducing displacement) may be essential in order to obtain support and, subsequently, to ensure that a decision to disinvest an intervention is taken and implemented. A review from 2008 focusing on reimbursement decisions for new medicines also found healthcare providers and administrators (i.e. policymakers) to be most influential in reimbursement decisions [\u003cspan citationid=\"CR36\" class=\"CitationRef\"\u003e36\u003c/span\u003e], indicating that this aspect may be similar in investment and in disinvestment decisions.\u003c/p\u003e \u003cp\u003eIn our study, we found that limiting the effect of disinvestment on current patients increased support for disinvestment and, subsequently, facilitated actual disinvestment, as actors were reluctant to disrupt treatment of current patients. This has also been found in two previous studies in which citizens and policymakers expressed a reluctance to disrupt treatments because of the negative effect this may have on current patients, e.g. anxiety because of losing the current treatment option and side-effects of stopping/changing treatments [\u003cspan citationid=\"CR6\" class=\"CitationRef\"\u003e6\u003c/span\u003e, \u003cspan citationid=\"CR37\" class=\"CitationRef\"\u003e37\u003c/span\u003e]. Hence, when considering the disinvestment of healthcare interventions, it is important to consider if and how the treatment of current patients could be (partially) continued. This consideration may be less relevant in the context of investment as, in the investment context, patients are not yet receiving the appraised intervention, and hence, no treatment will be disrupted if a decision not to reimburse the intervention is taken. This indicates that different considerations may be relevant in the context of disinvestment compared to the context of investment.\u003c/p\u003e \u003cp\u003eIn this study, we found that actors\u0026rsquo; financial interests influence the outcome of the active disinvestment process through the actions actors undertake. Similar findings have been described by previous studies on the disinvestment/de-implementation of low value care. For instance, van Egmond et al. found that financial incentives influence the de-implementation of low-value care by healthcare providers [\u003cspan citationid=\"CR38\" class=\"CitationRef\"\u003e38\u003c/span\u003e]. Furthermore, Haas et al. and Robinson et al. describe that there is a lack of financial incentives for healthcare providers to engage in disinvestment [\u003cspan citationid=\"CR24\" class=\"CitationRef\"\u003e24\u003c/span\u003e, \u003cspan citationid=\"CR39\" class=\"CitationRef\"\u003e39\u003c/span\u003e]. Further research is needed to determine how changing financial incentives may facilitate disinvestment. To our knowledge, our finding that actors\u0026rsquo; inclination to exert pressure because of the role appointed to them by the health insurance system influences the outcome of active disinvestment processes has not been found by previous studies on the disinvestment of healthcare interventions.\u003c/p\u003e \u003cp\u003eIn the Netherlands, a formal assessment framework is in place for the appraisal of new healthcare interventions for reimbursement. However, in this study we found that the formal criteria from this assessment framework for new additions to the basic benefits package (i.e. effectiveness, cost-effectiveness, necessity and feasibility) have been inconsistently applied in disinvestment decisions. This finding may be problematic as a structured, evidence-based process has been described in a review from 2015 as a facilitator for (the implementation of) disinvestment [\u003cspan citationid=\"CR17\" class=\"CitationRef\"\u003e17\u003c/span\u003e]. Furthermore, consistency in the rationale underlying decisions has been described as an important requirement for decision-making to be considered fair [\u003cspan citationid=\"CR40\" class=\"CitationRef\"\u003e40\u003c/span\u003e]. Therefore, it is important for policymakers to ensure that the criteria underlying disinvestment decisions are consistently applied. Such a consistent assessment framework may also facilitate the selection of the potentially most successful (i.e. most likely to result in actual disinvestment) cases for active disinvestment processes.\u003c/p\u003e \u003cp\u003ePrevious studies have described that, although broad stakeholder engagement is considered essential for the success of disinvestment, it is considered very difficult to sufficiently organize this [\u003cspan citationid=\"CR17\" class=\"CitationRef\"\u003e17\u003c/span\u003e, \u003cspan citationid=\"CR22\" class=\"CitationRef\"\u003e22\u003c/span\u003e, \u003cspan citationid=\"CR24\" class=\"CitationRef\"\u003e24\u003c/span\u003e]. Although this aspect has not been specifically addressed in the current study, we did find that the possibility for stakeholders to be involved in the disinvestment process differed between cases, depending on the support from policymakers for disinvestment. Furthermore, we found that the engagement of patients was difficult, especially in cases where the patient group was in a vulnerable situation and, because of this, poorly organized.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec15\" class=\"Section2\"\u003e \u003ch2\u003e4.2 Strengths and limitations\u003c/h2\u003e \u003cp\u003eIn this study, we have used a qualitative approach which enabled us to obtain in-depth insight into the factors that influence disinvestment processes and their outcomes. Furthermore, by interviewing many different actors who have perceived the disinvestment process from different perspectives, we were able to obtain a comprehensive view of the disinvestment processes studied. Moreover, as a sample (40%) of the interview transcripts was double coded, and the matrices were checked for recurring themes by three researchers, we ensured the reliability of data analysis [\u003cspan citationid=\"CR32\" class=\"CitationRef\"\u003e32\u003c/span\u003e]. In addition, as the disinvestment process of the studied cases took place several years ago, it may have been perceived as a closed chapter by respondents, making elaborating on the cases less sensitive and reflecting on it easier.\u003c/p\u003e \u003cp\u003eHowever, our study also has some limitations. Firstly, we have selected 5 cases from a list of 34 identified cases. Although we aimed to select 5 distinctive cases from this list, we may have missed aspects determining the outcome of the disinvestment process that may have been more pronounced in the non-selected cases. Furthermore, as we identified the 34 possible cases from policy documents, we may have introduced bias, as we could only select cases that made it to the stage of a policy document. Because of this, we may have missed cases for which the disinvestment process was terminated at a very early stage, before any policy document was written. However, even though it is clear that some information may have been omitted due to case selection, we did include a distinct selection of cases to maximize the transferability of our findings to other cases.\u003c/p\u003e \u003cp\u003eSecondly, although we tried our best to have all the relevant topics discussed during the interviews, it may be that respondents (intentionally or unintentionally) left some relevant information out. Especially one of the five cases studied (i.e. case D) still appeared to be sensitive to respondents, indicating that it may be more prone to information omission. We tried to overcome this limitation by including multiple respondents for each case. No conflicting information was obtained from the interviews with the different respondents, indicating that there are no clear signs of information omission. Furthermore, the older cases may have also been more prone to information omission because respondents may have had trouble remembering the relevant information. We tried to overcome this by showing respondents a timeline displaying policy reports and the reimbursement status to stimulate remembrance. In the interviews, this timeline appeared to be helpful for respondents in remembering the disinvestment process.\u003c/p\u003e \u003cp\u003eThirdly, in the quit smoking program case we were not able to interview all eligible actors because we did not succeed in including a politician who was involved in this case. As politicians played a major role in this case, it would have been informative to interview a politician. However, as the political process was extensively discussed in the remaining interviews on the case, we expect the information omission by not including politicians to be limited.\u003c/p\u003e \u003cp\u003eFinally, this study has been conducted in a Dutch setting. As disinvestment processes are often context-specific [\u003cspan citationid=\"CR21\" class=\"CitationRef\"\u003e21\u003c/span\u003e], one should take the differences between healthcare systems and other contextual factors into account when considering the implications of this study for other healthcare systems. For instance, in other healthcare systems, the roles may be differently divided between the different actors than is the case in the Dutch healthcare system. Moreover, actors may have a different tendency to stick to these roles. This may affect the importance of this aspect for the outcome of disinvestment processes in other healthcare systems.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec16\" class=\"Section2\"\u003e \u003ch2\u003e4.3 Implications\u003c/h2\u003e \u003cp\u003eThe results of this study may have implications for future active disinvestment processes. If policymakers are interested in selecting candidate interventions for which the disinvestment process is more likely to result in a disinvestment decision, they are recommended to select interventions for which there is support for disinvestment from actors, especially from healthcare providers. Furthermore, interventions for which support can be easily obtained, for instance because of the possibility to ease the consequences of disinvestment for current patients, are suitable candidate interventions as well. Moreover, also interventions for which actors do not have (strong) financial interests in maintaining reimbursement are suitable candidates for disinvestment.\u003c/p\u003e \u003cp\u003eAfter having selected candidate interventions for disinvestment, policymakers are recommended to increase support for disinvestment to facilitate the disinvestment process. As support from healthcare providers appeared to be important, policymakers are recommended to start with increasing support among this actor group. To this end, healthcare providers who are not aware of all the potential merits of disinvestment should be made aware of these merits in addition to the possible disadvantages they may already be aware of (i.e. losing therapy options for new patients and disrupting treatment of current patients). In order to make these healthcare providers aware of the merits, the scientific literature suggests that the emphasis of disinvestment processes should be on safety, and quality improvements such as avoiding side effects of ineffective care, instead of cost savings as this makes disinvestment more acceptable to healthcare providers [\u003cspan citationid=\"CR18\" class=\"CitationRef\"\u003e18\u003c/span\u003e, \u003cspan citationid=\"CR41\" class=\"CitationRef\"\u003e41\u003c/span\u003e]. Furthermore, it is important to make these healthcare providers aware of the opportunity costs of providing the intervention that will be disinvested. For instance, healthcare providers should be explained that, by disinvesting the intervention, their time and efforts can be devoted to interventions that generate more health outcomes. Moreover, healthcare providers should be made aware of the displacement taking place in the healthcare system because of the reimbursement and usage of interventions that are unsafe or not (cost-)effective. In addition, as easing the consequences of disinvestment on current patients appeared to increase support, it is recommended to explore the opportunities to do so for candidate interventions for disinvestment. In order to facilitate disinvestment, policymakers are also recommended to explore the financial interests that actors have with regards to disinvesting or maintaining reimbursement of the intervention and the mechanisms underlying these financial interests. By being aware of this, policymakers can better anticipate on the pressure that will be exerted by actors because of these financial interests.\u003c/p\u003e \u003cp\u003eIt is important for policymakers to be aware of the fact that different considerations may be relevant in the disinvestment context compared to the investment context. For instance, the reluctance to disrupt treatment for current patients may be highly relevant with regards to disinvestment decisions, while not being relevant in the investment context. As consistency and transparency in the rationale underlying disinvestment decisions is an important requirement for the policy process to be considered fair [\u003cspan citationid=\"CR40\" class=\"CitationRef\"\u003e40\u003c/span\u003e], we recommend policymakers to develop, consistently apply and transparently communicate on an assessment framework for disinvestment decisions, taking into account considerations that are specifically relevant in the disinvestment context.\u003c/p\u003e \u003cdiv id=\"Sec17\" class=\"Section3\"\u003e \u003ch2\u003e4.3.1 Implications for conditional reimbursement\u003c/h2\u003e \u003cp\u003eConditional reimbursement, or coverage with evidence development is the reimbursement of (new) healthcare interventions under a specific condition, often the requirement of collecting real-world (cost-)effectiveness data. It has been proposed as a policy-tool to delay the final reimbursement decision, decreasing the uncertainty on the (cost-)effectiveness and/or budget-impact of new interventions, while making these interventions available to patients at an early stage [\u003cspan citationid=\"CR42\" class=\"CitationRef\"\u003e42\u003c/span\u003e, \u003cspan citationid=\"CR43\" class=\"CitationRef\"\u003e43\u003c/span\u003e]. However, conditional reimbursement has also been described as creating a wedge effect, i.e. giving suppliers a \u0026ldquo;foot in the door\u0026rdquo; while creating challenges for decision-makers when the reversal of (conditional) reimbursement is warranted [\u003cspan citationid=\"CR12\" class=\"CitationRef\"\u003e12\u003c/span\u003e]. As the intervention has already been provided to patients, reversal of reimbursement implies the withdrawal of treatment, which has been described in the scientific literature as far less acceptable to actors than withholding treatment [\u003cspan citationid=\"CR42\" class=\"CitationRef\"\u003e42\u003c/span\u003e, \u003cspan citationid=\"CR44\" class=\"CitationRef\"\u003e44\u003c/span\u003e]. However, the specific nature of conditional reimbursement processes, provides policymakers with opportunities to address the aspects influencing the likelihood of an active disinvestment process to result in a disinvestment decision, as identified in our study. For instance, conditional reimbursement has the advantage that support for disinvestment can be ensured before starting reimbursement. Therefore, to ensure support, policymakers are recommended to make agreements with actors, before starting reimbursement, on the criteria the intervention should meet to maintain reimbursement after the evaluation period. Furthermore, we recommend policymakers to change the default outcome of conditional reimbursement from \u0026lsquo;reimbursement is maintained if the intervention meets the criteria\u0026rsquo; to \u0026lsquo;reimbursement is reversed, unless the intervention meets the criteria\u0026rsquo;. Although this difference may seem trivial, it has shown to be important psychologically [\u003cspan citationid=\"CR45\" class=\"CitationRef\"\u003e45\u003c/span\u003e, \u003cspan citationid=\"CR46\" class=\"CitationRef\"\u003e46\u003c/span\u003e]. Subsequently, policymakers are recommended to make sure that actors understand and agree that if the intervention does not meet the agreed upon criteria at the end of the reimbursement period, it will be disinvested. In this way, policymakers ensure that actors know that care is only provided under the precondition that it can be withdrawn later on, which makes withdrawing treatment similar to withholding treatment from a psychological point of view [\u003cspan citationid=\"CR42\" class=\"CitationRef\"\u003e42\u003c/span\u003e, \u003cspan citationid=\"CR44\" class=\"CitationRef\"\u003e44\u003c/span\u003e].\u003c/p\u003e \u003c/div\u003e \u003c/div\u003e "},{"header":"5. Conclusions","content":" \u003cp\u003eIn conclusion, this study indicates that contextual aspects such as support, institutional structures and financial interests are important determinants of the outcome of active disinvestment processes. Furthermore, the possibility to relieve the consequences of disinvestment for current patients appeared to be important to increase the acceptability of disinvestment. These results provide researchers and policymakers with insight into disinvestment processes in the Netherlands. Furthermore, the results can be used by policymakers in the selection of future candidate interventions for disinvestment and in future disinvestment processes to increase the likelihood of the disinvestment process to result in an actual disinvestment decision. Moreover, the results can be used by policymakers to prevent some of the challenges inherent in reversing reimbursement after a period of conditional reimbursement.\u003c/p\u003e "},{"header":"Abbreviations","content":"\u003cp\u003eCCE: Centre for Clinical Expertise\u003c/p\u003e\n\u003cp\u003eGDP: Gross Domestic Product\u003c/p\u003e\n\u003cp\u003eOECD: Organisation for Economic Cooperation and Development\u003c/p\u003e\n\u003cp\u003eZINL: Dutch National Healthcare Institute\u003c/p\u003e"},{"header":"Declarations","content":"\u003ch2\u003eEthics approval and consent to participate\u003c/h2\u003e\n\u003cp\u003eWritten informed consent was obtained at the start of the interview. This research project has been assessed by the Centre for Clinical Expertise (CCE) at the RIVM and concluded that the research project is exempted from further review by a medical ethics committee as it does not fulfill the specific conditions as stated in the Dutch Medical Research Involving Human Subjects Act (WMO; \u003cem\u003eWet Medisch-wetenschappelijk Onderzoek met mensen)\u003c/em\u003e.\u003c/p\u003e\n\u003ch2\u003eConsent for publication\u003c/h2\u003e\n\u003cp\u003eQuotes that were used in this paper were approved by respondents.\u003c/p\u003e\n\u003ch2\u003eAvailability of data and materials\u003c/h2\u003e\n\u003cp\u003eThe interviews analyzed during the current study are not publicly available due to concerns for respondents\u0026rsquo; privacy. However, a summary of the interview data on each theme for each case is included in additional file F.\u003c/p\u003e\n\u003ch2\u003eCompeting interests\u003c/h2\u003e\n\u003cp\u003eThe authors declare that they have no competing interests.\u003c/p\u003e\n\u003ch2\u003eFunding\u003c/h2\u003e\n\u003cp\u003eThis research was funded by the strategic research programme RIVM (S/133005), a research fund from the National Institute of Public Health and the Environment, the Netherlands. Funders had no role in the design of the study, its conduct, and the analysis and interpretation of the results and were not involved in manuscript preparation or submission.\u003c/p\u003e\n\u003ch2\u003eAuthors contribution\u003c/h2\u003e\n\u003cp\u003eAR designed and conducted the study, coded and analyzed interview data and wrote the manuscript. ML designed the study, performed data analysis and contributed to the manuscript. JvdR coded and analyzed interview data and contributed to the manuscript. NvE and KM were involved in the design of the study and contributed to the manuscript. GdW designed the study, performed data collection and analysis and contributed to the manuscript. All authors read and approved the final manuscript.\u003c/p\u003e\n\u003ch2\u003eAcknowledgements\u003c/h2\u003e\n\u003cp\u003eThe authors would like to thank the respondents for their participation in this study. Furthermore, the authors would like to thank Natascha van Vooren for her help with conducting the interviews and the valuable suggestion of bringing a timeline to the interviews to support the conversation.\u003c/p\u003e"},{"header":"References","content":"\u003col\u003e\u003cli\u003e \u003cspan\u003eOrganisation for Economic Co-operation and Development: \u003cb\u003eOECD Health Statistics 2019\u003c/b\u003e. In., November 2019 edn; 2019.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eGetzen TE, Okunade AA: \u003cb\u003eSymposium Introduction\u003c/b\u003e: \u003cb\u003ePapers on\u003c/b\u003e \u0026lsquo;\u003cb\u003eModeling National Health Expenditures\u003c/b\u003e\u0026rsquo;. \u003cem\u003eHealth Econ\u003c/em\u003e 2016.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003ede la Maisonneuve C, Martins JO. The future of health and long-term care spending. OECD journal: Economic studies. 2015;2014(1):61\u0026ndash;96.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003evan der Horst A, van Erp F, de Jong J: \u003cb\u003eTrends in gezondheid en zorg\u003c/b\u003e. In: \u003cem\u003eCPB policy brief.\u003c/em\u003e vol. 2011/11: Centraal planbureau; 2011.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eDonaldson C, Bate A, Mitton C, Dionne F, Ruta D. Rational disinvestment. QJM: An International Journal of Medicine. 2010;103(10):801\u0026ndash;7.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eDaniels T, Williams I, Robinson S, Spence K. Tackling disinvestment in health care services: The views of resource allocators in the English NHS. Journal of Health Organisation Management. 2013;27(6):762\u0026ndash;80.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eWilliams I, Robinson S, Dickinson H. Rationing in health care: the theory and practice of priority setting. Bristol: The policy press; 2012.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eBrody H. From an ethics of rationing to an ethics of waste avoidance. N Engl J Med. 2012;366(21):1949\u0026ndash;51.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eCalabro GE, La Torre G, de Waure C, Villari P, Federici A, Ricciardi W, Specchia ML. Disinvestment in healthcare: an overview of HTA agencies and organizations activities at European level. BMC Health Serv Res. 2018;18(1):148.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eHarris C, Allen K, King R, Ramsey W, Kelly C, Thiagarajan M. Sustainability in Health care by Allocating Resources Effectively (SHARE) 2: identifying opportunities for disinvestment in a local healthcare setting. BMC Health Serv Res. 2017;17(1):328.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003e\u003cb\u003e\"I won't call it rationing\u0026hellip; An ethnographic study of healthcare disinvestment in theory and practice\u003c/b\u003e. \u003cem\u003eSoc Sci Med\u003c/em\u003e 2015, \u003cb\u003e128\u003c/b\u003e:273\u0026ndash;281.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eParkinson B, Sermet C, Clement F, Crausaz S, Godman B, Garner S, Choudhury M, Pearson SA, Viney R, Lopert R, et al. Disinvestment and Value-Based Purchasing Strategies for Pharmaceuticals: An International Review. Pharmacoeconomics. 2015;33(9):905\u0026ndash;24.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003evan de Ven WPMM, Schut FT. Universal mandatory health insurance in the Netherlands: A model for the United States? Health Aff (Millwood). 2008;27(3):771\u0026ndash;81.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eCouwenbergh BTLE, van der Meer M, Weghaus-Reus SE, Schelleman H, Zwaap J: \u003cb\u003ePakketbeheer in de praktijk\u003c/b\u003e (\u003cb\u003edeel 3\u003c/b\u003e) [\u003cb\u003ePackage management in practice\u003c/b\u003e (\u003cb\u003epart 3\u003c/b\u003e)]. In.: College voor Zorgverzekeringen; 2013.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eZwaap J: \u003cb\u003ePackage advice in practice\u003c/b\u003e - \u003cb\u003eDeliberations for arriving at a fair package\u003c/b\u003e. In. Diemen: National Healthcare Institute; 2017.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eMinistry of Health Welfare and Sports: \u003cb\u003eBesluit van 23 april\u003c/b\u003e. 2018, \u003cb\u003ehoudende wijziging van het Besluit zorgverzekering in verband met regels voor de toelating van geneesmiddelen tot het basispakket\u003c/b\u003e [\u003cb\u003ein Dutch]\u003c/b\u003e. In., vol. 131; 2018.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eMayer J, Nachtnebel A. Disinvesting from ineffective technologies: Lessons learned from current programs. Int J Technol Assess Health Care. 2015;31(6):355\u0026ndash;62.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003evan Dulmen S, Heus P, Kool T, Verkerk E: \u003cb\u003eDoen of laten in de gezondheidszorg\u003c/b\u003e. \u003cb\u003eEen onderzoek naar de mogelijkheden van terugdringen van niet\u003c/b\u003e-\u003cb\u003egepaste zorg\u003c/b\u003e. [\u003cb\u003eTo do or not to do in healthcare\u003c/b\u003e. \u003cb\u003eA study after the possibilities to reduce low\u003c/b\u003e-\u003cb\u003evalue care\u003c/b\u003e.]. In. Nijmegen: Scientific Center for Quality of Healthcare (IQ healthcare); 2019.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eSchelleman H: \u003cb\u003eVoorwaardelijke toelating tot het basispakket 2019\u003c/b\u003e. In.: Zorginstituut Nederland; 2018.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eMakady A, van Veelen A, de Boer A, Hillege H, Klungel OH, Goettsch W. Implementing managed entry agreements in practice: The Dutch reality check. Health Policy. 2019;123(3):267\u0026ndash;74.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eMacKean G, Noseworthy T, Elshaug AG, Leggett L, Littlejohns P, Berezanski J, Clement F. Health Technology Reassessment: The art of the possible. Int J Technol Assess Health Care. 2013;29(4):418\u0026ndash;23.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eLeggett L, Mackean G, Noseworthy TW, Sutherland L, Clement F. Current status of health technology reassessment of non-drug technologies: survey and key informant interviews. Health research policy systems. 2012;10:38.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003ePolisena J, Trunk G, Gutierrez-Ibarluzea I, Joppi R. Disinvestment Activities and Candidates in the Health Technology Assessment Community: An Online Survey. Int J Technol Assess Health Care. 2019;35(3):189\u0026ndash;94.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eRobinson S, Williams I, Dickinson H, Freeman T, Rumbold B. Priority-setting and rationing in healthcare: Evidence from the English experience. Soc Sci Med. 2012;75(12):2386\u0026ndash;93.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eHowlett M, Ramesh M, Perl A. Studying public policy: policy cycles \u0026amp; policy sybsystems. 3rd ed. Ontario: Oxford University Press; 2009.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eMossialos E, Djordjevic A, Osborn R, Sarnak D. International Profiles of Health Care Systems. In. New York: The Commonwealth Fund; 2017.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eSaunders B, Sim J, Kingstone T, Baker S, Waterfield J, Bartlam B, Burroughs H, Jinks CJQ. Quantity: \u003cb\u003eSaturation in qualitative research: exploring its conceptualization and operationalization\u003c/b\u003e. 2018, 52(4):1893\u0026ndash;1907.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eBraun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology. 2006;3(2):77\u0026ndash;101.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eKleinhout-Vliek T, de Bont A, Boer B. The bare necessities? A realist review of necessity argumentations used in health care coverage decisions. Health Policy. 2017;121(7):731\u0026ndash;44.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eZwaap J, Knies S, van der Meijden C, Staal P, van der Heiden L: \u003cb\u003eCost\u003c/b\u003e-\u003cb\u003eeffectiveness in practice\u003c/b\u003e. In. Diemen: National Health Care Institute; 2015.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eSoftware VERBI. \u003cb\u003eMAXQDA 2019\u003c/b\u003e. In. Berlin: VERBI Software; 2019.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eMays N, Pope C. Qualitative Research: Rigour and qualitative research. BMJ. 1995;311(6997):109\u0026ndash;12.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eHodgetts K, Elshaug AG, Hiller JE. What counts and how to count it: Physicians\u0026rsquo; constructions of evidence in a disinvestment context. Soc Sci Med. 2012;75(12):2191\u0026ndash;9.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eGarpenby P. Formal priority setting in health care: the Swedish experience. Journal of Health Organization Management. 2016;30(6):891\u0026ndash;907.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eMaloney MA, Schwartz L, O'Reilly D, Levine M. Drug disinvestment frameworks: Components, challenges, and solutions. Int J Technol Assess Health Care. 2017;33(2):261\u0026ndash;9.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eVuorenkoski L, Toiviainen H, Hemminki E. Decision-making in priority setting for medicines\u0026mdash;A review of empirical studies. Health Policy. 2008;86(1):1\u0026ndash;9.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eCosta S, Bentley C, Regier DA, McTaggart-Cowan H, Mitton C, Burgess MM, Peacock SJ. Public perspectives on disinvestments in drug funding: results from a Canadian deliberative public engagement event on cancer drugs. BMC Public Health. 2019;19(1):977.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003evan Egmond S, Wakkee M, van Rengen A, Bastiaens MT, Nijsten T, Lugtenberg M. Factors influencing current low-value follow-up care after basal cell carcinoma and suggested strategies for de-adoption: a qualitative study. Br J Dermatol. 2019;180(6):1420\u0026ndash;9.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eHaas M, Hall J, Viney R, Gallego G. Breaking up is hard to do: Why disinvestment in medical technology is harder than investment. Aust Health Rev. 2012;36(2):148\u0026ndash;52.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eDaniels N, Sabin J. Setting limits fairly - Learning to share resources for health. 2nd ed. New York: Oxford University Press, Inc.; 2008.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eHarris C, Allen K, Waller C, Green S, King R, Ramsey W, Kelly C, Thiagarajan M. Sustainability in Health care by Allocating Resources Effectively (SHARE) 5: developing a model for evidence-driven resource allocation in a local healthcare setting. BMC Health Serv Res. 2017;17(1):342.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003evan de Wetering EJ, van Exel NJA, Brouwer WBF. The Challenge of Conditional Reimbursement: Stopping Reimbursement Can Be More Difficult Than Not Starting in the First Place! Value Health. 2017;20(1):118\u0026ndash;25.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eMakady A, van Acker S, Nijmeijer H, de Boer A, Hillege H, Klungel OH, Goettsch W. Conditional Financing of Drugs in the Netherlands: Past, Present, and Future\u0026mdash;Results From Stakeholder Interviews. Value Health. 2019;22(4):399\u0026ndash;407.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eSandman L, Liliemark J. Withholding and withdrawing treatment for cost-effectiveness reasons: Are they ethically on par? Bioethics. 2019;33(2):278\u0026ndash;86.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eFryer RG Jr, Levitt SD, List J, Sadoff S: \u003cb\u003eEnhancing the Efficacy of Teacher Incentives through Framing\u003c/b\u003e: \u003cb\u003eA Field Experiment\u003c/b\u003e [\u003cb\u003eworking paper]\u003c/b\u003e. In.: Harvard; 2018.\u003c/span\u003e \u003c/li\u003e \u003cli\u003e \u003cspan\u003eRemmerswaal M, Boone J, Bijlsma M, Douven R. Cost-Sharing Design Matters: A Comparison of the Rebate and Deductible in Healthcare. In. The Hague: CPB Netherlands Bureau for Economic Policy Analysis; 2019.\u003c/span\u003e \u003c/li\u003e\u003c/ol\u003e"}],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":true,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":false,"highlight":"","institution":"","isAcceptedByJournal":true,"isAuthorSuppliedPdf":false,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":false,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"bmc-health-services-research","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"bhsr","sideBox":"Learn more about [BMC Health Services Research](http://bmchealthservres.biomedcentral.com/)","snPcode":"","submissionUrl":"https://www.editorialmanager.com/BHSR/default.aspx","title":"BMC Health Services Research","twitterHandle":"BMC_series","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"em","reportingPortfolio":"BMC Series","inReviewEnabled":true,"inReviewRevisionsEnabled":true},"keywords":"Health technology reassessment, policy process, agenda-setting, policy formulation, decision-making, determinants, qualitative research","lastPublishedDoi":"10.21203/rs.3.rs-59485/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-59485/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003e\u003cstrong\u003eBackground\u003c/strong\u003e: Recent attempts of active disinvestment (i.e. withdrawal of reimbursement by means of a policy decision) of reimbursed healthcare interventions in the Netherlands have differed in their outcome: some were successful, with interventions actually being disinvested, while others were terminated at some point, implying continuation of reimbursement. This study aimed to obtain insight into recent active disinvestment processes, and to explore what aspects affect their outcome.\u003c/p\u003e\u003cp\u003e\u003cstrong\u003eMethods\u003c/strong\u003e: Semi-structured interviews were conducted from January to December 2018 with stakeholders (e.g. patients, policymakers, physicians) who were involved in the policy process of five cases for which the full or partial withdrawal of reimbursement was considered in the Netherlands between 2007 and 2017: benzodiazepines, medication for Fabry disease, quit smoking programme, psychoanalytic therapy and maternity care assistance. These cases covered both interventions that were eventually disinvested and interventions for which reimbursement was maintained after consideration. Interviews were transcribed verbatim, double coded and analyzed using thematic analysis.\u003c/p\u003e\u003cp\u003e\u003cstrong\u003eResults\u003c/strong\u003e: The 37 interviews showed that support for disinvestment from stakeholders, especially from healthcare providers and policymakers, strongly affected the outcome of the disinvestment process. Furthermore, the institutional role of stakeholders as legitimized by the Dutch health insurance system, their financial interests in maintaining or discontinuing reimbursement, and the possibility to relieve the consequences of disinvestment for current patients affected the outcome of the disinvestment process as well. No evidence was found of a consistent role of the formal Dutch package criteria (i.e. effectiveness, cost-effectiveness, necessity and feasibility) in active disinvestment processes.\u003c/p\u003e\u003cp\u003e\u003cstrong\u003eConclusions: \u003c/strong\u003eContextual factors as well as the possibility to relieve the consequences of disinvestment for current patients are important determinants of the outcome of active disinvestment processes. These results provide insight into active disinvestment processes and their determinants, and provide guidance to policymakers for a potentially more successful approach for future active disinvestment processes.\u003c/p\u003e","manuscriptTitle":"What Influences the Outcome of Active Disinvestment Processes in Healthcare? A Qualitative Interview Study on five Recent Cases of Active Disinvestment","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2020-09-21 15:20:27","doi":"10.21203/rs.3.rs-59485/v1","editorialEvents":[{"type":"communityComments","content":0},{"type":"decision","content":"Major revision","date":"2021-02-04T00:00:00+00:00","index":"","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2021-01-25T00:00:00+00:00","index":3,"fulltext":"Recommendation: Accept after minor essential revisions\nForm responses:\n---\n\nComments to Author:\n---\nPEER REVIEWER ASSESSMENTS:\n\nOBJECTIVE - Full research articles: is there a clear objective that addresses a testable research question(s) (brief or other article types: is there a clear objective)?\nYes - there is a clear objective\n\nDESIGN - Is the current approach (including controls and analysis protocols) appropriate for the objective?\nNo - there are minor issues\n\nEXECUTION - Are the experiments and analyses performed with technical rigor to allow confidence in the results?\nYes - experiments and analyses were performed appropriately\n\nSTATISTICS - Is the use of statistics in the manuscript appropriate?\nN/A - there are no statistics in this study\n\nINTERPRETATION - Is the current interpretation/discussion of the results reasonable and not overstated?\nYes - the author's interpretation is reasonable\n\nOVERALL MANUSCRIPT POTENTIAL - Is the current version of this work technically sound? If not, can revisions be made to make the work technically sound?\nProbably - with minor revisions\n\nPEER REVIEWER COMMENTS:\n\nGENERAL COMMENTS:\nThis is a very interesting manuscript that allows the reader to take a deep dive into 5 distinct divestment cases based on close to 40 interviews. The authors do an excellent job identifying and communicating the themes to the reader. While I commend the authors on looking at multiple cases, I was not certain how saturation was determined since they interviewed so many different types of respondents - how can interviewing 1 type of person (i.e., a patient for a specific case) reach saturation?\n\nREQUESTED REVISIONS:\nPlease provide additional clarity on what \"saturation\" meant in this study. When reading the results, it seemed like different types of individuals interviewed have very different thoughts, across cases. Therefore, it was not clear to me how saturation could have been reached, if there was only one individual within a cell. How can one reach saturation on a patient's perspective on quitting smoking or benzo use when only 1 patient is interviewed?* Publons Reviewer Recognition. Springer Nature can send verification of this review directly to Publons (a subsidiary of Clarivate Analytics). If you would like to take advantage of this service, please click on the “Yes” option below. Your name, email address, title of the reviewed manuscript, name of the journal, and date of your review submission (the “Review Data”) will then be transmitted to Publons upon publication of the manuscript. If you have already registered at Publons, they will notify you of the receipt of this review and update your profile as per your settings and their policy. If you are not registered with Publons, you will receive an email from them asking you to register in order for them to be able to recognize your review on your new profile page. Publons may use the Review Data to generate derivative metadata for the benefit of Publons and you as a reviewer, carefully considering the sensitivity of such information. For example, Publons may verify your record as a reviewer by updating your profile published on its webservice if you have registered for such service or help editors to identify candidate reviewers. Please find the details of processing in Publons’ privacy policy https://publons.com/about/terms: **No**\n* Declaration of competing interests: **This reviewer has been recruited by a partner organization, Research Square. Reviewers with declared or apparent competing interests are not utilized for these reviews. This reviewer has agreed to publication of their comments online under a Creative Commons Attribution License attributed to Research Square and was paid a small honorarium for completing the review within a specified timeframe. Honoraria for reviews such as this are paid regardless of the reviewer recommendation.**\n* Reviewer Publication Consent. I agree for my report to be made available under an Open Access Creative Commons CC-BY License (http://creativecommons.org/licenses/by/4.0) if this manuscript is accepted for publication. Any comments that I do not wish to be included in the published report have been included as confidential comments to the editor, which will not be published.: **I agree to the terms of the CC-BY 4.0 license; please do not publish my name with my report. (default)**\n* Is the study design appropriate to answer the research question (including the use of appropriate controls), and are the conclusions supported by the evidence presented?: **No**\n* Are the methods sufficiently described to allow the study to be repeated?: **No**\n* Is the use of statistics and treatment of uncertainties appropriate?: **Yes**\n* Is the presentation of the work clear?: **Yes**\n* Are the images in this manuscript (including electrophoretic gels and blots) free from apparent manipulation?: **Yes**\n"},{"type":"reviewerAgreed","content":"","date":"2021-01-08T00:00:00+00:00","index":3,"fulltext":""},{"type":"editorInvitedReview","content":"","date":"2020-11-19T00:00:00+00:00","index":2,"fulltext":"Recommendation: Accept after discretionary revisions\nForm responses:\n---\n\nComments to Author:\n---\nReview Disinvestment\n\nThis is a very strong, useful paper. Much research on disinvestment is academic or descriptive. This paper adds a theoretically informed analysis of successful and \"unsuccessful\" disinvestment within a given health system going well beyond the usual analysis of effectiveness or cost effectiveness. Health Technology Assessment (HTA) is a social science as well as an exercise in economics and epidemiology. This paper exemplifies the value of using a social science lens in HTA.\n\nMy comments are minor and suggested changes are discretionary.\n\n1. Consider including a sentence in the results section of the abstract about the role of the patient voice\n2. On Page 1, line 19-20, the authors state \"while others were terminated at some point, implying continuation of reimbursement\". I had to re-read this several times. The sentence is long and the reader sees the subject as being \"interventions\" rather than \"attempts\", which appears on line 17. I suggest re-writing as two sentences. This phrase is repeated on line 86 and I suggest a change here as well\n3. The cases are named (line 125ff) but not allocated their alphabetic code by which they are referred elsewhere in the manuscript. I kept turning back to cross reference as the alphabetic code (A, B, C, D, E) is used to refer case studies elsewhere in the manuscript. Both Table 1 describing the cases and the initial descriptive text should add the alphabetic code.\n4. Line 249 - \"belief\" not \"believe\"\n5. Line 259 - I found the first part of this quote hard to follow\n6. In describing the patients included could you add whether they were representatives of patient organisations or selected in some other way i.e. were they a single voice or representing a collective?\n7. Line 340 \"advise\" rather than \"do advice\"\n8. Discussion: I never had a sense of whether the patient representatives added anything to the analysis of each case. I suggest a few lines in the discussion about the value of their inclusion.\n9. This paper may provide guidance to other jurisdictions on conducting an audit of the consequences of disinvestment recommendations. It may be worth preparing another paper on the cost of such an audit relative to the savings in the disinvestment or adding a line about this in the discussion.\n* Publons Reviewer Recognition. Springer Nature can send verification of this review directly to Publons (a subsidiary of Clarivate Analytics). If you would like to take advantage of this service, please click on the “Yes” option below. Your name, email address, title of the reviewed manuscript, name of the journal, and date of your review submission (the “Review Data”) will then be transmitted to Publons upon publication of the manuscript. If you have already registered at Publons, they will notify you of the receipt of this review and update your profile as per your settings and their policy. If you are not registered with Publons, you will receive an email from them asking you to register in order for them to be able to recognize your review on your new profile page. Publons may use the Review Data to generate derivative metadata for the benefit of Publons and you as a reviewer, carefully considering the sensitivity of such information. For example, Publons may verify your record as a reviewer by updating your profile published on its webservice if you have registered for such service or help editors to identify candidate reviewers. Please find the details of processing in Publons’ privacy policy https://publons.com/about/terms: **Yes**\n* Declaration of competing interests: **I declare that I have no competing interests.**\n* Reviewer Publication Consent. I agree for my report to be made available under an Open Access Creative Commons CC-BY License (http://creativecommons.org/licenses/by/4.0) if this manuscript is accepted for publication. Any comments that I do not wish to be included in the published report have been included as confidential comments to the editor, which will not be published.: **I agree to the terms of the CC-BY 4.0 license; please publish my name with my report.**\n* Is the study design appropriate to answer the research question (including the use of appropriate controls), and are the conclusions supported by the evidence presented?: **Yes**\n* Are the methods sufficiently described to allow the study to be repeated?: **Yes**\n* Is the use of statistics and treatment of uncertainties appropriate?: **Yes**\n* Is the presentation of the work clear?: **Yes**\n* Are the images in this manuscript (including electrophoretic gels and blots) free from apparent manipulation?: **Yes**\n"},{"type":"reviewerAgreed","content":"","date":"2020-11-15T00:00:00+00:00","index":2,"fulltext":""},{"type":"editorInvitedReview","content":"","date":"2020-10-04T12:00:00+00:00","index":1,"fulltext":"Recommendation: Accept without revision\nForm responses:\n---\n\nComments to Author:\n---\nContribution of interest. Paper balanced in its different parts and well structured.\n\nBesides, this revised version has clearly solved the problems the first Reviewer pointed out.\n\nI have not further comments. Hence, I also agree the paper can be accepted for publication.\n* Publons Reviewer Recognition. Springer Nature can send verification of this review directly to Publons (a subsidiary of Clarivate Analytics). If you would like to take advantage of this service, please click on the “Yes” option below. Your name, email address, title of the reviewed manuscript, name of the journal, and date of your review submission (the “Review Data”) will then be transmitted to Publons upon publication of the manuscript. If you have already registered at Publons, they will notify you of the receipt of this review and update your profile as per your settings and their policy. If you are not registered with Publons, you will receive an email from them asking you to register in order for them to be able to recognize your review on your new profile page. Publons may use the Review Data to generate derivative metadata for the benefit of Publons and you as a reviewer, carefully considering the sensitivity of such information. For example, Publons may verify your record as a reviewer by updating your profile published on its webservice if you have registered for such service or help editors to identify candidate reviewers. Please find the details of processing in Publons’ privacy policy https://publons.com/about/terms: **No**\n* Declaration of competing interests: **I declare that I have no competing interests.**\n* Reviewer Publication Consent. I agree for my report to be made available under an Open Access Creative Commons CC-BY License (http://creativecommons.org/licenses/by/4.0) if this manuscript is accepted for publication. Any comments that I do not wish to be included in the published report have been included as confidential comments to the editor, which will not be published.: **I agree to the terms of the CC-BY 4.0 license; please do not publish my name with my report. (default)**\n* Is the study design appropriate to answer the research question (including the use of appropriate controls), and are the conclusions supported by the evidence presented?: **Yes**\n* Are the methods sufficiently described to allow the study to be repeated?: **Yes**\n* Is the use of statistics and treatment of uncertainties appropriate?: **Yes**\n* Is the presentation of the work clear?: **Yes**\n* Are the images in this manuscript (including electrophoretic gels and blots) free from apparent manipulation?: **Yes**\n"},{"type":"editorAssigned","content":"","date":"2020-09-21T12:00:00+00:00","index":"","fulltext":""},{"type":"reviewersInvited","content":"","date":"2020-09-21T12:00:00+00:00","index":"","fulltext":""},{"type":"reviewerAgreed","content":"","date":"2020-09-21T12:00:00+00:00","index":1,"fulltext":""},{"type":"checksComplete","content":"","date":"2020-09-17T12:00:00+00:00","index":"","fulltext":""},{"type":"editorInvited","content":"","date":"2020-09-15T12:00:00+00:00","index":"","fulltext":""}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"bmc-health-services-research","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"bhsr","sideBox":"Learn more about [BMC Health Services Research](http://bmchealthservres.biomedcentral.com/)","snPcode":"","submissionUrl":"https://www.editorialmanager.com/BHSR/default.aspx","title":"BMC Health Services Research","twitterHandle":"BMC_series","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"em","reportingPortfolio":"BMC Series","inReviewEnabled":true,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"a3005cb3-9fd5-4b1f-9956-8724ecc76ebe","owner":[],"postedDate":"September 21st, 2020","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"published-in-journal","subjectAreas":[{"id":567718,"name":"Health Economics \u0026 Outcomes Research"},{"id":567719,"name":"Health Policy"},{"id":567720,"name":"Health Law"}],"tags":[],"updatedAt":"2021-08-18T19:35:37+00:00","versionOfRecord":{"articleIdentity":"rs-59485","link":"https://doi.org/10.1186/s12913-021-06298-3","journal":{"identity":"bmc-health-services-research","isVorOnly":false,"title":"BMC Health Services Research"},"publishedOn":"2021-04-01 19:03:24","publishedOnDateReadable":"April 1st, 2021"},"versionCreatedAt":"2020-09-21 15:20:27","video":"","vorDoi":"10.1186/s12913-021-06298-3","vorDoiUrl":"https://doi.org/10.1186/s12913-021-06298-3","workflowStages":[]},"version":"v1","identity":"rs-59485","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-59485","identity":"rs-59485","version":["v1"]},"buildId":"7rjqhiLT3MXkJMwkYKINL","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}