Unlocking the promise of virtual care in hospitals: The Smarter Hospitals Project Protocol

Unlocking the promise of virtual care in hospitals: The Smarter Hospitals Project Protocol | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Study protocol Unlocking the promise of virtual care in hospitals: The Smarter Hospitals Project Protocol Reema Harrison, Rebecca Mitchell, Ramya Walsan, Maryam Sina, Robyn Clay-Williams, and 17 more This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-4799684/v1 This work is licensed under a CC BY 4.0 License Status: Published Journal Publication published 11 Aug, 2025 Read the published version in BMC Health Services Research → Version 1 posted 4 You are reading this latest preprint version Abstract Background Integration of virtual and in person care across health systems is a priority to create and sustain healthy nations by improving access to services, along with healthcare experiences, efficiency, and outcomes. Our collaborative project between health services, agencies, consumers, and clinicians across Australia seeks to provide the required evidence and solutions to optimise the integration of virtual care in hospital outpatient settings. Methods Our five-year project contains three sub-studies using a multi-method approach. Firstly, linked hospitalisation data will be used to describe the patterns of virtual outpatient use and the associated health service outcomes, including for priority populations. The second sub-study will use realist evaluation to determine the context, circumstances, and populations in which virtual care is used successfully, and economic impact of virtual care. We will then test the effectiveness of a co-designed Specialised Change Methodology for improving workforce change readiness and capability for integrating virtual models of care compared to current practice within health redevelopment settings. Statistical and qualitative analytic techniques will be applied. Discussion The study will generate evidence and resources to support the successful integration of virtual care in Australian health systems. Ethics approval has been obtained from the Victorian Human Research Ethics Committee (Study 1: HREC/97793/DOH-2023-383794), and Macquarie University Human Research Ethics Committee (Study 2: 520231303852269; Study 3 520231586954286). Research dissemination will be channelled through established communities of practice in Australian states to reach networks of clinicians, consumers and health managers. Further targeted outputs will be devised in collaboration with the consumer, clinician and health system partners to guide the implementation and use of virtual modalities in outpatient care, with equity as a central consideration. In addition to scientific research outputs, we will develop and disseminate evidence-based Virtual Care Design Principles, Evaluation Framework and Specialised Change Methodology for improving the integration of virtual outpatient hospital care. Virtual care telehealth virtual care integration study protocol healthcare outcomes healthcare access healthcare equity digital health Figures Figure 1 Figure 2 Background Virtual models of healthcare delivery have been employed throughout Australia for many years to provide care to regional and remote locations.[ 1 ] Rapid scale up and adoption of virtual care internationally, and in metropolitan areas of Australia in response to the COVID-19 pandemic has utilised evidence from Australia’s long history of telehealth. As we transition into the post-COVID era, health systems recognise the opportunity for notable gains in efficiency and to redress inequities by appropriately employing virtual and hybrid models of service delivery with the required support.[ 2 ] Evidence of the outcomes and costs (both human and financial) associated with virtual care is critical in informing decisions about the which digitally enabled services should be sustained and how these can be integrated into routine care processes.[ 3 ] In hospital outpatient services, the use of virtual care has been associated with improved patient and clinician experiences, reduce costs and enhance clinical outcomes for people with chronic and long-term conditions.[ 4 – 6 ] Enhanced patient experiences have been reported as a result of reduced financial burden associated with the reductions in travel required to receive care, childcare and other respite care costs.[ 7 – 9 ] Patients and carers also report opportunities for family members who cannot be physically present due to geographic distance, work or other commitments to attend and provide support when aspects of care are provided virtually.[ 10 ] For healthcare professionals, the reported benefits of digital solutions include the ability to access multidisciplinary teams and expertise at distance, along with reductions in travel time to attend patient visits. There is great potential for improved provision of care for people who have high healthcare utilisation, live at distance from major hospitals, and/or have multiple caring commitments. Yet evaluations of virtual care delivery to date indicate that benefits associated with using virtual care are not universal; they vary by population groups, personal circumstances, and care model [ 11 – 13 ]. Issues of digital exclusion, health literacy and socio-economic factors are identified barriers to successful realisation of the gains of virtual care for many individuals and families [ 14 ]. Desire for widespread use of virtual care has created an imperative to deliver robust evidence of the optimal use of virtual care and its implementation in hybrid models of service delivery. Health systems must also identify solutions to known implementation barriers that influence the success of virtual care integration with the existing services.[ 15 – 17 ] Evolving systems, processes and technologies have led to a piecemeal implementation approach between healthcare districts and services, with a lack of evidence-based approaches.[ 18 ] Historically, a lack of prospective planning for virtual care in health facility development or redevelopment continues to be a major contributing factor; integrating new technology into ageing infrastructure constrains the realisation of the virtual care benefits of improved patient experiences, health outcomes and reduced costs. In our analysis of statewide virtual care services, including remote monitoring, virtual hospitals, hospital-in-the-home and tele- or video-conferencing across > 20 specialities, a central barrier to the optimal use of virtual models was the limitations in the infrastructure design of healthcare facilities, along with ongoing challenges of limited equipment, connectivity and electronic health record integration.[ 11 ] These facility design barriers included lack of sufficient private space for telephone or video-consultations, and reception/waiting areas not designed to integrate the management of both face-to-face and virtual appointments. As the uptake and integration of virtual care evolves, uncertainty about the number of patients that will use virtual care and for what purpose, remains a challenge in updating facilities for virtual care use. [ 19 ]. In a new era of virtual care at-scale, current fragmented approaches limit the extent to which system-wide cost savings and improvements in healthcare access and patient outcomes may be realised. Illuminated in the NSW Health 20-Year Health Infrastructure Strategy is the need for capital assets that are fit-for-purpose for future health.[ 20 ] The Australasian Health Facility Guidelines provide a common set of best-practice principles for health facility planners regarding the physical environment.[ 21 ] While these guidelines provide guidance on elements of virtual care planning and design, they are not designed to address all technological innovations, and the extent of their application varies between jurisdictions. Internationally, transformative infrastructure innovation is now critical from capital works investment and facility planning to accommodate integrated virtual care provision.[ 18 , 20 ] Virtual healthcare delivery does not mimic in-person care; it requires changes to facility design but also in staff and consumer behaviours.[ 22 ] To deliver care using virtual or hybrid virtual and in person approaches, healthcare staff must adapt their practice to interact with a range of technologies to deliver and share health information, and to interact with patients, families and other healthcare workers.[ 13 , 23 ] Engaging in virtual care therefore requires new individual and collective behaviours that may be a substantial departure from current practice.[ 11 – 13 ] Behavioural change can be supported by theory-based implementation science and evaluation techniques.[ 24 , 25 ] Evidence from our systematic review of the management of healthcare change in the context of virtual care highlights that combining strategic change frameworks with implementation science methods provides a useful approach for supporting behavioural change amongst healthcare staff, but lacks application in shifting into greater use of virtual care.[ 26 , 27 ] Population-based, robust evidence of the patterns of virtual care use in outpatient services and their associated impacts on health service delivery outcomes are needed to inform the integration of virtual care in health systems. Evidence of the differential contexts and mechanisms that contribute to virtual care experiences and outcomes is critical to understand how to best support virtual care implementation, along with processes to facilitate staff behavioural change. The Smarter Hospitals Project seeks to provide evidence to address these gaps through a five-year, national research program. Methods and analysis Study design Study 1 Retrospective cohort study. Study 1 will be a retrospective cohort study of outpatient virtual care use in Victoria and Queensland among four patient cohorts with chronic or long-term conditions: people accessing cancer, renal, rehabilitation or mental health services. The study aims to describe the patterns of outpatient virtual care use among these patient cohorts over time: before, during and after the acute Covid-19 pandemic period, and the associated health service outcomes. The study will also investigate whether virtual care use and service-related outcomes vary between population groups including culturally and linguistically diverse communities, people with disabilities, by age, geographic location or disease type/stage. Study 2 Realist evaluation will be used to determine whether, how, when, where and why virtual care provision is effective. A realist evaluation explores interventions using the context-mechanism-outcome model; proposing that a given outcome is achieved because of underlying mechanism(s) that are operationalised in specific contexts.[ 28 ] Our preliminary work indicates that virtual care models can improve patient health and service delivery outcomes when certain mechanisms are apparent in certain contexts (Fig. 1 ). This information has been used to develop our initial theory about how virtual models might work to produce improved patient and service outcomes.[ 11 ] We will evaluate the virtual care models used by our health service partners to determine the conditions and circumstances that support their use, and populations for whom they work optimally.[ 29 , 30 ] Using realist evaluation, which we have successfully employed previously for complex program evaluations,[ 29 , 31 ] we will test and refine our initial theory. Further, we will examine the economic impact of virtual care by using a modified Social Accounting Matrix framework to measure the incremental direct and indirect costs and benefits of implementing the virtual care models versus usual care. The economic analysis will include an activity-based costing study to identify the costs of developing and implementing virtual care models, exploring changes in health service costs, and evaluate the health and non-health out-of-pocket costs for consumers and their families. Study 3 : A controlled pre- and post-intervention study will be used to evaluate the use of a Specialised Change Methodology in improving workforce change readiness (comprising two components: change self-efficacy and commitment to change) in the context of hospital redevelopments that comprise substantial integration of virtual care. A mixed-methods survey and interview study will measure differences in workforce change readiness between cohorts of change managers, comparing change readiness among those using the Specialised Change Methodology and usual practice. Setting and data sources Study 1: Outpatient hospital services providing cancer, renal, rehabilitation and mental health care in two Australian states: Victoria (VIC) and Queensland (QLD). We may seek to extend the research to include New South Wales (NSW) data in year two of the project subject to ethics and governance approvals. Data sources from Victoria and Queensland are: Victorian non admitted hospital services dataset, Victorian clinical public mental health services dataset, Victorian admitted episode dataset, Victorian emergency minimum dataset, Victorian cancer registry, Victorian registry of births, deaths and marriages, national cause of death unit record file for Victorians, Queensland health non-admitted patient data collection, Queensland consumer integrated mental health and addiction dataset, Queensland hospital admitted patient data collection, Queensland emergency data collection, Queensland cancer register and Queensland death registration and coded cause of deaths data. Study 2: National study of people accessing outpatient cancer, renal, rehabilitation and mental health care in Australia. Study 3: Two major hospital redevelopment projects in the Australian state of New South Wales. Study sample Study 1 : The data of patients aged ≥ 18 who attended outpatient clinics for the following priority chronic or long-terms conditions: (i) renal care; (ii) cancer; (iii) mental health; and (iv) rehabilitation in public hospitals over three-time periods will be eligible for inclusion. The time periods represent pre-, during and post- the acute Covid-19 pandemic period: 1 January 2017 and 31 December 2018 (T1), between 1 January 2020 and 31 December 2021 (T2) and between 1 January and 31 December 2023 (T3). These four outpatient services were identified by our healthcare partners as those with the greatest potential for improving access, quality and efficiency using virtual care because of the nature of these chronic and long term conditions, service demand and local burden of disease.[ 32 ] A sample of 395 patients is sufficient to identify a small effect size with 80% power (α = 0.05). Hence, the full dataset will provide adequate power to explore interactions and subgroup analyses. Study 2 Approximately 60 consumers who have used virtual outpatient hospital services at a range of time points from 2017 onwards for one or more of the four conditions will be recruited. Sampling will seek to ensure representation from consumers with diverse cultural, ethnic, socioeconomic backgrounds, age groups, gender and sexuality, and ability, from a range of geographic regions and Australian states. Study 3 : Eligible staff are those who are directly involved in delivering the redevelopment and include: 1) hospital redevelopment staff (n = 20 per site), 2) NSW Health Infrastructure (HI; agency responsible for state-wide capital works) Project User Group (PUG) leads who chair stakeholder meetings called PUGs for HI throughout the design and redevelopment process to enable shared agreement between developers, architects, staff and consumers about the hospital design (n = 20 per site), and 3) staff who will be providing care using virtual and hybrid models at the newly redeveloped hospitals once completed (n ≥ 1000) staff. Recruitment Study 1 Patient cohorts (cancer, renal, mental health and rehabilitation) will be identified from the non-admitted patient data collection and the mental health ambulatory data collection for each state based on the patient service establishment unit type and/or non-admitted service classification. Cohort data will be linked to emergency department (ED) presentation, hospital admission, and mortality data in each state for the three time periods by the Centre for Victorian Data Linkage (CVDL) and the Statistical Services Branch (SSB) Queensland. Study 2 Recruitment will occur through a multi-modal strategy that includes use of social media, healthcare and professional networks and newsletters to provide study information to people accessing the relevant virtual care services. Targeted recruitment of people who live regionally, rurally, who are from culturally and linguistically diverse backgrounds and/or have a disability will occur through a range of organisations including Language Other Than English Agency (LOTE), the Agency for Clinical Innovation (ACI) Intellectual Disability Network and a range of consumer groups. In each instance, a study flyer will be distributed via mailing lists and on social media groups, using plain English or translation as required. Study 3 Recruitment will occur via an email invitation distributed to hospital redevelopment staff, clinicians and change managers by NSW Health Infrastructure, which will contain links to the anonymous survey and unique identifiers to link data provided at each timepoint. Data Collection Study 1 observational data Retrospective, linked outpatient data will be securely transmitted by CVDL, and SSB to a secure research environment known as the Secured Unified Research Environment (SURE) or the Victorian Data Access Linkage Trust (VALT). The data will be exclusively accessible to authorised research team members. Study 2 interviews Our research team will use preliminary discussions with potential participants during the recruitment process to determine the support needs and preferences of individuals ahead of undertaking consent processes and scheduling interviews. Once preferences and needs are identified and addressed, interviews will be conducted using video-conferencing software or in person based on the participant’s preferences and requirements. Interview will be conducted by the research team, supported by accredited translators and support persons as required. Participants and their supporters will be reimbursed and remunerated for involvement as per the Health Consumers NSW payment guidelines. For online interviews, video-conferencing software will be used for transcription. For in person interviews, audio-recorders will be used, and the data will be sent to a professional transcription service (Pacific Transcription) or using transcription software. Study 3 surveys : Intervention group : Redevelopment staff and PUG leads at Hospital Redevelopment Site A (n = 40) will receive training in the Asset Management (AM) Specialised Change Methodology . The AM Specialised Change Methodology is a theory-based methodology that aims to improve change readiness in infrastructure projects. The methodology was co-produced by the investigator team and HI, and integrates models from strategic change management, implementation science and project management in three stages (Fig. 2). It will be used by redevelopment staff and PUG leads at one redevelopment site over 12-months to increase change readiness for integrating virtual models. Control group A matched sample of redevelopment staff and PUG leads (n = 40) at Hospital Redevelopment Site B, in which no formalised change methodology will be implemented, will provide comparator outcome data over a 12-month period. Outcome measures Surveys and semi-structured interviews will be used to gather pre- and post-intervention outcome data from participating staff Online surveys : Organisational readiness for integrating virtual care models will be measured using validated surveys previously deployed to capture individual and collective change readiness (33). These comprise: (i) a 4-item individual change readiness scale, (ii) a 4-item collective change readiness scale; (iii) a 4-item change self-efficacy scale; and (iv) a 3-item affective commitment to change scale. [ 33 – 35 ] Surveys will be administered at three time-points at both intervention and control sites: during redevelopment planning (T1), during redevelopment design (T2), and at commencement of service provision (T3). For 80% power to detect a small to medium effect (α = 0.05), we will aim to survey 80 healthcare staff at each time point. Semi-structured telephone interviews (at pre- and post-intervention) will be undertaken with the 40-redevelopment staff and 40 PUG leads per site. Thematic analysis of interview data will be undertaken to gather evidence of the acceptability, feasibility and perceived value of the AM Specialised Change Methodology and related training at the intervention site; to explore initial perceptions of change readiness; to establish the way in which change management processes occurred in each site and explain any variation between sites that may have influenced the findings.[ 36 ] An iterative process of data collection and analysis will guide sample size [ 37 ] Data analysis plan Study 1 observational data Descriptive analysis will be performed comparing the characteristics of study sample in the cohorts for three study periods. Chi-square tests of independence and ANOVA will be used to further describe the patient, neighbourhood and subsequent health service use outcomes for the three time periods. Generalised linear mixed modelling will be used to perform multi-level modelling to examine the association between type of care (in person, hybrid or entirely virtual) with health service outcomes (emergency department visits, inpatient admissions, length of stay, mortality), adjusting for covariates including an indicator variable for COVID 19, and considering clustering of patients within health service areas. Covariates included will be age, gender, country of birth, language spoken at home, economic status, comorbidity index, remoteness classification of the place of residence, area level socio economic disadvantage and any other relevant diagnosis related variables that could potentially influence the outcomes such as stage of cancer, type of mental health diagnosis. Adjusted relative risks and 95% confidence intervals will be generated. Study 2 interview data Retroductive analysis will be undertaken combining inductive and deductive approaches following Gilmore et al [ 38 ] to reveal the possible causal factors that underpin the results generated by Study 1. Our analysis will provide insight into why different virtual models work in certain contexts/for certain groups to achieve improved health service outcomes. Outcomes of interest include subsequent planned and unplanned hospitalisation after outpatient virtual care, length of stay in these admissions, patient reported outcomes of care and patient reported experiences of care. Economic analysis will examine the economic impact of virtual care by using a modified Social Accounting Matrix (SAM) framework to measure the incremental direct and indirect costs and benefits of implementing the virtual care models versus usual care. All costs and benefits will be monetised and rebased to a reference year with a 5% discount rate. A sensitivity analysis will be conducted to examine variability, and a return on investment will be determined for implementing virtual models. Study 3 survey data Survey data will be analysed using descriptive statistics (e.g. mean, percent change) for each site and Mann-Whitney test to compare pre-post intervention. We will use multiple linear regression to estimate the effect of the Specialised Change Methodology adjusting for differences in individual factors such as age, experience, role (clinical or non-clinical), and time in role. Ensuring study quality This program of work has been through an independent scientific peer review process by the National Health and Medical Research Council under the Partnership Projects Funding Scheme (Project number: 2015544). The scheme has competitively funded this research based on the scientific quality of the proposal and require progress reporting biannually. Throughout the project, study quality will be ensured by our project governance process which comprises primarily of an external stakeholder Project Steering Group (PSG) that includes consumers. The PSG meets twice a year to provide independent oversight of the project processes and progress against milestones. Consumer members specifically provide review and advice on consumer involvement activities and project processes to ensure that we retain a consumer-centric approach. Patient or public involvement Consumer involvement has been central to all elements of the research process from the project inception to execution, with a range of mechanisms being used to ensure the research receives inputs from and is disseminated with diverse stakeholder groups and communities. The protocol has been co-authored with two consumer advisors representing cultural diversity, people with disability and long-term health conditions, who have informed the project approach (DB and MS). Consumer input is embedded in the project governance through a Project Advisory Group has that includes two consumer members and provides oversight of the research approach throughout the project lifecycle. These members will also review any materials or processes of research proposed with patients and carers in detail throughout the research. During each study, community engagement with targeted populations is used to gain insight into the appropriate mechanisms to reach consumers and ensure that a diverse range of consumer perspectives are considered in the research. Attention to diverse representation is embedded in each study to ensure that participants are representative of the Australian population. Working in partnership with the project’s consumer advisors, a dissemination plan has been developed that embeds principles of accessible and inclusive research to ensure findings are shared and discussed with consumers broadly. Discussion Ethical considerations have been explored, identified and a risk mitigation plan created for each matter arising through the process of applying for ethical approval for the conduct of the study. Ethics approval has been obtained for all components of the research. The first study has ethical approval from Victorian Human Research Ethics Committee which was subsequently ratified by Queensland under the mutual acceptance scheme (HREC/97793/DOH-2023-383794), studies 2 and 3 have further been approved by Macquarie University Human Research Ethics Committee (Study 2: 520231303852269 Study 3: 520231586954286), which is a National Health and Medical Research Council (NHMRC) recognised ethics committee. During the study, data will be stored on the secure VALT or SURE systems (Study 1) or the OneDrive system (studies 2 and 3) of the leading institution with the primary investigator and retained in this secure location for at least seven years following the end of the project in accordance with the national ethical requirements. Through the project development process, several key risks and mitigation strategies were identified and developed. Four strategies will ensure that research activities will be managed and coordinated effectively. Firstly, we have established approval from the research sites in each state to conduct this work to mitigate the risk of not being able to access the services and individuals within these. Secondly, to address risks of working nationally, we have local project team members in each state to ensure local oversight. Thirdly, we are cognisant of the complexities, associated risks and mitigation practices needed to work with a highly diverse consumer group. To address the risk of not being able to interact with the diverse target population of consumers effectively, we access relevant translation services, bilingual fieldworkers and have budgeted for the associated costs and complexity. Finally, annual meetings, monthly virtual meetings and the project reference group mitigates risk and enhances our ability to respond effectively. The study findings will be disseminated at multiple events and through a range of formats to ensure that all stakeholder groups with interest in the project and its outcomes are able to access and interact with the findings. Specific mechanisms to enhance the successful implementation of virtual care will be disseminated, along with findings from the individual studies. In year 1, we will engage with established communities of practice around virtual care in three Australian states to translate knowledge as it emerges throughout the project into policy and practice change, and into business as usual with the partner organisations. COPs are a tool to facilitate the implementation of evidence-based practice across boundaries, but also to generate and manage evidence to support the adoption of best practice.[ 39 ] Our approach to knowledge translation seeks to build clinician, facility management and research capacity to advance and sustain the adoption of virtual models using standardised and evidence-based approaches to improve service delivery, outcomes and system efficiency. Discussion Principal Findings The study aims to produce large-scale, population-based evidence on the use of virtual care in outpatient services and its impact on health service delivery outcomes, with a particular focus on priority populations. It will generate insights into the contexts, circumstances, and populations where virtual care models are most effective, as well as their economic impact. The study will also test the effectiveness of a Specialized Change Methodology to enhance workforce readiness and capability for integrating virtual care models compared to current practices. Additionally, it will co-produce and integrate theory and evidence-based virtual care design principles, change methodology resources, and evaluation frameworks to improve health and service outcomes, which will be disseminated through communities of practice focused on virtual care models. Strengths and limitations of this study Partnership with clinicians, consumers and health agencies nationally will drive the project aims to be relevant to health system stakeholders. Using multiple hospital administrative datasets and data linkage methods enables this project to explore outcomes associated with virtual care across multiple states and services nationally but cannot provide causal evidence. Realist evaluation will enable the identification of the factors that influence virtual care experiences and outcomes for different communities. The analysis of hospital administrative data focuses on virtual care in outpatient settings only. Although findings may not be directly transferable to other virtual care provision in the Australian health system, or to other health systems learning from this research will have relevance internationally as many health services across the globe move to virtual delivery for some care processes. Conclusions This research is being conducted with a view of developing evidence and solutions for health services nationally to improve patient and service delivery outcomes for virtual care facilitated by best practice change management. Declarations Funding This work is funded by the National Health and Medical Research Council Partnership Scheme grant number: 2015544. Acknowledgements We would like to thank the ‘Smarter Hospitals Project’ partners—NSW Health Infrastructure, Western NSW Local Health District, South Western Sydney Local Health District, UNSW Sydney, Western Health, Northern Health, University of Leeds, Townsville Hospital and Health Service, Monash University and Macquarie University—for their support. Data availability Data and materials will be made available upon the publication of the findings. The datasets generated or analysed during this study can be obtained from the corresponding author upon reasonable request, unless restricted by the data custodians. Authors’ Contributions RH, RCW, AC, JB and RM conceived the project. All authors collectively developed the project design through creating the NHMRC project proposal that forms the basis of this protocol. We work collaboratively through a series of meetings and working across multiple drafts. In these ways, all authors contributed to developing the project design and study methods described in the protocol as project investigators. RH prepared the initial draft of the protocol based on the project protocol and contributions were made by all authors to all aspects of the protocol manuscript. The authorship team meet monthly to plan the project processes. RH, RM, RW, MS are primarily responsible for data acquisition, preparation and analysis across the sites and states, with local project team members in the services and health agencies SS, AM, AC, MM, WC, DB, AG, TW contributing to data acquisition, preparation and analysis at each study site. All authors edited, contributed content, and reviewed the final draft of the protocol. Conflicting interests No conflicting interests to declare. Human Ethics and Consent to Participate Ethical considerations have been explored, identified and a risk mitigation plan created for each matter arising through the process of applying for ethical approval for the conduct of the study. Ethics approval has been obtained for all components of the research. The first study has ethical approval from Victorian Human Research Ethics Committee which was subsequently ratified by Queensland under the mutual acceptance scheme (HREC/97793/DOH-2023-383794), studies 2 and 3 have further been approved by Macquarie University Human Research Ethics Committee (Study 2: 520231303852269 Study 3: 520231586954286), which is a National Health and Medical Research Council (NHMRC) recognised ethics committee. As per our ethical approvals, we confirm that all human participants will provide their consent to participate before taking part in any study processes. References Harkey LC, Jung SM, Newton ER, Patterson A. Patient satisfaction with telehealth in rural settings: a systematic review. International journal of telerehabilitation. 2020;12(2):53. Mistry SK, Shaw M, Raffan F, Johnson G, Perren K, Shoko S, et al. Inequity in access and delivery of virtual care interventions: a scoping review. International Journal of Environmental Research and Public Health. 2022;19(15):9411. Schwamm LH, Estrada J, Erskine A, Licurse A. Virtual care: new models of caring for our patients and workforce. The Lancet Digital Health. 2020;2(6):e282-e5. Snoswell CL, Taylor ML, Comans TA, Smith AC, Gray LC, Caffery LJ. Determining if telehealth can reduce health system costs: scoping review. J Med Internet Res. 2020;22(10):e17298. Menvielle L, Audrain-Pontevia A-F, Menvielle W. The digitization of healthcare: new challenges and opportunities: Springer; 2017. Wootton R. Twenty years of telemedicine in chronic disease management – an evidence synthesis. Journal of telemedicine and telecare. 2012;18(4):211-20. Patel KB, Turner K, Alishahi Tabriz A, Gonzalez BD, Oswald LB, Nguyen OT, et al. Estimated Indirect Cost Savings of Using Telehealth Among Nonelderly Patients With Cancer. JAMA Network Open. 2023;6(1):e2250211-e. Chu C, Nayyar D, Bhattacharyya O, Martin D, Agarwal P, Mukerji G. Patient and Provider Experiences With Virtual Care in a Large, Ambulatory Care Hospital in Ontario, Canada During the COVID-19 Pandemic: Observational Study. J Med Internet Res. 2022;24(10):e38604. Hutchings OR, Dearing C, Jagers D, Shaw MJ, Raffan F, Jones A, et al. Virtual Health Care for Community Management of Patients With COVID-19 in Australia: Observational Cohort Study. J Med Internet Res. 2021;23(3):e21064. Almathami HKY, Win KT, Vlahu-Gjorgievska E. Barriers and facilitators that influence telemedicine-based, real-time, online consultation at patients’ homes: systematic literature review. J Med Internet Res. 2020;22(2):e16407. Harrison R ME, Mimmo L, Walpola R, Roxas-Harris B,. Clinician Experience of Virtual Modes. NSW Mnistry of Health, Branch SR; 2021. Edge R, Meyers J, Tiernan G, Li Z, Schiavuzzi A, Chan P, et al. Cancer care disruption and reorganisation during the COVID-19 pandemic in Australia: A patient, carer and healthcare worker perspective. PLoS ONE. 2021;16(9):e0257420. Clay-Williams R, Baysari M, Taylor N, Zalitis D, Georgiou A, Robinson M, et al. Service provider perceptions of transitioning from audio to video capability in a telehealth system: a qualitative evaluation. BMC health services research. 2017;17(1):1-8. Rivera V, Aldridge MD, Ornstein K, Moody KA, Chun A. Racial and socioeconomic disparities in access to telehealth. Journal of the American Geriatrics Society. 2021;69(1):44. Jonnagaddala J, Godinho MA, Liaw S-T. From telehealth to virtual primary care in Australia? A Rapid scoping review. International Journal of Medical Informatics. 2021:104470. Sutherland K, Chessman J, Zhao J, Sara G, Shetty A, Smith S, et al. Impact of COVID-19 on healthcare activity in NSW, Australia. Public Health Res Pract. 2020;30(4):e3042030. Fisk M, Livingstone A, Pit SW. Telehealth in the Context of COVID-19: Changing Perspectives in Australia, the United Kingdom, and the United States. J Med Internet Res. 2020;22(6):e19264. Astier A, Carlet J, Hoppe-Tichy T, Jacklin A, Jeanes A, McManus S, et al. What is the role of technology in improving patient safety? A French, German and UK healthcare professional perspective. Journal of Patient Safety and Risk Management. 2020;25(6):219-24. Audit Office of NSW. Health Capital Works. 2020. New South Wales Health. 20-Year Health Infrastructure Strategy. Sydney: NSW Health; 2021. Australasian Health Facility Guidelines. Australasian Health Facility Guidelines 2021 [Available from: https://healthfacilityguidelines.com.au/aushfg-parts. Phimphasone-Brady P, Chiao J, Karamsetti L, Sieja A, Johnson R, Macke L, et al. Clinician and staff perspectives on potential disparities introduced by the rapid implementation of telehealth services during COVID-19: a mixed-methods analysis. Translational Behavioral Medicine. 2021;11(7):1339-47. Scott RE, Mars M. Behaviour change and e-health—looking broadly: a scoping narrative review. Stud Health Technol Inform. 2020;268:123-38. Michie S, Van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6(1):1-12. Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Quality and Safety in Health Care. 2005;14(1):26-33. Harrison R, Fischer S, Walpola RL, Chauhan A, Babalola T, Mears S, et al. Where Do Models for Change Management, Improvement and Implementation Meet? A Systematic Review of the Applications of Change Management Models in Healthcare. Journal of healthcare leadership. 2021;13:85. Le-Dao H, Chauhan A, Walpola R, Fischer S, Schwarz G, Minbashian A, et al. Managing Complex Healthcare Change: A Qualitative Exploration of Current Practice in New South Wales, Australia. Journal of healthcare leadership. 2020;12:143. Flynn R, Rotter T, Hartfield D, Newton AS, Scott SD. A realist evaluation to identify contexts and mechanisms that enabled and hindered implementation and had an effect on sustainability of a lean intervention in pediatric healthcare. BMC Health Serv Res. 2019;19(1):912. Sarkies MN, Francis-Auton E, Long JC, Partington A, Pomare C, Nguyen HM, et al. Implementing large-system, value-based healthcare initiatives: a realist study protocol for seven natural experiments. BMJ Open. 2020;10(12):e044049. Pawson R, Tilley N, Tilley N. Realistic evaluation: sage; 1997. Wong G, Westhorp G, Manzano A, Greenhalgh J, Jagosh J, Greenhalgh T. RAMESES II reporting standards for realist evaluations. BMC Med. 2016;14(1):1-18. Australian Bureau of Statistics. Experiences of telehealth services. 2021. Harrison R MA, Schwarz G, Chauhan A, Walpola R, Le-Dao, H.,. Translation and change: Embedding effective change management in health. UNSW Health SoP; 2020. Herscovitch L, Meyer JP. Commitment to organizational change: extension of a three-component model. Journal of applied psychology. 2002;87(3):474. Rafferty AE, Minbashian A. Cognitive beliefs and positive emotions about change: Relationships with employee change readiness and change-supportive behaviors. Human Relations. 2019;72(10):1623-50. Braun V, Clarke V, Hayfield N, Terry G. Thematic analysis. Handbook of research methods in health social sciences. 2018:1-18. Malterud K, Siersma VD, Guassora AD. Sample Size in Qualitative Interview Studies:Guided by Information Power. Qual Health Res. 2016;26(13):1753-60. Gilmore B, McAuliffe E, Power J, Vallières F. Data Analysis and Synthesis Within a Realist Evaluation: Toward More Transparent Methodological Approaches. International Journal of Qualitative Methods. 2019;18:1609406919859754. Ranmuthugala G, Plumb JJ, Cunningham FC, Georgiou A, Westbrook JI, Braithwaite J. How and why are communities of practice established in the healthcare sector? A systematic review of the literature. BMC Health Serv Res. 2011;11(1):273. Additional Declarations Competing interest reported. Reema Harrison and Ramya Walsan are AEs for BMC HSR Cite Share Download PDF Status: Published Journal Publication published 11 Aug, 2025 Read the published version in BMC Health Services Research → Version 1 posted Editorial decision: Revision requested 08 Apr, 2025 Editor assigned by journal 29 Jul, 2024 Submission checks completed at journal 29 Jul, 2024 First submitted to journal 25 Jul, 2024 You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-4799684","acceptedTermsAndConditions":true,"allowDirectSubmit":false,"archivedVersions":[],"articleType":"Study protocol","associatedPublications":[],"authors":[{"id":336842548,"identity":"ce5072c0-d98c-4b83-8ec2-1e027da88864","order_by":0,"name":"Reema Harrison","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAA/ElEQVRIiWNgGAWjYPCCA0DM2AAkbMBcCVK0pJGkBQwOE9Zi3t58dMMPhjvy5rMPN3/4uON8NN8B5oO3eRjsEhtwaJE5cyztZg/DM8M55xLbJGeeuZ078wBbsjUPQzJOLRISOWY3eBgOM87gYWxj5m27nbvhAI+ZNA8DM24t8u+/3fzDcNgeqKX5M2/bOaAW/m9ALfV4bOFhA7r8cCJQS4M0b9sBkC1s0iARnFp40sxuyxgcTgY5THJmW3LuzMNsxpZzDI4b49TCfvjZzTcVh21n8LA//vCxzS6373jzwxtvKqplcWmBAANkzmEMEYLgAEmqR8EoGAWjYAQAAHcEWZvwhJD6AAAAAElFTkSuQmCC","orcid":"","institution":"Macquarie University","correspondingAuthor":true,"prefix":"","firstName":"Reema","middleName":"","lastName":"Harrison","suffix":""},{"id":336842549,"identity":"17337c57-554f-49b0-b72d-82b2303ca2bc","order_by":1,"name":"Rebecca Mitchell","email":"","orcid":"","institution":"Macquarie University","correspondingAuthor":false,"prefix":"","firstName":"Rebecca","middleName":"","lastName":"Mitchell","suffix":""},{"id":336842550,"identity":"62cddc38-8752-4d8c-9de1-f486541cd5d9","order_by":2,"name":"Ramya Walsan","email":"","orcid":"","institution":"Macquarie University","correspondingAuthor":false,"prefix":"","firstName":"Ramya","middleName":"","lastName":"Walsan","suffix":""},{"id":336842551,"identity":"b371ecc4-3028-4a05-9a72-646131c24c5b","order_by":3,"name":"Maryam Sina","email":"","orcid":"","institution":"Macquarie University","correspondingAuthor":false,"prefix":"","firstName":"Maryam","middleName":"","lastName":"Sina","suffix":""},{"id":336842552,"identity":"127336d5-2b03-4e27-9ade-e5e8a6260807","order_by":4,"name":"Robyn Clay-Williams","email":"","orcid":"","institution":"Macquarie University","correspondingAuthor":false,"prefix":"","firstName":"Robyn","middleName":"","lastName":"Clay-Williams","suffix":""},{"id":336842553,"identity":"69da5149-9f49-4e58-aefa-e6d36d107dc3","order_by":5,"name":"Alexander Cardenas","email":"","orcid":"","institution":"New South Wales Department of Health","correspondingAuthor":false,"prefix":"","firstName":"Alexander","middleName":"","lastName":"Cardenas","suffix":""},{"id":336842554,"identity":"e07db3bd-1eba-4e94-ae2c-3c4b927cbfc0","order_by":6,"name":"Michelle Moscova","email":"","orcid":"","institution":"UNSW Sydney","correspondingAuthor":false,"prefix":"","firstName":"Michelle","middleName":"","lastName":"Moscova","suffix":""},{"id":336842557,"identity":"4362e498-2d79-4330-ac8a-4c2a45130a47","order_by":7,"name":"Dalal Baumgartner","email":"","orcid":"","institution":"Macquarie University","correspondingAuthor":false,"prefix":"","firstName":"Dalal","middleName":"","lastName":"Baumgartner","suffix":""},{"id":336842559,"identity":"d2b2760e-cf36-47ad-ba5c-bf7a58823679","order_by":8,"name":"Mashreka Sarwar","email":"","orcid":"","institution":"Macquarie University","correspondingAuthor":false,"prefix":"","firstName":"Mashreka","middleName":"","lastName":"Sarwar","suffix":""},{"id":336842562,"identity":"18cbd23c-b21f-4161-af37-3b5edb6453f6","order_by":9,"name":"Johanna Westbrook","email":"","orcid":"","institution":"Macquarie University","correspondingAuthor":false,"prefix":"","firstName":"Johanna","middleName":"","lastName":"Westbrook","suffix":""},{"id":336842565,"identity":"a3b70459-4ee4-43f0-9f02-81a710f58af6","order_by":10,"name":"Elizabeth Manias","email":"","orcid":"","institution":"Monash University","correspondingAuthor":false,"prefix":"","firstName":"Elizabeth","middleName":"","lastName":"Manias","suffix":""},{"id":336842566,"identity":"eea27fd2-034f-4d4c-a659-36bec7d93632","order_by":11,"name":"Natalie Taylor","email":"","orcid":"","institution":"UNSW Sydney","correspondingAuthor":false,"prefix":"","firstName":"Natalie","middleName":"","lastName":"Taylor","suffix":""},{"id":336842567,"identity":"cdfbca26-cbd8-48cc-94ac-10626582227d","order_by":12,"name":"Rebecca Lawton","email":"","orcid":"","institution":"University of Leeds","correspondingAuthor":false,"prefix":"","firstName":"Rebecca","middleName":"","lastName":"Lawton","suffix":""},{"id":336842568,"identity":"5a5bdd14-9ed6-4c31-ade2-18410b64b40d","order_by":13,"name":"Sabe Sabesan","email":"","orcid":"","institution":"Townsville Hospital","correspondingAuthor":false,"prefix":"","firstName":"Sabe","middleName":"","lastName":"Sabesan","suffix":""},{"id":336842569,"identity":"cb9a4a00-3766-433f-b6cd-16ed95735020","order_by":14,"name":"Virginia Mumford","email":"","orcid":"","institution":"Macquarie University","correspondingAuthor":false,"prefix":"","firstName":"Virginia","middleName":"","lastName":"Mumford","suffix":""},{"id":336842570,"identity":"2b5d12de-64c1-4844-a9a3-4ba066af88ef","order_by":15,"name":"Tim Badgery-Parker","email":"","orcid":"","institution":"Macquarie University","correspondingAuthor":false,"prefix":"","firstName":"Tim","middleName":"","lastName":"Badgery-Parker","suffix":""},{"id":336842571,"identity":"38ea3679-b30b-4803-aea8-d460d8cd1bdb","order_by":16,"name":"Deepak Bhonagiri","email":"","orcid":"","institution":"South Western Sydney Local Health District","correspondingAuthor":false,"prefix":"","firstName":"Deepak","middleName":"","lastName":"Bhonagiri","suffix":""},{"id":336842572,"identity":"c2a1f7c5-c658-4afe-ba9b-4e3c8e663d5f","order_by":17,"name":"Craig Nelson","email":"","orcid":"","institution":"Western Health","correspondingAuthor":false,"prefix":"","firstName":"Craig","middleName":"","lastName":"Nelson","suffix":""},{"id":336842573,"identity":"7d8a9197-e94a-4a1c-929c-bd5352869192","order_by":18,"name":"Wei Chua","email":"","orcid":"","institution":"South Western Sydney Local Health District","correspondingAuthor":false,"prefix":"","firstName":"Wei","middleName":"","lastName":"Chua","suffix":""},{"id":336842574,"identity":"7736e67d-397f-40bd-962d-6339a556e75b","order_by":19,"name":"Bradley Christian","email":"","orcid":"","institution":"The University of Sydney","correspondingAuthor":false,"prefix":"","firstName":"Bradley","middleName":"","lastName":"Christian","suffix":""},{"id":336842575,"identity":"aec9c3e6-0c65-4c48-9c6e-e95fa481b9c8","order_by":20,"name":"Kate Churruca","email":"","orcid":"","institution":"Macquarie University","correspondingAuthor":false,"prefix":"","firstName":"Kate","middleName":"","lastName":"Churruca","suffix":""},{"id":336842576,"identity":"2f57157a-674c-4e40-b75a-21f62bf406b8","order_by":21,"name":"Jeffrey Braithwaite","email":"","orcid":"","institution":"Macquarie University","correspondingAuthor":false,"prefix":"","firstName":"Jeffrey","middleName":"","lastName":"Braithwaite","suffix":""}],"badges":[],"createdAt":"2024-07-25 07:07:29","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-4799684/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-4799684/v1","draftVersion":[],"editorialEvents":[{"content":"https://doi.org/10.1186/s12913-025-13129-2","type":"published","date":"2025-08-11T15:58:04+00:00"}],"editorialNote":"","failedWorkflow":false,"files":[{"id":63153310,"identity":"c10bced9-f3ed-4f87-b633-3be42d96cd07","added_by":"auto","created_at":"2024-08-23 19:24:08","extension":"png","order_by":1,"title":"Figure 1","display":"","copyAsset":false,"role":"figure","size":522449,"visible":true,"origin":"","legend":"\u003cp\u003eContextual factors and mechanisms that are identified as driving outcomes in virtual care\u003c/p\u003e","description":"","filename":"1.png","url":"https://assets-eu.researchsquare.com/files/rs-4799684/v1/90bed5eb0aed5b347863be18.png"},{"id":63153311,"identity":"ae94504e-f72e-487b-abca-1786a39d0520","added_by":"auto","created_at":"2024-08-23 19:24:08","extension":"png","order_by":2,"title":"Figure 2","display":"","copyAsset":false,"role":"figure","size":141576,"visible":true,"origin":"","legend":"\u003cp\u003eSee image above for figure legend\u003c/p\u003e","description":"","filename":"2.png","url":"https://assets-eu.researchsquare.com/files/rs-4799684/v1/233d6ffd4cd95fc867bacc28.png"},{"id":89311220,"identity":"1b69065d-3e02-47b3-bedf-06d7561927c2","added_by":"auto","created_at":"2025-08-18 16:10:23","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":1541331,"visible":true,"origin":"","legend":"","description":"","filename":"manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-4799684/v1/6ca6a22d-2e35-4e66-8fca-4ad8f5fc9205.pdf"}],"financialInterests":"Competing interest reported. Reema Harrison and Ramya Walsan are AEs for BMC HSR","formattedTitle":"Unlocking the promise of virtual care in hospitals: The Smarter Hospitals Project Protocol","fulltext":[{"header":"Background","content":"\u003cp\u003eVirtual models of healthcare delivery have been employed throughout Australia for many years to provide care to regional and remote locations.[\u003cspan citationid=\"CR1\" class=\"CitationRef\"\u003e1\u003c/span\u003e] Rapid scale up and adoption of virtual care internationally, and in metropolitan areas of Australia in response to the COVID-19 pandemic has utilised evidence from Australia\u0026rsquo;s long history of telehealth. As we transition into the post-COVID era, health systems recognise the opportunity for notable gains in efficiency and to redress inequities by appropriately employing virtual and hybrid models of service delivery with the required support.[\u003cspan citationid=\"CR2\" class=\"CitationRef\"\u003e2\u003c/span\u003e] Evidence of the outcomes and costs (both human and financial) associated with virtual care is critical in informing decisions about the which digitally enabled services should be sustained and how these can be integrated into routine care processes.[\u003cspan citationid=\"CR3\" class=\"CitationRef\"\u003e3\u003c/span\u003e]\u003c/p\u003e \u003cp\u003eIn hospital outpatient services, the use of virtual care has been associated with improved patient and clinician experiences, reduce costs and enhance clinical outcomes for people with chronic and long-term conditions.[\u003cspan additionalcitationids=\"CR5\" citationid=\"CR4\" class=\"CitationRef\"\u003e4\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR6\" class=\"CitationRef\"\u003e6\u003c/span\u003e] Enhanced patient experiences have been reported as a result of reduced financial burden associated with the reductions in travel required to receive care, childcare and other respite care costs.[\u003cspan additionalcitationids=\"CR8\" citationid=\"CR7\" class=\"CitationRef\"\u003e7\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR9\" class=\"CitationRef\"\u003e9\u003c/span\u003e] Patients and carers also report opportunities for family members who cannot be physically present due to geographic distance, work or other commitments to attend and provide support when aspects of care are provided virtually.[\u003cspan citationid=\"CR10\" class=\"CitationRef\"\u003e10\u003c/span\u003e] For healthcare professionals, the reported benefits of digital solutions include the ability to access multidisciplinary teams and expertise at distance, along with reductions in travel time to attend patient visits. There is great potential for improved provision of care for people who have high healthcare utilisation, live at distance from major hospitals, and/or have multiple caring commitments. Yet evaluations of virtual care delivery to date indicate that benefits associated with using virtual care are not universal; they vary by population groups, personal circumstances, and care model [\u003cspan additionalcitationids=\"CR12\" citationid=\"CR11\" class=\"CitationRef\"\u003e11\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR13\" class=\"CitationRef\"\u003e13\u003c/span\u003e]. Issues of digital exclusion, health literacy and socio-economic factors are identified barriers to successful realisation of the gains of virtual care for many individuals and families [\u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eDesire for widespread use of virtual care has created an imperative to deliver robust evidence of the optimal use of virtual care and its implementation in hybrid models of service delivery. Health systems must also identify solutions to known implementation barriers that influence the success of virtual care integration with the existing services.[\u003cspan additionalcitationids=\"CR16\" citationid=\"CR15\" class=\"CitationRef\"\u003e15\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR17\" class=\"CitationRef\"\u003e17\u003c/span\u003e] Evolving systems, processes and technologies have led to a piecemeal implementation approach between healthcare districts and services, with a lack of evidence-based approaches.[\u003cspan citationid=\"CR18\" class=\"CitationRef\"\u003e18\u003c/span\u003e] Historically, a lack of prospective planning for virtual care in health facility development or redevelopment continues to be a major contributing factor; integrating new technology into ageing infrastructure constrains the realisation of the virtual care benefits of improved patient experiences, health outcomes and reduced costs. In our analysis of statewide virtual care services, including remote monitoring, virtual hospitals, hospital-in-the-home and tele- or video-conferencing across \u0026gt;\u0026thinsp;20 specialities, a central barrier to the optimal use of virtual models was the limitations in the infrastructure design of healthcare facilities, along with ongoing challenges of limited equipment, connectivity and electronic health record integration.[\u003cspan citationid=\"CR11\" class=\"CitationRef\"\u003e11\u003c/span\u003e] These facility design barriers included lack of sufficient private space for telephone or video-consultations, and reception/waiting areas not designed to integrate the management of both face-to-face and virtual appointments. As the uptake and integration of virtual care evolves, uncertainty about the number of patients that will use virtual care and for what purpose, remains a challenge in updating facilities for virtual care use. [\u003cspan citationid=\"CR19\" class=\"CitationRef\"\u003e19\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eIn a new era of virtual care at-scale, current fragmented approaches limit the extent to which system-wide cost savings and improvements in healthcare access and patient outcomes may be realised. Illuminated in the \u003cem\u003eNSW Health 20-Year Health Infrastructure Strategy\u003c/em\u003e is the need for capital assets that are fit-for-purpose for future health.[\u003cspan citationid=\"CR20\" class=\"CitationRef\"\u003e20\u003c/span\u003e] The \u003cem\u003eAustralasian Health Facility Guidelines\u003c/em\u003e provide a common set of best-practice principles for health facility planners regarding the physical environment.[\u003cspan citationid=\"CR21\" class=\"CitationRef\"\u003e21\u003c/span\u003e] While these guidelines provide guidance on elements of virtual care planning and design, they are not designed to address all technological innovations, and the extent of their application varies between jurisdictions. Internationally, transformative infrastructure innovation is now critical from capital works investment and facility planning to accommodate integrated virtual care provision.[\u003cspan citationid=\"CR18\" class=\"CitationRef\"\u003e18\u003c/span\u003e, \u003cspan citationid=\"CR20\" class=\"CitationRef\"\u003e20\u003c/span\u003e]\u003c/p\u003e \u003cp\u003eVirtual healthcare delivery does not mimic in-person care; it requires changes to facility design but also in staff and consumer behaviours.[\u003cspan citationid=\"CR22\" class=\"CitationRef\"\u003e22\u003c/span\u003e] To deliver care using virtual or hybrid virtual and in person approaches, healthcare staff must adapt their practice to interact with a range of technologies to deliver and share health information, and to interact with patients, families and other healthcare workers.[\u003cspan citationid=\"CR13\" class=\"CitationRef\"\u003e13\u003c/span\u003e, \u003cspan citationid=\"CR23\" class=\"CitationRef\"\u003e23\u003c/span\u003e] Engaging in virtual care therefore requires new individual and collective behaviours that may be a substantial departure from current practice.[\u003cspan additionalcitationids=\"CR12\" citationid=\"CR11\" class=\"CitationRef\"\u003e11\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR13\" class=\"CitationRef\"\u003e13\u003c/span\u003e] Behavioural change can be supported by theory-based implementation science and evaluation techniques.[\u003cspan citationid=\"CR24\" class=\"CitationRef\"\u003e24\u003c/span\u003e, \u003cspan citationid=\"CR25\" class=\"CitationRef\"\u003e25\u003c/span\u003e] Evidence from our systematic review of the management of healthcare change in the context of virtual care highlights that combining strategic change frameworks with implementation science methods provides a useful approach for supporting behavioural change amongst healthcare staff, but lacks application in shifting into greater use of virtual care.[\u003cspan citationid=\"CR26\" class=\"CitationRef\"\u003e26\u003c/span\u003e, \u003cspan citationid=\"CR27\" class=\"CitationRef\"\u003e27\u003c/span\u003e]\u003c/p\u003e \u003cp\u003ePopulation-based, robust evidence of the patterns of virtual care use in outpatient services and their associated impacts on health service delivery outcomes are needed to inform the integration of virtual care in health systems. Evidence of the differential contexts and mechanisms that contribute to virtual care experiences and outcomes is critical to understand how to best support virtual care implementation, along with processes to facilitate staff behavioural change. The Smarter Hospitals Project seeks to provide evidence to address these gaps through a five-year, national research program.\u003c/p\u003e"},{"header":"Methods and analysis","content":"\u003cp\u003eStudy design\u003c/p\u003e \u003cp\u003e \u003cstrong\u003eStudy 1\u003c/strong\u003e \u003cp\u003eRetrospective cohort study.\u003c/p\u003e \u003c/p\u003e \u003cp\u003eStudy 1 will be a retrospective cohort study of outpatient virtual care use in Victoria and Queensland among four patient cohorts with chronic or long-term conditions: people accessing cancer, renal, rehabilitation or mental health services. The study aims to describe the patterns of outpatient virtual care use among these patient cohorts over time: before, during and after the acute Covid-19 pandemic period, and the associated health service outcomes. The study will also investigate whether virtual care use and service-related outcomes vary between population groups including culturally and linguistically diverse communities, people with disabilities, by age, geographic location or disease type/stage.\u003c/p\u003e \u003cp\u003e \u003cstrong\u003eStudy 2\u003c/strong\u003e \u003cp\u003eRealist evaluation will be used to determine whether, how, when, where and why virtual care provision is effective. A realist evaluation explores interventions using the \u003cb\u003econtext-mechanism-outcome\u003c/b\u003e model; proposing that a given outcome is achieved because of underlying mechanism(s) that are operationalised in specific contexts.[\u003cspan citationid=\"CR28\" class=\"CitationRef\"\u003e28\u003c/span\u003e] Our preliminary work indicates that virtual care models can improve patient health and service delivery \u003cb\u003eoutcomes\u003c/b\u003e when certain \u003cb\u003emechanisms\u003c/b\u003e are apparent in certain \u003cb\u003econtexts\u003c/b\u003e (Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e). This information has been used to develop our initial theory about how virtual models might work to produce improved patient and service outcomes.[\u003cspan citationid=\"CR11\" class=\"CitationRef\"\u003e11\u003c/span\u003e] We will evaluate the virtual care models used by our health service partners to determine the conditions and circumstances that support their use, and populations for whom they work optimally.[\u003cspan citationid=\"CR29\" class=\"CitationRef\"\u003e29\u003c/span\u003e, \u003cspan citationid=\"CR30\" class=\"CitationRef\"\u003e30\u003c/span\u003e] Using realist evaluation, which we have successfully employed previously for complex program evaluations,[\u003cspan citationid=\"CR29\" class=\"CitationRef\"\u003e29\u003c/span\u003e, \u003cspan citationid=\"CR31\" class=\"CitationRef\"\u003e31\u003c/span\u003e] we will test and refine our initial theory. Further, we will examine the economic impact of virtual care by using a modified Social Accounting Matrix framework to measure the incremental direct and indirect costs and benefits of implementing the virtual care models versus usual care. The economic analysis will include an activity-based costing study to identify the costs of developing and implementing virtual care models, exploring changes in health service costs, and evaluate the health and non-health out-of-pocket costs for consumers and their families.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003c/p\u003e \u003cdiv id=\"Sec3\" class=\"Section2\"\u003e \u003ch2\u003e\u0026lt;INSERT FIGURE \u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e\u0026gt;\u003c/h2\u003e \u003cp\u003e \u003cem\u003eStudy 3\u003c/em\u003e: A controlled pre- and post-intervention study will be used to evaluate the use of a Specialised Change Methodology in improving workforce change readiness (comprising two components: change self-efficacy and commitment to change) in the context of hospital redevelopments that comprise substantial integration of virtual care. A mixed-methods survey and interview study will measure differences in workforce change readiness between cohorts of change managers, comparing change readiness among those using the Specialised Change Methodology and usual practice.\u003c/p\u003e \u003cp\u003eSetting and data sources\u003c/p\u003e \u003cp\u003eStudy 1: Outpatient hospital services providing cancer, renal, rehabilitation and mental health care in two Australian states: Victoria (VIC) and Queensland (QLD). We may seek to extend the research to include New South Wales (NSW) data in year two of the project subject to ethics and governance approvals. Data sources from Victoria and Queensland are: Victorian non admitted hospital services dataset, Victorian clinical public mental health services dataset, Victorian admitted episode dataset, Victorian emergency minimum dataset, Victorian cancer registry, Victorian registry of births, deaths and marriages, national cause of death unit record file for Victorians, Queensland health non-admitted patient data collection, Queensland consumer integrated mental health and addiction dataset, Queensland hospital admitted patient data collection, Queensland emergency data collection, Queensland cancer register and Queensland death registration and coded cause of deaths data.\u003c/p\u003e \u003cp\u003eStudy 2: National study of people accessing outpatient cancer, renal, rehabilitation and mental health care in Australia.\u003c/p\u003e \u003cp\u003eStudy 3: Two major hospital redevelopment projects in the Australian state of New South Wales.\u003c/p\u003e \u003cp\u003eStudy sample\u003c/p\u003e \u003cp\u003e \u003cspan type=\"ItalicUnderline\" class=\"ItalicUnderline\" name=\"Emphasis\"\u003eStudy 1\u003c/span\u003e: The data of patients aged\u0026thinsp;\u0026ge;\u0026thinsp;18 who attended outpatient clinics for the following priority chronic or long-terms conditions: (i) renal care; (ii) cancer; (iii) mental health; and (iv) rehabilitation in public hospitals over three-time periods will be eligible for inclusion. The time periods represent pre-, during and post- the acute Covid-19 pandemic period: 1 January 2017 and 31 December 2018 (T1), between 1 January 2020 and 31 December 2021 (T2) and between 1 January and 31 December 2023 (T3). These four outpatient services were identified by our healthcare partners as those with the greatest potential for improving access, quality and efficiency using virtual care because of the nature of these chronic and long term conditions, service demand and local burden of disease.[\u003cspan citationid=\"CR32\" class=\"CitationRef\"\u003e32\u003c/span\u003e] A sample of 395 patients is sufficient to identify a small effect size with 80% power (α\u0026thinsp;=\u0026thinsp;0.05). Hence, the full dataset will provide adequate power to explore interactions and subgroup analyses.\u003c/p\u003e \u003cp\u003e \u003cstrong\u003eStudy 2\u003c/strong\u003e \u003cp\u003eApproximately 60 consumers who have used virtual outpatient hospital services at a range of time points from 2017 onwards for one or more of the four conditions will be recruited. Sampling will seek to ensure representation from consumers with diverse cultural, ethnic, socioeconomic backgrounds, age groups, gender and sexuality, and ability, from a range of geographic regions and Australian states.\u003c/p\u003e \u003c/p\u003e \u003cp\u003e \u003cspan type=\"ItalicUnderline\" class=\"ItalicUnderline\" name=\"Emphasis\"\u003eStudy 3\u003c/span\u003e: Eligible staff are those who are directly involved in delivering the redevelopment and include: 1) hospital redevelopment staff (n\u0026thinsp;=\u0026thinsp;20 per site), 2) NSW Health Infrastructure (HI; agency responsible for state-wide capital works) Project User Group (PUG) leads who chair stakeholder meetings called PUGs for HI throughout the design and redevelopment process to enable shared agreement between developers, architects, staff and consumers about the hospital design (n\u0026thinsp;=\u0026thinsp;20 per site), and 3) staff who will be providing care using virtual and hybrid models at the newly redeveloped hospitals once completed (n\u0026thinsp;\u0026ge;\u0026thinsp;1000) staff.\u003c/p\u003e \u003cp\u003eRecruitment\u003c/p\u003e \u003cp\u003e \u003cstrong\u003eStudy 1\u003c/strong\u003e \u003cp\u003ePatient cohorts (cancer, renal, mental health and rehabilitation) will be identified from the non-admitted patient data collection and the mental health ambulatory data collection for each state based on the patient service establishment unit type and/or non-admitted service classification. Cohort data will be linked to emergency department (ED) presentation, hospital admission, and mortality data in each state for the three time periods by the Centre for Victorian Data Linkage (CVDL) and the Statistical Services Branch (SSB) Queensland.\u003c/p\u003e \u003c/p\u003e \u003cp\u003e \u003cstrong\u003eStudy 2\u003c/strong\u003e \u003cp\u003eRecruitment will occur through a multi-modal strategy that includes use of social media, healthcare and professional networks and newsletters to provide study information to people accessing the relevant virtual care services. Targeted recruitment of people who live regionally, rurally, who are from culturally and linguistically diverse backgrounds and/or have a disability will occur through a range of organisations including Language Other Than English Agency (LOTE), the Agency for Clinical Innovation (ACI) Intellectual Disability Network and a range of consumer groups. In each instance, a study flyer will be distributed via mailing lists and on social media groups, using plain English or translation as required.\u003c/p\u003e \u003c/p\u003e \u003cp\u003e \u003cstrong\u003eStudy 3\u003c/strong\u003e \u003cp\u003eRecruitment will occur via an email invitation distributed to hospital redevelopment staff, clinicians and change managers by NSW Health Infrastructure, which will contain links to the anonymous survey and unique identifiers to link data provided at each timepoint.\u003c/p\u003e \u003c/p\u003e \u003cp\u003eData Collection\u003c/p\u003e \u003cp\u003e \u003cstrong\u003eStudy 1 observational data\u003c/strong\u003e \u003cp\u003eRetrospective, linked outpatient data will be securely transmitted by CVDL, and SSB to a secure research environment known as the Secured Unified Research Environment (SURE) or the Victorian Data Access Linkage Trust (VALT). The data will be exclusively accessible to authorised research team members.\u003c/p\u003e \u003c/p\u003e \u003cp\u003e \u003cstrong\u003eStudy 2 interviews\u003c/strong\u003e \u003cp\u003eOur research team will use preliminary discussions with potential participants during the recruitment process to determine the support needs and preferences of individuals ahead of undertaking consent processes and scheduling interviews. Once preferences and needs are identified and addressed, interviews will be conducted using video-conferencing software or in person based on the participant\u0026rsquo;s preferences and requirements. Interview will be conducted by the research team, supported by accredited translators and support persons as required. Participants and their supporters will be reimbursed and remunerated for involvement as per the Health Consumers NSW payment guidelines. For online interviews, video-conferencing software will be used for transcription. For in person interviews, audio-recorders will be used, and the data will be sent to a professional transcription service (Pacific Transcription) or using transcription software.\u003c/p\u003e \u003c/p\u003e \u003cp\u003e \u003cspan type=\"ItalicUnderline\" class=\"ItalicUnderline\" name=\"Emphasis\"\u003eStudy 3 surveys\u003c/span\u003e: \u003cem\u003eIntervention group\u003c/em\u003e: Redevelopment staff and PUG leads at Hospital Redevelopment Site A (n\u0026thinsp;=\u0026thinsp;40) will receive training in the \u003cem\u003eAsset Management (AM) Specialised Change Methodology\u003c/em\u003e. The \u003cem\u003eAM Specialised Change Methodology\u003c/em\u003e is a theory-based methodology that aims to improve change readiness in infrastructure projects. The methodology was co-produced by the investigator team and HI, and integrates models from strategic change management, implementation science and project management in three stages (Fig.\u0026nbsp;2). It will be used by redevelopment staff and PUG leads at one redevelopment site over 12-months to increase change readiness for integrating virtual models.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec4\" class=\"Section2\"\u003e \u003ch2\u003e\u0026lt;INSERT FIGURE 2\u0026gt;\u003c/h2\u003e \u003cp\u003e \u003cstrong\u003eControl group\u003c/strong\u003e \u003cp\u003eA matched sample of redevelopment staff and PUG leads (n\u0026thinsp;=\u0026thinsp;40) at Hospital Redevelopment Site B, in which no formalised change methodology will be implemented, will provide comparator outcome data over a 12-month period.\u003c/p\u003e \u003c/p\u003e \u003cp\u003e \u003cstrong\u003eOutcome measures\u003c/strong\u003e \u003cp\u003eSurveys and semi-structured interviews will be used to gather pre- and post-intervention outcome data from participating staff\u003c/p\u003e \u003c/p\u003e \u003cp\u003e \u003col\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003e \u003cspan type=\"Underline\" class=\"Underline\" name=\"Emphasis\"\u003eOnline surveys\u003c/span\u003e: Organisational readiness for integrating virtual care models will be measured using validated surveys previously deployed to capture individual and collective change readiness (33). These comprise: (i) a 4-item individual change readiness scale, (ii) a 4-item collective change readiness scale; (iii) a 4-item change self-efficacy scale; and (iv) a 3-item affective commitment to change scale. [\u003cspan additionalcitationids=\"CR34\" citationid=\"CR33\" class=\"CitationRef\"\u003e33\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR35\" class=\"CitationRef\"\u003e35\u003c/span\u003e] Surveys will be administered at three time-points at both intervention and control sites: during redevelopment planning (T1), during redevelopment design (T2), and at commencement of service provision (T3). For 80% power to detect a small to medium effect (α\u0026thinsp;=\u0026thinsp;0.05), we will aim to survey 80 healthcare staff at each time point.\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003e \u003cspan type=\"Underline\" class=\"Underline\" name=\"Emphasis\"\u003eSemi-structured telephone interviews\u003c/span\u003e (at pre- and post-intervention) will be undertaken with the 40-redevelopment staff and 40 PUG leads per site. Thematic analysis of interview data will be undertaken to gather evidence of the acceptability, feasibility and perceived value of the \u003cem\u003eAM Specialised Change Methodology\u003c/em\u003e and related training at the intervention site; to explore initial perceptions of change readiness; to establish the way in which change management processes occurred in each site and explain any variation between sites that may have influenced the findings.[\u003cspan citationid=\"CR36\" class=\"CitationRef\"\u003e36\u003c/span\u003e] An iterative process of data collection and analysis will guide sample size [\u003cspan citationid=\"CR37\" class=\"CitationRef\"\u003e37\u003c/span\u003e]\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003c/ol\u003e \u003c/p\u003e \u003cp\u003eData analysis plan\u003c/p\u003e \u003cp\u003e \u003cstrong\u003eStudy 1 observational data\u003c/strong\u003e \u003cp\u003eDescriptive analysis will be performed comparing the characteristics of study sample in the cohorts for three study periods. Chi-square tests of independence and ANOVA will be used to further describe the patient, neighbourhood and subsequent health service use outcomes for the three time periods. Generalised linear mixed modelling will be used to perform multi-level modelling to examine the association between type of care (in person, hybrid or entirely virtual) with health service outcomes (emergency department visits, inpatient admissions, length of stay, mortality), adjusting for covariates including an indicator variable for COVID 19, and considering clustering of patients within health service areas. Covariates included will be age, gender, country of birth, language spoken at home, economic status, comorbidity index, remoteness classification of the place of residence, area level socio economic disadvantage and any other relevant diagnosis related variables that could potentially influence the outcomes such as stage of cancer, type of mental health diagnosis. Adjusted relative risks and 95% confidence intervals will be generated.\u003c/p\u003e \u003c/p\u003e \u003cp\u003e \u003cstrong\u003eStudy 2 interview data\u003c/strong\u003e \u003cp\u003eRetroductive analysis will be undertaken combining inductive and deductive approaches following Gilmore et al [\u003cspan citationid=\"CR38\" class=\"CitationRef\"\u003e38\u003c/span\u003e] to reveal the possible causal factors that underpin the results generated by Study 1. Our analysis will provide insight into why different virtual models work in certain contexts/for certain groups to achieve improved health service outcomes. Outcomes of interest include subsequent planned and unplanned hospitalisation after outpatient virtual care, length of stay in these admissions, patient reported outcomes of care and patient reported experiences of care. Economic analysis will examine the economic impact of virtual care by using a modified Social Accounting Matrix (SAM) framework to measure the incremental direct and indirect costs and benefits of implementing the virtual care models versus usual care. All costs and benefits will be monetised and rebased to a reference year with a 5% discount rate. A sensitivity analysis will be conducted to examine variability, and a return on investment will be determined for implementing virtual models.\u003c/p\u003e \u003c/p\u003e \u003cp\u003e \u003cstrong\u003eStudy 3 survey data\u003c/strong\u003e \u003cp\u003eSurvey data will be analysed using descriptive statistics (e.g. mean, percent change) for each site and Mann-Whitney test to compare pre-post intervention. We will use multiple linear regression to estimate the effect of the \u003cem\u003eSpecialised Change Methodology\u003c/em\u003e adjusting for differences in individual factors such as age, experience, role (clinical or non-clinical), and time in role.\u003c/p\u003e \u003c/p\u003e \u003cp\u003eEnsuring study quality\u003c/p\u003e \u003cp\u003e This program of work has been through an independent scientific peer review process by the National Health and Medical Research Council under the Partnership Projects Funding Scheme (Project number: 2015544). The scheme has competitively funded this research based on the scientific quality of the proposal and require progress reporting biannually. Throughout the project, study quality will be ensured by our project governance process which comprises primarily of an external stakeholder Project Steering Group (PSG) that includes consumers. The PSG meets twice a year to provide independent oversight of the project processes and progress against milestones. Consumer members specifically provide review and advice on consumer involvement activities and project processes to ensure that we retain a consumer-centric approach.\u003c/p\u003e \u003cp\u003ePatient or public involvement\u003c/p\u003e \u003cp\u003eConsumer involvement has been central to all elements of the research process from the project inception to execution, with a range of mechanisms being used to ensure the research receives inputs from and is disseminated with diverse stakeholder groups and communities. The protocol has been co-authored with two consumer advisors representing cultural diversity, people with disability and long-term health conditions, who have informed the project approach (DB and MS). Consumer input is embedded in the project governance through a Project Advisory Group has that includes two consumer members and provides oversight of the research approach throughout the project lifecycle. These members will also review any materials or processes of research proposed with patients and carers in detail throughout the research. During each study, community engagement with targeted populations is used to gain insight into the appropriate mechanisms to reach consumers and ensure that a diverse range of consumer perspectives are considered in the research. Attention to diverse representation is embedded in each study to ensure that participants are representative of the Australian population. Working in partnership with the project\u0026rsquo;s consumer advisors, a dissemination plan has been developed that embeds principles of accessible and inclusive research to ensure findings are shared and discussed with consumers broadly.\u003c/p\u003e \u003c/div\u003e"},{"header":"Discussion","content":"\u003cp\u003eEthical considerations have been explored, identified and a risk mitigation plan created for each matter arising through the process of applying for ethical approval for the conduct of the study. Ethics approval has been obtained for all components of the research. The first study has ethical approval from Victorian Human Research Ethics Committee which was subsequently ratified by Queensland under the mutual acceptance scheme (HREC/97793/DOH-2023-383794), studies 2 and 3 have further been approved by Macquarie University Human Research Ethics Committee (Study 2: 520231303852269 Study 3: 520231586954286), which is a National Health and Medical Research Council (NHMRC) recognised ethics committee. During the study, data will be stored on the secure VALT or SURE systems (Study 1) or the OneDrive system (studies 2 and 3) of the leading institution with the primary investigator and retained in this secure location for at least seven years following the end of the project in accordance with the national ethical requirements.\u003c/p\u003e \u003cp\u003eThrough the project development process, several key risks and mitigation strategies were identified and developed. Four strategies will ensure that research activities will be managed and coordinated effectively. Firstly, we have established approval from the research sites in each state to conduct this work to mitigate the risk of not being able to access the services and individuals within these. Secondly, to address risks of working nationally, we have local project team members in each state to ensure local oversight. Thirdly, we are cognisant of the complexities, associated risks and mitigation practices needed to work with a highly diverse consumer group. To address the risk of not being able to interact with the diverse target population of consumers effectively, we access relevant translation services, bilingual fieldworkers and have budgeted for the associated costs and complexity. Finally, annual meetings, monthly virtual meetings and the project reference group mitigates risk and enhances our ability to respond effectively.\u003c/p\u003e \u003cp\u003eThe study findings will be disseminated at multiple events and through a range of formats to ensure that all stakeholder groups with interest in the project and its outcomes are able to access and interact with the findings. Specific mechanisms to enhance the successful implementation of virtual care will be disseminated, along with findings from the individual studies. In year 1, we will engage with established communities of practice around virtual care in three Australian states to translate knowledge as it emerges throughout the project into policy and practice change, and into business as usual with the partner organisations. COPs are a tool to facilitate the implementation of evidence-based practice across boundaries, but also to generate and manage evidence to support the adoption of best practice.[\u003cspan citationid=\"CR39\" class=\"CitationRef\"\u003e39\u003c/span\u003e] Our approach to knowledge translation seeks to build clinician, facility management and research capacity to advance and sustain the adoption of virtual models using standardised and evidence-based approaches to improve service delivery, outcomes and system efficiency.\u003c/p\u003e"},{"header":"Discussion","content":"\u003cp\u003ePrincipal Findings\u003c/p\u003e \u003cp\u003e The study aims to produce large-scale, population-based evidence on the use of virtual care in outpatient services and its impact on health service delivery outcomes, with a particular focus on priority populations. It will generate insights into the contexts, circumstances, and populations where virtual care models are most effective, as well as their economic impact. The study will also test the effectiveness of a Specialized Change Methodology to enhance workforce readiness and capability for integrating virtual care models compared to current practices. Additionally, it will co-produce and integrate theory and evidence-based virtual care design principles, change methodology resources, and evaluation frameworks to improve health and service outcomes, which will be disseminated through communities of practice focused on virtual care models.\u003c/p\u003e \u003cp\u003eStrengths and limitations of this study\u003c/p\u003e \u003cp\u003e \u003cul\u003e \u003cli\u003e \u003cp\u003ePartnership with clinicians, consumers and health agencies nationally will drive the project aims to be relevant to health system stakeholders.\u003c/p\u003e \u003c/li\u003e \u003cli\u003e \u003cp\u003eUsing multiple hospital administrative datasets and data linkage methods enables this project to explore outcomes associated with virtual care across multiple states and services nationally but cannot provide causal evidence.\u003c/p\u003e \u003c/li\u003e \u003cli\u003e \u003cp\u003eRealist evaluation will enable the identification of the factors that influence virtual care experiences and outcomes for different communities.\u003c/p\u003e \u003c/li\u003e \u003cli\u003e \u003cp\u003eThe analysis of hospital administrative data focuses on virtual care in outpatient settings only. Although findings may not be directly transferable to other virtual care provision in the Australian health system, or to other health systems learning from this research will have relevance internationally as many health services across the globe move to virtual delivery for some care processes.\u003c/p\u003e \u003c/li\u003e \u003c/ul\u003e \u003c/p\u003e"},{"header":"Conclusions","content":"\u003cp\u003e This research is being conducted with a view of developing evidence and solutions for health services nationally to improve patient and service delivery outcomes for virtual care facilitated by best practice change management.\u003c/p\u003e"},{"header":"Declarations","content":"\u003ch2\u003eFunding\u003c/h2\u003e\n\u003cp\u003eThis work is funded by the National Health and Medical Research Council Partnership Scheme grant number: 2015544. \u0026nbsp;\u003c/p\u003e\n\u003ch2\u003eAcknowledgements\u003c/h2\u003e\n\u003cp\u003eWe would like to thank the \u0026lsquo;Smarter Hospitals Project\u0026rsquo; partners\u0026mdash;NSW Health Infrastructure, Western NSW Local Health District, South Western Sydney Local Health District, UNSW Sydney, Western Health, Northern Health, University of Leeds, Townsville Hospital and Health Service, Monash University and Macquarie University\u0026mdash;for their support.\u003c/p\u003e\n\u003ch2\u003eData availability\u003c/h2\u003e\n\u003cp\u003eData and materials will be made available upon the publication of the findings. The datasets generated or analysed during this study can be obtained from the corresponding author upon reasonable request, unless restricted by the data custodians.\u003c/p\u003e\n\u003cp\u003eAuthors\u0026rsquo; Contributions\u003c/p\u003e\n\u003cp\u003eRH, RCW, AC, JB and RM conceived the project. All authors collectively developed the project design through creating the NHMRC project proposal that forms the basis of this protocol. We work collaboratively through a series of meetings and working across multiple drafts. In these ways, all authors contributed to developing the project design and study methods described in the protocol as project investigators. RH prepared the initial draft of the protocol based on the project protocol and contributions were made by all authors to all aspects of the protocol manuscript. The authorship team meet monthly to plan the project processes. RH, RM, RW, MS are primarily responsible for data acquisition, preparation and analysis across the sites and states, with local project team members in the services and health agencies SS, AM, AC, MM, WC, DB, AG, TW contributing to data acquisition, preparation and analysis at each study site. All authors edited, contributed content, and reviewed the final draft of the protocol.\u003c/p\u003e\n\u003ch2\u003eConflicting interests\u003c/h2\u003e\n\u003cp\u003eNo conflicting interests to declare.\u003c/p\u003e\n\u003cp\u003eHuman Ethics and Consent to Participate\u0026nbsp;\u003c/p\u003e\n\u003cp\u003eEthical considerations have been explored, identified and a risk mitigation plan created for each matter arising through the process of applying for ethical approval for the conduct of the study. Ethics approval has been obtained for all components of the research. The first study has ethical approval from Victorian Human Research Ethics Committee which was subsequently ratified by Queensland under the mutual acceptance scheme (HREC/97793/DOH-2023-383794), studies 2 and 3 have further been approved by Macquarie University Human Research Ethics Committee (Study 2: 520231303852269 Study 3: 520231586954286), which is a National Health and Medical Research Council (NHMRC) recognised ethics committee. \u0026nbsp;As per our ethical approvals, we confirm that all human participants will provide their consent to participate before taking part in any study processes.\u003c/p\u003e"},{"header":"References","content":"\u003col\u003e\n\u003cli\u003eHarkey LC, Jung SM, Newton ER, Patterson A. Patient satisfaction with telehealth in rural settings: a systematic review. International journal of telerehabilitation. 2020;12(2):53.\u003c/li\u003e\n\u003cli\u003eMistry SK, Shaw M, Raffan F, Johnson G, Perren K, Shoko S, et al. Inequity in access and delivery of virtual care interventions: a scoping review. International Journal of Environmental Research and Public Health. 2022;19(15):9411.\u003c/li\u003e\n\u003cli\u003eSchwamm LH, Estrada J, Erskine A, Licurse A. Virtual care: new models of caring for our patients and workforce. The Lancet Digital Health. 2020;2(6):e282-e5.\u003c/li\u003e\n\u003cli\u003eSnoswell CL, Taylor ML, Comans TA, Smith AC, Gray LC, Caffery LJ. Determining if telehealth can reduce health system costs: scoping review. J Med Internet Res. 2020;22(10):e17298.\u003c/li\u003e\n\u003cli\u003eMenvielle L, Audrain-Pontevia A-F, Menvielle W. The digitization of healthcare: new challenges and opportunities: Springer; 2017.\u003c/li\u003e\n\u003cli\u003eWootton R. Twenty years of telemedicine in chronic disease management \u0026ndash; an evidence synthesis. Journal of telemedicine and telecare. 2012;18(4):211-20.\u003c/li\u003e\n\u003cli\u003ePatel KB, Turner K, Alishahi Tabriz A, Gonzalez BD, Oswald LB, Nguyen OT, et al. Estimated Indirect Cost Savings of Using Telehealth Among Nonelderly Patients With Cancer. JAMA Network Open. 2023;6(1):e2250211-e.\u003c/li\u003e\n\u003cli\u003eChu C, Nayyar D, Bhattacharyya O, Martin D, Agarwal P, Mukerji G. Patient and Provider Experiences With Virtual Care in a Large, Ambulatory Care Hospital in Ontario, Canada During the COVID-19 Pandemic: Observational Study. J Med Internet Res. 2022;24(10):e38604.\u003c/li\u003e\n\u003cli\u003eHutchings OR, Dearing C, Jagers D, Shaw MJ, Raffan F, Jones A, et al. Virtual Health Care for Community Management of Patients With COVID-19 in Australia: Observational Cohort Study. J Med Internet Res. 2021;23(3):e21064.\u003c/li\u003e\n\u003cli\u003eAlmathami HKY, Win KT, Vlahu-Gjorgievska E. Barriers and facilitators that influence telemedicine-based, real-time, online consultation at patients\u0026rsquo; homes: systematic literature review. J Med Internet Res. 2020;22(2):e16407.\u003c/li\u003e\n\u003cli\u003eHarrison R ME, Mimmo L, Walpola R, Roxas-Harris B,. Clinician Experience of Virtual Modes. NSW Mnistry of Health, Branch SR; 2021.\u003c/li\u003e\n\u003cli\u003eEdge R, Meyers J, Tiernan G, Li Z, Schiavuzzi A, Chan P, et al. Cancer care disruption and reorganisation during the COVID-19 pandemic in Australia: A patient, carer and healthcare worker perspective. PLoS ONE. 2021;16(9):e0257420.\u003c/li\u003e\n\u003cli\u003eClay-Williams R, Baysari M, Taylor N, Zalitis D, Georgiou A, Robinson M, et al. Service provider perceptions of transitioning from audio to video capability in a telehealth system: a qualitative evaluation. BMC health services research. 2017;17(1):1-8.\u003c/li\u003e\n\u003cli\u003eRivera V, Aldridge MD, Ornstein K, Moody KA, Chun A. Racial and socioeconomic disparities in access to telehealth. Journal of the American Geriatrics Society. 2021;69(1):44.\u003c/li\u003e\n\u003cli\u003eJonnagaddala J, Godinho MA, Liaw S-T. From telehealth to virtual primary care in Australia? A Rapid scoping review. International Journal of Medical Informatics. 2021:104470.\u003c/li\u003e\n\u003cli\u003eSutherland K, Chessman J, Zhao J, Sara G, Shetty A, Smith S, et al. Impact of COVID-19 on healthcare activity in NSW, Australia. Public Health Res Pract. 2020;30(4):e3042030.\u003c/li\u003e\n\u003cli\u003eFisk M, Livingstone A, Pit SW. Telehealth in the Context of COVID-19: Changing Perspectives in Australia, the United Kingdom, and the United States. J Med Internet Res. 2020;22(6):e19264.\u003c/li\u003e\n\u003cli\u003eAstier A, Carlet J, Hoppe-Tichy T, Jacklin A, Jeanes A, McManus S, et al. What is the role of technology in improving patient safety? A French, German and UK healthcare professional perspective. Journal of Patient Safety and Risk Management. 2020;25(6):219-24.\u003c/li\u003e\n\u003cli\u003eAudit Office of NSW. Health Capital Works. 2020.\u003c/li\u003e\n\u003cli\u003eNew South Wales Health. 20-Year Health Infrastructure Strategy. Sydney: NSW Health; 2021.\u003c/li\u003e\n\u003cli\u003eAustralasian Health Facility Guidelines. Australasian Health Facility Guidelines 2021 [Available from: https://healthfacilityguidelines.com.au/aushfg-parts.\u003c/li\u003e\n\u003cli\u003ePhimphasone-Brady P, Chiao J, Karamsetti L, Sieja A, Johnson R, Macke L, et al. Clinician and staff perspectives on potential disparities introduced by the rapid implementation of telehealth services during COVID-19: a mixed-methods analysis. Translational Behavioral Medicine. 2021;11(7):1339-47.\u003c/li\u003e\n\u003cli\u003eScott RE, Mars M. Behaviour change and e-health\u0026mdash;looking broadly: a scoping narrative review. Stud Health Technol Inform. 2020;268:123-38.\u003c/li\u003e\n\u003cli\u003eMichie S, Van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6(1):1-12.\u003c/li\u003e\n\u003cli\u003eMichie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Quality and Safety in Health Care. 2005;14(1):26-33.\u003c/li\u003e\n\u003cli\u003eHarrison R, Fischer S, Walpola RL, Chauhan A, Babalola T, Mears S, et al. Where Do Models for Change Management, Improvement and Implementation Meet? A Systematic Review of the Applications of Change Management Models in Healthcare. Journal of healthcare leadership. 2021;13:85.\u003c/li\u003e\n\u003cli\u003eLe-Dao H, Chauhan A, Walpola R, Fischer S, Schwarz G, Minbashian A, et al. Managing Complex Healthcare Change: A Qualitative Exploration of Current Practice in New South Wales, Australia. Journal of healthcare leadership. 2020;12:143.\u003c/li\u003e\n\u003cli\u003eFlynn R, Rotter T, Hartfield D, Newton AS, Scott SD. A realist evaluation to identify contexts and mechanisms that enabled and hindered implementation and had an effect on sustainability of a lean intervention in pediatric healthcare. BMC Health Serv Res. 2019;19(1):912.\u003c/li\u003e\n\u003cli\u003eSarkies MN, Francis-Auton E, Long JC, Partington A, Pomare C, Nguyen HM, et al. Implementing large-system, value-based healthcare initiatives: a realist study protocol for seven natural experiments. BMJ Open. 2020;10(12):e044049.\u003c/li\u003e\n\u003cli\u003ePawson R, Tilley N, Tilley N. Realistic evaluation: sage; 1997.\u003c/li\u003e\n\u003cli\u003eWong G, Westhorp G, Manzano A, Greenhalgh J, Jagosh J, Greenhalgh T. RAMESES II reporting standards for realist evaluations. BMC Med. 2016;14(1):1-18.\u003c/li\u003e\n\u003cli\u003eAustralian Bureau of Statistics. Experiences of telehealth services. 2021.\u003c/li\u003e\n\u003cli\u003eHarrison R MA, Schwarz G, Chauhan A, Walpola R, Le-Dao, H.,. Translation and change: Embedding effective change management in health. UNSW Health SoP; 2020.\u003c/li\u003e\n\u003cli\u003eHerscovitch L, Meyer JP. Commitment to organizational change: extension of a three-component model. Journal of applied psychology. 2002;87(3):474.\u003c/li\u003e\n\u003cli\u003eRafferty AE, Minbashian A. Cognitive beliefs and positive emotions about change: Relationships with employee change readiness and change-supportive behaviors. Human Relations. 2019;72(10):1623-50.\u003c/li\u003e\n\u003cli\u003eBraun V, Clarke V, Hayfield N, Terry G. Thematic analysis. Handbook of research methods in health social sciences. 2018:1-18.\u003c/li\u003e\n\u003cli\u003eMalterud K, Siersma VD, Guassora AD. Sample Size in Qualitative Interview Studies:Guided by Information Power. Qual Health Res. 2016;26(13):1753-60.\u003c/li\u003e\n\u003cli\u003eGilmore B, McAuliffe E, Power J, Valli\u0026egrave;res F. Data Analysis and Synthesis Within a Realist Evaluation: Toward More Transparent Methodological Approaches. International Journal of Qualitative Methods. 2019;18:1609406919859754.\u003c/li\u003e\n\u003cli\u003eRanmuthugala G, Plumb JJ, Cunningham FC, Georgiou A, Westbrook JI, Braithwaite J. How and why are communities of practice established in the healthcare sector? A systematic review of the literature. BMC Health Serv Res. 2011;11(1):273. \u003c/li\u003e\n\u003c/ol\u003e"}],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":true,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":false,"highlight":"","institution":"","isAcceptedByJournal":true,"isAuthorSuppliedPdf":false,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":false,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"bmc-health-services-research","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"bhsr","sideBox":"Learn more about [BMC Health Services Research](http://bmchealthservres.biomedcentral.com/)","snPcode":"","submissionUrl":"https://www.editorialmanager.com/BHSR/default.aspx","title":"BMC Health Services Research","twitterHandle":"BMC_series","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"em","reportingPortfolio":"BMC Series","inReviewEnabled":true,"inReviewRevisionsEnabled":true},"keywords":"Virtual care, telehealth, virtual care integration, study protocol, healthcare outcomes, healthcare access, healthcare equity, digital health","lastPublishedDoi":"10.21203/rs.3.rs-4799684/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-4799684/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003e\u003cb\u003eBackground\u003c/b\u003e\u003c/p\u003e \u003cp\u003eIntegration of virtual and in person care across health systems is a priority to create and sustain healthy nations by improving access to services, along with healthcare experiences, efficiency, and outcomes. Our collaborative project between health services, agencies, consumers, and clinicians across Australia seeks to provide the required evidence and solutions to optimise the integration of virtual care in hospital outpatient settings.\u003c/p\u003e\u003cp\u003e\u003cb\u003eMethods\u003c/b\u003e\u003c/p\u003e \u003cp\u003eOur five-year project contains three sub-studies using a multi-method approach. Firstly, linked hospitalisation data will be used to describe the patterns of virtual outpatient use and the associated health service outcomes, including for priority populations. The second sub-study will use realist evaluation to determine the context, circumstances, and populations in which virtual care is used successfully, and economic impact of virtual care. We will then test the effectiveness of a co-designed Specialised Change Methodology for improving workforce change readiness and capability for integrating virtual models of care compared to current practice within health redevelopment settings. Statistical and qualitative analytic techniques will be applied.\u003c/p\u003e\u003cp\u003e\u003cb\u003eDiscussion\u003c/b\u003e\u003c/p\u003e \u003cp\u003eThe study will generate evidence and resources to support the successful integration of virtual care in Australian health systems. Ethics approval has been obtained from the Victorian Human Research Ethics Committee (Study 1: HREC/97793/DOH-2023-383794), and Macquarie University Human Research Ethics Committee (Study 2: 520231303852269; Study 3 520231586954286). Research dissemination will be channelled through established communities of practice in Australian states to reach networks of clinicians, consumers and health managers. Further targeted outputs will be devised in collaboration with the consumer, clinician and health system partners to guide the implementation and use of virtual modalities in outpatient care, with equity as a central consideration. In addition to scientific research outputs, we will develop and disseminate evidence-based Virtual Care Design Principles, Evaluation Framework and Specialised Change Methodology for improving the integration of virtual outpatient hospital care.\u003c/p\u003e","manuscriptTitle":"Unlocking the promise of virtual care in hospitals: The Smarter Hospitals Project Protocol","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2024-08-23 19:24:04","doi":"10.21203/rs.3.rs-4799684/v1","editorialEvents":[{"type":"communityComments","content":0},{"type":"decision","content":"Revision requested","date":"2025-04-08T16:33:37+00:00","index":"","fulltext":""},{"type":"editorAssigned","content":"","date":"2024-07-29T17:43:43+00:00","index":"","fulltext":""},{"type":"checksComplete","content":"","date":"2024-07-29T08:39:30+00:00","index":"","fulltext":""},{"type":"submitted","content":"BMC Health Services Research","date":"2024-07-25T07:06:07+00:00","index":"","fulltext":""}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"bmc-health-services-research","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"bhsr","sideBox":"Learn more about [BMC Health Services Research](http://bmchealthservres.biomedcentral.com/)","snPcode":"","submissionUrl":"https://www.editorialmanager.com/BHSR/default.aspx","title":"BMC Health Services Research","twitterHandle":"BMC_series","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"em","reportingPortfolio":"BMC Series","inReviewEnabled":true,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"cbd95b96-e71b-40cd-bca4-5e7bfa51ac00","owner":[],"postedDate":"August 23rd, 2024","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"published-in-journal","subjectAreas":[],"tags":[],"updatedAt":"2025-08-18T16:08:39+00:00","versionOfRecord":{"articleIdentity":"rs-4799684","link":"https://doi.org/10.1186/s12913-025-13129-2","journal":{"identity":"bmc-health-services-research","isVorOnly":false,"title":"BMC Health Services Research"},"publishedOn":"2025-08-11 15:58:04","publishedOnDateReadable":"August 11th, 2025"},"versionCreatedAt":"2024-08-23 19:24:04","video":"","vorDoi":"10.1186/s12913-025-13129-2","vorDoiUrl":"https://doi.org/10.1186/s12913-025-13129-2","workflowStages":[]},"version":"v1","identity":"rs-4799684","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-4799684","identity":"rs-4799684","version":["v1"]},"buildId":"qtupq5eGEP_6zYnWcrvyt","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}