Dual Healthcare System Users and Risk of Opioid Use Disorder: A Deep Learning analysis

Dual Healthcare System Users and Risk of Opioid Use Disorder: A Deep Learning analysis | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Article Dual Healthcare System Users and Risk of Opioid Use Disorder: A Deep Learning analysis Ying Yin, Elizabeth Workman, Phillip Ma, Yan Cheng, Yijun Shao, and 13 more This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-4344773/v1 This work is licensed under a CC BY 4.0 License Status: Published Journal Publication published 29 Jan, 2025 Read the published version in Scientific Reports → Version 1 posted 10 You are reading this latest preprint version Abstract The opioid crisis has disproportionately affected U.S. veterans, leading the Veterans Health Administration to implement opioid prescribing guidelines. Veterans who receive care from both VA and non-VA providers—known as dual-system users — have an increased risk of Opioid Use Disorder (OUD). The interaction between dual-system use and demographic and clinical factors, however, has not been previously explored. We conducted a retrospective study of 856,299 patient instances from the Washington DC and Baltimore VA Medical Centers (2012–2019), using a deep neural network (DNN) and explainable Artificial Intelligence to examine the impact of dual-system use on OUD and how demographic and clinical factors interact with it. Of the cohort, 146,688(17%) had OUD, determined through Natural Language Processing of clinical notes and ICD-9/10 diagnoses. The DNN model, with a 78% area under the curve, confirmed that dual-system use is a risk factor for OUD, along with prior opioid use or other substance use. Interestingly, a history of other drug use interacted negatively with dual-system use regarding OUD risk. In contrast, older age was associated with a lower risk of OUD but interacted positively with dual-system use. These findings suggest that within the dual-system users, patients with certain risk profiles warrant special attention. Health sciences/Health care Health sciences/Risk factors Deep Neural Network Explainable AI Opioid Use Disorder dual-system use interaction Figures Figure 1 Figure 2 Figure 3 Introduction Millions of Americans who suffer from chronic and acute pain are prescribed opioid. Prescription misuse and opioid use disorder (OUD), however, have been a grave concern across the U.S. during the past two decades. Between 1999 and 2010, there was a sharp increase in opioid prescribing in the U.S., which has led to a dramatic increase in prescription opioid-related overdose death. 1 Since 2012, tighter regulation has resulted in a steady decline in opioid prescription in most healthcare settings. 2 OUD, however, did not decline at the same rate. 3 Furthermore, opioid-related deaths continue to increase. In 2021 alone, more than 106,000 individuals in the U.S. died from drug-involved overdose with 14,900 extra cases from the year prior. 4 Similarly, the opioid epidemic has greatly impacted active-military personnel and veterans, reflected by the rising rates of opioid addiction and overdose deaths till 2012. 5 , 6 In response, the VA has dramatically reduced opioid prescriptions, with only 7.9% of patients receiving these medications in 2021 compared to 22% in 2013. 7 While significant efforts have been made and progress has been reported in promoting safe opioid use and decreasing opioid-related mortality, a challenge has been the care coordination when patients have access to multiple healthcare systems, or multiple sources of opioid prescriptions. Studies has shown that such fragmented care can leave patients at a higher risk of opioid use and misuse, which may be due to lack of information sharing between healthcare systems. 8 , 9 This challenge is important for the US Veterans Administration (VA), as many VA enrollees also receive outside care via Veterans Choice Program (VCP)/Veterans Community Care Program (VCCP), which are paid for by the VA. The dual-system care adds another layer of responsibility for VA to understand its impact on opioid use. Our own study confirmed that VA patients who use both VA and community care (dual-system users) are more likely to have opioid initiation, continued opioid prescriptions, and diagnoses of OUD than those who only use VA care. 10 While dual-system users face a heightened OUD risk, little is known about how individual patient factors affect this vulnerability. Traditionally, differential effects are analyzed using statistical interaction or regression mixture models. The rise of artificial intelligence (AI), especially deep neural network (DNN) models, provided us with a new approach. Literature has shown that when trained on large datasets, DNNs are particularly capable of modeling complex, non-linear relationships without making assumptions of the variable independence or distribution. 11 However, since DNN models often have a large number of parameters, they are difficult to interpret and are thus sometimes called black box models. To tackle this problem, our research team has developed and validated an explainable AI method, 12 , 13 allowing the assessment of an individual feature’s contribution, as well as the interactions between features that are captured by DNN models. One challenge we face in analyzing OUD using medical record data is that it has been widely reported OUD is often under coded. 14 A number of studies, including one from our team, have developed natural language processing (NLP) methods to identify OUD from clinical notes. 15 – 20 NLP systems generally consist of either hard-coded rules, or trained machine learning models, or both. 15 The development of NLP tools allows us to capture a fuller extent of the OUD problem. In this study, we assembled a cohort of veterans from the Washington DC and Baltimore Veteran Affairs (VA) Medical Centers with mono- or dual- system enrollment and evaluated the association of dual-system use status and OUD using a DNN model. OUD was determined through ICD codes or NLP classification of clinical notes. Additionally, we leveraged a novel explainable AI approach to assess the impact of dual-system use on the outcome of OUD and how patient demographic and clinic characteristics interact with dual-system use status to influence the outcome. Methods Study Population Our study cohort consists of 222,370 distinct patients who received outpatient care between 2012 and 2019. We required that each patient must have at least two encounters from two consecutive calendar years in the Washington DC or Baltimore VA Medical Center. (VA IRBnet protocol #1607134) Since dual-system user status changes over time, each year is treated as a separate cohort. Patients with multiple and inconsistent dates of birth, gender, race, or ethnicity were excluded. We used January 1st of each cohort year as the index date for retrieving comorbid conditions and outcomes. All data were derived from electronic health records (EHR) from the VA Corporate Data Warehouse (CDW). Research was performed within the secure VA Informatics and Computing Infrastructure (VINCI) platform. 21 NLP Application To identify patients with problematic opioid use-related concerns (e.g., current abuse, overuse, or addiction) documented in their clinical notes, we developed an NLP classifier that uses both rule-based and machine learning methods. 20 After reviewing sample notes, two project members identified 36 key phrases relevant to problematic opioid use concern documentation. Using snippets (a span of clinical note text containing one of the key phrases), the team developed a support vector machine (SVM) model to identify notes documenting problematic opioid use concerns. Also using snippets, the team built a library of regular expressions matching relevant template data (e.g., “[x] substance abuse and/or dependence”) and relevant standard clinical text (e.g., “current opioid dependence”). Leveraging both the SVM and regular expressions, the NLP classifier achieved 96.6% specificity, 90.4% precision/PPV, 88.4% sensitivity/recall, and 94.4% accuracy on an unseen (i.e. not used in classifier development) snippet dataset. Predictors Covariates including dual-system user status, demographic, and clinical variables were derived from the VA Corporate Data Warehouse (CDW) before the index date. We defined dual healthcare system users as those with VCP/VCCP encounters in the calendar year by use of a VA stop code designated for the community care program, or VCP/VCCP note. Patients without any VCP/VCCP encounter in a calendar year were defined as “mono” users. The clinical variables like comorbid diagnoses were defined using the criteria established by the VA MSD cohort 10 and derived from the relevant ICD 9/10 codes. Other drug disorders include cannabis-related disorders, nicotine dependence, cocaine-related disorders, and others (ICD-9: 304.1-304.6,304.8-304.9, 305.2-305.4, 305.6-305.9; ICD-10: F12-F19). Age was measured as a continuous variable and the other covariates were measured as categorical variables. Study outcomes The study outcome is OUD within each calendar year. OUD was defined in two ways: using the ICD 9/10 codes of 304.0, 304.7, 305.5, and F11; and the OUD-related issues documented in clinical notes that are extracted by the NLP tool described above. DNN modeling The deep neural network (DNN) model is assembled with a variation of the residual network (ResNet) model, 22 as shown in Fig. 1 . The input variables undergo a linear transformation, followed by two residual blocks. Each residual block consists of two feed-forward layers with layer normalization and ReLU activation, and a skip connection to add the residual from the previous layer. The benefit of the ResNet model is that it is more stable and efficient for training. The final layer is activated with the sigmoid function σ, so that the output value is always between 0 and 1. The dataset was split into training, validation, and testing sets in a ratio of 64%, 16%, and 20%, respectively. Due to the rarity of the observed outcome, an imbalance between positive and negative instances existed in the dataset. To address this, a down-sampling approach was implemented on the majority class for the training set. Specifically, a randomly selected subset of the controls was selected with 1:1 ratio to the case for training. The validation set and test set remained unchanged representing the original population. The binary cross-entropy function was used as the loss function, and the area under the ROC curve (AUC) was used as the main metric for measuring the model performance. Stochastic gradient descent was used for optimization. A dropout rate of 0.25 was used for regularization and an early stopping mechanism (i.e. stop the training once the model's AUC on the validation set stops improving) was also adopted to prevent overfitting. Impact and Impact Scores Because DNN models are often considered black boxes, our team developed a scoring method to measure the impact of features on model output. 12 , 23 The output score, defined as the impact score, is similar to the coefficient of a logistic regression model, which measures the association between changes in the predictor value and changes in the output. For binary variables, the score measures the difference between the output when the feature is absent and the output when the feature is present. For continuous variables, the score measures the impact of a one-unit increase in the variable value. Interaction and interaction score: Similarly, we designed the interaction score to measure the interaction between two variables. 24 Conceptually, we define the interaction between two variables as the residual impact of changes in both variables simultaneously subtracting the impact of each individual variable. Confidence interval and bootstrapping: To estimate the confidence intervals of the impact scores and interaction scores of our model, we employed the nonparametric percentile bootstrap method. In this approach, we resampled the original data with replacement 200 times, trained the model, and independently calculated the impact scores and interaction scores. The 95% confidence interval was determined as the range between the 2.5th and 97.5th percentiles of the calculated scores for each feature. Results As we evaluated the patient's baseline characteristics and OUD outcomes over the year, we treated the same patients in different years as separate instances in our analysis. Thus, we had a total of 856,299 patient instances from 2012 to 2019. Of these, 17% had an OUD outcome identified either by ICD code or NLP classification. The differences in demographics and selected clinical characteristics are shown in the Table 1 . In summary, patients with OUD tend to be younger, more likely to be Black and single, and more likely to have dual-system use, prior opioid use, and other substance use disorders. Using these predictors for OUD outcomes in our DNN model, our model achieved a 78% AUC during training, validation, and testing (Table 2 ). Table 1 Demographics of Groups with and without OUD Based on NLP or ICD Codes. Opioid Abuse Disorder No Yes N = 709,611 N = 146,688 ASD (%) Age 61.9 ± 17.0 56.8 ± 14.2 32 Dual-system user 54489 (8%) 22982 (16%) 25 Female 99325 (14%) 22916 (16%) 5 Race Non-Hispanic White 324987 (46%) 46937 (32%) 29 Hispanic 16700 (2%) 3146 (2%) 1 Non-Hispanic Black 278841 (39%) 87740 (60%) 42 Non-Hispanic Other 30933 (4%) 5371 (4%) 4 Unknown 58150 (8%) 3494 (2%) 26 Marital Status Single 117994 (17%) 35993 (25%) 20 Divorced 142313 (20%) 41879 (29%) 20 Married 347810 (49%) 48335 (33%) 33 Separated 29482 (4%) 12010 (8%) 17 Unknown 22690 (3%) 910 (1%) 19 Widowed 49322 (7%) 7561 (5%) 8 Prior opioid prescription 336428 (47%) 99550 (68%) 42 Comorbidity Alcohol use disorder 95641 (13%) 62532 (43%) 69 Anxiety 150629 (21%) 58060 (40%) 41 Back Pain 318722 (45%) 87035 (59%) 29 Cancer 122294 (17%) 19947 (14%) 10 Diabetes 212854 (30%) 86098 (59%) 3 Depression 203234 (29%) 43941 (30%) 60 Hypertension 435223 (61%) 92422 (63%) 3 Neck Pain 200018 (28%) 61288 (42%) 29 Other drug disorder 59672 (8%) 59825 (41%) 81 PTSD 121873 (17%) 52920 (36%) 44 TBI 38192 (5%) 15269 (10%) 19 Tobacco use disorder 159410 (22%) 69949 (48%) 55 PTSD = Post-Traumatic Stress Disorder, TBI = Traumatic Brain Injury Table 2 DNN performances on training, validation and test datasets. F1 Accuracy Precision Recall AUC Training 0.699 0.708 0.72 0.679 0.783 Validation 0.461 0.727 0.349 0.681 0.783 Test 0.462 0.728 0.35 0.68 0.784 HTN = Hypertension; OUD = Opioid Use Disorder; PTSD = Post Traumatic Stress Disorder; TBI = Traumatic Brain Injury A positive impact score indicates an association with increased risks of OUD, and a negative impact score indicates an association with decreased risks of OUD. It is clear that previous abuse of other drugs is the most significant risk factor. use is also one of the top risk factors (Fig. 2). A positive interaction score indicates a higher risk than the additive impacts of the two predictors, and a negative interaction score indicates a lower risk. Figure 3 shows that age has a positive interaction with dual-system use. In contrast, races such as Non-Hispanic Black or Non-Hispanic Other, as well as a history of other drug disorders and prior PTSD diagnosis, interact negatively with it. Discussion The explainable AI analyses confirmed that dual-system use is associated with OUD in our cohort. The interaction analysis of OUD with other covariates revealed that the combined impact of dual-system use with a number of conditions (e.g., PTSD, abuse of other drugs) is less than their additive impacts. Conversely, older patients who are dual system users are at a higher risk for OUD. Interestingly, the predictors with a negative interaction score regarding dual user status tend to be those associated with a positive impact score. Inversely, predictors with a positive interaction score concerning dual-system use are often associated with a negative impact score. This could suggest that dual system use has a more significant impact on those not already at high risk. This and other previous studies have identified dual system use as a risk factor. 10 Known risk factors such as prior drug abuse has also been confirmed. 25 A novel finding of this study is that patients without well-known risk factors, such as other drug abuse, may be more affected by dual user status. In this study the dual use status was limited to VA-paid community care, while Veterans may seek care outside of the VA independently, which may be considered a limitation. Another limitation is the imperfect nature of OUD identification by NLP, which does not equate to an OUD diagnosis. Nevertheless, our NLP classifier achieved over 94.4% accuracy, as confirmed by medical expert annotation. Within our cohort, 16,852 patient instances had an ICD-based OUD diagnosis, of which 88% were corroborated by NLP. At the same time, the NLP identified almost eight times more patients with OUD conditions. Given the under-coding reality of OUD in EHR, 14 the NLP program provides additional insights into OUD prevalence among Veterans. Our analysis confirmed that dual-system users are more likely to have OUD identified by both ICD and NLP. For our cohort assembly, we did not exclude patients with existing OUD. In general, patients with a prior OUD diagnosis will be more likely to receive OUD diagnoses in subsequent years. 26 , 27 In our cohort, 65% of the patients had additional OUD diagnoses after their first OUD diagnoses. Even though relapse is common, many patients eventually recover from OUD. 28 We thus did not limit the outcome to first OUD diagnosis. A future direction we plan to explore is analyzing the underlying causes of interactions that increase OUD risks. In addition, social and community factors play important roles in the prevention of OUD. We hope to include those factors in future analyses. Conclusion In conclusion, out analysis underscores the heightened risk of OUD among dual-system users, a finding that echoes that patterns identified in prior research. Notably, our study brings to light that the risk associated with dual-system use is not uniformly distributed across all patient demographics. Specifically, the risk is more pronounced in patients who are not traditionally identified as high-risk such as prior substance disorder. This revelation suggests a nuanced approach to public health interventions, advocating for a focus on seemingly lower-risk population like older patients, who may be more susceptible to the adverse effects of dual-system use. Declarations Conflict of interest statement We declare that this study was conducted in the absence of any commercial or financial relationships that could be construed as potential conflicts of interest. Ethics Statement This study was approved by the Institution Review Boards for the Washington DC VA Medical Center and West Haven VA. Author Contribution QZ-T and JK obtained the funding for the project; QZ-T designed and supervised the experiments; YY performed analyses; TW performed the NLP classification; PM and YC participated in the data analyses; YS provides methodology guidance; WB, FS, and CS provided guidance as clinical experts in pain management and opioid use; JG and CB provided guidance on cohort creation; HMS facilitated data curation from the EHR; JTK, JB, RMA, NS, and AB participated in the results interpretation; All authors contributed to the article and approved the submitted version. Acknowledgements This work is supported by VA grant 1I01HX003100-01A2 “Assessing and Reducing Opioid Misuse Among Veterans in VA and Non-VA Systems: Coordination of Fragmented Care.” Data Availability The data that support the findings of this study are derived from the Veterans Health Administration’s Clinical Data Warehouse. Restrictions apply to the availability of these data, which were used under license for this study. Data are available to VA researchers, References Guy GP, Jr., Shults RA. Opioid Prescribing in the United States. Am J Nurs 2018;118(2):19–20. DOI: 10.1097/01.NAJ.0000530238.99144.e8 . Jannetto PJ. The North American Opioid Epidemic. Ther Drug Monit 2021;43(1):1–5. DOI: 10.1097/FTD.0000000000000817 . Keyes KM, Rutherford C, Hamilton A, et al. What is the prevalence of and trend in opioid use disorder in the United States from 2010 to 2019? Using multiplier approaches to estimate prevalence for an unknown population size. Drug Alcohol Depend Rep 2022;3. DOI: 10.1016/j.dadr.2022.100052 . Abuse NIoD. Drug Overdose Death Rates. June 30, 2023 ( https://nida.nih.gov/research-topics/trends-statistics/overdose-death-rates) . Rhee TG, Rosenheck RA. Comparison of opioid use disorder among male veterans and non-veterans: Disorder rates, socio-demographics, co-morbidities, and quality of life. Am J Addict 2019;28(2):92–100. DOI: 10.1111/ajad.12861 . Bennett AS, Guarino H, Britton PC, et al. U.S. Military veterans and the opioid overdose crisis: a review of risk factors and prevention efforts. Ann Med 2022;54(1):1826–1838. DOI: 10.1080/07853890.2022.2092896 . VA continues to reduce opioid prescribing throughout the pandemic. May 13, 2021 ( https://news.va.gov/88759/va-continues-to-reduce-opioid-prescribing-throughout-the-pandemic/#:~:text=VA%20has%20reduced%20 opioid%20prescribing,opioid%20prescribing%20overall%20by%2063%25.). Lagisetty P, Bohnert A, Goesling J, et al. Care Coordination for Patients on Chronic Opioid Therapy Following Surgery: A Cohort Study. Ann Surg 2020;272(2):304–310. DOI: 10.1097/SLA.0000000000003235 . Hinami K, Ray MJ, Doshi K, et al. Prescribing Associated with High-Risk Opioid Exposures Among Non-cancer Chronic Users of Opioid Analgesics: a Social Network Analysis. J Gen Intern Med 2019;34(11):2443–2450. DOI: 10.1007/s11606-019-05114-3 . Goulet J, Cheng Y, Becker W, et al. Opioid use and opioid use disorder in mono and dual-system users of veteran affairs medical centers. Front Public Health 2023;11:1148189. DOI: 10.3389/fpubh.2023.1148189 . Ching T, Himmelstein DS, Beaulieu-Jones BK, et al. Opportunities and obstacles for deep learning in biology and medicine. J R Soc Interface 2018;15(141). DOI: 10.1098/rsif.2017.0387 . Shao Y, Cheng Y, Shah RU, Weir CR, Bray BE, Zeng-Treitler Q. Shedding Light on the Black Box: Explaining Deep Neural Network Prediction of Clinical Outcomes. J Med Syst 2021;45(1):5. DOI: 10.1007/s10916-020-01701-8 . Shao Y, Ahmed A, Zamrini EY, Cheng Y, Goulet JL, Zeng-Treitler Q. Enhancing Clinical Data Analysis by Explaining Interaction Effects between Covariates in Deep Neural Network Models. J Pers Med 2023;13(2)(217). DOI: https://doi.org/10.3390/jpm13020217 . Palumbo SA, Adamson KM, Krishnamurthy S, et al. Assessment of Probable Opioid Use Disorder Using Electronic Health Record Documentation. JAMA Netw Open 2020;3(9):e2015909. DOI: 10.1001/jamanetworkopen.2020.15909 . Blackley SV, MacPhaul E, Martin B, Song W, Suzuki J, Zhou L. Using Natural Language Processing and Machine Learning to Identify Hospitalized Patients with Opioid Use Disorder. AMIA Annu Symp Proc 2020;2020:233–242. ( https://www.ncbi.nlm.nih.gov/pubmed/33936395 ). Carrell DS, Cronkite D, Palmer RE, et al. Using natural language processing to identify problem usage of prescription opioids. Int J Med Inform 2015;84(12):1057–64. DOI: 10.1016/j.ijmedinf.2015.09.002 . Afshar M, Sharma B, Bhalla S, et al. External validation of an opioid misuse machine learning classifier in hospitalized adult patients. Addict Sci Clin Pract 2021;16(1):19. DOI: 10.1186/s13722-021-00229-7 . Zhu VJ, Lenert LA, Barth KS, et al. Automatically identifying opioid use disorder in non-cancer patients on chronic opioid therapy. Health Informatics J 2022;28(2):14604582221107808. DOI: 10.1177/14604582221107808 . Sharma B, Dligach D, Swope K, et al. Publicly available machine learning models for identifying opioid misuse from the clinical notes of hospitalized patients. BMC Med Inform Decis Mak 2020;20(1):79. DOI: 10.1186/s12911-020-1099-y . Workman TE, Kupersmith J, Ma P, et al. A Comparison of Veterans with Problematic Opioid Use Identified through Natural Language Processing of Clinical Notes versus Using Diagnostic Codes. Healthcare (Basel) 2024;12(7). DOI: 10.3390/healthcare12070799 . VA Informatics and Computing Infrastructure (VINCI). ( https://www.research.va.gov/programs/vinci/ ). He KaZ, Xiangyu and Ren, Shaoqing and Sun, Jian. Deep Residual Learning for Image Recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)2016:770–778. Shao Y, Ahmed A, Liappis AP, Faselis C, Nelson SJ, Zeng-Treitler Q. Understanding Demographic Risk Factors for Adverse Outcomes in COVID-19 Patients: Explanation of a Deep Learning Model. J Healthc Inform Res 2021;5(2):181–200. DOI: 10.1007/s41666-021-00093-9 . Shao Y, Ahmed A, Zamrini EY, Cheng Y, Goulet JL, Zeng-Treitler Q. Enhancing Clinical Data Analysis by Explaining Interaction Effects between Covariates in Deep Neural Network Models. Journal of Personalized Medicine 2023;13(2):217. Webster LR. Risk Factors for Opioid-Use Disorder and Overdose. Anesth Analg 2017;125(5):1741–1748. DOI: 10.1213/ANE.0000000000002496 . Binger KJ, Ansara ED, Miles TM, Schulte SL. Relapse rates among veterans on maintenance doses of combination buprenorphine and naloxone for opioid use disorder. Ment Health Clin 2020;10(3):80–84. DOI: 10.9740/mhc.2020.05.080 . Hser YI, Evans E, Grella C, Ling W, Anglin D. Long-term course of opioid addiction. Harv Rev Psychiatry 2015;23(2):76–89. DOI: 10.1097/HRP.0000000000000052 . Strang J, Volkow ND, Degenhardt L, et al. Opioid use disorder. Nat Rev Dis Primers 2020;6(1):3. DOI: 10.1038/s41572-019-0137-5 . Additional Declarations No competing interests reported. Cite Share Download PDF Status: Published Journal Publication published 29 Jan, 2025 Read the published version in Scientific Reports → Version 1 posted Editorial decision: Revision requested 22 Aug, 2024 Reviews received at journal 21 Aug, 2024 Reviewers agreed at journal 17 Jul, 2024 Reviews received at journal 05 Jul, 2024 Reviewers agreed at journal 27 Jun, 2024 Reviewers invited by journal 27 Jun, 2024 Editor assigned by journal 27 Jun, 2024 Editor invited by journal 08 May, 2024 Submission checks completed at journal 05 May, 2024 First submitted to journal 29 Apr, 2024 You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-4344773","acceptedTermsAndConditions":true,"allowDirectSubmit":false,"archivedVersions":[],"articleType":"Article","associatedPublications":[],"authors":[{"id":300105344,"identity":"f7dc5c0f-fe30-4599-a502-9fc3a5fe73b7","order_by":0,"name":"Ying Yin","email":"","orcid":"","institution":"Washington DC VA Medical Center","correspondingAuthor":false,"prefix":"","firstName":"Ying","middleName":"","lastName":"Yin","suffix":""},{"id":300105345,"identity":"81e92ab2-a24b-4f8c-b437-ebda155a0b31","order_by":1,"name":"Elizabeth Workman","email":"","orcid":"","institution":"Washington DC VA Medical Center","correspondingAuthor":false,"prefix":"","firstName":"Elizabeth","middleName":"","lastName":"Workman","suffix":""},{"id":300105347,"identity":"325bfd95-a52a-4ad6-8186-352bb5e258d7","order_by":2,"name":"Phillip Ma","email":"","orcid":"","institution":"Washington DC VA Medical Center","correspondingAuthor":false,"prefix":"","firstName":"Phillip","middleName":"","lastName":"Ma","suffix":""},{"id":300105349,"identity":"cb1266e4-cbfb-4445-b877-cfd49cf424cc","order_by":3,"name":"Yan Cheng","email":"","orcid":"","institution":"Washington DC VA Medical Center","correspondingAuthor":false,"prefix":"","firstName":"Yan","middleName":"","lastName":"Cheng","suffix":""},{"id":300105351,"identity":"a2f06c1e-536d-4bd1-8371-08c19dfb0473","order_by":4,"name":"Yijun Shao","email":"","orcid":"","institution":"Washington DC VA Medical Center","correspondingAuthor":false,"prefix":"","firstName":"Yijun","middleName":"","lastName":"Shao","suffix":""},{"id":300105353,"identity":"cb8f7df9-bf20-413c-b729-8f403eecb83b","order_by":5,"name":"Joseph L. Goulet","email":"","orcid":"","institution":"VA Connecticut Healthcare System","correspondingAuthor":false,"prefix":"","firstName":"Joseph","middleName":"L.","lastName":"Goulet","suffix":""},{"id":300105354,"identity":"f3e5b13f-d568-461a-8a56-79b7d50f1dd7","order_by":6,"name":"Friedhelm Sandbrink","email":"","orcid":"","institution":"Washington DC VA Medical Center","correspondingAuthor":false,"prefix":"","firstName":"Friedhelm","middleName":"","lastName":"Sandbrink","suffix":""},{"id":300105355,"identity":"4019251f-d4ca-47da-b864-d9447258413b","order_by":7,"name":"Cynthia Brandt","email":"","orcid":"","institution":"VA Connecticut Healthcare System","correspondingAuthor":false,"prefix":"","firstName":"Cynthia","middleName":"","lastName":"Brandt","suffix":""},{"id":300105356,"identity":"c88e9167-92ca-45f5-aa5e-a4324d151de6","order_by":8,"name":"Christopher Spevak","email":"","orcid":"","institution":"Georgetown University School of Medicine","correspondingAuthor":false,"prefix":"","firstName":"Christopher","middleName":"","lastName":"Spevak","suffix":""},{"id":300105357,"identity":"5a36f526-0a60-4fd9-bb29-8ba119b7ec82","order_by":9,"name":"Jacob T. Kean","email":"","orcid":"","institution":"VA Salt Lake City Healthcare System","correspondingAuthor":false,"prefix":"","firstName":"Jacob","middleName":"T.","lastName":"Kean","suffix":""},{"id":300105358,"identity":"1f0a1a71-fb11-462c-ae50-b3b03023a60d","order_by":10,"name":"William Becker","email":"","orcid":"","institution":"VA Connecticut Healthcare System","correspondingAuthor":false,"prefix":"","firstName":"William","middleName":"","lastName":"Becker","suffix":""},{"id":300105359,"identity":"3b1afdfd-d62b-41be-b22d-a2a026adfbf7","order_by":11,"name":"Alexander Libin","email":"","orcid":"","institution":"Georgetown University School of Medicine","correspondingAuthor":false,"prefix":"","firstName":"Alexander","middleName":"","lastName":"Libin","suffix":""},{"id":300105360,"identity":"d4bdda28-068d-446a-b622-aa06beb58af6","order_by":12,"name":"Nawar Shara","email":"","orcid":"","institution":"Georgetown University School of Medicine","correspondingAuthor":false,"prefix":"","firstName":"Nawar","middleName":"","lastName":"Shara","suffix":""},{"id":300105361,"identity":"a1f69eb0-27cc-4ac6-b23b-a9d0b02d7c20","order_by":13,"name":"Helen M Sheriff","email":"","orcid":"","institution":"Washington DC VA Medical Center","correspondingAuthor":false,"prefix":"","firstName":"Helen","middleName":"M","lastName":"Sheriff","suffix":""},{"id":300105362,"identity":"24002bfb-b2f5-425b-a379-15b0ebb5d4a1","order_by":14,"name":"Jorie Butler","email":"","orcid":"","institution":"The University of Utah","correspondingAuthor":false,"prefix":"","firstName":"Jorie","middleName":"","lastName":"Butler","suffix":""},{"id":300105363,"identity":"716a7ea2-9036-4a06-bbf2-165ee6dfc6e3","order_by":15,"name":"Rajeev M Agrawal","email":"","orcid":"","institution":"MedStar Health","correspondingAuthor":false,"prefix":"","firstName":"Rajeev","middleName":"M","lastName":"Agrawal","suffix":""},{"id":300105365,"identity":"3560d97e-bf86-4ff9-9bbd-0111810978a6","order_by":16,"name":"Joel Kupersmith","email":"","orcid":"","institution":"Georgetown University School of Medicine","correspondingAuthor":false,"prefix":"","firstName":"Joel","middleName":"","lastName":"Kupersmith","suffix":""},{"id":300105368,"identity":"e7b167ed-551e-4bef-a8f8-fe27ac5b15b5","order_by":17,"name":"Qing Zeng-Trietler","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAA1UlEQVRIiWNgGAWjYBACfmYgwfgHSLA3EKlFshlE8oDwASK1GByAaZFIIFbLcd7DLxgkbPLkI98YfmD4ZZNI0H0Gh/nSLBgM0ooNb+cYSzD2pRGjhcfMgCHhcOLG2WkJEow9h40JOswMrOXA/8SNM48l/yBKi/FhHuMHjA0HEudLMB+TYPhxWI6gFslmHjOGxIbkxA08yccsEhvSCGvh9z9j/OHjH7vE+e0Hm298+GPDQ1ALELCBYwQcQYltxGhgYGD+ACLlG0DkH+K0jIJRMApGwcgCAH0gPjvSHko3AAAAAElFTkSuQmCC","orcid":"","institution":"Washington DC VA Medical Center","correspondingAuthor":true,"prefix":"","firstName":"Qing","middleName":"","lastName":"Zeng-Trietler","suffix":""}],"badges":[],"createdAt":"2024-04-29 18:52:13","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-4344773/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-4344773/v1","draftVersion":[],"editorialEvents":[{"content":"https://doi.org/10.1038/s41598-024-77602-4","type":"published","date":"2025-01-29T15:57:39+00:00"}],"editorialNote":"","failedWorkflow":false,"files":[{"id":56399028,"identity":"8feeb393-b2da-4be8-ad37-f1a3e47f3e2f","added_by":"auto","created_at":"2024-05-13 15:59:43","extension":"jpg","order_by":1,"title":"Figure 1","display":"","copyAsset":false,"role":"figure","size":27071,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cstrong\u003eDNN Architect\u003c/strong\u003e\u003c/p\u003e","description":"","filename":"1.jpg","url":"https://assets-eu.researchsquare.com/files/rs-4344773/v1/c7fedecc514260b5326527a9.jpg"},{"id":56399030,"identity":"5b9b8750-8358-4811-8329-0f131c2113e1","added_by":"auto","created_at":"2024-05-13 15:59:44","extension":"png","order_by":2,"title":"Figure 2","display":"","copyAsset":false,"role":"figure","size":1115275,"visible":true,"origin":"","legend":"\u003cp\u003eImpact Scores and 95% Confidence Intervals of Predictors on OUD Outcomes.\u003c/p\u003e\n\u003cp\u003eHTN = Hypertension; OUD = Opioid Use Disorder; PTSD = Post Traumatic Stress Disorder; TBI = Traumatic Brain Injury\u003c/p\u003e","description":"","filename":"2.png","url":"https://assets-eu.researchsquare.com/files/rs-4344773/v1/6f4c7dcb183c616e6fcef4e2.png"},{"id":56399029,"identity":"53e51d2b-0bff-4fd9-b781-d0101888c829","added_by":"auto","created_at":"2024-05-13 15:59:44","extension":"jpg","order_by":3,"title":"Figure 3","display":"","copyAsset":false,"role":"figure","size":57301,"visible":true,"origin":"","legend":"\u003cp\u003eInteraction Scores and 95% Confidence Intervals for Feature Interactions with Dual-System User on OUD Outcomes. HTN = Hypertension; OUD = Opioid Use Disorder; PTSD = Post Traumatic Stress Disorder; TBI = Traumatic Brain Injury\u003c/p\u003e","description":"","filename":"3.jpg","url":"https://assets-eu.researchsquare.com/files/rs-4344773/v1/92b3347f8eb1ea53f3e7b5c0.jpg"},{"id":75351933,"identity":"1d8e193b-9b06-4e9f-b300-8f8d9f44f954","added_by":"auto","created_at":"2025-02-03 16:12:48","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":1861413,"visible":true,"origin":"","legend":"","description":"","filename":"manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-4344773/v1/ab5b8c2f-1dc7-473e-a3ef-aa3173fb8911.pdf"}],"financialInterests":"No competing interests reported.","formattedTitle":"Dual Healthcare System Users and Risk of Opioid Use Disorder: A Deep Learning analysis","fulltext":[{"header":"Introduction","content":"\u003cp\u003eMillions of Americans who suffer from chronic and acute pain are prescribed opioid. Prescription misuse and opioid use disorder (OUD), however, have been a grave concern across the U.S. during the past two decades. Between 1999 and 2010, there was a sharp increase in opioid prescribing in the U.S., which has led to a dramatic increase in prescription opioid-related overdose death.\u003csup\u003e\u003cspan citationid=\"CR1\" class=\"CitationRef\"\u003e1\u003c/span\u003e\u003c/sup\u003e Since 2012, tighter regulation has resulted in a steady decline in opioid prescription in most healthcare settings.\u003csup\u003e\u003cspan citationid=\"CR2\" class=\"CitationRef\"\u003e2\u003c/span\u003e\u003c/sup\u003e OUD, however, did not decline at the same rate.\u003csup\u003e\u003cspan citationid=\"CR3\" class=\"CitationRef\"\u003e3\u003c/span\u003e\u003c/sup\u003e Furthermore, opioid-related deaths continue to increase. In 2021 alone, more than 106,000 individuals in the U.S. died from drug-involved overdose with 14,900 extra cases from the year prior.\u003csup\u003e\u003cspan citationid=\"CR4\" class=\"CitationRef\"\u003e4\u003c/span\u003e\u003c/sup\u003e\u003c/p\u003e \u003cp\u003eSimilarly, the opioid epidemic has greatly impacted active-military personnel and veterans, reflected by the rising rates of opioid addiction and overdose deaths till 2012.\u003csup\u003e\u003cspan citationid=\"CR5\" class=\"CitationRef\"\u003e5\u003c/span\u003e,\u003cspan citationid=\"CR6\" class=\"CitationRef\"\u003e6\u003c/span\u003e\u003c/sup\u003e In response, the VA has dramatically reduced opioid prescriptions, with only 7.9% of patients receiving these medications in 2021 compared to 22% in 2013.\u003csup\u003e\u003cspan citationid=\"CR7\" class=\"CitationRef\"\u003e7\u003c/span\u003e\u003c/sup\u003e\u003c/p\u003e \u003cp\u003eWhile significant efforts have been made and progress has been reported in promoting safe opioid use and decreasing opioid-related mortality, a challenge has been the care coordination when patients have access to multiple healthcare systems, or multiple sources of opioid prescriptions. Studies has shown that such fragmented care can leave patients at a higher risk of opioid use and misuse, which may be due to lack of information sharing between healthcare systems.\u003csup\u003e\u003cspan citationid=\"CR8\" class=\"CitationRef\"\u003e8\u003c/span\u003e,\u003cspan citationid=\"CR9\" class=\"CitationRef\"\u003e9\u003c/span\u003e\u003c/sup\u003e This challenge is important for the US Veterans Administration (VA), as many VA enrollees also receive outside care via Veterans Choice Program (VCP)/Veterans Community Care Program (VCCP), which are paid for by the VA. The dual-system care adds another layer of responsibility for VA to understand its impact on opioid use. Our own study confirmed that VA patients who use both VA and community care (dual-system users) are more likely to have opioid initiation, continued opioid prescriptions, and diagnoses of OUD than those who only use VA care.\u003csup\u003e\u003cspan citationid=\"CR10\" class=\"CitationRef\"\u003e10\u003c/span\u003e\u003c/sup\u003e While dual-system users face a heightened OUD risk, little is known about how individual patient factors affect this vulnerability.\u003c/p\u003e \u003cp\u003eTraditionally, differential effects are analyzed using statistical interaction or regression mixture models. The rise of artificial intelligence (AI), especially deep neural network (DNN) models, provided us with a new approach. Literature has shown that when trained on large datasets, DNNs are particularly capable of modeling complex, non-linear relationships without making assumptions of the variable independence or distribution.\u003csup\u003e\u003cspan citationid=\"CR11\" class=\"CitationRef\"\u003e11\u003c/span\u003e\u003c/sup\u003e However, since DNN models often have a large number of parameters, they are difficult to interpret and are thus sometimes called black box models. To tackle this problem, our research team has developed and validated an explainable AI method,\u003csup\u003e\u003cspan citationid=\"CR12\" class=\"CitationRef\"\u003e12\u003c/span\u003e,\u003cspan citationid=\"CR13\" class=\"CitationRef\"\u003e13\u003c/span\u003e\u003c/sup\u003e allowing the assessment of an individual feature\u0026rsquo;s contribution, as well as the interactions between features that are captured by DNN models.\u003c/p\u003e \u003cp\u003eOne challenge we face in analyzing OUD using medical record data is that it has been widely reported OUD is often under coded.\u003csup\u003e\u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e\u003c/sup\u003e A number of studies, including one from our team, have developed natural language processing (NLP) methods to identify OUD from clinical notes.\u003csup\u003e\u003cspan additionalcitationids=\"CR16 CR17 CR18 CR19\" citationid=\"CR15\" class=\"CitationRef\"\u003e15\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR20\" class=\"CitationRef\"\u003e20\u003c/span\u003e\u003c/sup\u003e NLP systems generally consist of either hard-coded rules, or trained machine learning models, or both.\u003csup\u003e\u003cspan citationid=\"CR15\" class=\"CitationRef\"\u003e15\u003c/span\u003e\u003c/sup\u003e The development of NLP tools allows us to capture a fuller extent of the OUD problem.\u003c/p\u003e \u003cp\u003eIn this study, we assembled a cohort of veterans from the Washington DC and Baltimore Veteran Affairs (VA) Medical Centers with mono- or dual- system enrollment and evaluated the association of dual-system use status and OUD using a DNN model. OUD was determined through ICD codes or NLP classification of clinical notes. Additionally, we leveraged a novel explainable AI approach to assess the impact of dual-system use on the outcome of OUD and how patient demographic and clinic characteristics interact with dual-system use status to influence the outcome.\u003c/p\u003e"},{"header":"Methods","content":"\u003cdiv id=\"Sec3\" class=\"Section2\"\u003e \u003ch2\u003eStudy Population\u003c/h2\u003e \u003cp\u003e Our study cohort consists of 222,370 distinct patients who received outpatient care between 2012 and 2019. We required that each patient must have at least two encounters from two consecutive calendar years in the Washington DC or Baltimore VA Medical Center. (VA IRBnet protocol #1607134) Since dual-system user status changes over time, each year is treated as a separate cohort. Patients with multiple and inconsistent dates of birth, gender, race, or ethnicity were excluded. We used January 1st of each cohort year as the index date for retrieving comorbid conditions and outcomes. All data were derived from electronic health records (EHR) from the VA Corporate Data Warehouse (CDW). Research was performed within the secure VA Informatics and Computing Infrastructure (VINCI) platform.\u003csup\u003e\u003cspan citationid=\"CR21\" class=\"CitationRef\"\u003e21\u003c/span\u003e\u003c/sup\u003e\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec4\" class=\"Section2\"\u003e \u003ch2\u003eNLP Application\u003c/h2\u003e \u003cp\u003eTo identify patients with problematic opioid use-related concerns (e.g., current abuse, overuse, or addiction) documented in their clinical notes, we developed an NLP classifier that uses both rule-based and machine learning methods.\u003csup\u003e\u003cspan citationid=\"CR20\" class=\"CitationRef\"\u003e20\u003c/span\u003e\u003c/sup\u003e After reviewing sample notes, two project members identified 36 key phrases relevant to problematic opioid use concern documentation. Using snippets (a span of clinical note text containing one of the key phrases), the team developed a support vector machine (SVM) model to identify notes documenting problematic opioid use concerns. Also using snippets, the team built a library of regular expressions matching relevant template data (e.g., \u0026ldquo;[x] substance abuse and/or dependence\u0026rdquo;) and relevant standard clinical text (e.g., \u0026ldquo;current opioid dependence\u0026rdquo;). Leveraging both the SVM and regular expressions, the NLP classifier achieved 96.6% specificity, 90.4% precision/PPV, 88.4% sensitivity/recall, and 94.4% accuracy on an unseen (i.e. not used in classifier development) snippet dataset.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec5\" class=\"Section2\"\u003e \u003ch2\u003ePredictors\u003c/h2\u003e \u003cp\u003eCovariates including dual-system user status, demographic, and clinical variables were derived from the VA Corporate Data Warehouse (CDW) before the index date. We defined dual healthcare system users as those with VCP/VCCP encounters in the calendar year by use of a VA stop code designated for the community care program, or VCP/VCCP note. Patients without any VCP/VCCP encounter in a calendar year were defined as \u0026ldquo;mono\u0026rdquo; users. The clinical variables like comorbid diagnoses were defined using the criteria established by the VA MSD cohort\u003csup\u003e\u003cspan citationid=\"CR10\" class=\"CitationRef\"\u003e10\u003c/span\u003e\u003c/sup\u003e and derived from the relevant ICD 9/10 codes. Other drug disorders include cannabis-related disorders, nicotine dependence, cocaine-related disorders, and others (ICD-9: 304.1-304.6,304.8-304.9, 305.2-305.4, 305.6-305.9; ICD-10: F12-F19). Age was measured as a continuous variable and the other covariates were measured as categorical variables.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec6\" class=\"Section2\"\u003e \u003ch2\u003eStudy outcomes\u003c/h2\u003e \u003cp\u003eThe study outcome is OUD within each calendar year. OUD was defined in two ways: using the ICD 9/10 codes of 304.0, 304.7, 305.5, and F11; and the OUD-related issues documented in clinical notes that are extracted by the NLP tool described above.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec7\" class=\"Section2\"\u003e \u003ch2\u003eDNN modeling\u003c/h2\u003e \u003cp\u003eThe deep neural network (DNN) model is assembled with a variation of the residual network (ResNet) model,\u003csup\u003e\u003cspan citationid=\"CR22\" class=\"CitationRef\"\u003e22\u003c/span\u003e\u003c/sup\u003e as shown in Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e. The input variables undergo a linear transformation, followed by two residual blocks. Each residual block consists of two feed-forward layers with layer normalization and ReLU activation, and a skip connection to add the residual from the previous layer. The benefit of the ResNet model is that it is more stable and efficient for training. The final layer is activated with the sigmoid function σ, so that the output value is always between 0 and 1.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003eThe dataset was split into training, validation, and testing sets in a ratio of 64%, 16%, and 20%, respectively. Due to the rarity of the observed outcome, an imbalance between positive and negative instances existed in the dataset. To address this, a down-sampling approach was implemented on the majority class for the training set. Specifically, a randomly selected subset of the controls was selected with 1:1 ratio to the case for training. The validation set and test set remained unchanged representing the original population.\u003c/p\u003e \u003cp\u003eThe binary cross-entropy function was used as the loss function, and the area under the ROC curve (AUC) was used as the main metric for measuring the model performance. Stochastic gradient descent was used for optimization. A dropout rate of 0.25 was used for regularization and an early stopping mechanism (i.e. stop the training once the model's AUC on the validation set stops improving) was also adopted to prevent overfitting.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec8\" class=\"Section2\"\u003e \u003ch2\u003eImpact and Impact Scores\u003c/h2\u003e \u003cp\u003eBecause DNN models are often considered black boxes, our team developed a scoring method to measure the impact of features on model output.\u003csup\u003e\u003cspan citationid=\"CR12\" class=\"CitationRef\"\u003e12\u003c/span\u003e,\u003cspan citationid=\"CR23\" class=\"CitationRef\"\u003e23\u003c/span\u003e\u003c/sup\u003e The output score, defined as the impact score, is similar to the coefficient of a logistic regression model, which measures the association between changes in the predictor value and changes in the output. For binary variables, the score measures the difference between the output when the feature is absent and the output when the feature is present. For continuous variables, the score measures the impact of a one-unit increase in the variable value.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec9\" class=\"Section2\"\u003e \u003ch2\u003eInteraction and interaction score:\u003c/h2\u003e \u003cp\u003eSimilarly, we designed the interaction score to measure the interaction between two variables.\u003csup\u003e\u003cspan citationid=\"CR24\" class=\"CitationRef\"\u003e24\u003c/span\u003e\u003c/sup\u003e Conceptually, we define the interaction between two variables as the residual impact of changes in both variables simultaneously subtracting the impact of each individual variable.\u003c/p\u003e \u003cdiv id=\"Sec10\" class=\"Section3\"\u003e \u003ch2\u003eConfidence interval and bootstrapping:\u003c/h2\u003e \u003cp\u003eTo estimate the confidence intervals of the impact scores and interaction scores of our model, we employed the nonparametric percentile bootstrap method. In this approach, we resampled the original data with replacement 200 times, trained the model, and independently calculated the impact scores and interaction scores. The 95% confidence interval was determined as the range between the 2.5th and 97.5th percentiles of the calculated scores for each feature.\u003c/p\u003e \u003c/div\u003e \u003c/div\u003e"},{"header":"Results","content":"\u003cp\u003eAs we evaluated the patient's baseline characteristics and OUD outcomes over the year, we treated the same patients in different years as separate instances in our analysis. Thus, we had a total of 856,299 patient instances from 2012 to 2019. Of these, 17% had an OUD outcome identified either by ICD code or NLP classification. The differences in demographics and selected clinical characteristics are shown in the Table\u0026nbsp;\u003cspan refid=\"Tab1\" class=\"InternalRef\"\u003e1\u003c/span\u003e. In summary, patients with OUD tend to be younger, more likely to be Black and single, and more likely to have dual-system use, prior opioid use, and other substance use disorders. Using these predictors for OUD outcomes in our DNN model, our model achieved a 78% AUC during training, validation, and testing (Table\u0026nbsp;\u003cspan refid=\"Tab2\" class=\"InternalRef\"\u003e2\u003c/span\u003e).\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab1\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 1\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eDemographics of Groups with and without OUD Based on NLP or ICD Codes.\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"4\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c4\" colnum=\"4\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e\u0026nbsp;\u003c/th\u003e \u003cth align=\"left\" colspan=\"2\" nameend=\"c3\" namest=\"c2\"\u003e \u003cp\u003eOpioid Abuse Disorder\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e\u0026nbsp;\u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eNo\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003eYes\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eN\u0026thinsp;=\u0026thinsp;709,611\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003eN\u0026thinsp;=\u0026thinsp;146,688\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003eASD (%)\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eAge\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e61.9\u0026thinsp;\u0026plusmn;\u0026thinsp;17.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e56.8\u0026thinsp;\u0026plusmn;\u0026thinsp;14.2\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e32\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eDual-system user\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e54489 (8%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e22982 (16%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e25\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eFemale\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e99325 (14%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e22916 (16%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e5\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eRace\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eNon-Hispanic White\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e324987 (46%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e46937 (32%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e29\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eHispanic\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e16700 (2%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e3146 (2%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e1\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eNon-Hispanic Black\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e278841 (39%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e87740 (60%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e42\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eNon-Hispanic Other\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e30933 (4%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e5371 (4%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e4\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eUnknown\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e58150 (8%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e3494 (2%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e26\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eMarital Status\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eSingle\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e117994 (17%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e35993 (25%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e20\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eDivorced\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e142313 (20%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e41879 (29%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e20\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eMarried\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e347810 (49%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e48335 (33%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e33\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eSeparated\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e29482 (4%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e12010 (8%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e17\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eUnknown\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e22690 (3%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e910 (1%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e19\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eWidowed\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e49322 (7%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e7561 (5%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e8\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ePrior opioid prescription\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e336428 (47%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e99550 (68%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e42\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eComorbidity\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eAlcohol use disorder\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e95641 (13%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e62532 (43%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e69\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eAnxiety\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e150629 (21%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e58060 (40%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e41\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eBack Pain\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e318722 (45%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e87035 (59%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e29\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eCancer\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e122294 (17%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e19947 (14%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e10\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eDiabetes\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e212854 (30%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e86098 (59%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e3\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eDepression\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e203234 (29%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e43941 (30%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e60\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eHypertension\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e435223 (61%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e92422 (63%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e3\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eNeck Pain\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e200018 (28%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e61288 (42%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e29\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eOther drug disorder\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e59672 (8%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e59825 (41%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e81\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ePTSD\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e121873 (17%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e52920 (36%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e44\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eTBI\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e38192 (5%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e15269 (10%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e19\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eTobacco use disorder\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e159410 (22%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e69949 (48%)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e55\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colspan=\"4\" nameend=\"c4\" namest=\"c1\"\u003e \u003cp\u003ePTSD\u0026thinsp;=\u0026thinsp;Post-Traumatic Stress Disorder, TBI\u0026thinsp;=\u0026thinsp;Traumatic Brain Injury\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab2\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 2\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eDNN performances on training, validation and test datasets.\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"6\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c4\" colnum=\"4\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c5\" colnum=\"5\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c6\" colnum=\"6\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e\u0026nbsp;\u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eF1\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003eAccuracy\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e \u003cp\u003ePrecision\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c5\"\u003e \u003cp\u003eRecall\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c6\"\u003e \u003cp\u003eAUC\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eTraining\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e0.699\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e0.708\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e0.72\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e \u003cp\u003e0.679\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003e0.783\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eValidation\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e0.461\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e0.727\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e0.349\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e \u003cp\u003e0.681\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003e0.783\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eTest\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e0.462\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e0.728\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e0.35\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e \u003cp\u003e0.68\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003e0.784\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003ctfoot\u003e \u003ctr\u003e\u003ctd colspan=\"6\"\u003eHTN\u0026thinsp;=\u0026thinsp;Hypertension; OUD\u0026thinsp;=\u0026thinsp;Opioid Use Disorder; PTSD\u0026thinsp;=\u0026thinsp;Post Traumatic Stress Disorder; TBI\u0026thinsp;=\u0026thinsp;Traumatic Brain Injury\u003c/td\u003e\u003c/tr\u003e \u003c/tfoot\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003eA positive impact score indicates an association with increased risks of OUD, and a negative impact score indicates an association with decreased risks of OUD. It is clear that previous abuse of other drugs is the most significant risk factor. use is also one of the top risk factors (Fig.\u0026nbsp;2).\u003c/p\u003e \u003cp\u003eA positive interaction score indicates a higher risk than the additive impacts of the two predictors, and a negative interaction score indicates a lower risk. Figure\u0026nbsp;\u003cspan refid=\"Fig2\" class=\"InternalRef\"\u003e3\u003c/span\u003e shows that age has a positive interaction with dual-system use. In contrast, races such as Non-Hispanic Black or Non-Hispanic Other, as well as a history of other drug disorders and prior PTSD diagnosis, interact negatively with it.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e"},{"header":"Discussion","content":"\u003cp\u003eThe explainable AI analyses confirmed that dual-system use is associated with OUD in our cohort. The interaction analysis of OUD with other covariates revealed that the combined impact of dual-system use with a number of conditions (e.g., PTSD, abuse of other drugs) is less than their additive impacts. Conversely, older patients who are dual system users are at a higher risk for OUD.\u003c/p\u003e \u003cp\u003eInterestingly, the predictors with a negative interaction score regarding dual user status tend to be those associated with a positive impact score. Inversely, predictors with a positive interaction score concerning dual-system use are often associated with a negative impact score. This could suggest that dual system use has a more significant impact on those not already at high risk.\u003c/p\u003e \u003cp\u003eThis and other previous studies have identified dual system use as a risk factor.\u003csup\u003e\u003cspan citationid=\"CR10\" class=\"CitationRef\"\u003e10\u003c/span\u003e\u003c/sup\u003e Known risk factors such as prior drug abuse has also been confirmed.\u003csup\u003e\u003cspan citationid=\"CR25\" class=\"CitationRef\"\u003e25\u003c/span\u003e\u003c/sup\u003e A novel finding of this study is that patients without well-known risk factors, such as other drug abuse, may be more affected by dual user status.\u003c/p\u003e \u003cp\u003eIn this study the dual use status was limited to VA-paid community care, while Veterans may seek care outside of the VA independently, which may be considered a limitation. Another limitation is the imperfect nature of OUD identification by NLP, which does not equate to an OUD diagnosis. Nevertheless, our NLP classifier achieved over 94.4% accuracy, as confirmed by medical expert annotation. Within our cohort, 16,852 patient instances had an ICD-based OUD diagnosis, of which 88% were corroborated by NLP. At the same time, the NLP identified almost eight times more patients with OUD conditions. Given the under-coding reality of OUD in EHR,\u003csup\u003e\u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e\u003c/sup\u003e the NLP program provides additional insights into OUD prevalence among Veterans. Our analysis confirmed that dual-system users are more likely to have OUD identified by both ICD and NLP.\u003c/p\u003e \u003cp\u003eFor our cohort assembly, we did not exclude patients with existing OUD. In general, patients with a prior OUD diagnosis will be more likely to receive OUD diagnoses in subsequent years.\u003csup\u003e\u003cspan citationid=\"CR26\" class=\"CitationRef\"\u003e26\u003c/span\u003e,\u003cspan citationid=\"CR27\" class=\"CitationRef\"\u003e27\u003c/span\u003e\u003c/sup\u003e In our cohort, 65% of the patients had additional OUD diagnoses after their first OUD diagnoses. Even though relapse is common, many patients eventually recover from OUD.\u003csup\u003e\u003cspan citationid=\"CR28\" class=\"CitationRef\"\u003e28\u003c/span\u003e\u003c/sup\u003e We thus did not limit the outcome to first OUD diagnosis.\u003c/p\u003e \u003cp\u003eA future direction we plan to explore is analyzing the underlying causes of interactions that increase OUD risks. In addition, social and community factors play important roles in the prevention of OUD. We hope to include those factors in future analyses.\u003c/p\u003e"},{"header":"Conclusion","content":"\u003cp\u003eIn conclusion, out analysis underscores the heightened risk of OUD among dual-system users, a finding that echoes that patterns identified in prior research. Notably, our study brings to light that the risk associated with dual-system use is not uniformly distributed across all patient demographics. Specifically, the risk is more pronounced in patients who are not traditionally identified as high-risk such as prior substance disorder. This revelation suggests a nuanced approach to public health interventions, advocating for a focus on seemingly lower-risk population like older patients, who may be more susceptible to the adverse effects of dual-system use.\u003c/p\u003e"},{"header":"Declarations","content":"\u003cp\u003e \u003ch2\u003eConflict of interest statement\u003c/h2\u003e \u003cp\u003eWe declare that this study was conducted in the absence of any commercial or financial relationships that could be construed as potential conflicts of interest.\u003c/p\u003e \u003c/p\u003e\u003cp\u003e \u003ch2\u003eEthics Statement\u003c/h2\u003e \u003cp\u003e This study was approved by the Institution Review Boards for the Washington DC VA\u003c/p\u003e \u003cp\u003eMedical Center and West Haven VA.\u003c/p\u003e \u003c/p\u003e\u003ch2\u003eAuthor Contribution\u003c/h2\u003e\u003cp\u003eQZ-T and JK obtained the funding for the project; QZ-T designed and supervised the experiments; YY performed analyses; TW performed the NLP classification; PM and YC participated in the data analyses; YS provides methodology guidance; WB, FS, and CS provided guidance as clinical experts in pain management and opioid use; JG and CB provided guidance on cohort creation; HMS facilitated data curation from the EHR; JTK, JB, RMA, NS, and AB participated in the results interpretation; All authors contributed to the article and approved the submitted version.\u003c/p\u003e\u003ch2\u003eAcknowledgements\u003c/h2\u003e \u003cp\u003eThis work is supported by VA grant 1I01HX003100-01A2 \u0026ldquo;Assessing and Reducing Opioid Misuse Among Veterans in VA and Non-VA Systems: Coordination of Fragmented Care.\u0026rdquo;\u003c/p\u003e\u003ch2\u003eData Availability\u003c/h2\u003e\u003cp\u003eThe data that support the findings of this study are derived from the Veterans Health Administration\u0026rsquo;s Clinical Data Warehouse. Restrictions apply to the availability of these data, which were used under license for this study. Data are available to VA researchers,\u003c/p\u003e"},{"header":"References","content":"\u003col\u003e\u003cli\u003e\u003cspan\u003eGuy GP, Jr., Shults RA. Opioid Prescribing in the United States. Am J Nurs 2018;118(2):19\u0026ndash;20. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1097/01.NAJ.0000530238.99144.e8\u003c/span\u003e\u003cspan address=\"10.1097/01.NAJ.0000530238.99144.e8\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eJannetto PJ. The North American Opioid Epidemic. Ther Drug Monit 2021;43(1):1\u0026ndash;5. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1097/FTD.0000000000000817\u003c/span\u003e\u003cspan address=\"10.1097/FTD.0000000000000817\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eKeyes KM, Rutherford C, Hamilton A, et al. What is the prevalence of and trend in opioid use disorder in the United States from 2010 to 2019? Using multiplier approaches to estimate prevalence for an unknown population size. Drug Alcohol Depend Rep 2022;3. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1016/j.dadr.2022.100052\u003c/span\u003e\u003cspan address=\"10.1016/j.dadr.2022.100052\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAbuse NIoD. Drug Overdose Death Rates. June 30, 2023 (\u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://nida.nih.gov/research-topics/trends-statistics/overdose-death-rates)\u003c/span\u003e\u003cspan address=\"https://nida.nih.gov/research-topics/trends-statistics/overdose-death-rates)\" targettype=\"URL\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eRhee TG, Rosenheck RA. Comparison of opioid use disorder among male veterans and non-veterans: Disorder rates, socio-demographics, co-morbidities, and quality of life. Am J Addict 2019;28(2):92\u0026ndash;100. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1111/ajad.12861\u003c/span\u003e\u003cspan address=\"10.1111/ajad.12861\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eBennett AS, Guarino H, Britton PC, et al. U.S. Military veterans and the opioid overdose crisis: a review of risk factors and prevention efforts. Ann Med 2022;54(1):1826\u0026ndash;1838. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1080/07853890.2022.2092896\u003c/span\u003e\u003cspan address=\"10.1080/07853890.2022.2092896\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eVA continues to reduce opioid prescribing throughout the pandemic. May 13, 2021 (\u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://news.va.gov/88759/va-continues-to-reduce-opioid-prescribing-throughout-the-pandemic/#:~:text=VA%20has%20reduced%20\u003c/span\u003e\u003cspan address=\"https://news.va.gov/88759/va-continues-to-reduce-opioid-prescribing-throughout-the-pandemic/#:~:text=VA%20has%20reduced%20\" targettype=\"URL\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003eopioid%20prescribing,opioid%20prescribing%20overall%20by%2063%25.).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eLagisetty P, Bohnert A, Goesling J, et al. Care Coordination for Patients on Chronic Opioid Therapy Following Surgery: A Cohort Study. Ann Surg 2020;272(2):304\u0026ndash;310. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1097/SLA.0000000000003235\u003c/span\u003e\u003cspan address=\"10.1097/SLA.0000000000003235\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHinami K, Ray MJ, Doshi K, et al. Prescribing Associated with High-Risk Opioid Exposures Among Non-cancer Chronic Users of Opioid Analgesics: a Social Network Analysis. J Gen Intern Med 2019;34(11):2443\u0026ndash;2450. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1007/s11606-019-05114-3\u003c/span\u003e\u003cspan address=\"10.1007/s11606-019-05114-3\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eGoulet J, Cheng Y, Becker W, et al. Opioid use and opioid use disorder in mono and dual-system users of veteran affairs medical centers. Front Public Health 2023;11:1148189. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.3389/fpubh.2023.1148189\u003c/span\u003e\u003cspan address=\"10.3389/fpubh.2023.1148189\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eChing T, Himmelstein DS, Beaulieu-Jones BK, et al. Opportunities and obstacles for deep learning in biology and medicine. J R Soc Interface 2018;15(141). DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1098/rsif.2017.0387\u003c/span\u003e\u003cspan address=\"10.1098/rsif.2017.0387\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eShao Y, Cheng Y, Shah RU, Weir CR, Bray BE, Zeng-Treitler Q. Shedding Light on the Black Box: Explaining Deep Neural Network Prediction of Clinical Outcomes. J Med Syst 2021;45(1):5. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1007/s10916-020-01701-8\u003c/span\u003e\u003cspan address=\"10.1007/s10916-020-01701-8\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eShao Y, Ahmed A, Zamrini EY, Cheng Y, Goulet JL, Zeng-Treitler Q. Enhancing Clinical Data Analysis by Explaining Interaction Effects between Covariates in Deep Neural Network Models. J Pers Med 2023;13(2)(217). DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://doi.org/10.3390/jpm13020217\u003c/span\u003e\u003cspan address=\"10.3390/jpm13020217\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003ePalumbo SA, Adamson KM, Krishnamurthy S, et al. Assessment of Probable Opioid Use Disorder Using Electronic Health Record Documentation. JAMA Netw Open 2020;3(9):e2015909. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1001/jamanetworkopen.2020.15909\u003c/span\u003e\u003cspan address=\"10.1001/jamanetworkopen.2020.15909\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eBlackley SV, MacPhaul E, Martin B, Song W, Suzuki J, Zhou L. Using Natural Language Processing and Machine Learning to Identify Hospitalized Patients with Opioid Use Disorder. AMIA Annu Symp Proc 2020;2020:233\u0026ndash;242. (\u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://www.ncbi.nlm.nih.gov/pubmed/33936395\u003c/span\u003e\u003cspan address=\"https://www.ncbi.nlm.nih.gov/pubmed/33936395\" targettype=\"URL\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eCarrell DS, Cronkite D, Palmer RE, et al. Using natural language processing to identify problem usage of prescription opioids. Int J Med Inform 2015;84(12):1057\u0026ndash;64. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1016/j.ijmedinf.2015.09.002\u003c/span\u003e\u003cspan address=\"10.1016/j.ijmedinf.2015.09.002\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAfshar M, Sharma B, Bhalla S, et al. External validation of an opioid misuse machine learning classifier in hospitalized adult patients. Addict Sci Clin Pract 2021;16(1):19. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1186/s13722-021-00229-7\u003c/span\u003e\u003cspan address=\"10.1186/s13722-021-00229-7\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eZhu VJ, Lenert LA, Barth KS, et al. Automatically identifying opioid use disorder in non-cancer patients on chronic opioid therapy. Health Informatics J 2022;28(2):14604582221107808. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1177/14604582221107808\u003c/span\u003e\u003cspan address=\"10.1177/14604582221107808\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eSharma B, Dligach D, Swope K, et al. Publicly available machine learning models for identifying opioid misuse from the clinical notes of hospitalized patients. BMC Med Inform Decis Mak 2020;20(1):79. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1186/s12911-020-1099-y\u003c/span\u003e\u003cspan address=\"10.1186/s12911-020-1099-y\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eWorkman TE, Kupersmith J, Ma P, et al. A Comparison of Veterans with Problematic Opioid Use Identified through Natural Language Processing of Clinical Notes versus Using Diagnostic Codes. Healthcare (Basel) 2024;12(7). DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.3390/healthcare12070799\u003c/span\u003e\u003cspan address=\"10.3390/healthcare12070799\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eVA Informatics and Computing Infrastructure (VINCI). (\u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://www.research.va.gov/programs/vinci/\u003c/span\u003e\u003cspan address=\"https://www.research.va.gov/programs/vinci/\" targettype=\"URL\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHe KaZ, Xiangyu and Ren, Shaoqing and Sun, Jian. Deep Residual Learning for Image Recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)2016:770\u0026ndash;778.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eShao Y, Ahmed A, Liappis AP, Faselis C, Nelson SJ, Zeng-Treitler Q. Understanding Demographic Risk Factors for Adverse Outcomes in COVID-19 Patients: Explanation of a Deep Learning Model. J Healthc Inform Res 2021;5(2):181\u0026ndash;200. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1007/s41666-021-00093-9\u003c/span\u003e\u003cspan address=\"10.1007/s41666-021-00093-9\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eShao Y, Ahmed A, Zamrini EY, Cheng Y, Goulet JL, Zeng-Treitler Q. Enhancing Clinical Data Analysis by Explaining Interaction Effects between Covariates in Deep Neural Network Models. Journal of Personalized Medicine 2023;13(2):217.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eWebster LR. Risk Factors for Opioid-Use Disorder and Overdose. Anesth Analg 2017;125(5):1741\u0026ndash;1748. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1213/ANE.0000000000002496\u003c/span\u003e\u003cspan address=\"10.1213/ANE.0000000000002496\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eBinger KJ, Ansara ED, Miles TM, Schulte SL. Relapse rates among veterans on maintenance doses of combination buprenorphine and naloxone for opioid use disorder. Ment Health Clin 2020;10(3):80\u0026ndash;84. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.9740/mhc.2020.05.080\u003c/span\u003e\u003cspan address=\"10.9740/mhc.2020.05.080\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHser YI, Evans E, Grella C, Ling W, Anglin D. Long-term course of opioid addiction. Harv Rev Psychiatry 2015;23(2):76\u0026ndash;89. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1097/HRP.0000000000000052\u003c/span\u003e\u003cspan address=\"10.1097/HRP.0000000000000052\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eStrang J, Volkow ND, Degenhardt L, et al. Opioid use disorder. Nat Rev Dis Primers 2020;6(1):3. DOI: \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.1038/s41572-019-0137-5\u003c/span\u003e\u003cspan address=\"10.1038/s41572-019-0137-5\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e\u003c/ol\u003e"}],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":true,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":false,"highlight":"","institution":"","isAcceptedByJournal":true,"isAuthorSuppliedPdf":false,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":false,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"scientific-reports","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"scirep","sideBox":"Learn more about [Scientific Reports](http://www.nature.com/srep/)","snPcode":"","submissionUrl":"","title":"Scientific Reports","twitterHandle":"","acdcEnabled":true,"dfaEnabled":true,"editorialSystem":"stoa","reportingPortfolio":"Scientific Reports","inReviewEnabled":true,"inReviewRevisionsEnabled":true},"keywords":"Deep Neural Network, Explainable AI, Opioid Use Disorder, dual-system use, interaction","lastPublishedDoi":"10.21203/rs.3.rs-4344773/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-4344773/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003e The opioid crisis has disproportionately affected U.S. veterans, leading the Veterans Health Administration to implement opioid prescribing guidelines. Veterans who receive care from both VA and non-VA providers\u0026mdash;known as dual-system users \u0026mdash; have an increased risk of Opioid Use Disorder (OUD). The interaction between dual-system use and demographic and clinical factors, however, has not been previously explored. We conducted a retrospective study of 856,299 patient instances from the Washington DC and Baltimore VA Medical Centers (2012\u0026ndash;2019), using a deep neural network (DNN) and explainable Artificial Intelligence to examine the impact of dual-system use on OUD and how demographic and clinical factors interact with it. Of the cohort, 146,688(17%) had OUD, determined through Natural Language Processing of clinical notes and ICD-9/10 diagnoses. The DNN model, with a 78% area under the curve, confirmed that dual-system use is a risk factor for OUD, along with prior opioid use or other substance use. Interestingly, a history of other drug use interacted negatively with dual-system use regarding OUD risk. In contrast, older age was associated with a lower risk of OUD but interacted positively with dual-system use. These findings suggest that within the dual-system users, patients with certain risk profiles warrant special attention.\u003c/p\u003e","manuscriptTitle":"Dual Healthcare System Users and Risk of Opioid Use Disorder: A Deep Learning analysis","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2024-05-13 15:59:39","doi":"10.21203/rs.3.rs-4344773/v1","editorialEvents":[{"type":"communityComments","content":0},{"type":"decision","content":"Revision requested","date":"2024-08-22T09:31:07+00:00","index":"","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2024-08-21T15:27:10+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"184525554584911293944550101073039387640","date":"2024-07-17T19:58:43+00:00","index":"hide","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2024-07-05T14:48:36+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"312228739093398005623288506256456923048","date":"2024-06-27T13:18:36+00:00","index":"hide","fulltext":""},{"type":"reviewersInvited","content":"","date":"2024-06-27T12:18:39+00:00","index":"","fulltext":""},{"type":"editorAssigned","content":"","date":"2024-06-27T12:17:47+00:00","index":"","fulltext":""},{"type":"editorInvited","content":"","date":"2024-05-08T09:15:54+00:00","index":"","fulltext":""},{"type":"checksComplete","content":"","date":"2024-05-06T03:41:32+00:00","index":"","fulltext":""},{"type":"submitted","content":"Scientific Reports","date":"2024-04-29T18:50:17+00:00","index":"","fulltext":""}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"scientific-reports","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"scirep","sideBox":"Learn more about [Scientific Reports](http://www.nature.com/srep/)","snPcode":"","submissionUrl":"","title":"Scientific Reports","twitterHandle":"","acdcEnabled":true,"dfaEnabled":true,"editorialSystem":"stoa","reportingPortfolio":"Scientific Reports","inReviewEnabled":true,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"388aef47-7123-46de-b45d-8cf29656b83a","owner":[],"postedDate":"May 13th, 2024","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"published-in-journal","subjectAreas":[{"id":31663153,"name":"Health sciences/Health care"},{"id":31663154,"name":"Health sciences/Risk factors"}],"tags":[],"updatedAt":"2025-02-03T16:09:42+00:00","versionOfRecord":{"articleIdentity":"rs-4344773","link":"https://doi.org/10.1038/s41598-024-77602-4","journal":{"identity":"scientific-reports","isVorOnly":false,"title":"Scientific Reports"},"publishedOn":"2025-01-29 15:57:39","publishedOnDateReadable":"January 29th, 2025"},"versionCreatedAt":"2024-05-13 15:59:39","video":"","vorDoi":"10.1038/s41598-024-77602-4","vorDoiUrl":"https://doi.org/10.1038/s41598-024-77602-4","workflowStages":[]},"version":"v1","identity":"rs-4344773","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-4344773","identity":"rs-4344773","version":["v1"]},"buildId":"qtupq5eGEP_6zYnWcrvyt","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}