An accessible deep learning tool for voxel-wise classification of brain malignancies from perfusion MRI

An accessible deep learning tool for voxel-wise classification of brain malignancies from perfusion MRI | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Article An accessible deep learning tool for voxel-wise classification of brain malignancies from perfusion MRI Alonso Garcia-Ruiz, Albert Pons-Escoda, Francesco Grussu, Pablo Naval-Baudin, and 12 more This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-2362207/v1 This work is licensed under a CC BY 4.0 License Status: Published Journal Publication published 01 Mar, 2024 Read the published version in Cell Reports Medicine → Version 1 posted You are reading this latest preprint version Abstract Non-invasive differential diagnosis of brain tumours is currently based on the assessment of tumour vascularity through magnetic resonance imaging (MRI) coupled with dynamic susceptibility contrast (DSC). However, given its limited accuracy, reaching a definitive diagnosis often requires complex neurosurgical interventions that compromise the patients’ quality of life. We applied deep learning on DSC images from histology-confirmed patients with glioblastoma, metastasis or lymphoma, the three most common brain malignancies. The convolutional neural network trained on ~ 50,000 voxels from 40 patients provided intra-tumour probability maps that yielded clinical-grade diagnosis. Performance was tested in 400 additional cases and an external validation cohort (n = 128). The tool reached a three-way accuracy of 0.78, superior to standard diagnosis with cerebral blood volume (0.55) and percentage of signal recovery (0.59) perfusion metrics. Our open-access software, Brain Enhancing Region Radiological analysis (BERRY), demonstrates the potential of voxel-wise probability maps for differential diagnosis of brain tumours using standard-of-care MRI. Health sciences/Diseases/Cancer/CNS cancer Health sciences/Medical research/Biomarkers/Diagnostic markers Health sciences/Health care/Medical imaging/Magnetic resonance imaging Figures Figure 1 Figure 2 Figure 3 Figure 4 Introduction Differential diagnosis between the most common brain malignancies, i.e., glioblastoma multiforme (GBM), brain metastasis from solid tumours and primary central nervous system lymphoma (PCNSL) represents a clinical unmet need, as each of these entities requires a distinct therapeutic approach 1–3 . While pathology evaluation of tumour samples remains the gold standard for diagnosis, it requires invasive neuro-surgical procedures, with a significant risk of complications, and eventually can be confounded by the use of prior medication, such as steroids 4,5 . To overcome the need for surgery, magnetic resonance imaging (MRI) with intravenous contrast injection is being explored as a non-invasive support system for differential diagnosis of brain malignancies. GBM, brain metastasis and PCNSL represent up to 70% of all malignant brain tumours and more than 80% of contrast enhancing tumours within the brain 6 . Nevertheless, the enhancing patterns exhibit a high degree of similarity across these tumour types, making differential diagnosis challenging even for experienced neuroradiologists 7–9 . The non-invasive characterization of brain tumours on MRI is an active subject of study 10,11 that has gained momentum with the surge of machine learning techniques applied to imaging data. However, most studies to date have focused on identifying anatomical MRI sequences that differentiate between two specific tumour types 10–14 , thus limiting the generalizability and clinical utility of this approach. Dynamic susceptibility contrast perfusion-weighted imaging (DSC-PWI) is a quantitative MRI technique that enables the visualisation of vascular characteristics including vascular density and permeability, thereby providing useful information for differential diagnosis 10,15,16 . DSC-PWI consists of a temporal T2*-weighted acquisition during the administration of a vascular contrast bolus. The contrast agent causes an initial decrease in the T2*-weighted signal intensity, followed by the signal recovery during washout. In DSC-PWI every voxel in the image yields a unique time-intensity curve (TIC) that describes the temporal evolution of the T2*-weighted signal intensity, and reflects local tissue vascular properties. The standard approach to analyse TICs is to derive metrics such as the relative cerebral blood volume (rCBV) and the percentage of signal recovery (PSR). The rCBV relates to the tumour vascular density with respect to normal tissue and the PSR reflects the vascular permeability 17 . Both parameters remain the main focus of DSC-PWI analyses for tasks like tumour grade stratification, differentiation status and treatment response 10,18 . However, the performance of these parameters differs greatly among diverse clinically-used DSC-PWI protocols 17,19,20 , which limits its use in routine clinical practice. This issue is exacerbated by a lack of standardised DSC-PWI workflows including contrast preload settings, imaging parameters, leakage correction and patient-specific conditions, all of which pose additional challenges to the generalizability of the technique and the establishment of reference rCBV/PSR values. Voxel-by-voxel analyses of the full TICs can overcome these limitations and unlock the potential of DSC-PWI as a tool for differential diagnosis among the most common brain malignancies (GBM, brain metastasis and PCNSL). To test this, we developed and validated an innovative, comprehensive framework for differential diagnosis of GBM, brain metastasis and PCNSL, taking advantage of the full TIC DSC-PWI data. The developed Brain Enhancing Region Radiological analYsis (BERRY) app provides voxel-by-voxel signatures of tumour type and is based on training 1D deep convolutional neural networks (CNNs) with only a small number of pilot scans for a given DSC-PWI protocol. In the current study, we demonstrate the feasibility and accuracy of the method and show its superior performance compared to classifiers based on conventional rCBV and PSR metrics. We further designed a user-friendly interface to evaluate the potential of BERRY to minimise the use of invasive brain biopsies, and guide selection of the best treatment strategies in clinical practice. Results Cohort and clinical characteristics In this multi-center, retrospective study we analysed MRI data from patients with biopsy-confirmed GBM, brain metastasis or PCNSL. A total of 568 patients from three institutions (Bellvitge University Hospital, Spain; UC San Diego Health Center, USA; HT Medica Jaen, Spain) were included in the study. Eligibility criteria included: i) histologically confirmed diagnosis of GBM, brain metastasis or PCNSL, ii) diagnostic MR scan on 1.5T or 3T including DSC-PWI and contrast-enhanced T1-weighted imaging (CE-T1WI) acquired prior to any oncological treatment and iii) a minimum of 10 mm of diameter of enhancing tumour in the CE-T1WI. Four hundred and forty patients (45 for PCNSL, 95 for metastasis and 300 for GBM) diagnosed from 2007 to 2020 at Bellvitge University Hospital (Spain) with MRI available were included in the development cohort after image quality inspection and exclusion (Fig. 1 a). Additional independent cohorts were included and processed for external validation: a) 80 patients from UC San Diego Health Center (USA) and HT Medica Jaen (Spain), b) 25 patients from Bellvitge University Hospital (Spain), acquired at magnet strength of 3T and c) 23 patients from the IvyGAP 21 open database of patients with GBM and MRI scan with pre-bolus contrast administration, to account for the effect of different DSC-PWI protocols in the tool performance. Further information about the study cohorts and classification results can be found in Appendix A. Patient demographics and clinical characteristics per groups are shown in Supplementary Table S1. No statistically significant differences (p > 0.05) in terms of age and sex were observed between the three tumour types. Development Of A Cnn For Brain Tumour Classification We trained our CNN classifier on a development cohort where patients were randomly split into training and test sets. For the training set, we included 20 patients with PCNSL and 20 non-PCNSL (10 with GBM and 10 with metastasis). This provides a comparable number of voxels for each tumour type and each binary classification (i.e., PCSNL vs non-PCNSL; GBM vs metastasis for the non-PCNSL cases). The test set consisted of 25 patients with PCNSL, 85 with metastasis and 290 with GBM (Fig. 1 ). Approximately 50,000 TICs from voxels of the enhancing region in the training group were used to train the classifier. Each TIC corresponds to a specific spatial voxel of the enhancing tumour. Berry Outperforms Standard Classifiers For Brain Tumour Diagnosis Following a hierarchical classification approach, our CNN method, BERRY, successfully achieved three-way tumoral classification, outperforming the traditional perfusion metrics (i.e., rCBV and PSR) and standing out from simpler binary classifiers. Specifically, for the task of PCNSL diagnosis, BERRY achieved superior performance with an accuracy of 0.94 (CI: 0.93–0.94); while mean rCBV and mean PSR classified patients with accuracies of 0.72 (CI: 0.70–0.74) and 0.84 (CI: 0.83–0.85), respectively. In a second step, patients not classified as PCNSL were categorised as GBM or brain metastasis. BERRY differentiated GBM from metastases with an accuracy of 0.81 (CI: 0.79–0.82). By contrast, the performance of standard DSC-derived metrics was markedly lower: rCBV classification achieved an accuracy of 0.69 (CI: 0.67–0.71) and mean PSR of 0.65 (CI: 0.63–0.67). In Fig. 2 the area under the receiver-operating characteristic (ROC) curves of the binary classifiers and 3-way average ROC curves are shown for both the BERRY classifier and conventional rCBV/PSR. Lastly, we mimicked a real-world clinical scenario in which our diagnostic support system is confronted with a priori agnostic brain lesions comprised by the three most common conditions, in this case represented by our blinded test dataset. In this setting, BERRY achieved an accuracy of 0.78 (CI: 0.76–0.79), which is substantially better than the three-way accuracy achieved using mean rCBV (0.59, CI: 0.57–0.60) and mean PSR (0.55, CI: 0.53–0.56). Furthermore, the combination of rCBV and PSR into a logistic regression model also yielded poor performance (Supplementary Table S3). Additional sensitivity and specificity values can be found in Supplementary Table S2. These data underscore the potential of BERRY for differentiating among the three most common clinical diagnostic challenges in patients with enhancing brain lesions. Voxel-wise Explainable Representation Of The Cnn Decision Process BERRY provides spatial probability maps of tumour classification, which are then used to obtain a voxel proportion and a patient classification label. In Fig. 2 A we present three examples per tumour type of the voxel-wise probability maps according to the BERRY classifier. The probability maps are shown overlaid onto the CE-T1W MRI for anatomical references. Overall, the tumour type probability maps are smooth and identify the tumour type with high confidence in most voxels, even when intra-tumour signal heterogeneity is seen in the contrast enhanced T1W scan. Voxels exhibiting a high probability of belonging to the incorrect tumour class tend to be located either in the boundary of the enhancing area, or around necrotic intra-tumoral spots. This potentially reflects partial volume (i.e., inclusion of signal from tumour and non-tumour areas within a voxel), or intra-tumoral heterogeneity. Voxel-wise classification allows for computing spatial distribution of the predictions within a tumour yielding relevant information about the prediction consistency and also about potential tumour heterogeneity, useful to guide interventions and for tumour spatial characterization. Visual Interpretation Of The Cnn Classification We further sought to implement Class Activation Mapping (CAM) to provide visual explanation of the BERRY classification network. The ScoreCAM 22 method yields a normalised score of the contribution of every input to the final classification of a CNN. This allows us to identify the most discriminative timepoints for TIC differentiation. ScoreCAM spatial maps were obtained for each binary classification (Fig. 3 A). The CNN mostly focuses on the bolus passage to classify the central tumour region (middle row for PCNSL vs non-PCNSL and lower row for GBM vs metastasis differentiation in Fig. 3 A). In contrast, the bolus passage seems less important for some voxels in surrounding regions. This suggests that the CNN effectively considered the bolus passage as a discerning characteristic, but also that it provides additional tissue perfusion differences compared to the raw DSC-PWI signal (top row in Fig. 3 A). The average ScoreCAM values per tumour type and per CNN classifier can be found in Fig. 3 B (upper row for PCNSL vs non-PCNSL and lower row for GBM vs metastasis differentiation). Overall, the sharper signal changes of the TICs, i.e., steep slopes during contrast arrival and washout, have a higher contribution score. This is especially true for GBM, with greater differences in these timepoints with respect to the other two tumour types (average TICs shown in black in Fig. 3 B). For PCNSL and metastasis, the last part of the signal is also considered important, which can be expected given the overall higher signal magnitude reached in these cases. Importantly, applying 1D CNNs over TIC signals allows to analyse the local changes of the signal over time. In this regard, methods that only consider the signal magnitude of specific timepoints, such as PSR, or a derived measurement like rCBV, may overlook local TIC changes occurring over time that reflect specific physiological traits of the tumour. A User-friendly Berry App The BERRY app was successfully implemented at the participating institutions for validating the tool in external cohorts, as illustrated in Fig. 4 . The tool requires approximately two minutes to process a new case and provides a classification outcome, in the form of i) voxel-wise tumour type probability maps, and ii) patient-wise tumour type. In addition, it shows the average TIC for the enhancing tumour and white matter, as well as a visualisation of the segmentation for the user to safely check the process. The mask can be automatically segmented from the enhancing tumour by BERRY or it can be provided by the user. The BERRY app provides a classification label with balanced sensitivity and specificity (Youden’s index) by default, but a given clinical scenario may require a different classification threshold. To that end, sensitivities and specificities for every threshold are displayed, and the default settings can be changed. Discussion We present a novel voxel-wise method for analysing perfusion scans with CNNs and improve brain cancer diagnosis, built upon prior DSC-PWI signal normalization 23 . By applying this method, we were able to surpass the performance of previous models for non-invasive differential diagnosis of the most frequent malignant brain tumours (i.e., GBM, metastasis and PCNSL, representing up to 70% of all malignant tumours in the brain 6 ), which is critical to define an optimal treatment approach. Our deep learning framework takes advantage of the large amount of information provided by the thousands of voxel-wise TICs available in each individual DSC-PWI scan 24 , and achieves optimal performance through training with a limited number of scans from a few patients at fixed DSC protocol (on the order of 30–40 cases). Our approach is particularly appealing for medical imaging applications, where the design of robust deep learning methods is challenged by the limited number of scans available. Additionally, our method distinguishes between tumour types in a three-way classification task. This can be of particular relevance as a support tool for differential diagnosis in clinical practice, and is a considerable step forward as compared to current literature, which is dominated by binary classification studies 10–14 . This is particularly important when PCNSL is considered among the potential diagnoses. Corticosteroids are usually the first treatment of choice to reduce the neurological symptoms secondary to oedema in patients with malignant brain tumours. However, early stereotactic biopsy prior to corticosteroids administration is mandatory when a brain PCNSL is suspected by imaging, as medication with steroids can alter the histological pattern of PCNSL 5 . Moreover, PCNSL is highly sensitive to chemoradiotherapy instead of resection, which is contraindicated, as opposed to GBM or metastasis. Therefore, a reliable characterization of the tumour type by imaging is critical to devise the appropriate management of patients. The BERRY app provides voxel-wise tumour type probability maps, which are then used to obtain a voxel proportion and a patient classification label. The default Youden’s index (trade-off between sensitivity and specificity) can be changed to the needs of different clinical scenarios. For instance, some clinical scenarios may require a very high specificity for suspected GBM and metastases with respect to PCNSL and, if all evidence supports it, an additional intervention for a biopsy could be prevented. Therefore, the voxel proportion can be adjusted in the app to match the user’s needs. The presented method successfully achieved three-way tumoral classification, outperforming the traditional perfusion metrics and standing out from simpler binary classifiers. When tested, our method performed with accuracies of 0.94 for PCNSL identification, 0.81 for differentiation of GBM from metastasis and 0.78 for three-way classification. Of note, the DSC protocol used for model development did not include contrast preload. Contrast preload is a common approach described in the literature to achieve a better estimate of the rCBV 20 . However, preload can be undesirable for a number of reasons. Firstly, it delivers a higher contrast dose to the patient. Secondly, it can introduce potential variability sources, affecting the TIC signal morphology. As countermeasures, leakage correction and acquisition parameters that minimise T1 effect, such as low flip angle, have been shown to effectively yield reliable rCBV estimates without preload 20,25 . In this study, rCBV was estimated with leakage correction, obtaining comparable results to those of PSR. The combination of both rCBV and PSR in logistic regression was explored for completeness, but it did not improve the results of the individual parameters. A key feature of our CNN approach is the computation of voxel-wise spatial representations of perfusion curve characteristics, in the form of maps describing the probability of a voxel to belong to a specific tumour type. Such spatial probability maps provide an explainable representation of the CNN decision process and may enable further studies of intra-tumour heterogeneity, making them an appealing tool for integrative multi-omics research and also of potential clinical interest to plan surgical procedures. To our knowledge, this is one of the first studies applying deep learning to voxel-wise DSC TICs in neuro-oncological applications. A recent study 26 used a deep autoencoder to derive a set of five descriptors of TICs that could differentiate between pairs of tumour types. However, the reconstructed timepoints from such a minimal set of descriptors, in contrast to the original signal, produce a smooth TIC morphology, which may be omitting relevant details for diagnostic applications. We acknowledge that our model trained with DSC-PWI data without preload from 1.5T scanners can be a potential limitation. As discussed, preload can change the TIC morphology and it is possible that the performance of our model is hindered when deployed in preloaded data. Nevertheless, tests on all eligible external 3T scans with contrast preload of 23 patients with GBM from the IvyGAP 21 dataset yielded 18 cases correctly classified as GBM (0.78 accuracy). Of note, internal centre tests on 3T scans (n = 25) resulted in 0.72 accuracy, showing an overall agreement in performance with mixed scans from external centres (n = 80) reaching 0.71 of accuracy. The results show that, albeit training on a small cohort, our method notably generalises in external populations, in contrast to reported conventional metrics. Importantly, the proposed method could accommodate different DSC-PWI protocols by training the models with just a few new imaging samples. Regarding the segmented regions of interest, we used the automatic segmented masks revised by an experienced neuroradiologist as reference, but the variability in the segmentations from different neuroradiologists is to be explored. We believe that future segmentation methods could make the manual input minimal and it could be integrated in the proposed pipeline. To account for that in the online tool, the user can check the automatic segmentation obtained from thresholding and they can provide their own if needed. In the future, the algorithm could be adapted to include rich multi-parametric MRI protocols that include additional contrasts (e.g., diffusion MRI 27 ), as these may provide orthogonal information on tumour microstructure that could improve the classification performance even further. Nevertheless, we proposed here a user-friendly tool that can be applied with just two MRI sequences (CE-T1WI for determining the area of interest and DSC-PWI for classification). BERRY allows for classifying the three most common enhancing brain tumours (i.e., GBM, metastases and PCNSL). Furthermore, the developed framework will allow expanding its use by training the model with a few cases of other less common tumours such as anaplastic astrocytoma and extra-axial tumours such as meningioma in the future. In conclusion, the presented CNN framework for three-class brain tumour classification based on voxel-wise DSC-PWI signal analysis is feasible and outperforms classifiers built on conventional rCBV and PSR metrics. The method can be trained using a limited number of scans, which most centres are likely to have available, with notable generalisation to external data. Additionally, it provides voxel-wise maps of tumour type signatures that could be useful to visualise the CNN classification process, and for tumour spatial characterization. As a way to make this tool more accessible and eventually make an impact in clinical practice, the proposed method has been implemented on the user-friendly BERRY application that is made freely accessible at https://berry-app.vhio.org , in order to enhance study reproducibility and accelerate its adoption in future clinical studies. Methods The research ethics committee of Bellvitge University Hospital (Barcelona, Spain) approved the study and informed consent was waived. The confidential data from patients were anonymized and protected in accordance with national and European regulations. Statistical analysis of patient characteristic distribution Statistical tests were performed to compare: (i) patient age distribution between training and test sets of each tumour type (Welch’s t-test), as well as among tumour types (one-way ANOVA); (ii) patient sex distribution between training and test sets of each tumour type (Fisher’s exact test), as well as among tumour types (Chi-square test). Relations shown in Supplementary Table S1. Data pre-processing The MRI scans were performed in 1.5T Philips scanners (219 on Ingenia and 221 on Intera). The DSC-PWI acquisition parameters were: temporal sampling of 1.26-1.93 seconds, 40-60 timepoints, acquired during a bolus administration of gadolinium contrast agent (gadobutrol 0.1 mmol/kg) without contrast preload (more details in Appendix B of the Supplementary Material). The DSC-PWI dynamic sequence was motion-corrected by rigid registration of all DSC volumes. Bias field correction 28 was applied to the CE-T1WI, which was rigidly registered to the DSC-PWI. Brain region masking was obtained on the CE-T1WI using a hierarchical approach 29 . Segmentations of the enhancing tumour and contralateral normal-appearing white matter were first obtained by simple thresholding and afterwards revised by an experienced neuroradiologist (APE). The TICs reflecting the bolus passage in every voxel of the DSC-PWI sequence were extracted for the enhancing tumour and normal white matter regions. According to a previously presented normalisation method 23 , TICs from the enhancing tumour were normalised to the white matter. The minimum peak point of the TICs was retrieved, the curves were aligned to this point and TICs with points within the average plus and minus standard deviation were used for training the CNNs. Slicer 30 (www.slicer.org) and Python 3.8 were used for segmentation, processing, training, inference and statistical tests. CNN architecture A CNN was designed with three 1D convolutional layers with kernel sizes [3,5,7], followed by a 10% dropout layer and max pooling layer (pool size 2), then concatenated into a dense layer with 100 nodes of rectified linear units and a final binary output layer with softmax activation, cross-entropy loss function and Adam optimizer. The CNN was built using Tensorflow v2 with Keras frontend. The CNN classifier receives a given TIC as input and outputs a binary probability. Classification scheme By applying the CNN classifier voxel-by-voxel, a probability map is obtained over the enhancing tumour region. These voxel-wise probabilities are then converted into a patient-wise classification as: Above, is the number of voxels with a probability higher than 0.9 for one tumour type and is the number of voxels with a probability higher than 0.9 for the second tumour type on the binary classifier. The tumour type of each patient was inferred by applying Youden’s index (highest sum of specificity and sensitivity in the training set) to the voxel proportion above. In practice, a 3-class classifier differentiating between PCNSL, GMB and metastases was implemented by concatenating two 2-class classifiers. The first classifier distinguishes PCNSL from non-PCNSL cases, while the second classifier differentiates the non-PCNSL cases into GBM or metastasis (Fig. 1). Classification performance and interpretation Classification accuracy, sensitivity and specificity were obtained for 100 groups of 25 randomly-selected patients from the test cohort in order to obtain average classification performance and 95% confidence intervals (CI) for all classifiers, as reported in Supplementary Table S2. In addition, the area under the ROC curve was obtained for binary classifications, which shows the trade-off between sensitivity and specificity of different classification thresholds (Fig. 2B). The thresholds were set by Youden’s index as described above, but the app allows users to change them to meet different clinical needs, as discussed. Average ROC curves were obtained for the 3-class problem (Fig. 2C). Current standard metrics of DSC-PWI analyses were obtained to compare against our voxel-trained CNN. Mean PSR and mean rCBV were computed with Slicer, for which further details can be found in Supplementary Appendix C. Classification metrics and ROC curves were obtained for PSR and rCBV applying the same classification structure used for the CNN-based approach. CNN interpretation The CNN provides a tumour-type probability value from each TIC found in each voxel. The map inherently informs about the decision process of the CNN classifier towards one tumour type or another and, more importantly, about the confidence of the classification in spatial regions. To further explore the features that the CNN associated with each tumour type, down to the individual timepoints of the DSC-PWI TIC signal, we applied a score-weighted visual explanation for CNNs (ScoreCAM 22 ). On Fig. 3A, the importance score was scaled to sum 1 over all timepoints in every voxel, in order to see the spatial relative importance. On Fig 3B, the average importance score is shown in each timepoint for each tumour type, with the average tumour TIC from the training data overlayed in black, in order to see the temporal differences. Development of the online app BERRY The processing and classification pipeline was bundled into a Docker image which can run as a standalone application in any system (Fig. 4). For demonstrative purposes, the BERRY app is also available on the VHIO server through a web interface, so that it is accessible from anywhere using an internet connection. The user can input their anonymized DSC-PWI and CE-T1WI scans in raw DICOM, Nifti or NRRD formats and, optionally, their own segmentations. When the study is processed, the tool shows the average TIC, the result of the classification and the spatial probability map. The online tool can be accessed at https://berry-app.vhio.org for research purposes. Declarations Data availability Four out of five datasets used in this study, from the 4 participating sites, are not publicly available due to their containing information that could compromise the privacy of research participants. The IvyGAP 21,31 dataset used as one of the validation cohorts is publicly available at The Cancer Imaging Archive 32 (https://doi.org/10.7937/K9/TCIA.2016.XLwaN6nL), along with reference segmentations 33,34 (https://doi.org/10.7937/9j41-7d44). Code availability The code integrating the app processing and classification pipeline can be publicly accessed at https://github.com/radiomicsvhio/berry-app. We relied on the open-source software dcm2niix (https://github.com/rordenlab/dcm2niix/) for DICOM conversion and Slicer 30 (www.slicer.org) for image annotations and computing. The BERRY online app can be accessed at https://berry-app.vhio.org. Equal contribution: *AGR, APE and FG are co-first authors with equal contributions. References Young RM, Jamshidi A, Davis G, Sherman JH. Current trends in the surgical management and treatment of adult glioblastoma. Ann Transl Med. 2015; 3(9):121. Hatiboglu MA, Wildrick DM, Sawaya R. The role of surgical resection in patients with brain metastases. Ecancermedicalscience. 2013; 7:308. Hoang-Xuan K, Bessell E, Bromberg J, et al. Diagnosis and treatment of primary CNS lymphoma in immunocompetent patients: guidelines from the European Association for Neuro-Oncology. The Lancet Oncology. 2015; 16(7):e322-e332. Dammers R, Haitsma IK, Schouten JW, Kros JM, Avezaat CJ, Vincent AJ. Safety and efficacy of frameless and frame-based intracranial biopsy techniques. Acta Neurochir (Wien). 2008; 150(1):23–29. Chiavazza C, Pellerino A, Ferrio F, Cistaro A, Soffietti R, Ruda R. Primary CNS Lymphomas: Challenges in Diagnosis and Monitoring. Biomed Res Int. 2018; 2018:3606970. Miller KD, Ostrom QT, Kruchko C, et al. Brain and other central nervous system tumor statistics, 2021. CA Cancer J Clin. 2021; 71(5):381–406. Leung D, Han X, Mikkelsen T, Nabors LB. Role of MRI in primary brain tumor evaluation. J Natl Compr Canc Netw. 2014; 12(11):1561–1568. Arita K, Miwa M, Bohara M, Moinuddin FM, Kamimura K, Yoshimoto K. Precision of preoperative diagnosis in patients with brain tumor - A prospective study based on "top three list" of differential diagnosis for 1061 patients. Surg Neurol Int. 2020; 11:55. Chakravorty A, Steel T, Chaganti J. Accuracy of percentage of signal intensity recovery and relative cerebral blood volume derived from dynamic susceptibility-weighted, contrast-enhanced MRI in the preoperative diagnosis of cerebral tumours. Neuroradiol J. 2015; 28(6):574–583. Cha S, Lupo JM, Chen MH, et al. Differentiation of glioblastoma multiforme and single brain metastasis by peak height and percentage of signal intensity recovery derived from dynamic susceptibility-weighted contrast-enhanced perfusion MR imaging. AJNR Am J Neuroradiol. 2007; 28(6):1078–1084. Fordham AJ, Hacherl CC, Patel N, et al. Differentiating Glioblastomas from Solitary Brain Metastases: An Update on the Current Literature of Advanced Imaging Modalities. Cancers (Basel). 2021; 13(12). Artzi M, Bressler I, Ben Bashat D. Differentiation between glioblastoma, brain metastasis and subtypes using radiomics analysis. J Magn Reson Imaging. 2019; 50(2):519–528. Bae S, An C, Ahn SS, et al. Robust performance of deep learning for distinguishing glioblastoma from single brain metastasis using radiomic features: model development and validation. Sci Rep. 2020; 10(1):12110. Qian Z, Li Y, Wang Y, et al. Differentiation of glioblastoma from solitary brain metastases using radiomic machine-learning classifiers. Cancer Lett. 2019; 451:128–135. Neska-Matuszewska M, Bladowska J, Sasiadek M, Zimny A. Differentiation of glioblastoma multiforme, metastases and primary central nervous system lymphomas using multiparametric perfusion and diffusion MR imaging of a tumor core and a peritumoral zone-Searching for a practical approach. PLoS One. 2018; 13(1):e0191341. Lee MD, Baird GL, Bell LC, Quarles CC, Boxerman JL. Utility of Percentage Signal Recovery and Baseline Signal in DSC-MRI Optimized for Relative CBV Measurement for Differentiating Glioblastoma, Lymphoma, Metastasis, and Meningioma. AJNR Am J Neuroradiol. 2019; 40(9):1445–1450. Bell LC, Hu LS, Stokes AM, McGee SC, Baxter LC, Quarles CC. Characterizing the Influence of Preload Dosing on Percent Signal Recovery (PSR) and Cerebral Blood Volume (CBV) Measurements in a Patient Population With High-Grade Glioma Using Dynamic Susceptibility Contrast MRI. Tomography. 2017; 3(2):89–95. Bell LC, Semmineh N, An H, et al. Evaluating the Use of rCBV as a Tumor Grade and Treatment Response Classifier Across NCI Quantitative Imaging Network Sites: Part II of the DSC-MRI Digital Reference Object (DRO) Challenge. Tomography. 2020; 6(2):203–208. Boxerman JL, Paulson ES, Prah MA, Schmainda KM. The effect of pulse sequence parameters and contrast agent dose on percentage signal recovery in DSC-MRI: implications for clinical applications. AJNR Am J Neuroradiol. 2013; 34(7):1364–1369. Paulson ES, Schmainda KM. Comparison of dynamic susceptibility-weighted contrast-enhanced MR methods: recommendations for measuring relative cerebral blood volume in brain tumors. Radiology. 2008; 249(2):601–613. Shah N, Feng X, Lankerovich M, Puchalski RB, Keogh B. Data from Ivy Glioblastoma Atlas Project (IvyGAP): The Cancer Imaging Archive; 2016. Wang H, Wang Z, Du M, et al. Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks. Paper presented at: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)2020. Pons-Escoda A, Garcia-Ruiz A, Naval-Baudin P, et al. Presurgical Identification of Primary Central Nervous System Lymphoma with Normalized Time-Intensity Curve: A Pilot Study of a New Method to Analyze DSC-PWI. AJNR Am J Neuroradiol. 2020; 41(10):1816–1824. Grussu F, Blumberg SB, Battiston M, et al. Feasibility of Data-Driven, Model-Free Quantitative MRI Protocol Design: Application to Brain and Prostate Diffusion-Relaxation Imaging. Frontiers in Physics. 2021; 9. Schmainda KM, Prah MA, Hu LS, et al. Moving Toward a Consensus DSC-MRI Protocol: Validation of a Low-Flip Angle Single-Dose Option as a Reference Standard for Brain Tumors. AJNR Am J Neuroradiol. 2019; 40(4):626–633. Park JE, Kim HS, Lee J, et al. Deep-learned time-signal intensity pattern analysis using an autoencoder captures magnetic resonance perfusion heterogeneity for brain tumor differentiation. Sci Rep. 2020; 10(1):21485. Nilsson M, Englund E, Szczepankiewicz F, van Westen D, Sundgren PC. Imaging brain tumour microstructure. Neuroimage. 2018; 182:232–250. Tustison NJ, Avants BB, Cook PA, et al. N4ITK: improved N3 bias correction. IEEE Trans Med Imaging. 2010; 29(6):1310–1320. Pohl KM, Bouix S, Nakamura M, et al. A hierarchical algorithm for MR brain image parcellation. IEEE Trans Med Imaging. 2007; 26(9):1201–1212. Fedorov A, Beichel R, Kalpathy-Cramer J, et al. 3D Slicer as an image computing platform for the Quantitative Imaging Network. Magn Reson Imaging. 2012; 30(9):1323–1341. Puchalski RB, Shah N, Miller J, et al. An anatomic transcriptional atlas of human glioblastoma. Science. 2018; 360(6389):660–663. Clark K, Vendt B, Smith K, et al. The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository. J Digit Imaging. 2013; 26(6):1045–1057. Data from the Multi-Institutional Paired Expert Segmentations and Radiomic Features of the Ivy GAP Dataset. The Cancer Imaging Archive (TCIA); 2020. https://wiki.cancerimagingarchive.net/pages/viewpage.action?pageId=70222827 . Pati S, Verma R, Akbari H, et al. Reproducibility analysis of multi-institutional paired expert annotations and radiomic features of the Ivy Glioblastoma Atlas Project (Ivy GAP) dataset. Med Phys. 2020; 47(12):6039–6052. Additional Declarations There is NO Competing Interest. Supplementary Files Supplementary.docx Cite Share Download PDF Status: Published Journal Publication published 01 Mar, 2024 Read the published version in Cell Reports Medicine → Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-2362207","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Article","associatedPublications":[],"authors":[{"id":159823467,"identity":"a8766c43-aa16-4f81-b6c8-4f3b2ad453f4","order_by":0,"name":"Alonso Garcia-Ruiz","email":"","orcid":"https://orcid.org/0000-0003-0129-3020","institution":"Vall d'Hebron Institute of Oncology","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Alonso","middleName":"","lastName":"Garcia-Ruiz","suffix":""},{"id":159823468,"identity":"1e706fe1-ea0c-402d-a0c4-e0c05c2809c9","order_by":1,"name":"Albert Pons-Escoda","email":"","orcid":"https://orcid.org/0000-0003-4167-8291","institution":"Bellvitge University Hospital","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Albert","middleName":"","lastName":"Pons-Escoda","suffix":""},{"id":159823469,"identity":"fa44c987-b962-4415-8425-f5edbd1be601","order_by":2,"name":"Francesco Grussu","email":"","orcid":"","institution":"Vall d'Hebron Institute of Oncology","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Francesco","middleName":"","lastName":"Grussu","suffix":""},{"id":159823470,"identity":"4abd8b77-22c4-419f-9f38-9f12dc0d216d","order_by":3,"name":"Pablo Naval-Baudin","email":"","orcid":"https://orcid.org/0000-0002-8714-0764","institution":"Bellvitge University Hospital","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Pablo","middleName":"","lastName":"Naval-Baudin","suffix":""},{"id":159823471,"identity":"961253b3-15d0-48c6-9782-a9a0afe586d2","order_by":4,"name":"Camilo Monreal-Aguero","email":"","orcid":"","institution":"Vall d'Hebron Institute of Oncology","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Camilo","middleName":"","lastName":"Monreal-Aguero","suffix":""},{"id":159823472,"identity":"0a6193b6-2284-4aab-8f5c-67ee1ac1513e","order_by":5,"name":"Gretchen Hermann","email":"","orcid":"","institution":"University of California San Diego","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Gretchen","middleName":"","lastName":"Hermann","suffix":""},{"id":159823473,"identity":"167cf446-598f-44a4-8630-adaa227ea61b","order_by":6,"name":"Roshan Karunamuni","email":"","orcid":"","institution":"University of California San Diego","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Roshan","middleName":"","lastName":"Karunamuni","suffix":""},{"id":159823474,"identity":"34fb8812-6def-43e4-ae46-98ac17bed678","order_by":7,"name":"Marta Ligero","email":"","orcid":"","institution":"Vall d'Hebron Institute of Oncology","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Marta","middleName":"","lastName":"Ligero","suffix":""},{"id":159823475,"identity":"cdfe1f6c-408c-46ab-b8f1-b9ff2f8054f2","order_by":8,"name":"Antonio Lopez-Rueda","email":"","orcid":"","institution":"Hospital Clínic de Barcelona","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Antonio","middleName":"","lastName":"Lopez-Rueda","suffix":""},{"id":159823476,"identity":"27cf8fc3-dda6-4ac7-9678-b9a13aef21ec","order_by":9,"name":"Laura Oleaga","email":"","orcid":"","institution":"Hospital Clínic de Barcelona","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Laura","middleName":"","lastName":"Oleaga","suffix":""},{"id":159823477,"identity":"ee39c479-d2a6-41b5-9e88-41deca53c0e8","order_by":10,"name":"Alvaro Berbis","email":"","orcid":"","institution":"HT Medica, Hospital San Juan de Dios","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Alvaro","middleName":"","lastName":"Berbis","suffix":""},{"id":159823478,"identity":"059c2b9a-e234-4ad2-9767-9fb047b7d686","order_by":11,"name":"Teodoro Martin-Noguerol","email":"","orcid":"","institution":"HT Medica","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Teodoro","middleName":"","lastName":"Martin-Noguerol","suffix":""},{"id":159823479,"identity":"972c562a-acdb-474f-a573-565249c97b68","order_by":12,"name":"Antonio Luna-Alcala","email":"","orcid":"","institution":"HT Medica","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Antonio","middleName":"","lastName":"Luna-Alcala","suffix":""},{"id":159823480,"identity":"b6ec64f1-1cc3-4f83-af00-be30c247d2d0","order_by":13,"name":"Tyler Seiber","email":"","orcid":"","institution":"University of California San Diego","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Tyler","middleName":"","lastName":"Seiber","suffix":""},{"id":159823481,"identity":"f9a7f588-347e-43f8-9201-4c9a87612ad4","order_by":14,"name":"Carlos Majos","email":"","orcid":"https://orcid.org/0000-0003-0468-5150","institution":"Bellvitge University Hospital","correspondingAuthor":false,"submittingAuthor":false,"prefix":"","firstName":"Carlos","middleName":"","lastName":"Majos","suffix":""},{"id":159823482,"identity":"0c2fd9b1-197e-4a7f-8032-a96a57eed052","order_by":15,"name":"Raquel Perez-Lopez","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAArElEQVRIiWNgGAWjYPACGwYDZhK1pMG0GBCt5TBMLRFazGc3H/vw4c/5xO3szAeYCyr+ENYic+dY8swZPLcTdzazJTDPOEOELRISOcbMPBK3jQ0O8xgw87YRpSX/M/Mfg3NQLf+Is4WZmSHhgBxESwMxWmSOGTP2HEgGamFLOMxzzJgILdLNjxl+/LHjMTh/+OBjnho5wloYJJDYB4hQj6ZlFIyCUTAKRgFWAAC3ozCksI8ezQAAAABJRU5ErkJggg==","orcid":"","institution":"Vall d'Hebron Institute of Oncology","correspondingAuthor":true,"submittingAuthor":false,"prefix":"","firstName":"Raquel","middleName":"","lastName":"Perez-Lopez","suffix":""}],"badges":[],"createdAt":"2022-12-09 15:13:58","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-2362207/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-2362207/v1","draftVersion":[],"editorialEvents":[{"content":"https://doi.org/10.1016/j.xcrm.2024.101464","type":"published","date":"2024-03-01T11:23:48+00:00"}],"editorialNote":"","failedWorkflow":false,"files":[{"id":30332163,"identity":"2c5c6714-c422-4a24-8f83-d42d7995debd","added_by":"auto","created_at":"2022-12-14 16:29:12","extension":"png","order_by":1,"title":"Figure 1","display":"","copyAsset":false,"role":"figure","size":673282,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cstrong\u003eSummary of the population and study design.\u003c/strong\u003e \u003cstrong\u003ea\u003c/strong\u003e Collected, excluded and included data for analysis and further split into the development cohort and external validation cohorts. The number of patients for each tumour type and the respective perfusion TIC distribution are shown for each cohort. \u003cstrong\u003eb\u003c/strong\u003e Processing pipeline of the implemented BERRY app for three-way tumour classification of DSC-PWI data. At the top, the input images of CE-T1WI for automated ROI selection and DSC-PWI for classification are provided. TICs are then extracted voxel-wise from the enhancing tumour and normalised to the white matter. Every TIC is classified by two sequential CNNs, obtaining a probability map and an overall tumour classification.\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eDSC-PWI: dynamic susceptibility contrast perfusion-weighted imaging. CE-T1WI: contrast-enhanced T1-weighted imaging. TIC: time-intensity curve. CNN: convolutional neural network. GBM: glioblastoma multiforme, PCNSL: primary central nervous system lymphoma.\u003c/em\u003e\u003c/p\u003e","description":"","filename":"floatimage1.png","url":"https://assets-eu.researchsquare.com/files/rs-2362207/v1/8f35209451211af426005cae.png"},{"id":30331618,"identity":"1b4a42dc-6427-4711-bc29-b3d93a3ed558","added_by":"auto","created_at":"2022-12-14 16:21:12","extension":"png","order_by":2,"title":"Figure 2","display":"","copyAsset":false,"role":"figure","size":1290260,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cstrong\u003eProbability maps and diagnostic performance of BERRY.\u003c/strong\u003e \u003cstrong\u003ea\u003c/strong\u003e Three cases correctly classified by BERRY are shown for each tumour type, from left to right: PCNSL, metastasis and GBM. In the upper row, a representative 2D slice of the CE-T1WI registered to the DSC-PWI with overlaid probability maps for PCNSL vs non-PCNSL (middle row) and for GBM vs metastasis (lower row) of non-PCNSL cases. \u003cstrong\u003eb\u003c/strong\u003e ROC curves for binary classifiers PCNSL vs non-PCNSL (top) and GBM vs metastasis (bottom) for the proposed CNN, rCBV and PSR. \u003cstrong\u003ec\u003c/strong\u003e 3-class ROC curves showing mean and standard deviation of 2-class combinations, from left to right: the proposed CNN, rCBV and PSR.\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eCE-T1WI: contrast-enhanced T1-weighted imaging. CNN: convolutional neural network. GBM: glioblastoma multiforme, PCNSL: primary central nervous system lymphoma. ROC: Receiver-operator characteristic. rCBV: relative cerebral blood volume, PSR: percentage of signal recovery.\u003c/em\u003e\u003c/p\u003e","description":"","filename":"floatimage2.png","url":"https://assets-eu.researchsquare.com/files/rs-2362207/v1/aecd2d31f98d12be0b9ceb61.png"},{"id":30331620,"identity":"ec034e37-f74e-472a-acf5-16fcab8c29fa","added_by":"auto","created_at":"2022-12-14 16:21:12","extension":"png","order_by":3,"title":"Figure 3","display":"","copyAsset":false,"role":"figure","size":490325,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cstrong\u003eVisual interpretation of the CNN classification.\u003c/strong\u003e \u003cstrong\u003ea\u003c/strong\u003e ScoreCAM spatial maps to further understand what are the most discriminative TIC timepoints for classification per voxel. We show here a representative case of a metastasis in a 2D slice of the DSC-PWI (red box at the leftmost). In the upper row, consecutive DSC-PWI dynamic timepoints, zoomed in on the lesion. In the middle row, spatial importance score maps obtained with ScoreCAM for PCNSL vs non-PCNSL, and for GBM vs metastasis in the lower row; the score was scaled to sum 1 over all timepoints in each voxel to observe relative importance in space. \u003cstrong\u003eb\u003c/strong\u003e The average importance of each timepoint obtained from ScoreCAM that contributes to the tumour classification of TICs, for PCNSL vs non-PCNSL (upper row) and GBM vs metastasis (lower row) differentiation; average tumour type TIC in the training set is overlaid as a black solid line.\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eDSC-PWI: dynamic susceptibility contrast perfusion-weighted imaging. TIC: time-intensity curve. GBM: glioblastoma multiforme, PCNSL: primary central nervous system lymphoma.\u003c/em\u003e\u003c/p\u003e","description":"","filename":"floatimage3.png","url":"https://assets-eu.researchsquare.com/files/rs-2362207/v1/dd4ac851788ccd1f7fd3a544.png"},{"id":30331621,"identity":"380a6764-756d-4b0c-b1dd-5f95c58b7975","added_by":"auto","created_at":"2022-12-14 16:21:12","extension":"jpeg","order_by":4,"title":"Figure 4","display":"","copyAsset":false,"role":"figure","size":611133,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cstrong\u003eImplementation of the app with an easy-to-use interface.\u003c/strong\u003e The image illustrates the web interface of the BERRY app Docker. In the uppermost tile, the user dashboard shows the ongoing and finished studies in which to run the pipeline. The next tiles show the results, namely the reference image used for segmentation and respective enhancing tumour and white matter regions, the average normalised TICs of those regions, the tumour probability map and distribution and a final classification result.\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eTIC: time-intensity curve.\u003c/em\u003e\u003c/p\u003e","description":"","filename":"floatimage4.jpeg","url":"https://assets-eu.researchsquare.com/files/rs-2362207/v1/42aaa1c1ee187b3d0090674b.jpeg"},{"id":53162289,"identity":"691b122d-bf4d-4c81-94ee-5c6dffe22b11","added_by":"auto","created_at":"2024-03-21 11:23:53","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":1788681,"visible":true,"origin":"","legend":"","description":"","filename":"manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-2362207/v1/508be396-1554-498f-8033-c1c919a88529.pdf"},{"id":30331617,"identity":"ef8a8048-40ff-4660-ad6a-65bc3f2b110a","added_by":"auto","created_at":"2022-12-14 16:21:12","extension":"docx","order_by":1,"title":"","display":"","copyAsset":false,"role":"supplement","size":32488,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cbr\u003e\u003c/p\u003e","description":"","filename":"Supplementary.docx","url":"https://assets-eu.researchsquare.com/files/rs-2362207/v1/248ffc23cb4e87616f4f1f65.docx"}],"financialInterests":"There is \u003cb\u003eNO\u003c/b\u003e Competing Interest.","formattedTitle":"An accessible deep learning tool for voxel-wise classification of brain malignancies from perfusion MRI","fulltext":[{"header":"Introduction","content":"\u003cp\u003eDifferential diagnosis between the most common brain malignancies, i.e., glioblastoma multiforme (GBM), brain metastasis from solid tumours and primary central nervous system lymphoma (PCNSL) represents a clinical unmet need, as each of these entities requires a distinct therapeutic approach\u003csup\u003e1\u0026ndash;3\u003c/sup\u003e. While pathology evaluation of tumour samples remains the gold standard for diagnosis, it requires invasive neuro-surgical procedures, with a significant risk of complications, and eventually can be confounded by the use of prior medication, such as steroids\u003csup\u003e4,5\u003c/sup\u003e.\u003c/p\u003e \u003cp\u003eTo overcome the need for surgery, magnetic resonance imaging (MRI) with intravenous contrast injection is being explored as a non-invasive support system for differential diagnosis of brain malignancies. GBM, brain metastasis and PCNSL represent up to 70% of all malignant brain tumours and more than 80% of contrast enhancing tumours within the brain\u003csup\u003e6\u003c/sup\u003e. Nevertheless, the enhancing patterns exhibit a high degree of similarity across these tumour types, making differential diagnosis challenging even for experienced neuroradiologists\u003csup\u003e7\u0026ndash;9\u003c/sup\u003e.\u003c/p\u003e \u003cp\u003eThe non-invasive characterization of brain tumours on MRI is an active subject of study\u003csup\u003e10,11\u003c/sup\u003e that has gained momentum with the surge of machine learning techniques applied to imaging data. However, most studies to date have focused on identifying anatomical MRI sequences that differentiate between two specific tumour types\u003csup\u003e10\u0026ndash;14\u003c/sup\u003e, thus limiting the generalizability and clinical utility of this approach. Dynamic susceptibility contrast perfusion-weighted imaging (DSC-PWI) is a quantitative MRI technique that enables the visualisation of vascular characteristics including vascular density and permeability, thereby providing useful information for differential diagnosis\u003csup\u003e10,15,16\u003c/sup\u003e. DSC-PWI consists of a temporal T2*-weighted acquisition during the administration of a vascular contrast bolus. The contrast agent causes an initial decrease in the T2*-weighted signal intensity, followed by the signal recovery during washout. In DSC-PWI every voxel in the image yields a unique time-intensity curve (TIC) that describes the temporal evolution of the T2*-weighted signal intensity, and reflects local tissue vascular properties.\u003c/p\u003e \u003cp\u003eThe standard approach to analyse TICs is to derive metrics such as the relative cerebral blood volume (rCBV) and the percentage of signal recovery (PSR). The rCBV relates to the tumour vascular density with respect to normal tissue and the PSR reflects the vascular permeability\u003csup\u003e17\u003c/sup\u003e. Both parameters remain the main focus of DSC-PWI analyses for tasks like tumour grade stratification, differentiation status and treatment response\u003csup\u003e10,18\u003c/sup\u003e. However, the performance of these parameters differs greatly among diverse clinically-used DSC-PWI protocols\u003csup\u003e17,19,20\u003c/sup\u003e, which limits its use in routine clinical practice. This issue is exacerbated by a lack of standardised DSC-PWI workflows including contrast preload settings, imaging parameters, leakage correction and patient-specific conditions, all of which pose additional challenges to the generalizability of the technique and the establishment of reference rCBV/PSR values.\u003c/p\u003e \u003cp\u003eVoxel-by-voxel analyses of the full TICs can overcome these limitations and unlock the potential of DSC-PWI as a tool for differential diagnosis among the most common brain malignancies (GBM, brain metastasis and PCNSL). To test this, we developed and validated an innovative, comprehensive framework for differential diagnosis of GBM, brain metastasis and PCNSL, taking advantage of the full TIC DSC-PWI data. The developed Brain Enhancing Region Radiological analYsis (BERRY) app provides voxel-by-voxel signatures of tumour type and is based on training 1D deep convolutional neural networks (CNNs) with only a small number of pilot scans for a given DSC-PWI protocol. In the current study, we demonstrate the feasibility and accuracy of the method and show its superior performance compared to classifiers based on conventional rCBV and PSR metrics. We further designed a user-friendly interface to evaluate the potential of BERRY to minimise the use of invasive brain biopsies, and guide selection of the best treatment strategies in clinical practice.\u003c/p\u003e"},{"header":"Results","content":"\u003cdiv id=\"Sec3\" class=\"Section2\"\u003e \u003ch2\u003eCohort and clinical characteristics\u003c/h2\u003e \u003cp\u003eIn this multi-center, retrospective study we analysed MRI data from patients with biopsy-confirmed GBM, brain metastasis or PCNSL. A total of 568 patients from three institutions (Bellvitge University Hospital, Spain; UC San Diego Health Center, USA; HT Medica Jaen, Spain) were included in the study. Eligibility criteria included: i) histologically confirmed diagnosis of GBM, brain metastasis or PCNSL, ii) diagnostic MR scan on 1.5T or 3T including DSC-PWI and contrast-enhanced T1-weighted imaging (CE-T1WI) acquired prior to any oncological treatment and iii) a minimum of 10 mm of diameter of enhancing tumour in the CE-T1WI. Four hundred and forty patients (45 for PCNSL, 95 for metastasis and 300 for GBM) diagnosed from 2007 to 2020 at Bellvitge University Hospital (Spain) with MRI available were included in the development cohort after image quality inspection and exclusion (Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003ea). Additional independent cohorts were included and processed for external validation: a) 80 patients from UC San Diego Health Center (USA) and HT Medica Jaen (Spain), b) 25 patients from Bellvitge University Hospital (Spain), acquired at magnet strength of 3T and c) 23 patients from the IvyGAP\u003csup\u003e21\u003c/sup\u003e open database of patients with GBM and MRI scan with pre-bolus contrast administration, to account for the effect of different DSC-PWI protocols in the tool performance. Further information about the study cohorts and classification results can be found in Appendix A. Patient demographics and clinical characteristics per groups are shown in Supplementary Table S1. No statistically significant differences (p\u0026thinsp;\u0026gt;\u0026thinsp;0.05) in terms of age and sex were observed between the three tumour types.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003c/div\u003e\n\u003ch3\u003eDevelopment Of A Cnn For Brain Tumour Classification\u003c/h3\u003e\n\u003cp\u003eWe trained our CNN classifier on a development cohort where patients were randomly split into training and test sets. For the training set, we included 20 patients with PCNSL and 20 non-PCNSL (10 with GBM and 10 with metastasis). This provides a comparable number of voxels for each tumour type and each binary classification (i.e., PCSNL vs non-PCNSL; GBM vs metastasis for the non-PCNSL cases). The test set consisted of 25 patients with PCNSL, 85 with metastasis and 290 with GBM (Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e). Approximately 50,000 TICs from voxels of the enhancing region in the training group were used to train the classifier. Each TIC corresponds to a specific spatial voxel of the enhancing tumour.\u003c/p\u003e\n\u003ch3\u003eBerry Outperforms Standard Classifiers For Brain Tumour Diagnosis\u003c/h3\u003e\n\u003cp\u003eFollowing a hierarchical classification approach, our CNN method, BERRY, successfully achieved three-way tumoral classification, outperforming the traditional perfusion metrics (i.e., rCBV and PSR) and standing out from simpler binary classifiers. Specifically, for the task of PCNSL diagnosis, BERRY achieved superior performance with an accuracy of 0.94 (CI: 0.93\u0026ndash;0.94); while mean rCBV and mean PSR classified patients with accuracies of 0.72 (CI: 0.70\u0026ndash;0.74) and 0.84 (CI: 0.83\u0026ndash;0.85), respectively. In a second step, patients not classified as PCNSL were categorised as GBM or brain metastasis. BERRY differentiated GBM from metastases with an accuracy of 0.81 (CI: 0.79\u0026ndash;0.82). By contrast, the performance of standard DSC-derived metrics was markedly lower: rCBV classification achieved an accuracy of 0.69 (CI: 0.67\u0026ndash;0.71) and mean PSR of 0.65 (CI: 0.63\u0026ndash;0.67). In Fig.\u0026nbsp;\u003cspan refid=\"Fig2\" class=\"InternalRef\"\u003e2\u003c/span\u003e the area under the receiver-operating characteristic (ROC) curves of the binary classifiers and 3-way average ROC curves are shown for both the BERRY classifier and conventional rCBV/PSR. Lastly, we mimicked a real-world clinical scenario in which our diagnostic support system is confronted with \u003cem\u003ea priori\u003c/em\u003e agnostic brain lesions comprised by the three most common conditions, in this case represented by our blinded test dataset. In this setting, BERRY achieved an accuracy of 0.78 (CI: 0.76\u0026ndash;0.79), which is substantially better than the three-way accuracy achieved using mean rCBV (0.59, CI: 0.57\u0026ndash;0.60) and mean PSR (0.55, CI: 0.53\u0026ndash;0.56). Furthermore, the combination of rCBV and PSR into a logistic regression model also yielded poor performance (Supplementary Table S3). Additional sensitivity and specificity values can be found in Supplementary Table S2. These data underscore the potential of BERRY for differentiating among the three most common clinical diagnostic challenges in patients with enhancing brain lesions.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e\n\u003ch3\u003eVoxel-wise Explainable Representation Of The Cnn Decision Process\u003c/h3\u003e\n\u003cp\u003eBERRY provides spatial probability maps of tumour classification, which are then used to obtain a voxel proportion and a patient classification label. In Fig.\u0026nbsp;\u003cspan refid=\"Fig2\" class=\"InternalRef\"\u003e2\u003c/span\u003eA we present three examples per tumour type of the voxel-wise probability maps according to the BERRY classifier. The probability maps are shown overlaid onto the CE-T1W MRI for anatomical references. Overall, the tumour type probability maps are smooth and identify the tumour type with high confidence in most voxels, even when intra-tumour signal heterogeneity is seen in the contrast enhanced T1W scan. Voxels exhibiting a high probability of belonging to the incorrect tumour class tend to be located either in the boundary of the enhancing area, or around necrotic intra-tumoral spots. This potentially reflects partial volume (i.e., inclusion of signal from tumour and non-tumour areas within a voxel), or intra-tumoral heterogeneity. Voxel-wise classification allows for computing spatial distribution of the predictions within a tumour yielding relevant information about the prediction consistency and also about potential tumour heterogeneity, useful to guide interventions and for tumour spatial characterization.\u003c/p\u003e\n\u003ch3\u003eVisual Interpretation Of The Cnn Classification\u003c/h3\u003e\n\u003cp\u003eWe further sought to implement Class Activation Mapping (CAM) to provide visual explanation of the BERRY classification network. The ScoreCAM\u003csup\u003e22\u003c/sup\u003e method yields a normalised score of the contribution of every input to the final classification of a CNN. This allows us to identify the most discriminative timepoints for TIC differentiation. ScoreCAM spatial maps were obtained for each binary classification (Fig.\u0026nbsp;\u003cspan refid=\"Fig3\" class=\"InternalRef\"\u003e3\u003c/span\u003eA). The CNN mostly focuses on the bolus passage to classify the central tumour region (middle row for PCNSL vs non-PCNSL and lower row for GBM vs metastasis differentiation in Fig.\u0026nbsp;\u003cspan refid=\"Fig3\" class=\"InternalRef\"\u003e3\u003c/span\u003eA). In contrast, the bolus passage seems less important for some voxels in surrounding regions. This suggests that the CNN effectively considered the bolus passage as a discerning characteristic, but also that it provides additional tissue perfusion differences compared to the raw DSC-PWI signal (top row in Fig.\u0026nbsp;\u003cspan refid=\"Fig3\" class=\"InternalRef\"\u003e3\u003c/span\u003eA).\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003eThe average ScoreCAM values per tumour type and per CNN classifier can be found in Fig.\u0026nbsp;\u003cspan refid=\"Fig3\" class=\"InternalRef\"\u003e3\u003c/span\u003eB (upper row for PCNSL vs non-PCNSL and lower row for GBM vs metastasis differentiation). Overall, the sharper signal changes of the TICs, i.e., steep slopes during contrast arrival and washout, have a higher contribution score. This is especially true for GBM, with greater differences in these timepoints with respect to the other two tumour types (average TICs shown in black in Fig.\u0026nbsp;\u003cspan refid=\"Fig3\" class=\"InternalRef\"\u003e3\u003c/span\u003eB). For PCNSL and metastasis, the last part of the signal is also considered important, which can be expected given the overall higher signal magnitude reached in these cases. Importantly, applying 1D CNNs over TIC signals allows to analyse the local changes of the signal over time. In this regard, methods that only consider the signal magnitude of specific timepoints, such as PSR, or a derived measurement like rCBV, may overlook local TIC changes occurring over time that reflect specific physiological traits of the tumour.\u003c/p\u003e\n\u003ch3\u003eA User-friendly Berry App\u003c/h3\u003e\n\u003cp\u003eThe BERRY app was successfully implemented at the participating institutions for validating the tool in external cohorts, as illustrated in Fig.\u0026nbsp;\u003cspan refid=\"Fig4\" class=\"InternalRef\"\u003e4\u003c/span\u003e. The tool requires approximately two minutes to process a new case and provides a classification outcome, in the form of i) voxel-wise tumour type probability maps, and ii) patient-wise tumour type. In addition, it shows the average TIC for the enhancing tumour and white matter, as well as a visualisation of the segmentation for the user to safely check the process. The mask can be automatically segmented from the enhancing tumour by BERRY or it can be provided by the user. The BERRY app provides a classification label with balanced sensitivity and specificity (Youden\u0026rsquo;s index) by default, but a given clinical scenario may require a different classification threshold. To that end, sensitivities and specificities for every threshold are displayed, and the default settings can be changed.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e"},{"header":"Discussion","content":"\u003cp\u003eWe present a novel voxel-wise method for analysing perfusion scans with CNNs and improve brain cancer diagnosis, built upon prior DSC-PWI signal normalization\u003csup\u003e23\u003c/sup\u003e. By applying this method, we were able to surpass the performance of previous models for non-invasive differential diagnosis of the most frequent malignant brain tumours (i.e., GBM, metastasis and PCNSL, representing up to 70% of all malignant tumours in the brain\u003csup\u003e6\u003c/sup\u003e), which is critical to define an optimal treatment approach.\u003c/p\u003e \u003cp\u003eOur deep learning framework takes advantage of the large amount of information provided by the thousands of voxel-wise TICs available in each individual DSC-PWI scan\u003csup\u003e24\u003c/sup\u003e, and achieves optimal performance through training with a limited number of scans from a few patients at fixed DSC protocol (on the order of 30\u0026ndash;40 cases). Our approach is particularly appealing for medical imaging applications, where the design of robust deep learning methods is challenged by the limited number of scans available. Additionally, our method distinguishes between tumour types in a three-way classification task. This can be of particular relevance as a support tool for differential diagnosis in clinical practice, and is a considerable step forward as compared to current literature, which is dominated by binary classification studies\u003csup\u003e10\u0026ndash;14\u003c/sup\u003e. This is particularly important when PCNSL is considered among the potential diagnoses. Corticosteroids are usually the first treatment of choice to reduce the neurological symptoms secondary to oedema in patients with malignant brain tumours. However, early stereotactic biopsy prior to corticosteroids administration is mandatory when a brain PCNSL is suspected by imaging, as medication with steroids can alter the histological pattern of PCNSL\u003csup\u003e5\u003c/sup\u003e. Moreover, PCNSL is highly sensitive to chemoradiotherapy instead of resection, which is contraindicated, as opposed to GBM or metastasis. Therefore, a reliable characterization of the tumour type by imaging is critical to devise the appropriate management of patients.\u003c/p\u003e \u003cp\u003eThe BERRY app provides voxel-wise tumour type probability maps, which are then used to obtain a voxel proportion and a patient classification label. The default Youden\u0026rsquo;s index (trade-off between sensitivity and specificity) can be changed to the needs of different clinical scenarios. For instance, some clinical scenarios may require a very high specificity for suspected GBM and metastases with respect to PCNSL and, if all evidence supports it, an additional intervention for a biopsy could be prevented. Therefore, the voxel proportion can be adjusted in the app to match the user\u0026rsquo;s needs.\u003c/p\u003e \u003cp\u003eThe presented method successfully achieved three-way tumoral classification, outperforming the traditional perfusion metrics and standing out from simpler binary classifiers. When tested, our method performed with accuracies of 0.94 for PCNSL identification, 0.81 for differentiation of GBM from metastasis and 0.78 for three-way classification.\u003c/p\u003e \u003cp\u003eOf note, the DSC protocol used for model development did not include contrast preload. Contrast preload is a common approach described in the literature to achieve a better estimate of the rCBV\u003csup\u003e20\u003c/sup\u003e. However, preload can be undesirable for a number of reasons. Firstly, it delivers a higher contrast dose to the patient. Secondly, it can introduce potential variability sources, affecting the TIC signal morphology. As countermeasures, leakage correction and acquisition parameters that minimise T1 effect, such as low flip angle, have been shown to effectively yield reliable rCBV estimates without preload\u003csup\u003e20,25\u003c/sup\u003e. In this study, rCBV was estimated with leakage correction, obtaining comparable results to those of PSR. The combination of both rCBV and PSR in logistic regression was explored for completeness, but it did not improve the results of the individual parameters.\u003c/p\u003e \u003cp\u003eA key feature of our CNN approach is the computation of voxel-wise spatial representations of perfusion curve characteristics, in the form of maps describing the probability of a voxel to belong to a specific tumour type. Such spatial probability maps provide an explainable representation of the CNN decision process and may enable further studies of intra-tumour heterogeneity, making them an appealing tool for integrative multi-omics research and also of potential clinical interest to plan surgical procedures. To our knowledge, this is one of the first studies applying deep learning to voxel-wise DSC TICs in neuro-oncological applications. A recent study\u003csup\u003e26\u003c/sup\u003e used a deep autoencoder to derive a set of five descriptors of TICs that could differentiate between pairs of tumour types. However, the reconstructed timepoints from such a minimal set of descriptors, in contrast to the original signal, produce a smooth TIC morphology, which may be omitting relevant details for diagnostic applications.\u003c/p\u003e \u003cp\u003eWe acknowledge that our model trained with DSC-PWI data without preload from 1.5T scanners can be a potential limitation. As discussed, preload can change the TIC morphology and it is possible that the performance of our model is hindered when deployed in preloaded data. Nevertheless, tests on all eligible external 3T scans with contrast preload of 23 patients with GBM from the IvyGAP\u003csup\u003e21\u003c/sup\u003e dataset yielded 18 cases correctly classified as GBM (0.78 accuracy). Of note, internal centre tests on 3T scans (n\u0026thinsp;=\u0026thinsp;25) resulted in 0.72 accuracy, showing an overall agreement in performance with mixed scans from external centres (n\u0026thinsp;=\u0026thinsp;80) reaching 0.71 of accuracy. The results show that, albeit training on a small cohort, our method notably generalises in external populations, in contrast to reported conventional metrics. Importantly, the proposed method could accommodate different DSC-PWI protocols by training the models with just a few new imaging samples.\u003c/p\u003e \u003cp\u003eRegarding the segmented regions of interest, we used the automatic segmented masks revised by an experienced neuroradiologist as reference, but the variability in the segmentations from different neuroradiologists is to be explored. We believe that future segmentation methods could make the manual input minimal and it could be integrated in the proposed pipeline. To account for that in the online tool, the user can check the automatic segmentation obtained from thresholding and they can provide their own if needed. In the future, the algorithm could be adapted to include rich multi-parametric MRI protocols that include additional contrasts (e.g., diffusion MRI\u003csup\u003e27\u003c/sup\u003e), as these may provide orthogonal information on tumour microstructure that could improve the classification performance even further. Nevertheless, we proposed here a user-friendly tool that can be applied with just two MRI sequences (CE-T1WI for determining the area of interest and DSC-PWI for classification). BERRY allows for classifying the three most common enhancing brain tumours (i.e., GBM, metastases and PCNSL). Furthermore, the developed framework will allow expanding its use by training the model with a few cases of other less common tumours such as anaplastic astrocytoma and extra-axial tumours such as meningioma in the future.\u003c/p\u003e \u003cp\u003eIn conclusion, the presented CNN framework for three-class brain tumour classification based on voxel-wise DSC-PWI signal analysis is feasible and outperforms classifiers built on conventional rCBV and PSR metrics. The method can be trained using a limited number of scans, which most centres are likely to have available, with notable generalisation to external data. Additionally, it provides voxel-wise maps of tumour type signatures that could be useful to visualise the CNN classification process, and for tumour spatial characterization. As a way to make this tool more accessible and eventually make an impact in clinical practice, the proposed method has been implemented on the user-friendly BERRY application that is made freely accessible at \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://berry-app.vhio.org\u003c/span\u003e\u003cspan address=\"https://berry-app.vhio.org\" targettype=\"URL\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e, in order to enhance study reproducibility and accelerate its adoption in future clinical studies.\u003c/p\u003e"},{"header":"Methods","content":"\u003cp\u003eThe research ethics committee of Bellvitge University Hospital (Barcelona, Spain) approved the study and informed consent was waived. The confidential data from patients were anonymized and protected in accordance with national and European regulations.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eStatistical analysis of patient characteristic distribution\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eStatistical tests were performed to compare: (i) patient age distribution between training and test sets of each tumour type (Welch\u0026rsquo;s t-test), as well as among tumour types (one-way ANOVA); (ii) patient sex distribution between training and test sets of each tumour type (Fisher\u0026rsquo;s exact test), as well as among tumour types (Chi-square test). Relations shown in Supplementary Table S1.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eData pre-processing\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThe MRI scans were performed in 1.5T Philips scanners (219 on Ingenia and 221 on Intera). The DSC-PWI acquisition parameters were: temporal sampling of 1.26-1.93 seconds, 40-60 timepoints, acquired during a bolus administration of gadolinium contrast agent (gadobutrol 0.1 mmol/kg) without contrast preload (more details in Appendix B of the Supplementary Material).\u0026nbsp;\u003c/p\u003e\n\u003cp\u003eThe DSC-PWI dynamic sequence was motion-corrected by rigid registration of all DSC volumes. Bias field correction\u003csup\u003e28\u003c/sup\u003e was applied to the CE-T1WI, which was rigidly registered to the DSC-PWI. Brain region masking was obtained on the CE-T1WI using a hierarchical approach\u003csup\u003e29\u003c/sup\u003e. Segmentations of the enhancing tumour and contralateral normal-appearing white matter were first obtained by simple thresholding and afterwards revised by an experienced neuroradiologist (APE). The TICs reflecting the bolus passage in every voxel of the DSC-PWI sequence were extracted for the enhancing tumour and normal white matter regions. According to a previously presented normalisation method\u003csup\u003e23\u003c/sup\u003e, TICs from the enhancing tumour were normalised to the white matter. The minimum peak point of the TICs was retrieved, the curves were aligned to this point and TICs with points within the average plus and minus standard deviation were used for training the CNNs. Slicer\u003csup\u003e30\u003c/sup\u003e (www.slicer.org) and Python 3.8 were used for segmentation, processing, training, inference and statistical tests.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eCNN architecture\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eA CNN was designed with three 1D convolutional layers with kernel sizes [3,5,7], followed by a 10% dropout layer and max pooling layer (pool size 2), then concatenated into a dense layer with 100 nodes of rectified linear units and a final binary output layer with softmax activation, cross-entropy loss function and Adam optimizer. The CNN was built using Tensorflow v2 with Keras frontend. The CNN classifier receives a given TIC as input and outputs a binary probability.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eClassification scheme\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eBy applying the CNN classifier voxel-by-voxel, a probability map is obtained over the enhancing tumour region. These voxel-wise probabilities are then converted into a patient-wise classification as:\u0026nbsp;\u003c/p\u003e\n\u003cp\u003e\u003cimg src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAy0AAAByCAYAAABeID65AAAgAElEQVR4nO3d3Y8b1f0/8Ld/6i2F8eaKAop2HAkEKIh4WQQBKUiN3YBQK2jt8O0FEhGJlwop0CapN6iq8kC8gZsKdm1EJC4KaxcqEGLNeiMRCRvEJg6yFaIiwVgoSnPlyfLwB5zfxfZzdmY844fNPsyS90taKfE8nXmyz2fmnM+JKKUUiIiIiIiIQur/rXcBiIiIiIiIumHQQkREREREocaghYiIiIiIQo1BCxERERERhRqDFiIiIiIiCjUGLUREREREFGoMWoiIiIiIKNQYtBARERERUagxaCEiIiIiolBj0EJERERERKHGoIWIiIiIiEKNQQsREREREYUagxYiIiIiIgo1Bi1ERERERBRqDFqIiIiIiCjUGLQQEREREVGoMWghIiIiIqJQY9BCREREREShxqCFiIiIiIhCjUELERERERGFGoMWIiIiIiIKNQYtRESk1Wo1jIyMIBKJYGRkBLZt62kTExOIRqOIRCIYGxtzTSMiIlpNDFqIiAgAUCwW8dprr2F2dhaJRAL1eh3vvfcebNvGyMgIDh48iIWFBQDA1NQU3nvvvXUuMRERXS8YtBAREQDggw8+wOuvv46hoSEMDw8DAG699Va89NJLAADLstBut2GaJgDg/fffX7eyEhHR9YVBCxERAVh80zI0NAQAaLVaAIDPPvsM586dw7lz5zA8PIyhoSE8++yzAICbbrpp3cpKRETXl1+sdwGIiCh8KpUKgMVmYN98841r2pdffgkAuPfee9e8XEREdH3imxYiInJpNpv635OTk/rti6jX6wCABx54YE3LdS1qtRqSySQikYhOJOAVjUYRi8X6WpesJxKJrEZxiYjIg0ELERG5fPHFFwAAwzCQTqdd01qtFizLAgBs3759zcu2HOVyGQ899BCefvppKKWQSCSwefNm1zzNZhMLCwuIx+M917d9+3Y0Gg0AQCKRWJUyU6dyuYxYLIZarbbeRSGidcDmYURE5CJvWnbu3Nkx7ezZswA2VmX9+eefRzwe1wHY7Oxsxzxbt26FUqrvdd5www0AgG3btq1MIQcQjUaRyWRw7NixvpdJp9OwLAvnzp1bxZKtjlqthqNHj+omi0R0feKbFiIicpmbmwPg32flgw8+AAA88sgja1qm5SqXy7AsC7///e9XdL1XrlwBADz44IMrut5eCoUCFhYWBtpus9lEqVTyDULDrlAoYP/+/Xj++eeRyWTWuzhEtI4YtBARkWbbtm7+5ddnRQKau+66q+t6yuWyqw9JNBpFsVjs2NbExARisZieZ3x83DVPs9nU65F+KM7PYrGYqw+OUzKZxB//+EcAwMGDB/X8Xs7+KX4DZtq2jfHxcT2wZiwWw/79+wEAt99+e+D+p9Npvd6RkRFXOWWgzmg0qj93Dt7pPQ7SJ2ffvn0AgEcffVSvO2j/bdtGMpnEjh07AADHjx/XyxQKhY5jmUwmXctPTEz0NX+/56PXMfHz61//GufOncOuXbs6mvQR0XVGERER/U+1WlUAVNDPg0xrNBpKKaXy+byamZlxzZPJZBQAlc/nlVJKzczMKACu+RqNhjJNU8XjcVWtVl3zZbNZpZRSlmWpeDyuLMtS2WxWbzebzap2u63nz+VygfuTSqUUANVutwPnabfbCoCKx+O+0+LxuDIMo6Ocpmn6ri+TySjDMPT+NxoNBUBlMhk9PZ/P6+3mcjmVzWb1+uPxeODxNwzDt5zddDsGpmmqdrutj+/09LTvso1GQ1mWpRKJROD5kP30K1+vY9KPXC6nAOjjRETXFwYtRESkScUwkUj4TpegpVqtqunpaRWPx12VYVleKqfO5SzL0v+XQMD5mVKLlWjDMDq2K5VnZyVXAqxuQYtpmoHBhbAsyxUsOSUSCVeQ5tyfVCrVMb/svzNAk/V7K+hScTcMw7V+2aaXzO9Xzm76CXSCgohUKuV7LUhg6i2LaZodZR/kmHTDoIXo+sbmYUREpH3yyScAgjuY5/N5AMDjjz+OCxcuYHZ2VqdEtm0bBw8eRDwex969e13LKaUwPDwMYHEQy3q9jkwmoz9zWlhY6PisXq/DMAwcOXJEf3bx4kUAwG233eZbVsl01isjmCQXuPvuu12fl8tlVCoVZDIZbN26VX8uTZqk2ZWwbRsnTpxAIpHArl270Gw2USwWsXPnThiGgT//+c+u+f/zn/8AAA4dOuRa/9mzZ2GaZkc5JavboP1ZFhYWevZnke07O+rbto1SqYTDhw93zH/u3DkYhoEXXnjB9fnVq1dd/x/0mBARBWH2MCIi0vwyaznt3bu3IyARp0+fBgDs2bOn6zqkM/9vfvMb1+fSn8ZbYZfgI5VKucaMOXPmDADgvvvu893O119/DaD3IJiffvqp73o++ugjAMBTTz3l+lyChzvvvNP1+enTp7GwsIBKpYJIJALTNBGLxfCXv/wFTz75ZMd4N7JdZyY2CTK8qaaBpf0dHR3tuj9+Ze0n0EkkEq4MXadOnUIikehIbW3btg46nftk23ZH2uhBjwkRURAGLUREtCIuXboEoLMy7/X9998D6BznRYIe71sBeRPifbNRKpVgmqbv2xoA+OyzzwD0HgRzbm7Odz2tVsu3nG+++abv57L/1Wq1rzFs5ubmYBiG6y2LBA0PP/xwYDkHqehLoBOUMMBp27ZtqFQqaLVauPHGG3HixAk9kKiTvCFylhtYOn/OTG2DHhMioiBsHhYSrVbLlcEmGo2ud5GIiFZEs9n0zcrlZNs2Dh8+7NtkSN5I3H///fozGWBQAhy/9Z8/fx5A90Ew5e1OP4NKAospeC3LGmicmlarhXK53PGZZVkdAZo0z5O3PrJf8hbDmf1MgqpuJBOcBGS2bQeeC2ked+XKFTz33HM4dOiQb0D4+eefA3AHp87z98wzz/Qsl98xIVotxWIRIyMj13zNlctljIyMdGRCpLXBoCUkhoeH0W639Q9nUHMHCq9araaDzn4qE0Q/N/JG47XXXgOwWJEtFArYsWMHLl++rOd7+umnASym1AUWK7D/93//B8uyMDk52VFRln4W3if7ALB582Y0m02Mjo52VMYrlUrPYETeGpimiVarhWQyqdfj7IMj+3LjjTciGo3qyn86ndYBlHP/ZR3FYhHxeBw//vija7u9mq4NDw9jbGwMp06dcn0u263Vati5c2ff3zWtVkvv3/z8vO88t9xyCwDg6NGjsCwLBw4c8J1PAisJXmS9V69exZkzZ1xvggY5Jr3K/+677wIAPv74455BMBGw+Lsci8UwNjaGF198sWfTynK5jGg0qu9pr9HRUbz44osYGxtDLBYLnI9WyXpnAiA3yRrTLRsOhVM+n++aBpXoepDL5ZRhGPpeyGQyvql2c7mczjRlGIbKZDIdmcSUWkpH7M1gJamI8b8sXt5lJbNYP9mp5Hs3kUi4sni12209zTRNnf1K0v06PxPT09N97Zesw5sJa3p6Wq/bm4FNlgnaZz/T09P6fDjTSweBTzazoHnk+MtxDipPv8fEjzMFt98fURC5l7wZDv1YlqUzFPrdl17O7x9vmnBaPbzjQ0a+2L0/hLQ+pMLUTyAiKUD90qAS0dqShwisUPRP0h53O2YyDx+sUZg5xwzqFbDk83kd2PcbtCjlDly6Bfm0ctg8LEScI1EPkh2GVo80zeiVLhQAJicnoZRiW1eiEHj//fcBLI6oTv6KxSLGx8ddzfimp6d9M5cJyUbWK7kB0Xp64oknACwmzQhKXCHNGk+ePInJyUnkcrmBtjE0NKSTcsj2aHUxaAkRaWc8aHYYWh3lchknTpwA4J/Jh4jCqVgsolKpIJfL8bu0i0uXLuH48ePYtGkT9u3bh8nJya4BC7CUjWyQ/ihEa6lYLMKyrI7xlbzOnj2Lbdu2YX5+Hul0elmB+NatW5HJZGBZFh9YroENEbQUCgXEYjFEIhEUCgXXNNu2MTY2hkgkglgsFtgpsVarIZ1OIxqN6s7S6XRaDxLmJRF40HqbzaYuU9CF2mq1MD4+rueLRCIYGRkJ3Kak5+w3i41sI51O64xjznWXy2W97WQy2bFd27YxPj6uj4lzP2q1mt7/SCQS2NlskONaq9UwMjKij4OzI+XExIRex9jYWNdOlrZtY2JiQq9LzpF06r3WfSwWi4hEInj00Uf1IHe7d+92ZXdzXg/Oz52Zffy0Wi3dgc95TfhlNLmWc0t0vYpEIjh8+DByuVxgR3Ja9OWXXwJY/M2pVqs9AxYAOgXyo48+yk7IFEoyGOpjjz3Wdb50Oo1jx45d84MN2Y7fIKy0wta7fVov0k9A/pydMZ3tCeXPr52ts6+BdP6rVqvKMAxlGEZHh8B2u61M01SNRkO3i3Z25mw0Gq72j35tH6XzYzwe120dZV2GYfjuq3T49Ha+DNJoNFQ8HleWZalcLufqT+E9bvD0y5BjV61W1czMjKtc0nnN+efXJnSQ4zo9Pa1SqZSrY2s+n/c9h97j7d1nWb+0u26327os2Wx2xfbR2YmvG7lenMffj3N9cs1YlqX339mPadBzu5x+NHIelvvHNu1ERBQm0pdlOdVbZ9KHfvq0OMly7NuyukIdtGSz2Y6KmzNoSaVSOjONBATeipRkW/Gr1Mk0bwU5n8+7KsTOyq5UUCX7id+N0S1jRbcLe9CbJZvN6vXINrPZrMrn866KsRw757pnZmZ0cCQ3qixjGIaeLx6P+1baBz2uErAotVTpnpmZUalUSgc97Xbblb3Dy7IsHSx6j5+cJwA6WFqpfRwk+1BQRV6CJtM0O64J5zTntv3OrQTDUvZux6vfMjNoISKinwOpC3qzDfbjWoKWQR860/KEOmhpNBq6gud92qzU4gUm06Vi56zMOi9Av/SKss5emaHkSbhlWTqQCspGIYGM3xscmeZXwXSWdTlkXzKZjG/FWNbtd0M5K/Tyhqmbaz2ucnNnMpmOoMe5bm85nMv5keX8Mt8Muo/O7fWTfUiCKb8vuna7rad3K1uv4ynn1jmPLBv09o6IiOh6IQ/y+nnY6HUtQQuzh66NXyDEnB2ovvvuOwDugbicoxxfuHABpmm6ljl69CgAIJPJ+I7qKyRjV5CRkRHU63WcOnUKU1NTqNfrgW0gs9ls4DZfeeUV1zxOFy9eBICBRll2ksG+pqam0Gg0Asv3ww8/dHwmA4TV63Xk8/muHdeAaz+ulUoFADA3Nxc4yBkA/PTTT/rftVpNL+cdLdvr0qVLHZ8Nuo/Oct5xxx1d52s2m7rvi9/I26dOncLCwgJM0+zZZvzKlSsdx9R5bqvVqmu6XDdhHow0EomsdxGIiCgklFKrtu7vv/8ewOKgs2tJtifbp9UR6qDFSTo+33XXXb7Tp6amMDk5qf9v27audPbqjGWaZtfpUsE9fvw4ZmZmAivqtm2jVCoBAP7whz8AWKxsX7x4ESdPnoRlWchms3jhhRc6lpWMLNu2betaliBnz54FgJ7ZMvyOn7Mz5t69e7tu51qPq7PD+NGjR7t2gHMGCx9//LEuY7dACQBuu+22js8G2UcAuoOpYRg9AxwZUTsogYKM4pxKpXpu9+abb+74zHluvUGRHM9HHnmk57qJiIiINqoNE7RIRfmXv/xlxzTJPOV8iu18gh805olUZHtlfLr11lsBLL4F2bVrV+B8p0+f1v++5557ACxWZIeGhvDss8/iySefDKxwz83NAQDuvvvurmXx02q19JN+vwq5M9PVr371q8Bt79mzp+e2rvW4SgXfMAzftw6XL1/W050BjZQxaLwUZzB0yy23dEwfZB+BpTcY/YzP8umnnwJYfCPnZdu2zrbz4IMPdt0WgI7rw/kWx+/cyn6FecyE1XyqRkRERNeHDRG0ONPf+j1pPnHiBD788EPX51999RWA7mOeSIXvd7/7XddtP//88wCWAqcg0iwpkUhgdna267xOzqBjOc185Em8t3mc+PrrrwOnO7d9//3399zWtR5XqeAHNZO6cOGC73Sp+AcFdTLgmWEYHdfIoPsILL35cjZHDCL76zeWiwRpAHD77bd33ZbfmxhnkOd37qQJnl+ztF6SyWTPa7obppQlIiKitbIhxmlxVtycbNvGE0884dtsRgS9RanVaroi223E5Oeeew7xeFz3NVmN8TAk6DAMo2fTJz9S0Q9qnvTRRx8BAJ599tmu2+6nn4dY7nE9d+4cAARuS5rXPfXUU77T/d6iAEujX/sFQ8vZRwmSgpojCtu2deDQq++L37m1bVsHPb/97W87pkuQ5xfMypu95faDIiIiItooNkTQIiPvOituzWYTo6OjiMViOHbs2MDrfOeddwB070xeKBQwNzeH119/XfcZkCf6y1EsFpFMJjs+lzc0y+1Mff78eQD+bwVarRampqZgGAaeeeaZjukS8KxUR+5ex1WCgTvvvLNjmoxim0gkBnpz0Gq1unbSX84+SiDibI7YbDY7zp/zTcogQZ84ffp01076EuT59Vm51n5Qs7OzUIsZBJf1x7csREQUJjfddBOApeRNa0W2J9un1bEhghZpkmTbth4NfceOHTAMA2+//bbvMvL0WZ6yO9VqNV2RP3LkiGtaOp1GoVBAsVjEvn378OGHH2JoaEg/cZeKIrDYvMbZdE3mqVQqKBQKru2l02ns3r0bTz/9dEd5JDuUVExt2/YNboJ0a+IzNjYGAJicnPRtziUBT78duZd7XGV6ENu2MTY2BsMwkMvlOqZL0yln/w8h+5jL5XwDpUH30UmCsFqthh07dnSsX8rjfMuVTqd1P6Lt27frN4Tet3SyzwDw1ltv+W5fgjy/PiuSpUQSDzSbTYyPjw+wd0REROGWTCYRiUT6qhft2LEDgLsv71qQ7cn2aZWseZLlZZDB95x/MqhkN85xPZzjuRiGEThWh4xsDs/gec5BJmUwS7884H6ju6PL+CFKLeX3lnLG4/G+xgZRyp1X3DmGR6PR6GucESwjJ/lyjqtS7kEunYNNzszMKNM0lWEYgcs6xyNxjiYvOdmz2eyq7KPzz2+wKu/AkJlMpuO6kP2WgVJlf+LxuDIMI/D89Bq7xzmgZaPR6Hv8GSIioo1Cfuv6GTCy0Wgsa8y7RqPhqr8lEomBfk9lOf4Gr64NEbTIKPRS2e238tlut1Uul3MFIvF4XOVyucCAR+bzqwTLAJaGYQSOBt5ut1Umk9GDCRqGoTKZjO+ggcKyLF3GQW8U5+iv3u2mUqmu63JWinsFgN59HPS4KuUe9Mk5krtpmn0FodVq1bWc7GO362G5++j8Aut2vpVa+kI1TVPNzMz4zjM9Pe36QpR97nZdOIOdoH2T851Kpbqui4iIaCMaJGhRaunhc9DvsVPQQ+ZeDyydvA8vafVElGI+0o1sbGwMU1NTGyKTUywWg2VZqFary8p2RURERNRNsVjE7t27kUqlUCwWV3176XQapVIJ09PTPQeQpmuzIfq0ULCNME4HcO3peYmINpparYZIJIKJiYn1LgrRdSOdTsM0TZRKpa59aVdCs9lEqVQKTKZDK4tBywY2SLrd9SZjxQSlZSYiIiJaCf/+978BAPv373clTFpJtm3rAatle7S6GLRsYM50u0EDPYaFZIALezmJiIhoY9u6dSump6dRr9c7Mr2uBMnyWq/XMT09vawhD2hwDFo2sM8//3y9i9A3SetMREREtNrS6TSq1SoWFhawZcsWFIvFaw5ebNtGsVjEli1bsLCwgGq1ymZha4hBywbmDARisVjHOCBhImPJVCoVjIyMrHNpaD0UCgXEYjFEIhE9Pg2wNF5NJBJBNBpl+38iH61WC+l0Wt8nzu/7crms761kMhnq3wKitbR9+3bMz8/j5Zdfxquvvor5+flrWt/8/DxeffVVvPzyy5ifn2cf3TXG7GFEtOrGxsawefNmPPPMM/oJVaPRALA4GNfCwoJr/kajwdfttOHVajU89NBD15zdsdlsYs+ePSiVSnjvvfdw8OBBnRlJMkg6rVXWJCKitcQ3LUS0qmSk4AMHDmBoaAjRaBQAcMMNN2DPnj1Ip9Not9s6iAGW3swREfCvf/0Lb775JoaHh3HbbbcBAEzTRLFYRLFYRLVahVIKqVQKAFAqldazuEREq4JBCxGtquHhYUxOTur/S8a7U6dOYefOnZicnMTQ0BC2bt2KRCIBALjxxhvXpaxEYXTs2DH95vHSpUsAgIWFBRw+fBj1el03UfnTn/4EADAMY30KSkS0ihi0ENGacebMP3/+PI4dO+aafvbsWQDAnXfeuablIlquiYkJRCIR37+HHnoIAHDw4MHAeZLJ5EDbk76MU1NTeOuttzA8PKynXbx4EQBw3333rdDeERGFB4MWIlozUqkC4Hr7Aiw2I5O+LezcSORPAvtMJtNxn0gH/EceeWTNy0VEtNoYtBDRmjlz5gyAxY7CzifEwFJlTJqIbQS2bWN8fFxnbopEIroPjygUCohEIn11jE4mk3o9zKK2MRw4cABKKd+/arUKAMjlcoHzzM7O9r2tZrOpA/u9e/d2TJ+bmwMAPPDAAyuwZ+tDsqRFo1FEIhHEYrGOeXhPEV2fGLQQ0Zqp1+sAFjOGeX366acANtZT4mQyibm5OczPz+sKqjcYk0Dtjjvu6Lm+2dlZ3Zl6I1c8NxJJuT1oM631IAMKG4bRkV2v1Wrp/mIb9U1lq9VCPB5HNBrF1atXkcvlfIMW3lPhVCwWXQFnNBpFOp3ueJBDtFwMWohoTTgrVX59VuSp6UapWBSLRdTrdfz973/H0NAQtm/fDr8M8sViEUqpvlM4S3a1fipkK0meXg8y+Fqz2UQkEkG5XF7Fkq0O27YxMTGBLVu2dKQMDisJ7P36rJw+fRrAxnpT6fXKK69gYWEBR44cAbD4FsvvTdTP+Z5azjJhMDExgd27dyMajeKbb76BUgqHDh1CqVTCzp0717t49DPBoIWI1sTXX3+t/+3XFl+avax1xWK5Xn31VQDArl27VnS98rR5aGhoRdfbjW3bOHny5MDbffnllwEAo6Ojq1W0VWHbti7zhx9+uM6l6d+5c+cA+L+NlLcP27ZtW9MyrRTbtjE1NYVEIrHi1/5GuaeWex+GhWEYOHLkiC77gQMHYJqmflhFdK0YtBDRmvjqq68A+D8J/umnnwAs/ujJD97Y2FhHswJpyuPsQzIyMtKxvlqtpkcPl3m8o4RPTEwgGo26RheXzyKRCMbHx333o1gsYmRkRDd1k21429c7s0oFratWq2FkZETPl06nUalUfPdJFAqFjmXkqWyz2dRt+MfGxjo+i8ViHcdhbGwMo6OjsCwL9Xrdtd5eZZDxQDZt2qSbg/gdX++bGNlGr/n7OR/efkXRaDRwXjE0NIS5uTkcOHBgQzWlkmvO723k999/DwB6HJdms9nzOMh8ziY9Qcdarnu/6w5YujflfrNt2/VZNBoN7IMyPj6ug8hKpRLYP2w17qle189a3VO9lnEey1gs5jo2tVqtr/n7PR/LuacOHDiAq1evdgRbTL9NK0oREa2BRCKhAKhcLtcxrVqtKgDKMAzVbrdVJpNRmUzGNU+j0VCGYah4PK4sy1JKKRWPx1U8HnfNl81m9Xba7bZqt9sqkUgowzD0cplMRuXzedVut/W82WxWVatVvd5uX4+NRkMBUNlstus+S1lmZmY6pk1PTysAKpPJuMoJQE1PT3fM3263VTweV6Zp6nLm83k9v2VZ+tjIdhuNhspms6rdbquZmZnA4y/r8Svnco5BPp/Xxx+AMk3Td9lUKqWPU7fzkUqlfMsn10QikdDnVuaV//cDgEokEn3P3y+5rv2O+XLXFXRdOu+vRqOhTNNUjUaj6zr9rkHvOXXeP3JdWpal70URj8dVtVrV19nMzIzKZDLKsiy93m7HuN9rcCXvqV7Xz1rfU92WSaVSruPr/X6UZfP5vFJq8Xrodj5M01QAVLvdHuiYDKLf70mifjFoIaI1IRWuoB9x+WE0TVP/8Ip2u60Mw1Cmabp+ZHO5nOvHW36gvT+SUpnxrld+VA3DcFXwpKITRNbnVxFyymQyvhUDqYBKpd25P1Ix8vIGXt3KIcfSeWy6VaBlfm85u+m3UuZX4ZHjLkGJsCxLXwPOYyD76Sy7XBPeoFWO+c8taJFrw7u/zm0ZhqGvq177H3QNJhIJ1/UUFCTIcfZeq3JdxONx1/XU6xj3e95W6p4a9PpZi3uq32Xku9Apn8/rhz5Ocu8kEgnXNNlP5z24kveUPGTxBldE14JBCxGFXrenq05BTw/9Kr3dPverFDgFVdj8yuO3HnmT41cxMgyjY35v5aharapcLudbwZDteiswzrcyXkHr6abfCpZUGp3nLpvN+lZgg55cS9mdn8t6q9Wqarfbqlqt6vMy6JPdjRC0rDS5BrudPwki/a4Nv0pv0OcSpHarwMo128tK3VODXj9rcU/1u4w8VHGWJR6P+15n8t3pPU9y/zo/X8l7KpVKMWChFceghYhCr58KjVSM/Cqf8sPtrVz4BR/9VLB6NR9TaqnC512PfO5XTmmW4SXllL94PK5SqZRvZUnW733iHNTEY7lNOPqtYHkr7vI011uJUmrpPHnL6Be0SoAqf4lEQmUyGd/19rJaQUtYBV0jXn7BoggKEvzu1W6Ve6VUX83HnOVeiXtqkOtnLe6pQZZxBhdKLb1l8wtApUmp3+fewGel7im/5r1EK+EXICIKOcuyeqZylc78fpmVpMO4N1Xs3Nxcx5gXlUoFAPDwww/7bse2bdTr9Z7lkcEyveu5cuWKbznL5TIWFhZ8yy+dbpVPSuWg7XrHwimVSjBNs2McmS+++AIAcPfdd/dct5Bsb90SBgjJBvfdd98BAE6dOoV0Ou3bAf78+fMwDKOjjKVSCYZhuLKUyTUxyOCMtEiuwXvvvbfrfD/88AOAzo7/rVYL9Xq943qStOYyLop4//33AfinagaA+fl5AL3HaFrJe2qQ62ct7qlBlrnrrrsAAJcvX1U8kUUAAAWySURBVAYAHD16FJOTk74Zx+r1esf5kPPnzdS2EveUJCuYnJxc9jqIgjB7GBFtWLVarec8hUIBlmUhm836VrC8Ywh88sknAJYqWN7xEmSAv14VrAsXLgDoL4Wzbdv429/+BmCwcWpqtVpH5iIZy+P+++93zQdA76tzny5dugQAuOWWW/RnvQaD++9//wsA2Lx5c89lhoaGYJomWq0Wms0mTpw4ocfh8KpUKh0VWzl/hw4d6isNbLFY3HBjXISFbdsd15OfbDYLAPjHP/7h+jyocl+pVHTl3u/cSGbBXtf+WtxTftfPWtxTgyxz++2362UKhQIA+GYmkzJ6g1M5f4cPH+5aJtHvPTUxMYGrV6+6AhbbtjEyMtLXdzVRLwxaiCj0EokEKpWKrlA1m02MjIzgnXfe0fNs374dpmnijTfe0D/2hUIBf/3rXxGPx/HCCy+41injxgQ9bR4eHsbY2BhOnTrl+vzzzz8HsPS0M8j58+cBLFZCCoUCJiYmAAA333wzAODdd9/VlcSXXnoJe/bsAQD8+OOPKJfLrkqIBEiyDhkY8fHHH+/Yrozl4Tfw3ubNm9FsNjE6OtpRCbl8+bJOierd5yDy9qRQKHQ8zXWKxWI4e/Ys9uzZg3/+85++wYdUar799lvX+du3bx8ymQwOHDjgml+uCVmu1WohnU7r8XP6JZW+s2fP9lVh/zm44447YBgG3njjDX0dlMtlbNmyRQflAPDkk08CAF577TWdwnh8fBylUgmZTKZjjCIJKvwGj43FYrBtG8lksqMCKw8KegUjK3lPDXL9rOU91c8y8vDl3XffxcmTJwPfash31ZdffulKQV0qlTA9Pd3xtvNa7qlms4mDBw+iVCrp9MuRSASbNm3SqbqJrtl6t08jIuql0Wjozqf4X1trv075jUZDtzPH//p+BLWjD+qgKp3z/bKYKbXUCbZXJp2ZmRllGIYyDMM3AYBkepL0rJJG1vmZt7wy3TRNnVLYKahvgGTygU9mKUmP222fvZypZA3D0Clgg0gb/G7t3J3ZsZz72a0fRL/n2o/zevL+hbHj/EqbmZnR590wDJVKpXwTS8zMzOhrR66foD4OQX29pE+WpEX2knPdT5lX6p7q9/pZq3tq0GW6pXL2zuP97gw6f9dyTzmX8/tbTl8zIq+IUn00kiYiIgDQAyB+++23612UDSOdTsOyLMzOzgY28Uqn0yiVSn3126Gfj2aziXvuuQeZTIb9IPpk2zZGR0exc+fOrscsGo3ivvvuY78v+tlg8zAioj7VajUsLCx0bQpFS02BZOTwXgELsJgUoVdyA/r5kcQXjz322DqXJLxarZZOelEul/sKWCRZRq++d0QbCbOHERH1wbZt7N+/H4ZhdPSPITfLsrBp0yYAQDwe7xmwSAWLHeivL5KYIZFIdPSPoSVXrlxBvV5HJBIBgL7eSkk2MskAR/RzwDctREQ9TExMYNOmTTBNE2fOnOkri9X1SjqzG4aBbDbbM2ABljKy1et1JJPJVS8jrb9kMokdO3YgnU7j7bffXu/ihNrFixcBAKZpIp/P99WMTu7D48eP64QFRBsd+7QQEREREVGo8U0LERERERGFGoMWIiIiIiIKNQYtREREREQUagxaiIiIiIgo1Bi0EBERERFRqDFoISIiIiKiUGPQQkREREREocaghYiIiIiIQo1BCxERERERhRqDFiIiIiIiCjUGLUREREREFGoMWoiIiIiIKNQYtBARERERUagxaCEiIiIiolBj0EJERERERKHGoIWIiIiIiEKNQQsREREREYUagxYiIiIiIgo1Bi1ERERERBRqDFqIiIiIiCjUGLQQEREREVGoMWghIiIiIqJQY9BCREREREShxqCFiIiIiIhCjUELERERERGFGoMWIiIiIiIKNQYtREREREQUagxaiIiIiIgo1Bi0EBERERFRqP1/b9RS/sd9Xe0AAAAASUVORK5CYII=\"\u003e\u003cbr\u003e\u003c/p\u003e\n\u003cp\u003eAbove, \u0026nbsp;\u003cimg src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAALsAAAApCAYAAABtPlgiAAAILElEQVR4nO2dTWsTWxjH/7ncL3CqKykueipYVAQ7VtFSaBeZIG4EZQouBWWKaxexSxXT7kSSKLrUvLhwlUIqVDBB1AZJUOlqZlFKVxmDn+DchfeZzmtmcpvaXOb8IJszZ848b+dlnnOGpIQQAhJJAvjrsAWQSP4UMtgliUEGuyQxyGCXJAYZ7JLEIINdkhhksEsSgwx2SWKQwS5JDDLYJYlBBrskMchglySGWMFumiYWFxeRSqUwNjaGTqdjX1tbW8Pk5CRSqRQymYzrmkQyUogI2u22UBRFGIYhcrmcACA0TRNCCKHrugDg+tE1iWTUiBzZq9UqXrx4gYmJCRw/fhwAwDlHuVxGuVxGo9GAEAKapgEAKpXKgXVMiWQ/RAb7w4cPcfbsWQDA9vY2AKDX62F5eRmtVguzs7MAgLt37wIAGGMHJatEsi/+HqTyxsYGAKBQKKDRaGBiYsK+9uPHDwDAzMzMEMWTSIbHQNmYL1++AAB0XbdHdIJeTBcWFoYkmkQyXGIHe6fTQa/XAwDcuXPHd319fR0AcOnSpSGJdvBQlmlsbAypVAqTk5O+OpSFMk0zsr1UKmX/ms3mQYgs2Qexg31rawvA7zU5reEJ0zRhGAYA+Eb8UcU0TSiKgrGxMfz8+RO5XC4w2NfX18EYcy3Zwuh2u+CcA/j/2OH/TqfTQSaTwcrKSnTluGkbSjOqquq7ViwWQ6+NKqRPt9sdarucc6EoylDbjIOmaQM/l/w2bBv8CQzDcKW+c7lc5D2xR/bNzU0AwWvy9+/fAwCmp6fjNneoWJaFQqEAVVVx5MiRobZtGAbS6fRQ24yi0+mgUqkM9FzLsrC6ugpFUYZug4Om2WwinU5jbm4OxWIx/o1xexL+7UGNRsN3TVVVAUAUi0UhxO+NqGw266vXbreFpmmCMWa3F1SvVCoJRVFcG1XO0afb7dq9WlEU0e12XWWMMVEqlQL1yGazgnPu2wwzDCNQJwCiVqsFtlUsFu22GGP2PWHPbrfbQtd1W3/OuaturVaz26NyZ5mqqj47qKrqsif9yBdB6LoeaAPaEHTaknPusk2j0YhVP64/omwSBPnbKU+ckT1WsDsVDIKcnMvlRLvdFpxz0W63XXVKpZIAIHRdt4X1BrvTeaSwYRiCMeaaohVFEY1GQ9RqNTsYdV23jUyBEQZN32FB7HwOQqZ5ciQFFckZ1HGc+mezWVt/zrngnNvXyTaKoghVVUWpVLLbz2azoYONpmkDL0f62UDTNJd9dV0PvJdkU1W1rz+oY3nli7JJHIYe7HRMIGxN2Gg0bEdrmuZzNgnkPUpADiXIoV4HUGB5OxAZnUZ3W6mIYKf2goLSSdj6m+zhHT2po3oh/b2zWJhjGWOCMeZqn54ZFOzewSAOcTsIY8wnY7FYFIyx0OD1zkBkb6fsg9okjKEH+37pN0IShmGEdqggY4WVt9vtwNHICec8MCiD5PG2QzNHWJAGnQ2iTtDtdoVhGKJWq9mzobdj03O9nZWC09tBSd+g5WA/4nYQktPpO0VRAoMrbPYh2Z3lg9ikH4ME+0A7qP8F0zTRarWgaVrfF6F3794BAG7cuOG7Ri/Hx44dc5VTWtCZ5vv06RMAYG5uLvA5lmXBMAyoqtpXbtpA87ZDct6+fdtVTvsQ586dc5Wbpol6vQ4AOHr0KBhjmJmZwfT0NPL5vC+lSc+9du2aT1fOua8+6Xv58uW++gTJGueFdmFhAfV6HVtbW5idnUWz2YRhGLh165avLsnoTbtSWnpqagrA4DYZFgce7Lu7uwDgCwIvv379AuDflKLO4nU05fbpABrx9u1bAOHHFj5//gwgeqf3w4cPge3Q+SCvnNVqNbCc9M/lcrh3717fZzqfe/HiRbus2Wyi1+thcXHRV58yYSdPnoxsm6AOcubMmci6p0+fBgDs7OwAAB48eIB8Ph84cNGg5oT858x8DWqTYXFoH29YlhXr7Hs2mwUAPHnyxFVOI+D8/LyrvF6v2x3Dsixfe9+/fwcQvdO7ubkZezOp0+mgUCgAiL+ZZFkWyuWyr5xmK+fG3cePHwHszTJOvWjUJDktywrU2wl12PHxcbssbIeYOtH29jaePXsGAIGdjnaMvYMa+W95ebmvTCR7kE2GxYEH+9TUFBhjeP78ue2EtbU1nDhxwt6VBYDr168DAJ4+fWo77P79+6hUKtB1HVeuXHG1++3bNwDAqVOnfM+cnJyEZVnIZDK+bXs6zEZTahg0m1iWhaWlJbsdOub8+vVrW5dqtWoHgGVZWFlZsXf0nPpTQDWbTWQyGXsUJ2iJFTYrjY+Po1wu4+bNm75rpmnCNE1kMhl79opiZ2fH1u/ly5eBdagTvXnzBqurq8jn84H1qEN+/frV9t/S0hIqlQpKpZJrEBjEJv2wLMv2w8bGRvSRjthvAvvAmSumlzhvZoXqefPrQdkHIfZeer048+9B9yLk5dILZT84574XJnoRY4zZL0aUdnOWEfQBTJRe1EbQ/ZShoTQdUSqV7ExYmM5eKD1M+vXLyQshIvcPnHWc+xOUkgyTIa6vg6D7gn5h7fyRYB8V4mRqJG4o9x1lM9pUG2US9cE1ZQCuXr16yJKMLqZp4vz58wB+L9EuXLiAdDodunwB9rI7o368+8CzMaNCp9PB48ePoaqqb/0v2WN3dxetVgupVArA728X+gU6sJfdoYzaqJKIkT2TyWB+fh6Li4t49erVYYsz0tAXZ5xzFIvFyEAH9j7cefToUbyjtodESgj5n0qSZJCIkV0iAWSwSxKEDHZJYpDBLkkM/wAnphsAWQXmTwAAAABJRU5ErkJggg==\"\u003e\u0026nbsp;is the number of voxels with a probability higher than 0.9 for one tumour type and \u003cimg src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAALUAAAArCAYAAAA+P8maAAAIX0lEQVR4nO2dz2sTzxvH3/nwvddprwol04OiotitFa1CLt3qtcpWTz2IsO1ZKRFvPRjPalOwR9n0IHowhbRgwaSgViULgoJsDqKeNgT8B+ZzqM90f8zmRz9trfudFwRkdnZ+PPM8z8w8T1IzQggBjSZF/POnB6DR7DZaqTWpQyu1JnVopdakDq3UmtShlVqTOrRSa1KHVmpN6tBKrUkdWqk1qUMrtSZ1aKXWpA6t1JrUoZVakzqUSl2r1TAyMoJMJoORkRE0m0357MGDB+jv70cmk8HMzEzomUZzIBARHMcRlmUJ3/eFaZoCgCgWi8L3fWEYhgAQ+hSLxWgTGs0fJeapX7x4gUePHmFgYADZbBYAcOTIEdy7dw8A4HkefN8H5xwA8Pz58/2xPo2mS2JKXSqVMDAwAABoNBoAgI2NDWxubmJzcxPZbBYDAwO4desWAODQoUP7OFyNpjP/a/ewUqkAABYWFvD169fQs48fPwIAzpw5s0dD02h2RmL0w3Vd+e/Hjx9L7028f/8eAHD+/Pk9GppGszMSlfrNmzcAAMYYpqamQs8ajQY8zwMAjI2N7eHwdpdarYaJiQlkMhkZvYnS39+PoaGhrtqidjKZzF4MV7NDOnrq8fHx2LN3794BAEzT3KNh7T4rKyu4ePEipqenIYSAaZoYHBwM1XFdF61WC4ZhdGxvbGwM9XodwN8lh7+RRqOBu3fvyjAzhZoXFxfVLySFRTjnAoAoFAqxZ5ZlJT47qHDOhWEYu9qm53kCgMjn87vabjcwxnru17KsXZfBfgBAMMZEtVoVQmzJnfTTcZxYfaWnbjab8nihOjOvrq4CAE6cOPHfzXAfWFlZged5uHbt2q62+/PnTwDAhQsXdrXdTiwuLqLVavXUr+u6WF5eVu68fwNzc3PyqJvNZjE/Pw8A+PbtW7yyyjKq1apMriRZDgBRr9eFEEIUi0VRLpdj9crlskzg4Le1RS3L8zxh27ZgjAkAgnMeq1Ov12U7tm3HyjjncixRTNOUbdOHc544JwDC9/3Yc9/3RT6fD42TklGe5yn7LpfLclcDIAzDCI2zUCgIxphgjMlyKoNiB6hWqyF5Bj9J86ckWlQGCCTOgrI0TTP0fqFQiNUvl8uxnTxYZpqmUobdyKRbyuVy4mlBqbU0kegE5Uu/B1StVoXjOMIwjNgkbNuOCQJASPkdxxGMMWFZllSMfD4fqud5njAMQ3ieJ5/V63WRz+eF7/ttJ0eQEJMELcTW4pOQVc8MwwhtgdSvykBo/oyxkOIEjdK2bZmppfHn83nZPhmMCsZYz8eIdjLgnEujhWJLp3fr9bool8vCtm0pE9M0heM4cp7FYjHxSNZJJr3OhzGmdChKqZHVJp3ZaOB0rosKiowimkIPejXP85SLQ+dUy7KUE4kKgXaVdkrNOU9Uvmi/qjmTPKIeJWmcNP+gAVP70QWkhQ1662CfUah+r+fpbgwhScksy1I6OM55bPeleSZ5/G5k0glyhkkePvGiuFPaebwg5Mmjx5YkoQixLcSgEZGBqS4MwfZUyhfEcRxlO+SRk5Qxari+7wvGmBx/vV4XjuPIsUc9C/UbNUrGmNIQab6q414SvRhCdO1oPWkHiZZH14n6Cpb3KpNOc2mn0EII0TajuBPW1tYAADdv3mxbr1QqAQCuXLkSKv/y5QsAyO+dEBQbtywrlAhaX18HAJw9e1bZD7XXKfP5+vVrZTsvX74EANy4cSNUTnH848ePh8rX1tbQarVQqVSQyWTAOcfQ0BBu376Nq1evxpJY1G8wLEihxWh+ANie7+joaNv5qMbazcXSNE2ZSQaApaUlmKYZy0e8ffsWADA9PR0q//HjBwBgeHhYlvUqkyRc18Xk5CTW19dx6tSpxHq7rtR0G40udpRWq6WM75ISXbp0KVROsfFcLhcqX15eBuc8ZgTExsYGgM6Zz9XVVWU79P2X6KI+efJEWU7zr1arXSWmVldXwRgLLRIpVVQGwXF2qwjAtiEcPXq0Y93h4WFUKhU0Gg309fXh/v37Mnsc5NOnTwCAY8eOhcpp/S5fvizLepWJClLoZ8+etVVoYB9/JOC6bsfvXruui4WFBRiGEfNS5NHOnTsny2q1GoDtBJGq/Q8fPgBon/mkEGY3SRdgK6TmeV5PSZdGo4GVlZVYmed5sTDbq1evAGzvGjSvZrOJVqsVyniS0bWDwrNksM1mM3EtTp48CWArXDk7O4u5uTmlw6AxBhWM1k/l2VWoZKKi2Wwil8vFFLpUKmFiYiJWf9eVmjziw4cP5YAWFxeRy+Xw/ft3Wc+2bVQqFamYtVoNk5OTYIxJLxhkc3MTAJRWOjg4CNd1MTo6GlusSqXSUVk/f/4MAOCco9FoYGJiQrZDC1oqleRc+vr60N/fL5VjampKziM4f2qjVCrBMAz8+vUr1G+no1E2m8XMzAyWlpZC5dRvrVbD+Ph4V4oNbCkRzY+OD1EOHz4MAJifn4fnebhz546yHu0mwfXL5XIwDANPnz4N1e1FJipmZ2fRarVw+vTp0FcTrl+/rn6h6xN6DwRjrZxzGQIK4vt+LD5dKBQSY8RQXEqCP1wIhgUJiox0c7sOxmmDl5DgjyU45/KCRuGvYBlBlyD8jmrYtq28DFEb0UsYXR4557GLKL2TNGcVFC3A70tgtL8oNO6kyxjJlaJKVD9p/WgM3cgkCl08kz6qgMKeKPVBoVNkRBOHlKidzEiunYzjT5FqpSYP2y7p8v+O4zgy11AsFpVZ3yiULzioHNyR/UeS4r+aMME0eLe7Gh1lDqqzSKVSB8/omvaQ1+3mrC3EdjKLPgeRjBD6f+fSpAv9x2w0qUMrtSZ1aKXWpA6t1JrU8S+Rw14ehuF5QgAAAABJRU5ErkJggg==\"\u003e\u0026nbsp; is the number of voxels with a probability higher than 0.9 for the second tumour type on the binary classifier. The tumour type of each patient was inferred by applying Youden\u0026rsquo;s index (highest sum of specificity and sensitivity in the training set) to the voxel proportion above. In practice, a 3-class classifier differentiating between PCNSL, GMB and metastases was implemented by concatenating two 2-class classifiers. The first classifier distinguishes PCNSL from non-PCNSL cases, while the second classifier differentiates the non-PCNSL cases into GBM or metastasis (Fig. 1).\u003c/p\u003e\n\u003cp\u003e\u0026nbsp;\u003cstrong\u003eClassification performance and interpretation\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eClassification accuracy, sensitivity and specificity were obtained for 100 groups of 25 randomly-selected patients from the test cohort in order to obtain average classification performance and 95% confidence intervals (CI) for all classifiers, as reported in Supplementary Table S2.\u0026nbsp;\u003c/p\u003e\n\u003cp\u003eIn addition, the area under the ROC curve was obtained for binary classifications, which shows the trade-off between sensitivity and specificity of different classification thresholds (Fig. 2B). The thresholds were set by Youden\u0026rsquo;s index as described above, but the app allows users to change them to meet different clinical needs, as discussed. Average ROC curves were obtained for the 3-class problem (Fig. 2C).\u003c/p\u003e\n\u003cp\u003eCurrent standard metrics of DSC-PWI analyses were obtained to compare against our voxel-trained CNN. Mean PSR and mean rCBV were computed with Slicer, for which further details can be found in Supplementary Appendix C. Classification metrics and ROC curves were obtained for PSR and rCBV applying the same classification structure used for the CNN-based approach.\u0026nbsp;\u003c/p\u003e\n\u003cp\u003e\u0026nbsp;\u003cstrong\u003eCNN interpretation\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThe CNN provides a tumour-type probability value from each TIC found in each voxel. The map inherently informs about the decision process of the CNN classifier towards one tumour type or another and, more importantly, about the confidence of the classification in spatial regions.\u003c/p\u003e\n\u003cp\u003eTo further explore the features that the CNN associated with each tumour type, down to the individual timepoints of the DSC-PWI TIC signal, we applied a score-weighted visual explanation for CNNs (ScoreCAM\u003csup\u003e22\u003c/sup\u003e). On Fig. 3A, the importance score was scaled to sum 1 over all timepoints in every voxel, in order to see the spatial relative importance. On Fig 3B, the average importance score is shown in each timepoint for each tumour type, with the average tumour TIC from the training data overlayed in black, in order to see the temporal differences.\u003c/p\u003e\n\u003cp\u003e\u0026nbsp;\u003cstrong\u003eDevelopment of the online app BERRY\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThe processing and classification pipeline was bundled into a Docker image which can run as a standalone application in any system (Fig. 4). For demonstrative purposes, the BERRY app is also available on the VHIO server through a web interface, so that it is accessible from anywhere using an internet connection. The user can input their anonymized DSC-PWI and CE-T1WI scans in raw DICOM, Nifti or NRRD formats and, optionally, their own segmentations. When the study is processed, the tool shows the average TIC, the result of the classification and the spatial probability map. The online tool can be accessed at https://berry-app.vhio.org for research purposes.\u003c/p\u003e"},{"header":"Declarations","content":"\u003cp\u003e\u003cstrong\u003eData availability\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eFour out of five datasets used in this study, from the 4 participating sites, are not publicly available due to their containing information that could compromise the privacy of research participants. The IvyGAP\u003csup\u003e21,31\u003c/sup\u003e dataset used as one of the validation cohorts is publicly available at The Cancer Imaging Archive\u003csup\u003e32\u003c/sup\u003e (https://doi.org/10.7937/K9/TCIA.2016.XLwaN6nL), along with reference segmentations\u003csup\u003e33,34\u003c/sup\u003e (https://doi.org/10.7937/9j41-7d44).\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eCode availability\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThe code integrating the app processing and classification pipeline can be publicly accessed at https://github.com/radiomicsvhio/berry-app. We relied on the open-source software dcm2niix (https://github.com/rordenlab/dcm2niix/) for DICOM conversion and Slicer\u003csup\u003e30\u003c/sup\u003e (www.slicer.org) for image annotations and computing. The BERRY online app can be accessed at https://berry-app.vhio.org.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eEqual contribution:\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003e*AGR, APE and FG are co-first authors with equal contributions.\u003c/p\u003e"},{"header":"References","content":"\u003col\u003e\n \u003cli\u003e\u003cspan\u003eYoung RM, Jamshidi A, Davis G, Sherman JH. Current trends in the surgical management and treatment of adult glioblastoma. \u003cem\u003eAnn Transl Med.\u003c/em\u003e 2015; 3(9):121.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eHatiboglu MA, Wildrick DM, Sawaya R. The role of surgical resection in patients with brain metastases. \u003cem\u003eEcancermedicalscience.\u003c/em\u003e 2013; 7:308.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eHoang-Xuan K, Bessell E, Bromberg J, et al. Diagnosis and treatment of primary CNS lymphoma in immunocompetent patients: guidelines from the European Association for Neuro-Oncology. \u003cem\u003eThe Lancet Oncology.\u003c/em\u003e 2015; 16(7):e322-e332.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eDammers R, Haitsma IK, Schouten JW, Kros JM, Avezaat CJ, Vincent AJ. Safety and efficacy of frameless and frame-based intracranial biopsy techniques. \u003cem\u003eActa Neurochir (Wien).\u003c/em\u003e 2008; 150(1):23\u0026ndash;29.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eChiavazza C, Pellerino A, Ferrio F, Cistaro A, Soffietti R, Ruda R. Primary CNS Lymphomas: Challenges in Diagnosis and Monitoring. \u003cem\u003eBiomed Res Int.\u003c/em\u003e 2018; 2018:3606970.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eMiller KD, Ostrom QT, Kruchko C, et al. Brain and other central nervous system tumor statistics, 2021. \u003cem\u003eCA Cancer J Clin.\u003c/em\u003e 2021; 71(5):381\u0026ndash;406.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eLeung D, Han X, Mikkelsen T, Nabors LB. Role of MRI in primary brain tumor evaluation. \u003cem\u003eJ Natl Compr Canc Netw.\u003c/em\u003e 2014; 12(11):1561\u0026ndash;1568.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eArita K, Miwa M, Bohara M, Moinuddin FM, Kamimura K, Yoshimoto K. Precision of preoperative diagnosis in patients with brain tumor - A prospective study based on \u0026quot;top three list\u0026quot; of differential diagnosis for 1061 patients. \u003cem\u003eSurg Neurol Int.\u003c/em\u003e 2020; 11:55.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eChakravorty A, Steel T, Chaganti J. Accuracy of percentage of signal intensity recovery and relative cerebral blood volume derived from dynamic susceptibility-weighted, contrast-enhanced MRI in the preoperative diagnosis of cerebral tumours. \u003cem\u003eNeuroradiol J.\u003c/em\u003e 2015; 28(6):574\u0026ndash;583.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eCha S, Lupo JM, Chen MH, et al. Differentiation of glioblastoma multiforme and single brain metastasis by peak height and percentage of signal intensity recovery derived from dynamic susceptibility-weighted contrast-enhanced perfusion MR imaging. \u003cem\u003eAJNR Am J Neuroradiol.\u003c/em\u003e 2007; 28(6):1078\u0026ndash;1084.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eFordham AJ, Hacherl CC, Patel N, et al. Differentiating Glioblastomas from Solitary Brain Metastases: An Update on the Current Literature of Advanced Imaging Modalities. \u003cem\u003eCancers (Basel).\u003c/em\u003e 2021; 13(12).\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eArtzi M, Bressler I, Ben Bashat D. Differentiation between glioblastoma, brain metastasis and subtypes using radiomics analysis. \u003cem\u003eJ Magn Reson Imaging.\u003c/em\u003e 2019; 50(2):519\u0026ndash;528.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eBae S, An C, Ahn SS, et al. Robust performance of deep learning for distinguishing glioblastoma from single brain metastasis using radiomic features: model development and validation. \u003cem\u003eSci Rep.\u003c/em\u003e 2020; 10(1):12110.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eQian Z, Li Y, Wang Y, et al. Differentiation of glioblastoma from solitary brain metastases using radiomic machine-learning classifiers. \u003cem\u003eCancer Lett.\u003c/em\u003e 2019; 451:128\u0026ndash;135.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eNeska-Matuszewska M, Bladowska J, Sasiadek M, Zimny A. Differentiation of glioblastoma multiforme, metastases and primary central nervous system lymphomas using multiparametric perfusion and diffusion MR imaging of a tumor core and a peritumoral zone-Searching for a practical approach. PLoS One. 2018; 13(1):e0191341.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eLee MD, Baird GL, Bell LC, Quarles CC, Boxerman JL. Utility of Percentage Signal Recovery and Baseline Signal in DSC-MRI Optimized for Relative CBV Measurement for Differentiating Glioblastoma, Lymphoma, Metastasis, and Meningioma. \u003cem\u003eAJNR Am J Neuroradiol.\u003c/em\u003e 2019; 40(9):1445\u0026ndash;1450.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eBell LC, Hu LS, Stokes AM, McGee SC, Baxter LC, Quarles CC. Characterizing the Influence of Preload Dosing on Percent Signal Recovery (PSR) and Cerebral Blood Volume (CBV) Measurements in a Patient Population With High-Grade Glioma Using Dynamic Susceptibility Contrast MRI. \u003cem\u003eTomography.\u003c/em\u003e 2017; 3(2):89\u0026ndash;95.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eBell LC, Semmineh N, An H, et al. Evaluating the Use of rCBV as a Tumor Grade and Treatment Response Classifier Across NCI Quantitative Imaging Network Sites: Part II of the DSC-MRI Digital Reference Object (DRO) Challenge. \u003cem\u003eTomography.\u003c/em\u003e 2020; 6(2):203\u0026ndash;208.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eBoxerman JL, Paulson ES, Prah MA, Schmainda KM. The effect of pulse sequence parameters and contrast agent dose on percentage signal recovery in DSC-MRI: implications for clinical applications. \u003cem\u003eAJNR Am J Neuroradiol.\u003c/em\u003e 2013; 34(7):1364\u0026ndash;1369.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003ePaulson ES, Schmainda KM. Comparison of dynamic susceptibility-weighted contrast-enhanced MR methods: recommendations for measuring relative cerebral blood volume in brain tumors. \u003cem\u003eRadiology.\u003c/em\u003e 2008; 249(2):601\u0026ndash;613.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eShah N, Feng X, Lankerovich M, Puchalski RB, Keogh B. Data from Ivy Glioblastoma Atlas Project (IvyGAP): The Cancer Imaging Archive; 2016.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eWang H, Wang Z, Du M, et al. Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks. Paper presented at: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)2020.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003ePons-Escoda A, Garcia-Ruiz A, Naval-Baudin P, et al. Presurgical Identification of Primary Central Nervous System Lymphoma with Normalized Time-Intensity Curve: A Pilot Study of a New Method to Analyze DSC-PWI. \u003cem\u003eAJNR Am J Neuroradiol.\u003c/em\u003e 2020; 41(10):1816\u0026ndash;1824.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eGrussu F, Blumberg SB, Battiston M, et al. Feasibility of Data-Driven, Model-Free Quantitative MRI Protocol Design: Application to Brain and Prostate Diffusion-Relaxation Imaging. \u003cem\u003eFrontiers in Physics.\u003c/em\u003e 2021; 9.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eSchmainda KM, Prah MA, Hu LS, et al. Moving Toward a Consensus DSC-MRI Protocol: Validation of a Low-Flip Angle Single-Dose Option as a Reference Standard for Brain Tumors. \u003cem\u003eAJNR Am J Neuroradiol.\u003c/em\u003e 2019; 40(4):626\u0026ndash;633.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003ePark JE, Kim HS, Lee J, et al. Deep-learned time-signal intensity pattern analysis using an autoencoder captures magnetic resonance perfusion heterogeneity for brain tumor differentiation. \u003cem\u003eSci Rep.\u003c/em\u003e 2020; 10(1):21485.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eNilsson M, Englund E, Szczepankiewicz F, van Westen D, Sundgren PC. Imaging brain tumour microstructure. \u003cem\u003eNeuroimage.\u003c/em\u003e 2018; 182:232\u0026ndash;250.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eTustison NJ, Avants BB, Cook PA, et al. N4ITK: improved N3 bias correction. \u003cem\u003eIEEE Trans Med Imaging.\u003c/em\u003e 2010; 29(6):1310\u0026ndash;1320.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003ePohl KM, Bouix S, Nakamura M, et al. A hierarchical algorithm for MR brain image parcellation. \u003cem\u003eIEEE Trans Med Imaging.\u003c/em\u003e 2007; 26(9):1201\u0026ndash;1212.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eFedorov A, Beichel R, Kalpathy-Cramer J, et al. 3D Slicer as an image computing platform for the Quantitative Imaging Network. \u003cem\u003eMagn Reson Imaging.\u003c/em\u003e 2012; 30(9):1323\u0026ndash;1341.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003ePuchalski RB, Shah N, Miller J, et al. An anatomic transcriptional atlas of human glioblastoma. \u003cem\u003eScience.\u003c/em\u003e 2018; 360(6389):660\u0026ndash;663.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eClark K, Vendt B, Smith K, et al. The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository. \u003cem\u003eJ Digit Imaging.\u003c/em\u003e 2013; 26(6):1045\u0026ndash;1057.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003eData from the Multi-Institutional Paired Expert Segmentations and Radiomic Features of the Ivy GAP Dataset. The Cancer Imaging Archive (TCIA); 2020. \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://wiki.cancerimagingarchive.net/pages/viewpage.action?pageId=70222827\u003c/span\u003e\u003c/span\u003e.\u003c/span\u003e\u003c/li\u003e\n \u003cli\u003e\u003cspan\u003ePati S, Verma R, Akbari H, et al. Reproducibility analysis of multi-institutional paired expert annotations and radiomic features of the Ivy Glioblastoma Atlas Project (Ivy GAP) dataset. \u003cem\u003eMed Phys.\u003c/em\u003e 2020; 47(12):6039\u0026ndash;6052.\u003c/span\u003e\u003c/li\u003e\n\u003c/ol\u003e"}],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":true,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":true,"hideJournal":false,"highlight":"","institution":"","isAcceptedByJournal":true,"isAuthorSuppliedPdf":false,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":false,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"","lastPublishedDoi":"10.21203/rs.3.rs-2362207/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-2362207/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003eNon-invasive differential diagnosis of brain tumours is currently based on the assessment of tumour vascularity through magnetic resonance imaging (MRI) coupled with dynamic susceptibility contrast (DSC). However, given its limited accuracy, reaching a definitive diagnosis often requires complex neurosurgical interventions that compromise the patients\u0026rsquo; quality of life. We applied deep learning on DSC images from histology-confirmed patients with glioblastoma, metastasis or lymphoma, the three most common brain malignancies. The convolutional neural network trained on ~\u0026thinsp;50,000 voxels from 40 patients provided intra-tumour probability maps that yielded clinical-grade diagnosis. Performance was tested in 400 additional cases and an external validation cohort (n\u0026thinsp;=\u0026thinsp;128). The tool reached a three-way accuracy of 0.78, superior to standard diagnosis with cerebral blood volume (0.55) and percentage of signal recovery (0.59) perfusion metrics. Our open-access software, Brain Enhancing Region Radiological analysis (BERRY), demonstrates the potential of voxel-wise probability maps for differential diagnosis of brain tumours using standard-of-care MRI.\u003c/p\u003e","manuscriptTitle":"An accessible deep learning tool for voxel-wise classification of brain malignancies from perfusion MRI","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2022-12-14 16:21:07","doi":"10.21203/rs.3.rs-2362207/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"f4db0eb0-8d2b-4286-8748-0a740a66136a","owner":[],"postedDate":"December 14th, 2022","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"published-in-journal","subjectAreas":[{"id":17681495,"name":"Health sciences/Diseases/Cancer/CNS cancer"},{"id":17681496,"name":"Health sciences/Medical research/Biomarkers/Diagnostic markers"},{"id":17681497,"name":"Health sciences/Health care/Medical imaging/Magnetic resonance imaging"}],"tags":[],"updatedAt":"2024-03-21T11:23:48+00:00","versionOfRecord":{"articleIdentity":"rs-2362207","link":"https://doi.org/10.1016/j.xcrm.2024.101464","journal":{"identity":"cell-reports-medicine","isVorOnly":true,"title":"Cell Reports Medicine"},"publishedOn":"2024-03-01 11:23:48","publishedOnDateReadable":"March 1st, 2024"},"versionCreatedAt":"2022-12-14 16:21:07","video":"","vorDoi":"10.1016/j.xcrm.2024.101464","vorDoiUrl":"https://doi.org/10.1016/j.xcrm.2024.101464","workflowStages":[]},"version":"v1","identity":"rs-2362207","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-2362207","identity":"rs-2362207","version":["v1"]},"buildId":"7rjqhiLT3MXkJMwkYKINL","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}