Results
The proposed feature selection algorithm produced seven features, including one morphology (slope) and three texture (entropy, inverse difference, information correlation 1) parameters, one kinetic parameter (SER), one pathological parameter (age) and ADC. Univariate statistical analyses were conducted to demonstrate the diagnostic capabilities of each feature. All features selected were shown to be statistically different between malignant and benign lesions. Table 3 summarizes the mean and standard deviation and the diagnostic performance on the whole dataset of the seven selected parameters. Among the seven parameters, the diagnostic accuracy of SER was the highest.
Computed with paired-sample t-test.
Computed with Receiving Operating Characteristic.
Signal enhancement ratio.
In this experiment, we evaluated the diagnostic performance of each individual feature group as well as their combinations through ten-fold cross validation scheme. The whole data were randomly divided into ten equal sized subsets, among which 9 subsets were trained to find out the classifier or optimal cut-off values and the one left behind was used for testing. For the group in which only one feature was selected, univariate analysis was carried out by Receiver Operating Characteristics (ROC). For the feature group which has more than two features, classical classification algorithms including SVM, Naïve Bayes (NB), KNN and Logistic Regression were conducted and their averaged performance was calculated.
The experimental results were summarized in Table.4 . When only individual feature group was used, the prediction performance was unsatisfactory. For example, the accuracy is 63.4% by using morphology features. While the accuracy increases to 74.9% by using DWI feature of ADC,. The observation implies two aspects: 1) characterization of the lesion through one-sided methodology was not comprehensive enough. It might have good sensitivity, yet the specificity was poor; 2) ADC is a nice diagnostic factor for discriminating the status of breast mass. Our finding is consistent with earlier results [8] , [11] , [14] . However, the specificity of ADC was lower than what’s anticipated, making it an unreliable factor in diagnostic practice as a result.
In comparison, when all the well selected features were combined together, the averaged sensitivity, specificity, AUC and accuracy of the classification model dramatically increased to 0.85, 0.89, 0.93 and 90.9%, respectively ( Table 4 ). Among the tested models, although SVM achieved superior performance to other three models in terms of accuracy, the latter ones had comparable results. Therefore, we may draw a conclusion that a full characterization of breast lesion through multi-sided methodologies will produce a high discrimination power.
Discussion
The results of our study demonstrate that diagnostic performance can be dramatically improved by incorporating the multi-sided characterizations of the breast lesions on MRI. In particular to the parameter of ADC, it has been shown to be correlated to lesion malignancy due to a high cell density, caused by an increased fraction of signals coming from intracellular water. This parameter, when combined with morphology and enhancement kinetic features, will increase in both specificity and sensitivity in discriminating types of lesions, thus it is promising in providing a supplementary assessment on lesion status.
We carried out a systematical analysis to investigate the potential power in discriminating a fully comprised pictorial characterization of lesions. Our analysis pipeline includes image segmentation, feature extraction, selection and classification model building. The seven features obtained are all shown to be statistically different between the malignant and benign lesions. The combined features were tested extensively through four popular classification models. The finding demonstrates that the combination of the kinetic enhancement data, morphology information and ADC in a systematic model is effective and comprehensive to make an accurate diagnosis on breast masses. We speculate that this could potentially impact clinical management decisions and therapy selection.
Introduction
The development of noninvasive methods of tissue characterization that could be applied early in the course of diagnosis to assess risk and to guild subsequent treatment would allow clinicians to tailor therapy on an individual. Conventional magnetic resonance imaging (MRI) of the breast has proven to be less successful than expected [1] . Breast MRI has demonstrated a high sensitivity, but with the shortcoming of varying specificity, reported to be from 37% to 97% [2] , [3] , [4] , and therefore multiple biopsies tests have to be conducted as supplementary. Recently, more specialized methods, including dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) and diffusion-weighted magnetic resonance imaging (DW-MRI), have advanced to the point where they provide quantitative measurements of tissue properties that are highly related to the assessing of tumor progression and/or responses [1] , [2] , [5] , [6] , [7] . DW MRI was designed to reflect water movement within tissues by measuring the degree of random molecular motion and quantify such movement with apparent diffusion coefficient (ADC) value. Recent studies [8] , [9] , [10] , [11] , [12] , [13] found that the ADC is significantly lower in malignant tumors than in benign breast lesions or normal tissue in DW MRI. This special observation is mainly due to a high cell density, caused by an increased restriction of the extracellular matrix and an increased fraction of the signal from intracellular water [8] , [11] , [14] .
The advances in imaging techniques allow for the possibility to investigate the diagnostic performance by combining the merits of different image modalities. Such investigation is promising in clinical diagnosis by reducing inter-observer biases in interpretation of the images [15] , [16] , and by shortening the diagnosis time [17] . For example, it has been shown that the morphological features in breast MRI as adjunct diagnostic criteria can improve the specificity without significantly reducing the sensitivity [18] , [19] , [20] . Combining morphological characteristics with enhancement kinetics can also improve the diagnostic performance of breast lesion interpretation [21] . Yabuuchi et al. [22] reported a high accuracy in enhancing breast masses through the combination of DWI and DCE-MRI features.
However, there are few researches on investigation of the combinational performance of both MRI and DWI in discriminating of pathologically verified breast masses. In the current study, we retrospectively investigated the potential discriminatory power of image features estimated from both of DWI and DCE-MRI. Four distinct groups of features were estimated to comprehensively characterize the image in a multi-sided way. To remove the redundancy as well as to increase the diagnosis capabilities of the features, a hybrid feature selection scheme was conducted on the four feature groups and a pathological variable group. The resulted seven features, including one for pathology, one for morphology, three for texture and one for kinetic characteristics, were widely tested by standard classification models to demonstrate their combinational prognostic capabilities.
Materials|Methods
The study comprised of 234 female patients from - Sun Yat-sen University Cancer Center (Guangzhou, China P. R.). The consecutive patients (mean age, 46.2 years ±10.9 [standard deviation]; range, 18–78 years) were enrolled into the study between September 2008 and December 2011. This study was approved by the Ethics Committee of Sun Yat-sen University Cancer Center, and all patients signed consent to participate in this study.
There were 85 benign lesions and 149 malignant lesions. Enrollment of the lesions abided by a strict inclusion criteria: (a) MR imaging was performed on a 1.5 T superconductive magnetic system (GE, Signa, HDx), with a bilateral, dedicated four-channel phased-array breast coil in its prone position.; (b) both DCE-MR imaging and DW MR imaging sequences were performed; (c) diagnosis was confirmed following a pathological analysis after core-needle biopsy or surgical excision (248 lesions), or lesion stability was confirmed at a minimum follow-up of 2 years (27 lesions); (d) lesions were presented as a mass according to the BI-RADS MRI lexicon; and (e) patients had not had a biopsy or received therapy before MR examination. Table 1 shows the distribution of histopathological findings of all analyzed lesions.
To fully characterize the pictorial properties of the lesions, four different groups of features were estimated from the image to portray the distinct and remarkable features related to lesions, and another one group included the patients’ pathological test results. The five groups produced twenty-eight measurements (called feature herein) for each lesion. All the features obtained were extracted by two radiologists with ten years’ experience in interpreting breast MR. They were blind to the histological results on current patients. The images were assessed independently and all disagreements were resolved through consensus. All images were analyzed on a workstation (Centricity Radiology RA 600 V 7.0, GE, USA). The four groups of features were summarized below:
Kinetic features: The shape of time-signal intensity curve has been shown to be an important criteria in differentiating benign from malignant breast lesions [23] . Both of the early-phase enhancement and the signal enhancement ratio (SER) [24] were estimated to represent the kinetic behavior of the lesion signal intensity of lesion before and after the injection of Gd-DTPA. They are defined as:
where , and represent the signal intensity in the pre-contrast, the first post-contrast and the last images, respectively. The morphology and enhancement kinetic features were also investigated to determine their diagnostic performance to differentiate between malignant and benign lesions that present as mass versus non-mass types [26] , [27] .
Morphological Features: The manually identified lesion was further segmented to have its contours. The segmentation used a two-step approach to incorporate fuzzy c-means (FCM) clustering [28] and gradient vector flow (GVF) snake algorithm [29] . Once the lesion was segmented, eleven morphological features were calculated to quantify its morphological characteristics. The lexicon by using morphology characteristics, such as shape and margin categories, have long been adopted in discrimination of breast lesion [30] . Its diagnostic capability were also widely studied by combining it with various factors, such as kinetic descriptor [31] , texture features [26] , [32] and DWI [33] . In the current study, eleven morphological features include compactness, spiculation, extent, elongation, solidity, circularity, entropy of radial length distribution, fractal, heterogeneity, area, and eccentricity were borrowed to serve as morphological characterization. Inclusion of the eleven features followed a strict criteria: either they are used in clinical practice or have been reported to be effective [30] , [34] . An illustrate examples is shown in Figure 1 .
Texture Features: The textural attributes evaluated via GLCM method were combined with morphologic descriptors in DCE-MRI to achieve a nice discrimination power [30] , [31] , [32] , [35] . It has also been reported that MRI texture features are significantly associated with breast tumor subtype and neoadjuvant therapy response. Thirteen texture features were estimated on the segmented lesion through its gray level co-occurrence matrix (GLCM) [36] . The texture features included: angular second moment, contrast, correlation, inverse difference moment, sum average, sum variance, sum entropy, entropy, difference average, difference variance, difference entropy, information measure of correlation 1, and information measure of correlation 2 [36] . This feature group is widely used in field of pattern recognition, such as handwriting discrimination [37] , [38] , and medical image analysis [39] , [40] . Readers can refer to File S1 for the rigorous mathematical definitions of the pictorial features.
DWI Features: The apparent diffusion coefficient (ADC) value was used to quantify the Diffusion weighted (DW) MRI. Firstly, the region of interests (ROIs) were manually drawn on the diffusion-weighted images (b = 800 s/mm2) ( Figure 2 ) by carefully inspecting the regions with high signal. ROIs that were larger than 20 mm 2 were considered meaningful and therefore retained for further analysis [41] . Then the DWI intensity for each lesion was dichotomized into low and high values by that of the corresponding background breast tissue. Finally, the mean ADC values were then obtained to serves as the quantification of the DWI characteristics.
(a) Area including a suspicious breast lesion is highlighted by a blue rectangle; (b) Initial segmentation result on (a) by using FCM-based method; (c) Final segmented lesion after GVF snake model initialized from (b).
(a) Raw dynamic contrast-enhanced MR image on lesion, which exhibits high signal intensity. The mass-like enhancement area is marked by purple arrow and the lesion; (b) Raw Diffusion-weighted MR image (b = 800 s/mm 2 ); (c) Calculated ADC map from (b). Lesion area exhibits with light green (pointed in purple arrow), implying a high ADC value. ADC measured in this lesion is 1.91×10 −3 s/mm 2 .
The status of breast masses enrolled in the study was all verified in histopathology, or confirmed by at least two years of follow-up subsequently. Therefore, the features aforementioned, coupling with the lesion status, can be considered as a binary classification problem.
Univariate analysis is limited since it ignores the role of combinational potentials which could provide a good classification. Therefore, we conducted firstly on the selection of a subgroup of informative variables that were able to distinguish malignant lesions from benign ones. This process is known as feature subset selection (FSS) [42] , [43] , [44] , [45] .
Feature selection algorithms usually fall into two categories [42] : filter and wrapper methods. Filter selects subsets of features as a preprocessing step, independently of the chosen predictor. In comparison, wrapper uses a base classifier to score subsets of features according to their predictive power. In many cases, wrapping with classical classifiers such as Support Vector Machine [44] , Naive Bayes [46] and Nearest Neighbors produce comparable performance [47] . The wrapper has the advantage of better performance; however, its usage in biomedical area is limited due to its high computational cost [42] . To alleviate this problem, we used a hybrid filter-wrapper algorithm [48] . In this hybrid feature selection model, the features were firstly filtered by t- test to find out the statistically significant variables with confidence level of 95%. The 24 variables obtained are then gone through FSS via the wrapper of the classifier of SVM. To alleviate computation cost in wrapping, genetic algorithms was used to find out an informative feature subset. After this step, thirteen features were selected. In the final step, each feature left was examined through the classification test by SVM to remove the features whose contribution to classification accuracy is negligible when it was omitted. Therefore, a compact but highly informative feature subset was obtained. The main advantage of this hybrid approach is that it remains a great part of advantages in wrapper, while reducing the computation cost greatly. We draw a workflow to illustrate the hybrid FSS algorithm in Fig. 3 . Table 2 summarized the features removed after each step and the resulted compact features.
The combination of the parameters as a whole could reflect different aspects of lesion properties and is potentially a comprehensive approach to characterize lesion status [49] . The differentiation of malignant from benign lesions was treated as a two-class pattern classification problem. Classical classification algorithms, including support vector machine (SVM) [44] , Naïve Bayes (NB), k-nearest neighbors (KNN), and logistic regression (LR) model, were used to evaluate the diagnostic performance of the carefully selected variables [44] , [47] , [50] . To make an extensive comparison, the derived classier was evaluated through ten-fold cross validation scheme. In the scheme, the data were randomly divided into ten equal subsets. In each experiment, nine subsets were used to construct the predication model and the one left behind was served for testing. The averaged performance after ten times’ experiments was used to evaluate the prognostic capabilities of the selected variables by using measurements including sensitivity, specificity, area under the ROC curve (AUC) and overall accuracy (OA). The hyper-parameters involved in classification models were estimated via five-fold cross validation scheme before testing the corresponding classification algorithm.
Supplementary Material
Quantitative measurements of breast lesions.
(DOCX)
Click here for additional data file.
Text is read by the "Ask this paper" AI Q&A widget below.
Extraction quality varies by source — PMC NXML preserves structure
cleanly, OA-HTML may include some navigation residue, and OA-PDF can
have broken hyphenation. The publisher copy
(via DOI)
is the canonical version.