 Research article
 Open Access
 Open Peer Review
 Published:
Automatic glioma segmentation based on adaptive superpixel
BMC Medical Imagingvolume 19, Article number: 73 (2019)
Abstract
Background
The automatic glioma segmentation is of great significance for clinical practice. This study aims to propose an automatic method based on superpixel for glioma segmentation from the T2 weighted Magnetic Resonance Imaging.
Methods
The proposed method mainly includes three steps. First, we propose an adaptive superpixel generation algorithm based on simple linear iterative clustering version with 0 parameter (ASLIC0). This algorithm can acquire a superpixel image with fewer superpixels and better fit the boundary of region of interest (ROI) by automatically selecting the optimal number of superpixels. Second, we compose a training set by calculating the statistical, texture, curvature and fractal features for each superpixel. Third, Support Vector Machine (SVM) is used to train classification model based on the features of the second step.
Results
The experimental results on Multimodal Brain Tumor Image Segmentation Benchmark 2017 (BraTS2017) show that the proposed method has good segmentation performance. The average Dice, Hausdorff distance, sensitivity, and specificity for the segmented tumor against the ground truth are 0.8492, 3.4697 pixels, 81.47, and 99.64%, respectively. The proposed method shows good stability on high and lowgrade glioma samples. Comparative experimental results show that the proposed method has superior performance.
Conclusions
This provides a close match to expert delineation across all grades of glioma, leading to a fast and reproducible method of glioma segmentation.
Background
Glioma is a prevalent brain disease with high malignancy, mortality, and disability [1, 2]. Magnetic resonance imaging (MRI) is widely used in the clinical diagnosis of glioma, can clearly reflect the anatomical structure of human soft tissue, and can accurately display the location, size and histological characteristics of lesions. The segmentation of glioma lesions are the key steps for computeraided diagnosis, surgery, radiotherapy, and chemotherapy planning of brain glioma.
Gliomas show infiltrative growth with lack of clear boundary and fixed growth pattern. Complex pathological changes, such as hemorrhage, necrosis, and edema, are found inside tumors. Gliomas show complex changes in brightness and texture on MRI images because of the complex pathological changes. Different tissues may have similar gray values, which present challenges to the accurate, repeatable, and stable segmentation of gliomas.
In clinical application, radiologists mainly perform manual segmentation, which is subjective, has heavy workload, and difficult to achieve repetitive segmentation. Some semiautomatic segmentation algorithms can segment ROI with minimal human interaction, integrate the advantages of manual and automatic segmentation, and improve segmentation efficiency. However, applying the scene that needs automated processing is difficult because of the necessity to set initial seed points, thresholds, and iteration termination conditions, among others. Automatic segmentation is completely controlled by an algorithm without human interaction. The segmentation speed is high and the results are repeatable. Automatic segmentation is conducive to the endtoend application development of glioma [3]. Automatic segmentation is the main research direction of glioma segmentation, while improving the accuracy of segmentation is the key challenge.
In clinical practice, radiologists make a comprehensive diagnosis of glioma on the basis of the characteristics of various MRIs. Commonly used sequences generally include at least four types: T1weighted imaging (T1), T2weighted imaging (T2), fluidattenuated inversion recovery (FLAIR) imaging, and contrastenhanced T1weighted (CET1) imaging [4, 5]. CET1 can reflect the blood flow information of a lesion, T1 provides anatomical information, FLAIR imaging can help distinguish the cerebrospinal fluid of the edema area, and T2 is sensitive to the edema area and can provide such information as tumor boundary and edema degree [6]. In these sequences, T2 images can considerably reflect the morphological information of tumors and are often used in clinical segmentation of gliomas. Moreover, using the segmentation result of the edema area as ROI of each sequence can provide information on all types of regions of tumors because such an area often contains the real and necrotic areas of tumors. Therefore, the design of an automatic segmentation algorithm for T2 sequence has superior clinical value.
Related studies
Glioma segmentation algorithms can be divided into regionbased, edgeconstrained, classification or clustering, and some hybrid methods [7].
Regionbased methods obtain the segmentation result by iteratively adding adjacent to the seed points through similarity evaluation. Region growth algorithms is a typical representation of the regionbased methods, while the key points are the design of similar metrics and growth rules [8]. The disadvantage is that the seed points should be specified manually. Ref. [9] implements the initialization of algorithm by mapping a tumor with multispectral histogram. Ref. [10] proposes the semiautomatic segmentation algorithm LuTA for lung cancer tumor using region growth algorithm. Ref. [11] extends LuTA by developing an automatic seed point generation algorithm, which automatically generates multiseed points in the core region of tumors to achieve automatic segmentation.
The edgeconstrained methods use the feature that the target object’s gray level changes substantially in the edge position to segment ROI. An active contour model can maximize the related prior knowledge to constrain the image segmentation process. Snake model is one of the representative algorithms of the active contour model, which considers image segmentation as an energy minimization problem [12]. Brightness and texture features in Ref. [13] are used to drive the active contour to approach the tumor boundary in different MRI sequences. The level set segmentation algorithm implicitly represents the evolution curve as a zerolevel set of high dimensional level set functions, which has a good theoretical basis, can be rapidly extended to threedimensional segmentation and is extensively used in the segmentation of gliomas [14,15,16]. Chan and Vese construct external forces to guide the evolution of curves by mean values of the inner and outer regions, and proposed a level set method ChanVese (CV) based on the global regional gray mean value [17]. However, the problem of edge overflow is prevalent using the level set segmentation algorithm, which needs to be further deepened and improved, owing to the heterogeneity of glioma and unclear boundary between tissues.
The classification or clustering methods divide a group of objects into several categories on the basis of the simple and intuitive principle that intra and interclass distances are small and large, respectively. Ref. [18] explores the user of Kmeans clustering for segmentation of different brain tissues. Ref. [19] uses SVM in the segmentation of brain tumors. Deep neural networks are also used for brain tumor segmentation [20,21,22]. In Ref. [22], a customized convolutional neural network is used to segment glioblastoma, thereby achieving automation. However, deep learning remains difficult to apply in glioma segmentation because of the difficulty of obtaining highquality glioma samples. Ref. [23] applies a random forest with contextaware features to identify subregions of tumors in MRI images. Given the characteristics of the random forest algorithm, this algorithm’s repeatability is not high, while difficulty is observed in achieving the continuous improvement of the existing model for the new sample. Ref. [24] extends the multiplicative inner composition optimization algorithm and applies it to the semiautomatic segmentation of glioma. Although good results were achieved, the interaction of the radiologist remains necessary. However, additional information may lead to other bias, which needs to be carefully screened in model selection.
Superpixelbased glioma segmentation is a hybrid method. This type of segmentation uses the clustering method to segment superpixels and trains classifiers on the basis of features calculated from each superpixel to classify tumor regions. Ref. [25] calculates the firstorder intensity statistics features, Gabor textons, fractal analysis, and curvature features from each superpixel and realizes the detection and segmentation of brain tumors in the FLAIR images using the extremely randomized trees (ERT) classifier. It proves that the combination of superpixel segmentation and machine learning classification is feasible for brain tumor segmentation. Ref. [26] performed segmentation based on graphical models with a probability maximization framework, which uses conditional random field to model the spatial interactions among image superpixel regions. ℓ_{1}regularization was performed with statistics features, texture features, curve features and fractal features among objective function optimization. Ref. [27] proposed a superpixel segmentation to generate approximately structural superpixels with sharp boundary adherence and comprehensive semantic information, and applied the method to brain tissue segmentation to illustrate the superior performance. Ref. [28] presents an iterative spatial fuzzy clustering algorithm to generate 3D supervoxels for brain MRI volume based on prior knowledge of generating reliable seeds from a populationbased brain template MRI image. Ref. [29] extracted supervoxels by the SLIC method and calculated intensity histogram, texture and shape features from each supervoxels, training a multinomial logistic regression by maximizing the mutual information between the data and their labels, and then automatically assigns a supervoxel with a class label.
For the segmentation based on superpixel, the distribution of superpixels will directly affect the segmentation results. Two parameters, namely, number of superpixels and compactness, are critical to the superpixel distribution. At present, hyperparameters are mainly searched using grid or set default values, although obtaining the best parameter remains challenging. Ref. [25] set fixed parameters for SLIC algorithm with 1600 superpixels and compactness equals 0.2. Ref. [26] uses SLIC0 for superpixel segmentation, compactness is not needed, the search for the optimal number of superpixels is performed through grid search, the search range is from 40 to 260, step size is 20, compactness is set to 40, and the number of iterations set to 10. Since the new sample does not have ground truth, it is impossible to determine the optimal number of superpixels, so it can’t be used directly.
Superpixel segmentation preprocesses a pixellevel image into a block image by merging the homogeneous regions, thereby obtaining a few regions and effective spatial location information. This type of segmentation can effectively reduce the difficulty of postprocessing and improve the robustness of the algorithm. After the glioma image is segmented by superpixel, ROI is concentrated in at least one adjacent superpixel block. The heterogeneity of brightness and texture on the superpixel block reflects the heterogeneity of tumors. The statistical, texture, curvature, and fractal features of each superpixel block are well distinguished. We can realize the segmentation of ROI by classifying the superpixel blocks using machine learning method. This study analyzes the automatic segmentation method of glioma using superpixels. The main contributions of this research are as follows.

1.
Given that the simple linear iterative clustering version with 0 parameter (SLIC0) algorithm needs to set the hyperparameter of the number of superpixels, this study proposes the adaptive SLIC0 (ASLIC0) algorithm, which can automatically estimate the optimal number of superpixels. The proposed algorithm achieves a fully automatic and efficient superpixel segmentation in the T2 images. Moreover, ASLIC0 does not need human intervention and has good stability and repeatability.

2.
The current research aims to design a framework for the segmentation of glioma using superpixel features and machine learning. We compute the statistical, texture, curvature, and fractal features for each superpixel. Thereafter, the classifier is trained using SVM.
Methods
Automatic glioma segmentation based on adaptive superpixel adopts the following steps: (1) Perform ASLIC0 to obtain superpixel images that fit well with the tumor boundary and have only a few superpixels; (2) Generate the training set by calculating the features and label for each superpixel; and (3) Train the classifier using the SVM model and classify the superpixel into tumor or nontumor regions. Figure 1 shows the flowchart of the proposed framework.
Adaptive superpixel partitioning
The simple linear iterative clustering (SLIC) [30] method partitions images into superpixel patches using the kmeans clustering algorithm. The distance measure in clustering algorithm includes the distance of the gray space d_{c} and Euclidean distance of pixels d_{s}. The calculation formulas are (Eqs. 1 and 2), respectively. The distance D of two pixels is calculated using Eq. (3).
where I_{i} and I_{j} are the gray values of pixels i and j, respectively.
where x and y are the coordinate values.
In Eq. (3), parameter S is used to limit the range of local clustering. In the SLIC algorithm, \( S=\sqrt{N/K} \), where N is the total number of images and K is the number of superpixels. Compactness C can be used as a balance parameter to adjust the relationship between color distance and spatial distance. Equation (3) shows that the parameters that should be set manually in SLIC include K and C. Accordingly, the selection of these two parameters will directly affect the performance of segmentation. Parameter K determines the number range of irregular regions; the larger K is, the smaller the size of the superpixel block is. Compactness C determines the proportion of spatial distance. When C is large, the proportion of spatial distance will increase, while the superpixel will have a smooth boundary. When C is small, the boundary of superpixel will be close to the edge of the image but the shape and size will be considerably irregular. Therefore, the key to the effective implementation of the SLIC algorithm is to find the best K and C.
The SLIC with 0 parameter (SLIC0) algorithm [31, 32] improves the selection of the C value by changing the fixed value of SLIC to an adaptive value for each superpixel in the first iteration, thereby solving the problem of the C parameter selection. Experiments on the T2weighted MR images of gliomas show that the SLIC0 algorithm can generate relatively regular superpixels in flat and highly variable regions and bring the superpixel close to the tumors or edema regions. Figure 2 shows that for highgrade gliomas (HGG) and lowgrade gliomas (LGG), the superpixel blocks obtained by the SLIC0 algorithm can substantially fit the tumor boundary. Therefore, the SLIC0 algorithm solves the problem of hyperparameter C selection, thereby resulting in the key problem of superpixel segmentation becoming the problem of the hyperparameter K selection. This study proposes an ASLIC0 algorithm, while the automatic selection of the hyperparameter K is realized.
Experiments show that the hyperparameter K is directly related to the segmentation effect. When K is considerably small, the size of the superpixel blocks is substantially large, thereby possibly leading to difficulty in distinguishing ROI. If K is considerably large, then the size of each superpixel will be substantially small, thereby resulting in each superpixel block losing regional features. This loss results in the lack of representativeness of the features that will be eventually calculated, thereby leading to the reduction of segmentation accuracy. Given the increase in superpixel blocks, the demand for computing resources will increase, while the advantages of the superpixel segmentation will be reduced. Figure 3 shows the segmentation effect under a various number of superpixels. The blue line is the superpixel boundary, while the pink line circles the ROI boundary. Evidently, the increase in the number of superpixels results in the boundary between superpixels and ROI becoming increasingly consistent with the actual situation. When the number of superpixels exceeds 150, the change of superpixels in the ROI is not evident.
Numerous observations have shown that the best value of the hyperparametric K is directly related to the size of the tumor and complexity of the tumor boundary. To find the best value of the hyperparameter K, which can segment the ROI well while the value is small, this study designed two evaluation indices, namely, area ratio of tumors (TAR) and boundary complexity of tumors (TC). Moreover, TAR and TC are combined with the best K value labeled by hand to form a training set. The K value of the new sample is predicted by training the random forest model.
Evaluation index of tumor
This research used TAR to reflect the volume of tumors. However, the method of calibrating the region of the tumor becomes a key problem that should be solved because the image does not know the location information of the tumor before segmentation. The normal brain tissue is a symmetrical structure because of the particularity of the head, while the appearance of a tumor tissue breaks this symmetry. Therefore, we look for the asymmetrical region in the left and right hemispheres as the tumor area. Figure 4 shows the method of finding suspected tumor areas.
The following steps are performed on the original image (Fig. 4 (A)).

(1)
Image correction is performed, in which the majority of the areas of the corrected image are symmetrical with respect to the midline (Fig. 4 (B)) [33].

(2)
The entire image is divided into an average of 256 grids by placing a grid on the image (Fig. 4 (C)). The horizontal and vertical grids are divided into 16 equal parts (15 pixels each).

(3)
Equation 4 is used to calculate the similarity of the pixels in the corresponding grids of the left hemispheres (A) and right hemispheres (B) of the brain.
Where m and n represent the size of the grid, all of them were 15 in this study.

(4)
When the similarity r is below the threshold (threshold is 0.81), both regions in the left and right hemispheres are considered suspected tumor areas (Fig. 4 (C)). Lastly, the number of blocks in left hemispheres is counted as n.

(5)
TAR is calculated by TAR = n/256.

(6)
The tumor boundary complexity index TC can be measured using the ratio of the perimeter to the area of the tumor. For the suspected tumor area calculated in step 4, TC is calculated using Eq. 5. To calculate conveniently, the number of pixels in the boundary is used to replace the perimeter, while the number of pixels in the suspected area is used to replace the area.
The function N is used to calculate the number of pixels.
Evaluation of the best value of K
For each image in BraTS2017, the optimal hyperparameter K is searched through a grid search, in which the search range is from 10 to 450, while the search step is 10.
For the superpixel image of each K in the grid search, the proportion of each superpixel to the manual segmentation (ground truth) is calculated. The superpixels with a ratio of over 90% are merged into the superpixel ROI, which is denoted as variable A. The result of the ground truth is denoted as variable B. The Dice index is calculated using Eq. 6 [34].
Function S denotes the area. The closer the value of Dice is to 1, the better the effect of K is.
The Dice index indicates that the performance of the different K in the grid search is evaluated. For the same image, the experimental results show that good results can be obtained in a certain range of K. Figure 5 shows that for image 1 (blue), the result of Dice is approximately the same when K is above 60 but below 130. For image 2 (red), when K is above 150 but below 210, the result of Dice is approximately the same. This observation indicates that to make K have better robustness, the manual selection of K in the middle is a good choice. For the two images in Fig. 5, 100 and 170 are selected.
Prediction model of K
The best choice of K is extremely different for the different glioma images. Figure 6 lists several examples of highgrade glioma (HGG) and lowgrade glioma (LGG) and shows no fixed pattern for the selection of K. Thus, we need to determine the applicable rules through machine learning. For all BraTS2017 images containing tumors, TAR and TC are calculated, while K is manually selected as the target value. Thereafter, a regression model is trained using random forest. We will use the trained model to predict K.
Superpixel annotation and feature extraction
Image preprocessing
Numerous black backgrounds apart from the head are observed in brain MRI images. Background does not make sense for research but increases computation. Therefore, the background should be removed before the feature calculation to reduce the impact of the background.
Overall, the brightness of the background is small, although there may be some large values because of the noise. The influence of noise can be eliminated by calculating the mean value of the superpixel. This study uses the threshold method to remove background. When the average brightness of pixels in the superpixel is below the threshold value, the superpixel will be removed. The threshold used in this study is that the average brightness is below 5.
Superpixel annotation
To train the superpixel classification model, whether the superpixel is a tumor area should be known to determine the performance of the classifier. This research uses manual segmentation as ground truth, while the Dice similarity coefficient is used to determine whether a superpixel belongs to a tumor area. When the Dice value is above the threshold value, it is determined as the tumor area; otherwise, it is a nontumor area. For example, superpixel A in Fig. 7 does not belong to the tumor region because of the small proportion of this tumor region. By contrast, superpixel B belongs to the tumor region because the proportion of this region is above the threshold. Threshold vary slightly depending on the image sequence.
Feature extraction
Feature extraction aims to quantify each superpixel. The intensity distribution of the pixels inside the superpixel should be transformed into comparable features. The features in this study include intensity statistical, texture, curvature, and fractal features, totaling 69.
Intensity statistical features
Intensity statistical features are based on the firstorder statistics of histogram and describes the distribution of values without considering their spatial relationship, including 17 statistical features (e.g., energy, entropy, mean, maximum, and median). Standard deviation, variation, and mean absolute deviation are used to evaluate the dispersion degree of statistical histogram. Variation, kurtosis, and skewness are commonly used central moments. In particular, skewness reflects the asymmetry degree of the statistical histogram deviating from the mean, while kurtosis reflects the steepness and slowness of the histogram distribution. Uniformity and entropy are calculated to measure the randomness degree of the histogram.
Texture features
The texture is an important visual cue, which is ubiquitous and difficult to describe in images. Gray level cooccurrence matrix (GLCM) describes the secondorder joint probability function of an image. A variety of GLCMs can be obtained from different directions and asynchronous lengths, while the corresponding Haralick texture features can be calculated [35]. Ref. [36] discusses that some texture information will be lost in the original images because of the influence of noise. Multilevel partial derivative mapping images can obtain images with rich texture structure [36, 37]. This study calculates GLCM from the original image, the gradient mapping map is calculated using the Roberts operator, and the gray level gradient cooccurrence matrix (GLGCM) is calculated, the curvature mapping map is calculated using the Prewitt operator, and the gray level curvature cooccurrence matrix (GLCCM) is calculated. The Haralick texture features are calculated for the GLCM, GLGCM, and GLCCM matrices.
Curvature feature
Curvature feature is a shapebased feature in image, and a measure of image irregularity. This feature is widely used in computer vision.
For image I, if f_{x} and f_{y} represent the gradient of the image along with the x and y directions respectively, f_{xx} and f_{yy} are the secondorder partial derivatives of image I(x, y). Accordingly, the curvature of the image is calculated using Eq. 7.
Given that the curvature is calculated for a single pixel, the curvature feature in a superpixel is defined as the average curvature of all the pixels in the superpixel.
Fractal features
Given the heterogeneity of gliomas, the tumor area shows complex structures and irregularities, while the normal brain tissue is regular and smooth. Moreover, the tumor area also shows similar structure and roughness. By utilizing the characteristics of the fractal features, the corresponding superpixels at a certain scale in the tumor area have selfsimilarity and good distinction between the tumor lesion and normal tissue. The current study uses the Otsu algorithm [38] to obtain binary images with different thresholds, while the fractal edge information of each binary image is obtained. we choose 4 as the number of channels to obtain good results and reduce the computational complexity in the implementation of the Otsu algorithm. Thereafter, the fractal features corresponding to superpixels are calculated (D, E, F and G in Fig. 8). The fractal features include the area, average brightness (rows 1, 2 and 3 of columns G, I, J and K in Fig. 8), and fractal distance, which is obtained using the box algorithm [39]. The process of extracting fractal features is shown in Fig. 8.
Machine learning tumor segmentation
For the feature set calculated from each superpixel, the machine learning algorithm is used to train a classification model to classify the tumors and nontumors, thereby achieving the segmentation of glioma. As a classical classification algorithm, SVM is widely used in machine learning, computer vision, and data mining. The basic idea of SVM is to find the maximum separating hyperplane in the sample space of the training set and separate the training samples. This research uses SVM as a classifier because the final model is only related to the support vector and overfitting is difficult to produce.
This study uses the statistical and machine learning toolkit of MATLAB to train the SVM classifier. Bayesian optimization is used in the training process, while radial basis function (RBF) is used as kernel function. The training data are standardized among the training processing. In all data, 80% of the samples were used as training set (228 cases) and 20% samples were retained as test set (57 cases). During the model training, 5folds crossvalidation is used to select the final model.
Results
Data set
For convenience, this study uses the public data set BraTS2017 [6, 40], the data sources of which include the Cancer Genome Atlas and Cancer Imaging Archive. All data include the T1, CET1, T2, and FLAIR sequences and have been preprocessed with the same resolution and registered with the same anatomical template. This research is based on the 2D image of the T2 sequence. BraTS2017 contains 285 preoperative glioma samples, include 210 HGG samples and 75 LGG samples. Although each sample contains 155 slices, these images are obtained by head registration with fewer original slices. To ensure the representativeness of the samples, the slice of the median of the tumor pixels in each sample is used as the training image.
Selection of parameters
To predict the value of K, a regression model is trained by random forest using TAR and TC, while K is manually selected as a training set. Rsquare is used to evaluate the fit between the predicted K value and manually selected K value. Rsquare is calculated using Eq. 8.
The denominator represents the dispersion of K, while the numerator represents the error between the predicted result and best K. Rsquare can substantially evaluate the regression model. Accordingly, the closer its value to 1, the better result will be obtained.
In the random forest training, the number of trees is 5, while the maximum tree depth is not set. When the maximum number of instances exceeds 4, the nodes are stopped from splitting.
The experimental results show that the final training model can fit K substantially, while Rsquare is 0.9719. Figure 9 shows the scatter plot of the best K and predicted values, while the red line is the fitting line. The closer the red line is to y = x, the better result will be obtained. The fitting curve of this experiment is y = 0.92x + 6.7.
Statistical features are directly calculated from the intensity of the pixel in each superpixel. Given that the original image is stored by 12 bits, the texture feature with such large gray value cannot considerably express the texture characteristics. Before calculating the texture features, gray resampling of the original brightness is necessary. This study uses 8, 16, 32, and 64 Gy levels to calculate the texture features. The calculation of GLCM is performed in the 0^{°}, 45^{°}, 90^{°}, and 135^{°} directions, while the step is 1. Curvature feature is calculated from the intensity of the pixel, while the mean value is used as the feature of the corresponding superpixel. Fractal features are calculated using four channels.
Segmentation results
During the test process, the test samples are processed into superpixel images by ASLIC0 algorithm, and four kinds of features are calculated for each superpixel. Superpixels predicted as tumor regions constitute the final segmentation. For all segmentation result of the test set, the average value of Dice, and Hausdorff distance (HD) [28], sensitivity and specificity were calculated to evaluate the algorithm.
Table 1 shows the segmentation performance of our method on BraTS2017. The method presented in this study has a good performance for images with high contrast between tumor areas and normal tissues in glioma images. Moreover, good results can be obtained on the HGG and LGG samples.
Figure 10 shows some segmentation results. Each row from top to bottom represents samples with different positions, brightness contrast, and tumor appearance. The left three columns are HGG samples, while the right three columns are LGG samples. Sublabels 1 and 2 in the three columns represent the original image and boundary of the ground truth, respectively. Sublabel 3 shows the comparison between the boundary of the segmentation result and ground truth. The blue and red lines represent the segmentation result and ground truth, respectively. Overall, the majority of the segmentation results have good performance.
Observations also show that the segmentation boundaries are slightly closer to the inner pixels than the ground truth. This result is related to the tendency of manual segmentation and characteristics of superpixel segmentation. In the T2 sequence, the brightness of the tumor area is often high, while the color of brain tissue around the tumor is relatively dark. In manual segmentation, the edge is often placed in the lowbrightness region to ensure that the entire tumor area can be included. In superpixel clustering, the brightness distance is dominant at the edge position. Thus, the edge will be placed in the highbrightness region, thereby enabling the segmentation results to be closer to the actual tumor area than the manual segmentation results. This outcome will not affect the actual clinical application. If necessary, the boundary can be expanded by 1 to 3 pixels through postprocessing.
Comparative experimental results
To compare the performance of the methods, the authors use classical segmentation algorithms and similar algorithms for comparative experiments. These algorithms include classical segmentation Snake [12], region growth [11], the classical level set method Chan–Vese (CV) [17], and two superpixelbased algorithms [25, 26]. All experiments use the same origin data. The seed of the region growth is initiated at the mean coordinates of ground truth, while the initiate level set function around the same seed by a circle with a diameter of 2 pixels and initiate the snake mask around the seed by 2 pixels. For the experiments in Ref. [25], K and compactness are set to 1600 and 0.2, respectively. For the experiments in Ref. [26], the search for K is performed through grid search, the search range is from 40 to 260, step size is 20, compactness is set to 40, and the number of iterations set to 10. Table 2 shows the comparison results.
The experimental results show that the proposed method is superior to traditional methods, such as snake, region growth, and CV. Competence in automated scenarios is difficult to achieve because of the heterogeneity of glioma and the need for the hyperparameter selection of the classical algorithms, its iterative evolution mechanism is more suitable for better use in semiautomated scenarios.
The performance of the proposed method is slightly higher than the methods of Refs. [25, 26]. The reason may be that the prediction algorithm of the optimal hyperparameter K improves the quality of the superpixels. Ref. [25] chooses the number of hyperparameters by grid search, in which the search step is 20. However, the best hyperparameter K may not be found because the search step is considerably large. Using fixed K and C in Ref. [26] is feasible, although achieving optimal results is difficult. Evidently, Fig. 5 shows that when the number of K exceeds a certain value, the performance decreases slightly but essentially remains unchanged.
Discussions
The proposed method works well for most of the time, but the effect become worse when image comes to have blurred edges, or tumor area presents a large number of the cross with other normal tissues, or ROI’s gray level contains much overlapping with neighboring tissues. Figure 11 shows two examples of method ineffectiveness. In the first row, the contrast between the core area and the edema area is large, and the contrast between the edema area and normal brain tissue is not obvious. Therefore, the edema area does not generate superpixel, which makes the final classification model unable to work well, and Dice equals 0.5505. Compare to ground truth, our method succeeded in finding the core area. In the second row, tumor areas have no distinct boundaries and are poorly differentiated from surrounding tissues, similar to the first row, our method also cannot produce good segmentation, the Dice equals 0.4938. In these cases, improving the accuracy of superpixel partitioning remains the main challenge.
Brats2017 contains four sequences: T1, T2, FLAIR and CET1. Experiments show that our method works well on T2, FLAIR. We made a preliminary analysis, which may be due to the fact that on T2 and FLAIR, tumors are usually highlighted and their borders are relatively clear, while on T1, the area of the tumor is dark and have much overlap with brain tissue. The segmentation of the T2 sequence in our method is actually the segmentation of edema area. The original MR image of glioma is 3D image, the adjacent information between slices may promoting the effect of segmentation and reduce the overall segmentation time. This research is based on the 2D image of the T2 sequence, but this method can be easily extended to 3D images. Our next research will focus on 3D images.
Conclusions
This study proposes an automatic segmentation method for brain glioma on the basis of the T2 sequence of BraTS2017. For the segmentation of superpixel, an ASLIC0 algorithm based on SLIC0 is proposed. In the ASLIC0 algorithm, the optimal hyperparameter K is predicted by training a random forest through the design of two evaluation indicators, namely, ratio of tumor area and complexity of tumor boundary. The experimental results show that the random forest model can considerably fit K, while Rsquare is 0.9719. Superpixel images with only a few superpixels and close to the tumor boundary can be obtained using ASLIC0. The SVM prediction model is trained by calculating the statistical, texture, curvature, and fractal features of each superpixel. Meanwhile, the automatic segmentation of glioma are realized by classifying superpixels into tumor or nontumor types. The experimental results on BraTS2017 show that the proposed method has good segmentation performance. The average Dice was 0.8492, Hausdorff distance was 3.4697 pixels, and sensitivity and specificity were 81.47 and 99.64%, respectively. The proposed method has good performance on the HGG and LGG samples, thereby showing that the proposed algorithm has good stability. Comparative experimental results also show that the proposed algorithm has superior performance.
Availability of data and materials
All data generated or analyzed during this study are included in the Multimodal Brain Tumor Image Segmentation Benchmark 2017 (BraTS2017).
You can get data at URL: https://www.med.upenn.edu/sbia/brats2017/data.html
Abbreviations
 ASLIC0:

Adaptive superpixel generation algorithm based on simple linear iterative clustering version with 0 parameter
 BraTS2017:

Multimodal Brain Tumor Image Segmentation Benchmark 2017
 CET1:

Contrastenhanced T1weighted (CET1) imaging
 ERT:

Extremely randomized trees
 FLAIR:

Fluidattenuated inversion recovery imaging
 GLCCM:

Gray level curvature cooccurrence matrix
 GLCM:

Gray level cooccurrence matrix
 GLGCM:

Gray level gradient cooccurrence matrix
 HGG:

Highgrade glioma
 LGG:

Lowgrade glioma
 MRI:

Magnetic resonance imaging
 ROI:

Region of interest
 SVM:

Support Vector Machine
 T1:

T1weighted imaging
 T2:

T2weighted imaging
 TAR:

Area ratio of tumors
 TC:

Boundary complexity of tumors (TC)
References
 1.
Louis DN, et al. The 2016 World Health Organization classification of tumors of the central nervous system: a summary. Acta Neuropathol. 2016;131(6):803–20.
 2.
Ostrom QT, et al. CBTRUS statistical report: primary brain and other central nervous system tumors diagnosed in the United States in 2009–2013. NeuroOncology. 2016;18(5):1–75.
 3.
Hossein A, et al. Magnetic resonance imagingbased target volume delineation in radiation therapy treatment planning for brain tumors using localized regionbased active contour. Int J Radiat Oncol Biol Phys. 2013;87(1):195–201.
 4.
Zhang X, et al. Radiomics strategy for molecular subtype stratification of lowergrade glioma: detecting IDH and TP53 mutations based on multimodal MRI. J Magn Reson Imaging. 2018;48(4):916–26.
 5.
Fouke SJ, Benzinger T, Gibson D, Ryken TC, Kalkanis SN, Olson JJ. The role of imaging in the management of adults with diffuse low grade glioma. J NeuroOncol. 2015;125(3):457–79.
 6.
Menze BH, et al. The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans Med Imaging. 2015;34(10):1993–2024.
 7.
Bauer S, Wiest R, Nolte LP, Reyes M. A survey of MRIbased medical image analysis for brain tumor studies. Phys Med Biol. 2013;58(13):R97–129.
 8.
Yang C, et al. Curvelike structure extraction using minimal path propagation with backtracking. IEEE Trans Image Process. 2016;25(2):988–1003.
 9.
Rexilius J, Hahn HK, Klein J, Peitgen HO, Lentschig MG. “Multispectral brain tumor segmentation based on histogram model adaptation,” in medical imaging 2007: computeraided diagnosis, Medical Imaging 2007: ComputerAided Diagnosis, vol. 6514; 2007. p. 1–10.
 10.
Bendtsen C, Kietzmann M, Korn R, Mozley PD, Schmidt G, Binnig G. Xray computed tomography: semiautomated volumetric analysis of latestage lung tumors as a basis for response assessments. J Biomed Imaging. 2011;3:–361589.
 11.
Gu Y, et al. Automated delineation of lung tumors from CT images using a single click ensemble segmentation approach. Pattern Recogn. 2013;46(3):692–702.
 12.
Kass M, Witkin A, Terzopoulos D. Snakes: active contour models. Int J Comput Vis. 1988;1(4):321–31.
 13.
Sachdeva J, Kumar V, Gupta I, Khandelwal N, Ahuja CK. A novel contentbased active contour model for brain tumor segmentation. Magn Reson Imaging. 2012;30(5):694–715.
 14.
Wang K, Ma C. A robust statistics driven volumescalable active contour for segmenting anatomical structures in volumetric medical images with complex conditions. Biomed Eng Online J Article. 2016;15(1):1–26.
 15.
Tao W, Irene C, Anup B. Fluid vector flow and applications in brain tumor segmentation. IEEE Trans Biomed Eng. 2009;56(3):781–9.
 16.
Ho S, Bullitt E, Gerig G. Levelset evolution with region competition: automatic 3D segmentation of brain tumors. In: 16 Th international conference on pattern recognition; 2002. p. 10532.
 17.
Chan TF, Vese LA. Active contours without edges. IEEE Trans Image Process. 2001;10(2):266–77.
 18.
Abualhaj B, Weng G, Ong M, Attarwala AA, Glatting G. Comparison of five cluster validity indices performance in brain [ 18 F]FETPET image segmentation using k means. Med Phys. 2016;44(1):209–20.
 19.
Ruan S, Lebonvallet S, Merabet A, Constans J. “Tumor segmentation from a multispectral MRI images by using support vector machine classification,” in international symposium on biomedical imaging, international symposium on biomedical imaging; 2007. p. 1236–9.
 20.
Zikic D, Ioannou Y, Brown M, Criminisi A. “Segmentation of brain tumor tissues with convolutional neural networks,” in Miccai workshop on multimodal brain tumor segmentation challenge; 2014.
 21.
Urban G. “Multimodal brain tumor segmentation using deep convolutional neural networks,” in MICCAI BraTS (brain tumor segmentation) challenge. Proceedings, winning contribution; 2014.
 22.
Havaei M, et al. Brain tumor segmentation with deep neural networks. Med Image Anal. 2015;35:18–31.
 23.
Zikic D, et al. Decision forests for tissuespecific segmentation of highgrade gliomas in multichannel MR. In Med Image Comput Comput Assist Interv. 2012;15:369–76.
 24.
Wu YP, et al. Semiautomatic segmentation of glioma on mobile devices. J Healthcare Eng. 2017;2017:1–10 Art. no. 8054939.
 25.
Soltaninejad M, et al. Automated brain tumour detection and segmentation using superpixelbased extremely randomized trees in FLAIR MRI. Int J Comput Assist Radiol Surg. 2017;12(2):183–203.
 26.
Zhao Z, Yang G, Lin Y, Pang H, Wang M. Automated glioma detection and segmentation using graphical models. PLoS One. 2018;13(8):e0200745.
 27.
Li H, Kwong S, Chen C, Jia Y, Cong R. Superpixel segmentation based on squarewise asymmetric partition and structural approximation. IEEE Trans Multimedia. 2019:1–12. https://ieeexplore.ieee.org/document/8673630.
 28.
Kong Y, Wu J, Yang G, Zuo Y, Chen Y, Shu H, Coatrieux JL. Iterative Spatial Fuzzy Clustering for 3D Brain Magnetic Resonance Image Supervoxel Segmentation. J Neurosci Methods. 2018;311:17–27.
 29.
Kong Y, Yue D, Dai Q. Discriminative clustering and feature selection for brain MRI segmentation. IEEE Signal Process Lett. 2015;22(5):573–7.
 30.
Radhakrishna A, Appu S, Kevin S, Aurelien L, Pascal F, Sabine S. SLIC superpixels compared to stateoftheart superpixel methods. IEEE Trans Pattern Anal Mach Intell. 2012;34(11):2274–82.
 31.
Wang X, Ma P, Zhao JJ. Brain tumor CT image segmentation based on SLIC0 superpixels. In: International congress on image and signal processing, biomedical engineering and informatics; 2017.
 32.
Nan B, Mu Z. SLIC0based superpixel segmentation method with texture fusion. Chin J Sci Instrum. 2014;35(3):527–34.
 33.
Smith SM, et al. Advances in functional and structural MR image analysis and implementation as FSL. NeuroImage. 2004;23(1):208–19.
 34.
Crum WR, Camara O, Hill DL. Generalized overlap measures for evaluation and validation in medical image analysis. Med Imaging IEEE Trans on. 2006;25(11):1451–61.
 35.
Haralick RM, Shanmugam K, Dinstein IH. Textural features for image classification. IEEE Trans Syst Man Cybern. 1973;3(6):610–21.
 36.
JuanAlbarracãN J, et al. Automated glioblastoma segmentation based on a multiparametric structured unsupervised classification. PLoS One. 2015;10(5):e0125143.
 37.
Song B, et al. Volumetric texture features from higherorder images for diagnosis of colon lesions via CT colonography. Int J Comput Assist Radiol Surg. 2014;9(6):1021–31.
 38.
Ohtsu N. A threshold selection method from graylevel histograms. IEEE Trans Syst Man Cybern. 2007;9(1):62–6.
 39.
Sarkar N, Chaudhuri BB. An efficient differential boxcounting approach to compute fractal dimension of image. IEEE Trans Syst Man Cybern. 1994;24(1):115–20.
 40.
Bakas S, et al. Advancing the Cancer genome atlas glioma MRI collections with expert segmentation labels and radiomic features. Sci Data. 2017;4(170117):170117.
Acknowledgments
Not applicable.
Funding
This work is supported by National Natural Science Foundation of China under Grant 81772009; In the role of design of the study, collection data and writing manuscript.
Scientific and Technological Research Project of Henan Province under Grant 182102310162; In the role of collection data.
Author information
Affiliations
Contributions
YW developed the algorithm, performed experiments, analyzed the data drafted the manuscript. ZZ participated in the algorithm design and implementation. WW and YL carried out the study design, coordination and polishing the manuscript. MW provided suggestions, comments and polishing the manuscript. All authors read and approved the final manuscript.
Corresponding author
Correspondence to Weiguo Wu.
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Received
Accepted
Published
DOI
Keywords
 Glioma segmentation
 Superpixel
 MRI
 Medical image processing
 Machine learning