Skip to main content
Download PDF

Differentiation of Pseudoprogression from True Progressionin Glioblastoma Patients after Standard Treatment: A Machine Learning Strategy Combinedwith Radiomics Features from T1-weighted Contrast-enhanced Imaging

BMC Medical Imaging volume 21, Article number: 17 (2021) Cite this article

Abstract

Background

Based on conventional MRI images, it is difficult to differentiatepseudoprogression from true progressionin GBM patients after standard treatment, which isa critical issue associated with survival. The aim of this study was to evaluate the diagnostic performance of machine learning using radiomics modelfrom T1-weighted contrast enhanced imaging(T1CE) in differentiating pseudoprogression from true progression after standard treatment for GBM.

Methods

Seventy-sevenGBM patients, including 51 with true progression and 26 with pseudoprogression,who underwent standard treatment and T1CE, were retrospectively enrolled.Clinical information, including sex, age, KPS score, resection extent, neurological deficit and mean radiation dose, were also recorded collected for each patient. The whole tumor enhancementwas manually drawn on the T1CE image, and a total of texture 9675 features were extracted and fed to a two-step feature selection scheme. A random forest (RF) classifier was trained to separate the patients by their outcomes.The diagnostic efficacies of the radiomics modeland radiologist assessment were further compared by using theaccuracy (ACC), sensitivity and specificity.

Results

No clinical features showed statistically significant differences between true progression and pseudoprogression.The radiomic classifier demonstrated ACC, sensitivity, and specificity of 72.78%(95% confidence interval [CI]: 0.45,0.91), 78.36%(95%CI: 0.56,1.00) and 61.33%(95%CI: 0.20,0.82).The accuracy, sensitivity and specificity of three radiologists’ assessment were66.23%(95% CI: 0.55,0.76), 61.50%(95% CI: 0.43,0.78) and 68.62%(95% CI: 0.55,0.80); 55.84%(95% CI: 0.45,0.66),69.25%(95% CI: 0.50,0.84) and 49.13%(95% CI: 0.36,0.62); 55.84%(95% CI: 0.45,0.66), 69.23%(95% CI: 0.50,0.84) and 47.06%(95% CI: 0.34,0.61), respectively.

Conclusion

T1CE–based radiomics showed better classification performance compared with radiologists’ assessment.The radiomics modelwas promising in differentiating pseudoprogression from true progression.

Peer Review reports

Background

Glioblastoma multiforme (GBM) is the most common primary malignant brain tumor in adults. Although maximal safe surgical resection followed by concurrent chemoradiotherapy (CCRT) with temozolomide (TMZ) and adjuvant TMZ has been a standard treatment, the prognosis of GBM patients is still very poor. Specially, the median overall survival ranges from 14 to 16 months, and the 2-year survival rate is only 26–33% [1, 2]. To improve this situation, the early and accurate diagnosis of postoperative progression has become very critical because it can directly influence the optimal therapy schemeselection associated with patient survival.

However, the pseudoprogression is a treatment-related change within 12 weeks after the completion of CCRT, including inflammation, radiation effects, ischemia and increased vascular permeabilityand contrast enhancement on MR imaging [3]. Both the true progression and pseudoprogression exhibit progressive enlargement and new enhancement within the radiation field. It is also difficult to differentiate them with conventional MRI sequences because pseudoprogression can mimic true progression in terms of tumor location, morphology, and enhancement patterns [4]. However, their treatments and prognosis are completely different [5]. Generally, pseudoprogressionshows better outcomes and overall survival without invasive treatment [2]. According to the Response Assessment in Neuro-Oncology (RANO) criteria [3], the current strategy to distinguish pseudoprogression from true progression heavily depends on continuous follow-up MRI examinations. Where, it may take several months to obtain a reliable diagnosis, resulting in the delay or inappropriate management of progressed GBM patients [6]. Moreover, studies by Ellington et al. [7] have shown that once tumor recurrence occurs, there is no consensus on its treatment standard. Then, even if the most aggressive treatment is adopted, it is expected that there will be no significant survival benefit. Therefore, it is crucial to develop an effective method to differentiate pseudoprogression from true progression as early as possible.

Although advanced MR imaging techniques, including diffusion-weighted imaging (DWI), perfusion-weighted imaging e.g. arterial spin labeling (ASL), dynamic contrast-enhanced MRI(DCE) anddynamic susceptibility contrast perfusion MRI (DSC) andmagnetic resonance spectroscopy (MRS), have been demonstrated to be promising in differentiating pseudoprogression from true progression, there are still limitations for them.First, the lesions were measured on the basis of a single slice region of interest(ROI)or the hot-spot method, leading to theincompleteassessment of tumors [8, 9]. Second, the limited image information applied in these studies cannot fully address tumor heterogeneity. Third, excessive parameters and time-consuming post-processing limit their clinical applications [10, 11]. Besides, advanced sequences highly depend on the performance of the scanner and are not available in all hospitals.Thus, it is urgent to develop a user-friendly protocol for the early and comprehensive differentiation ofpseudoprogression from true progression.

Recently, the term radiomics,byextracting a large number of quantitative image features combined with machine learning algorithms, radiomics can provide information that is difficult to perceive by visual inspection to guide clinical decision-making, has attracted increased attention in the medical field, especially in tumor research for diagnosis, staging and prognosis [12,13,14,15]. Theradiomics strategy hasalso been used to identify pseudoprogression and true progression [16,17,18]. However, most of them were largely focused on advanced MR techniques, andthe varied post-processing models, varied interpretation and uniform standards for evaluation restricted their clinical applications. In contrast, T1CE is widelyused in almost all hospitalsfor thediagnosis and follow-upof GBM patients. Thus, developing an effective T1CE based radiomics model to differentiate pseudoprogression and true progressionwill have great potential in clinic.

In this study, we aimed to evaluate the diagnostic power of T1CE imaging radiomics-based machinelearning in differentiating pseudoprogression from true progression inGBM patients after standard treatment.The diagnostic power of radiomics model was further compared with that of radiologists’ assessment.

Methods

Patient population

This study was approved by our institutional review board, and the requirement for informed consent was waived based on its retrospective nature. One hundred thirty-one pathologically confirmed primary GBM patients were retrospectively enrolled from May 2014 to February 2017 in Tangdu hospital.

The inclusioncriteria were as follows: (1) GBM patients underwent gross total resection or subtotal resection of the lesion; (2) routine MRI was performed within 48 h after surgery, including T1-weighted imaging (T1WI) and contrast-enhanced T1WI; (3) the patients underwent standard treatment (CCRT with TMZ and six cycles of adjuvant TMZ after surgery); (4) the patients underwent a second round of MR imaging within 2 months after CCRT with TMZ, and the third follow-up MRI examination was obtained at 6 months after CCRT [19]; (5) the patients did notreceivecorticosteroidtreatment3 days before each MRI examination; (6) the patients had new or enlarged enhancement within the radiation field on the second follow-up MR images; and (7) thepatientswere confirmed to havetrue progression or pseudoprogression through pathology after the second surgery or clinical radiologic follow-up.

Fifty-four patients were excluded for the following reasons: (1) absence of new or enlarged enhancement at the end of radiation therapy with concurrent TMZ (n = 15); (2) lack ofstandardized treatment schedules after surgery (n = 10); (3)poor image quality or motion artifacts (n = 11); and (4) lack ofcomplete clinical radiological follow-up or pathological evidence (n = 18).

Finally, 77 patients were included and confirmed to have true progression (n = 51) or pseudoprogression (n = 26). Thirteen patients with true progression and 2 patients with pseudoprogression were confirmed by pathology of the reoperation samples. The other 2 patients died of GBM-related complications within 9 months and were also classified intothe true progression group. The other patients with true progression (n = 36) or pseudoprogression (n = 24) according to the RANO criteria [3]. The details of the patient enrollment are shown in Fig. 1.

Fig. 1
figure 1

Flow chart of patient enrollment

Full size image

Image Acquisition

The MRI protocol was performed on a 3.0 T MRI scanner (MR750, GE Healthcare, and Milwaukee, Wisconsin, USA) with an 8-channel head coil (General Electric Medical System). Preoperative and the follow-up MR images were collected including axial T1-weighted imaging (T1WI), T2-weighted imaging (T2WI), fluid-attenuated inversion recovery (FLAIR) and T1-weighted contrast-enhanced imaging (T1CE).

The scanning parameters were as follows: axial T1WI(TR/TE, 1750 ms/24 ms; matrix size, 256 × 256; FOV,24 × 24 cm; number of excitations (NEX), 1; slice thickness, 5 mm; and gap, 1.5 mm),axial T2WI(TR/TE, 4247 ms/93 ms; matrix size, 512 × 512; FOV, 24 × 24 cm; NEX, 1; slice thickness, 5 mm; and gap, 1.5 mm), sagittal T2WI (TR/TE, 4338 ms/96 ms; matrix size,384 × 384; FOV, 24 × 24 cm; NEX, 2; slice thickness, 5 mm; and gap, 1.0 mm), and axial FLAIR (TR/TE, 8000 ms/165 ms; matrix size, 256 × 256; FOV, 24 × 24 cm; NEX, 1; slice thickness, 5 mm; and gap, 1.5 mm). Finally, a contrast-enhanced T1-weighted spin-echo sequence was acquired in the transverse, sagittal, and coronal planes after intravenous administration of 0.1 mmol/kg gadodiamide (Omniscan; GE Healthcare, Co., Cork, Ireland).

Segmentation of the volume of interest(VOI)

The research pipeline, including image preprocessing, feature extraction, feature selection and radiomics model building is depicted in Fig. 2.Two neuroradiologists (L.F.Y., with 12 years of experience and Y.Z.S., with 10 years of experiencein neuro-oncology imaging) independently reviewed all images. A third senior neuroradiologist (G.B.C., with 25 years of experience in brain tumor imaging) re-examined the images and determined the finalclassificationwhen inconsistencies existed between the two neuroradiologists. In assessing whether the lesion progressed after complete resection, the preoperative image features of the tumor would affect the results. Thus, the preoperative image features of the tumor were also observed and characterized based on the criteria outlined in Additional file 1: Table S1.

Fig. 2
figure 2

Workflow of image processing and machine learning

Full size image
Table 1 Clinical characteristics of patients
Full size table

The VOIs were semi-automatically segmented by the two neuroradiologists(L.F.Y. and Y.Z.S.)using ITK-SNAP (version 3.6, http://www.itk-snap.org). The VOIs covering the enhanced lesion were drawn slice by slice on T1CE, avoiding the regions of macroscopicnecrosis, cystic, edema and non-tumor macrovessels, at the second follow-up MR imaging within 2 months after standard treatment [20].

Radiomics Strategy

Feature Extraction

A series of texture featureswere involved in this study, including 42 histogram features, 11 Gy level size zone matrix (GLSZM) texture features, 10 Haralick features, 144 Gy level co-occurrence matrix (GLCM) texture features and 180 run-length matrix (RLM) texture features of the original images. The after 25 times Gabor and Haarwavelettransforming. Then, a total of 9675 features were extracted from the T1CE images using Analysis-Kinetics (A.K., GE Healthcare) software.The aforementioned features were used here because they were found to be relevant for distinguishing glioma grades in our previous study[14].

Feature Selection

After normalization, the highly redundant and correlated features were subjected to a two-step feature selection procedure. First, highly correlated features were eliminated using Pearson correlation analysis, with anr threshold of 0.75. Then, a random forest (RF) classifier consisting of a number of decision trees was used to rankthe feature importance. Specially, each node in the decision trees is a condition on a single feature, designed to split the dataset into two and similar response values will end up in the same set. The measurement based on which the (locally) optimal condition is determinedis called impurity. When training a tree, how much each feature decreases this weighted impurity in the tree can be computed. Furthermore, for a forest, the impurity decrease ofeach feature can be averaged across the trees, and then used to rank the features, i.e. features importance. In our study, the Gini impurity decrease was used as the criterion to evaluate the feature importance for feature selection.

Radiomics Model Building

After feature ranking, the 50 most important features were fed into a conditional inference RF classifier for model fitting [21]. The synthetic minority oversampling technique (SMOTE) strategy was used to address the data imbalance issue [22].Five-fold cross validation method was employed for tuning the hyperparameter and performed 3 times to avoid bias and overfitting as much as possible. Then these results were averaged to get the final performance.

The accuracy, sensitivity and specificityof the receiver operating characteristic (ROC)were computed to evaluate the constructed radiomics model.

Radiologists’assessment

To compare the efficacies of radiologists’ assessment and radiomics modelin differentiating pseudoprogression from true progression, the images were also evaluated by three junior neuroradiologists (Q.T., G.X. and Y.H., with 8, 7 and 7 years of experience in neuroradiology, respectively) using the second follow-up MR images when new or enlarged enhanced lesions were observed within the radiation field.The neuroradiologists were blinded to the clinical information but were aware that the tumors showedeither pseudoprogression or true progression, without knowing the exact category each patient fell in. Each readers independently assessed only the T1CE images and recorded a final diagnosis using a 4-point scale (1 = definite pseudoprogression; 2 = likely pseudoprogression; 3 = likely true progression; and 4 = definite true progression) [23].

Statistics

For comparisons of the differences in clinical characteristics between thepseudoprogression and true progression groups, Fisher’s exact test or thechi-square test wasused for the categorical variables, and unpaired Student’s t test was used for continuous variables. These were performed by using SPSS 20.0 software (SPSS Inc., Chicago, IL, USA). P value < 0.05 was considered to indicate statistical significance.

Radiomics model construction was performed using R version 3. 4. 2 (R Foundation for Statistical Computing). The ‘RF’,‘caret’ and ‘unbalanced’R packages were used for feature selection and SMOTE, respectively. Thediagnostic performance of the radiomics model was assessedby using the accuracy, sensitivity, specificity.The samevalues of the three readers for differentiating pseudoprogression from true progression were also calculated and compared with the radiomicsmodel.

Results

Patient Characteristics and Qualitative MR Assessment

The patient characteristics are summarized in Table 1. The study group consisted of 40 men and 37 women with a mean age of 49.1 ± 10.5 years (range 17–76 years).The symptoms of these patients included headache and vomiting (61.0%; 47 of 77 patients), epilepsy (18.2%; 14 of 77), physical dysfunction (20.8%; 16 of 77) and others (31.1%; 24 of 77). None of the pretreatment clinical characteristics, including sex, age, Karnofsky Performance Status (KPS) score, resection extent, neurological deficit and mean radiation dose, showed significant differencein differentiating pseudoprogression from true progression.

In addition, the diagnostic powers of preoperative image features in differentiatingpseudoprogression from true progression were summarized in Additional file 1: Table S2. The side of the tumor exhibited statistically significant (P = 0.023), and the location of the tumor had a tendency towards statistical significancebetween-group difference (P = 0.053).

Table 2 Statistical differences of radiomic features determined by using RF classifier between pseudoprogression and true progression
Full size table

Figures 3 and 4 demonstrate representative patients withpseudoprogression and true progression onT1CE imaging, respectively. The pseudoprogression case (Fig. 3), in the absence of more interventions, showed a strengthened extent of the lesion and a reduced degree of enhancement. The case of true progression (Fig. 4) showed a marked increase in the extent of the enhanced lesions, which was confirmed by secondary surgical pathology as tumor recurrence.

Fig. 3
figure 3

T1CE images showing pseudoprogression in a 45-year-old female patient with GBM. (a) Postoperative MRI (within 48 h after surgery) showing complete tumor resection. (b) Three days before CCRT, MRI showed mild enhancement of the cavity walls denoting surgical trauma-related changes. (c) Two months after CCRT, enhancement markedly increased. After CCRT and at the (d) 6-, (e) 8- and (f) 11-month follow-ups, the follow-up MR images demonstrated that the degree of lesion enhancement was reduced and the extent of enhancement was reduced. (CCRT: concurrent chemoradiotherapy)

Full size image
Fig. 4
figure 4

T1CE images showing true progression in a 48-year-old male patient with GBM. (a) Postoperative MRI (within 24 h after surgery) showed that the tumor was completely resected. (b) Two months after CCRT, the new enhancement disappeared. After CCRT and at the (c) 6-and (d) 9-month follow-ups, the follow-up MR images demonstrated that the extension of the enhanced lesion increased. Recurrence was confirmed by second surgical pathology. (GBM: glioblastoma multiforme)

Full size image

Quantitative MR Texture Analysis

Figure 5 depicts the relative importance of the top 50 featuresbased on the Gini index. In the present study, 92% (n = 46) of the key features in the radiomics model were wavelet features. Twenty-two of the top 50 texture features had significant differences between the true progression group and the pseudoprogression group (Table 2).

Fig. 5
figure 5

Feature importance plot showing the mean decrease in Gini impurity. Features that most reduced the Gini impurity were those that resulted in the least misclassifications

Full size image

These optimal features included1 GLSZM texture feature, 6 histogram texture features, 19 GLCM texture featuresand 24 RLM texture features. The details of the optimal feature subsets are provided in Additional file 1: Table S3.The RLM texture features accounted forthe highest proportion of the top 50 features, among which Short Run Emphasis_angle45_offset1_LHHL was the most relevant feature and was significantly lower in patients with true progression than in patients with pseudoprogression (Table 2). The GLCM texture feature was the second most dominant featurecomputed from T1CE (Fig. 5)and was significantly higher in patients with pseudoprogression than in patients with true progression (Table 2). The histogram feature and GLSZM texture feature were the least relevantof the top 50 features. Skewness_LHLH and low intensity small area emphasis were the fourth and ninth most relevant features (Fig. 5) and were significantly lower in patients with true progression than in patients with pseudoprogression (Table 2). Low intensity small area emphasisindicated that hypointense zones were more likely to be present inpseudoprogression patients. The above results indicated that lesions with a relatively homogenous appearance were associated with pseudoprogression.

The optimal performance was obtained by using an RF classifier trained with 50 trees. The RF classifier achieved an ACC of 72.78% (95% confidence interval [CI]: 0.45, 0.91) for differentiating pseudoprogression from true progression,with a sensitivity of 78.36% (95% CI: 0.56,1.00), and a specificity of 61.33% (95% CI: 0.20,0.82)(Table 3).

Table 3 Diagnostic performances of the radiomics model for differentiating pseudoprogression from true progression versus the radiologists’ assessment
Full size table

Comparison of the diagnostic performance between theradiomicsmodeland the radiologists’ assessment

Table 3 showed the comparison of the diagnostic performance of the radiomicsmodel and the radiologists’ assessment using the sameT1CE image data.The accuracy, sensitivity and specificity of three radiologists’ assessment were 66.23% (95% CI: 0.55, 0.76), 61.50% (95% CI: 0.43, 0.78) and 68.62% (95% CI: 0.55, 0.80); 55.84%(95% CI: 0.45, 0.66), 69.25% (95% CI: 0.50, 0.84) and 49.13% (95% CI: 0.36, 0.62); 55.84% (95% CI: 0.45, 0.66), 69.23% (95% CI: 0.50, 0.84) and 47.06% (95% CI: 0.34, 0.61), respectively.In comparing the diagnostic performance, theACC,sensitivityand specificityof the radiomics model were significantly higher than those of the three radiologists’ assessment.

The ROC curve in Fig. 6 indicated that the radiomics model hasbetter diagnostic performance than the radiologists’ assessment.

Fig. 6
figure 6

Graph shows receiver operating characteristic curve for radiomics model in differentiating pseudoprogression from true progression versus the radiologists’ assessment in GBM patients after CCRT

Full size image

Discussion

In this study, none of the pretreatment clinical characteristics showed significant difference between the two groups.In addition, according to the results of preoperative imaging characteristics analysis,only the side of the tumor was statistically significantand the location of the tumor had a tendency towards statistical significance between two groups (Additional file 1: Table S2). The results may be related to the small sample size and data imbalance, we will observe the results in future research.

The ability of quantitative radiomics features based on T1CE imagesto differentiate pseudoprogression from true progressionin patients with GBM after CCRTwas investigated in the current study.When combined with RF classifier, the radiomics model achieved relatively gooddiagnosis performance with higher ACC (72.78%) and sensitivity (78.36%) than radiologists’ assessment.

Regarding the top 50 most important features selectedby using the Gini index as a metric,most of them were RLM (n = 24) and GLCM (n = 19) features. The RLM mainly reflects the roughness and directionality of the texture.The GLCM reflects the intensity of the spatial distribution[24].The histogram features (n = 6) and GLSZM texture feature (n = 1) were also played an important role in identifying pseudoprogression and true progression.The ninth important feature of low intensity small area emphasis indicated that hypointense zones were more likely to be present in pseudoprogression patients. Previous literature reports have shown that low intensity small area emphasis may reflect fibrinoid necrosis, oligodendroglial injury and glial cell hyperplasia [11, 25]. The higher the valuewas the greater the probability of pseudoprogression, which appears as a low-signal region. On the contrast,recurrent GBM was characterized by vascular proliferation and a disrupted blood–brain barrier, leading to the high signal intensity in the T1CE image caused by contrast agent leakage [11, 26]. Above texture features mainly reflect the tumor heterogeneity and complexity of components based on voxel-based changes in grayscale[27]. Specially, the Haralick features were not in the top 50 features, whichprobablysuggested that these two groups of features were not effective in distinguishing pseudoprogression from true progression and needed to be verified in future research.

Moreover, it can be observed that, in our study, 92% (n = 46) of the key features in the radiomics model were Gabor filtered wavelet features.The use of high-dimensional feature helps to improve the performance of the model.This finding demonstrates thatthe wavelet features can provide more information about the tumor invisible to the eye, so as to better assess treatment response [28, 29].

Previous studies have used low-dimensional features coupled witha few pieces of information from multi-parametric histograms[16]orSVM classification based on DCE MRI to differentiate pseudoprogression from true progression [30]. Although these studies achieved good results in differentiating pseudoprogression from true progression inGBM patients with standard treatment, there were still certain disadvantages. First, the samples and quantitative features in previous studies were relatively small, especially the relatively small number of pseudoprogression patientswithout proper handling, which might have overshadowed their statistical results [16]. Second, previous studies were mostly based on advanced MR sequences that were of much equipment dependent and may hamper its application in some primary hospitals.

To the best of our knowledge, there is no published study in the literature comparing the radiomics model with radiologists’ assessment for distinguishing pseudoprogression from true progression. In our study, the radiomics model demonstrated betterdiagnostic performance than the radiologists’ assessment. It suggested that our radiomics model may have the potential to help clinicians make an earlier judgment for patients in whom a “wait and see” approach may be the most appropriate.

Study limitations

Several limitations of the current study should be addressed. First, the sample size was still small,so there may be a risk of overfitting. In order to solve the problem of small sample size and overfitting risk, we adopted the following methods: 1)25 times Gabor and wavelet transformations were performed on the features extracted from the original images. 2) five-fold cross validation was employed for tuning the hyperparameter and was performed 3 times to avoid bias and overfitting as much as possible.3) the SMOTE strategy was used to address the data imbalance issue, especially the sample size of pseudoprogression was relatively small. Moreover, Bum-Sup Jang et al. built a radiomics model by machine learning algorithm differentiating pseudoprogression from true progression with the total amount of sample they used was 78 cases [31]. In the future, a much larger dataset needs to be investigated to validate the robustness and reproducibility of the currently proposed radiomics model.Second, molecular alterations, such as isocitrate dehydrogenase (IDH) mutation and oxygen 6-methylguanine-DNA methyltransferase (MGMT) promoter methylation status, were not included in this study. The recently published 2016 WHO classification of brain tumors incorporated genetic parameters into the classical histopathological findings. These genetic alterations have prognostic implications in terms of survival and response to therapies [32, 33]. These indicators will be included in future studies.

Conclusion

In conclusion, our study showed that theproposed radiomics model based on conventional T1CE had stable diagnostic efficacy and performed better than the radiologists’ assessment in the early differentiation ofpseudoprogression from true progressioninGBM patients after CCRT. The radiomics model may assist clinicians in the early, accurate judgment of recurrence and provide a novel tool to guide individual treatment strategies for GBM patients.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author upon reasonable request.

Abbreviations

AUC:

Area Under the Curve

ADC:

Apparent Diffusion Coefficient

ASL:

Arterial Spin Labeling

DCE:

Dynamic Contrast Enhancement

DSC:

Dynamic Susceptibility Contrast

DWI:

Diffusion-weighted Imaging

GLCM:

Gray-level Cooccurrence Matrix

GLSZM:

Gray Level Size Zone Matrix

KPS:

Karnofsky Performance Status

MGMT:

O6-methylguanine-DNA Methyltransferase

ROC:

ReceiverOperating Characteristic

ROI:

Region of Interest

RLM:

Run-length Matrix

RF:

Random Forest

SVM:

Support Vector Machine

SMOTE:

Synthetic Minority Oversampling Technique

T1CE:

T1-weighted Contrast-enhanced Imaging

VOI:

Volume of Interest

References

  1. Ostrom QT, Gittleman H, Fulop J, Liu M, Blanda R, Kromer C, Wolinsky Y, Kruchko C, Barnholtz-Sloan JS: CBTRUS Statistical Report: Primary Brain and Central Nervous System Tumors Diagnosed in the United States in 2008–2012. Neuro Oncol 2015, 17 Suppl 4:iv1-iv62.

  2. Erpolat OP, Akmansu M, Goksel F, Bora H, Yaman E, Buyukberber S. Outcome of newly diagnosed glioblastoma patients treated by radiotherapy plus concomitant and adjuvant temozolomide: a long-term analysis. Tumori. 2009;95(2):191–7.

    Article  Google Scholar 

  3. Wen PY, Macdonald DR, Reardon DA, Cloughesy TF, Sorensen AG, Galanis E, Degroot J, Wick W, Gilbert MR, Lassman AB, et al. Updated response assessment criteria for high-grade gliomas: response assessment in neuro-oncology working group. J Clin Oncol. 2010;28(11):1963–72.

    Article  Google Scholar 

  4. Hygino da Cruz LC, Jr., Rodriguez I, Domingues RC, Gasparetto EL, Sorensen AG: Pseudoprogression and pseudoresponse: imaging challenges in the assessment of posttreatment glioma. AJNR American journal of neuroradiology 2011, 32(11):1978–1985.

  5. Kumar AJ, Leeds NE, Fuller GN, Van Tassel P, Maor MH, Sawaya RE, Levin VA. Malignant gliomas: MR imaging spectrum of radiation therapy- and chemotherapy-induced necrosis of the brain after treatment. Radiology. 2000;217(2):377–84.

    CAS  Article  Google Scholar 

  6. Qian X, Tan H, Zhang J, Zhao W, Chan MD, Zhou X. Stratification of pseudoprogression and true progression of glioblastoma multiform based on longitudinal diffusion tensor imaging without segmentation. Med Phys. 2016;43(11):5889.

    Article  Google Scholar 

  7. Ellingson BM, Wen PY, Cloughesy TF. Modified Criteria for Radiographic Response Assessment in Glioblastoma Clinical Trials. Neurotherapeutics : the journal of the American Society for Experimental NeuroTherapeutics. 2017;14(2):307–20.

    Article  Google Scholar 

  8. Qu J, Qin L, Cheng S, Leung K, Li X, Li H, Dai J, Jiang T, Akgoz A, Seethamraju R, et al. Residual low ADC and high FA at the resection margin correlate with poor chemoradiation response and overall survival in high-grade glioma patients. Eur J Radiol. 2016;85(3):657–64.

    Article  Google Scholar 

  9. Swiderska Z, Markiewicz T, Grala B, Slodkowska J. Hot-spot selection and evaluation methods for whole slice images of meningiomas and oligodendrogliomas. Conference proceedings : Annual International Conference of the IEEE Engineering in Medicine and Biology Society IEEE Engineering in Medicine and Biology Society Annual Conference. 2015;2015:6252–6.

    Google Scholar 

  10. Yoo RE, Choi SH. Recent Application of Advanced MR Imaging to Predict Pseudoprogression in High-grade Glioma Patients. Magn Reson Med Sci. 2016;15(2):165–77.

    Article  Google Scholar 

  11. Yun TJ, Park CK, Kim TM, Lee SH, Kim JH, Sohn CH, Park SH, Kim IH, Choi SH. Glioblastoma treated with concurrent radiation therapy and temozolomide chemotherapy: differentiation of true progression from pseudoprogression with quantitative dynamic contrast-enhanced MR imaging. Radiology. 2015;274(3):830–40.

    Article  Google Scholar 

  12. Huang YQ, Liang CH, He L, Tian J, Liang CS, Chen X, Ma ZL, Liu ZY. Development and Validation of a Radiomics Nomogram for Preoperative Prediction of Lymph Node Metastasis in Colorectal Cancer. J Clin Oncol. 2016;34(18):2157–64.

    Article  Google Scholar 

  13. Horvat N, Veeraraghavan H, Khan M, Blazic I, Zheng J, Capanu M, Sala E, Garcia-Aguilar J, Gollub MJ. MR Imaging of Rectal Cancer: Radiomics Analysis to Assess Treatment Response after Neoadjuvant Therapy. 2018;287(3):833–43.

    Google Scholar 

  14. Tian Q, Yan LF, Zhang X: Radiomics strategy for glioma grading using texture features from multiparametric MRI. 2018.

  15. Gillies RJ, Kinahan PE, Hricak H. Radiomics: Images Are More than Pictures, They Are Data. Radiology. 2016;278(2):563–77.

    Article  Google Scholar 

  16. Cha J, Kim ST, Kim HJ, Kim BJ, Kim YK, Lee JY, Jeon P, Kim KH, Kong DS, Nam DH. Differentiation of tumor progression from pseudoprogression in patients with posttreatment glioblastoma using multiparametric histogram analysis. AJNR Am J Neuroradiol. 2014;35(7):1309–17.

    CAS  Article  Google Scholar 

  17. Song YS, Choi SH, Park CK, Yi KS, Lee WJ, Yun TJ, Kim TM, Lee SH, Kim JH, Sohn CH, et al. True progression versus pseudoprogression in the treatment of glioblastomas: a comparison study of normalized cerebral blood volume and apparent diffusion coefficient by histogram analysis. Korean journal of radiology. 2013;14(4):662–72.

    Article  Google Scholar 

  18. Hu X, Wong KK, Young GS, Guo L, Wong ST. Support vector machine multiparametric MRI identification of pseudoprogression from tumor recurrence in patients with resected glioblastoma. Journal of magnetic resonance imaging : JMRI. 2011;33(2):296–305.

    Article  Google Scholar 

  19. Abdulla S, Saada J, Johnson G, Jefferies S, Ajithkumar T. Tumour progression or pseudoprogression? A review of post-treatment radiological appearances of glioblastoma. Clin Radiol. 2015;70(11):1299–312.

    CAS  Article  Google Scholar 

  20. Yushkevich PA, Yang G, Gerig G. ITK-SNAP: An interactive tool for semi-automatic segmentation of multi-modality biomedical images. Conference proceedings : Annual International Conference of the IEEE Engineering in Medicine and Biology Society IEEE Engineering in Medicine and Biology Society Annual Conference. 2016;2016:3342–5.

    Google Scholar 

  21. Tagliamonte SA, Baayen RH. Models, forests and trees of York English: Was/were variation as a case study for statistical practice. Language Variation & Change. 2012;24(2):135–78.

    Article  Google Scholar 

  22. Hao M, Wang Y, Bryant SH. An efficient algorithm coupled with synthetic minority over-sampling technique to classify imbalanced PubChem BioAssay data. Anal Chim Acta. 2014;806:117–27.

    CAS  Article  Google Scholar 

  23. Suh HB, Choi YS: Primary central nervous system lymphoma and atypical glioblastoma: Differentiation using radiomics approach. 2018.

  24. Chu H, Lin X, He J, Pang P, Fan B, Lei P, Guo D, Ye C: Value of MRI Radiomics Based on Enhanced T1WI Images in Prediction of Meningiomas Grade. Academic radiology 2020.

  25. Coroller TP, Bi WL, Huynh E, Abedalthagafi M, Aizer AA, Greenwald NF, Parmar C, Narayan V, Wu WW, Miranda de Moura S et al: Radiographic prediction of meningioma grade by semantic and radiomic features. PloS one 2017, 12(11):e0187908.

  26. Delgado-Lopez PD, Rinones-Mena E, Corrales-Garcia EM. Treatment-related changes in glioblastoma: a review on the controversies in response assessment criteria and the concepts of true progression, pseudoprogression, pseudoresponse and radionecrosis. Clinical & translational oncology : official publication of the Federation of Spanish Oncology Societies and of the National Cancer Institute of Mexico. 2018;20(8):939–53.

    CAS  Article  Google Scholar 

  27. Li Y, Qian Z, Xu K, Wang K, Fan X, Li S, Jiang T, Liu X, Wang Y. MRI features predict p53 status in lower-grade gliomas via a machine-learning approach. NeuroImage Clinical. 2018;17:306–11.

    Article  Google Scholar 

  28. Nie K, Shi L, Chen Q, Hu X, Jabbour SK, Yue N, Niu T, Sun X. Rectal Cancer: Assessment of Neoadjuvant Chemoradiation Outcome based on Radiomics of Multiparametric MRI. Clinical cancer research : an official journal of the American Association for Cancer Research. 2016;22(21):5256–64.

    Article  Google Scholar 

  29. Liu Z, Zhang XY, Shi YJ, Wang L, Zhu HT, Tang Z, Wang S, Li XT, Tian J, Sun YS. Radiomics Analysis for Evaluation of Pathological Complete Response to Neoadjuvant Chemoradiotherapy in Locally Advanced Rectal Cancer. Clinical cancer research : an official journal of the American Association for Cancer Research. 2017;23(23):7253–62.

    CAS  Article  Google Scholar 

  30. Artzi M, Liberman G, Nadav G, Blumenthal DT, Bokstein F, Aizenstein O, Ben Bashat D. Differentiation between treatment-related changes and progressive disease in patients with high grade brain tumors using support vector machine classification based on DCE MRI. J Neurooncol. 2016;127(3):515–24.

    CAS  Article  Google Scholar 

  31. Jang BS, Jeon SH, Kim IH, Kim IA. Prediction of Pseudoprogression versus Progression using Machine Learning Algorithm in Glioblastoma. Scientific reports. 2018;8(1):12516.

    Article  Google Scholar 

  32. Louis DN, Perry A, Reifenberger G, von Deimling A, Figarella-Branger D, Cavenee WK, Ohgaki H, Wiestler OD, Kleihues P, Ellison DW. The 2016 World Health Organization Classification of Tumors of the Central Nervous System: a summary. Acta Neuropathol. 2016;131(6):803–20.

    Article  Google Scholar 

  33. Kanas VG, Zacharaki EI, Thomas GA, Zinn PO, Megalooikonomou V, Colen RR. Learning MRI-based classification models for MGMT methylation status prediction in glioblastoma. Comput Methods Programs Biomed. 2017;140:249–57.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank Dr. Xiao-Cheng Weiat GE Healthcare China for providing technical support regarding the application of Analysis-Kit software.

Funding

This study received financial support from the National Key Research and Development Program of China(No. 2016YFC0107105 to Dr. C.G.B.), the Innovation and Development Foundation of Tangdu Hospital (No.2016LCYJ001 to Dr. C.G.B.) and the Young Seeding Talent Foundation of Tangdu Hospital (to Dr. Y.L.F.).The funding bodiesdid not play any roles in the design of the study, in the collection, analysis, and interpretation of the data or in the writing of the manuscript.

Author information

Author notes

  1. Ying-Zhi Sun and Lin-Feng Yan contributed equally to this work

Authors and Affiliations

  1. Department of Radiology and Functional and Molecular Imaging Key Lab of Shaanxi Province, Tangdu Hospital, Air Force Medical University, 569 Xinsi Road, Xi’an, 710038, Shaanxi, China

    Ying-Zhi Sun, Lin-Feng Yan, Yu Han, Hai-Yan Nan, Gang Xiao, Qiang Tian, Wen Wang & Guang-Bin Cui

  2. Student Brigade, Air Force Medical University, Xi’an, 710032, Shaanxi, China

    Wen-Hui Pu & Ze-Yang Li

  3. GE Healthcare, Shanghai, 210000, China

    Xiao-Cheng Wei

Authors
  1. Ying-Zhi Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lin-Feng Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yu Han
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hai-Yan Nan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Gang Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Qiang Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Wen-Hui Pu
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Ze-Yang Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Xiao-Cheng Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Wen Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Guang-Bin Cui
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

CGB and WW conceived the project; SYZ and YLF conducted the patient enrollment and data collection; HY, TQ, PWH, LZY, XG and WXC contributed to the data analysis and graph making; and NHY contributed to the thoughtful discussion and provided constructive help in the data analysis. SYZ, YLF, WW and CGB drafted the manuscript. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Wen Wang or Guang-Bin Cui.

Ethics declarations

Ethics approval and consent to participate

Theretrospective studywas approved by the Air Force Medical University, Tang Du Hospital Institutional Review Boardand the requirement for written informed consent was waived.(Study Nr.201510–013).

Consent for publication

Our manuscript does not contain any individual person’s data. (Not applicable).

Competing interests

The authors declare no conflicts of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Details of the preoperative image features and top 50 importance features for differentiating pseudoprogression from true progressionthe.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Sun, YZ., Yan, LF., Han, Y. et al. Differentiation of Pseudoprogression from True Progressionin Glioblastoma Patients after Standard Treatment: A Machine Learning Strategy Combinedwith Radiomics Features from T1-weighted Contrast-enhanced Imaging. BMC Med Imaging 21, 17 (2021). https://doi.org/10.1186/s12880-020-00545-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12880-020-00545-5

Keywords

  • Glioblastoma
  • MRI
  • Pseudoprogression
  • Radiomics
  • Texture feature
  • Machine learning

BMC Medical Imaging

ISSN: 1471-2342

Contact us