Skip to main content
Download PDF

Efficiency of a deep learning-based artificial intelligence diagnostic system in spontaneous intracerebral hemorrhage volume measurement

BMC Medical Imaging volume 21, Article number: 125 (2021) Cite this article

Abstract

Background

Accurate measurement of hemorrhage volume is critical for both the prediction of prognosis and the selection of appropriate clinical treatment after spontaneous intracerebral hemorrhage (ICH). This study aimed to evaluate the performance and accuracy of a deep learning-based automated segmentation algorithm in segmenting spontaneous intracerebral hemorrhage (ICH) volume either with or without intraventricular hemorrhage (IVH) extension. We compared this automated pipeline with two manual segmentation techniques.

Methods

We retrospectively reviewed 105 patients with acute spontaneous ICH. Depending on the presence of IVH extension, patients were divided into two groups: ICH without (n = 56) and with IVH (n = 49). ICH volume of the two groups were segmented and measured using a deep learning-based artificial intelligence (AI) diagnostic system and computed tomography-based planimetry (CTP), and the ABC/2 score were used to measure hemorrhage volume in the ICH without IVH group. Correlations and agreement analyses were used to analyze the differences in volume and length of processing time among the three segmentation approaches.

Results

In the ICH without IVH group, the ICH volumes measured using AI and the ABC/2 score were comparable to CTP segmentation. Strong correlations were observed among the three segmentation methods (r = 0.994, 0.976, 0.974; P < 0.001; concordance correlation coefficient [CCC] = 0.993, 0.968, 0.967). But the absolute error of the ICH volume measured by the ABC/2 score was greater than that of the algorithm (P < 0.05). In the ICH with IVH group, there is no significant differences were found between algorithm and CTP(P = 0.614). The correlation and agreement between CTP and AI were strong (r = 0.996, P < 0.001; CCC = 0.996). The AI segmentation took a significantly shorter amount of time than CTP (P < 0.001), but was slightly longer than ABC/2 score technique (P = 0.002).

Conclusions

The deep learning-based AI diagnostic system accurately quantified volumes of acute spontaneous ICH with high fidelity and greater efficiency compared to the CTP measurement and more accurately than the ABC/2 scores. We believe this is a promising tool to help physicians achieve precise ICH quantification in practice.

Peer Review reports

Background

Spontaneous intracerebral hemorrhage (ICH) is a severe medical concern and one of the leading causes of morbidity and mortality worldwide [1, 2]. The annual overall incidence rate is approximately 24.6 cases per 100,000 people, and the median case fatality was approximately 40.4% during the first month of illness [3]. Moreover, hemorrhage volume is a powerful predictor of the 30-day prognosis following diagnosis [4]. Hematoma expansion and the presence of intraventricular hemorrhage (IVH) extension are closely correlated to poor outcomes in patients with ICH [5,6,7]. Recent clinical trials investigating new ICH treatments have included hematoma volume as one of the eligibility criteria to determine which patients are best suited for intervention [8, 9]. Accordingly, hematoma volume is not only one of the indicators of the patient’s prognostic score but also an important marker of clinical treatment options. Therefore, quick and accurate measurements of ICH volume have become clinically essential. Computed tomography (CT)-based planimetry (CTP) and ABC/2 score are the two primary manual methods used for the measurement of ICH volume in clinical practice and research [2, 9, 10]; however, CTP is time consuming and the accuracy of the ABC/2 score decreases with large, irregular, or lobar hematoma [11,12,13].

To improve the efficiency of quantitative ICH, research has presented various methods based on machine learning for the automatic segmentation of ICH. Machine learning is a subset of artificial intelligence (AI) that is widely used in many fields [14]. Deep learning is a recently developed machine learning technology that simulates the human brain with multiple layers of artificial neural networks [14, 15]. Traditional computer vision techniques are based on handcrafted features; however, deep learning models are learned and extracted automatically [16]. Accordingly, its network can learn by analyzing the training data and make predictions as new data are entered, requiring little manual engineering [15, 17]. Some deep learning-based AI diagnosis systems have been developed to detect and segment cerebral hemorrhage,[18, 19] but the accuracy of these algorithms and their practical clinical value require further external verification. IVH has been associated with mortality rates as high as 50–75% [20, 21] and increasing the accuracy of the definitions of IVH volume could improve its ability to predict outcomes.[22, 23] However, the presence of IVH may blur the boundaries between intraparenchymal and intraventricular blood, and consequently, it’s challenging to accurately differentiate IVH from the adjacent parenchymal hematoma, even for experienced human raters [18, 24, 25]. Researchers have tried different techniques to find a more efficient way to define hematoma expansion including IVH expansion. By detecting the ICH volume of patients without and with IVH using CTP, David et al. [25] demonstrated that the minimal detectable difference for total ICH hemorrhage volume measurement was greater in the presence of IVH. To our knowledge, however, there are few studies that have examined the difference in the accuracy of deep learning-based diagnosis systems in segmenting ICH volume, either with or without IVH extension. In the present study, patients with acute spontaneous ICH were divided into two groups based on the presence of IVH extension: ICH without and with IVH groups. By measuring the total hemorrhage volume, we aimed to evaluate the performance of a deep learning-based automated segmented algorithm and compared it with two manual segmentation techniques: CTP and ABC/2 score.

Methods

Patient selection and grouping

We retrospectively collected patient data from those who were initially diagnosed with ICH in the General Hospital of Ningxia Medical University, China, between July 2017 and December 2018. Patients with trauma, vascular abnormalities, brain tumors, hemorrhagic transformation after cerebral infarction, or any other secondary causes of ICH were excluded. A total of 105 patients with acute spontaneous ICH (within 72 h of manifestation of clinical symptoms) were included in the current study. They were divided into two groups: ICH without IVH (56 patients) and ICH with IVH (49 patients).

Quantification of ICH

Hemorrhage volume measurements of the two groups were conducted using deep learning-based automated segmentation algorithm and CTP segmentation techniques, and the ABC/2 scores were used to measure hemorrhage volume in the ICH without IVH group. Additional file 1: Fig. S1 shows the segmentation examples of hematoma using different segmentation techniques.

Deep learning-based automated segmentation algorithm

The InferRead CT Stroke (InferVision, Beijing, China) is a standardized and fully automated computer-aided diagnostic (CAD) system of stroke diseases and was used as the AI diagnostic system. Specifically, the segmentation of hemorrhage lesions is one of the main functions of this AI system. Using 3000 head CT scans from multi-centers as well as multi-scanners and implementing deep convolutional neural networks, refined from Dense-Net and U-Net architecture, the hemorrhage segmentation model was developed. In an internal test containing a dataset of 71 cases of ICH, the model achieved an accuracy of 0.99, a Dice similarity coefficient of 0.89, and an F1 score of 0.89.

Manual segmentation techniques

Hematoma volume was first measured with CTP by two independent raters (Drs. Z Chen and T Wang, neuroradiologists specialized in stroke and did not participate in the training phase of the deep learning algorithm) blinded to the results of the algorithm segmentation. They used the Extended Brilliance Workstation (Philips, Amsterdam, The Netherlands) to segment the hematoma area (including intraparenchymal hemorrhage and IVH volume, excluding subarachnoid hemorrhage) slice-by-slice for hematoma area calculation. The volume of hematoma was calculated as follows: V = Σ hematoma area × slice thickness, with measurements in milliliters. The average of hematoma volume measured by the two raters was finally used as the ground-truth volume.

The hematoma volume of the ICH without IVH group was also independently measured using the ABC/2 score by the two raters. In this formula, A is the maximum length on the slice with the largest clot area, B is the maximum width perpendicular to A on the same slice, and the number of slices containing the hematoma were then multiplied by the slice thickness to yield C. The hematoma volume was then calculated and converted into milliliters. The mean of the bleeding volume, measured by the two raters, was used for the final statistical analysis.

Finally, the time to complete each volumetric analysis time was recorded separately to compare the measurement speed.

Statistical analysis

Baseline demographics between the two groups of patients were compared using Pearson’s or Fisher’s exact tests for categorical data, and the t or Mann–Whitney U tests for continuous data, as appropriate. ICH volume and calculation time were analyzed using standard descriptive statistics. Agreement between the two radiologists and different measurement approaches were assessed using intraclass correlation coefficient (ICC) and concordance correlation coefficient (CCC), respectively. Pairwise correlations among ICH volumes measured from each of the three segmentation methods were assessed using the Pearson correlation coefficient. Meanwhile, limits of agreement (LOA) were calculated and Bland–Altman plots were drawn to assess agreement between different measurement methods [26]. The Friedman test or Wilcoxon signed-rank test was used to analyze the differences in volume and calculation time among the three hematoma segmentation methods. P values of < 0.05 were considered significant. All statistical analyses were performed using Stata (version 15.0; StataCorp, College Station, TX, USA), MedCalc (version 15.6.1; MedCalc Software, Ostend, Belgium) and PRISM software (version 8.0.1; GraphPad Software Inc., San Diego, CA, USA).

Results

Demographic data

We included 56 patients in the ICH without IVH and 49 patients in the ICH with IVH groups. The two groups did not show significant differences in age, gender, or hematoma location (P > 0.05). More detailed information is shown in Table 1.

Table 1 Comparison of the demographics and volumetry between two groups of patients
Full size table

ICH quantification

In the ICH without IVH group, ICC between the two independent raters indicated excellent interrater agreement for manually measured data (CTP: ICC = 0.979, 95% confidence interval [CI]: 0.965 to 0.988; ABC/2 score: ICC = 0.988, 95% CI: 0.979 to 0.993). In the ICH with IVH group, agreement between the two raters was also strong (CTP; ICC = 0.983, 95% CI: 0.971 to 0.991; see Additional file 1: Table S1). Therefore, the CTP segmented ICH volume was regarded as the ground-truth volume for further analysis.

Results from the ICH quantification for the two groups are shown in Table 1. In the ICH without IVH group, the differences in the measured ICH volume between CTP and the algorithm or ABC/2 score were not significant (P = 0.218 and P = 0.658, respectively, Table 2 and Additional file 1: Fig. S2). In the ICH with IVH group, the difference in the measured ICH volume between CTP and algorithm was not significant (P = 0.941; Table 2 and Additional file 1: Fig. S2).

Table 2 Agreement comparisons among different segmentation methods for spontaneous ICH volume in two groups
Full size table
Table 3 Pairwise comparisons of differences in volumetric analysis times among segmentation methods in two groups
Full size table

Correlation and agreement analysis

Figure 1a, b demonstrate the segmented ICH volumes by different raters and segmentation methods in each group. In the ICH without IVH group, strong correlations were observed among the three segmentation methods (r = 0.994, 0.976, 0.974, P < 0.001; Fig. 1c–e). In the ICH with IVH group, strong correlations were also found between the CTP and algorithm (r = 0.996, P < 0.001; Fig. 1f).

Fig. 1
figure 1

Scatter plots comparing segmented spontaneous intracerebral hemorrhage (ICH) volumes among the algorithm, ABC/2 score and CTP segmentation methods. a, b Comparison of the segmented ICH volumes for each user between different segmentation methods in ICH without intraventricular hemorrhage (IVH) group (a), and ICH with IVH group (b). c–f, Comparison of segmented ICH volumes among both user for algorithm versus CTP (c) ABC/2 score versus CTP (d) algorithm versus ABC/2 score (e) in ICH without IVH group, and algorithm versus CTP (f) segmentation methods in ICH with IVH group

Full size image

In the ICH without IVH group, strong agreement, among the three different segmentation methods, was illustrated with CCC and Bland–Altman analyses (Fig. 2a–c and Table 2). The mean deviation values were − 0.10 for the algorithm versus CTP, 1.53 for ABC/2 score versus CTP, and − 1.63 for algorithm versus ABC/2 score. The 95% LOA values were − 4.38 to 4.18, 10.96 to − 7.90, and − 11.22 to 7.96 mL, respectively. The difference curve showed that the absolute error of the ICH volume measured by the ABC/2 score was greater than that of the algorithm (P < 0.05, Fig. 3).

Fig. 2
figure 2

Agreement analysis of spontaneous intracerebral hemorrhage (ICH) volume segmented by different methods in two groups. a–c, Agreement illustrated for algorithm versus CTP (a), ABC/2 versus CTP (b), and algorithm versus ABC/2 score (c) segmentation methods in ICH without intraventricular hemorrhage (IVH) group, and algorithm versus CTP (d) segmentation methods in ICH with IVH group

Full size image
Fig. 3
figure 3

The difference curve of absolute error of the ICH volume measured by the ABC/2 score and algorithm in intracerebral hemorrhage without intraventricular hemorrhage group

Full size image

In the ICH with IVH group, agreement between the algorithm and CTP was strongly demonstrated by the mean deviation of 0.11 mL, 95% LOA of − 6.82 to 7.05 mL (Fig. 2d), and CCC of 0.996 (0.993 to 0.998; Table 2).

Volumetric analysis time

The volumetric analysis times of the different segmentation methods for the two groups are shown in Table 1. The volumetric analysis time of the algorithm was significantly shorter than the CTP segmentation method in both the groups (median differences were − 4.51 [− 7.88 to − 2.17] min/scan for the ICH without IVH group and − 13.97 [− 18.97 to − 8.64] min/scan for the ICH with IVH group; P < 0.001; Table 3). Further, the volumetric analysis time of the algorithm was slightly longer than the ABC/2 score method (median difference = − 0.16 [− 0.28 to − 0.03] s/scan; P = 0.002, Table 3).

Discussion

In the present study, we evaluated the efficacy of a deep learning-based AI diagnostic system in measuring the total volume of acute spontaneous ICH by comparing this method with two other manual volume segmentation techniques. Our agreement analysis of ICH volume showed that AI was comparable to CTP segmentation in patients either with or without the presence of IVH extension. Further, the agreement analysis showed that the ABC/2 score was comparable to the CTP in patients without IVH extension, but its absolute measurement error was greater than the algorithm segmentation. Moreover, the average time of the AI system model, which was slightly longer than the ABC/2 score, took less than one tenth of the time of CTP.

The deep learning algorithm labels a target with a pixel-wise precise boundary and segments it.The volume of each pixel was calculated by combining CT slice thickness, and the hemorrhage volume was calculated by accumulating all the volumes of pixels in the hemorrhage region [19].

Several different deep learning models have been developed for ICH automated quantification. Research has supported that the volume of ICH segmented by deep learning models, which is faster than manual CTP, yields similar results to CTP; [18, 19, 28,29,30]this is consistent with our present results.

A group of manual methods, including CTP and the ABC/2 score, have long been available for measuring ICH volume. The ABC/2 score is based on a simplified ellipsoid volumetric formula.[4, 10] Many previous studies have found that ICH volume measured using the ABC/2 score is highly correlated with CTP measurement, and volumetric analysis time was less than 1 min per case.[4, 12, 31] Therefore, the ABC/2 score has been commonly used in clinical settings and research to rapidly quantify the volume of ICH. Our current analysis demonstrated that the accuracy of the deep learning-based AI model was the same as that of the ABC/2 score in segmenting ICH volume without IVH extension. Several studies reported that the measurement errors of the ABC/2 score increased with larger ICH hematoma and clot irregularity [11, 12, 32,33,34]. We also observed that the ABC/2 score overestimated some ICH volumes when confronting larger and irregular morphology features (Additional file 1: Fig. S3).

Various studies have shown that deep learning also performs well in detecting and measuring the midline shift [35,36,37]. Accordingly, we also extracted midline shift data (maximum septum pellucidum shift), measured by the algorithm and radiologist (reference standard), from 73 patients with spontaneous supratentorial ICH out of all the patients enrolled. A strong correlation and agreement was observed between the algorithm and reference standard (r = 0.858, P < 0.001; ICC = 0.853 [0.775 to 0.905]; Additional file 1: Fig. S4a and Additional file 1: Table S2) for midline shift measurement. Consistent with previous reports, our results revealed that the algorithm showed potential advantages in the evaluation of the midline shift.

Our study has some limitations. First, random sample selection does not balance different hematoma locations or morphology features, which may negatively influence the accuracy of ABC/2 in the agreement analysis. Second, we used the agreement analysis and Bland–Altman plots to compare the volumetric results among different methods. The dice coefficient, however, which can compare not only the volumetric results, but also the clot shape between any two methods, should be considered in future studies. Third, hypodensities on noncontrast CT were reported to be frequently present in patients with oral anticoagulants [38], which may affect accuracy of ICH volume segmentation results using the algorithm. There were only two cases with oral anticoagulants in our study, and more research work focusing on this subject is warranted in the future. Lastly, it would be interesting and meaningful to retrieve ICH and IVH volumes separately to specify volumetric analysis with regards to its prognostic significance in ICH. More practical and effective function, including this promising selective segmentation technique in the algorithm system of AI is still anticipated.

Conclusion

In summary, the deep learning-based AI diagnostic system accurately quantified volumes of acute spontaneous ICH with high fidelity and greater efficiency compared to the CTP measurement and more accurately than the ABC/2 scores. We believe this is a promising tool to help physicians achieve precise ICH quantification in practice.

Further research is needed to determine the application of AI for hematoma volume measurement in a larger sample size or in other types as well as different phases of cerebral hemorrhage.

Availability of data and materials

All data generated or analyzed during this study are included in this published article [and its supplementary information file].

Abbreviations

ICH:

Intracerebral hemorrhage

IVH:

Intraventricular hemorrhage

AI:

Artificial intelligence

CTP:

Computed tomography-based planimetry

CAD:

Computer-aided diagnostic

ICC:

Intraclass correlation coefficient

CCC:

Concordance correlation coefficient

LOA:

Limits of agreement

References

  1. Hemphill JC 3rd, Greenberg SM, Anderson CS, Becker K, Bendok BR, Cushman M, Fung GL, Goldstein JN, Macdonald RL, Mitchell PH, et al. Guidelines for the Management of Spontaneous Intracerebral Hemorrhage: A Guideline for Healthcare Professionals From the American Heart Association/American Stroke Association. Stroke. 2015;46(7):2032–60.

    Article  Google Scholar 

  2. Fallenius M, Skrifvars MB, Reinikainen M, Bendel S, Curtze S, Sibolt G, Martinez-Majander N, Raj R. Spontaneous intracerebral hemorrhage. Stroke. 2019;50(9):2336–43.

    Article  Google Scholar 

  3. van Asch CJJ, Luitse MJA, Rinkel GJE, van der Tweel I, Algra A, Klijn CJM. Incidence, case fatality, and functional outcome of intracerebral haemorrhage over time, according to age, sex, and ethnic origin: a systematic review and meta-analysis. Lancet Neurol. 2010;9(2):167–76.

    Article  Google Scholar 

  4. Kothari RU, Brott T, Broderick JP, Barsan WG, Sauerbeck LR, Zuccarello M, Khoury J. The ABCs of measuring intracerebral hemorrhage volumes. Stroke. 1996;27(8):1304–5.

    Article  CAS  Google Scholar 

  5. Fogelholm R, Murros K, Rissanen A, Avikainen S. Long term survival after primary intracerebral haemorrhage: a retrospective population based study. J Neurol Neurosurg Psychiatry. 2005;76(11):1534–8.

    Article  CAS  Google Scholar 

  6. Li Q, Li R, Zhao LB, Yang XM, Yang WS, Deng L, Lv XN, Wu GF, Tang ZP, Wei M, et al. Intraventricular Hemorrhage Growth: Definition, Prevalence and Association with Hematoma Expansion and Prognosis. Neurocrit Care. 2020 Dec;33(3):732–9.

    Article  Google Scholar 

  7. Sembolini A, Romoli M, Pannacci U, Gambaracci G, Floridi P, Acciarresi M, Agnelli G, Alberti A, Venti M, Paciaroni M, et al. Acute hematoma expansion after spontaneous intracerebral hemorrhage: risk factors and impact on long-term prognosis. Neurol Sci. 2020;41(9):2503–9.

    Article  Google Scholar 

  8. Mendelow AD, Gregson BA, Rowan EN, Murray GD, Gholkar A, Mitchell PM. Early surgery versus initial conservative treatment in patients with spontaneous supratentorial lobar intracerebral haematomas (STICH II): a randomised trial. Lancet. 2013;382(9890):397–408.

    Article  Google Scholar 

  9. Hanley DF, Thompson RE, Rosenblum M, Yenokyan G, Lane K, McBee N, Mayo SW, Bistran-Hall AJ, Gandhi D, Mould WA, et al. Efficacy and safety of minimally invasive surgery with thrombolysis in intracerebral haemorrhage evacuation (MISTIE III): a randomised, controlled, open-label, blinded endpoint phase 3 trial. Lancet. 2019;393(10175):1021–32.

    Article  Google Scholar 

  10. Broderick JP, Brott TG, Duldner JE, Tomsick T, Huster G. Volume of intracerebral haemorrhage. A powerful and easy-to-use predictor of 30-day mortality. Stroke. 1993;24(7):987–93.

    Article  CAS  Google Scholar 

  11. Divani AA, Majidi S, Luo X, Souslian FG, Zhang J, Abosch A, Tummala RP. The ABCs of accurate volumetric measurement of cerebral hematoma. Stroke. 2011;42(6):1569–74.

    Article  Google Scholar 

  12. Webb AJ, Ullman NL, Morgan TC, Muschelli J, Kornbluth J, Awad IA, Mayo S, Rosenblum M, Ziai W, Zuccarrello M, et al. Accuracy of the ABC/2 Score for Intracerebral Hemorrhage: Systematic Review and Analysis of MISTIE, CLEAR-IVH, and CLEAR III. Stroke. 2015;46(9):2470–6.

    Article  Google Scholar 

  13. Scherer M, Cordes J, Younsi A, Sahin YA, Gotz M, Mohlenbruch M, Stock C, Bosel J, Unterberg A, Maier-Hein K, et al. Development and validation of an automatic segmentation algorithm for quantification of intracerebral hemorrhage. Stroke. 2016;47(11):2776–82.

    Article  CAS  Google Scholar 

  14. Lee EJ, Kim YH, Kim N, Kang DW. Deep into the brain: artificial intelligence in stroke imaging. J Stroke. 2017;19(3):277–85.

    Article  Google Scholar 

  15. Lee JG, Jun S, Cho YW, Lee H, Kim GB, Seo JB, Kim N. Deep learning in medical imaging: general overview. Korean J Radiol. 2017;18(4):570–84.

    Article  Google Scholar 

  16. Petrick N, Mori K, Patel AA, Rao N, Arbabshirani MR, Jnawali K. Deep 3D convolution neural network for CT brain hemorrhage classification. In: Medical Imaging 2018: Computer-Aided Diagnosis. Proceedings of SPIE. 2018;10575;UNSP 105751C.

  17. LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521(7553):436–44.

    Article  CAS  Google Scholar 

  18. Dhar R, Falcone GJ, Chen Y, Hamzehloo A, Kirsch EP, Noche RB, Roth K, Acosta J, Ruiz A, Phuah CL, et al. Deep learning for automated measurement of hemorrhage and perihematomal edema in supratentorial intracerebral hemorrhage. Stroke. 2020;51(2):648–51.

    Article  Google Scholar 

  19. Xu J, Zhang R, Zhou Z, Wu C, Gong Q, Zhang H, Wu S, Wu G, Deng Y, Xia C, et al. Deep network for the automatic segmentation and quantification of intracranial hemorrhage on CT. Front Neurosci. 2020;14:541817.

    Article  Google Scholar 

  20. Hanley DF. Intraventricular hemorrhage: severity factor and treatment target in spontaneous intracerebral hemorrhage. Stroke. 2009;40(4):1533–8.

    Article  Google Scholar 

  21. Balami JS, Buchan AM. Complications of intracerebral haemorrhage. Lancet Neurol. 2012;11(1):101–18.

    Article  Google Scholar 

  22. Yogendrakumar V, Ramsay T, Fergusson DA, Demchuk AM, Aviv RI, Rodriguez-Luna D, Molina CA, Silva Y, Dzialowski I, Kobayashi A, et al. Redefining hematoma expansion with the inclusion of intraventricular hemorrhage growth. Stroke. 2020;51(4):1120–7.

    Article  Google Scholar 

  23. Yogendrakumar V, Ramsay T, Fergusson D, Demchuk AM, Aviv RI, Rodriguez-Luna D, Molina CA, Silva Y, Dzialowski I, Kobayashi A, et al. New and expanding ventricular hemorrhage predicts poor outcome in acute intracerebral hemorrhage. Neurology. 2019;93(9):e879–88.

    Article  Google Scholar 

  24. Dowlatshahi D, Kosior JC, Idris S, Eesa M, Dickhoff P, Joshi M, Subramaniam S, Tymchuk S, Hill MD, Aviv RI, et al. Planimetric hematoma measurement in patients with intraventricular hemorrhage: is total volume a preferred target for reliable analysis? Stroke. 2012;43(7):1961–3.

    Article  Google Scholar 

  25. Rodriguez-Luna D, Boyko M, Subramaniam S, Klourfeld E, Jo P, Diederichs BJ, Kosior JC, Dowlatshahi D, Aviv RI, Molina CA, et al. Magnitude of hematoma volume measurement error in intracerebral hemorrhage. Stroke. 2016;47(4):1124–6.

    Article  Google Scholar 

  26. Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8(2):135–60.

    Article  CAS  Google Scholar 

  27. Kaka H, Zhang E, Khan N. Artificial intelligence and deep learning in neuroradiology: exploring the new frontier. Can Assoc Radiol J. 2020;72(1):35–44.

    Article  Google Scholar 

  28. Ironside N, Chen CJ, Mutasa S, Sim JL, Ding D, Marfatiah S, Roh D, Mukherjee S, Johnston KC, Southerland AM, et al. Fully automated segmentation algorithm for perihematomal edema volumetry after spontaneous intracerebral hemorrhage. Stroke. 2020;51(3):815–23.

    Article  Google Scholar 

  29. Zhao X, Chen K, Wu G, Zhang G, Zhou X, Lv C, Wu S, Chen Y, Xie G, Yao ZJEr. Deep learning shows good reliability for automatic segmentation and volume measurement of brain hemorrhage, intraventricular extension, and peripheral edema. Eur Radiol. 2021;31(7):5012–20.

  30. Ironside N, Chen CJ, Mutasa S, Sim JL, Marfatia S, Roh D, Ding D, Mayer SA, Lignelli A, Connolly ES. Fully automated segmentation algorithm for hematoma volumetric analysis in spontaneous intracerebral hemorrhage. Stroke. 2019;50(12):3416–23.

    Article  Google Scholar 

  31. Kleinman JT, Hillis AE, Jordan LC. ABC/2: estimating intracerebral haemorrhage volume and total brain volume, and predicting outcome in children. Dev Med Child Neurol. 2011;53(3):281–4.

    Article  Google Scholar 

  32. Wang CW, Juan CJ, Liu YJ, Hsu HH, Liu HS, Chen CY, Hsueh CJ, Lo CP, Kao HW, Huang GS. Volume-dependent overestimation of spontaneous intracerebral hematoma volume by the ABC/2 formula. Acta Radiol. 2009;50(3):306–11.

    Article  Google Scholar 

  33. Kosior JC, Idris S, Dowlatshahi D, Alzawahmah M, Eesa M, Sharma P, Tymchuk S, Hill MD, Aviv RI, Frayne R, et al. Quantomo: validation of a computer-assisted methodology for the volumetric analysis of intracerebral haemorrhage. Int J Stroke. 2011;6(4):302–5.

    Article  Google Scholar 

  34. Freeman WD, Barrett KM, Bestic JM, Meschia JF, Broderick DF, Brott TG. Computer-assisted volumetric analysis compared with ABC/2 method for assessing warfarin-related intracranial hemorrhage volumes. Neurocrit Care. 2008;9(3):307–12.

    Article  Google Scholar 

  35. Jain S, Vyvere TV, Terzopoulos V, Sima DM, Roura E, Maas A, Wilms G, Verheyden J. Automatic quantification of computed tomography features in acute traumatic brain injury. J Neurotrauma. 2019;36(11):1794–803.

    Article  Google Scholar 

  36. Nag MK, Gupta A, Hariharasudhan AS, Sadhu AK, Das A, Ghosh N. Quantitative analysis of brain herniation from non-contrast CT images using deep learning. J Neurosci Methods. 2021;349:109033.

    Article  Google Scholar 

  37. Chilamkurthy S, Ghosh R, Tanamala S, Biviji M, Campeau NG, Venugopal VK, Mahajan V, Rao P, Warier P. Deep learning algorithms for detection of critical findings in head CT scans: a retrospective study. Lancet. 2018;392(10162):2388–96.

    Article  Google Scholar 

  38. Seiffge DJ, Curtze S, Dequatre-Ponchelle N, Pezzini A, Tatlisumak T, Cordonnier C, Werring D. Hematoma location and morphology of anticoagulation-associated intracerebral hemorrhage. Neurology. 2019;92(8):e782–91.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

We thank Wiley for the linguistic assistance during the preparation of this manuscript. We thank all of the participants of this study. We also acknowledge the technical support provided by Dr. Weidao Chen from Beijing Infervision Technology Co., Ltd. Beijing, China.

Funding

This work was supported by grants from the Key Research and Development Program of Ningxia (No.2019BEG03033;No.2020BEG03026), Chunhui Project of the Ministry of Education(No.Z2012002), First-Class Discipline Construction Founded Project of Ningxia Medical University and the School of Clinical Medicine (No.NXYLXK2017A05).

Author information

Author notes

  1. Tao Wang and Na Song have contributed equally to this paper

Authors and Affiliations

  1. The Department of Radiology, The General Hospital of Ningxia Medical University, Yinchuan, 750004, Ningxia, China

    Tao Wang, Na Song, Lingling Liu, Zichao Zhu, Bing Chen & Zhiqiang Chen

  2. Key Laboratory of Fertility Preservation and Maintenance, School of Basic Medicine and the General Hospital, Ningxia Medical University, Yinchuan, 750004, China

    Wenjun Yang

Authors
  1. Tao Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Na Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lingling Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zichao Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Bing Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Wenjun Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Zhiqiang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

TW and ZC designed the study, conducted the experiments, analyzed data, and prepared the manuscript. NS involved in drafting of the manuscript. LL and ZZ involved in acquisition of data. BC and WY took part in critical revision of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Zhiqiang Chen.

Ethics declarations

Ethics approval and consent to participate

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. The informed consent was obtained from all subjects or, if subjects are under 16, from a parent and/or legal guardian.The study was approved by the Ethical Committee of the Genetal Hospital of Ningxia Medical University prior to study conduct.

Consent for publication

Not applicable.

Competing interests

The authors declared no potential conflicts of interest. We declare that there is no any conflict of interest with the company that makes the software (Beijing Infervision Technology Co., Ltd. Beijing, China).

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Supplementary tables and figures.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, T., Song, N., Liu, L. et al. Efficiency of a deep learning-based artificial intelligence diagnostic system in spontaneous intracerebral hemorrhage volume measurement. BMC Med Imaging 21, 125 (2021). https://doi.org/10.1186/s12880-021-00657-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12880-021-00657-6

Keywords

BMC Medical Imaging

ISSN: 1471-2342

Contact us