An evaluation of performance measures for arterial brain vessel segmentation

BMC Medical Imaging

Table 5 Index of dispersion and median performance measure values of performance measures

	Median value corresponding to visual score
PM	IoD	1	2	3	4	5	6	7	8	9	10
HD95	9.191	20.395	43.578	57.892	59.363	61.011	66.332	66.393	67.971	71.365	77.772
bAHD	5.925	0.086	0.332	0.905	1.353	2.309	3.275	4.309	6.408	8.626	13.212
AHD	2.537	0.082	0.318	0.843	1.197	1.983	2.722	3.648	4.766	5.769	7.967
CNF	0.337	0.963	0.925	0.848	0.759	0.701	0.615	0.477	0.353	0.257	-0.145
SB	0.163	0.976	0.957	0.900	0.847	0.784	0.738	0.654	0.524	0.399	0.158
MHD	0.103	0.038	0.077	0.135	0.204	0.207	0.233	0.284	0.309	0.340	0.404
JAC	0.037	0.964	0.931	0.868	0.806	0.770	0.722	0.657	0.607	0.574	0.466
PRC	0.034	0.976	0.956	0.908	0.862	0.816	0.777	0.726	0.660	0.610	0.515
ARI	0.017	0.982	0.964	0.929	0.891	0.868	0.836	0.790	0.751	0.726	0.631
KAP	0.017	0.982	0.964	0.929	0.892	0.869	0.838	0.792	0.754	0.728	0.634
ICC	0.016	0.982	0.964	0.930	0.892	0.870	0.838	0.793	0.756	0.729	0.636
DICE	0.016	0.982	0.964	0.930	0.892	0.870	0.838	0.793	0.756	0.729	0.636
SNS	0.013	0.994	0.989	0.980	0.978	0.970	0.955	0.951	0.935	0.966	0.898
VS	0.011	0.986	0.974	0.956	0.924	0.908	0.888	0.848	0.827	0.780	0.734
VOI	0.010	0.004	0.006	0.011	0.017	0.020	0.024	0.028	0.034	0.039	0.052
AUC	0.003	0.997	0.994	0.989	0.988	0.985	0.977	0.975	0.966	0.981	0.947
GCE	0.002	0	0.001	0.001	0.002	0.002	0.003	0.004	0.004	0.005	0.007
MI	0.001	0.041	0.039	0.037	0.036	0.035	0.034	0.032	0.031	0.031	0.027
PBD	0.001	0	0	0	0	0.001	0.001	0.001	0.001	0.001	0.002
RI	0.000008	1	0.999	0.999	0.998	0.997	0.997	0.996	0.995	0.994	0.991
ACC	0.000002	1	1	0.999	0.999	0.999	0.998	0.998	0.997	0.997	0.996
SP	0.000002	1	1	1	0.999	0.999	0.999	0.998	0.998	0.997	0.996

Performance measures (PM) are sorted from highest index of dispersion (IoD) to the lowest. Median performance measure values corresponding to the different segmentation qualities are provided in the additional columns. Performance measures exhibit different value ranges (Please see Fig. 4 for two errors with their corresponding Dice and balanced average Hausdorff distance values). Some performance measures, such as accuracy and rand index, give close values to segmentations receiving different visual scores. For example, the Rand index has the same median correlation coefficient value of 0.997 for visual scores 5 and 6. In contrast, the adjusted Rand index can differentiate between two visual qualities and has the median values 0.868 and 0.836 for visual scores 5 and 6, respectively. This explains the higher IoD for the adjusted Rand index. Performance measures like Conformity, Sensibility and balanced average Hausdorff distance provide higher IoD values than their theoretical counterparts Dice, Specificity and average Hausdorff distance respectively

ISSN: 1471-2342