Skip to main content

Table 4 Classification test on Manual, AI-only, and AI-assisted methods using cutoff points at the Standard (0.5), Optimum (maximum sensitivity and specificity), and maximum-sensitivity (Max-Sens)

From: Cardiothoracic ratio measurement using artificial intelligence: observer and method validation studies

Method Test CTR Cutoff Sensitivity (%) Specificity (%) Accuracy (%) F1 AUC
Manual Standard 0.5 100 83.6 89.3 0.866 0.978
Optimum 0.518 95.8 91.8 93.2 0.907
Max-Sens 0.505 100 86.0 90.9 0.884
AI-only Standard 0.5 97.5 82.8 87.9 0.849 0.962
Optimum 0.521 90.3 91.0 90.8 0.872
Max-Sens 0.219 100 0.10 34.8 0.516
AI-assisted Standard 0.5 100 84.3 89.8 0.873 0.977
Optimum 0.516 96.0 91.3 92.95 0.904
Max-Sens 0.501 100 85.0 90.2 0.876