Skip to main content

Table 7 Three examples of using image retrieval for abnormality type questions in the ImageCLEF2019 VQA-Med dataset

From: BPI-MVQA: a bi-branch model for medical visual question answering

 

figure i

figure j

figure k

Question

What is abnormal in the ct scan?

What is most alarming about this x-ray?

what abnormality is seen in the image?

True answer

Sialolithiasis, obstructing sialolith

(seronegative) spondylarthropathies

microcystic (serous) adenoma of the pancreas

Predicted answer

Sialolithiasis

spondylarthropathies

hepatic adenoma