Table 4 Error analysis
From: Clinical language search algorithm from free-text: facilitating appropriate imaging
Dataset and indications | Ground truth document | Ground truth rank | Main cause of error |
|---|---|---|---|
Simulated indications dataset | |||
1. “64yo woman with history of obesity and alcohol use disorder presents with chronic onset of progressive big toe pain and swelling.” | Chronic extremity joint pain, suspected inflammatory arthritis | 10 | Semantic matching of “big toe pain” |
2. “60yo female with history of hypertension presents with right groin pain, fatigue, and weight loss for past 3 months. Concerning for sarcoma” | Soft-tissue masses | 54 | No clinical context in ground truth document |
3. “21yo G2P0A1 with history of recent termination procedure presenting with vaginal bleeding and vomiting for a week” | Gestational trophoblastic disease | 15 | Vague indication |
Institutional radiology report indications dataset | |||
1. “Aortic dissection suspected. Cancer metastatic pt with pancreatic cancer stage IV currently on treatment and needs restaging scan” | Acute chest pain–suspected aortic dissection | Not top 10 | Overly specific indication with distracting medical history |