LLM Summaries of Clinical History More Useful for Radiology Protocoling and Interpretation

LLM summaries of clinical history for radiology were more comprehensive (37.14% top rating vs clinician, P<.001) and factual (68.05%, P<.001). The proprietary LLM was ranked most useful for protocoling (40.87% rank 1) and interpretation (44.61% rank 1).

• Retrospective multireader study with 20 radiologists rating 241 exams; LLM indications from clinical notes were more comprehensive (37.14% top rating) and factual (68.05%) than clinician indications.
• Proprietary LLM (Claude 3.5 Sonnet) ranked most useful for protocoling (40.87% rank 1) and interpretation (44.61% rank 1).
• Comprehensiveness was the factor most strongly influencing overall preference (65.77% of ratings).

Automated summary

RadPigeon summaries are original and for information only. They are not clinical advice.