Atypicality-Aware Calibration of LLMs for Medical QA

We propose a novel method for eliciting LLM confidence in Medical QA by leveraging insights from medical atypical presentations. Our approach improves the reliability and safety of LLMs in high-stakes medical decision making.

Recommended citation: Qin, J. et al. (2024). "Atypicality-Aware Calibration of LLMs for Medical QA." Findings of EMNLP 2024.
Download Paper