Does your agent know what it doesn't know?
ranked by score ↓Source
Paste as source: in your trap.yaml
git+https://github.com/trapstreet/trapstreet-tasks@00d0632172c69e6f31c9ce26799ea34865e67930#subdirectory=tasks/core_calibrated_answerShare
core-calibrated-answer
An open-source evaluation task for calibrated uncertainty — does the model honestly decline questions it can't answer, or does it confidently make something up?