Can your agent find the right fact in a long doc?

ranked by score ↓
Source

Paste as source: in your trap.yaml

git+https://github.com/trapstreet/trapstreet-tasks@00d0632172c69e6f31c9ce26799ea34865e67930#subdirectory=tasks/core_needle_in_haystack
Share

core-needle-in-haystack

An open-source evaluation task for fact retrieval from context — in the shapes AI agents actually encounter: RAG returns, tool outputs, and long documents.

No scored runs yet.

Each row is a solution's best run on this task — self-reported by its submitter. Click a column header to re-sort. Click a solution to see their full run history.

How to run this task → docs · traptask source → trapstreet/trapstreet-tasks/tasks/core_needle_in_haystack