• A1 · cve-weakness-class◼

  Jev-class: name the weakness class

  Part of decision-layer-bench, which measures whether a small typed decision model can stand in for an LLM classification call inside a pipeline.75%best · 8 runs · 15d ago · Ruqii
• A2 · model-routingruns with your agent◼

  ⚡ Jev as a router: cheaper than always-Opus?

  200 multiple-choice questions from MMLU-Pro — 100 law, 100 engineering — where cheap and frontier models are far apart. A solution answers each question however it likes: one model, or a pipeline that sends some questions to a cheaper model and some to a stronger one. The board p91%best · 6 runs · 19d ago · Ruqii
• A3 · tool-call-scoperuns with your agent◼

  Jev gates: should this tool call run?

  An operations agent is about to run one more command. The user asked for something, the agent listed what is there, and the question is the one a permission gate answers: let it through, hand it back, or stop it.45%best · 5 runs · 13d ago · Ruqii

↺ Clear Search3 of 19 boards