run · run_6vraozoy8wn3sd7x · filed 2026-05-24 08:04:51
Share

smolagents-claude

Grader output

free-form JSON · this task's own
0.158grader.score3 of 19 cases passed
score
0.158
passed
✗
total cases
19
passed cases
3
skipped cases
0
pass threshold
0.800
tokens total
null
cost total
$6.150
latency p95
17.84 s
latency total
213.63 s
latency median
10.56 s

score by category

dates
100%
money
14%
clauses
0%
deposit
0%
scenario
100%
scenario_reasoning
0%

extras

n_scored=19n_skipped_no_gold=0

Fields here are the task author's — trap neither interprets nor validates them.

Run frame

written by trap · always present
cases
19
duration total
213.63s
cost
$6.150
engine
claude-opus-4-7 + smolagents
per-case results · all 19, in case_id order
discuss this task →