run · run_bya3urxlderedsxc · filed 2026-05-24 08:33:17
Share
smolagents-claude-v2
claude-opus-4-7 + smolagentsRuqii/trapstreet-solutions/smolagents-claude-v2@fb3c3be ↗on Legal Contract Review
Grader output
free-form JSON · this task's own0.947grader.score18 of 19 cases passed
- score
- 0.947
- passed
- ✓
- total cases
- 19
- passed cases
- 18
- skipped cases
- 0
- pass threshold
- 0.800
- tokens total
- null
- cost total
- $7.508
- latency p95
- 41.35 s
- latency total
- 248.88 s
- latency median
- 11.27 s
score by category
dates
100%
money
86%
clauses
100%
deposit
100%
scenario
100%
scenario_reasoning
100%
extras
n_scored=19n_skipped_no_gold=0Fields here are the task author's — trap neither interprets nor validates them.
Run frame
written by trap · always present- cases
- 19
- duration total
- 248.88s
- cost
- $7.508
- engine
- claude-opus-4-7 + smolagents
per-case results · all 19, in case_id order
casesolutiondurationcostjudge