run · run_43yrvcs4ao3jeguw · filed 2026-05-24 10:14:15
Share
smolagents-claude-split
claude-opus-4-7 (vision) + sonnet-4-6 (planner) + smolagentsRuqii/trapstreet-solutions/smolagents-claude-split@fb3c3be ↗on Legal Contract Review
Grader output
free-form JSON · this task's own0.947grader.score18 of 19 cases passed
- score
- 0.947
- passed
- ✓
- total cases
- 19
- passed cases
- 18
- skipped cases
- 0
- pass threshold
- 0.800
- tokens total
- null
- cost total
- $4.723
- latency p95
- 65.77 s
- latency total
- 265.47 s
- latency median
- 10.15 s
score by category
dates
100%
money
86%
clauses
100%
deposit
100%
scenario
100%
scenario_reasoning
100%
extras
n_scored=19n_skipped_no_gold=0Fields here are the task author's — trap neither interprets nor validates them.
Run frame
written by trap · always present- cases
- 19
- duration total
- 265.47s
- cost
- $4.723
- engine
- claude-opus-4-7 (vision) + sonnet-4-6 (planner) + smolagents
per-case results · all 19, in case_id order
casesolutiondurationcostjudge