run · run_tngx4h5yd5skexw7
smolagents-claude-split
Ruqii/trapstreet-solutions/smolagents-claude-split@80cb002 ↗
total score
0.947
engine
claude-opus-4-7 (vision) + sonnet-4-6 (planner) + smolagents
cases
18 passed · 1 failed
latency
265.47s
cost
$4.723
submitted
2026-05-24 10:14:15
Run summary
- score
- 0.947
- passed
- ✓
- total cases
- 19
- passed cases
- 18
- skipped cases
- 0
- pass threshold
- 0.800
- tokens total
- null
- cost total
- $4.723
- latency p95
- 65.77 s
- latency total
- 265.47 s
- latency median
- 10.15 s
score by category
dates
100%
money
86%
clauses
100%
deposit
100%
scenario
100%
scenario_reasoning
100%
extras
n_scored=19n_skipped_no_gold=0Per-case results
18 pass1 fail
answer
5th
expected
on or prior 5th of the month
- id
- rent_payment_day
- type
- text
- category
- money
- usd_cost
- $0.137
- difficulty
- medium
- tool_calls
- 1
- tool_model
- claude-opus-4-7
- planner_model
- claude-sonnet-4-6
- agent_framework
- smolagents
- matcher_results
- [object Object],[object Object],[object Object]
- tool_input_tokens
- 20
- tool_output_tokens
- 23
- agent_planning_input_tokens
- 5,570
- agent_planning_output_tokens
- 47
- tool_cache_read_input_tokens
- 78,706
- tool_cache_creation_input_tokens
- 0