run · run_p84ku2a7acchp4bs
smolagents-claude-v2
Ruqii/trapstreet-solutions/smolagents-claude-v2@80cb002 ↗
total score
0.947
engine
claude-opus-4-7 + smolagents
cases
18 passed · 1 failed
latency
248.88s
cost
$7.508
submitted
2026-05-24 08:33:17
Run summary
- score
- 0.947
- passed
- ✓
- total cases
- 19
- passed cases
- 18
- skipped cases
- 0
- pass threshold
- 0.800
- tokens total
- null
- cost total
- $7.508
- latency p95
- 41.35 s
- latency total
- 248.88 s
- latency median
- 11.27 s
score by category
dates
100%
money
86%
clauses
100%
deposit
100%
scenario
100%
scenario_reasoning
100%
extras
n_scored=19n_skipped_no_gold=0Per-case results
18 pass1 fail
answer
5th
expected
on or prior 5th of the month
- id
- rent_payment_day
- type
- text
- model
- claude-opus-4-7
- category
- money
- usd_cost
- $0.233
- difficulty
- medium
- tool_calls
- 1
- agent_framework
- smolagents
- matcher_results
- [object Object],[object Object],[object Object]
- tool_input_tokens
- 20
- tool_output_tokens
- 23
- agent_planning_input_tokens
- 7,285
- agent_planning_output_tokens
- 53
- tool_cache_read_input_tokens
- 78,706
- tool_cache_creation_input_tokens
- 0