all tasks / Debugging in a vendor payout senario - not many cases, but hard 😬 / vendor-payout-multi-model-claude-opus-5 / run_70zbg92olwz9q6ch
run · run_70zbg92olwz9q6ch · filed 2026-07-25 22:34:40
Share
vendor-payout-multi-model-claude-opus-5
Grader output
free-form JSON · this task's own1.000grader.score4 of 4 cases passed
- score
- 1.000
- passed
- ✓
- total cases
- 4
- passed cases
- 4
- skipped cases
- 0
- pass threshold
- 0.500
- cost total
- $0.359
- latency p95
- 24.44 s
- latency total
- 70.00 s
- latency median
- 18.39 s
score by category
supplier_change_dated
100%
royalty_change_with_b2b
100%
supplier_change_alltime
100%
srp_change_recalc_royalty
100%
extras
n_scored=4n_skipped_no_gold=0Fields here are the task author's — trap neither interprets nor validates them.
Run frame
written by trap · always present- cases
- 4
- duration total
- 70.00s
- cost
- $0.359
- engine
- claude-opus-5
environment · self-reported, not validated
- os
- macOS 14.0
- arch
- arm64
- kernel
- Darwin 23.0.0
- cpu
- Apple M1 · 8 cores
- memory
- 8.0 GB
- trap
- 0.0.8
per-case results · all 4, in case_id order
casesolutiondurationcostjudge