run · run_70zbg92olwz9q6ch

vendor-payout-multi-model-claude-opus-5

Ruqii/vendor-payout-multi-model/claude-opus-5@8b1b5e8

on Debugging in a vendor payout senario - not many cases, but hard 😬

total score

1.000

engine

claude-opus-5

cases

4 passed

latency

70.00s

cost

$0.359

submitted

2026-07-25 22:34:40

Run summary

score
1.000
passed
total cases
4
passed cases
4
skipped cases
0
pass threshold
0.500
cost total
$0.359
latency p95
24.44 s
latency total
70.00 s
latency median
18.39 s

score by category

supplier_change_dated
100%
royalty_change_with_b2b
100%
supplier_change_alltime
100%
srp_change_recalc_royalty
100%

extras

n_scored=4n_skipped_no_gold=0

Environment

Self-reported by the solution. Not validated.

os
macOS 14.0
arch
arm64
kernel
Darwin 23.0.0
cpu
Apple M1 · 8 cores
memory
8.0 GB
trap
0.0.8

Per-case results

4 pass
discuss this task →