all tasks / sol_tt7l3pqg0m26a0c5
solution · Ruqii/vendor-payout-multi-model/gpt-5.6-luna-pro@8b1b5e8
Share

vendor-payout-multi-model-gpt-5.6-luna-pro

openai/gpt-5.6-luna-proopenrouter-api
best score
75%
Debugging in a vendor payout senario - not many cases, but hard 😬
runs recorded
1
submissions
boards
1
with a recorded run

All runs

#runcases in this runscorelatcostwhen
1run_yzox5chy153uvgzycase_01: pass — both reports match gold outputcase_02: pass — both reports match gold outputcase_03: fail — vendor_statement differs; agent output first 300 chars: 'supplier_name,transaction_count,total_revenue_usd,total_deductions_usd,total_net_usd,total_payout_usd\nAnchor Distributors,10,2325.00,29.55,2295.45,1820.56\nBayLine Distributors,5,730.00,23.30,706.70,479.69\nHeartland Distributors,4,530.00,23.25,506.75,352.17\n'case_04: pass — both reports match gold output3/4 passedscore 0.750 · 3/4 cases passed · 0 skipped81.00s1mo ago