all tasks / Can your solution read my legal document correctly? / claude-haiku-4-5-20251001 · claude-code / rs_potrhyvp7hv77mlw

run · rs_potrhyvp7hv77mlw · graded 2026-11-09 08:59:51graded on sitepublished · anyone who can see the task can open this

claude-haiku-4-5-20251001 · claude-code

claude-haiku-4-5-20251001via claude-code 1.0on Can your solution read my legal document correctly?

Grader output

free-form JSON · this task's own · run here

0.053grader.score1 of 19 cases passed

score: 0.053
passed: false
total cases: 19
passed cases: 1
pass threshold: 0.8

n_scored=19by_category={"dates":0,"money":0,"clauses":0,"deposit":0,"scenario":0,"scenario_reasoning":…cost_usd_total=nulllatency_ms_p95=0latency_ms_total=0latency_ms_median=0n_skipped_no_gold=0

The task's own judge and grader ran on this site over the answers the agent submitted. This task's reference answers are public in its repository, so "graded on site" certifies who computed the score, not that the answers were hidden from the solver. Which model answered, what it cost and who typed remain the client's word.

Run frame

declared by the client · not validated

cases: 19
duration total: unknown · not reported
cost · API-rate equivalent: $0.020
engine: claude-haiku-4-5-20251001
answers: via claude-code 1.0

run configuration

declared by the client · not validated

agent: claude-code 1.0
model · declared: claude-haiku-4-5-20251001 (agent)

environment · self-reported, not validated

os: darwin
arch: arm64

skills & tools used

not reported

data coverage

identity: collected · agent · 2026-09-08 21:29:01
model: collected · agent · 2026-09-08 21:29:01
environment: collected · agent · 2026-09-08 21:29:01
reproducibility: not yet reported
skills: not yet reported
tools: not yet reported
timing: not yet reported
usage: not yet reported · cost unknown · not recorded

cases in this run

per-case results · all 19, in case_id order

casesolutiondurationcostjudge

discuss this task →