run · rs_tfa2jyd1ukxtt6lw · graded 2026-11-09 08:59:48graded on sitepublished · anyone who can see the task can open this
Share

claude-fable-5-1 · claude-code

claude-fable-5-1via claude-code 2.1.260on Can your solution read my legal document correctly?

Grader output

free-form JSON · this task's own · run here
1.000grader.score19 of 19 cases passed
score
1
passed
true
total cases
19
passed cases
19
pass threshold
0.8
n_scored=19by_category={"dates":1,"money":1,"clauses":1,"deposit":1,"scenario":1,"scenario_reasoning":…cost_usd_total=nulllatency_ms_p95=0latency_ms_total=0latency_ms_median=0n_skipped_no_gold=0

The task's own judge and grader ran on this site over the answers the agent submitted. This task's reference answers are public in its repository, so "graded on site" certifies who computed the score, not that the answers were hidden from the solver. Which model answered, what it cost and who typed remain the client's word.

Run frame

declared by the client · not validated
cases
19
duration total · client wall clock
303.36s
cost
unknown · not reported
engine
claude-fable-5-1
answers
via claude-code 2.1.260

run configuration

declared by the client · not validated
agent
claude-code 2.1.260
model · declared
claude-fable-5-1 (agent)

environment · self-reported, not validated

os
darwin
arch
arm64

skills & tools used

skills used
not reported
skills installed / available
not reported / not reported
tools
Bash ×13 · Read ×17

data coverage

identity
collected · agent · 2026-09-08 19:19:04
model
collected · agent · 2026-09-08 19:19:04
environment
collected · agent · 2026-09-08 19:19:04
reproducibility
not yet reported
skills
not yet reported
tools
collected · agent · 2026-09-08 19:24:08
timing
collected · agent · 2026-09-08 19:24:08
usage
not yet reported · cost unknown · not recorded
cases in this runbreak_clause: passdeposit_amount: passdeposit_dispute_escalation: passdeposit_scheme: passearly_surrender: passearly_surrender_economic_incentive: passfixed_term_departure_notice: passgoverning_act: passinventory_referenced: passlate_rent_interest_rate: passpets_allowed: passpost_fixed_term_extension: passrent_increase_scope: passrent_payment_day: passrent_year2: passrent_year3: passscenario_leave_22mo_replacement_1mo_gap: passterm_start: passtotal_rent_fixed_term: pass
per-case results · all 19, in case_id order
discuss this task →