run · run_a6ld17s8g0mz5dbh · filed 2026-08-25 20:50:22
Share

claude-pdf

Grader output

free-form JSON · this task's own
0.304grader.score7 of 23 cases passed
score
0.304
passed
total cases
23
passed cases
7
skipped cases
0
pass threshold
0.800
cost total
$0.114
latency p95
14.25 s
latency total
205.00 s
latency median
6.91 s

score by category

semantic
75%
abstention
67%
count_marks
0%
read_length
0%
cross_figure
33%
derived_value
25%
read_position
0%

extras

n_scored=23n_skipped_no_gold=0

Fields here are the task author's — trap neither interprets nor validates them.

Run frame

written by trap · always present
cases
23
duration total
205.00s
cost
$0.114
engine
claude-sonnet-5

environment · self-reported, not validated

os
macOS 14.0
arch
arm64
kernel
Darwin 23.0.0
cpu
Apple M1 · 8 cores
memory
8.0 GB
trap
0.0.14
per-case results · all 23, in case_id order
discuss this task →