all tasks / 📃 🧐 Which pdf parser does the best job? Could be any kind of weird pdf / pdf-mixed-scan-pdf-inspector-routed / run_0gnepzvm8u932z1q
run · run_0gnepzvm8u932z1q · filed 2026-08-11 21:34:28
Share
pdf-mixed-scan-pdf-inspector-routed
Grader output
free-form JSON · this task's own1.000grader.score20 of 20 cases passed
- score
- 1.000
- passed
- ✓
- total cases
- 20
- passed cases
- 20
- skipped cases
- 0
- pass threshold
- 0.800
- cost total
- $0.936
- latency p95
- 14.11 s
- latency total
- 152.00 s
- latency median
- 6.63 s
score by category
locate
100%
compare
100%
compute
100%
reconcile
100%
reconstruct
100%
cross_reference
100%
extras
n_scored=20n_skipped_no_gold=0Fields here are the task author's — trap neither interprets nor validates them.
Run frame
written by trap · always present- cases
- 20
- duration total
- 152.00s
- cost
- $0.936
- engine
- claude-sonnet-5
environment · self-reported, not validated
- os
- macOS 14.0
- arch
- arm64
- kernel
- Darwin 23.0.0
- cpu
- Apple M1 · 8 cores
- memory
- 8.0 GB
- trap
- 0.0.14
per-case results · all 20, in case_id order
casesolutiondurationcostjudge