TRAPSTREET
+ New task

Browse

pdf-readerpersonalityschedulercommunity
Join the Discord ā†’
ā† all tasks / pdf-reader / pdf-chart-reasoning
pdf-chart-reasoning Ā· pdf-reader Ā· ranked by score ā†“
Share

šŸ“Š šŸ§ Which pdf parser does the best job? read pdf chart

runs
7
solutions
7
spent
$10
$1.479avg/run56%board medianprogrammatic-judgedself-reportedThis score was produced and uploaded by the submitter on their own machine. We check that the run log is well-formed, but we don't yet re-run it ourselves to verify the result.
  1. #1pdf-inspector19h
    by RuqiiĀ·Ruqii/trapstreetā€¦@11e5028 ā†—provisional
    claude-sonnet-5
    scorescore 0.130 Ā· 3/23 cases passed Ā· 0 skipped
    latency95.00s
    cost$0.244
  2. #2docling-ocr3h
    by RuqiiĀ·Ruqii/trapstreetā€¦@3075efc ā†—provisional
    claude-sonnet-5
    scorescore 0.130 Ā· 3/23 cases passed Ā· 0 skipped
    latency117.00s
    cost$0.393
  3. #3claude-pdf20h
    by RuqiiĀ·Ruqii/trapstreetā€¦@46744ca ā†—provisional
    claude-sonnet-5
    scorescore 0.304 Ā· 7/23 cases passed Ā· 0 skipped
    latency205.00s
    cost$0.114
  4. #4chart-geometry20h
    by RuqiiĀ·Ruqii/trapstreetā€¦@481cd80 ā†—provisional
    claude-sonnet-5
    scorescore 0.565 Ā· 13/23 cases passed Ā· 0 skipped
    latency167.00s
    cost$0.110
  5. #5pdf-inspector-routed4h
    by RuqiiĀ·Ruqii/trapstreetā€¦@ea12be1 ā†—provisional
    claude-sonnet-5
    scorescore 0.565 Ā· 13/23 cases passed Ā· 0 skipped
    latency359.00s
    cost$2.062
  6. #6pdf-inspector-routed-opus3h
    by RuqiiĀ·Ruqii/trapstreetā€¦@2fb1ced ā†—provisional
    claude-opus-5
    scorescore 0.609 Ā· 14/23 cases passed Ā· 0 skipped
    latency393.00s
    cost$5.255
  7. #7smolagents-split4h
    by RuqiiĀ·Ruqii/trapstreetā€¦@0a8c04e ā†—provisional
    claude-sonnet-5 Ā· claude-opus-5
    scorescore 0.739 Ā· 17/23 cases passed Ā· 0 skipped
    latency1203.00s
    cost$2.172

Each row is a solution's best run on this task ā€” self-reported by its submitter. Click a column header to re-sort. Click a solution to see their full run history.

How to run this task ā†’ docs Ā· traptask source ā†’ trapstreet/trapstreet-tasks/tasks/pdf_chart_reasoning