all tasks / sol_3wd5n23b1cfu80m8
claude-pdf
My own reference solutions for trapstreet.run tasks, organized by task so they're findable β one repo instead of a growing pile of single-purpose ones.
claude-sonnet-5anthropic-api
- best score
- 30%
- π π§ Which pdf parser does the best job? read pdf chart
- runs recorded
- 1
- submissions
- boards
- 1
- with a recorded run
All runs
| # | run | cases in this run | score | lat | cost | when |
|---|---|---|---|---|---|---|
| 1 | run_a6ld17s8g0mz5dbh | case_01: fail β committed_value: committed 14, expected 13case_02: fail β committed_value: committed 10, expected 9case_03: fail β committed_value: committed 10, expected 12case_04: fail β committed_value: committed -0.25, expected -0.832case_05: fail β committed_value: committed 0, expected 0.168case_06: fail β committed_value: committed -0.5, expected -0.773case_07: fail β committed_value: the solution returned nothing; no_hedge: the solution returned nothing (the solution returned nothing)case_08: fail β committed_value: the solution returned nothing; no_hedge: the solution returned nothing (the solution returned nothing)case_09: pass β all matchers passedcase_10: fail β committed_value: committed 6, expected 5case_11: fail β committed_value: committed 9, expected 8case_12: fail β committed_value: the solution returned nothing; no_hedge: the solution returned nothing (the solution returned nothing)case_13: fail β committed_value: the solution returned nothing; no_hedge: the solution returned nothing (the solution returned nothing)case_14: pass β all matchers passedcase_15: pass β all matchers passedcase_16: pass β all matchers passedcase_17: fail β committed_value: committed 3.8, expected 3.75case_18: fail β not_derivable: the committed answer does not say why the figure cannot identify a participantcase_19: pass β all matchers passedcase_20: pass β all matchers passedcase_21: fail β committed_value: no ANSWER line; no_hedge: no ANSWER line (no ANSWER line)case_22: fail β committed_value: the solution returned nothing; no_hedge: the solution returned nothing (the solution returned nothing)case_23: pass β all matchers passed7/23 passed | score 0.304 Β· 7/23 cases passed Β· 0 skipped | 205.00s | $0.114 | 20h ago |