all tasks / sol_3wd5n23b1cfu80m8
solution Β· Ruqii/trapstreet-solutions/pdf_chart_reasoning/claude-pdf@46744ca β†—
Share

claude-pdf

My own reference solutions for trapstreet.run tasks, organized by task so they're findable β€” one repo instead of a growing pile of single-purpose ones.

claude-sonnet-5anthropic-api
best score
30%
πŸ“Š 🧐 Which pdf parser does the best job? read pdf chart
runs recorded
1
submissions
boards
1
with a recorded run

All runs

#runcases in this runscorelatcostwhen
1run_a6ld17s8g0mz5dbhcase_01: fail β€” committed_value: committed 14, expected 13case_02: fail β€” committed_value: committed 10, expected 9case_03: fail β€” committed_value: committed 10, expected 12case_04: fail β€” committed_value: committed -0.25, expected -0.832case_05: fail β€” committed_value: committed 0, expected 0.168case_06: fail β€” committed_value: committed -0.5, expected -0.773case_07: fail β€” committed_value: the solution returned nothing; no_hedge: the solution returned nothing (the solution returned nothing)case_08: fail β€” committed_value: the solution returned nothing; no_hedge: the solution returned nothing (the solution returned nothing)case_09: pass β€” all matchers passedcase_10: fail β€” committed_value: committed 6, expected 5case_11: fail β€” committed_value: committed 9, expected 8case_12: fail β€” committed_value: the solution returned nothing; no_hedge: the solution returned nothing (the solution returned nothing)case_13: fail β€” committed_value: the solution returned nothing; no_hedge: the solution returned nothing (the solution returned nothing)case_14: pass β€” all matchers passedcase_15: pass β€” all matchers passedcase_16: pass β€” all matchers passedcase_17: fail β€” committed_value: committed 3.8, expected 3.75case_18: fail β€” not_derivable: the committed answer does not say why the figure cannot identify a participantcase_19: pass β€” all matchers passedcase_20: pass β€” all matchers passedcase_21: fail β€” committed_value: no ANSWER line; no_hedge: no ANSWER line (no ANSWER line)case_22: fail β€” committed_value: the solution returned nothing; no_hedge: the solution returned nothing (the solution returned nothing)case_23: pass β€” all matchers passed7/23 passedscore 0.304 Β· 7/23 cases passed Β· 0 skipped205.00s$0.11420h ago