all tasks / sol_sya48n6bvnz86sng
solution Β· Ruqii/trapstreet-solutions/pdf_chart_reasoning/smolagents-split@0a8c04e β†—
Share

smolagents-split

My own reference solutions for trapstreet.run tasks, organized by task so they're findable β€” one repo instead of a growing pile of single-purpose ones.

claude-sonnet-5claude-opus-5smolagents
best score
74%
πŸ“Š 🧐 Which pdf parser does the best job? read pdf chart
runs recorded
1
submissions
boards
1
with a recorded run

All runs

#runcases in this runscorelatcostwhen
1run_x3axt2bt2xcf4w3ocase_01: pass β€” all matchers passedcase_02: pass β€” all matchers passedcase_03: pass β€” all matchers passedcase_04: fail β€” committed_value: committed -0.75, expected -0.832case_05: fail β€” committed_value: committed 0, expected 0.168case_06: fail β€” committed_value: committed -0.8, expected -0.773case_07: fail β€” committed_value: committed 0.5, expected 0.712case_08: pass β€” all matchers passedcase_09: fail β€” committed_value: committed 8, expected 7case_10: fail β€” committed_value: committed 4, expected 5case_11: pass β€” all matchers passedcase_12: pass β€” all matchers passedcase_13: pass β€” all matchers passedcase_14: pass β€” all matchers passedcase_15: pass β€” all matchers passedcase_16: pass β€” all matchers passedcase_17: pass β€” all matchers passedcase_18: pass β€” all matchers passedcase_19: pass β€” all matchers passedcase_20: pass β€” all matchers passedcase_21: pass β€” all matchers passedcase_22: pass β€” all matchers passedcase_23: pass β€” all matchers passed17/23 passedscore 0.739 Β· 17/23 cases passed Β· 0 skipped1203.00s$2.1724h ago