all tasks / sol_bjx55j017nw7ack2
solution Β· Ruqii/trapstreet-solutions/pdf_chart_reasoning/docling-ocr@3075efc β†—
Share

docling-ocr

My own reference solutions for trapstreet.run tasks, organized by task so they're findable β€” one repo instead of a growing pile of single-purpose ones.

claude-sonnet-5docling
best score
13%
πŸ“Š 🧐 Which pdf parser does the best job? read pdf chart
runs recorded
1
submissions
boards
1
with a recorded run

All runs

#runcases in this runscorelatcostwhen
1run_lwrtlx61ohdxurv6case_01: fail β€” committed_value: committed answer carries no number: 'Not stated in the document'case_02: fail β€” committed_value: committed answer carries no number: 'Not stated in the document'case_03: fail β€” committed_value: committed answer carries no number: 'Not stated in the document'case_04: fail β€” committed_value: committed answer carries no number: 'Not found in the document'case_05: fail β€” committed_value: committed answer carries no number: 'Not stated in the document'case_06: fail β€” committed_value: committed answer carries no number: 'Not stated in the document'case_07: fail β€” committed_value: committed answer carries no number: 'Cannot be determined from the document'; no_hedge: hedge 'cannot be determined' in the committed answercase_08: fail β€” committed_value: committed answer carries no number: 'Not stated in the document'case_09: fail β€” committed_value: committed 8, expected 7case_10: fail β€” committed_value: committed 8, expected 5case_11: fail β€” committed_value: committed answer carries no number: 'Not stated in the document'case_12: fail β€” committed_value: committed answer carries no number: 'Not stated in the document'case_13: fail β€” committed_value: committed 3, expected 9case_14: pass β€” all matchers passedcase_15: pass β€” all matchers passedcase_16: fail β€” committed_regex: pattern '1\\.9\\s*[-‐-―]\\s*2\\.0' against '2.0 percent'case_17: fail β€” committed_value: committed 3.875, expected 3.75case_18: fail β€” not_derivable: the committed answer does not say why the figure cannot identify a participantcase_19: fail β€” not_derivable: the committed answer does not say why the figure cannot identify a participantcase_20: pass β€” all matchers passedcase_21: fail β€” committed_value: committed answer carries no number: 'Not stated in the document'case_22: fail β€” committed_value: committed answer carries no number: 'Not stated in the document'case_23: fail β€” committed_regex: pattern '3\\.38\\s*[-‐-―]\\s*3\\.62' against '3.25–3.5 percent'3/23 passedscore 0.130 Β· 3/23 cases passed Β· 0 skipped117.00s$0.3933h ago