run · run_6126fcu8yperopu0

claude-pdf

Ruqii/trapstreet-solutions/claude-pdf@80cb002

on Legal Contract Review

total score

0.895

engine

claude-opus-4-7

cases

17 passed · 2 failed

latency

69.17s

cost

$3.684

submitted

2026-05-23 23:44:03

Run summary

score
0.895
passed
total cases
19
passed cases
17
skipped cases
0
pass threshold
0.800
tokens total
null
cost total
$3.684
latency p95
7.25 s
latency total
69.17 s
latency median
3.24 s

score by category

dates
100%
money
86%
clauses
88%
deposit
100%
scenario
100%
scenario_reasoning
100%

extras

n_scored=19n_skipped_no_gold=0

Per-case results

17 pass2 fail

answer

No

expected

yes
id
early_surrender
type
boolean
model
claude-opus-4-7
category
clauses
usd_cost
$0.119
difficulty
hard
input_tokens
55
output_tokens
5
matcher_results
[object Object]
cache_read_input_tokens
78,854
cache_creation_input_tokens
0

answer

5th

expected

on or prior 5th of the month
id
rent_payment_day
type
text
model
claude-opus-4-7
category
money
usd_cost
$0.119
difficulty
medium
input_tokens
28
output_tokens
7
matcher_results
[object Object],[object Object],[object Object]
cache_read_input_tokens
78,854
cache_creation_input_tokens
0
discuss this task →