run · run_zrjf2oi5wa93qnx6
cuad-baseline
Ruqii/trapstreet-solutions/cuad-baseline@80cb002 ↗
on CUAD — legal contract clause extraction
total score
0.375
engine
deterministic-baseline
cases
12 passed · 20 failed
latency
771ms
cost
—
submitted
2026-06-17 20:44:53
Run summary
- score
- 0.375
- passed
- ✗
- total cases
- 32
- passed cases
- 12
- skipped cases
- 0
- pass threshold
- 0.800
- tokens total
- null
- cost total
- null
- latency p95
- 26 ms
- latency total
- 771 ms
- latency median
- 23 ms
score by category
Exclusivity
50%
Non-Compete
50%
Audit Rights
50%
Renewal Term
0%
License Grant
0%
Agreement Date
0%
Effective Date
0%
Rofr/Rofo/Rofn
50%
Anti-Assignment
50%
Expiration Date
0%
Cap On Liability
50%
Change Of Control
50%
Joint Ip Ownership
0%
Liquidated Damages
0%
Minimum Commitment
50%
Uncapped Liability
50%
Most Favored Nation
50%
Revenue/Profit Sharing
50%
Ip Ownership Assignment
0%
Termination For Convenience
50%
extras
n_absent=12n_scored=32n_present=20recall_present=0precision_absent=1n_skipped_no_gold=0Per-case results
12 pass20 fail
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p01_anti_assignment
- type
- span_extraction
- category
- Anti-Assignment
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p02_change_of_control
- type
- span_extraction
- category
- Change Of Control
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p03_most_favored_nation
- type
- span_extraction
- category
- Most Favored Nation
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p04_cap_on_liability
- type
- span_extraction
- category
- Cap On Liability
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p05_uncapped_liability
- type
- span_extraction
- category
- Uncapped Liability
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p06_non_compete
- type
- span_extraction
- category
- Non-Compete
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p07_exclusivity
- type
- span_extraction
- category
- Exclusivity
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p08_termination_for_convenience
- type
- span_extraction
- category
- Termination For Convenience
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p09_rofr_rofo_rofn
- type
- span_extraction
- category
- Rofr/Rofo/Rofn
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p10_revenue_profit_sharing
- type
- span_extraction
- category
- Revenue/Profit Sharing
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p11_minimum_commitment
- type
- span_extraction
- category
- Minimum Commitment
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p12_audit_rights
- type
- span_extraction
- category
- Audit Rights
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p13_ip_ownership_assignment
- type
- span_extraction
- category
- Ip Ownership Assignment
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p14_joint_ip_ownership
- type
- span_extraction
- category
- Joint Ip Ownership
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p15_license_grant
- type
- span_extraction
- category
- License Grant
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p16_liquidated_damages
- type
- span_extraction
- category
- Liquidated Damages
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p17_effective_date
- type
- span_extraction
- category
- Effective Date
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p18_agreement_date
- type
- span_extraction
- category
- Agreement Date
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p19_expiration_date
- type
- span_extraction
- category
- Expiration Date
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]
answer
NO CLAUSE FOUND
expected
—
- id
- cuad_p20_renewal_term
- type
- span_extraction
- category
- Renewal Term
- difficulty
- hard
- gold_present
- ✓
- matcher_results
- [object Object]