run · run-mpym6isl-1
mineru-claude
status
scored · passed
total score
0.842
cases
16 passed · 3 failed
latency
40.42s
cost
$0.920
tokens
—
scored
2026-06-03 22:04:34
duration
41s
Run summary
- score
- 0.842
- passed
- ✓
- total cases
- 19
- passed cases
- 16
- skipped cases
- 0
- pass threshold
- 0.800
- tokens total
- null
- cost total
- $0.920
- latency p95
- 6.57 s
- latency total
- 40.42 s
- latency median
- 1.91 s
score by category
dates
100%
money
100%
clauses
63%
deposit
100%
scenario
100%
scenario_reasoning
100%
extras
n_scored=19n_skipped_no_gold=0Solution metadata
Self-reported by the solution. Not validated.
- repo
- https://github.com/Ruqii/trapstreet-solutions
- engine
- mineru + claude-opus-4-7
Per-case results
| case | exit | duration | metrics |
|---|---|---|---|
| break_clause | 0 | 2102 ms | id=break_clausetype=booleanmodel=claude-opus-4-7score=1category=clausesusd_cost=0.028879difficulty=mediumagent_answer=Noinput_tokens=66output_tokens=5expected_answer=nomatcher_results=[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| deposit_amount | 0 | 1842 ms | id=deposit_amounttype=numericmodel=claude-opus-4-7score=1category=moneyusd_cost=0.028715difficulty=easyagent_answer=£2,250.00input_tokens=30output_tokens=10expected_answer=2250matcher_results=[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| deposit_dispute_escalation | 0 | 2052 ms | id=deposit_dispute_escalationtype=textmodel=claude-opus-4-7score=1category=depositusd_cost=0.032375difficulty=hardagent_answer=The dispute will be referred to the Independent Case Examiner (ICE) for adjudication, and all parties agree to co-operate with the adjudication.input_tokens=64output_tokens=52expected_answer=The dispute may be submitted to the Independent Case Examiner (ICE) for adjudication.matcher_results=[object Object],[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| deposit_scheme | 0 | 1945 ms | id=deposit_schemetype=textmodel=claude-opus-4-7score=1category=clausesusd_cost=0.030589difficulty=mediumagent_answer=The Tenancy Deposit Scheme (administered by The Dispute Service Limited).input_tokens=40output_tokens=33expected_answer=TDSmatcher_results=[object Object],[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| early_surrender | 0 | 1740 ms | id=early_surrendertype=booleanmodel=claude-opus-4-7score=1category=clausesusd_cost=0.028895difficulty=hardagent_answer=Yesinput_tokens=57output_tokens=7expected_answer=yesmatcher_results=[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| early_surrender_economic_incentive | 0 | 2611 ms | id=early_surrender_economic_incentivetype=booleanmodel=claude-opus-4-7score=1category=scenario_reasoningusd_cost=0.034669difficulty=expertagent_answer=No. The clause only provides for the surrendering tenant to pay any difference where the replacement tenant pays a LOWER amount; it makes no provision for refund or credit if the replacement pays a higher rent.input_tokens=127output_tokens=70expected_answer=nomatcher_results=[object Object],[object Object],[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| fixed_term_departure_notice | 0 | 1478 ms | id=fixed_term_departure_noticetype=booleanmodel=claude-opus-4-7score=0category=clausesusd_cost=0.028685difficulty=hardagent_answer=Noinput_tokens=53output_tokens=5expected_answer=yesmatcher_results=[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| governing_act | 0 | 1573 ms | id=governing_acttype=textmodel=claude-opus-4-7score=1category=clausesusd_cost=0.029614difficulty=hardagent_answer=Housing Act 1988input_tokens=80output_tokens=12expected_answer=Housing Act 1988matcher_results=[object Object],[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| inventory_referenced | 0 | 1615 ms | id=inventory_referencedtype=booleanmodel=claude-opus-4-7score=1category=clausesusd_cost=0.029014difficulty=hardagent_answer=Yesinput_tokens=65output_tokens=7expected_answer=yesmatcher_results=[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| late_rent_interest_rate | 0 | 2008 ms | id=late_rent_interest_ratetype=textmodel=claude-opus-4-7score=1category=moneyusd_cost=0.030094difficulty=hardagent_answer=3% per annum above the Bank of England base rateinput_tokens=72output_tokens=20expected_answer=3% per annum above Bank of England base ratematcher_results=[object Object],[object Object],[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| pets_allowed | 0 | 1463 ms | id=pets_allowedtype=textmodel=claude-opus-4-7score=0category=clausesusd_cost=0.028594difficulty=mediumagent_answer=Noinput_tokens=47output_tokens=5expected_answer=with landlord consentmatcher_results=[object Object],[object Object],[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| post_fixed_term_extension | 0 | 2330 ms | id=post_fixed_term_extensiontype=textmodel=claude-opus-4-7score=0category=clausesusd_cost=0.031324difficulty=hardagent_answer=The tenancy continues for a further six months from expiration of the term, with rent increasing by 5% from the previous rent.input_tokens=49output_tokens=41expected_answer=the tenancy automatically extends for six monthsmatcher_results=[object Object],[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| rent_increase_scope | 0 | 1688 ms | id=rent_increase_scopetype=textmodel=claude-opus-4-7score=1category=moneyusd_cost=0.029735difficulty=hardagent_answer=The automatic extension period (the extended six-month period).input_tokens=48output_tokens=20expected_answer=the automatic extension period onlymatcher_results=[object Object],[object Object],[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| rent_payment_day | 0 | 1699 ms | id=rent_payment_daytype=textmodel=claude-opus-4-7score=1category=moneyusd_cost=0.02924difficulty=mediumagent_answer=On or prior to the 5th of the month.input_tokens=30output_tokens=17expected_answer=on or prior 5th of the monthmatcher_results=[object Object],[object Object],[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| rent_year2 | 0 | 1924 ms | id=rent_year2type=numericmodel=claude-opus-4-7score=1category=moneyusd_cost=0.345431difficulty=mediumagent_answer=£2,100.00input_tokens=50output_tokens=10expected_answer=2100matcher_results=[object Object]cache_read_input_tokens=0cache_creation_input_tokens=18343 |
| rent_year3 | 0 | 1912 ms | id=rent_year3type=numericmodel=claude-opus-4-7score=1category=moneyusd_cost=0.029389difficulty=mediumagent_answer=£2,400.00input_tokens=75output_tokens=10expected_answer=2400matcher_results=[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| scenario_leave_22mo_replacement_1mo_gap | 0 | 6570 ms | id=scenario_leave_22mo_replacement_1mo_gaptype=numericmodel=claude-opus-4-7score=1category=scenariousd_cost=0.063215difficulty=hardagent_answer=Months surrendered early = 36 − 22 = 14 months. Replacement moves in after 1 month, so 13 months remain at the new rent. Rent for period 05/09/2023–04/09/2024 = £2,100/month; rent for 05/09/2024–04/09/2025 = £2,400/month. Tenant is 22 months in (from 05/09/2022) = 05/07/2024. Surrender immediately; replacement starts 1 month later = 05/08/2024. (a) Gap rent (1 month, within the £2,100 period, 05/07/2024–05/08/2024): £2,100 (b) Letting fee on replacement's rent for remainder (05/08/2024–04/09/2025 = 13 months): - 05/08/2024–04/09/2024 = 1 month × £2,100 = £2,100 - 05/09/2024–04/09/2025 = 12 months × £2,400 = £28,800 - Total = £30,900 × 13.2% = £4,078.80 (c) Inventory check-in: £144 × 14/36 = £56.00 (d) Administration: £480 × 14/36 = £186.67 Total = £2,100 + £4,078.80 + £56.00 + £186.67 = **£6,421.47**input_tokens=275output_tokens=421expected_answer=£6,421.47matcher_results=[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| term_start | 0 | 1604 ms | id=term_starttype=datemodel=claude-opus-4-7score=1category=datesusd_cost=0.028955difficulty=easyagent_answer=05/09/2022input_tokens=41output_tokens=11expected_answer=05/09/2022matcher_results=[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |
| total_rent_fixed_term | 0 | 2263 ms | id=total_rent_fixed_termtype=numericmodel=claude-opus-4-7score=1category=moneyusd_cost=0.032359difficulty=hardagent_answer=£1,950×12 + £2,100×12 + £2,400×12 = £23,400 + £25,200 + £28,800 = £77,400.input_tokens=68output_tokens=51expected_answer=77400matcher_results=[object Object]cache_read_input_tokens=18343cache_creation_input_tokens=0 |