run · run-mpylekh0-3
mineru-claude
status
scored · passed
total score
0.842
cases
16 passed · 3 failed
latency
644.52s
cost
—
tokens
—
scored
2026-06-03 21:42:50
duration
645s
Run summary
- score
- 0.842
- passed
- ✓
- total cases
- 19
- passed cases
- 16
- skipped cases
- 0
- pass threshold
- 0.800
- tokens total
- null
- cost total
- null
- latency p95
- 604.50 s
- latency total
- 644.52 s
- latency median
- 2.04 s
score by category
dates
100%
money
86%
clauses
75%
deposit
100%
scenario
100%
scenario_reasoning
100%
extras
n_scored=19n_skipped_no_gold=0Solution metadata
Self-reported by the solution. Not validated.
- repo
- https://github.com/Ruqii/trapstreet-solutions
Per-case results
| case | exit | duration | metrics |
|---|---|---|---|
| break_clause | 0 | 1478 ms | id=break_clausetype=booleanscore=1category=clausesdifficulty=mediumagent_answer=Noexpected_answer=nomatcher_results=[object Object] |
| deposit_amount | 0 | 2435 ms | id=deposit_amounttype=numericscore=1category=moneydifficulty=easyagent_answer=£2,250.00expected_answer=2250matcher_results=[object Object] |
| deposit_dispute_escalation | 0 | 2402 ms | id=deposit_dispute_escalationtype=textscore=1category=depositdifficulty=hardagent_answer=The unresolved dispute is referred to the Independent Case Examiner (ICE) for adjudication, and all parties agree to co-operate with the adjudication.expected_answer=The dispute may be submitted to the Independent Case Examiner (ICE) for adjudication.matcher_results=[object Object],[object Object] |
| deposit_scheme | 0 | 1632 ms | id=deposit_schemetype=textscore=1category=clausesdifficulty=mediumagent_answer=The Tenancy Deposit Scheme (administered by The Dispute Service Limited).expected_answer=TDSmatcher_results=[object Object],[object Object] |
| early_surrender | 0 | 1428 ms | id=early_surrendertype=booleanscore=1category=clausesdifficulty=hardagent_answer=Yesexpected_answer=yesmatcher_results=[object Object] |
| early_surrender_economic_incentive | 0 | 2701 ms | id=early_surrender_economic_incentivetype=booleanscore=1category=scenario_reasoningdifficulty=expertagent_answer=No. The clause only provides for the surrendering tenant to pay any difference where the replacement tenant pays a LOWER amount; it does not provide any refund or credit if the replacement pays a higher rent.expected_answer=nomatcher_results=[object Object],[object Object],[object Object] |
| fixed_term_departure_notice | 0 | 2044 ms | id=fixed_term_departure_noticetype=booleanscore=0category=clausesdifficulty=hardagent_answer=Noexpected_answer=yesmatcher_results=[object Object] |
| governing_act | 0 | 1590 ms | id=governing_acttype=textscore=1category=clausesdifficulty=hardagent_answer=Housing Act 1988expected_answer=Housing Act 1988matcher_results=[object Object],[object Object] |
| inventory_referenced | 0 | 1452 ms | id=inventory_referencedtype=booleanscore=1category=clausesdifficulty=hardagent_answer=Yesexpected_answer=yesmatcher_results=[object Object] |
| late_rent_interest_rate | 0 | 2125 ms | id=late_rent_interest_ratetype=textscore=1category=moneydifficulty=hardagent_answer=3% per annum above the Bank of England base rateexpected_answer=3% per annum above Bank of England base ratematcher_results=[object Object],[object Object],[object Object] |
| pets_allowed | 0 | 1628 ms | id=pets_allowedtype=textscore=1category=clausesdifficulty=mediumagent_answer=with landlord consentexpected_answer=with landlord consentmatcher_results=[object Object],[object Object],[object Object] |
| post_fixed_term_extension | 0 | 2931 ms | id=post_fixed_term_extensiontype=textscore=0category=clausesdifficulty=hardagent_answer=The tenancy will continue on a month-to-month basis from the expiration of the term, with the rent during the extended six-month period increasing by 5% from the previous rent, without affecting the Landlord's ability to serve a Section 21 to end the Tenancy at the end of the fixed term.expected_answer=the tenancy automatically extends for six monthsmatcher_results=[object Object],[object Object] |
| rent_increase_scope | 0 | 2035 ms | id=rent_increase_scopetype=textscore=0category=moneydifficulty=hardagent_answer=The extension period.expected_answer=the automatic extension period onlymatcher_results=[object Object],[object Object],[object Object] |
| rent_payment_day | 0 | 1703 ms | id=rent_payment_daytype=textscore=1category=moneydifficulty=mediumagent_answer=On or prior to the 5th of the month.expected_answer=on or prior 5th of the monthmatcher_results=[object Object],[object Object],[object Object] |
| rent_year2 | 0 | 604498 ms | id=rent_year2type=numericscore=1category=moneydifficulty=mediumagent_answer=£2100.00expected_answer=2100matcher_results=[object Object] |
| rent_year3 | 0 | 1708 ms | id=rent_year3type=numericscore=1category=moneydifficulty=mediumagent_answer=£2,400.00expected_answer=2400matcher_results=[object Object] |
| scenario_leave_22mo_replacement_1mo_gap | 0 | 6326 ms | id=scenario_leave_22mo_replacement_1mo_gaptype=numericscore=1category=scenariodifficulty=hardagent_answer=Months elapsed: 22. Months remaining at surrender: 14. Replacement found 1 month later, so replacement covers 13 months. Rent schedule: tenancy started 05/09/2022. Month 22 ends around 05/07/2024. The gap month (month 23) falls in the period 05/09/2023–04/09/2024 at £2,100/month. The remaining 13 months (months 24–36) span 05/08/2024–04/09/2025: 1 month at £2,100 (to 04/09/2024) + 12 months at £2,400. (a) Gap rent: £2,100 (b) Letting fee: replacement rent = (1 × £2,100) + (12 × £2,400) = £2,100 + £28,800 = £30,900; × 13.2% = £4,078.80 (c) Inventory: £144 × 14/36 = £56.00 (d) Admin: £480 × 14/36 = £186.67 Total: £2,100 + £4,078.80 + £56.00 + £186.67 = **£6,421.47**expected_answer=£6,421.47matcher_results=[object Object] |
| term_start | 0 | 1519 ms | id=term_starttype=datescore=1category=datesdifficulty=easyagent_answer=05/09/2022expected_answer=05/09/2022matcher_results=[object Object] |
| total_rent_fixed_term | 0 | 2885 ms | id=total_rent_fixed_termtype=numericscore=1category=moneydifficulty=hardagent_answer=12×1950 + 12×2100 + 12×2400 = 23400 + 25200 + 28800 = £77,400expected_answer=77400matcher_results=[object Object] |
