all tasks / 🪲 Which code review skill works the best? / baseline-no-skill-claude-opus-5 / run_b2umyxspezzl3jc3
run · run_b2umyxspezzl3jc3 · filed 2026-07-30 20:45:35
Share
baseline-no-skill-claude-opus-5
Grader output
free-form JSON · this task's own0.500grader.score5 of 10 cases passed
- score
- 0.500
- passed
- ✓
- total cases
- 10
- passed cases
- 5
- skipped cases
- 0
- pass threshold
- 0.500
- cost total
- $0.182
- latency p95
- 17.28 s
- latency total
- 107.00 s
- latency median
- 11.48 s
score by category
null_deref
0%
off_by_one
100%
broad_except
0%
resource_leak
0%
sql_injection
100%
stale_closure_state
0%
security_missing_auth
100%
cache_invalidate_keyerror
100%
floating_point_truncation
100%
elif_short_circuit_wrong_deny
0%
extras
n_scored=10n_skipped_no_gold=0Fields here are the task author's — trap neither interprets nor validates them.
Run frame
written by trap · always present- cases
- 10
- duration total
- 107.00s
- cost
- $0.182
- engine
- claude-opus-5
environment · self-reported, not validated
- os
- macOS 14.0
- arch
- arm64
- kernel
- Darwin 23.0.0
- cpu
- Apple M1 · 8 cores
- memory
- 8.0 GB
- trap
- 0.0.11
per-case results · all 10, in case_id order
casesolutiondurationcostjudge