Karpathy's jagged questions — the 50 m car wash
ranked by score ↓Source
Paste as source: in your trap.yaml
git+https://github.com/xiaotianhan91/karpathys-jagged-questions@e13950d4882019936d16c6cf7b756b4d4fc68274Share
karpathys-jagged-questions
A trap task built around an anecdote Andrej Karpathy told at the Sequoia AI Ascent fireside chat (April 2026): a state-of-the-art model can refactor a 100k-line codebase, yet advises you to walk to the car wash 50 meters away
$0.08spent38runs16solutions$0.0021avg/runprogrammatic-judgedself-reportedThis score was produced and uploaded by the submitter on their own machine. We check that the run log is well-formed, but we don't yet re-run it ourselves to verify the result.
| # | solution | engine | score ↓ | latency | cost | submitted |
|---|---|---|---|---|---|---|
| 1 | car-wash-claude-fable-5 | claude-fable-5 | score 1.000 · 1/1 cases passed · 0 skipped | 10.00s | $0.0000 | 15d ago |
| 2 | car-wash-claude-opus-4-6 | claude-opus-4-6 | score 1.000 · 1/1 cases passed · 0 skipped | 6.00s | $0.0015 | 15d ago |
| 3 | car-wash-claude-opus-4-5 | claude-opus-4-5 | score 1.000 · 1/1 cases passed · 0 skipped | 7.00s | $0.0015 | 15d ago |
| 4 | car-wash-claude-opus-4-8 | claude-opus-4-8 | score 1.000 · 1/1 cases passed · 0 skipped | 5.00s | $0.0028 | 15d ago |
| 5 | car-wash-claude-opus-4-7 | claude-opus-4-7 | score 1.000 · 1/1 cases passed · 0 skipped | 8.00s | $0.0032 | 15d ago |
| 6 | car-wash-gpt-5.5 | gpt-5.5 | score 1.000 · 1/1 cases passed · 0 skipped | 6.00s | $0.0035 | 15d ago |
| 7 | xiaotianhan91/karpathys-jagged-solutions@df9b892 | gpt-5.5 | score 1.000 · 1/1 cases passed · 0 skipped | 6.00s | — | 17d ago |
| 8 | car-wash-claude-haiku | claude-haiku-4-5 | score 0.000 · 0/1 cases passed · 0 skipped | 2.00s | $0.0000 | 16d ago |
| 9 | jagged-car-wash-crappy-model | gpt-5.4-nano | score 0.000 · 0/1 cases passed · 0 skipped | 1.00s | $0.0001 | 13d ago |
| 10 | jagged-car-wash-crappy-model | — | score 0.000 · 0/1 cases passed · 0 skipped | 3.00s | $0.0001 | 13d ago |
| 11 | car-wash-gpt-5.4-mini | gpt-5.4-mini | score 0.000 · 0/1 cases passed · 0 skipped | 5.00s | $0.0002 | 15d ago |
| 12 | car-wash-claude-haiku-4-5 by xiaotianhan91·xiaotianhan91/karpathys-jagged-solutions/claude-haiku-4-5@4e604a3 ↗2 runsprovisional | claude-haiku-4-5 | score 0.000 · 0/1 cases passed · 0 skipped | 4.00s | $0.0003 | 15d ago |
| 13 | car-wash-claude-sonnet-5 | claude-sonnet-5 | score 0.000 · 0/1 cases passed · 0 skipped | 6.00s | $0.0016 | 15d ago |
| 14 | car-wash-claude-sonnet-4-5 | claude-sonnet-4-5 | score 0.000 · 0/1 cases passed · 0 skipped | 6.00s | $0.0016 | 15d ago |
| 15 | car-wash-claude-sonnet-4-6 | claude-sonnet-4-6 | score 0.000 · 0/1 cases passed · 0 skipped | 6.00s | $0.0017 | 15d ago |
| 16 | car-wash-claude-opus-4-1 | claude-opus-4-1 | score 0.000 · 0/1 cases passed · 0 skipped | 10.00s | $0.0067 | 15d ago |
Each row is a solution's best run on this task — self-reported by its submitter. Click a column header to re-sort. Click a solution to see their full run history.
How to run this task → docs · traptask source → xiaotianhan91/karpathys-jagged-questions