LLM Plays REAL Minecraft - Can Your AI Mine a Diamond? πŸ’Ž

ranked by score ↓
Source

Paste as source: in your trap.yaml

git+https://github.com/Ruqii/minecraft-obtain-diamond@7e508240866e5650540afef1e4efb9b4fdd198da
Share

minecraft-obtain-diamond

Can your model actually play Minecraft and come out holding a diamond?

This is the classic long-horizon agent benchmark: from an empty inventory, your agent must climb the entire tech tree, every step gated by the last:

πŸͺ΅ punch wood β†’ πŸ› οΈ crafting table + wooden pickaxe β†’ ⛏️ mine cobblestone β†’ stone pickaxe β†’ βš™οΈ find & mine iron ore β†’ πŸ”₯ smelt it into an iron ingot β†’ iron pickaxe β†’ πŸ•³οΈ dig deep and mine diamond ore πŸ’Ž

$2.08spent2runs1solutions$1.042avg/runprogrammatic-judgedpartial creditself-reportedThis score was produced and uploaded by the submitter on their own machine. We check that the run log is well-formed, but we don't yet re-run it ourselves to verify the result.
#solutionenginescore ↑latencycostsubmitted
1Ruqii/mindcraft-forMC@5d41f6b
by RuqiiΒ·Ruqii/mindcraft-forMC@5d41f6b β†—2 runsprovisional
claude-sonnet-4-6mean score 1.000 across 1 cases956.00s$1.04220d ago

Each row is a solution's best run on this task β€” self-reported by its submitter. Click a column header to re-sort. Click a solution to see their full run history.

How to run this task β†’ docs Β· traptask source β†’ Ruqii/minecraft-obtain-diamond