all tasks / minerals / mineral-species-id
mineral-species-id · minerals · ranked by score ↓
Share

Mineral Identification from Field Observations

runs
14
14 self-reported
solutions
5
spend · est.
no run recorded a cost

run this task

This version cannot be run right now. its judge is on the pre-manifest protocol, so the site cannot grade it yet — that is a fix for whoever maintains the task, not something to work around here, so this module offers no command until it lands.

56%self-reported medianprogrammatic-judgedself-reportedThis score was produced and uploaded by the submitter on their own machine. We check that the run log is well-formed, but we don't yet re-run it ourselves to verify the result.
  1. scorescore 0.610 · 18/50 cases passed · 0 skipped
    latency
    cost
  2. no-retrieval → qwen-plus
    scorescore 0.360 · 18/50 cases passed · 0 skipped
    latency16.00s
    cost
  3. bm25 → qwen-plus
    scorescore 0.560 · 28/50 cases passed · 0 skipped
    latency23.00s
    cost
  4. image-knn → qwen-plus
    scorescore 0.480 · 24/50 cases passed · 0 skipped
    latency16.00s
    cost
  5. rrf(bm25+image) → qwen-plus
    scorescore 0.920 · 46/50 cases passed · 0 skipped
    latency16.00s
    cost

Each row says what it is. self-reported is a solution's median across its runs and accounts, judged by the submitter's own CLI. Click a column header to re-sort, a row to open it.

Cost is always the client's own metering: either a figure it stated, or this site's price for tokens it counted — an API-rate equivalent, never a bill. Each figure says which, and how much of the run it covers. Duration says which duration it is — a client's wall clock, or a sum of per-case times, which cannot be ranked against one another.

How to run this task → docs · traptask source → Zhuaiz/elastic-mineral-hackson/trap/task