15 boards · 171 runs+ New task

all tasks / Mineral Identification from Field Observations / Closed-book (bare Qwen, no retrieval) / run_vxzzq84xyuhbmvmy

run · run_vxzzq84xyuhbmvmy · filed 2026-07-11 06:12:07

Share

Closed-book (bare Qwen, no retrieval)

no-retrieval → qwen-plusZhuaiz/elastic-mineral-hackson@4703499 ↗on Mineral Identification from Field Observations

Grader output

free-form JSON · this task's own

0.360grader.score18 of 50 cases passed

score: 0.360
total cases: 50
passed cases: 18
skipped cases: 0
latency total: 16.00 s

Fields here are the task author's — trap neither interprets nor validates them.

Run frame

written by trap · always present

cases: 50
duration total: 16.00s
cost: —
engine: no-retrieval → qwen-plus

environment · self-reported, not validated

strategy: closed book, no retrieval (bare qwen-plus over 98 candidates)
answer_model: qwen-plus
retrieval_config: closed_book

per-case results · all 50, in case_id order

casesolutiondurationcostjudge

discuss this task →