run · run_vxzzq84xyuhbmvmy
闭卷（裸 Qwen·无检索）
Zhuaiz/elastic-mineral-hackson@4703499 ↗
on Mineral Identification from Field Observations
total score
0.360
engine
no-retrieval → qwen-plus
cases
18 passed · 32 failed
latency
16.00s
cost
—
submitted
2026-07-11 06:12:07
Run summary
- score
- 0.360
- total cases
- 50
- passed cases
- 18
- skipped cases
- 0
- latency total
- 16.00 s
Environment
Self-reported by the solution. Not validated.
- strategy
- closed book, no retrieval (bare qwen-plus over 98 candidates)
- answer_model
- qwen-plus
- retrieval_config
- closed_book
Per-case results
18 pass32 fail
reasonanswer 'epidote' ≠ 'actinolite'
answer
epidote
expected
actinolite
- id
- actinolite
- category
- monoclinic
- difficulty
- hard
reasonanswer 'augite' ≠ 'aegirine'
answer
augite
expected
aegirine
- id
- aegirine
- category
- monoclinic
- difficulty
- easy
reasonanswer 'amazonite' ≠ 'andalusite'
answer
amazonite
expected
andalusite
- id
- andalusite
- category
- orthorhombic
- difficulty
- hard
reasonanswer 'cassiterite' ≠ 'andradite'
answer
cassiterite
expected
andradite
- id
- andradite
- category
- isometric
- difficulty
- hard
reasonanswer 'ilmenite' ≠ 'arsenopyrite'
answer
ilmenite
expected
arsenopyrite
- id
- arsenopyrite
- category
- monoclinic
- difficulty
- easy
reasonanswer 'epidote' ≠ 'augite'
answer
epidote
expected
augite
- id
- augite
- category
- monoclinic
- difficulty
- easy
reasonanswer 'galena' ≠ 'bournonite'
answer
galena
expected
bournonite
- id
- bournonite
- category
- orthorhombic
- difficulty
- easy
reasonanswer 'apatite' ≠ 'cancrinite'
answer
apatite
expected
cancrinite
- id
- cancrinite
- category
- hexagonal
- difficulty
- hard
reasonanswer 'aegirine' ≠ 'chalcopyrite'
answer
aegirine
expected
chalcopyrite
- id
- chalcopyrite
- category
- tetragonal
- difficulty
- easy
reasonanswer 'topaz' ≠ 'chrysoberyl'
answer
topaz
expected
chrysoberyl
- id
- chrysoberyl
- category
- orthorhombic
- difficulty
- hard
reasonanswer 'arsenopyrite' ≠ 'cobaltite'
answer
arsenopyrite
expected
cobaltite
- id
- cobaltite
- category
- orthorhombic
- difficulty
- easy
reasonanswer 'albite' ≠ 'creedite'
answer
albite
expected
creedite
- id
- creedite
- category
- monoclinic
- difficulty
- hard
reasonanswer 'epidote' ≠ 'diopside'
answer
epidote
expected
diopside
- id
- diopside
- category
- monoclinic
- difficulty
- hard
reasonanswer 'calcite' ≠ 'dolomite'
answer
calcite
expected
dolomite
- id
- dolomite
- category
- trigonal
- difficulty
- hard
reasonanswer 'amazonite' ≠ 'elbaite'
answer
amazonite
expected
elbaite
- id
- elbaite
- category
- trigonal
- difficulty
- hard
reasonanswer 'andradite' ≠ 'grossular'
answer
andradite
expected
grossular
- id
- grossular
- category
- isometric
- difficulty
- hard
reasonanswer 'epidote' ≠ 'hedenbergite'
answer
epidote
expected
hedenbergite
- id
- hedenbergite
- category
- monoclinic
- difficulty
- hard
reasonanswer 'goethite' ≠ 'hematite'
answer
goethite
expected
hematite
- id
- hematite
- category
- trigonal
- difficulty
- easy
reasonanswer 'amazonite' ≠ 'kyanite'
answer
amazonite
expected
kyanite
- id
- kyanite
- category
- triclinic
- difficulty
- easy
reasonanswer 'albite' ≠ 'microcline'
answer
albite
expected
microcline
- id
- microcline
- category
- triclinic
- difficulty
- hard
reasonanswer 'analcime' ≠ 'natrolite'
answer
analcime
expected
natrolite
- id
- natrolite
- category
- orthorhombic
- difficulty
- hard
reasonanswer 'quartz' ≠ 'pollucite'
answer
quartz
expected
pollucite
- id
- pollucite
- category
- isometric
- difficulty
- hard
reasonanswer 'albite' ≠ 'prehnite'
answer
albite
expected
prehnite
- id
- prehnite
- category
- orthorhombic
- difficulty
- hard
reasonanswer 'chromite' ≠ 'pyrite'
answer
chromite
expected
pyrite
- id
- pyrite
- category
- isometric
- difficulty
- easy
reasonanswer 'arsenopyrite' ≠ 'pyrrhotite'
answer
arsenopyrite
expected
pyrrhotite
- id
- pyrrhotite
- category
- monoclinic
- difficulty
- easy
reasonanswer 'cinnabar' ≠ 'rutile'
answer
cinnabar
expected
rutile
- id
- rutile
- category
- tetragonal
- difficulty
- easy
reasonanswer 'apatite' ≠ 'siderite'
answer
apatite
expected
siderite
- id
- siderite
- category
- trigonal
- difficulty
- hard
reasonanswer 'apatite' ≠ 'sphalerite'
answer
apatite
expected
sphalerite
- id
- sphalerite
- category
- isometric
- difficulty
- easy
reasonanswer 'albite' ≠ 'spodumene'
answer
albite
expected
spodumene
- id
- spodumene
- category
- monoclinic
- difficulty
- hard
reasonanswer 'galena' ≠ 'stibnite'
answer
galena
expected
stibnite
- id
- stibnite
- category
- orthorhombic
- difficulty
- easy
reasonanswer 'albite' ≠ 'tremolite'
answer
albite
expected
tremolite
- id
- tremolite
- category
- monoclinic
- difficulty
- hard
reasonanswer 'gypsum' ≠ 'vivianite'
answer
gypsum
expected
vivianite
- id
- vivianite
- category
- monoclinic
- difficulty
- hard