run · run_ady8ctyw9gfcde2v
BM25 单路(属性文字)
Zhuaiz/elastic-mineral-hackson@8280342 ↗
on Mineral Identification from Field Observations
total score
0.560
engine
bm25 → qwen-plus
cases
28 passed · 22 failed
latency
23.00s
cost
—
submitted
2026-07-11 06:12:15
Run summary
- score
- 0.560
- total cases
- 50
- passed cases
- 28
- skipped cases
- 0
- latency total
- 23.00 s
Environment
Self-reported by the solution. Not validated.
- strategy
- BM25 single-path retrieval over property text (Elasticsearch) + qwen-plus
- answer_model
- qwen-plus
- retrieval_config
- bm25
Per-case results
28 pass22 fail
reasonanswer 'epidote' ≠ 'actinolite'
answer
epidote
expected
actinolite
- id
- actinolite
- category
- monoclinic
- difficulty
- hard
reasonanswer 'augite' ≠ 'aegirine'
answer
augite
expected
aegirine
- id
- aegirine
- category
- monoclinic
- difficulty
- easy
reasonanswer 'pollucite' ≠ 'albite'
answer
pollucite
expected
albite
- id
- albite
- category
- triclinic
- difficulty
- hard
reasonanswer 'prehnite' ≠ 'andalusite'
answer
prehnite
expected
andalusite
- id
- andalusite
- category
- orthorhombic
- difficulty
- hard
reasonanswer 'none of the listed minerals match all th' ≠ 'andradite'
answer
none of the listed minerals match all the criteria
expected
andradite
- id
- andradite
- category
- isometric
- difficulty
- hard
reasonanswer 'quartz' ≠ 'beryl'
answer
quartz
expected
beryl
- id
- beryl
- category
- hexagonal
- difficulty
- hard
reasonanswer 'creedite' ≠ 'calcite'
answer
creedite
expected
calcite
- id
- calcite
- category
- trigonal
- difficulty
- hard
reasonanswer 'apatite' ≠ 'cancrinite'
answer
apatite
expected
cancrinite
- id
- cancrinite
- category
- hexagonal
- difficulty
- hard
reasonanswer 'epidote' ≠ 'diopside'
answer
epidote
expected
diopside
- id
- diopside
- category
- monoclinic
- difficulty
- hard
reasonanswer 'calcite' ≠ 'dolomite'
answer
calcite
expected
dolomite
- id
- dolomite
- category
- trigonal
- difficulty
- hard
reasonanswer 'none of the listed minerals match all th' ≠ 'elbaite'
answer
none of the listed minerals match all the given properties (trigonal crystal system, hardness 7.5, white streak, green color, vitreous to oily luster, transparent, SG ~2.9). However, the question requires choosing from the provided list, and among them, **amazonite** is a green variety of microcline (triclinic), not trigonal — but wait: amazonite is triclinic, not trigonal. Let’s re-check key constraints: - Trigonal crystal system - Mohs hardness 7.5 - White streak - Green color - Vitreous to oily luster - Transparent - SG ≈ 2.9 Common trigonal minerals: quartz (hardness 7, SG 2.65, usually not green — except prasiolite, but that’s not on list), beryl (hexagonal, not trigonal — though sometimes confused; beryl is hexagonal, *not* trigonal), apatite (hexagonal), calcite (trigonal, but hardness 3, not 7.5), corundum (trigonal, hardness 9, SG 4.0), tourmaline (trigonal, hardness 7–7.5, SG 2.8–3.3, commonly green, white streak, vitreous luster, transparent — yes!). Tourmaline fits: - Crystal system: trigonal - Mohs hardness: 7–7.5 - Streak: white - Color: green (e.g., chrome tourmaline, verdelite) - Luster: vitreous (sometimes described as slightly resinous/oily) - Diaphaneity: transparent to translucent - Specific gravity: 2.8–3.3 → ~2.9 fits And **tourmaline** is in the list. Yes — tourmaline matches all criteria. answer: tourmaline
expected
elbaite
- id
- elbaite
- category
- trigonal
- difficulty
- hard
reasonanswer 'pollucite' ≠ 'grossular'
answer
pollucite
expected
grossular
- id
- grossular
- category
- isometric
- difficulty
- hard
reasonanswer 'epidote' ≠ 'hedenbergite'
answer
epidote
expected
hedenbergite
- id
- hedenbergite
- category
- monoclinic
- difficulty
- hard
reasonanswer 'amazonite' ≠ 'kyanite'
answer
amazonite
expected
kyanite
- id
- kyanite
- category
- triclinic
- difficulty
- easy
reasonanswer 'albite' ≠ 'microcline'
answer
albite
expected
microcline
- id
- microcline
- category
- triclinic
- difficulty
- hard
reasonanswer 'prehnite' ≠ 'natrolite'
answer
prehnite
expected
natrolite
- id
- natrolite
- category
- orthorhombic
- difficulty
- hard
reasonanswer 'cinnabar' ≠ 'rutile'
answer
cinnabar
expected
rutile
- id
- rutile
- category
- tetragonal
- difficulty
- easy
reasonanswer 'creedite' ≠ 'siderite'
answer
creedite
expected
siderite
- id
- siderite
- category
- trigonal
- difficulty
- hard
reasonanswer 'none of the listed minerals match the gi' ≠ 'spodumene'
answer
none of the listed minerals match the given properties exactly. however, based on the provided list and constraints, no mineral in the list has monoclinic crystal system *and* hardness 6.5–7.0 *and* white streak *and* colorless *and* vitreous luster *and* transparent *and* sg ~3.1. but wait — rechecking the list: **epidote** is monoclinic, hardness 6–7, white streak, color commonly green but also colorless or pale, vitreous luster, transparent to translucent, sg 3.4–3.5 — close but sg higher. **titanite (sphene)**: monoclinic, hardness 5–5.5 — too soft. **orthoclase**: monoclinic? No — it's monoclinic *only* in its low-temperature form (sanidine is triclinic, orthoclase is monoclinic? Actually, orthoclase is monoclinic — yes, standard orthoclase is monoclinic. Hardness 6–6.5, streak white, colorless to pink/white, vitreous, transparent, sg ~2.5–2.6 — too low. **albite**: triclinic, not monoclinic. **amazonite**: variety of microcline (triclinic), not monoclinic. Wait — **jadeite** isn’t listed. **Spodumene**: monoclinic, hardness 6.5–7, white streak, colorless varieties exist (e.g., hiddenite less common, but triphane is colorless), vitreous, transparent, sg ~3.1–3.2 — yes! But spodumene *is* in the list. Check spodumene: - crystal system: monoclinic ✅ - Mohs hardness: 6.5–7 ✅ - streak: white ✅ - color: colorless (triaphane variety) ✅ - luster: vitreous ✅ - diaphaneity: transparent ✅ - specific gravity: 3.1–3.2 ✅ And **spodumene** is in the provided list. So answer is: spodumene
expected
spodumene
- id
- spodumene
- category
- monoclinic
- difficulty
- hard
reasonanswer 'creedite' ≠ 'titanite'
answer
creedite
expected
titanite
- id
- titanite
- category
- monoclinic
- difficulty
- medium
reasonanswer 'creedite' ≠ 'tremolite'
answer
creedite
expected
tremolite
- id
- tremolite
- category
- monoclinic
- difficulty
- hard
reasonanswer 'scheelite' ≠ 'zircon'
answer
scheelite
expected
zircon
- id
- zircon
- category
- tetragonal
- difficulty
- medium