run · run_ady8ctyw9gfcde2v

BM25 单路(属性文字)

Zhuaiz/elastic-mineral-hackson@8280342

on Mineral Identification from Field Observations

total score

0.560

engine

bm25 → qwen-plus

cases

28 passed · 22 failed

latency

23.00s

cost

submitted

2026-07-11 06:12:15

Run summary

score
0.560
total cases
50
passed cases
28
skipped cases
0
latency total
23.00 s

Environment

Self-reported by the solution. Not validated.

strategy
BM25 single-path retrieval over property text (Elasticsearch) + qwen-plus
answer_model
qwen-plus
retrieval_config
bm25

Per-case results

28 pass22 fail
reasonanswer 'epidote' ≠ 'actinolite'

answer

epidote

expected

actinolite
id
actinolite
category
monoclinic
difficulty
hard
reasonanswer 'augite' ≠ 'aegirine'

answer

augite

expected

aegirine
id
aegirine
category
monoclinic
difficulty
easy
reasonanswer 'pollucite' ≠ 'albite'

answer

pollucite

expected

albite
id
albite
category
triclinic
difficulty
hard
reasonanswer 'prehnite' ≠ 'andalusite'

answer

prehnite

expected

andalusite
id
andalusite
category
orthorhombic
difficulty
hard
reasonanswer 'none of the listed minerals match all th' ≠ 'andradite'

answer

none of the listed minerals match all the criteria

expected

andradite
id
andradite
category
isometric
difficulty
hard
reasonanswer 'quartz' ≠ 'beryl'

answer

quartz

expected

beryl
id
beryl
category
hexagonal
difficulty
hard
reasonanswer 'creedite' ≠ 'calcite'

answer

creedite

expected

calcite
id
calcite
category
trigonal
difficulty
hard
reasonanswer 'apatite' ≠ 'cancrinite'

answer

apatite

expected

cancrinite
id
cancrinite
category
hexagonal
difficulty
hard
reasonanswer 'epidote' ≠ 'diopside'

answer

epidote

expected

diopside
id
diopside
category
monoclinic
difficulty
hard
reasonanswer 'calcite' ≠ 'dolomite'

answer

calcite

expected

dolomite
id
dolomite
category
trigonal
difficulty
hard
reasonanswer 'none of the listed minerals match all th' ≠ 'elbaite'

answer

none of the listed minerals match all the given properties (trigonal crystal system, hardness 7.5, white streak, green color, vitreous to oily luster, transparent, SG ~2.9). However, the question requires choosing from the provided list, and among them, **amazonite** is a green variety of microcline (triclinic), not trigonal — but wait: amazonite is triclinic, not trigonal. Let’s re-check key constraints: - Trigonal crystal system - Mohs hardness 7.5 - White streak - Green color - Vitreous to oily luster - Transparent - SG ≈ 2.9 Common trigonal minerals: quartz (hardness 7, SG 2.65, usually not green — except prasiolite, but that’s not on list), beryl (hexagonal, not trigonal — though sometimes confused; beryl is hexagonal, *not* trigonal), apatite (hexagonal), calcite (trigonal, but hardness 3, not 7.5), corundum (trigonal, hardness 9, SG 4.0), tourmaline (trigonal, hardness 7–7.5, SG 2.8–3.3, commonly green, white streak, vitreous luster, transparent — yes!). Tourmaline fits: - Crystal system: trigonal - Mohs hardness: 7–7.5 - Streak: white - Color: green (e.g., chrome tourmaline, verdelite) - Luster: vitreous (sometimes described as slightly resinous/oily) - Diaphaneity: transparent to translucent - Specific gravity: 2.8–3.3 → ~2.9 fits And **tourmaline** is in the list. Yes — tourmaline matches all criteria. answer: tourmaline

expected

elbaite
id
elbaite
category
trigonal
difficulty
hard
reasonanswer 'pollucite' ≠ 'grossular'

answer

pollucite

expected

grossular
id
grossular
category
isometric
difficulty
hard
reasonanswer 'epidote' ≠ 'hedenbergite'

answer

epidote

expected

hedenbergite
id
hedenbergite
category
monoclinic
difficulty
hard
reasonanswer 'amazonite' ≠ 'kyanite'

answer

amazonite

expected

kyanite
id
kyanite
category
triclinic
difficulty
easy
reasonanswer 'albite' ≠ 'microcline'

answer

albite

expected

microcline
id
microcline
category
triclinic
difficulty
hard
reasonanswer 'prehnite' ≠ 'natrolite'

answer

prehnite

expected

natrolite
id
natrolite
category
orthorhombic
difficulty
hard
reasonanswer 'cinnabar' ≠ 'rutile'

answer

cinnabar

expected

rutile
id
rutile
category
tetragonal
difficulty
easy
reasonanswer 'creedite' ≠ 'siderite'

answer

creedite

expected

siderite
id
siderite
category
trigonal
difficulty
hard
reasonanswer 'none of the listed minerals match the gi' ≠ 'spodumene'

answer

none of the listed minerals match the given properties exactly. however, based on the provided list and constraints, no mineral in the list has monoclinic crystal system *and* hardness 6.5–7.0 *and* white streak *and* colorless *and* vitreous luster *and* transparent *and* sg ~3.1. but wait — rechecking the list: **epidote** is monoclinic, hardness 6–7, white streak, color commonly green but also colorless or pale, vitreous luster, transparent to translucent, sg 3.4–3.5 — close but sg higher. **titanite (sphene)**: monoclinic, hardness 5–5.5 — too soft. **orthoclase**: monoclinic? No — it's monoclinic *only* in its low-temperature form (sanidine is triclinic, orthoclase is monoclinic? Actually, orthoclase is monoclinic — yes, standard orthoclase is monoclinic. Hardness 6–6.5, streak white, colorless to pink/white, vitreous, transparent, sg ~2.5–2.6 — too low. **albite**: triclinic, not monoclinic. **amazonite**: variety of microcline (triclinic), not monoclinic. Wait — **jadeite** isn’t listed. **Spodumene**: monoclinic, hardness 6.5–7, white streak, colorless varieties exist (e.g., hiddenite less common, but triphane is colorless), vitreous, transparent, sg ~3.1–3.2 — yes! But spodumene *is* in the list. Check spodumene: - crystal system: monoclinic ✅ - Mohs hardness: 6.5–7 ✅ - streak: white ✅ - color: colorless (triaphane variety) ✅ - luster: vitreous ✅ - diaphaneity: transparent ✅ - specific gravity: 3.1–3.2 ✅ And **spodumene** is in the provided list. So answer is: spodumene

expected

spodumene
id
spodumene
category
monoclinic
difficulty
hard
reasonanswer 'creedite' ≠ 'titanite'

answer

creedite

expected

titanite
id
titanite
category
monoclinic
difficulty
medium
reasonanswer 'creedite' ≠ 'tremolite'

answer

creedite

expected

tremolite
id
tremolite
category
monoclinic
difficulty
hard
reasonanswer 'scheelite' ≠ 'zircon'

answer

scheelite

expected

zircon
id
zircon
category
tetragonal
difficulty
medium
discuss this task →