solution
BM25 单路(属性文字)
Zhuaiz/elastic-mineral-hackson@8280342 ↗
> 选型依据见 RESEARCH-选型报告.md。 > 数据:MineralImage5k-98(Nesteruk et al. 2023, Fersman 矿物博物馆)——仅私用演示,勿再分发图片。 > 嵌入:jina-clip-v2(CC-BY-NC-4.0,演示需标注)。
bm25 → qwen-pluselastic-agenthack2 total runs
Share
All runs
| # | score | cases | latency | cost | submitted |
|---|---|---|---|---|---|
| #2 | score 0.560 · 28/50 cases passed · 0 skipped | 28/50actinolite: fail — answer 'epidote' ≠ 'actinolite'aegirine: fail — answer 'augite' ≠ 'aegirine'albite: fail — answer 'pollucite' ≠ 'albite'andalusite: fail — answer 'prehnite' ≠ 'andalusite'andradite: fail — answer 'none of the listed minerals match all th' ≠ 'andradite'beryl: fail — answer 'quartz' ≠ 'beryl'calcite: fail — answer 'creedite' ≠ 'calcite'cancrinite: fail — answer 'apatite' ≠ 'cancrinite'diopside: fail — answer 'epidote' ≠ 'diopside'dolomite: fail — answer 'calcite' ≠ 'dolomite'elbaite: fail — answer 'none of the listed minerals match all th' ≠ 'elbaite'grossular: fail — answer 'pollucite' ≠ 'grossular'hedenbergite: fail — answer 'epidote' ≠ 'hedenbergite'kyanite: fail — answer 'amazonite' ≠ 'kyanite'microcline: fail — answer 'albite' ≠ 'microcline'natrolite: fail — answer 'prehnite' ≠ 'natrolite'rutile: fail — answer 'cinnabar' ≠ 'rutile'siderite: fail — answer 'creedite' ≠ 'siderite'spodumene: fail — answer 'none of the listed minerals match the gi' ≠ 'spodumene'titanite: fail — answer 'creedite' ≠ 'titanite'tremolite: fail — answer 'creedite' ≠ 'tremolite'zircon: fail — answer 'scheelite' ≠ 'zircon'almandine: pass — answer 'almandine' matched 'almandine'arsenopyrite: pass — answer 'arsenopyrite' matched 'arsenopyrite'augite: pass — answer 'augite' matched 'augite'azurite: pass — answer 'azurite' matched 'azurite'bournonite: pass — answer 'bournonite' matched 'bournonite'chalcopyrite: pass — answer 'chalcopyrite' matched 'chalcopyrite'chrysoberyl: pass — answer 'chrysoberyl' matched 'chrysoberyl'cobaltite: pass — answer 'cobaltite' matched 'cobaltite'corundum: pass — answer 'corundum' matched 'corundum'creedite: pass — answer 'creedite' matched 'creedite'cuprite: pass — answer 'cuprite' matched 'cuprite'epidote: pass — answer 'epidote' matched 'epidote'fluorite: pass — answer 'fluorite' matched 'fluorite'galena: pass — answer 'galena' matched 'galena'graphite: pass — answer 'graphite' matched 'graphite'hematite: pass — answer 'hematite' matched 'hematite'ilmenite: pass — answer 'ilmenite' matched 'ilmenite'magnetite: pass — answer 'magnetite' matched 'magnetite'molybdenite: pass — answer 'molybdenite' matched 'molybdenite'pollucite: pass — answer 'pollucite' matched 'pollucite'prehnite: pass — answer 'prehnite' matched 'prehnite'pyrite: pass — answer 'pyrite' matched 'pyrite'pyrrhotite: pass — answer 'pyrrhotite' matched 'pyrrhotite'scheelite: pass — answer 'scheelite' matched 'scheelite'sphalerite: pass — answer 'sphalerite' matched 'sphalerite'stibnite: pass — answer 'stibnite' matched 'stibnite'topaz: pass — answer 'topaz' matched 'topaz'vivianite: pass — answer 'vivianite' matched 'vivianite' | 23.00s | — | 19d ago |
| #1 | score 0.560 · 28/50 cases passed · 0 skipped | 28/50actinolite: fail — answer 'epidote' ≠ 'actinolite'aegirine: fail — answer 'augite' ≠ 'aegirine'albite: fail — answer 'pollucite' ≠ 'albite'andalusite: fail — answer 'prehnite' ≠ 'andalusite'andradite: fail — answer 'none of the listed minerals match all th' ≠ 'andradite'beryl: fail — answer 'quartz' ≠ 'beryl'calcite: fail — answer 'creedite' ≠ 'calcite'cancrinite: fail — answer 'apatite' ≠ 'cancrinite'diopside: fail — answer 'epidote' ≠ 'diopside'dolomite: fail — answer 'calcite' ≠ 'dolomite'elbaite: fail — answer 'none of the listed minerals match all th' ≠ 'elbaite'grossular: fail — answer 'pollucite' ≠ 'grossular'hedenbergite: fail — answer 'epidote' ≠ 'hedenbergite'kyanite: fail — answer 'amazonite' ≠ 'kyanite'microcline: fail — answer 'albite' ≠ 'microcline'natrolite: fail — answer 'prehnite' ≠ 'natrolite'rutile: fail — answer 'cinnabar' ≠ 'rutile'siderite: fail — answer 'creedite' ≠ 'siderite'spodumene: fail — answer 'none of the listed minerals match the gi' ≠ 'spodumene'titanite: fail — answer 'creedite' ≠ 'titanite'tremolite: fail — answer 'creedite' ≠ 'tremolite'zircon: fail — answer 'scheelite' ≠ 'zircon'almandine: pass — answer 'almandine' matched 'almandine'arsenopyrite: pass — answer 'arsenopyrite' matched 'arsenopyrite'augite: pass — answer 'augite' matched 'augite'azurite: pass — answer 'azurite' matched 'azurite'bournonite: pass — answer 'bournonite' matched 'bournonite'chalcopyrite: pass — answer 'chalcopyrite' matched 'chalcopyrite'chrysoberyl: pass — answer 'chrysoberyl' matched 'chrysoberyl'cobaltite: pass — answer 'cobaltite' matched 'cobaltite'corundum: pass — answer 'corundum' matched 'corundum'creedite: pass — answer 'creedite' matched 'creedite'cuprite: pass — answer 'cuprite' matched 'cuprite'epidote: pass — answer 'epidote' matched 'epidote'fluorite: pass — answer 'fluorite' matched 'fluorite'galena: pass — answer 'galena' matched 'galena'graphite: pass — answer 'graphite' matched 'graphite'hematite: pass — answer 'hematite' matched 'hematite'ilmenite: pass — answer 'ilmenite' matched 'ilmenite'magnetite: pass — answer 'magnetite' matched 'magnetite'molybdenite: pass — answer 'molybdenite' matched 'molybdenite'pollucite: pass — answer 'pollucite' matched 'pollucite'prehnite: pass — answer 'prehnite' matched 'prehnite'pyrite: pass — answer 'pyrite' matched 'pyrite'pyrrhotite: pass — answer 'pyrrhotite' matched 'pyrrhotite'scheelite: pass — answer 'scheelite' matched 'scheelite'sphalerite: pass — answer 'sphalerite' matched 'sphalerite'stibnite: pass — answer 'stibnite' matched 'stibnite'topaz: pass — answer 'topaz' matched 'topaz'vivianite: pass — answer 'vivianite' matched 'vivianite' | — | — | 19d ago |