solution

闭卷(裸 Qwen·无检索)

Zhuaiz/elastic-mineral-hackson@4703499

> 选型依据见 RESEARCH-选型报告.md。 > 数据:MineralImage5k-98(Nesteruk et al. 2023, Fersman 矿物博物馆)——仅私用演示,勿再分发图片。 > 嵌入:jina-clip-v2(CC-BY-NC-4.0,演示需标注)。

no-retrieval → qwen-pluselastic-agenthack2 total runs
Share

All runs

#scorecaseslatencycostsubmitted
#2score 0.360 · 18/50 cases passed · 0 skipped18/50actinolite: fail — answer 'epidote' ≠ 'actinolite'aegirine: fail — answer 'augite' ≠ 'aegirine'andalusite: fail — answer 'amazonite' ≠ 'andalusite'andradite: fail — answer 'cassiterite' ≠ 'andradite'arsenopyrite: fail — answer 'ilmenite' ≠ 'arsenopyrite'augite: fail — answer 'epidote' ≠ 'augite'bournonite: fail — answer 'galena' ≠ 'bournonite'cancrinite: fail — answer 'apatite' ≠ 'cancrinite'chalcopyrite: fail — answer 'aegirine' ≠ 'chalcopyrite'chrysoberyl: fail — answer 'topaz' ≠ 'chrysoberyl'cobaltite: fail — answer 'arsenopyrite' ≠ 'cobaltite'creedite: fail — answer 'albite' ≠ 'creedite'diopside: fail — answer 'epidote' ≠ 'diopside'dolomite: fail — answer 'calcite' ≠ 'dolomite'elbaite: fail — answer 'amazonite' ≠ 'elbaite'grossular: fail — answer 'andradite' ≠ 'grossular'hedenbergite: fail — answer 'epidote' ≠ 'hedenbergite'hematite: fail — answer 'goethite' ≠ 'hematite'kyanite: fail — answer 'amazonite' ≠ 'kyanite'microcline: fail — answer 'albite' ≠ 'microcline'natrolite: fail — answer 'analcime' ≠ 'natrolite'pollucite: fail — answer 'quartz' ≠ 'pollucite'prehnite: fail — answer 'albite' ≠ 'prehnite'pyrite: fail — answer 'chromite' ≠ 'pyrite'pyrrhotite: fail — answer 'arsenopyrite' ≠ 'pyrrhotite'rutile: fail — answer 'cinnabar' ≠ 'rutile'siderite: fail — answer 'apatite' ≠ 'siderite'sphalerite: fail — answer 'apatite' ≠ 'sphalerite'spodumene: fail — answer 'albite' ≠ 'spodumene'stibnite: fail — answer 'galena' ≠ 'stibnite'tremolite: fail — answer 'albite' ≠ 'tremolite'vivianite: fail — answer 'gypsum' ≠ 'vivianite'albite: pass — answer 'albite' matched 'albite'almandine: pass — answer 'almandine' matched 'almandine'azurite: pass — answer 'azurite' matched 'azurite'beryl: pass — answer 'beryl' matched 'beryl'calcite: pass — answer 'calcite' matched 'calcite'corundum: pass — answer 'corundum' matched 'corundum'cuprite: pass — answer 'cuprite' matched 'cuprite'epidote: pass — answer 'epidote' matched 'epidote'fluorite: pass — answer 'fluorite' matched 'fluorite'galena: pass — answer 'galena' matched 'galena'graphite: pass — answer 'graphite' matched 'graphite'ilmenite: pass — answer 'ilmenite' matched 'ilmenite'magnetite: pass — answer 'magnetite' matched 'magnetite'molybdenite: pass — answer 'molybdenite' matched 'molybdenite'scheelite: pass — answer 'scheelite' matched 'scheelite'titanite: pass — answer 'titanite' matched 'titanite'topaz: pass — answer 'topaz' matched 'topaz'zircon: pass — answer 'zircon' matched 'zircon'16.00s19d ago
#1score 0.360 · 18/50 cases passed · 0 skipped18/50actinolite: fail — answer 'epidote' ≠ 'actinolite'aegirine: fail — answer 'augite' ≠ 'aegirine'andalusite: fail — answer 'amazonite' ≠ 'andalusite'andradite: fail — answer 'cassiterite' ≠ 'andradite'arsenopyrite: fail — answer 'ilmenite' ≠ 'arsenopyrite'augite: fail — answer 'epidote' ≠ 'augite'bournonite: fail — answer 'galena' ≠ 'bournonite'cancrinite: fail — answer 'apatite' ≠ 'cancrinite'chalcopyrite: fail — answer 'aegirine' ≠ 'chalcopyrite'chrysoberyl: fail — answer 'topaz' ≠ 'chrysoberyl'cobaltite: fail — answer 'arsenopyrite' ≠ 'cobaltite'creedite: fail — answer 'albite' ≠ 'creedite'diopside: fail — answer 'epidote' ≠ 'diopside'dolomite: fail — answer 'calcite' ≠ 'dolomite'elbaite: fail — answer 'amazonite' ≠ 'elbaite'grossular: fail — answer 'andradite' ≠ 'grossular'hedenbergite: fail — answer 'epidote' ≠ 'hedenbergite'hematite: fail — answer 'goethite' ≠ 'hematite'kyanite: fail — answer 'amazonite' ≠ 'kyanite'microcline: fail — answer 'albite' ≠ 'microcline'natrolite: fail — answer 'analcime' ≠ 'natrolite'pollucite: fail — answer 'quartz' ≠ 'pollucite'prehnite: fail — answer 'albite' ≠ 'prehnite'pyrite: fail — answer 'chromite' ≠ 'pyrite'pyrrhotite: fail — answer 'arsenopyrite' ≠ 'pyrrhotite'rutile: fail — answer 'cinnabar' ≠ 'rutile'siderite: fail — answer 'apatite' ≠ 'siderite'sphalerite: fail — answer 'apatite' ≠ 'sphalerite'spodumene: fail — answer 'albite' ≠ 'spodumene'stibnite: fail — answer 'galena' ≠ 'stibnite'tremolite: fail — answer 'albite' ≠ 'tremolite'vivianite: fail — answer 'gypsum' ≠ 'vivianite'albite: pass — answer 'albite' matched 'albite'almandine: pass — answer 'almandine' matched 'almandine'azurite: pass — answer 'azurite' matched 'azurite'beryl: pass — answer 'beryl' matched 'beryl'calcite: pass — answer 'calcite' matched 'calcite'corundum: pass — answer 'corundum' matched 'corundum'cuprite: pass — answer 'cuprite' matched 'cuprite'epidote: pass — answer 'epidote' matched 'epidote'fluorite: pass — answer 'fluorite' matched 'fluorite'galena: pass — answer 'galena' matched 'galena'graphite: pass — answer 'graphite' matched 'graphite'ilmenite: pass — answer 'ilmenite' matched 'ilmenite'magnetite: pass — answer 'magnetite' matched 'magnetite'molybdenite: pass — answer 'molybdenite' matched 'molybdenite'scheelite: pass — answer 'scheelite' matched 'scheelite'titanite: pass — answer 'titanite' matched 'titanite'topaz: pass — answer 'topaz' matched 'topaz'zircon: pass — answer 'zircon' matched 'zircon'19d ago