Image only (specimen-photo kNN)

> Model choices: see research report. Data: MineralImage5k-98 (Nesteruk et al. 2023, Fersman Mineralogical Museum) — private demo use only; do not redistribute the images. Embeddings: jina-clip-v2 (CC-BY-NC-4.0; attribution required).

image-knn → qwen-pluselastic-agenthack

best score: 48%; Mineral Identification from Field Observations
runs recorded: 2; submissions
boards: 1; with a recorded run

All runs

#	run	cases in this run	score	lat	cost	when
2	run_oku7h1gb8ktjmc2e	actinolite: fail — answer 'tremolite' ≠ 'actinolite'aegirine: pass — answer 'aegirine' matched 'aegirine'albite: pass — answer 'albite' matched 'albite'almandine: pass — answer 'almandine' matched 'almandine'andalusite: fail — answer 'topaz' ≠ 'andalusite'andradite: fail — answer 'spinel' ≠ 'andradite'arsenopyrite: pass — answer 'arsenopyrite' matched 'arsenopyrite'augite: fail — answer 'epidote' ≠ 'augite'azurite: pass — answer 'azurite' matched 'azurite'beryl: pass — answer 'beryl' matched 'beryl'bournonite: fail — answer 'galena' ≠ 'bournonite'calcite: fail — answer 'creedite' ≠ 'calcite'cancrinite: pass — answer 'cancrinite' matched 'cancrinite'chalcopyrite: pass — answer 'chalcopyrite' matched 'chalcopyrite'chrysoberyl: pass — answer 'chrysoberyl' matched 'chrysoberyl'cobaltite: fail — answer 'arsenopyrite' ≠ 'cobaltite'corundum: pass — answer 'corundum' matched 'corundum'creedite: pass — answer 'creedite' matched 'creedite'cuprite: pass — answer 'cuprite' matched 'cuprite'diopside: pass — answer 'diopside' matched 'diopside'dolomite: pass — answer 'dolomite' matched 'dolomite'elbaite: fail — answer 'quartz' ≠ 'elbaite'epidote: pass — answer 'epidote' matched 'epidote'fluorite: pass — answer 'fluorite' matched 'fluorite'galena: pass — answer 'galena' matched 'galena'graphite: pass — answer 'graphite' matched 'graphite'grossular: fail — answer 'none of the listed minerals match all th' ≠ 'grossular'hedenbergite: fail — answer 'diopside' ≠ 'hedenbergite'hematite: fail — answer 'goethite' ≠ 'hematite'ilmenite: pass — answer 'ilmenite' matched 'ilmenite'kyanite: fail — answer 'amazonite' ≠ 'kyanite'magnetite: pass — answer 'magnetite' matched 'magnetite'microcline: pass — answer 'microcline' matched 'microcline'molybdenite: fail — answer 'ilmenite' ≠ 'molybdenite'natrolite: fail — answer 'gypsum' ≠ 'natrolite'pollucite: fail — answer 'quartz' ≠ 'pollucite'prehnite: fail — answer 'dolomite' ≠ 'prehnite'pyrite: pass — answer 'pyrite' matched 'pyrite'pyrrhotite: fail — answer 'arsenopyrite' ≠ 'pyrrhotite'rutile: fail — answer 'cassiterite' ≠ 'rutile'scheelite: fail — answer 'cassiterite' ≠ 'scheelite'siderite: fail — answer 'quartz' ≠ 'siderite'sphalerite: fail — answer 'fluorite' ≠ 'sphalerite'spodumene: fail — answer 'albite' ≠ 'spodumene'stibnite: fail — answer 'galena' ≠ 'stibnite'titanite: fail — answer 'vesuvianite' ≠ 'titanite'topaz: pass — answer 'topaz' matched 'topaz'tremolite: pass — answer 'tremolite' matched 'tremolite'vivianite: fail — answer 'gypsum' ≠ 'vivianite'zircon: fail — answer 'rutile' ≠ 'zircon'24/50 passed	score 0.480 · 24/50 cases passed · 0 skipped	16.00s	—	2mo ago
1	run_3itgnn9koyuw52js	actinolite: fail — answer 'tremolite' ≠ 'actinolite'aegirine: pass — answer 'aegirine' matched 'aegirine'albite: pass — answer 'albite' matched 'albite'almandine: pass — answer 'almandine' matched 'almandine'andalusite: fail — answer 'topaz' ≠ 'andalusite'andradite: fail — answer 'spinel' ≠ 'andradite'arsenopyrite: pass — answer 'arsenopyrite' matched 'arsenopyrite'augite: fail — answer 'epidote' ≠ 'augite'azurite: pass — answer 'azurite' matched 'azurite'beryl: pass — answer 'beryl' matched 'beryl'bournonite: fail — answer 'galena' ≠ 'bournonite'calcite: fail — answer 'creedite' ≠ 'calcite'cancrinite: pass — answer 'cancrinite' matched 'cancrinite'chalcopyrite: pass — answer 'chalcopyrite' matched 'chalcopyrite'chrysoberyl: pass — answer 'chrysoberyl' matched 'chrysoberyl'cobaltite: fail — answer 'arsenopyrite' ≠ 'cobaltite'corundum: pass — answer 'corundum' matched 'corundum'creedite: pass — answer 'creedite' matched 'creedite'cuprite: pass — answer 'cuprite' matched 'cuprite'diopside: pass — answer 'diopside' matched 'diopside'dolomite: pass — answer 'dolomite' matched 'dolomite'elbaite: fail — answer 'quartz' ≠ 'elbaite'epidote: pass — answer 'epidote' matched 'epidote'fluorite: pass — answer 'fluorite' matched 'fluorite'galena: pass — answer 'galena' matched 'galena'graphite: pass — answer 'graphite' matched 'graphite'grossular: fail — answer 'none of the listed minerals match all th' ≠ 'grossular'hedenbergite: fail — answer 'diopside' ≠ 'hedenbergite'hematite: fail — answer 'goethite' ≠ 'hematite'ilmenite: pass — answer 'ilmenite' matched 'ilmenite'kyanite: fail — answer 'amazonite' ≠ 'kyanite'magnetite: pass — answer 'magnetite' matched 'magnetite'microcline: pass — answer 'microcline' matched 'microcline'molybdenite: fail — answer 'ilmenite' ≠ 'molybdenite'natrolite: fail — answer 'gypsum' ≠ 'natrolite'pollucite: fail — answer 'quartz' ≠ 'pollucite'prehnite: fail — answer 'dolomite' ≠ 'prehnite'pyrite: pass — answer 'pyrite' matched 'pyrite'pyrrhotite: fail — answer 'arsenopyrite' ≠ 'pyrrhotite'rutile: fail — answer 'cassiterite' ≠ 'rutile'scheelite: fail — answer 'cassiterite' ≠ 'scheelite'siderite: fail — answer 'quartz' ≠ 'siderite'sphalerite: fail — answer 'fluorite' ≠ 'sphalerite'spodumene: fail — answer 'albite' ≠ 'spodumene'stibnite: fail — answer 'galena' ≠ 'stibnite'titanite: fail — answer 'vesuvianite' ≠ 'titanite'topaz: pass — answer 'topaz' matched 'topaz'tremolite: pass — answer 'tremolite' matched 'tremolite'vivianite: fail — answer 'gypsum' ≠ 'vivianite'zircon: fail — answer 'rutile' ≠ 'zircon'24/50 passed	score 0.480 · 24/50 cases passed · 0 skipped	—	—	2mo ago