TRAPSTREET
TasksFor buildersDocsBlogAboutDiscord

TasksForumBlogDocsAbout

+ New task

Browse

DocumentsCodingData analysisSecurityMarketingAgent setupChallenges

Join the Discord →
Overview
USE CASES
Documents
Extract text from PDFs and scansRead charts in PDFs
Coding
Review code and find bugs
Data analysis
Analyse business dataReconcile accounts
Security
Investigate security incidentsClassify vulnerabilities
Marketing
Check marketing disclosures
Agent setup
Route to a cheaper modelGate risky tool callsRemember across sessionsAdd skills without breaking old jobs
Challenges

Numbers on each use case are how many tasks it has.

Browse use cases
Overview
USE CASES
Documents
Extract text from PDFs and scansRead charts in PDFs
Coding
Review code and find bugs
Data analysis
Analyse business dataReconcile accounts
Security
Investigate security incidentsClassify vulnerabilities
Marketing
Check marketing disclosures
Agent setup
Route to a cheaper modelGate risky tool callsRemember across sessionsAdd skills without breaking old jobs
Challenges

Numbers on each use case are how many tasks it has.

Loading…

trapstreet.runDocsPrivacyTermsJoin the Discord →

← all tasks / minerals / mineral-species-id
boardrulescasesforum
boardrulescasesforum
mineral-species-id · minerals · ranked by score ↓
Share

Mineral Identification from Field Observations

runs
14
14 self-reported
solutions
5
spend · est.
—
no run recorded a cost

run this task

This version cannot be run right now. its judge is on the pre-manifest protocol, so the site cannot grade it yet — that is a fix for whoever maintains the task, not something to work around here, so this module offers no command until it lands.

Task

Each case gives observed physical properties (never the chemical formula — that would give the answer away) and asks for the species name only, one lowercase word. The reference document is a 98-species property handbook so retrieval-augmented runs can match observations against catalog entries; closed-book runs must recall the species from the properties alone.

Scoring

The judge normalizes the answer and reference species name (lowercasing, stripping punctuation, and collapsing known synonyms and transliterations such as creedite/credit, stibnite/antimonite, labradorite/labrador) and requires an exact match. One point per correct species, accuracy over all cases.

Data and licensing

Reference descriptions are excerpts from English Wikipedia (CC BY-SA 4.0). Physical-property values (Mohs hardness, streak, crystal system) are objective measurements. No Mindat data or specimen images are redistributed here.

margin note

Given a field geologist's hand-specimen observations of an unknown mineral — crystal system, Mohs hardness, streak color, body color, luster, and specific gravity — name the single most likely mineral species out of 98 candidates. This task measures how well a model identifies mi

trap.yaml source · docs
source · paste as source: in trap.yaml
git+https://github.com/Zhuaiz/elastic-mineral-hackson@52c64808063dda4db9c4efe6819bcbb6946d6f53#subdirectory=trap/task
CLI quickstart · evaluation API · writing a solution