run · run_q1962s0ccq26dq63
alfred-ruqilabs/wildlife-classifier-zamba@c3c41ed
on Can your model identify animals?
total score
0.800
engine
zamba-speciesnet-cv
cases
16 passed · 4 failed
latency
431.00s
cost
$0.0000
submitted
2026-07-10 12:18:16
Run summary
- score
- 0.800
- passed
- ✓
- total cases
- 20
- passed cases
- 16
- skipped cases
- 0
- pass threshold
- 0.800
- cost total
- $0.0000
- latency p95
- 72.97 s
- latency total
- 431.00 s
- latency median
- 16.06 s
score by category
lion
50%
hyena
100%
zebra
100%
buffalo
50%
cheetah
100%
giraffe
100%
leopard
50%
warthog
50%
elephant
100%
wildebeest
100%
extras
n_scored=20n_skipped_no_gold=0Environment
Self-reported by the solution. Not validated.
- os
- macOS 14.0
- arch
- arm64
- kernel
- Darwin 23.0.0
- cpu
- Apple M1 · 8 cores
- memory
- 8.0 GB
- trap
- 0.0.1
Per-case results
16 pass4 fail
answer
wildebeest
expected
buffalo
- id
- buffalo_02
- type
- species_classification
- category
- buffalo
- difficulty
- easy
- matcher_results
- [{"kind":"leading_word","pass":false,"reason":"leading word 'wildebeest' ≠ required 'buffalo'"},{"kind":"no_hedge","pass":true,"reason":"no hedge phrases"}]
answer
cheetah
expected
leopard
- id
- leopard_01
- type
- species_classification
- category
- leopard
- difficulty
- hard
- matcher_results
- [{"kind":"leading_word","pass":false,"reason":"leading word 'cheetah' ≠ required 'leopard'"},{"kind":"no_hedge","pass":true,"reason":"no hedge phrases"}]
answer
warthog
expected
lion
- id
- lion_02
- type
- species_classification
- category
- lion
- difficulty
- medium
- matcher_results
- [{"kind":"leading_word","pass":false,"reason":"leading word 'warthog' ≠ required 'lion'"},{"kind":"no_hedge","pass":true,"reason":"no hedge phrases"}]
answer
wildebeest
expected
warthog
- id
- warthog_02
- type
- species_classification
- category
- warthog
- difficulty
- medium
- matcher_results
- [{"kind":"leading_word","pass":false,"reason":"leading word 'wildebeest' ≠ required 'warthog'"},{"kind":"no_hedge","pass":true,"reason":"no hedge phrases"}]