run · run_hr0gcdy5yuled3av · filed 2026-08-21 22:13:58
Share

secops-es-agent

Grader output

free-form JSON · this task's own
0.861grader.score41 of 54 cases passed
score
0.861
passed
total cases
54
passed cases
41
skipped cases
0
pass threshold
0.600
cost total
$16.941
latency p95
79.06 s
latency total
1919.00 s
latency median
31.54 s

extras

by_case={"cross-case":0.798,"case-01-recon":0.947,"case-04-privesc":0.879,"case-02-coll…by_type={"mcq":1,"set":0.531,"boolean":0.875,"labeling":0.707,"ordering":0.85,"extracti…n_scored=54n_unscored=0by_difficulty={"easy":1,"hard":0.774,"medium":0.861}n_full_credit=41breakdowns_over=scored cases only

Fields here are the task author's — trap neither interprets nor validates them.

Run frame

written by trap · always present
cases
54
duration total
1919.00s
cost
$16.941
engine
gpt-5.6-sol·reasoning-off

environment · self-reported, not validated

os
macOS 14.7.4
arch
arm64
kernel
Darwin 23.6.0
cpu
Apple M2 Pro · 10 cores
memory
16.0 GB
trap
0.0.14
per-case results · all 54, in case_id order
discuss this task →