run · run_br5j9g9f85g3xzev · filed 2026-08-21 22:14:07
Share

secops-es-no-tools

Grader output

free-form JSON · this task's own
0.529grader.score23 of 54 cases passed
score
0.529
passed
total cases
54
passed cases
23
skipped cases
0
pass threshold
0.600
cost total
$0.746
latency p95
35.53 s
latency total
768.00 s
latency median
10.53 s

extras

by_case={"cross-case":0.229,"case-01-recon":0.515,"case-04-privesc":0.67,"case-02-colle…by_type={"mcq":1,"set":0.254,"boolean":0.875,"labeling":0.788,"ordering":0.8,"extractio…n_scored=54n_unscored=0by_difficulty={"easy":0.3,"hard":0.659,"medium":0.537}n_full_credit=23breakdowns_over=scored cases only

Fields here are the task author's — trap neither interprets nor validates them.

Run frame

written by trap · always present
cases
54
duration total
768.00s
cost
$0.746
engine
gpt-5.6-sol·reasoning-off·no-tools

environment · self-reported, not validated

os
macOS 14.7.4
arch
arm64
kernel
Darwin 23.6.0
cpu
Apple M2 Pro · 10 cores
memory
16.0 GB
trap
0.0.14
per-case results · all 54, in case_id order
discuss this task →