all tasks / sol_wgbq4l8kjy3tsdio
solution · Zhuaiz/secops-es-trapstreet@0137cd1 ↗
Share
secops-es-agent
A trapstreet port of **secops-es-benchmark** by TocharianOU — 54 auto-graded SOC-investigation questions over ~239k real ECS documents in a live, read-only Elasticsearch.
gpt-5.6-sol·reasoning-offsecops-es-benchmark-port
- best score
- 86%
- SecOps investigation in Elasticsearch
- runs recorded
- 1
- submissions
- boards
- 1
- with a recorded run
All runs
| # | run | cases in this run | score | lat | cost | when |
|---|---|---|---|---|---|---|
| 1 | run_hr0gcdy5yuled3av | q-c01-attck: partial — set_f1: partial (0.75)q-c01-c2-ip: pass — exact_ci: hit (1.00)q-c01-c2-port: pass — exact_ci: hit (1.00)q-c01-credaccess-file: pass — exact_ci: hit (1.00)q-c01-delivery: pass — mcq: hit (1.00)q-c01-disc-8080: pass — mcq: hit (1.00)q-c01-iocs: partial — set_f1: partial (0.67)q-c01-neg-zeekcron: pass — boolean: hit (1.00)q-c01-persistence: pass — exact_ci: hit (1.00)q-c01-root-cause: pass — exact_ci: hit (1.00)q-c01-timeline: pass — ordering: hit (1.00)q-c02-archive: pass — exact_ci: hit (1.00)q-c02-attck: partial — set_f1: partial (0.42)q-c02-decoy-or-real: pass — mcq: hit (1.00)q-c02-exfil-dest: pass — exact_ci: hit (1.00)q-c02-exfil-happened: fail — boolean: miss (0.00)q-c02-portscan: pass — mcq: hit (1.00)q-c02-same-actor: pass — boolean: hit (1.00)q-c02-ti-match: pass — boolean: hit (1.00)q-c02-timestomp: fail — exact_ci: miss (0.00)q-c03-attck: pass — set_f1: hit (1.00)q-c03-handsonkbd: partial — set_f1: partial (0.60)q-c03-initial-access: pass — exact_ci: hit (1.00)q-c03-log4shell: pass — mcq: hit (1.00)q-c03-neg-benign-ua: pass — boolean: hit (1.00)q-c03-revshell-dest: pass — exact_ci: hit (1.00)q-c03-revshell-mechanism: pass — mcq: hit (1.00)q-c03-webshell: pass — exact_ci: hit (1.00)q-c03-webtools: fail — set_f1: miss (0.00)q-c04-already-root: pass — mcq: hit (1.00)q-c04-antiforensics: pass — boolean: hit (1.00)q-c04-attck: partial — set_f1: partial (0.36)q-c04-binary-copy-alert: pass — exact_ci: hit (1.00)q-c04-gtfobins: partial — set_f1: partial (0.67)q-c04-severity-calibration: pass — mcq: hit (1.00)q-c04-suid-artifact: pass — exact_ci: hit (1.00)q-c04-suid-how: pass — mcq: hit (1.00)q-c05-access-method: pass — mcq: hit (1.00)q-c05-attck: pass — set_f1: hit (1.00)q-c05-correlation-ip: pass — exact_ci: hit (1.00)q-c05-cred: pass — exact_ci: hit (1.00)q-c05-discriminator: pass — mcq: hit (1.00)q-c05-neg-scannoise: pass — boolean: hit (1.00)q-c05-recon: partial — set_f1: partial (0.43)q-c05-scope: pass — exact_ci: hit (1.00)q-c05-source-host: pass — exact_ci: hit (1.00)q-c05-target-host: pass — exact_ci: hit (1.00)q-x-attacker-ip: pass — exact_ci: hit (1.00)q-x-containment: fail — set_f1: miss (0.00)q-x-hosts: pass — set_f1: hit (1.00)q-x-implant: pass — exact_ci: hit (1.00)q-x-iocs-full: partial — set_f1: partial (0.89)q-x-killchain-order: partial — ordering: partial (0.70)q-x-single-intrusion: pass — boolean: hit (1.00)41/54 passed | mean score 0.861 across 54 cases | 1919.00s | $16.941 | 4d ago |