all tasks / sol_xu05j530iyktotnk
solution · Zhuaiz/secops-es-trapstreet/configs/no-tools@0137cd1 ↗
Share
secops-es-no-tools
A trapstreet port of **secops-es-benchmark** by TocharianOU — 54 auto-graded SOC-investigation questions over ~239k real ECS documents in a live, read-only Elasticsearch.
gpt-5.6-sol·reasoning-off·no-toolssecops-es-benchmark-port
- best score
- 53%
- SecOps investigation in Elasticsearch
- runs recorded
- 1
- submissions
- boards
- 1
- with a recorded run
All runs
| # | run | cases in this run | score | lat | cost | when |
|---|---|---|---|---|---|---|
| 1 | run_br5j9g9f85g3xzev | q-c01-attck: partial — set_f1: partial (0.67)q-c01-c2-ip: fail — exact_ci: miss (0.00)q-c01-c2-port: fail — exact_ci: miss (0.00)q-c01-credaccess-file: pass — exact_ci: hit (1.00)q-c01-delivery: pass — mcq: hit (1.00)q-c01-disc-8080: pass — mcq: hit (1.00)q-c01-iocs: fail — set_f1: miss (0.00)q-c01-neg-zeekcron: pass — boolean: hit (1.00)q-c01-persistence: fail — exact_ci: miss (0.00)q-c01-root-cause: fail — exact_ci: miss (0.00)q-c01-timeline: pass — ordering: hit (1.00)q-c02-archive: fail — exact_ci: miss (0.00)q-c02-attck: partial — set_f1: partial (0.62)q-c02-decoy-or-real: pass — mcq: hit (1.00)q-c02-exfil-dest: fail — exact_ci: miss (0.00)q-c02-exfil-happened: fail — boolean: miss (0.00)q-c02-portscan: pass — mcq: hit (1.00)q-c02-same-actor: pass — boolean: hit (1.00)q-c02-ti-match: pass — boolean: hit (1.00)q-c02-timestomp: fail — exact_ci: miss (0.00)q-c03-attck: partial — set_f1: partial (0.80)q-c03-handsonkbd: partial — set_f1: partial (0.50)q-c03-initial-access: pass — exact_ci: hit (1.00)q-c03-log4shell: pass — mcq: hit (1.00)q-c03-neg-benign-ua: pass — boolean: hit (1.00)q-c03-revshell-dest: fail — exact_ci: miss (0.00)q-c03-revshell-mechanism: pass — mcq: hit (1.00)q-c03-webshell: fail — exact_ci: miss (0.00)q-c03-webtools: partial — set_f1: partial (0.57)q-c04-already-root: pass — mcq: hit (1.00)q-c04-antiforensics: pass — boolean: hit (1.00)q-c04-attck: partial — set_f1: partial (0.86)q-c04-binary-copy-alert: fail — exact_ci: miss (0.00)q-c04-gtfobins: partial — set_f1: partial (0.50)q-c04-severity-calibration: pass — mcq: hit (1.00)q-c04-suid-artifact: fail — exact_ci: miss (0.00)q-c04-suid-how: pass — mcq: hit (1.00)q-c05-access-method: pass — mcq: hit (1.00)q-c05-attck: pass — set_f1: hit (1.00)q-c05-correlation-ip: fail — exact_ci: miss (0.00)q-c05-cred: fail — exact_ci: miss (0.00)q-c05-discriminator: pass — mcq: hit (1.00)q-c05-neg-scannoise: pass — boolean: hit (1.00)q-c05-recon: partial — set_f1: partial (0.46)q-c05-scope: pass — exact_ci: hit (1.00)q-c05-source-host: fail — exact_ci: miss (0.00)q-c05-target-host: fail — exact_ci: miss (0.00)q-x-attacker-ip: fail — exact_ci: miss (0.00)q-x-containment: fail — set_f1: miss (0.00)q-x-hosts: fail — set_f1: miss (0.00)q-x-implant: fail — exact_ci: miss (0.00)q-x-iocs-full: fail — set_f1: miss (0.00)q-x-killchain-order: partial — ordering: partial (0.60)q-x-single-intrusion: pass — boolean: hit (1.00)23/54 passed | mean score 0.529 across 54 cases | 768.00s | $0.746 | 4d ago |