TarantuLabs' proprietary engine generates dozens of new environments an hour. The current focus is cybersecurity, the hardest domain to verify: multi-step exploit chains where up to five vulnerabilities must compose correctly for the flag to fall out. Each one is deterministically solvable and automatically verified, verifiably correct, by the intended path, enforced by gates: the chain composes or it doesn't, with no human judgment and no partial credit. The hard part isn't the exploits; it's generating environments whose correctness is provable at scale.
Each carries a hidden flag, binary ground truth, generated and checked by a deterministic solver. Verifiably correct, by the intended path, enforced by gates, no human grading, no ambiguity.
Exploit chains that must fire in sequence, ideal for evaluating and training correct tool-use and long-horizon tasks.
Every HTTP request, tool call, and reasoning trace is logged. Full per-step telemetry into exactly how an agent reasons, acts, and fails.
If you need them built at scale, provably correct, deterministically verified, and checked to work via the intended path through exploit gates, reach out at tomer@tarantulabs.com or on LinkedIn.
Interactive environments. Launch any one in your browser and attempt the exploit yourself. The same flag a model has to extract is the one you submit.
Proof-of-value for the environments: training runs and model evaluations conducted directly on them. Each study tests specific models or harness configurations under controlled conditions, with binary ground truth and full per-step telemetry. The environments are the product. These studies show they hold up.
Preparing scenario...