
Patronus Insights · Episode 3
The road to sub-cent AI security inference
Sep 2026 · 12 pages · PDF · German · 1,0 MB
AI security becomes an inference problem as agents, tool calls, and context windows grow. This issue shows how Patronus Ark separates high-volume CPU routing from selective deep inference: at the validated operating point, roughly 25% of chunks reach L3 while F1 and false-positive behavior remain approximately at the level of full L3 inference. It connects that architecture to measured CPU and NVIDIA L4 throughput, TensorRT latency, and the planned Patronus Pro price of about €0.0067 per million protected tokens at continuous 4,000-token-per-second usage.
What's inside
- Selective inference: why roughly 25% L3 promotion can retain approximately full-L3 quality at the validated operating point
- Measured stack: about 963k CPU L2 input tokens/s and about 387k L3 tokens/s on a full NVIDIA L4
- Economics and scaling: separate CPU and GPU bottlenecks, plus the assumptions behind about €0.0067 per million protected tokens
Related on this site: Blog: Sub-cent AI security inference · Deep dive: Patronus Ark on CPU · AI Models

