Our AI-Security Model Zoo Is Now Open Source
Dominik Hommer
7 min
AI Security Research

Securing an AI application means answering several different questions at once. Is this prompt an instruction from the user, or an injection embedded in a webpage the agent just fetched? Is this uploaded document a lunch menu or a salary list? Is this tool call reading a config file, or moving sensitive data to an external endpoint? Each question needs an answer in milliseconds, on the device where the traffic originates.
In March we released Wolf Defender, our prompt-injection detector. In June, Orca-Sonar followed for document classification. Today we're releasing the complete model family.
What We're Releasing
Six model families, all Apache-2.0, all on Hugging Face:
Model | Task | Classes | Macro-F1* |
|---|---|---|---|
Wolf Defender | Prompt-injection detection and threat classification | binary + 7 threat types | 0.997 / 0.945 |
Orca Sonar | Document classification | 7 | 0.978 |
Husky Sight | Tool-type classification for agent tool calls | 14 | 0.957 |
Husky Paw | Tool-operation classification | 6 | 0.937 |
Husky Nose | Data-flow risk classification | 3, multi-label | 0.965 |
Panther Read | User-intent classification and routing | 5 | 0.899 |
Lion Warden | All seven tasks in one unified model | 7 heads | 0.92–0.98 per head |
*Measured on held-out test sets consisting exclusively of real-world data. Details under Performance.
The release also includes quantized GLiNER edge builds for zero-shot entity extraction. These are not our models: we exported and quantized the upstream work and documented every modification in the model cards.
Under the Hood
All models are fine-tuned from the mmBERT family (ModernBERT architecture, MIT license) and trained bilingually on English and German data.
The training data combines curated real-world sources with targeted augmentation: homoglyph substitution, character encodings, zero-width characters, leetspeak, and natural-language wrappers around attack payloads. These augmentations are applied to positive and negative examples alike, so the models learn to key on content rather than surface form. Evaluation is stricter: test sets contain no synthetic samples at all.
Each model family covers a specific position in an AI application:
Wolf Defender inspects text as it enters the system — user prompts, but also tool outputs, since fetched webpages are the common carrier for indirect injection. The threat-classifier variant additionally identifies the attack type: instruction override, secrets access, tool abuse, exfiltration attempt, and three more.
The Husky models inspect agent tool calls. Husky Sight identifies the target (14 classes from
filetosecretstoinfra), Husky Paw the operation (read,write,list,exec,network), and Husky Nose the data-flow properties as independent labels:source:sensitive,source:untrusted,sink:external. The combination of a sensitive source and an external sink on a single call is a precise, deterministic gate condition for a policy layer.Panther Read classifies request intent so that only traffic requiring deep checks receives them. Conversation takes the fast path; tool operations are routed into the security stack.
Orca Sonar classifies documents before they reach a context window or leave the device.
Lion Warden consolidates all seven tasks into one model with a shared encoder and seven heads, trained with masked losses on partially labeled data. It runs one forward pass where the dedicated models would need up to seven.
Quantized Edge Builds
Every model is published in two forms: the full FP32 weights for fine-tuning and benchmarking, and a quantized build in a separate -edge repository — ONNX with INT8 weights and 4-bit embeddings, starting at 96 MB.
Each edge repository contains a measured parity benchmark against FP32 (metrics/quant_bench.json). Across the family, the largest quantization cost we measured is approximately 0.01 macro-F1. Inference runs in the double-digit millisecond range per text on a laptop CPU; no GPU is required.
Performance
All reported numbers come from held-out test sets built exclusively from real-world data. Synthetic samples are used during training for robustness, but never for evaluation.
For the unified Lion Warden model, per-head results on the same test sets: injection 0.962, documents 0.980, tool type 0.957, tool operation 0.945, tool tags 0.958, routing 0.916, threat 0.952. The dedicated single-task models score marginally higher on most tasks; both variants are published, so the trade-off between accuracy and inference cost can be evaluated directly.
Per-class metrics for every model are listed in the respective model cards.
How to Use It
Every model card includes usage snippets for transformers and ONNX Runtime, label tables with examples, and per-class metrics. The six collections on the organization page mirror the table above.
Limitations
These are classifiers, and classifiers produce false positives — thresholds should be tuned to the deployment's traffic. Only English and German are actively evaluated; other languages pass through the multilingual backbone without validation. All classification is per-text: detecting an exfiltration split across multiple innocuous steps requires session-level tracking on top. Finally, the benchmarks are our own. Independent evaluation is welcome, and publishing the weights is meant to enable exactly that.
What's Next
A dedicated PII model will complete the family shortly. Beyond that, we're working on the engine that runs these models as a single layered scanning pipeline, more on this soon.
The models are live at huggingface.co/patronus-studio. If you evaluate them and find weaknesses, we want to hear about it.
