A framework that finds and masks personal data in text, images and tables. It detects the data, then redacts or replaces it so it can be safely sent to a model.
All repositories
Securityethz-spylab
agentdojo
A dynamic environment for evaluating attacks and defenses against LLM agents. It runs an agent on user tasks and checks whether a malicious instruction gets through.
Who it is for
For researchers and engineers comparing agent defenses against prompt injection.
How to start
- Install:
pip install agentdojo - Run a single test:
python -m agentdojo.scripts.benchmark -s workspace -ut user_task_0 - For the full benchmark, pass a model with
--modelas shown in the README
Steps are taken from the README. Check the current version in the repository before running them.
Stars over the last 30 days
+91Sep 6 — Oct 4
Author's description
A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
More in «Security»
A vulnerability scanner for LLMs: it runs a model through a set of probes for prompt injection, data leakage, toxicity and other failures. Works as a command-line tool.
A Python framework that checks LLM inputs and outputs with ready validators from Guardrails Hub and helps produce structured answers. It catches risks before a reply reaches the user.
NVIDIA's toolkit for programmable rails in LLM-based conversational systems. Rules live in config and control what the bot talks about and does.
Microsoft's framework for proactively finding risks in generative AI systems. It helps automate red teaming against models and applications.
Meta's generative AI safety project: the Llama Guard and Prompt Guard filter models, the Code Shield scanner and the CyberSec Eval test suites. It pairs defense with attack-based testing.