All repositories

SecurityNVIDIA

garak

A vulnerability scanner for LLMs: it runs a model through a set of probes for prompt injection, data leakage, toxicity and other failures. Works as a command-line tool.

Who it is for

For people who want to test their model or chatbot against common attacks before launch.

How to start

  1. Install: python -m pip install -U garak
  2. List the probes: garak --list_probes
  3. Run a scan: python3 -m garak --target_type openai --target_name gpt-5-nano --spec probes.encoding (needs OPENAI_API_KEY)

Steps are taken from the README. Check the current version in the repository before running them.

Stars over the last 30 days

+325Sep 6 — Oct 5
9,1059,430

Author's description

the LLM vulnerability scanner

data-privacy-stack

presidio

A framework that finds and masks personal data in text, images and tables. It detects the data, then redacts or replaces it so it can be safely sent to a model.

11Kstars+430 in 30 dPython

guardrails-ai

guardrails

A Python framework that checks LLM inputs and outputs with ready validators from Guardrails Hub and helps produce structured answers. It catches risks before a reply reaches the user.

7.5Kstars+137 in 30 dPython

NVIDIA-NeMo

Guardrails

NVIDIA's toolkit for programmable rails in LLM-based conversational systems. Rules live in config and control what the bot talks about and does.

7.2Kstars+183 in 30 dPython

microsoft

PyRIT

Microsoft's framework for proactively finding risks in generative AI systems. It helps automate red teaming against models and applications.

4.6Kstars+174 in 30 dPython

meta-llama

PurpleLlama

Meta's generative AI safety project: the Llama Guard and Prompt Guard filter models, the Code Shield scanner and the CyberSec Eval test suites. It pairs defense with attack-based testing.

4.4Kstars+45 in 30 dPython

A security scanner for AI agents, MCP servers and skills. It checks configs and SKILL.md files for risky spots.

3.1Kstars+112 in 30 dPython