Skip to content
@protectai

Protect AI

Securing ML

Protect AI OSS

Protect AI's OSS portfolio includes tools aimed at improving security of AI/ML software. These tools are meant for a wide range of engineering, security and ML practitioners including:

  • Developers
  • Security Engineers/Researchers
  • ML Engineers
  • LLM Engineers & Prompt Engineers
  • Data Scientists

Project Description
ModelScan 🔍 ML Model Security Scanner
AI Exploits 🗡️ Collection of AI/ML Exploits
LLM Guard 🛡️ Security Toolkit for LLM Interactions
rebuff 💉 LLM Prompt Injection Attack Detection
NB Defense 📓 Jupyter Notebooks Security
Vulnhuntr 🏹 Autonomous AI-Discovered 0Day Tool

Pinned Loading

  1. modelscan Public

    Protection against Model Serialization Attacks

    Python 413 85

  2. nbdefense Public

    Secure Jupyter Notebooks and Experimentation Environment

    Python 69 16

  3. llm-guard Public

    The Security Toolkit for LLM Interactions

    Python 1.5k 188

  4. rebuff Public

    LLM Prompt Injection Detector

    TypeScript 1.2k 93

  5. ai-exploits Public

    A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities

    Python 1.5k 122

Repositories

Showing 10 of 13 repositories
  • modelscan Public

    Protection against Model Serialization Attacks

    Python 413 Apache-2.0 85 18 (1 issue needs help) 7 Updated Mar 3, 2025
  • llm-guard Public

    The Security Toolkit for LLM Interactions

    Python 1,470 MIT 188 25 2 Updated Mar 3, 2025
  • nbdefense Public

    Secure Jupyter Notebooks and Experimentation Environment

    Python 69 Apache-2.0 16 1 2 Updated Feb 6, 2025
  • vulnhuntr Public

    Zero shot vulnerability discovery using LLMs

    Python 1,533 AGPL-3.0 164 7 4 Updated Feb 6, 2025
  • chart-testing Public Forked from helm/chart-testing

    CLI tool for linting and testing Helm charts

    Go 0 Apache-2.0 227 0 0 Updated Dec 11, 2024
  • .github Public
    1 0 0 0 Updated Oct 24, 2024
  • ai-exploits Public

    A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities

    Python 1,530 122 1 2 Updated Oct 23, 2024
  • TypeScript 11 Apache-2.0 6 2 6 Updated Oct 1, 2024
  • grepdiff Public Forked from rsc/grepdiff

    grep for diffs

    Go 1 BSD-3-Clause 4 0 1 Updated Aug 7, 2024
  • rebuff Public

    LLM Prompt Injection Detector

    TypeScript 1,197 Apache-2.0 93 26 (9 issues need help) 6 Updated Aug 7, 2024