Tag

Practical measures for enterprises to secure AI and LLM technology adoption, reducing security risks with pragmatic advice.

Bugcrowd introduces AI Penetration Testing to uncover vulnerabilities in AI systems, including LLM applications, using vetted pentesters.

Burp extension to fuzz GenAI/LLM prompts for behavioral and prompt injection vulnerabilities, aiding security assessments.

NIST's AI Risk Management Framework (AI RMF) is a voluntary framework for managing risks associated with artificial intelligence.

AI Red Teaming Playground Labs: Challenges for AI red teaming training, covering adversarial ML and Responsible AI failures.

Aikido is a security platform for code and cloud, designed to automatically find and fix vulnerabilities in one central system.

AI-native SAST tool for code security, detecting vulnerabilities, secrets, IaC issues, and AI model security with actionable AI fixes.

Gandalf is a prompting skills test by Lakera that challenges users to extract secret information from a large language model.

Huntr is the first bug bounty platform focused on AI and ML security, rewarding researchers for finding vulnerabilities in open-source and model-related software.

Julius is an open-source LLM service fingerprinting tool that identifies Ollama, vLLM, LiteLLM, and 30+ other AI services running on network endpoints.

Lakera provides an AI-native security platform to accelerate GenAI initiatives, trusted by Fortune 500s and backed by AI red teams.