OWASP unveils the Gen AI Red Teaming Guide, offering a structured approach to evaluating LLM and Generative AI vulnerabilities.
OWASP Gen AI Security Project provides resources, risk strategies, and global collaboration to secure LLMs, AI agents, and generative AI technologies.
OWASP Machine Learning Security Top 10 (2023) identifies the top 10 security risks for machine learning systems, focusing on developers and security experts.
OWASP Top 10 for LLM Applications 2025 highlights key security risks in AI applications, focusing on vulnerabilities and countermeasures.
OWASP Top 10 for Large Language Model Applications educates on security risks in deploying and managing LLMs and Generative AI applications.
Pillar Security: AI security platform to identify, assess, and mitigate security risks across the entire AI lifecycle.
Prompt Airlines AI CTF by Wiz challenges users to manipulate an AI chatbot for a free ticket, focusing on AI security vulnerabilities.
Payloads and techniques for exploiting prompt injection vulnerabilities in AI/NLP models like ChatGPT, including direct and indirect methods.
PromptBench: A unified library for evaluating and understanding large language models, enabling quick model assessment and robustness testing.
Open-source LLM security platform for red-teaming, guardrails, model security, and evaluations, trusted by 150,000+ developers.
PyRIT is an open-source Python framework empowering security pros to proactively identify risks in generative AI systems.
Garak is an LLM vulnerability scanner that probes for weaknesses like prompt injection, data leakage, hallucination, and toxicity.
