UTCP
Secure, direct tool-calling to any native endpoint for your AI agent
Secure, direct tool-calling to any native endpoint for your AI agent
Awesome LLM Security
A curation of awesome tools, documents and projects about LLM Security.
This page lists names, links and short descriptions. The original list on GitHub is the source and belongs to its authors.
Tools
Plexiglass
a security toolbox for testing and safeguarding LLMs
In 2 lists
PurpleLlama
set of tools to assess and improve LLM security.
Garak
a LLM vulnerability scanner
In 3 lists
LLMFuzzer
a fuzzing framework for LLMs
In 3 lists
LLM Guard
a security toolkit for LLM Interactions
In 2 lists
Vigil
a LLM prompt injection detection toolkit
In 2 lists
jailbreak-evaluation
an easy-to-use Python package for language model jailbreak evaluation
Prompt Fuzzer
the open-source tool to help you harden your GenAI applications
In 2 lists
WhistleBlower
open-source tool designed to infer the system prompt of an AI agent based on its generated text outputs.
In 2 lists
Open-Prompt-Injection
open-source tool to evaluate prompt injection attacks and defenses on benchmark datasets.
In 2 lists
Agentic Radar
Open-source CLI security scanner for agentic workflows.
In 6 listsDetails
Articles
Prompt Injection Cheat Sheet: How To Manipulate AI Language Models
A prompt injection cheat sheet for AI bot integrations.
In 2 lists
Indirect Prompt Injection Threats
Interactive playground for testing prompt injections.
In 3 lists
Prompt injection: What’s the worst that can happen?
General overview of Prompt Injection attacks, part of a series.
In 3 lists
OWASP Top 10 for Large Language Model Applications
Top 10 security risks for LLM applications.
In 2 lists
ChatGPT Plugins: Data Exfiltration via Images & Cross Plugin Request Forgery
This post shows how a malicious website can take control of a ChatGPT chat session and exfiltrate the history of the conversation.
In 2 lists
In 2 lists
Other Awesome Projects
Gandalf
a prompt injection wargame
In 3 lists
Adversarial Prompting
A guide on the various types of adversarial prompting and ways to mitigate them.
In 3 lists
Epivolis
a prompt injection aware chatbot designed to mitigate adversarial efforts
LLM Security Problems at DEFCON31 Quals
the world's top security competition
Related lists in Security
See category94
Awesome-Selfhosted
awesome-selfhosted/awesome-selfhosted
A list of Free Software network services and web applications which can be hosted on your own servers
91
Awesome Hacker Search Engines
edoardottt/awesome-hacker-search-engines
A curated list of awesome search engines useful during Penetration testing, Vulnerability assessments, Red/Blue Team operations, Bug Bounty and more
91
Awesome Privacy
lissy93/awesome-privacy
🦄 A curated list of privacy & security-focused software and services
89
Awesome Bug Bounty Tools
vavkamil/awesome-bugbounty-tools
A curated list of various bug bounty tools
88
android-security-awesome
ashishb/android-security-awesome
A collection of android security related resources
87
Awesome Web Security
qazbnm456/awesome-web-security
🐶 A curated list of Web Security materials and resources.