README
AI Red Teaming a.k.a. Awesome-LLM-Red-Teaming
Back to TOC
All things specific to Generative AI LLM Red Teaming
My Blog "What the heck is AI Red Teaming" https://bit.ly/ai-red-teaming
As of 11.30.23, I am working hard to build the repos - takes time to review and curate. Appreciate your patience ... Thanks ... As of 2.1.24, Started transcribing and curating the links from my Omnioutline to this GitHub page ...
Best Practices
| Year | Title | Notes |
|---|---|---|
| My Blog "What the heck is AI Red Teaming" | A quick general blog | |
| What’s the Difference Between Traditional Red-Teaming and AI Red-Teaming? | There is a slight cognitice dissonance between traditional Red Teaming and AI Red Teaming | |
| 2023.07 | Google's AI Red Team: the ethical hackers making AI safer | Good Conceptual Diagrams |
| 2023.10 | Best Practices for Securing LLM-Enabled Applications | Nvidia |
| 2023.06 | NVIDIA AI Red Team: An Introduction | |
| Use Cases | ||
| Adversarial Intelligence: Red Teaming Malicious Use Cases for AI | ||
| Sensational Press | ||
| 2023.08 | Hackers red-teaming A.I. are ‘breaking stuff left and right,’ but don’t expect quick fixes from DefCon: ‘There are no good guardrails |
NIST
All NIST documents, ideas, responses et al
Most probably will split into a Awesome-NIST repository. I have - see Awesome-NIST
Survey & Analytical Papers
Metrics
LLM benchmarks (See LLM Evaluation Topics for a quick intro)
I will start polulating this section
Benchmarks
LLM benchmarks (See LLM Evaluation Topics for a quick intro)
I will start polulating this section
Datasets
LLM benchmarks (See LLM Evaluation Topics for a quick intro)
I will start polulating this section
Other Repos
LLM benchmarks (See LLM Evaluation Other Repos
I will start polulating this section
| Title | Notes |
|---|---|
| Awesome Security | |
| Awesome Controls | Links to various security fraeworks. Last update 4 years ago, still useful |
| Awesome Infosec | A curated list of awesome information security resources |
Similar repos
README
AI Red Teaming a.k.a. Awesome-LLM-Red-Teaming
Back to TOC
All things specific to Generative AI LLM Red Teaming
My Blog "What the heck is AI Red Teaming" https://bit.ly/ai-red-teaming
As of 11.30.23, I am working hard to build the repos - takes time to review and curate. Appreciate your patience ... Thanks ... As of 2.1.24, Started transcribing and curating the links from my Omnioutline to this GitHub page ...
Best Practices
| Year | Title | Notes |
|---|---|---|
| My Blog "What the heck is AI Red Teaming" | A quick general blog | |
| What’s the Difference Between Traditional Red-Teaming and AI Red-Teaming? | There is a slight cognitice dissonance between traditional Red Teaming and AI Red Teaming | |
| 2023.07 | Google's AI Red Team: the ethical hackers making AI safer | Good Conceptual Diagrams |
| 2023.10 | Best Practices for Securing LLM-Enabled Applications | Nvidia |
| 2023.06 | NVIDIA AI Red Team: An Introduction | |
| Use Cases | ||
| Adversarial Intelligence: Red Teaming Malicious Use Cases for AI | ||
| Sensational Press | ||
| 2023.08 | Hackers red-teaming A.I. are ‘breaking stuff left and right,’ but don’t expect quick fixes from DefCon: ‘There are no good guardrails |
NIST
All NIST documents, ideas, responses et al
Most probably will split into a Awesome-NIST repository. I have - see Awesome-NIST
Survey & Analytical Papers
Metrics
LLM benchmarks (See LLM Evaluation Topics for a quick intro)
I will start polulating this section
Benchmarks
LLM benchmarks (See LLM Evaluation Topics for a quick intro)
I will start polulating this section
Datasets
LLM benchmarks (See LLM Evaluation Topics for a quick intro)
I will start polulating this section
Other Repos
LLM benchmarks (See LLM Evaluation Other Repos
I will start polulating this section
| Title | Notes |
|---|---|
| Awesome Security | |
| Awesome Controls | Links to various security fraeworks. Last update 4 years ago, still useful |
| Awesome Infosec | A curated list of awesome information security resources |