Shadowgraph
TrendingAbout
Sign in

EvanThomasLuke/Awesome-AI-Security-Benchmarks

List of AI Security benchmarks

35

15 commits

updated Aug 15, 2026

See the code

README

Awesome-AI-Security-Benchmarks

List of AI Security benchmarks (with some datasets, working on a seperate repo for datasets).

THIS IS A WORK IN PROGRESS. I need to fix some of the categorizations and add more. There may be some errors and hallucinations just fyi.

Come chat about AI Security benchmarks in the AI Hacking Discord https://discord.com/channels/1422426099391922258/1422426100067471462/1469143844216897588

Total unique benchmarks: ~175 (165 core cybersecurity + 10 AI security adjacent)

Complete Unified Table

BenchmarkYearTypeLinksDefinition
KNOWLEDGE & Q&A
SecEval2023DatasetGitHub | HuggingFace | Website2000+ multiple-choice questions across 9 security domains, GPT-4 generated from textbooks and standards
SecQA2023DatasetarXiv:2312.15838 | HuggingFaceMultiple-choice questions from "Computer Systems Security" textbook with two complexity tiers
CyberMetric2024DatasetarXiv:2402.07688 | GitHubRAG-generated MCQ datasets (80/500/2000/10000 variants) from NIST standards, research papers, and cybersecurity books
SECURE2024DatasetarXiv:2405.20441 | GitHub6 datasets (MAET, CWET, KCV, VOOD, RERT, CPST) for ICS cybersecurity evaluation
SEvenLLM-Bench2024DatasetarXiv:2405.03446 | GitHub1,300-sample bilingual benchmark for CTI analytical capabilities with 28 tasks
CS-Eval2024DatasetarXiv:2411.16239 | GitHubComprehensive LLM benchmark for cybersecurity knowledge evaluation
SecBench2024DatasetarXiv:2412.20787 | HuggingFaceMulti-dimensional, multi-language benchmarking dataset for LLMs in cybersecurity
CSEBenchmark2025DatasetarXiv:2504.11783 | GitHubFine-grained cyber-security evaluation based on 345 knowledge points (IEEE S&P 2025)
AttackQA2024DatasetarXiv:2408.16847Dataset for assisting cybersecurity operations using LLMs
CyberBench2024DatasetGitHubMulti-task benchmark over multiple cybersecurity NLP task datasets (JPMorganChase)
CySecBench2025DatasetarXiv:2501.01335Generative AI-based cybersecurity-focused prompt dataset (12,662 prompts)
AthenaBench2025DatasetarXiv:2511.01144CTI-focused dynamic evaluation tasks for LLMs
OCCULT2025FrameworkarXiv:2502.15797Offensive tactic knowledge evaluation framework
MMLU Computer Security2021DatasetHuggingFaceStandard MMLU benchmark's dedicated computer security subset
MMLU Security Studies2021DatasetHuggingFaceStandard MMLU benchmark's security studies subset
CTF & OFFENSIVE SECURITY
InterCode-CTF2023EnvironmentarXiv:2306.14898 | GitHub | Website100 CTF tasks from PicoCTF with containerized bash execution environment
NYU CTF Bench2024EnvironmentarXiv:2406.05590 | GitHub | Website200 challenges from CSAW CTF spanning crypto, forensics, web, reverse engineering, pwn
Cybench2024EnvironmentarXiv:2408.08926 | GitHub | Website40 professional CTF tasks from HackTheBox, SekaiCTF, Glacier, HKCert
3CB2024EnvironmentarXiv:2410.09114 | WebsiteAdvanced CTF challenges designed to be harder than Cybench
BountyBench2025EnvironmentWebsite | GitHubReal-world vulnerability detection, exploitation, and patching with dollar impact
RCTF22025EnvironmentarXiv:2510.24317Robotics/cyber-physical sub-benchmark inside CAIBench (27 challenges)
CTFKnow2025DatasetarXiv:2501.09564CTF technical knowledge benchmark built from CTF writeups
CTF-Dojo2025EnvironmentarXiv:2501.17535Large-scale executable runtime of containerized CTF challenges
AIRTBench2025EnvironmentarXiv:2506.14682Autonomous AI red-teaming benchmark; 70 black-box CTFs
Crowdsourced CTF Elicitation2025FrameworkarXiv:2505.19915Evaluating AI cyber capabilities with crowdsourced elicitation (CTF-based)
PENETRATION TESTING
PentestGPT Benchmark2023HarnessarXiv:2308.06782 | GitHub182 sub-tasks from HackTheBox and VulnHub for penetration testing
AutoPenBench2024EnvironmentarXiv:2410.03225 | GitHubBenchmarking generative agents for pentesting with defined milestones
PentestEval2025HarnessarXiv:2512.14233Stage-specific evaluation across entire pentesting lifecycle
Vulhub Benchmark2024EnvironmentGitHubDocker-based vulnerable environments for automated pentesting
CHECKMATE2025FrameworkarXiv:2503.12735Planning + LLM agents for automated penetration testing
PenHeal2023FrameworkarXiv:2312.03015AI cybersecurity capabilities evaluation for pentesting and healing
AutoAttacker2024FrameworkarXiv:2403.01038Automated cyber-attack generation and evaluation benchmark
AI-Pentest-Benchmark2024EnvironmentarXiv:2410.17141 | GitHub13 VulnHub VMs with 152 subtasks ("Towards Automated Penetration Testing")
TermiBench2025EnvironmentarXiv:2509.09207Real-world pentesting benchmark; 510 hosts/30 CVEs; shell-focused
CTFTiny2025DatasetarXiv:2508.05674Curated 50 representative CTF challenges for rapid evaluation of offensive-security agents
CVE-Bench2025EnvironmentarXiv:2503.17332 | GitHubReal-world webapp vulnerability exploitation based on critical CVEs
XBOW Validation2025EnvironmentWebsite104 web security challenges for autonomous offensive tools
CyberGym2025EnvironmentarXiv:2506.02548 | HuggingFace1,507 instances from 188 OSS projects with ASan/UBSan validation
Cyberattack Capabilities Framework2025FrameworkarXiv:2503.11917 | DeepMind BlogEnd-to-end attack chain evaluation with representative archetypes
VULNERABILITY DETECTION
VulDetectBench2024DatasetarXiv:2406.07595 | GitHubVulnerability detection benchmark with 5 tasks (identify/classify/localize, etc.)
CyberSecEval v12023HarnessarXiv:2312.04724 | GitHubEvaluates LLMs for insecure code generation propensity (Purple Llama)
CyberSecEval v22024HarnessarXiv:2404.13161 | GitHubExtended benchmark with vulnerability exploitation and prompt injection tests
CyberSecEval v32024HarnessarXiv:2408.01605 | GitHubFurther advances in evaluating LLM cybersecurity risks
CyberSecEval v42025Meta-benchmarkGitHub | WebsiteMeta's latest suite; includes AutoPatchBench and CyberSOCEval
AutoPatchBench2025DatasetBlogBenchmark for automated repair of fuzzing-discovered vulnerabilities (part of CyberSecEval 4)
CyberSOCEval2025DatasetarXiv:2509.20166 | MetaSOC-focused benchmarks for malware analysis + threat-intelligence reasoning (part of CyberSecEval 4)
SecLLMHolmes2024FrameworkarXiv:2405.19803 | GitHubFully automated framework for evaluating LLM vulnerability detection
SecVulEval2025DatasetarXiv:2505.19828C/C++ vulnerability detection with statement-level granularity
VulnLLMEval2024FrameworkarXiv:2401.16185Framework for evaluating LLMs in vulnerability detection and patching
LLMSecCode2024HarnessarXiv:2408.17894Benchmark for evaluating secure code practices in LLMs
eyeballvul2024DatasetarXiv:2407.08708 | GitHubFuture-proof benchmark for vulnerability detection in the wild
VADER2025FrameworkarXiv:2505.19395 | GitHubHuman-evaluated framework for Vulnerability Assessment, Detection, Explanation
SVEN2023FrameworkarXiv:2302.05319 | GitHubSecurity hardening & adversarial testing for code LLMs (controlled code generation)
PrimeVul2024DatasetarXiv:2403.18624 | GitHubFiltered C/C++ function-level vulnerability detection dataset (ICSE 2025)
ARVO2024DatasetarXiv:2411.09278Project-level C/C++ vulnerability detection benchmark
Juliet Test Suite 1.32017DatasetNISTNIST's comprehensive test cases for C/C++ and Java vulnerability detection
SV-TrustEval-C2025DatasetarXiv:2505.20630Structure and semantic reasoning benchmark for C vulnerability analysis
VulGate2025DatasetarXiv:2508.16625Dataset with dedicated test sets for vulnerability detection generalization
Multi-Vuln Detection2025DatasetarXiv:2512.22306Long-context multi-label vulnerability benchmark across languages
Multi-Lang SVD2025DatasetarXiv:2503.01449Multi-language software vulnerability detection benchmark study
SECURE CODE GENERATION
CodeSecEval2024HarnessarXiv:2407.02395Evaluating LLMs on secure code generation with CWE-based evaluation
CodeLMSec2024HarnessarXiv:2302.04012Systematically evaluating security vulnerabilities in black-box code LMs
SecurityEval2022DatasetarXiv:2210.09263 | GitHubMining vulnerability examples to evaluate ML-based code generation
SecCodePLT2024HarnessarXiv:2410.11096 | GitHubUnified platform for evaluating code GenAI security with 27 CWEs
CWEval2025HarnessarXiv:2501.08200 | GitHubOutcome-driven evaluation for functionality and security of LLM code
SafeGenBench2025DatasetarXiv:2506.05692558 security-sensitive test questions covering vulnerability taxonomy (ByteDance)
SecRepoBench2025DatasetarXiv:2504.21205Repository-level secure coding with 318 tasks across 27 repos
SecureAgentBench2025EnvironmentarXiv:2509.22097105 tasks for evaluating code agents on secure code generation
A.S.E2025DatasetarXiv:2508.18106 | GitHubRepository-level benchmark using real CVEs (Tencent)
SEC-bench2025EnvironmentarXiv:2506.11791Automated benchmarking of LLM agents on real-world security tasks
CASTLE2025DatasetarXiv:2503.09433 | GitHubBenchmarking dataset for static code analysis with ground-truth annotations
MT-Sec2025DatasetarXiv:2503.09700Benchmarking correctness and security in multi-turn code generation
DUALGUAGE2025HarnessarXiv:2511.20709Automated joint security-functionality benchmarking
BaxBench2025EnvironmentarXiv:2502.11844 | GitHub392 backend tasks validating functionality and exploits
SecCodeBench2025HarnessGitHubAlibaba's 37 test cases / 16 CWEs with dynamic PoC exploits
AutoPatchBench2025ComponentGitHubAutomated vulnerability patching (component of CyberSecEval v4)
PatchEval2025HarnessarXiv:2511.11019Multilingual benchmark for patching real-world vulnerabilities; 1,000 CVEs
PACEbench2025FrameworkarXiv:2510.11688Framework for practical AI cyber-exploitation capabilities
VulnRepairEval2025FrameworkarXiv:2509.03331Exploit-based evaluation for LLM vulnerability repair
THREAT INTELLIGENCE & CTI
CTIBench2024DatasetarXiv:2406.07599 | HuggingFaceEvaluating LLMs on CTI tasks: attack patterns, threat actors, APT campaigns
CTI-MCQ2024DatasetarXiv:2406.07599Multiple-choice questions on attack patterns, APT campaigns, detection
CTI-RCM2024DatasetarXiv:2406.07599Root cause mapping correlating CVE records with CWE entities
SecKnowledge-Eval2025DatasetarXiv:2510.14113Evaluation datasets for complex cybersecurity tasks
ExCyTIn-Bench2025EnvironmentarXiv:2507.14201Microsoft's cyber threat investigation agent benchmark
MALWARE & SOC
ACSE-Eval2025DatasetarXiv:2505.11565AWS Cloud Security Engineering Eval for cloud threat modeling
LogEval2024DatasetarXiv:2407.01896Benchmark suite for LLM log analysis tasks (parsing, anomaly detection, diagnosis, summarization)
CyberSOCEval2025ComponentGitHubMalware analysis and threat intel reasoning (component of CyberSecEval v4)
Sophos SOC Benchmark2024HarnessSophos BlogThree SOC tasks: incident investigation, summarization, severity evaluation
LogLLM2024HarnessarXiv:2411.08561Log-based anomaly detection using large language models
LogLM2024DatasetarXiv:2410.09352Task-based to instruction-based automated log analysis benchmark
DefenderBench2025HarnessarXiv:2506.00739 | GitHubMicrosoft toolkit spanning offense/defense/understanding
PHISHING DETECTION
PhishAgent Benchmark2024HarnessarXiv:2408.02291Multimodal agent evaluation for phishing webpage detection
MLLM Phishing Benchmark2025DatasetarXiv:2503.01040Comprehensive security benchmark for multimodal LLMs
Open-Source LLM Phishing2025HarnessarXiv:2503.0152021 LLMs evaluated with 4 prompt engineering techniques
SME Phishing Detection2025DatasetarXiv:2503.08766LLM evaluation for small/medium enterprise phishing
PhishEmailLLM Dataset2025DatasetarXiv:2503.09270Meta-model approach for phishing email detection
APOLLO2024HarnessarXiv:2402.16862GPT-based tool benchmark for phishing email detection
PROMPT INJECTION
AgentDojo2024EnvironmentarXiv:2406.13352 | GitHubDynamic environment for prompt injection attacks & defenses
INJECAGENT2024DatasetarXiv:2403.02691 | GitHubBenchmarking indirect prompt injections in tool-using agents
BIPIA2023DatasetarXiv:2312.14197 | GitHubFirst benchmark for indirect prompt injection attacks
GenTel-Safe / GenTel-Bench2024FrameworkarXiv:2404.06531Unified benchmark and shielding framework for prompt injection
NotInject2024DatasetarXiv:2410.22770 | GitHubOver-defense/false-positive benchmark for prompt injection detectors (from InjecGuard)
PINT Benchmark2024HarnessGitHubLakera's benchmark for prompt injection detection systems
Tensor Trust2023DatasetarXiv:2311.01011 | GitHub | Website126K+ human-generated prompt injection attacks
Open-Prompt-Injection2024HarnessarXiv:2402.12138Standardized framework for prompt injection vulnerability evaluation
safe-guard-prompt-injection2024DatasetarXiv:2402.13064 | HuggingFace10,296 prompt injection examples for guardrail evaluation
WASP2025EnvironmentarXiv:2504.18575 | GitHubWeb Agent Security against Prompt injection attacks (Meta)
WAInjectBench2025HarnessarXiv:2510.01354Benchmarking prompt injection detections for web agents
RAS-Eval2025HarnessarXiv:2506.15253Security eval benchmark for LLM agents with tool execution
JAILBREAK & RED TEAMING
JailbreakBench2024HarnessarXiv:2404.01318 | GitHub | Website200 behaviors for standardized jailbreak evaluation
HarmBench2024HarnessarXiv:2402.04249 | GitHubStandardized evaluation framework for automated red teaming
SafetyBench2024HarnessGitHubCAIS benchmark suite for comprehensive safety testing
ToxiGen2022DatasetarXiv:2203.09509 | GitHubMicrosoft dataset for toxic/harmful content detection
StrongREJECT2024DatasetarXiv:2402.10260 | GitHub313 forbidden questions across 6 categories
WildJailbreak2024DatasetarXiv:2406.18510 | GitHub261,534 conversations for training LLMs to be safe
SORRY-Bench2024HarnessarXiv:2406.14598 | GitHubSystematically evaluating LLM safety refusal behaviors
ALERT2024HarnessarXiv:2404.08676Comprehensive benchmark for LLM safety through red teaming
GPTFuzzer2023HarnessarXiv:2309.10253 | GitHubAuto-generated jailbreak prompts for red teaming LLMs
SG-Bench2024HarnessarXiv:2410.21965Evaluating LLM safety generalization across diverse tasks
LatentJailbreak2023DatasetarXiv:2307.08487Benchmark for evaluating text safety and output robustness
AdvBench2023DatasetarXiv:2307.15043Adversarial behaviors dataset (foundation for many jailbreak benchmarks)
S-Eval2024HarnessarXiv:2405.14191Automatic and adaptive test generation for LLM safety
SAFE2024DatasetarXiv:2404.18539Fine-grained safety dataset for LLMs beyond binary classification
DoNotAnswer2023DatasetarXiv:2308.13387 | GitHubEvaluating safeguards in LLMs with comprehensive refusal scenarios
AILuminate Jailbreak v0.52025HarnessMLCommonsMLCommons jailbreak benchmark (industry standard)
SecReEvalBench2025DatasetarXiv:2505.07584Multi-turn security resilience evaluation benchmark
HELM Safety2024ComponentStanford HELMSafety evaluation component of Stanford's HELM
Agent Security Bench (ASB)2024HarnessarXiv:2410.02644 | GitHubFormalizing attacks and defenses in LLM-based agents (ICLR 2025)
AgentHarm2024DatasetarXiv:2410.09024 | HuggingFaceUK AISI's 110 harmful agent tasks
b3 (Backbone Breaker Benchmark)2025DatasetarXiv:2510.22620 | BlogSecurity evaluation for backbone LLMs used inside AI agents (agent-focused adversarial attacks)
META-BENCHMARKS & FRAMEWORKS
CAIBench2025Meta-benchmarkarXiv:2510.24317Meta-benchmark integrating Base, Cybench, AutoPenBench, CTIBench
CyberPII-Bench2025DatasetarXiv:2510.24317PII anonymization evaluation in cybersecurity contexts
Cyber-Zero2025FrameworkarXiv:2508.00910 | GitHubTraining framework with benchmark suites for EnIGMA+
EnIGMA2024EnvironmentarXiv:2409.16165 | GitHubEnhanced interactive generative model agent for CTF
NETWORK & IDS DATASETS
NSL-KDD2009DatasetUNBClassic network intrusion detection dataset
CIC-IDS 20172017DatasetUNBIntrusion detection evaluation dataset
CSE-CIC-IDS 20182018DatasetUNBIDS/IPS dataset on AWS infrastructure
CIC-DDoS 20192019DatasetUNBDDoS attack evaluation dataset
CIRA-CIC-DoHBrw 20202020DatasetUNBDNS over HTTPS dataset
CIC-Bell DNS 20212021DatasetUNBDNS security dataset
CIC IoT Attack Dataset2023DatasetUNBIoT attack patterns dataset
CICIoV20242024DatasetUNBInternet of Vehicles security dataset
CICIoMT20242024DatasetUNBMedical IoT security dataset
IoT-DIAD2024DatasetUNBIoT intrusion detection and anomaly dataset
APT IIoT (CICADA)2024DatasetUNBIndustrial IoT APT attack dataset
Datasense IIoT2025DatasetUNBIndustrial IoT sensor data security dataset
BCCC-CIC-IDS20172017DatasetUNB BCCCLarge-scale intrusion detection dataset
BCCC-CSE-CIC-IDS20182018DatasetUNB BCCCExtended large-scale IDS dataset
BCCC-VulSCs-20232023DatasetUNB BCCCVulnerable smart contracts dataset
BCCC-SCsVuls-20242024DatasetUNB BCCCSmart contract vulnerabilities dataset
BCCC-cPacket-Cloud-DDoS-20242024DatasetUNB BCCCCloud DDoS attacks dataset
BCCC-IoT-IDS-Zwave-20252025DatasetUNB BCCCLarge-scale IoT-Zwave intrusion detection dataset
BCCC-DeFiFraudTrans-20252025DatasetUNB BCCCDeFi fraud transactions dataset
BCCC-Mal-NetMem-20252025DatasetUNB BCCCMultisource malware analysis using network traffic and memory
UNSW-NB152015/2024DatasetUNSWNetwork intrusion detection dataset (updated 2024)
MITRE ATLAS2023Knowledge BaseMITREAttack success rates for AI models (knowledge base)
AI SECURITY ADJACENT: ADVERSARIAL ML & ROBUSTNESS
CIFAR-10 Adversarial2019DatasetIBM ARTIBM ART benchmark for attack success rates
ADDC2024Dataset⚠️ Unable to verify - Mahalle et al.Adversarial Diversity-Driven Dataset
DCA2024Harness⚠️ Unable to verify - Mahalle et al.Aggressive events simulation for benchmark datasets
REA2024Harness⚠️ Unable to verify - Mahalle et al.AI model threat handling evaluation
VMA2024Framework⚠️ Unable to verify - Mahalle et al.AI model vulnerability identification benchmark
RobustBench2021HarnessarXiv:2010.09670 | GitHub | WebsiteAdversarial robustness leaderboard for image classifiers
AdversarialNLI (ANLI)2020DatasetarXiv:1910.14599 | GitHubMeta's adversarial robustness in NLI
AI SECURITY ADJACENT: DEEPFAKE & MEDIA
Faceswap-GAN2018DatasetGitHubDeepfake detection methods evaluation
VidTIMIT2012DatasetConvAIVideo-based deepfake detection benchmark
FaceForensics++2019DatasetarXiv:1901.08971 | GitHubLarge-scale deepfake detection benchmark
MISCELLANEOUS
AI Cyber Risk Benchmark2024HarnessarXiv:2412.09878Evaluating automated exploitation capabilities
ITBench2025EnvironmentarXiv:2502.03969Evaluating AI agents across IT automation tasks
SandboxEval2025EnvironmentarXiv:2504.00018Test suite for LLM assessment environment safety
CyberLLMInstruct2025DatasetarXiv:2503.09144Dataset for analyzing safety of fine-tuned LLMs
DebugBench2024HarnessarXiv:2401.08420Evaluating debugging capability of LLMs
AttackER2024DatasetarXiv:2408.05866Named entity recognition dataset for cyber-attack attribution
Hackphyr2024EnvironmentarXiv:2409.11276Local fine-tuned LLM agent for network security
CyberPal.AI2024DatasetarXiv:2408.09304Expert-driven cybersecurity instructions benchmark
Truth Seeker Dataset2023DatasetUNBMisinformation detection in cybersecurity context
BinMetric2025HarnessarXiv:2505.07360Binary analysis metrics and evaluation benchmark
OS-Harm2025EnvironmentarXiv:2506.14866Safety of computer use agents with GUIs (150 tasks)
AgentThreatBenchUK AISI / inspect_evals2026BenchmarkOWASP Top 10 Agentic

Summary Statistics

By Category

CategoryCount
Knowledge & Q&A15
CTF & Offensive10
Penetration Testing13
Vulnerability Detection19
Secure Code Generation20
Threat Intelligence & CTI5
Malware & SOC7
Phishing Detection6
Prompt Injection12
Jailbreak & Red Teaming20
Meta-Benchmarks4
Network & IDS Datasets22
Miscellaneous12
Core Cybersecurity Benchmarks~165
AI Security Adjacent: Adversarial ML7
AI Security Adjacent: Deepfake & Media3
TOTAL (incl. adjacent)~175

todo

https://github.com/ethiack/ethibench

https://x.com/AISecHub/status/2077481328950292544

https://www.cotool.ai/research/aws-cloud-intrusion - multiple links from this one

Contributors

EvanThomasLuke

12 commits

yashpj

2 commits

vgudur-dev

1 commits

Similar repos

EvanThomasLuke/Awesome-AI-Hacking-Agents

List of AI Hacking Agents

684

same org

anshug/ai-security-evals

Curated AI security and safety evaluation benchmarks well-regarded by Frontier AI labs

2

Ashfaaq98/awesome-genai-cyberhub

A curated list of LLM driven Cyber security Resources

57

XuanwuAI/SecEval

Dataset

SecEval: A Comprehensive Benchmark for Evaluating Cybersecurity Knowledge of Foundation Models

26

simon-p-j-r/LLM4Pentest

363

XuanwuAI/SecEval

116

xashru/cti-bench

[NeurIPS'24, Spotlight] CTIBench: A Benchmark for Evaluating LLMs in Cyber Threat Intelligence

94

ch3cke/awesome-auto-penetration-testing

6

EvanThomasLuke/Awesome-AI-Security-Benchmarks

List of AI Security benchmarks

35

15 commits

updated Aug 15, 2026

See the code

README

Awesome-AI-Security-Benchmarks

List of AI Security benchmarks (with some datasets, working on a seperate repo for datasets).

THIS IS A WORK IN PROGRESS. I need to fix some of the categorizations and add more. There may be some errors and hallucinations just fyi.

Come chat about AI Security benchmarks in the AI Hacking Discord https://discord.com/channels/1422426099391922258/1422426100067471462/1469143844216897588

Total unique benchmarks: ~175 (165 core cybersecurity + 10 AI security adjacent)

Complete Unified Table

BenchmarkYearTypeLinksDefinition
KNOWLEDGE & Q&A
SecEval2023DatasetGitHub | HuggingFace | Website2000+ multiple-choice questions across 9 security domains, GPT-4 generated from textbooks and standards
SecQA2023DatasetarXiv:2312.15838 | HuggingFaceMultiple-choice questions from "Computer Systems Security" textbook with two complexity tiers
CyberMetric2024DatasetarXiv:2402.07688 | GitHubRAG-generated MCQ datasets (80/500/2000/10000 variants) from NIST standards, research papers, and cybersecurity books
SECURE2024DatasetarXiv:2405.20441 | GitHub6 datasets (MAET, CWET, KCV, VOOD, RERT, CPST) for ICS cybersecurity evaluation
SEvenLLM-Bench2024DatasetarXiv:2405.03446 | GitHub1,300-sample bilingual benchmark for CTI analytical capabilities with 28 tasks
CS-Eval2024DatasetarXiv:2411.16239 | GitHubComprehensive LLM benchmark for cybersecurity knowledge evaluation
SecBench2024DatasetarXiv:2412.20787 | HuggingFaceMulti-dimensional, multi-language benchmarking dataset for LLMs in cybersecurity
CSEBenchmark2025DatasetarXiv:2504.11783 | GitHubFine-grained cyber-security evaluation based on 345 knowledge points (IEEE S&P 2025)
AttackQA2024DatasetarXiv:2408.16847Dataset for assisting cybersecurity operations using LLMs
CyberBench2024DatasetGitHubMulti-task benchmark over multiple cybersecurity NLP task datasets (JPMorganChase)
CySecBench2025DatasetarXiv:2501.01335Generative AI-based cybersecurity-focused prompt dataset (12,662 prompts)
AthenaBench2025DatasetarXiv:2511.01144CTI-focused dynamic evaluation tasks for LLMs
OCCULT2025FrameworkarXiv:2502.15797Offensive tactic knowledge evaluation framework
MMLU Computer Security2021DatasetHuggingFaceStandard MMLU benchmark's dedicated computer security subset
MMLU Security Studies2021DatasetHuggingFaceStandard MMLU benchmark's security studies subset
CTF & OFFENSIVE SECURITY
InterCode-CTF2023EnvironmentarXiv:2306.14898 | GitHub | Website100 CTF tasks from PicoCTF with containerized bash execution environment
NYU CTF Bench2024EnvironmentarXiv:2406.05590 | GitHub | Website200 challenges from CSAW CTF spanning crypto, forensics, web, reverse engineering, pwn
Cybench2024EnvironmentarXiv:2408.08926 | GitHub | Website40 professional CTF tasks from HackTheBox, SekaiCTF, Glacier, HKCert
3CB2024EnvironmentarXiv:2410.09114 | WebsiteAdvanced CTF challenges designed to be harder than Cybench
BountyBench2025EnvironmentWebsite | GitHubReal-world vulnerability detection, exploitation, and patching with dollar impact
RCTF22025EnvironmentarXiv:2510.24317Robotics/cyber-physical sub-benchmark inside CAIBench (27 challenges)
CTFKnow2025DatasetarXiv:2501.09564CTF technical knowledge benchmark built from CTF writeups
CTF-Dojo2025EnvironmentarXiv:2501.17535Large-scale executable runtime of containerized CTF challenges
AIRTBench2025EnvironmentarXiv:2506.14682Autonomous AI red-teaming benchmark; 70 black-box CTFs
Crowdsourced CTF Elicitation2025FrameworkarXiv:2505.19915Evaluating AI cyber capabilities with crowdsourced elicitation (CTF-based)
PENETRATION TESTING
PentestGPT Benchmark2023HarnessarXiv:2308.06782 | GitHub182 sub-tasks from HackTheBox and VulnHub for penetration testing
AutoPenBench2024EnvironmentarXiv:2410.03225 | GitHubBenchmarking generative agents for pentesting with defined milestones
PentestEval2025HarnessarXiv:2512.14233Stage-specific evaluation across entire pentesting lifecycle
Vulhub Benchmark2024EnvironmentGitHubDocker-based vulnerable environments for automated pentesting
CHECKMATE2025FrameworkarXiv:2503.12735Planning + LLM agents for automated penetration testing
PenHeal2023FrameworkarXiv:2312.03015AI cybersecurity capabilities evaluation for pentesting and healing
AutoAttacker2024FrameworkarXiv:2403.01038Automated cyber-attack generation and evaluation benchmark
AI-Pentest-Benchmark2024EnvironmentarXiv:2410.17141 | GitHub13 VulnHub VMs with 152 subtasks ("Towards Automated Penetration Testing")
TermiBench2025EnvironmentarXiv:2509.09207Real-world pentesting benchmark; 510 hosts/30 CVEs; shell-focused
CTFTiny2025DatasetarXiv:2508.05674Curated 50 representative CTF challenges for rapid evaluation of offensive-security agents
CVE-Bench2025EnvironmentarXiv:2503.17332 | GitHubReal-world webapp vulnerability exploitation based on critical CVEs
XBOW Validation2025EnvironmentWebsite104 web security challenges for autonomous offensive tools
CyberGym2025EnvironmentarXiv:2506.02548 | HuggingFace1,507 instances from 188 OSS projects with ASan/UBSan validation
Cyberattack Capabilities Framework2025FrameworkarXiv:2503.11917 | DeepMind BlogEnd-to-end attack chain evaluation with representative archetypes
VULNERABILITY DETECTION
VulDetectBench2024DatasetarXiv:2406.07595 | GitHubVulnerability detection benchmark with 5 tasks (identify/classify/localize, etc.)
CyberSecEval v12023HarnessarXiv:2312.04724 | GitHubEvaluates LLMs for insecure code generation propensity (Purple Llama)
CyberSecEval v22024HarnessarXiv:2404.13161 | GitHubExtended benchmark with vulnerability exploitation and prompt injection tests
CyberSecEval v32024HarnessarXiv:2408.01605 | GitHubFurther advances in evaluating LLM cybersecurity risks
CyberSecEval v42025Meta-benchmarkGitHub | WebsiteMeta's latest suite; includes AutoPatchBench and CyberSOCEval
AutoPatchBench2025DatasetBlogBenchmark for automated repair of fuzzing-discovered vulnerabilities (part of CyberSecEval 4)
CyberSOCEval2025DatasetarXiv:2509.20166 | MetaSOC-focused benchmarks for malware analysis + threat-intelligence reasoning (part of CyberSecEval 4)
SecLLMHolmes2024FrameworkarXiv:2405.19803 | GitHubFully automated framework for evaluating LLM vulnerability detection
SecVulEval2025DatasetarXiv:2505.19828C/C++ vulnerability detection with statement-level granularity
VulnLLMEval2024FrameworkarXiv:2401.16185Framework for evaluating LLMs in vulnerability detection and patching
LLMSecCode2024HarnessarXiv:2408.17894Benchmark for evaluating secure code practices in LLMs
eyeballvul2024DatasetarXiv:2407.08708 | GitHubFuture-proof benchmark for vulnerability detection in the wild
VADER2025FrameworkarXiv:2505.19395 | GitHubHuman-evaluated framework for Vulnerability Assessment, Detection, Explanation
SVEN2023FrameworkarXiv:2302.05319 | GitHubSecurity hardening & adversarial testing for code LLMs (controlled code generation)
PrimeVul2024DatasetarXiv:2403.18624 | GitHubFiltered C/C++ function-level vulnerability detection dataset (ICSE 2025)
ARVO2024DatasetarXiv:2411.09278Project-level C/C++ vulnerability detection benchmark
Juliet Test Suite 1.32017DatasetNISTNIST's comprehensive test cases for C/C++ and Java vulnerability detection
SV-TrustEval-C2025DatasetarXiv:2505.20630Structure and semantic reasoning benchmark for C vulnerability analysis
VulGate2025DatasetarXiv:2508.16625Dataset with dedicated test sets for vulnerability detection generalization
Multi-Vuln Detection2025DatasetarXiv:2512.22306Long-context multi-label vulnerability benchmark across languages
Multi-Lang SVD2025DatasetarXiv:2503.01449Multi-language software vulnerability detection benchmark study
SECURE CODE GENERATION
CodeSecEval2024HarnessarXiv:2407.02395Evaluating LLMs on secure code generation with CWE-based evaluation
CodeLMSec2024HarnessarXiv:2302.04012Systematically evaluating security vulnerabilities in black-box code LMs
SecurityEval2022DatasetarXiv:2210.09263 | GitHubMining vulnerability examples to evaluate ML-based code generation
SecCodePLT2024HarnessarXiv:2410.11096 | GitHubUnified platform for evaluating code GenAI security with 27 CWEs
CWEval2025HarnessarXiv:2501.08200 | GitHubOutcome-driven evaluation for functionality and security of LLM code
SafeGenBench2025DatasetarXiv:2506.05692558 security-sensitive test questions covering vulnerability taxonomy (ByteDance)
SecRepoBench2025DatasetarXiv:2504.21205Repository-level secure coding with 318 tasks across 27 repos
SecureAgentBench2025EnvironmentarXiv:2509.22097105 tasks for evaluating code agents on secure code generation
A.S.E2025DatasetarXiv:2508.18106 | GitHubRepository-level benchmark using real CVEs (Tencent)
SEC-bench2025EnvironmentarXiv:2506.11791Automated benchmarking of LLM agents on real-world security tasks
CASTLE2025DatasetarXiv:2503.09433 | GitHubBenchmarking dataset for static code analysis with ground-truth annotations
MT-Sec2025DatasetarXiv:2503.09700Benchmarking correctness and security in multi-turn code generation
DUALGUAGE2025HarnessarXiv:2511.20709Automated joint security-functionality benchmarking
BaxBench2025EnvironmentarXiv:2502.11844 | GitHub392 backend tasks validating functionality and exploits
SecCodeBench2025HarnessGitHubAlibaba's 37 test cases / 16 CWEs with dynamic PoC exploits
AutoPatchBench2025ComponentGitHubAutomated vulnerability patching (component of CyberSecEval v4)
PatchEval2025HarnessarXiv:2511.11019Multilingual benchmark for patching real-world vulnerabilities; 1,000 CVEs
PACEbench2025FrameworkarXiv:2510.11688Framework for practical AI cyber-exploitation capabilities
VulnRepairEval2025FrameworkarXiv:2509.03331Exploit-based evaluation for LLM vulnerability repair
THREAT INTELLIGENCE & CTI
CTIBench2024DatasetarXiv:2406.07599 | HuggingFaceEvaluating LLMs on CTI tasks: attack patterns, threat actors, APT campaigns
CTI-MCQ2024DatasetarXiv:2406.07599Multiple-choice questions on attack patterns, APT campaigns, detection
CTI-RCM2024DatasetarXiv:2406.07599Root cause mapping correlating CVE records with CWE entities
SecKnowledge-Eval2025DatasetarXiv:2510.14113Evaluation datasets for complex cybersecurity tasks
ExCyTIn-Bench2025EnvironmentarXiv:2507.14201Microsoft's cyber threat investigation agent benchmark
MALWARE & SOC
ACSE-Eval2025DatasetarXiv:2505.11565AWS Cloud Security Engineering Eval for cloud threat modeling
LogEval2024DatasetarXiv:2407.01896Benchmark suite for LLM log analysis tasks (parsing, anomaly detection, diagnosis, summarization)
CyberSOCEval2025ComponentGitHubMalware analysis and threat intel reasoning (component of CyberSecEval v4)
Sophos SOC Benchmark2024HarnessSophos BlogThree SOC tasks: incident investigation, summarization, severity evaluation
LogLLM2024HarnessarXiv:2411.08561Log-based anomaly detection using large language models
LogLM2024DatasetarXiv:2410.09352Task-based to instruction-based automated log analysis benchmark
DefenderBench2025HarnessarXiv:2506.00739 | GitHubMicrosoft toolkit spanning offense/defense/understanding
PHISHING DETECTION
PhishAgent Benchmark2024HarnessarXiv:2408.02291Multimodal agent evaluation for phishing webpage detection
MLLM Phishing Benchmark2025DatasetarXiv:2503.01040Comprehensive security benchmark for multimodal LLMs
Open-Source LLM Phishing2025HarnessarXiv:2503.0152021 LLMs evaluated with 4 prompt engineering techniques
SME Phishing Detection2025DatasetarXiv:2503.08766LLM evaluation for small/medium enterprise phishing
PhishEmailLLM Dataset2025DatasetarXiv:2503.09270Meta-model approach for phishing email detection
APOLLO2024HarnessarXiv:2402.16862GPT-based tool benchmark for phishing email detection
PROMPT INJECTION
AgentDojo2024EnvironmentarXiv:2406.13352 | GitHubDynamic environment for prompt injection attacks & defenses
INJECAGENT2024DatasetarXiv:2403.02691 | GitHubBenchmarking indirect prompt injections in tool-using agents
BIPIA2023DatasetarXiv:2312.14197 | GitHubFirst benchmark for indirect prompt injection attacks
GenTel-Safe / GenTel-Bench2024FrameworkarXiv:2404.06531Unified benchmark and shielding framework for prompt injection
NotInject2024DatasetarXiv:2410.22770 | GitHubOver-defense/false-positive benchmark for prompt injection detectors (from InjecGuard)
PINT Benchmark2024HarnessGitHubLakera's benchmark for prompt injection detection systems
Tensor Trust2023DatasetarXiv:2311.01011 | GitHub | Website126K+ human-generated prompt injection attacks
Open-Prompt-Injection2024HarnessarXiv:2402.12138Standardized framework for prompt injection vulnerability evaluation
safe-guard-prompt-injection2024DatasetarXiv:2402.13064 | HuggingFace10,296 prompt injection examples for guardrail evaluation
WASP2025EnvironmentarXiv:2504.18575 | GitHubWeb Agent Security against Prompt injection attacks (Meta)
WAInjectBench2025HarnessarXiv:2510.01354Benchmarking prompt injection detections for web agents
RAS-Eval2025HarnessarXiv:2506.15253Security eval benchmark for LLM agents with tool execution
JAILBREAK & RED TEAMING
JailbreakBench2024HarnessarXiv:2404.01318 | GitHub | Website200 behaviors for standardized jailbreak evaluation
HarmBench2024HarnessarXiv:2402.04249 | GitHubStandardized evaluation framework for automated red teaming
SafetyBench2024HarnessGitHubCAIS benchmark suite for comprehensive safety testing
ToxiGen2022DatasetarXiv:2203.09509 | GitHubMicrosoft dataset for toxic/harmful content detection
StrongREJECT2024DatasetarXiv:2402.10260 | GitHub313 forbidden questions across 6 categories
WildJailbreak2024DatasetarXiv:2406.18510 | GitHub261,534 conversations for training LLMs to be safe
SORRY-Bench2024HarnessarXiv:2406.14598 | GitHubSystematically evaluating LLM safety refusal behaviors
ALERT2024HarnessarXiv:2404.08676Comprehensive benchmark for LLM safety through red teaming
GPTFuzzer2023HarnessarXiv:2309.10253 | GitHubAuto-generated jailbreak prompts for red teaming LLMs
SG-Bench2024HarnessarXiv:2410.21965Evaluating LLM safety generalization across diverse tasks
LatentJailbreak2023DatasetarXiv:2307.08487Benchmark for evaluating text safety and output robustness
AdvBench2023DatasetarXiv:2307.15043Adversarial behaviors dataset (foundation for many jailbreak benchmarks)
S-Eval2024HarnessarXiv:2405.14191Automatic and adaptive test generation for LLM safety
SAFE2024DatasetarXiv:2404.18539Fine-grained safety dataset for LLMs beyond binary classification
DoNotAnswer2023DatasetarXiv:2308.13387 | GitHubEvaluating safeguards in LLMs with comprehensive refusal scenarios
AILuminate Jailbreak v0.52025HarnessMLCommonsMLCommons jailbreak benchmark (industry standard)
SecReEvalBench2025DatasetarXiv:2505.07584Multi-turn security resilience evaluation benchmark
HELM Safety2024ComponentStanford HELMSafety evaluation component of Stanford's HELM
Agent Security Bench (ASB)2024HarnessarXiv:2410.02644 | GitHubFormalizing attacks and defenses in LLM-based agents (ICLR 2025)
AgentHarm2024DatasetarXiv:2410.09024 | HuggingFaceUK AISI's 110 harmful agent tasks
b3 (Backbone Breaker Benchmark)2025DatasetarXiv:2510.22620 | BlogSecurity evaluation for backbone LLMs used inside AI agents (agent-focused adversarial attacks)
META-BENCHMARKS & FRAMEWORKS
CAIBench2025Meta-benchmarkarXiv:2510.24317Meta-benchmark integrating Base, Cybench, AutoPenBench, CTIBench
CyberPII-Bench2025DatasetarXiv:2510.24317PII anonymization evaluation in cybersecurity contexts
Cyber-Zero2025FrameworkarXiv:2508.00910 | GitHubTraining framework with benchmark suites for EnIGMA+
EnIGMA2024EnvironmentarXiv:2409.16165 | GitHubEnhanced interactive generative model agent for CTF
NETWORK & IDS DATASETS
NSL-KDD2009DatasetUNBClassic network intrusion detection dataset
CIC-IDS 20172017DatasetUNBIntrusion detection evaluation dataset
CSE-CIC-IDS 20182018DatasetUNBIDS/IPS dataset on AWS infrastructure
CIC-DDoS 20192019DatasetUNBDDoS attack evaluation dataset
CIRA-CIC-DoHBrw 20202020DatasetUNBDNS over HTTPS dataset
CIC-Bell DNS 20212021DatasetUNBDNS security dataset
CIC IoT Attack Dataset2023DatasetUNBIoT attack patterns dataset
CICIoV20242024DatasetUNBInternet of Vehicles security dataset
CICIoMT20242024DatasetUNBMedical IoT security dataset
IoT-DIAD2024DatasetUNBIoT intrusion detection and anomaly dataset
APT IIoT (CICADA)2024DatasetUNBIndustrial IoT APT attack dataset
Datasense IIoT2025DatasetUNBIndustrial IoT sensor data security dataset
BCCC-CIC-IDS20172017DatasetUNB BCCCLarge-scale intrusion detection dataset
BCCC-CSE-CIC-IDS20182018DatasetUNB BCCCExtended large-scale IDS dataset
BCCC-VulSCs-20232023DatasetUNB BCCCVulnerable smart contracts dataset
BCCC-SCsVuls-20242024DatasetUNB BCCCSmart contract vulnerabilities dataset
BCCC-cPacket-Cloud-DDoS-20242024DatasetUNB BCCCCloud DDoS attacks dataset
BCCC-IoT-IDS-Zwave-20252025DatasetUNB BCCCLarge-scale IoT-Zwave intrusion detection dataset
BCCC-DeFiFraudTrans-20252025DatasetUNB BCCCDeFi fraud transactions dataset
BCCC-Mal-NetMem-20252025DatasetUNB BCCCMultisource malware analysis using network traffic and memory
UNSW-NB152015/2024DatasetUNSWNetwork intrusion detection dataset (updated 2024)
MITRE ATLAS2023Knowledge BaseMITREAttack success rates for AI models (knowledge base)
AI SECURITY ADJACENT: ADVERSARIAL ML & ROBUSTNESS
CIFAR-10 Adversarial2019DatasetIBM ARTIBM ART benchmark for attack success rates
ADDC2024Dataset⚠️ Unable to verify - Mahalle et al.Adversarial Diversity-Driven Dataset
DCA2024Harness⚠️ Unable to verify - Mahalle et al.Aggressive events simulation for benchmark datasets
REA2024Harness⚠️ Unable to verify - Mahalle et al.AI model threat handling evaluation
VMA2024Framework⚠️ Unable to verify - Mahalle et al.AI model vulnerability identification benchmark
RobustBench2021HarnessarXiv:2010.09670 | GitHub | WebsiteAdversarial robustness leaderboard for image classifiers
AdversarialNLI (ANLI)2020DatasetarXiv:1910.14599 | GitHubMeta's adversarial robustness in NLI
AI SECURITY ADJACENT: DEEPFAKE & MEDIA
Faceswap-GAN2018DatasetGitHubDeepfake detection methods evaluation
VidTIMIT2012DatasetConvAIVideo-based deepfake detection benchmark
FaceForensics++2019DatasetarXiv:1901.08971 | GitHubLarge-scale deepfake detection benchmark
MISCELLANEOUS
AI Cyber Risk Benchmark2024HarnessarXiv:2412.09878Evaluating automated exploitation capabilities
ITBench2025EnvironmentarXiv:2502.03969Evaluating AI agents across IT automation tasks
SandboxEval2025EnvironmentarXiv:2504.00018Test suite for LLM assessment environment safety
CyberLLMInstruct2025DatasetarXiv:2503.09144Dataset for analyzing safety of fine-tuned LLMs
DebugBench2024HarnessarXiv:2401.08420Evaluating debugging capability of LLMs
AttackER2024DatasetarXiv:2408.05866Named entity recognition dataset for cyber-attack attribution
Hackphyr2024EnvironmentarXiv:2409.11276Local fine-tuned LLM agent for network security
CyberPal.AI2024DatasetarXiv:2408.09304Expert-driven cybersecurity instructions benchmark
Truth Seeker Dataset2023DatasetUNBMisinformation detection in cybersecurity context
BinMetric2025HarnessarXiv:2505.07360Binary analysis metrics and evaluation benchmark
OS-Harm2025EnvironmentarXiv:2506.14866Safety of computer use agents with GUIs (150 tasks)
AgentThreatBenchUK AISI / inspect_evals2026BenchmarkOWASP Top 10 Agentic

Summary Statistics

By Category

CategoryCount
Knowledge & Q&A15
CTF & Offensive10
Penetration Testing13
Vulnerability Detection19
Secure Code Generation20
Threat Intelligence & CTI5
Malware & SOC7
Phishing Detection6
Prompt Injection12
Jailbreak & Red Teaming20
Meta-Benchmarks4
Network & IDS Datasets22
Miscellaneous12
Core Cybersecurity Benchmarks~165
AI Security Adjacent: Adversarial ML7
AI Security Adjacent: Deepfake & Media3
TOTAL (incl. adjacent)~175

todo

https://github.com/ethiack/ethibench

https://x.com/AISecHub/status/2077481328950292544

https://www.cotool.ai/research/aws-cloud-intrusion - multiple links from this one

Similar repos

EvanThomasLuke/Awesome-AI-Hacking-Agents

List of AI Hacking Agents

684

same org

anshug/ai-security-evals

Curated AI security and safety evaluation benchmarks well-regarded by Frontier AI labs

2

Ashfaaq98/awesome-genai-cyberhub

A curated list of LLM driven Cyber security Resources

57

XuanwuAI/SecEval

Dataset

SecEval: A Comprehensive Benchmark for Evaluating Cybersecurity Knowledge of Foundation Models

26

simon-p-j-r/LLM4Pentest

363

XuanwuAI/SecEval

116

xashru/cti-bench

[NeurIPS'24, Spotlight] CTIBench: A Benchmark for Evaluating LLMs in Cyber Threat Intelligence

94

ch3cke/awesome-auto-penetration-testing

6

Contributors

EvanThomasLuke

12 commits

yashpj

2 commits

vgudur-dev

1 commits