Yeti-791/Awesome-Offensive-AI-Agentic-Landscape

This document curates open-source projects, academic papers, capability benchmarks, and commercial solutions (international & China) in AI penetration testing, LLM red teaming, autonomous offensive agents, and vulnerability discovery—aimed at helping researchers, security engineers, and enterprise decision-makers quickly form a holistic view.

306

25 commits

updated Sep 10, 2026

See the code

README

Offensive AI Agentic 全景:项目 / 模型 / Skill / MCP / 论文 / Benchmark / 商业产品 一览

Offensive AI Agents Landscape: Projects, Models, Skills, MCP Servers, Papers, Benchmarks & Commercial Solutions 599999755-793799dc-53e7-4fee-8959-654fbc09c902

🛠️ Projects🧬 Models🧩 Skills🔌 MCP📑 Papers🧪 Benchmarks📚 Awesome Lists💼 Commercial
46113711613932
渗透 / 红队 / CTF Agent进攻 6 + 安全专用 5Claude/Agent SkillBurp/Metasploit/工具链2023 → 20262023 → 2026资源索引国外 Top 20 + 国内 12

本文档以进攻型 AI为主线,系统整理了 AI 渗透测试 / 自主红队 Agent 领域的开源项目、进攻型 & 安全专用开源模型进攻型 AI Skill 与 MCP Server、学术论文、能力评测 Benchmark 与国内外商业化解决方案,帮助研究者、安全工程师与企业安全决策者快速建立领域全景认知。注意:本文档聚焦"用 AI 做攻击",而非"攻击 AI 系统"(LLM 自身安全性如 prompt injection / jailbreak 等不在主线范围,仅少量关联项目涉及)。

This document focuses on offensive AI — curating open-source projects, offensive & security-specialized open-weight models, offensive AI Skills & MCP Servers, academic papers, capability benchmarks, and commercial solutions (international & China) in AI-driven penetration testing & autonomous red-team agents. It helps researchers, security engineers, and enterprise decision-makers quickly form a holistic view of the domain. Note: the primary lens is "using AI to attack", not "attacking AI systems" (LLM security topics such as prompt injection / jailbreaking are out of scope for the main thread, though a few related projects may appear incidentally).

数据采集时点:2026-09-11(论文章节全量核验:修复错链与元数据、移除 4 篇 LLM 自身安全类论文、经 LLM4Pentest 交叉核对补充 47 篇,73→116)| Star 数 ≥ 1000 统一以 k 为单位(保留一位小数)。


📋 开源Agent列表

Open-Source Agent List

按 Star 数降序排列,收录 Star ≥ 90 的开源 AI 渗透测试 / 红队 Agent 及进攻型安全项目。 ⭐新补充 = 本轮新增(2026-07-14/15) Sorted by stars (desc), projects with ≥ 90 stars — covering AI penetration testing, red-team agents, and offensive security tools. ⭐ = newly added this round (2026-07-14/15).

#项目Stars语言类型简介
1usestrix/strix60.1kPython渗透 Agent开源 AI 黑客,发现并修复应用漏洞(🚀 一个多月 Star 从 41k 飙升至 60k,反超 shannon 登顶)
2KeygraphHQ/shannon47.6kTypeScript渗透 Agent面向 Web 应用和 API 的自主白盒 AI 渗透测试工具
3vxcontrol/pentagi22.2kGo渗透 Agent全自主 AI 代理系统,执行复杂渗透测试任务
4GreyDGL/PentestGPT15.2kPython渗透 AgentLLM 驱动的自动化渗透测试代理框架(早期标杆)
50x4m4/hexstrike-ai11.5kPythonMCP / 渗透MCP 服务器,让 AI Agent 自主运行 150+ 安全工具
6aliasrobotics/cai9.8kPython安全 AI 框架Cybersecurity AI(CAI)安全框架(已于 2026-08-28 归档,曾产出 18 篇论文、30+ CVE)
7Ed1s0nZ/CyberStrikeAI6.3kGo渗透 AgentGo 构建的 AI 原生安全测试平台
8elder-plinius/T3MP3ST5.9kTypeScript红队 Agent自主红队平台 / 多智能体进攻性安全元框架,复用本机 AI 编码代理(Claude Code/Codex/Ollama 等)作零日漏洞猎手
9OWASP/Nettacker5.5kPython自动化扫描OWASP 自动化渗透测试 / 漏扫框架
10GH05TCREW/pentestagent3.0kPython渗透 Agent黑盒安全测试 AI Agent 框架(GHOSTCREW)
11oritera/Cairn2.5kPython渗透 Agent通用状态空间搜索引擎,自主渗透
12samugit83/redamon2.4kPython红队 AgentAI 驱动的代理式红队框架
13Armur-Ai/Pentest-Swarm-AI ⭐新补充2.4kGo渗透 Agent首个"蜂群"架构自主渗透平台,信息素黑板去中心化协作,ReAct 推理 + 5 种蜂群剧本,支持 Claude API / Ollama 本地,含 MCP 服务器
140xSteph/pentest-ai-agents2.2kShellClaude SubAgent将 Claude Code 转为攻击性安全研究助手
15CyberStrikeus/CyberStrike ⭐新补充2.2kTypeScript渗透 AgentAI 驱动的进攻性安全代理,7,300+ 安全技能,基于 MITRE ATT&CK / CIS / OWASP / NIST,含网站 cyberstrike.io
16zakirkun/guardian-cli1.9kPython渗透 Agent生产级 AI 渗透 CLI(Gemini + LangChain)
170xSteph/pentest-ai ⭐新补充1.6kPython渗透 AgentMCP 服务器封装 205+ 安全工具 + 17 个专业代理 + 确定性漏洞验证(零误报),CLI + MCP 双路径,自带 LLM
18Gowtham-Darkseid/AutoPentestX1.5kPython渗透 Agent自动化渗透测试与漏洞报告
19bugbasesecurity/pentest-copilot1.3kJavaScript浏览器助手浏览器端的道德黑客辅助工具
20SanMuzZzZz/LuaN1aoAgent1.3kPython渗透 Agent全自主 AI 渗透 Agent,XBOW >90%(广州大学)
21PentesterFlow/agent ⭐新补充1.3kTypeScript渗透 Agent终端内 Agentic 进攻性安全,"人在回路中",内置 OWASP Top 10 技能 + Burp 集成 + 覆盖率跟踪
22ipa-lab/hackingBuddyGPT1.2kPython渗透 Agent50 行代码内调用 LLM 协助伦理黑客
23berylliumsec/nebula1.1kPython渗透助手AI 渗透助手,自动侦察 / 笔记 / 漏洞分析
24splx-ai/agentic-radar1.0kPythonAgent 安全扫描LLM Agentic 工作流安全扫描器(OpenAI Agents、CrewAI、LangGraph 等)
25xalgord/xalgorix953Go渗透 Agent开源 AI 渗透测试 Agent
26ASCIT31/Dark-Moon ⭐新补充887Python渗透 AgentAI 驱动的自主渗透测试引擎,覆盖 Web/云/AD/K8s,多智能体编排 + 隐私网关 + 50+ 工具集成
27verialabs/ctf-agent757PythonCTF Agent自主 CTF solver,BSidesSF 2026 第一名
28westonbrown/Cyber-AutoAgent544TypeScript渗透 AgentXBOW 验证基准 85%,已归档但代表性强
29ARCANGEL0/EVA526Python渗透 AgentAI 辅助渗透测试代理,多后端 AI 集成
30m-sec-org/BreachWeave525TypeScript渗透 AgentManager/Observer/Solver 多角色架构(腾讯云黑客松第二期线下决赛一等奖,排名 1/613)
31transilienceai/communitytools502PythonClaude 工具集开源 Claude Code skills/agents/slash command
320ca/BoxPwnr450Python渗透 Agent / 多平台基准HackTheBox / TryHackMe / picoCTF / Cybench / XBOW 等 15 个平台基准框架
33crond-jaist/AutoPentest-DRL448Python强化学习渗透使用深度强化学习的自动化渗透测试
34SHAdd0WTAka/Zen-Ai-Pentest446Python渗透 Agent多代理 AI 渗透框架 + 合规报告
35aielte-research/HackSynth316Python渗透 AgentPlanner + Summarizer 双模块,PicoCTF / OverTheWire 200 题(arXiv:2412.01778)
36straylabs-ai/deadend-cli(原 xoxruns)302Python渗透 AgentXBOW 黑盒 81%,约 $122 API 成本,本地化执行
37yz9yt/BugTrace-AI253TypeScript漏洞追踪(已归档,演进为 BugTraceAI v2)
38GitHubSecurityLab/seclab-taskflow-agent230PythonAgent 框架GitHub Security Lab 出品,YAML 驱动多 Agent + CodeQL
39KHenryAegis/VulnBot191Python渗透 Agent多代理协作框架的自主渗透测试
40chainreactors/tinyctfer174PythonCTF Agentantix 微型意图运行时 + 元工具设计(腾讯云黑客松第 4 名核心代码)
41NYU-LLM-CTF/nyuctf_agents161PythonCTF AgentNYU CTF Bench 配套的 D-CIPHER + Baseline
42antoninoLorenzo/AI-OPS158Python渗透助手基于开源 LLM 的渗透测试 AI 助手
43andreashappe/cochise134PythonAD 渗透 Agent自主 Assumed Breach AD 渗透(TOSEM 2025)
44arthurgervais/mapta106Python渗透 Agent多 Agent Web 应用安全评估 + 端到端漏洞利用验证(arXiv:2508.20816)
45vikramrajkumarmajji/AI-VAPT102TypeScriptVAPT 框架自主 AI 漏洞评估与渗透测试框架
46amazon-science/Cyber-Zero101Python训练框架无运行时训练网络安全代理(Amazon Science,已于 2026-07-10 归档)

备注:1k–10k 区间的 Star 数为 GitHub 网页缩写值的换算结果;万级以上误差更大。2026-09-02 全量刷新要点:strix 反超 shannon 登顶(41k→60.1k);cai(2026-08-28)与 Cyber-Zero(2026-07-10)已归档;deadend-cli 迁移至 straylabs-ai 组织;mcp-shodan 迁移至 w0h1v。2026-09-07 精简:移除 promptfoo、garak、PyRIT、vulnhuntr、deepteam、agentic_security、buttercup、promptmap、reaper 共 9 个项目(56→47,聚焦渗透 / 红队 / CTF Agent 主线)。 Note: stars in the 1k–10k range are converted from GitHub's abbreviated values; 10k+ may carry larger errors. 2026-09-02 refresh highlights: strix overtakes shannon as #1 (41k→60.1k); cai & Cyber-Zero archived; deadend-cli moved to straylabs-ai; mcp-shodan moved to w0h1v. 2026-09-07 pruning: removed 9 entries (promptfoo, garak, PyRIT, vulnhuntr, deepteam, agentic_security, buttercup, promptmap, reaper), refocusing on pentest / red-team / CTF agents.


🧬 进攻型 / 安全专用开源模型

Offensive & Security-Specialized Open-Weight Models

上面的项目多为"Agent 框架 / 脚手架",其能力最终取决于底层模型。本节盘点可作为 Offensive AI Agent 推理内核的开源权重模型,分两类:

  • A. 无安全对齐 / 弱审查的进攻型模型:刻意去除或大幅弱化拒答对齐,可直接输出漏洞利用 / 攻击链推理,最适合本地化、无云依赖的红队 Agent 驱动。
  • B. 安全领域专用模型(含推理 / 漏洞 / 防御对齐):面向安全垂域微调,能力强但保留了不同程度的安全对齐,进攻场景常需搭配越狱 / 系统提示或作为漏洞检测内核使用。

These are open-weight models usable as the reasoning core of an offensive AI agent, split into (A) uncensored/weakly-aligned offensive models and (B) security-specialized models that still retain safety alignment.

A. 无安全对齐 / 弱审查的进攻型模型

Uncensored / Weakly-Aligned Offensive Models

#模型参数量基座发布方定位与特色
1Qwythos-9B-Claude-Mythos-5-1M ⭐新补充Ollama9BQwen3.5-9B(深度无审查)Empero AI🔥 "Claude 平替"级无审查推理模型,后训练超 5 亿 token Claude Mythos/Fable 思维链,1M 上下文 + 自我纠正工具调用,4GB 显存即可本地运行,MMLU +34.3 / gsm8k +30 大幅超越基座
2WhiteRabbitNeo / DeepHatDeepHat-V1-7B、13B、33B、70B)7B–70BLlama / Qwen / DeepSeekKindo.ai最知名的无审查红队模型家族,2025 Black Hat 后更名 DeepHat。面向真实进攻推理、长上下文分析,可映射立足点、串联弱点、探索利用路径
3Lily-Cybersecurity-7B-v0.27BMistral-7BSego Lily LabsMistral 微调,22,000 条手工构造的网络安全 / 黑客问答对,无强拒答对齐,适合本地渗透问答助手
4BaronLLM (Offensive Security LLM)GGUF Q6_K7B/8B 级AlicanKiraz0专为进攻性安全研究、对抗模拟、红队微调的模型,输出偏向 exploit / 攻击链推理
5CyberStrike-OffSec-35B ⭐新补充35B MoE(激活 3B)Qwen3.6-35B-A3BOrhan Yildirim35B 混合专家进攻性安全模型,SFT+DPO 训练,专攻漏洞利用开发 / 红队行动 / 云攻击 / 免杀技术,自称多个安全基准超越 GPT-4无安全对齐
6BugTraceAI-CORE-Ultra-27B ⭐新补充27BQwen3.6-27BBugTraceAI基于 2,541 份真实漏洞赏金报告 + CVE 分析 + 进攻性安全研究 SFT 微调,专注漏洞发现与 Nuclei 模板生成,面向 Bug Bounty 场景

⚠️ 说明:此类模型刻意弱化安全对齐,可直接产出攻击性内容,必须严格限定于授权测试 / 隔离环境(详见文末免责声明)。 These models intentionally weaken safety alignment; use only within authorized, isolated environments.

B. 安全领域专用模型(含推理 / 漏洞 / 防御对齐)

Security-Specialized Models (Reasoning / VulnDetect / Defense-Aligned)

#模型参数量基座发布方定位与特色对齐属性
1VulnLLM-R-7B代码7BQwen 系UCSB-SURFI漏洞挖掘推理模型,逐步推理数据流 / 控制流 / 安全上下文;在 Python/C/C++/Java 上超越 CodeQL、AFL++、Claude-3.7 等(arXiv:2512.07533)面向检测,弱进攻对齐
2Foundation-Sec-8B-Reasoning8BLlama-3.1-8BCisco Foundation AI"全球首个安全推理模型",安全垂域指令微调,可本地部署驱动 AI 安全工具(arXiv:2601.21051)通用安全,保留对齐
3CyberSecQwen-4B4BQwen3-4B-InstructAMD Hackathon / athena129轻量防御性安全模型,专攻 CVE→CWE 映射(CTI-RCM)与威胁情报选择题(CTI-MCQ),4B 却超 8B 基座明确防御导向
4Meta-SecAlign-8B70B8B / 70BLlama-3.1Meta (FAIR)首个内建 prompt injection 防御的全开源商用级 LLM(arXiv:2507.02735);本质是防御对齐标杆,可作红队攻防的"蓝方"陪练强防御对齐(非进攻)
5Titus-CybersecurityLLM-v1.0 ⭐新补充35B MoEQwen3.6-35B-A3BAlicanKiraz0面向 SOC/DFIR 的网络安全操作模型,土耳其语优先 + 英文,含 MLX 4-bit 量化版(19.5GB VRAM),与 BaronLLM 同一作者偏防御(SOC/DFIR 导向)

甄别提示:VulnLLM-R / Foundation-Sec / CyberSecQwen / Meta-SecAlign / Titus 均非"无对齐进攻模型"——它们分别偏漏洞检测、安全推理、防御问答、抗注入防御与 SOC/DFIR 运营。真正"无安全对齐、适合直接进攻"的是 A 类(Qwythos、WhiteRabbitNeo/DeepHat、Lily、BaronLLM、CyberStrike-OffSec-35B、BugTraceAI-CORE-Ultra)。将它们并列收录,是为了呈现"进攻内核 vs 安全垂域 / 防御对齐"的完整光谱,便于选型时对症下药。 Selection note: only Group A models are genuinely uncensored/offensive; Group B are vuln-detection, reasoning, or defense-aligned models included for a complete spectrum.


🧩 进攻型 AI Skill 资源精选

Offensive AI Skills (Claude Code / Agent Skills Ecosystem)

除了独立 Agent 与底层模型,Agent Skill(如 Claude Code Skills、agentskills.io / skills.sh 生态)正成为"进攻型 AI"落地到通用 AI 编程客户端的重要形态——把渗透测试方法论、工具链调用顺序与 payload/字典打包为可被 Agent 按需自动加载的结构化技能模块。仅收录纯 Skill 形态(非 Agent/Subagent 混合项目)、Star ≥ 100 的仓库,按 Star 数降序排列。 Agent Skills package pentest methodology, tool-chains, and payloads/wordlists into structured modules that general-purpose AI coding agents (e.g. Claude Code) can auto-load on demand. Only pure-Skill repos (excluding Agent/Subagent-hybrid projects) with ≥ 100 stars are listed, sorted by stars (desc).

#仓库Stars载体 / 生态定位与特色
1mukul975/Anthropic-Cybersecurity-Skills ⭐新补充32.0kAgent Skills(agentskills.io 标准,20+ 平台兼容)🔥 全球最大开源网安 Agent Skill 库,817 个结构化技能覆盖 29 大安全域(红队/渗透/云安全/取证/威胁狩猎等),业界唯一六框架映射(ATT&CK/NIST CSF/ATLAS/D3FEND/AI RMF/F3),社区非官方项目
2ljagiello/ctf-skills3.2kAgent Skills(Claude Code 等)CTF 全领域技能包,覆盖 Web/Pwn/密码学/逆向/取证/OSINT/恶意软件/AI-ML 等 10 大类,内置 solve-challenge 总调度器自动分发题型
3Eyadkelleh/awesome-skills-security374Agent Skills(60+ Agent 兼容)基于 SecLists 精选打包为 7 类技能(Fuzzing/密码字典/敏感模式/Payload/用户名/Webshell/LLM 测试),一键安装

⚠️ 上述 Skill 本身通常不内置攻击性代码,仅提供方法论、脚本编排与工具调用规范;实际执行仍依赖用户自行安装的安全工具,且必须严格限定于授权测试场景。 These skills mostly provide methodology/orchestration rather than embedded exploit code; actual execution still relies on separately installed security tools and must remain within authorized testing scope.


🔌 进攻型 AI MCP Server 精选

Offensive AI MCP Servers

MCP(Model Context Protocol)让 AI Agent 以标准化协议直接调用真实安全工具,是"进攻型 AI"从推理走向实际执行的关键基础设施——Burp、Metasploit、Nmap 等工具借此被"AI 化"。仅收录安全工具集合类 MCP Server(非单一 Agent 项目自带的 MCP 组件)、Star ≥ 100 的仓库,按 Star 数降序排列。 MCP servers let AI agents invoke real security tools via a standardized protocol — the execution layer that turns offensive AI reasoning into action. Only dedicated security-tool MCP servers (excluding MCP components bundled inside a single agent project) with ≥ 100 stars are listed, sorted by stars (desc).

#仓库Stars语言定位与特色
1PortSwigger/mcp-server1.1kKotlinPortSwigger 官方出品,Burp Suite 扩展,桥接 Burp 与 MCP 客户端(Claude Desktop 等),SSE + Stdio 双模式
2Wh0am123/MCP-Kali-Server ⭐新补充808Python已收录 Kali 官方软件源apt install mcp-kali-server)的轻量级 API 桥接,集成 nmap/hydra/sqlmap/metasploit/wpscan 等,支持 AI 辅助渗透与 CTF/HTB/THM 靶场解题
3FuzzingLabs/mcp-security-hub776Python38 个容器化 MCP 服务器集合,覆盖侦察/Web/二进制分析/区块链/云/模糊测试/AD 等,共 300+ 安全工具,生产级安全加固
4GH05TCREW/MetasploitMCP722PythonMetasploit 框架 MCP 桥接,支持 exploit/payload 生成、会话管理、Handler 监听器全流程操作
5MorDavid/BloodHound-MCP-AI ⭐新补充375Python首个 BloodHound AI 集成,75+ 工具将 Cypher 查询封装为自然语言,专攻 AD 攻击路径分析(Kerberoasting/AS-REP Roasting/NTLM 中继/委派滥用)
6w0h1v/mcp-shodan(原 BurtTheCoder) ⭐新补充161TypeScriptShodan API + CVEDB 查询 MCP,IP 侦察/DNS 操作/联网设备发现/CVE-CPE 关联查询,支持 Claude Code、Codex、Gemini CLI
7DMontgomery40/pentest-mcp143JavaScript/TS面向专业渗透测试者的实战级 MCP 服务器,内置 nmap/hydra/sqlmap/nuclei/hashcat 等,含 SoW 授权范围采集与 Prompt Injection 风险缓解

⚠️ 此类 MCP Server 通常直接封装真实攻击性工具(Metasploit、sqlmap、hashcat 等),风险等级高于 Skill 类资源,必须部署于隔离环境并严格限定授权范围These MCP servers wrap real offensive tools directly and carry higher risk than skill-based resources — deploy only in isolated, explicitly authorized environments.


🏆 知名 AI 攻防 / 智能渗透赛事

Notable AI Offense-Defense & Intelligent Penetration Competitions

本节收录全球范围内具有代表性的 AI 驱动攻防 / 自主渗透 竞技赛事,是检验 Agent 实战能力的"竞技场",产出的开源系统往往代表当前工程实践的最高水准。 This section covers representative AI-driven offense-defense / autonomous penetration competitions worldwide — the "arenas" that stress-test Agent capabilities, whose open-sourced systems often represent state-of-the-art engineering practice.

1. DARPA AIxCC 2025

DARPA AI Cyber Challenge 2025 Final

美国 DARPA 在 2025 年举办的 AI Cyber Challenge(AIxCC) 决赛中,7 支队伍各自开源了完整的 Cyber Reasoning System(CRS),代表当前自动化漏洞发现 + 修复 Agent 的最高工程水准。 The 7 finalist Cyber Reasoning Systems from DARPA's AI Cyber Challenge represent today's state-of-the-art in automated vulnerability discovery & patching agents.

排名队伍CRS 系统Stars仓库
🥇 1Team AtlantaATLANTIS642Team-Atlanta/aixcc-afc-atlantis
🥈 2Trail of BitsButtercup1.7ktrailofbits/buttercup
🥉 3TheoriRoboDucktheori-io/aixcc-afc-archive
4All You Need Is A Fuzzing BrainFuzzingBraino2lab/afc-crs-all-you-need-is-a-fuzzing-brain
5ShellphishARTIPHISHELL141shellphish/artiphishell
642-b3yond-6ugBugBuster42-b3yond-6ug/42-b3yond-6ug-crs
7Lacrosse (SIFT)Lacrosse CRSsiftech/afc-crs-lacrosse

2. 腾讯云智能渗透黑客松

Tencent Cloud Intelligent Penetration Hackathon

腾讯安全云鼎实验室主办,国内首个聚焦 LLM 智能体全流程自动化渗透 的顶级专业赛事,理念"铸刃止戈、以智御危"。已连续举办两届,累计汇聚清华大学、复旦大学、帝国理工学院、卡内基梅隆大学等国内外知名高校学生战队,鹏城实验室、中国科学院信息工程研究所等权威科研机构专家战队,以及阿里、京东、长亭、绿盟等行业领军企业战队,参赛规模从第一届 238 支战队/518 名选手增长至第二届 610 支战队/1,345 名选手,累计产出 20 套顶尖智能渗透技术框架。赛制核心导向为纯 AI 驱动渗透,严格限制人工操作,前 20 名可获开源贡献奖。官方资源仓:Yeti-791/Tsec-Hackathon(709 Stars)。 Hosted by Tencent Security Yunding Lab, the first domestic top-tier competition focused on LLM-agent fully-automated penetration. Two editions held so far, growing from 238 teams/518 competitors to 610 teams/1,345 competitors, producing 20 leading intelligent-penetration frameworks. Strictly AI-driven with manual operation prohibited. Official repo: Yeti-791/Tsec-Hackathon.

届次时间冠军战队参与规模
第一届2025-11xjtuHunter(西安交大)第2名 / BinX(广州大学)第3名清华大学、复旦大学、帝国理工学院、卡内基梅隆大学等国内外知名高校学生战队,鹏城实验室、中国科学院信息工程研究所等权威科研机构专家战队,以及阿里、京东、长亭等行业领军企业战队,共计 238 支战队、518 名顶尖选手参与
第二届2026-04ai小分队(第1名)/ Bytex(第3名,全场唯一 AK)首创"智能渗透主赛场 +『零界』平行赛场"双轨竞技模式,参赛规模在第一届基础上增长至 610 支战队、1,345 名安全极客与 AI 研究者;获奖队伍包括绿盟科技、京东、天翼安全、中国电信、清华大学、奇盾信息等

📑 相关学术论文

Related Academic Papers (grouped by topic; within each group, newest first)

在原有基础上,融合了 tmylla/Awesome-LLM4Cybersecurity 中渗透测试、进攻 AI、漏洞挖掘相关章节,并于 2026-09-11 与 simon-p-j-r/LLM4Pentest(108 篇分类清单)逐篇交叉核对:勘误多项标题/作者/链接(含 CyberSecEval 3 错链、MAPTA/D-CIPHER/Aurora 旧版标题、PwnGPT PDF 直链等)、移除 4 篇"攻击 AI 系统 / LLM 自身安全"类论文(UDora、AgentPoison、CyberSecEval 1/3)、补充 47 篇遗漏论文。现共收录 116 篇,按主题拆为 3 个子表:

  • A. 渗透测试 & 红队 Agent(62 篇)
  • B. 漏洞挖掘 / 利用 / 修复(20 篇)
  • C. 评测基准 & 训练方法 & 综述 & 奠基(34 篇)

时间以 arXiv v1 提交日期 / 期刊首发日期为准;⭐新补充 = 本轮新增(2026-09-11),ⓝ 为往轮补充。

Cross-checked entry-by-entry against simon-p-j-r/LLM4Pentest on 2026-09-11: multiple title/author/link errata fixed (incl. a wrong CyberSecEval 3 link), 4 "attacking-AI / LLM-safety" papers removed (UDora, AgentPoison, CyberSecEval 1/3), and 47 missing papers added — 116 in total: (A) Pentesting & Red-Team Agents (62) · (B) Vulnerability Discovery / Exploitation / Repair (20) · (C) Evaluation, Training, Surveys & Foundational (34).

A. 渗透测试 & 红队 Agent

Pentesting & Red-Team Agents

#时间论文作者 / 机构发表渠道关联项目 / 主题
A12026-07A Survey of LLM-Driven Penetration Testing: Taxonomy, Co-Evolution, and Open ChallengesZheyuan He et al.arXiv系统综述 81 篇文献:Agents4Pentest 分类学与四阶段架构演进(RLVR 转折)
A22026-07Intelligent Penetration Testing Through Integrated Knowledge Graph and Historical Decision Enhancement ⭐新补充Qianyu LiIEEE TDSC 2026知识图谱 + 历史决策增强的智能渗透
A32026-06ZERO-APT: A Closed-Loop Adversarial Framework for LLM-Driven Automated Penetration Testing under Intelligent DefenseAnlan Zheng, Tiantian ZhuarXiv攻击者-防御者-裁判回合制闭环,含实时智能防御
A42026-05APT-Agent: Automated Penetration Testing using Large Language Models ⭐新补充William Guanting Li et al.arXiv幻觉矫正 + 命令记忆,Metasploitable 2 端到端成功率 84.29%
A52026-05Pen-Strategist: A Reasoning Framework for Penetration Testing Strategy Formation and Analysis ⭐新补充Yasod Ginige et al.arXivRL 微调策略推理模型,策略推导 +87%、子任务 +47.5%
A62026-05From Intent to Invocation: A Reasoning-First Framework for Natural Language to Penetration Testing Commands ⭐新补充He Kong et al.ICASSP 2026自然语言 → 渗透命令的推理优先框架
A72026-04Hackers or Hallucinators? A Comprehensive Analysis of LLM-Based Automated Penetration TestingJiaren Peng et al.arXivsimon-p-j-r/LLM4Pentest:SoK + 13 框架统一基准实测(超 100 亿 token)
A82026-04Automation-Exploit: A Multi-Agent LLM Framework for Adaptive Offensive Security with Digital Twin-Based Risk-Mitigated Exploitation ⭐新补充Biagio Andreucci, Arcangelo CastiglionearXiv数字孪生隔离调试的"风险缓解型"多 Agent 黑盒攻击链
A92026-03Red-MIRROR: Agentic LLM-based Autonomous Penetration Testing with Reflective Verification and Knowledge-augmented Interaction ⭐新补充Tran Vy Khang et al.arXiv记忆-反思骨干 + RAG,XBOW 基准 86%
A102026-03STRIATUM-CTF: A Protocol-Driven Agentic Framework for General-Purpose CTF Solving ⭐新补充James Hugglestone et al.arXivMCP 协议驱动通用 CTF Agent,真实赛事击败 21 支人类战队夺冠
A112026-03Towards Reliable Local Security Agents: Verifiable Post-Training for Linux Privilege Escalation ⭐新补充Philipp Normann, Andreas Happe et al.arXivSFT+RLVR 后训练 4B 本地模型,Linux 提权 93.3%、成本降 80×
A122026-03PTFusion: LLM-driven context-aware knowledge fusion for web penetration testing ⭐新补充Wang et al.Information Fusion 2026上下文感知知识融合的 Web 渗透策略规划
A132026-03Building adaptative and transparent cyber agents with local language models ⭐新补充Maria RigakiExpert Systems with Applications 2026本地 LLM 构建自适应、可解释攻击 Agent
A142026-02AWE: Adaptive Agents for Dynamic Web Penetration Testing ⭐新补充Akshat Singh Jaswal et al.NDSS 2026stuxlabs/AWE:记忆增强多 Agent 动态 Web 渗透
A152026-02What Makes a Good LLM Agent for Real-world Penetration Testing? ⭐新补充Gelei Deng et al.arXivExcalibur:难度感知规划 + 证据引导攻击树搜索,GOAD 攻陷 4/5 主机
A162026-02LLMs as Hackers: Autonomous Linux Privilege Escalation Attacks ⭐新补充Andreas HappeEmpirical Software Engineering 2026自主 Linux 提权攻击实证
A172026-01PenForge: On-the-Fly Expert Agent Construction for Automated Penetration TestingHuihui Huang et al.ICSE-NIER 2026动态构造领域专家 Agent,CVE-Bench 零日设定 30%(SOTA 3×)
A182026-01WiFiPenTester: Advancing Wireless Ethical Hacking with Governed GenAI ⭐新补充Haitham S. Al-Sinani, Chris J. MitchellarXiv治理型 GenAI 无线渗透(人在回路)
A192026-01CTFAgent: An LLM-powered Agent for CTF Challenge Solving ⭐新补充Yuwen ZouJISA 2026LLM 驱动 CTF 解题 Agent
A202026AI-Driven Penetration Testing for ARM Systems: Experimental Evaluation and Deployment Framework Across Four Paradigms ⭐新补充Matthew RagsdaleIEEE Access 2026ARM 平台四范式 AI 渗透评估
A212025-12PentestEval: Benchmarking LLM-based Penetration Testing with Modular and Stage-Level DesignRuozhao Yang et al.arXiv六阶段模块化渗透评测,346 任务
A222025-12Comparing AI Agents to Cybersecurity Professionals in Real-World Penetration TestingJustin W. Lin et al.(Stanford)ICLR 2026Stanford-Trinity/ARTEMIS:8,000 主机企业网,胜 9/10 人类专家
A232025-12Automated Penetration Testing with LLM Agents and Classical Planning ⭐新补充Lingzhi Wang et al.arXivCHECKMATE:经典规划作外置"结构化大脑",超 Claude Code 20%
A242025-11Controller Makes Pentesting Better: An Improved Multi-Agent Automated Penetration Testing Framework ⭐新补充Geng et al.IEEE TrustCom 2025Controller 跨阶段调度多 Agent 渗透
A252025-11Automated tactics planning for cyber attack and defense based on large language model agents ⭐新补充Yimo RenNeural Networks 2025LLM Agent 攻防战术自动规划
A262025-10AutoPentester: An LLM Agent-based Framework for Automated PentestingYasod Ginige et al.IEEE TrustCom 2025全自动渗透,子任务完成率较 PentestGPT +27%
A272025-09xOffense: An Autonomous Multi-Agent Framework for Penetration Testing with Domain-Adapted Large Language ModelsPhung Duc Luong et al.arXiv微调 Qwen3-32B 多 Agent,子任务 79.17%
A282025-09Guided Reasoning in LLM-Driven Penetration Testing Using Structured Attack TreesKatsuaki Nakano et al.arXivMITRE ATT&CK 攻击树约束推理,查询量大幅下降
A292025-09PentestMCP: LLM and MCP Based Multi-Agent Framework for Automated Penetration Testing ⭐新补充Jiqiang Zhai et al.Research Square(预印本·在审)LLM + MCP + RAG 端到端自动渗透
A302025-08Multi-Agent Penetration Testing AI for the Web (MAPTA)Isaac David, Arthur GervaisarXivarthurgervais/mapta:XBOW 76.9%,10 项发现进入 CVE 评审
A312025-08Chimera: Harnessing Multi-Agent LLMs for Automatic Insider Threat Simulation ⭐新补充NDSS 2026fish98/Chimera:多 Agent 内部威胁自动化模拟
A322025-08CurriculumPT: LLM-Based Multi-Agent Autonomous Penetration Testing with Curriculum-Guided Task SchedulingXingyu Wu et al.Applied Sciences 2025课程式由易到难任务调度 + 经验知识库
A332025-08Pentest-R1: Towards Autonomous Penetration Testing Reasoning Optimized via Two-Stage RLHe Kong et al.arXiv离线+在线两阶段 RL,8B 模型比肩 GPT-4o
A342025-08Automated penetration testing: Formalization and realization ⭐新补充Charilaos SkandylasComputers & Security 2025自动化渗透测试的形式化与实现
A352025-07PenTest2.0: Towards Autonomous Privilege Escalation Using GenAIHaitham S. Al-Sinani, Chris J. MitchellarXivRAG + CoT + 任务树自主提权
A362025-07On the Surprising Efficacy of LLMs for Penetration-TestingAndreas Happe, Jürgen CitoarXivLLM 渗透有效性实证(含恶意采用视角)
A372025-05AutoPentest: Enhancing Vulnerability Management With Autonomous LLM AgentsJulius HenkearXivGPT-4o + LangChain 黑盒渗透
A382025-05RedTeamLLM: an Agentic AI framework for offensive securityBrian Challita, Pierre ParrendarXiv总结-推理-行动循环,含错误恢复
A392025-05RefPentester: A Knowledge-Informed Self-Reflective Penetration Testing Framework Based on Large Language Models ⭐新补充Hanzheng Dai et al.arXivipa-lab/hackingBuddyGPT:七状态机自反思渗透
A402025-04CAI: An Open, Bug Bounty-Ready Cybersecurity AIVíctor Mayoral-Vilches et al.(aliasrobotics)arXivaliasrobotics/cai:首个网络安全自主等级分类
A412025-02Construction and Evaluation of LLM-based agents for Semi-Autonomous penetration testingMasaya Kobayashi et al.arXiv多 LLM 模块半自主渗透
A422025-02RapidPen: Fully Automated IP-to-Shell Penetration Testing with LLM-based AgentsSho Nakatani(SecDevLab)arXivIP→Shell 全自动,单次 $0.3-0.6
A432025-02PenTest++: Elevating Ethical Hacking with AI and AutomationHaitham S. Al-Sinani, Chris J. MitchellarXiv道德黑客 AI 自动化升级
A442025-02Can LLMs Hack Enterprise Networks? Autonomous Assumed Breach Penetration-Testing Active Directory NetworksAndreas Happe, Jürgen CitoACM TOSEM 2025andreashappe/cochise:GOAD 全自主 AD 渗透
A452025-02D-CIPHER: Dynamic Collaborative Intelligent Multi-Agent System with Planner and Heterogeneous Executors for Offensive SecurityMeet Udeshi et al.(NYU)arXivNYU-LLM-CTF/nyuctf_agents:Planner-Executor 架构
A462025-02ARACNE: An LLM-Based Autonomous Shell Pentesting Agent ⭐新补充Tomas Nieponice et al.arXiv多 LLM 自主 Shell 渗透,OTW Bandit 57.58%
A472025-01Incalmo: An Autonomous LLM-assisted System for Red Teaming Multi-Host NetworksBrian Singer et al.(CMU)arXiv多主机红队,MHBench 40 网络 37 成功
A482025-01VulnBot: Autonomous Penetration Testing for A Multi-Agent Collaborative FrameworkHe Kong et al.arXivKHenryAegis/VulnBot:渗透任务图 PTG
A492024-12HackSynth: LLM Agent and Evaluation Framework for Autonomous Penetration TestingLajos Muzsai et al.(ELTE)arXivaielte-research/HackSynth:PicoCTF/OTW 200 题
A502024-12Hacking CTFs with Plain AgentsRustem Turtayev et al.arXiv朴素 Agent 饱和 InterCode-CTF(95%)
A512024-11PentestAgent: Incorporating LLM Agents to Automated Penetration TestingXiangmin Shen et al.AsiaCCS 2025GH05TCREW/pentestagent
A522024-11AutoPT: How Far Are We from the End2End Automated Web Penetration Testing?Benlong Wu et al.arXiv渗透状态机 PSM,任务完成 22%→41%
A532024-09BreachSeek: A Multi-Agent Automated Penetration TesterIbrahim Alshehri et al.arXivLangGraph 多 Agent 渗透
A542024-09Hacking, The Lazy Way: LLM Augmented PentestingDhruva Goyal et al.arXivbugbasesecurity/pentest-copilot:浏览器内 LLM 增强渗透
A552024-09EnIGMA: Interactive Tools Substantially Assist LM Agents in Finding Security VulnerabilitiesTalor Abramovich et al.(NYU)ICML 2025交互式工具(gdb 等)CTF Agent,识别"独白"幻觉现象
A562024-08CIPHER: Cybersecurity Intelligent Penetration-testing Helper for Ethical ResearcherDerry Pratama et al.Sensors 2024300+ writeup 训练的渗透垂域模型 + FARR 基准
A572024-08ChainReactor: Automated Privilege Escalation Chain Discovery via AI Planning ⭐新补充Giulio De Pasquale et al.USENIX Security 2024PDDL 经典规划(非 LLM)自动提权链发现
A582024-07PenHeal: A Two-Stage LLM Framework for Automated Pentesting and Optimal RemediationJunjie Huang, Quanyan ZhuACSW 2024两阶段:渗透 + 最优修复
A592024-07From Sands to Mansions: Towards Automated Cyberattack Emulation with Classical Planning and Large Language ModelsLingzhi Wang et al.ACNS 2026Aurora:CTI 报告→攻击链自动编排(250 报告数据集)
A602024-03AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attacksJiacen Xu et al.(UC Irvine)arXiv后渗透"hands-on-keyboard"自动化攻击
A612023-08PentestGPT: An LLM-empowered Automatic Penetration Testing ToolGelei Deng et al.(NTU)USENIX Security 2024GreyDGL/PentestGPT:奠基之作
A622023-07Getting pwn'd by AI: Penetration Testing with Large Language ModelsAndreas Happe, Jürgen Cito(TU Wien)ESEC/FSE 2023奠基论文,hackingBuddyGPT 前身

B. 漏洞挖掘 / 利用 / 修复

Vulnerability Discovery / Exploitation / Repair

#时间论文作者 / 机构发表渠道关联项目 / 主题
B12026-05FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and ReproductionZe Sheng et al.arXiv构建于 OSS-Fuzz,实战挖出 29 个 0day(2 个获 CVE),AIxCC 数据集 90% 检出
B22026-02FirmAgent: Leveraging Fuzzing to Assist LLM Agents with IoT Firmware Vulnerability Discovery ⭐新补充Jiangan Ji et al.(清华/信息工程大学)NDSS 2026AxiaoJJ/FirmAgent:Fuzzing + 双 LLM Agent 的 IoT 固件漏洞发现与 PoC 生成
B32025-10LLM Agents for Automated Web Vulnerability Reproduction: Are We There Yet?Bin Liu et al.arXiv20 个 Agent × 80 真实 CVE 漏洞复现实证
B42025-09VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing LLM Vulnerability RepairWeizhe Wang et al.arXiv基于 PoC exploit 的修复评测(12 LLM,最高仅 21.7%)
B52025-09All You Need Is A Fuzzing Brain: An LLM-Powered System for Automated Vulnerability Detection and PatchingZe Sheng et al.(o2lab)arXivAIxCC 决赛第 4 名 CRS 论文,28 漏洞(含 6 个 0day),附公开榜单
B62025-09LLM-Driven SAST-Genius: A Hybrid Static Analysis Framework for Comprehensive and Actionable SecurityVaibhav Agrawal, Kiarash AhiarXivSAST + LLM 混合静态分析,误报降约 91%
B72025-09ATLANTIS: AI-driven Threat Localization, Analysis, and Triage Intelligence SystemTaesoo Kim et al.(Team Atlanta)arXivAIxCC 决赛冠军 CRS 论文(符号执行 + 定向 fuzz + LLM)
B82025-08Prompt to Pwn: Automated Exploit Generation for Smart ContractsZeKe Xiao et al.ACISP 2026ReX 框架:LLM + Foundry 端到端智能合约 Exploit 生成
B92025-07LLMxCPG: Context-Aware Vulnerability Detection Through Code Property Graph-Guided Large Language ModelsAhmed Lekssays et al.USENIX Security 2025CPG 切片 + LLM,代码量降 67-91%、F1 +15-40%
B102025-07MalCodeAI: Autonomous Vulnerability Detection and Remediation via Language Agnostic Code ReasoningJugal Gajjar et al.IEEE IRI 2025跨 14 语言漏洞检测 + 修复(LoRA 微调 Qwen2.5-Coder-3B)
B112025-07PwnGPT: Automatic Exploit Generation Based on Large Language ModelsWanzong Peng et al.ACL 2025CTF 二进制 pwn 自动 Exploit 生成(分析-生成-验证三模块)
B122025-05VADER: A Human-Evaluated Benchmark for Vulnerability Assessment, Detection, Explanation, and RemediationEthan TS. Liu et al.arXiv漏洞处理四维人评基准(174 真实漏洞)
B132025-04CVE-Bench (NAACL): Benchmarking LLM-based Software Engineering Agent's Ability to Repair Real-World CVE VulnerabilitiesPeiran Wang et al.NAACL 2025509 个真实 CVE 修复评测(注:与 ICML 版同名不同任务)
B142025-03CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World VulnerabilitiesYuxuan Zhu et al.(UIUC Kang Lab)ICML 2025uiuc-kang-lab/cve-bench:真实 Web CVE 利用评测
B152025-03CASTLE: Benchmarking Dataset for Static Code Analyzers and LLMs towards CWE DetectionRichard A. Dubniczky et al.arXiv25 类 CWE × 250 微基准程序
B162024-10HonestCyberEval: An AI Cyber Risk Benchmark for Automated Software ExploitationDan Ristea, Vasilios MavroudisarXiv自动化利用能力风险基准(o1-preview 92.85%)
B172024-07eyeballvul: a future-proof benchmark for vulnerability detection in the wildTimothee ChauvinarXiv每周更新、防训练泄漏的漏洞检测基准
B182024-06Teams of LLM Agents can Exploit Zero-Day VulnerabilitiesYuxuan Zhu et al.(UIUC)arXivHPTSA:规划 Agent + 子 Agent 协作 0day 利用(+4.3×)
B192024-04LLM Agents can Autonomously Exploit One-day VulnerabilitiesRichard Fang et al.(UIUC)arXivGPT-4 给定 CVE 描述利用 87%,无描述仅 7%
B202024-02LLM Agents can Autonomously Hack WebsitesRichard Fang et al.(UIUC)arXiv早期工作:GPT-4 自主盲注/SQLi 攻击网站

C. 评测基准 & 训练方法 & 综述 & 奠基

Evaluation Benchmarks, Training Methods, Surveys & Foundational

#时间论文作者 / 机构发表渠道关联项目 / 主题
C12026-08RangeFactory: Scalable Construction of Multi-Hop Cyber Ranges ⭐新补充Hanlin Jiang et al.(北大)arXiv多跳靶场自动编排,RangeBench 1,148 实例 × 287 攻击链
C22026-08CyberForge: Verified Vulnerability Injection at Repository Level for Cybersecurity Agent Training ⭐新补充Amine Lbath et al.(NIST/UMD)arXivCyb3rForge/CyberForge:仓库级漏洞注入合成训练数据(1,034 实例)
C32026-07Baselines Before Architecture: Evaluating Coding Agents for Autonomous Penetration Testing ⭐新补充Ananda Dhakal et al.arXiv同模型 plain-agent 基线对照,质疑安全 harness 增益归因
C42026-06AgentCyberRange: Benchmarking Frontier AI Systems in Realistic Cyber Ranges ⭐新补充Fengyu Liu et al.(复旦)arXivAgentCyberRange:110 漏洞 × 8 企业级靶场,GPT-5.5+Codex 最优
C52026-06CyberGym-E2E: Scalable Real-World Benchmark for AI Agents' End-to-End Cybersecurity Capabilities ⭐新补充Tianneng Shi et al.(UC Berkeley)ICML 2026920 真实漏洞端到端(发现→PoC→补丁)
C62026-05CTFusion: A CTF-based Benchmark for LLM Agent EvaluationDongjun Lee, Ga-eun Bae, Insu YunICML 2026 AIWILD Workshop基于 Live CTF 的流式评测,抗数据污染/作弊
C72026-05ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks? ⭐新补充Zhun Wang et al.(UC Berkeley)arXiv898 实例"漏洞→利用"基准(用户态/V8/内核),Claude Mythos Preview 157 题
C82026-05How Reliable Are AI Attackers Against a Fixed Vulnerable Target? A 400-Run Empirical Study of LLM Penetration Testing Consistency ⭐新补充Galip Tolga ErdemarXiv4 模型 × 100 次同目标攻击一致性实证
C92026-04Autonomous LLM Agents & CTFs: A Second Look ⭐新补充Youness Bouchari et al.EuroS&P 2026 Workshop复检"接近人类"论断:claude-code 通用 Agent 即强基线
C102026-04Towards Optimal Agentic Architectures for Offensive Security Tasks ⭐新补充Isaac David, Arthur GervaisarXiv600 次运行的架构族消融(白盒 vs 黑盒、Web vs 二进制)
C112026-03Measuring AI Agents' Progress on Multi-Step Cyber Attack Scenarios ⭐新补充Linus Folkerts et al.arXiv32 步企业网 + 7 步工控攻击链,性能随算力对数线性扩展
C122025-11From Capabilities to Performance: Evaluating Key Functional Properties of LLM Architectures in Penetration Testing ⭐新补充Lanxiao Huang et al.EMNLP 2025记忆/通信/规划/监控五类功能增强对渗透成功率的影响
C132025-11Measuring and Augmenting Large Language Models for Solving Capture-the-Flag Challenges ⭐新补充Zimo Ji et al.ACM CCS 2025CTF 求解能力测量与增强
C142025-10PACEbench: A Framework for Evaluating Practical AI Cyber-Exploitation CapabilitiesZicheng Liu et al.ICLR 2026实战 AI 网络利用能力评测(单点/混合/链式/带防御)
C152025-10HackWorld: Evaluating Computer-Use Agents on Exploiting Web Application Vulnerabilities ⭐新补充Xiaoxue Ren et al.ICLR 2026GUI-Agent/HackWorld:CUA 视觉交互漏洞利用评测
C162025-08Towards Effective Offensive Security LLM Agents: Hyperparameter Tuning, LLM as a Judge, and a Lightweight CTF BenchmarkMinghao Shao et al.(NYU)AAAI 2026CTFTiny + CTFJudge + CCI 部分正确性指标
C172025-08Training Language Model Agents to Find Vulnerabilities with CTF-Dojo ⭐新补充Terry Yue Zhuo et al.(Amazon)arXivamazon-science/CTF-Dojo:658 个容器化 CTF 可执行训练环境
C182025-07Cyber-Zero: Training Cybersecurity Agents without RuntimeTerry Yue Zhuo et al.(Amazon AGI)ICLR 2026amazon-science/Cyber-Zero:无运行时轨迹合成训练
C192025-06CyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at ScaleZhun Wang et al.(UC Berkeley Sunblaze)ICLR 2026sunblaze-ucb/cybergym:1,507 真实漏洞,衍生 34 个 0day
C202025-06SEC-bench: Automated Benchmarking of LLM Agents on Real-World Software Security TasksHwiwon Lee et al.NeurIPS 2025SEC-bench/SEC-bench:PoC 生成 + 补丁全自动评测
C212025-05Forewarned is Forearmed: A Survey on Large Language Model-based Agents in Autonomous Cyberattacks ⭐新补充Minrui Xu et al.arXivLLM Agent 自主网络攻击综述("网络威胁通胀")
C222025-04Benchmarking Practices in LLM-driven Offensive Security: Testbeds, Metrics, and Experiment DesignAndreas Happe, Jürgen CitoarXiv19 篇原型评测方法学批判
C232025A Unified Modeling Framework for Automated Penetration Testing ⭐新补充Computers & Security 2025AutoPT 统一建模框架
C242025-02OCCULT: Evaluating Large Language Models for Offensive Cyber Operation CapabilitiesMichael Kouremetis et al.arXiv进攻性网络作战能力评测(TACTL/CyberLayer)
C252024-10AutoPenBench: Benchmarking Generative Agents for Penetration TestingLuca Gioacchini et al.(Politecnico di Torino)EMNLP Industry 2025lucagioacchini/auto-pen-bench:33 任务
C262024-10Catastrophic Cyber Capabilities Benchmark (3CB): Robustly Evaluating LLM Agent Cyber Offense Capabilities ⭐新补充Andrey Anurin et al.(Apart Research)arXivapartresearch/3cb:进攻能力稳健评测
C272024-10Towards Automated Penetration Testing: Introducing LLM Benchmark, Analysis, and ImprovementsIsamu Isozaki et al.ACM UMAP 2025渗透 LLM 基准 + PentestGPT 消融改进
C282024-08Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language ModelsAndy K. Zhang et al.(Stanford CRFM)ICLR 2025 Oralandyzorigin/cybench:40 道专业 CTF
C292024-07SoK: A Comparison of Autonomous Penetration Testing Agents ⭐新补充Raphael SimonARES 2024AutoPT Agent 系统化对比 SoK
C302024-06NYU CTF Bench: A Scalable Open-Source Benchmark for Evaluating LLMs in Offensive SecurityMinghao Shao et al.(NYU)NeurIPS 2024 D&BNYU-LLM-CTF/NYU_CTF_Bench:CSAW 200 题
C312024-05Got Root? A Linux Priv-Esc Benchmark ⭐新补充Andreas Happe, Jürgen CitoarXivLinux 提权能力标准化基准
C322024-02An Empirical Evaluation of LLMs for Solving Offensive Security Challenges ⭐新补充Minghao Shao et al.(NYU)NeurIPS 2024NickNameInvalid/LLM_CTF:早期全自动 CTF 工作流实证,超人类平均
C332024自动化渗透测试技术研究综述 ⭐新补充软件学报 2024中文视角的自动化渗透测试技术综述
C342023-06InterCode: Standardizing and Benchmarking Interactive Coding with Execution FeedbackJohn Yang et al.(Princeton NLP)NeurIPS 2023 D&Bprinceton-nlp/intercode:交互式执行反馈奠基基准

注:会议/期刊年份为论文实际收录会议届期;arXiv 时间为 v1 提交月份。来源致谢:tmylla/Awesome-LLM4CybersecurityEvanThomasLuke/Awesome-AI-Hacking-Agentssimon-p-j-r/LLM4Pentest(2026-09-11 逐篇交叉核对)。本轮移除的 4 篇"攻击 AI 系统 / LLM 自身安全"类论文:UDora(劫持 LLM Agent 推理的红队框架)、AgentPoison(LLM Agent 记忆投毒后门)、CyberSecEval 1/3(LLM 安全编码与风险评测,其基准本体仍保留于 Benchmark 章节)。 Note: conference years refer to actual proceedings; arXiv dates are v1. Credits to the awesome lists above. Four "attacking-AI / LLM-safety" papers removed this round: UDora, AgentPoison, and CyberSecEval 1/3 (the CyberSecEval benchmark family itself remains in the Benchmark section).


🧪 Agent 能力评测 Benchmark

Agent Capability Benchmarks (sorted by stars, desc)

用于评估渗透测试 / 网络安全 / CTF / 红队 Agent 能力的开源 benchmark。 Open-source benchmarks for evaluating pentest / cybersecurity / CTF / red-team Agent capabilities.

#Benchmark仓库Stars时间任务规模评测重点关联论文
1TSecBench ⭐新补充tsecbench.zc.tencent.com2026-07从腾讯云黑客松诞生,采用闭卷模式,结果更准确🔥 腾讯安全云鼎实验室出品,智能攻防 AI Agent 统一跑分基准,覆盖 Web/二进制漏洞挖掘、漏洞利用、多阶段渗透、云攻击、对抗规避 6 大维度,支持 3 种 Agent 接入方式
2CyberSecEval (1/2/3/4)meta-llama/PurpleLlama4.4k2023-12跨多类任务(不安全代码 / Prompt Injection / 攻击辅助 / AutoPatchBench 等)Meta 出品,覆盖 LLM "防/攻"两端arXiv:2312.04724 / arXiv:2408.01605
3CyberGymsunblaze-ucb/cybergym7842025-06真实世界漏洞分析任务(240GB 数据集)UC Berkeley 出品,强调 real-world,配 4 个示例 Agent(Star 一个多月翻倍,375→784)arXiv:2506.02548(ICLR 2026)
4XBOW Validation Benchmarksxbow-engineering/validation-benchmarks6942025-06104 道 Web 漏洞挑战(Jeopardy CTF)XBOW(首个登顶 HackerOne 的 AI)出品;⚠️ 已被主流模型刷至约 100% 饱和,仓库转为历史保留XBOW Engineering Blog
5Cybenchandyzorigin/cybench3172024-0840 道专业级 CTF 任务(17 个子任务)Stanford CRFM,支持 Unguided / Subtask 双模式arXiv:2408.08926(ICLR 2025)
6InterCode-CTFprinceton-nlp/intercode2552023-06100 道 picoCTF 题Bash/SQL/Python/CTF 交互式代码 Agent 评测arXiv:2306.14898(NeurIPS 2023 D&B)
7NYU CTF BenchNYU-LLM-CTF/NYU_CTF_Bench1712024-06200 题正式 + 55 题开发集,6 大类CSAW CTF 历年题目 + Docker 化部署arXiv:2406.05590(NeurIPS 2024 D&B)
8AutoPenBenchlucagioacchini/auto-pen-bench972024-1033 个任务(22 In-Vitro + 11 真实 CVE)生成式 Agent 渗透测试通用评测arXiv:2410.03225(EMNLP Industry 2025)
9inspect_cyberUKGovernmentBEIS/inspect_cyber382025-06通用扩展(任务可插拔)UK AI Security Institute 官方 Agentic Cyber 评估扩展
10CVE-Benchuiuc-kang-lab/cve-bench2025-0340 个 critical 严重程度 CVE首个基于真实 CVE 的 Web 漏洞利用 Agent 评测arXiv:2503.17332(ICML 2025)
11BountyBenchbountybench/bountybench2025-0525 个真实 GitHub 项目 + Bug Bounty用美元金额量化攻防影响力Stanford CRFM Blog(2025-05)
12SEC-benchSEC-bench/SEC-bench2025-06200 个 C/C++ 真实 CVE,PoC + 补丁双任务首个全自动化的真实安全工程评测arXiv:2506.11791(NeurIPS 2025)
13CTFTinyNYU-LLM-CTF/CTFTiny2025-0850 题轻量 CTF 子集配套 CTFJudge(LLM-as-a-Judge),降低复现成本arXiv:2508.05674(AAAI 2026)

备注:标 的 Stars 表示数据缺失或仓库较新。许多 Agent 项目(PentestGPT、cochise、xOffense、Cyber-Zero、deadend-cli 等)会在自己 README 中报告在 NYU CTF Bench / Cybench / AutoPenBench / XBOW 等 Benchmark 上的得分。 Note: "—" means missing data or a new repo. Many agent projects report scores against these benchmarks in their own READMEs.

Benchmark 选型小贴士|Selection Cheatsheet

评测目标 / Goal推荐 Benchmark / Recommendation
通用 CTF 能力 / General CTFNYU CTF Bench(200 题)、Cybench(40 题精选)、InterCode-CTF(轻量起步)
真实漏洞利用 / Real-world ExploitXBOW(104 Web)、CyberGym(真实漏洞 240GB)、AutoPenBench(CVE 任务)、CVE-Bench(Web)、SEC-bench(C/C++ CVE)、TSecBench(云鼎黑客松靶场)
LLM 安全 / 红队基础 / LLM Safety & Red TeamCyberSecEval(Meta 全家桶)
经济影响量化 / Economic ImpactBountyBench
政府级评估扩展 / Government-gradeinspect_cyber(UK AISI)
快速回归 / Lightweight RegressionCTFTiny

💼 商业化解决方案

Commercial Solutions

本节盘点全球范围内主流的 AI / Agentic 智能渗透测试 / 自主攻击安全 商业化产品。分为「国外」与「国内」两个子表。国外部分经全网核查(融资记录、公司估值、官网定价、并购/退出事件、权威媒体报道)后,按公司/产品的融资规模、估值与行业影响力精选 Top 20——原列表中缺乏可查融资证据、无第三方媒体报道、疑似早期占位官网的长尾条目已剔除(如 KinoSec、Casco、PentX、Revelion、qriousec、Penligent、bugbunny ai、Sec1、Zentinel、Shinobi Security、AutoVAPT.ai、RedVeil.ai、PAIStrike、Novee、AISLE、Pensar、Origin/Prelude、Hound、PentestGPT Pro 等)。国外首位为 Anthropic 的 Mythos(本身为前沿模型而非纯渗透产品,但其安全能力已构成该赛道的现象级存在,故保留)。 This section enumerates representative commercial AI / Agentic penetration testing & autonomous offensive security products worldwide. The international table has been fact-checked against funding records, valuations, official pricing pages, M&A/exit events, and credible media coverage, then narrowed to the Top 20 by funding scale, valuation, and market influence — long-tail entries lacking verifiable funding or press coverage were removed.

🌍 国外厂商 Top 20(按融资规模 / 估值 / 影响力排序)

International Vendors — Top 20 (ranked by funding, valuation & market influence)

#公司产品官网融资 / 估值 / 影响力证据产品定位与特色
1Anthropic ⭐新补充Claude Mythosanthropic.com/claude/mythos万亿美元级估值母公司,Project Glasswing 覆盖 150+ 关键基础设施机构🔥 2026 年最受关注的 AI 安全模型,无需专项安全训练即能发现数千 0day 并自主编写完整利用链,被美国财政部与美联储联合推荐
2PenteraPentera AVPpentera.io累计融资 $250-314M,估值 $1B,ARR 突破 $100M(2026-01),1200+ 企业客户AI 驱动的暴露验证平台(Exposure Validation),覆盖身份/终端/网络/云,持续真实攻击模拟(含 LockBit/BlackCat 等勒索家族)
3XBOWXBOWxbow.com2026-03 完成 $120M Series C(DFJ Growth/Northzone 领投),估值超 $1B,成立仅 26 个月即成独角兽首个登顶 HackerOne 排行榜的 AI,自主攻击性安全平台,真实 exploit 独立验证每一发现
4Aikido SecurityAikido AI Pentestaikido.dev/attack/aipentest2026-01 完成 $60M Series B(DST Global 领投),估值 $1B,欧洲史上最快独角兽网络安全公司All-in-one 应用安全平台,AI Pentest 为其模块之一,代码/云/应用统一安全平台
5SPLXSPLX (含 agentic-radar)splx.ai2025-11 被纳斯达克上市公司 Zscaler(NASDAQ: ZS)收购,商业化验证等级最高的退出事件LLM Agent 工作流安全扫描 + 红队,开源 agentic-radar
6Horizon3.aiNodeZero®horizon3.ai累计融资 $183.5M,估值 $660-750M(NEA 领投 $100M Series D)自称 "World's Best AI Hacker",无 Agent 部署,已执行 24 万+ 次自主渗透测试,客户含 NSA 与 4 家财富 10 强
7HadrianHadrianhadrian.io荷兰/伦敦网络安全公司,多轮 Growth 融资(Notion Capital 等机构),Gartner Peer Insights 常客持续攻击面管理 + Agentic AI 自主渗透,覆盖域名/子域名/证书/IP 全资产测绘
8RunSybilSybilrunsybil.com2026-03 完成 $40M 融资(Khosla Ventures 领投),创始人为 OpenAI 首位安全员工自主 Web 应用渗透 AI Agent,强调与人工 pentester 协作
9Strix (Usestrix)Strixusestrix.com开源版本 GitHub 60k+ Stars(社区影响力最高,一个多月激增 19k),商业化融资已启动开源 + 商业双栈 AI 黑客,动态运行代码找漏洞并用真实 PoC 验证
10Terra SecurityTerra Portalterra.security2025-09 完成 $30M Series A(Felicis Ventures 领投),累计融资 $38M+首个 Agentic AI + Human-in-the-Loop 持续渗透测试平台
11CalypsoAICalypsocalypsoai.com累计融资 $40.8M,估值 $145M,2018 年成立的老牌厂商,Gartner Cool Vendor企业级 GenAI 安全 + 红队评估
12CorridorCorridorcorridor.dev2026-03 完成 $25M Series A,创始人 Jack Cable 为美国前 CISA 安全工程师AI 生成代码实时安全护栏,源头级漏洞检测
13Veria LabsVeria CTF Agentverialabs.com2026-02 完成 $3.2M 种子轮,出自 CTFtime 美国第一战队,BSidesSF 2026 CTF 52/52 全胜夺冠自主 CTF 求解 Agent,多模型并行"蜂群"架构
14DreadnodeDreadnodedreadnode.io累计融资 $14M,估值 $60M,前 Microsoft AI Red Team 核心成员创办攻击性 ML 研究平台,聚焦 AI 系统评测与网络靶场
15MindgardMindgardmindgard.ai累计融资 $11.9M,Lancaster University 学术孵化,2026 Gartner 新兴技术报告收录专注 AI / LLM 红队(测 AI 模型本身),含 Mindgard Lite 自助平台
16Hex SecurityHexhex.coY Combinator 2026 冬季批入选企业,已获种子轮融资AI Agent 驱动的持续自主渗透测试
17Harmony IntelligenceHarmonyharmonyintelligence.com2025-03 完成 $3M 种子轮(Airtree 领投,30+ 投资人参与)AI 红队 + 安全评估,替代传统年度人工渗透
18TheoriXint / Xint Codexint.ioDARPA AIxCC 2025 决赛季军(RoboDuck),公开对比复现并超越 Anthropic Mythos 发现数一线攻防专家创办的老牌安全公司,AI 代码审计与渗透产品
19MindFortMindFortmindfort.ai2026-04 完成 $3M+ 种子轮(Y Combinator/468 Capital/CRV 参投),创始人为 OpenAI/Anthropic 前员工自主红队 AI Agent,长期在后台运行守护组织安全
20HacktronHacktron AIhacktron.ai累计融资 $3.5M,估值 $9.3M,创始团队为精英 CTF 竞技选手端到端 AI 渗透 / 漏洞挖掘平台,每次代码变更即触发安全测试

🇨🇳 国内厂商

Domestic Vendors (China)

#公司产品官网产品定位与特色
1绿盟科技绿盟智能渗透系统 AI-PTSAI-PTS 产品页基于"风云卫大模型 SecLLM + 多智能体(MAS)",2025-08 正式发布。聚焦 Web 应用安全测试与自动化渗透,含 8.8 万+ 漏洞知识图谱、8600+ POC 库
2京东云 ⭐新补充AIPTS AI 智能渗透测试服务京东云 AIPTS2026-06 正式上线,"One For All"理念服务多安全角色;自然语言发起任务 + AI 自动编排(资产探测/接口验证/漏洞分析)+ 攻击路径动态推进 + 一键生成攻击链证据报告,隶属京东云全栈大模型安全产品体系
3360 ⭐新补充"破阵子" 渗透测试智能体360.cn专属安全记忆机制(企业资产/权限/历史风险持续沉淀)+ 双引擎架构(批量常态化巡检 + 业务逻辑深度风险挖掘)+ 全流程闭环(发现→核验→整改复测);已具备 AI 应用新型风险检测(提示词注入/智能体越权),实战覆盖 132 家关基单位,发现 312 个有效漏洞(含 46 个 AI 新型漏洞),零误报
4阿里云 ⭐新补充Agentic BAS 智能渗透验证阿里云开发者社区2026-07-16 开放邀测,千问大模型驱动"三段式调度多 Agent 协同架构"(侦察/渗透/验证/报告 Agent + 中心调度),可还原完整攻击链(非孤立漏洞点),覆盖 AI 生成代码 / Agent 应用新型风险(Prompt 注入、工具滥用、RAG 投毒),支持每周例行自动验证与合规留痕
5万径安全(Yaklang)万径千机 / 小智 智能渗透机器人megavector.cn国内首款融合知识图谱与大模型的智能渗透机器人,"AI+YAK" 双引擎(YAK 为自研网络安全语言)
6长亭科技无锋chaitin.com--
7斗象科技(漏洞盒子)蛙池AIdigpool.cn全球首款"原生 AI"漏洞挖掘工具 / 白帽工作台。对话式挖洞,AI 自主拆解渗透意图,内置 SQLi/XSS/RCE/上传等漏洞检测专家技能矩阵
8奇安信AI 加特林 自动化渗透测试系统qianxin.com / AI"自动化漏洞攻击的火力平台",能在数分钟内将漏洞公告转为可执行的渗透链;与 QAX-GPT 安全大模型联动
9安恒信息AI 渗透测试智能体(基于恒脑 3.0)dbappsecurity.com.cn国内首个安全垂域大模型"恒脑"驱动的渗透 Agent,三大能力:自动化风险发现 + 任务规划、智能调度渗透工具、深度解析被动流量
10悬镜安全灵脉 PTE AI 自动化渗透测试平台pte.xmirror.cn结合漏扫工具与专家渗透优势,将专家能力训练为 AI,半自动化 / 自动化检测业务逻辑漏洞

🎯 选型对照(按典型场景)

Pick by Scenario

场景 / Scenario推荐产品(国外)推荐产品(国内)
Web App / API 自主渗透XBOW、Pentera、Strix、Mythos绿盟 AI-PTS、京东云 AIPTS、斗象蛙池AI
生产环境安全验证Horizon3.ai NodeZero、Pentera绿盟 AI-PTS、阿里云 Agentic BAS
漏洞赏金 / Bug HuntingXBOW、Strix、Veria Labs斗象蛙池AI、长亭 chainreactors
持续攻击面 + 攻击模拟Hadrian、Pentera、Terra Security360 破阵子、华云安灵刃
业务逻辑 / 复杂渗透XBOW、RunSybil、Mythos悬镜灵脉 PTE、万径千机 / 小智
火力打击型自动化漏洞利用Horizon3.ai NodeZero、Mythos奇安信 AI 加特林
LLM / Agent 红队(测 AI 本身)Mindgard、Dreadnode、SPLX(已被 Zscaler 收购)
AI 生成代码 / Agent 新型风险Corridor、Harmony Intelligence阿里云 Agentic BAS、360 破阵子
CTF / 竞赛型自主求解Veria Labs、Hacktron

📚 Awesome List 资源汇编

Awesome List Collection

本节汇总专门收录 Offensive AI / AI 安全相关精选资源的 Awesome List 仓库,本文档大量内容来自这几个 list 的交叉合并。 This section gathers Awesome List–style repositories. This document is largely derived from cross-merging the following lists.

#仓库Stars维护者内容定位
1fr0gger/Awesome-GPT-Agents ⭐新补充6.6kfr0gger网络安全 GPT Agents 全景清单,攻防双方向覆盖
2jiep/offensive-ai-compilation1.4kjiep攻击性 AI 综合资源(对抗 ML / 渗透 / 钓鱼 / 生成式 AI 滥用)
3ottosulin/awesome-ai-security1.4kottosulin通用 AI 安全资源集合(攻防兼顾)
4TalEliyahu/Awesome-AI-Security861TalEliyahu偏 AI 系统防御侧的资源、研究与工具
5EvanThomasLuke/Awesome-AI-Hacking-Agents653EvanThomasLukeAI Hacking Agent 全景 + AIxCC 决赛队伍 + 商业产品 + 论文(一个多月 Star 从 258 涨至 653)
6raphabot/awesome-cybersecurity-agentic-ai ⭐新补充578raphabot网络安全 Agentic AI 精选资源(MCP / 工具 / 框架 / 论文 / 社区)
7Eyadkelleh/awesome-skills-security ⭐新补充374Eyadkelleh基于 SecLists 精选打包的 Agent Skill 合集(Fuzzing/密码字典/Payload/Webshell/LLM 测试等),60+ Agent 兼容
8simon-p-j-r/LLM4Pentest352simon-p-j-r基于《Hackers or Hallucinators?》论文整理的 LLM 自动化渗透测试资源合集:105 篇学术论文 + 开源工具 / 博客 / 评测基准(自项目主表迁入)
9gmh5225/awesome-ai-security44gmh5225面向渗透测试者 / 漏洞猎人 / 安全研究的 AI 安全精选

⚠️ 变动说明(2026-09-02):原收录的 ox01024/awesome-offensive-security-ai 已被作者删除(404),本轮移除;EvanThomasLuke/Awesome-AI-Hacking-Agents 重新排序时反超 raphabot 列表。2026-09-07:simon-p-j-r/LLM4Pentest(352 Stars)实为资源合集而非 Agent 项目,自项目主表迁入本节。 Changelog note: ox01024/awesome-offensive-security-ai was deleted by its owner (404) and removed. 2026-09-07: simon-p-j-r/LLM4Pentest (352 stars) is a curated resource collection rather than an agent project, moved here from the main project table.


📊 统计概览

Statistics Overview

  • 项目总数 / Total projects:53(项目主表 46 个 + AIxCC CRS 系统 7 个;2026-09-07 移除 9 个偏离主线的项目,LLM4Pentest 迁入 Awesome List)
  • 进攻型 / 安全专用模型 / Models:11 个(A. 无对齐进攻型 6 个:Qwythos、WhiteRabbitNeo/DeepHat、Lily-Cybersecurity、BaronLLM、CyberStrike-OffSec-35B、BugTraceAI-CORE-Ultra-27B;B. 安全专用 5 个:VulnLLM-R、Foundation-Sec-8B-Reasoning、CyberSecQwen-4B、Meta-SecAlign、Titus-CybersecurityLLM)
  • 进攻型 AI Skill / Skills:3 个,均为 Star ≥ 100 的纯 Skill 项目(Anthropic-Cybersecurity-Skills、ctf-skills、awesome-skills-security)
  • 进攻型 AI MCP Server / MCP Servers:7 个,均为 Star ≥ 100 的安全工具集合类 MCP(PortSwigger mcp-server、MCP-Kali-Server、mcp-security-hub、MetasploitMCP、BloodHound-MCP-AI、mcp-shodan、pentest-mcp)
  • 收录论文 / Papers116 篇(A. 渗透 & 红队 62 篇 / B. 漏洞挖掘 20 篇 / C. 评测 & 训练 34 篇;覆盖 2023-06 → 2026-08;2026-09-11 与 LLM4Pentest 交叉核对:勘误多项 + 补充 47 篇 + 移除 4 篇 LLM 自身安全类)
  • 收录 Benchmark / Benchmarks:13 个(覆盖 2023-06 → 2026-07)
  • 商业产品 / Commercial products:32 个(国外 Top 20,经融资/估值/媒体报道核查精选 + 国内 12)
  • Awesome List:9 个(2026-09-07 新增 LLM4Pentest 资源合集;此前 ox01024/awesome-offensive-security-ai 已被作者删除并移除)
  • 主要语言 / Languages:Python ≈ 70%,TypeScript ≈ 12%,Go ≈ 8%,其他 ≈ 10%
  • 领域趋势 / Trends
    • 2023:方向探索(Happe & Cito、PentestGPT、InterCode-CTF)
    • 2024:基础工作落地 + 评测基准建立(Cybench、NYU CTF Bench、AutoPenBench、EnIGMA、Fang 三部曲、PenHeal、AutoPT)
    • 2025:多 Agent 协作 + 训练方法 + 自主 AD 渗透 + 真实 CVE 评测 + AIxCC 决赛 + RL 渗透 + 实证研究(VulnBot、cochise、D-CIPHER、Cyber-Zero、xOffense、CVE-Bench、SEC-bench、CyberGym、ATLANTIS、Buttercup、RapidPen、Pentest-R1、OCCULT、PACEbench)
    • 2026 起:商业化加速(XBOW、Pentera、Horizon3.ai、Hacktron、MindFort、Anthropic Mythos 等纷纷涌现)+ 持续基准化(PentestEval、PenForge、CTFusion、HackWorld、ExploitGym、AgentCyberRange)+ 靶场与训练数据基建(RangeFactory、CyberForge、CTF-Dojo)+ 攻防闭环与实战化(ZERO-APT 攻防裁判闭环、FuzzingBrain V2 实战挖 0day、Agents4Pentest 综述成型)

🕐 最后更新时间 / Last updated:2026-09-11 (UTC+8)


⚠️ 免责声明

Disclaimer

本文档汇总的所有项目、论文与 Benchmark 仅供学习研究、企业内部安全防护与授权渗透测试使用。 在任何情况下,使用者均须严格遵守所在国家和地区的法律法规以及目标组织的授权范围;严禁将其用于未经授权的攻击、入侵、破坏或其他任何违法活动。任何因滥用本文档收录内容而引发的法律责任、经济损失或安全后果,均由使用者自行承担,与本文档作者及所列项目维护者无关。

All projects, papers, and benchmarks compiled in this document are intended solely for learning, internal enterprise security hardening, and authorized penetration testing. Users must strictly comply with the laws and regulations of their jurisdiction as well as the authorization scope granted by the target organization. Any unauthorized attack, intrusion, sabotage, or other illegal activities are strictly prohibited. Any legal liability, financial loss, or security consequence resulting from misuse of the contents herein shall be borne entirely by the user, and is unrelated to the authors of this document or the maintainers of the listed projects.

ai-benchmarks
ai-hacking
ai-pentesting
ai-red-teaming
ai-security
autonomous-penetration
awesome-list
ctf
cybersecurity
hacking-agents
hacking-tool
intelligent-penetration
llm-security
offensive-ai
offensive-security
pentest
pentest-tool
redteam
security-tools

Contributors

Yeti-791

25 commits

Yeti-791/Awesome-Offensive-AI-Agentic-Landscape

This document curates open-source projects, academic papers, capability benchmarks, and commercial solutions (international & China) in AI penetration testing, LLM red teaming, autonomous offensive agents, and vulnerability discovery—aimed at helping researchers, security engineers, and enterprise decision-makers quickly form a holistic view.

306

25 commits

updated Sep 10, 2026

See the code

README

Offensive AI Agentic 全景:项目 / 模型 / Skill / MCP / 论文 / Benchmark / 商业产品 一览

Offensive AI Agents Landscape: Projects, Models, Skills, MCP Servers, Papers, Benchmarks & Commercial Solutions 599999755-793799dc-53e7-4fee-8959-654fbc09c902

🛠️ Projects🧬 Models🧩 Skills🔌 MCP📑 Papers🧪 Benchmarks📚 Awesome Lists💼 Commercial
46113711613932
渗透 / 红队 / CTF Agent进攻 6 + 安全专用 5Claude/Agent SkillBurp/Metasploit/工具链2023 → 20262023 → 2026资源索引国外 Top 20 + 国内 12

本文档以进攻型 AI为主线,系统整理了 AI 渗透测试 / 自主红队 Agent 领域的开源项目、进攻型 & 安全专用开源模型进攻型 AI Skill 与 MCP Server、学术论文、能力评测 Benchmark 与国内外商业化解决方案,帮助研究者、安全工程师与企业安全决策者快速建立领域全景认知。注意:本文档聚焦"用 AI 做攻击",而非"攻击 AI 系统"(LLM 自身安全性如 prompt injection / jailbreak 等不在主线范围,仅少量关联项目涉及)。

This document focuses on offensive AI — curating open-source projects, offensive & security-specialized open-weight models, offensive AI Skills & MCP Servers, academic papers, capability benchmarks, and commercial solutions (international & China) in AI-driven penetration testing & autonomous red-team agents. It helps researchers, security engineers, and enterprise decision-makers quickly form a holistic view of the domain. Note: the primary lens is "using AI to attack", not "attacking AI systems" (LLM security topics such as prompt injection / jailbreaking are out of scope for the main thread, though a few related projects may appear incidentally).

数据采集时点:2026-09-11(论文章节全量核验:修复错链与元数据、移除 4 篇 LLM 自身安全类论文、经 LLM4Pentest 交叉核对补充 47 篇,73→116)| Star 数 ≥ 1000 统一以 k 为单位(保留一位小数)。


📋 开源Agent列表

Open-Source Agent List

按 Star 数降序排列,收录 Star ≥ 90 的开源 AI 渗透测试 / 红队 Agent 及进攻型安全项目。 ⭐新补充 = 本轮新增(2026-07-14/15) Sorted by stars (desc), projects with ≥ 90 stars — covering AI penetration testing, red-team agents, and offensive security tools. ⭐ = newly added this round (2026-07-14/15).

#项目Stars语言类型简介
1usestrix/strix60.1kPython渗透 Agent开源 AI 黑客,发现并修复应用漏洞(🚀 一个多月 Star 从 41k 飙升至 60k,反超 shannon 登顶)
2KeygraphHQ/shannon47.6kTypeScript渗透 Agent面向 Web 应用和 API 的自主白盒 AI 渗透测试工具
3vxcontrol/pentagi22.2kGo渗透 Agent全自主 AI 代理系统,执行复杂渗透测试任务
4GreyDGL/PentestGPT15.2kPython渗透 AgentLLM 驱动的自动化渗透测试代理框架(早期标杆)
50x4m4/hexstrike-ai11.5kPythonMCP / 渗透MCP 服务器,让 AI Agent 自主运行 150+ 安全工具
6aliasrobotics/cai9.8kPython安全 AI 框架Cybersecurity AI(CAI)安全框架(已于 2026-08-28 归档,曾产出 18 篇论文、30+ CVE)
7Ed1s0nZ/CyberStrikeAI6.3kGo渗透 AgentGo 构建的 AI 原生安全测试平台
8elder-plinius/T3MP3ST5.9kTypeScript红队 Agent自主红队平台 / 多智能体进攻性安全元框架,复用本机 AI 编码代理(Claude Code/Codex/Ollama 等)作零日漏洞猎手
9OWASP/Nettacker5.5kPython自动化扫描OWASP 自动化渗透测试 / 漏扫框架
10GH05TCREW/pentestagent3.0kPython渗透 Agent黑盒安全测试 AI Agent 框架(GHOSTCREW)
11oritera/Cairn2.5kPython渗透 Agent通用状态空间搜索引擎,自主渗透
12samugit83/redamon2.4kPython红队 AgentAI 驱动的代理式红队框架
13Armur-Ai/Pentest-Swarm-AI ⭐新补充2.4kGo渗透 Agent首个"蜂群"架构自主渗透平台,信息素黑板去中心化协作,ReAct 推理 + 5 种蜂群剧本,支持 Claude API / Ollama 本地,含 MCP 服务器
140xSteph/pentest-ai-agents2.2kShellClaude SubAgent将 Claude Code 转为攻击性安全研究助手
15CyberStrikeus/CyberStrike ⭐新补充2.2kTypeScript渗透 AgentAI 驱动的进攻性安全代理,7,300+ 安全技能,基于 MITRE ATT&CK / CIS / OWASP / NIST,含网站 cyberstrike.io
16zakirkun/guardian-cli1.9kPython渗透 Agent生产级 AI 渗透 CLI(Gemini + LangChain)
170xSteph/pentest-ai ⭐新补充1.6kPython渗透 AgentMCP 服务器封装 205+ 安全工具 + 17 个专业代理 + 确定性漏洞验证(零误报),CLI + MCP 双路径,自带 LLM
18Gowtham-Darkseid/AutoPentestX1.5kPython渗透 Agent自动化渗透测试与漏洞报告
19bugbasesecurity/pentest-copilot1.3kJavaScript浏览器助手浏览器端的道德黑客辅助工具
20SanMuzZzZz/LuaN1aoAgent1.3kPython渗透 Agent全自主 AI 渗透 Agent,XBOW >90%(广州大学)
21PentesterFlow/agent ⭐新补充1.3kTypeScript渗透 Agent终端内 Agentic 进攻性安全,"人在回路中",内置 OWASP Top 10 技能 + Burp 集成 + 覆盖率跟踪
22ipa-lab/hackingBuddyGPT1.2kPython渗透 Agent50 行代码内调用 LLM 协助伦理黑客
23berylliumsec/nebula1.1kPython渗透助手AI 渗透助手,自动侦察 / 笔记 / 漏洞分析
24splx-ai/agentic-radar1.0kPythonAgent 安全扫描LLM Agentic 工作流安全扫描器(OpenAI Agents、CrewAI、LangGraph 等)
25xalgord/xalgorix953Go渗透 Agent开源 AI 渗透测试 Agent
26ASCIT31/Dark-Moon ⭐新补充887Python渗透 AgentAI 驱动的自主渗透测试引擎,覆盖 Web/云/AD/K8s,多智能体编排 + 隐私网关 + 50+ 工具集成
27verialabs/ctf-agent757PythonCTF Agent自主 CTF solver,BSidesSF 2026 第一名
28westonbrown/Cyber-AutoAgent544TypeScript渗透 AgentXBOW 验证基准 85%,已归档但代表性强
29ARCANGEL0/EVA526Python渗透 AgentAI 辅助渗透测试代理,多后端 AI 集成
30m-sec-org/BreachWeave525TypeScript渗透 AgentManager/Observer/Solver 多角色架构(腾讯云黑客松第二期线下决赛一等奖,排名 1/613)
31transilienceai/communitytools502PythonClaude 工具集开源 Claude Code skills/agents/slash command
320ca/BoxPwnr450Python渗透 Agent / 多平台基准HackTheBox / TryHackMe / picoCTF / Cybench / XBOW 等 15 个平台基准框架
33crond-jaist/AutoPentest-DRL448Python强化学习渗透使用深度强化学习的自动化渗透测试
34SHAdd0WTAka/Zen-Ai-Pentest446Python渗透 Agent多代理 AI 渗透框架 + 合规报告
35aielte-research/HackSynth316Python渗透 AgentPlanner + Summarizer 双模块,PicoCTF / OverTheWire 200 题(arXiv:2412.01778)
36straylabs-ai/deadend-cli(原 xoxruns)302Python渗透 AgentXBOW 黑盒 81%,约 $122 API 成本,本地化执行
37yz9yt/BugTrace-AI253TypeScript漏洞追踪(已归档,演进为 BugTraceAI v2)
38GitHubSecurityLab/seclab-taskflow-agent230PythonAgent 框架GitHub Security Lab 出品,YAML 驱动多 Agent + CodeQL
39KHenryAegis/VulnBot191Python渗透 Agent多代理协作框架的自主渗透测试
40chainreactors/tinyctfer174PythonCTF Agentantix 微型意图运行时 + 元工具设计(腾讯云黑客松第 4 名核心代码)
41NYU-LLM-CTF/nyuctf_agents161PythonCTF AgentNYU CTF Bench 配套的 D-CIPHER + Baseline
42antoninoLorenzo/AI-OPS158Python渗透助手基于开源 LLM 的渗透测试 AI 助手
43andreashappe/cochise134PythonAD 渗透 Agent自主 Assumed Breach AD 渗透(TOSEM 2025)
44arthurgervais/mapta106Python渗透 Agent多 Agent Web 应用安全评估 + 端到端漏洞利用验证(arXiv:2508.20816)
45vikramrajkumarmajji/AI-VAPT102TypeScriptVAPT 框架自主 AI 漏洞评估与渗透测试框架
46amazon-science/Cyber-Zero101Python训练框架无运行时训练网络安全代理(Amazon Science,已于 2026-07-10 归档)

备注:1k–10k 区间的 Star 数为 GitHub 网页缩写值的换算结果;万级以上误差更大。2026-09-02 全量刷新要点:strix 反超 shannon 登顶(41k→60.1k);cai(2026-08-28)与 Cyber-Zero(2026-07-10)已归档;deadend-cli 迁移至 straylabs-ai 组织;mcp-shodan 迁移至 w0h1v。2026-09-07 精简:移除 promptfoo、garak、PyRIT、vulnhuntr、deepteam、agentic_security、buttercup、promptmap、reaper 共 9 个项目(56→47,聚焦渗透 / 红队 / CTF Agent 主线)。 Note: stars in the 1k–10k range are converted from GitHub's abbreviated values; 10k+ may carry larger errors. 2026-09-02 refresh highlights: strix overtakes shannon as #1 (41k→60.1k); cai & Cyber-Zero archived; deadend-cli moved to straylabs-ai; mcp-shodan moved to w0h1v. 2026-09-07 pruning: removed 9 entries (promptfoo, garak, PyRIT, vulnhuntr, deepteam, agentic_security, buttercup, promptmap, reaper), refocusing on pentest / red-team / CTF agents.


🧬 进攻型 / 安全专用开源模型

Offensive & Security-Specialized Open-Weight Models

上面的项目多为"Agent 框架 / 脚手架",其能力最终取决于底层模型。本节盘点可作为 Offensive AI Agent 推理内核的开源权重模型,分两类:

  • A. 无安全对齐 / 弱审查的进攻型模型:刻意去除或大幅弱化拒答对齐,可直接输出漏洞利用 / 攻击链推理,最适合本地化、无云依赖的红队 Agent 驱动。
  • B. 安全领域专用模型(含推理 / 漏洞 / 防御对齐):面向安全垂域微调,能力强但保留了不同程度的安全对齐,进攻场景常需搭配越狱 / 系统提示或作为漏洞检测内核使用。

These are open-weight models usable as the reasoning core of an offensive AI agent, split into (A) uncensored/weakly-aligned offensive models and (B) security-specialized models that still retain safety alignment.

A. 无安全对齐 / 弱审查的进攻型模型

Uncensored / Weakly-Aligned Offensive Models

#模型参数量基座发布方定位与特色
1Qwythos-9B-Claude-Mythos-5-1M ⭐新补充Ollama9BQwen3.5-9B(深度无审查)Empero AI🔥 "Claude 平替"级无审查推理模型,后训练超 5 亿 token Claude Mythos/Fable 思维链,1M 上下文 + 自我纠正工具调用,4GB 显存即可本地运行,MMLU +34.3 / gsm8k +30 大幅超越基座
2WhiteRabbitNeo / DeepHatDeepHat-V1-7B、13B、33B、70B)7B–70BLlama / Qwen / DeepSeekKindo.ai最知名的无审查红队模型家族,2025 Black Hat 后更名 DeepHat。面向真实进攻推理、长上下文分析,可映射立足点、串联弱点、探索利用路径
3Lily-Cybersecurity-7B-v0.27BMistral-7BSego Lily LabsMistral 微调,22,000 条手工构造的网络安全 / 黑客问答对,无强拒答对齐,适合本地渗透问答助手
4BaronLLM (Offensive Security LLM)GGUF Q6_K7B/8B 级AlicanKiraz0专为进攻性安全研究、对抗模拟、红队微调的模型,输出偏向 exploit / 攻击链推理
5CyberStrike-OffSec-35B ⭐新补充35B MoE(激活 3B)Qwen3.6-35B-A3BOrhan Yildirim35B 混合专家进攻性安全模型,SFT+DPO 训练,专攻漏洞利用开发 / 红队行动 / 云攻击 / 免杀技术,自称多个安全基准超越 GPT-4无安全对齐
6BugTraceAI-CORE-Ultra-27B ⭐新补充27BQwen3.6-27BBugTraceAI基于 2,541 份真实漏洞赏金报告 + CVE 分析 + 进攻性安全研究 SFT 微调,专注漏洞发现与 Nuclei 模板生成,面向 Bug Bounty 场景

⚠️ 说明:此类模型刻意弱化安全对齐,可直接产出攻击性内容,必须严格限定于授权测试 / 隔离环境(详见文末免责声明)。 These models intentionally weaken safety alignment; use only within authorized, isolated environments.

B. 安全领域专用模型(含推理 / 漏洞 / 防御对齐)

Security-Specialized Models (Reasoning / VulnDetect / Defense-Aligned)

#模型参数量基座发布方定位与特色对齐属性
1VulnLLM-R-7B代码7BQwen 系UCSB-SURFI漏洞挖掘推理模型,逐步推理数据流 / 控制流 / 安全上下文;在 Python/C/C++/Java 上超越 CodeQL、AFL++、Claude-3.7 等(arXiv:2512.07533)面向检测,弱进攻对齐
2Foundation-Sec-8B-Reasoning8BLlama-3.1-8BCisco Foundation AI"全球首个安全推理模型",安全垂域指令微调,可本地部署驱动 AI 安全工具(arXiv:2601.21051)通用安全,保留对齐
3CyberSecQwen-4B4BQwen3-4B-InstructAMD Hackathon / athena129轻量防御性安全模型,专攻 CVE→CWE 映射(CTI-RCM)与威胁情报选择题(CTI-MCQ),4B 却超 8B 基座明确防御导向
4Meta-SecAlign-8B70B8B / 70BLlama-3.1Meta (FAIR)首个内建 prompt injection 防御的全开源商用级 LLM(arXiv:2507.02735);本质是防御对齐标杆,可作红队攻防的"蓝方"陪练强防御对齐(非进攻)
5Titus-CybersecurityLLM-v1.0 ⭐新补充35B MoEQwen3.6-35B-A3BAlicanKiraz0面向 SOC/DFIR 的网络安全操作模型,土耳其语优先 + 英文,含 MLX 4-bit 量化版(19.5GB VRAM),与 BaronLLM 同一作者偏防御(SOC/DFIR 导向)

甄别提示:VulnLLM-R / Foundation-Sec / CyberSecQwen / Meta-SecAlign / Titus 均非"无对齐进攻模型"——它们分别偏漏洞检测、安全推理、防御问答、抗注入防御与 SOC/DFIR 运营。真正"无安全对齐、适合直接进攻"的是 A 类(Qwythos、WhiteRabbitNeo/DeepHat、Lily、BaronLLM、CyberStrike-OffSec-35B、BugTraceAI-CORE-Ultra)。将它们并列收录,是为了呈现"进攻内核 vs 安全垂域 / 防御对齐"的完整光谱,便于选型时对症下药。 Selection note: only Group A models are genuinely uncensored/offensive; Group B are vuln-detection, reasoning, or defense-aligned models included for a complete spectrum.


🧩 进攻型 AI Skill 资源精选

Offensive AI Skills (Claude Code / Agent Skills Ecosystem)

除了独立 Agent 与底层模型,Agent Skill(如 Claude Code Skills、agentskills.io / skills.sh 生态)正成为"进攻型 AI"落地到通用 AI 编程客户端的重要形态——把渗透测试方法论、工具链调用顺序与 payload/字典打包为可被 Agent 按需自动加载的结构化技能模块。仅收录纯 Skill 形态(非 Agent/Subagent 混合项目)、Star ≥ 100 的仓库,按 Star 数降序排列。 Agent Skills package pentest methodology, tool-chains, and payloads/wordlists into structured modules that general-purpose AI coding agents (e.g. Claude Code) can auto-load on demand. Only pure-Skill repos (excluding Agent/Subagent-hybrid projects) with ≥ 100 stars are listed, sorted by stars (desc).

#仓库Stars载体 / 生态定位与特色
1mukul975/Anthropic-Cybersecurity-Skills ⭐新补充32.0kAgent Skills(agentskills.io 标准,20+ 平台兼容)🔥 全球最大开源网安 Agent Skill 库,817 个结构化技能覆盖 29 大安全域(红队/渗透/云安全/取证/威胁狩猎等),业界唯一六框架映射(ATT&CK/NIST CSF/ATLAS/D3FEND/AI RMF/F3),社区非官方项目
2ljagiello/ctf-skills3.2kAgent Skills(Claude Code 等)CTF 全领域技能包,覆盖 Web/Pwn/密码学/逆向/取证/OSINT/恶意软件/AI-ML 等 10 大类,内置 solve-challenge 总调度器自动分发题型
3Eyadkelleh/awesome-skills-security374Agent Skills(60+ Agent 兼容)基于 SecLists 精选打包为 7 类技能(Fuzzing/密码字典/敏感模式/Payload/用户名/Webshell/LLM 测试),一键安装

⚠️ 上述 Skill 本身通常不内置攻击性代码,仅提供方法论、脚本编排与工具调用规范;实际执行仍依赖用户自行安装的安全工具,且必须严格限定于授权测试场景。 These skills mostly provide methodology/orchestration rather than embedded exploit code; actual execution still relies on separately installed security tools and must remain within authorized testing scope.


🔌 进攻型 AI MCP Server 精选

Offensive AI MCP Servers

MCP(Model Context Protocol)让 AI Agent 以标准化协议直接调用真实安全工具,是"进攻型 AI"从推理走向实际执行的关键基础设施——Burp、Metasploit、Nmap 等工具借此被"AI 化"。仅收录安全工具集合类 MCP Server(非单一 Agent 项目自带的 MCP 组件)、Star ≥ 100 的仓库,按 Star 数降序排列。 MCP servers let AI agents invoke real security tools via a standardized protocol — the execution layer that turns offensive AI reasoning into action. Only dedicated security-tool MCP servers (excluding MCP components bundled inside a single agent project) with ≥ 100 stars are listed, sorted by stars (desc).

#仓库Stars语言定位与特色
1PortSwigger/mcp-server1.1kKotlinPortSwigger 官方出品,Burp Suite 扩展,桥接 Burp 与 MCP 客户端(Claude Desktop 等),SSE + Stdio 双模式
2Wh0am123/MCP-Kali-Server ⭐新补充808Python已收录 Kali 官方软件源apt install mcp-kali-server)的轻量级 API 桥接,集成 nmap/hydra/sqlmap/metasploit/wpscan 等,支持 AI 辅助渗透与 CTF/HTB/THM 靶场解题
3FuzzingLabs/mcp-security-hub776Python38 个容器化 MCP 服务器集合,覆盖侦察/Web/二进制分析/区块链/云/模糊测试/AD 等,共 300+ 安全工具,生产级安全加固
4GH05TCREW/MetasploitMCP722PythonMetasploit 框架 MCP 桥接,支持 exploit/payload 生成、会话管理、Handler 监听器全流程操作
5MorDavid/BloodHound-MCP-AI ⭐新补充375Python首个 BloodHound AI 集成,75+ 工具将 Cypher 查询封装为自然语言,专攻 AD 攻击路径分析(Kerberoasting/AS-REP Roasting/NTLM 中继/委派滥用)
6w0h1v/mcp-shodan(原 BurtTheCoder) ⭐新补充161TypeScriptShodan API + CVEDB 查询 MCP,IP 侦察/DNS 操作/联网设备发现/CVE-CPE 关联查询,支持 Claude Code、Codex、Gemini CLI
7DMontgomery40/pentest-mcp143JavaScript/TS面向专业渗透测试者的实战级 MCP 服务器,内置 nmap/hydra/sqlmap/nuclei/hashcat 等,含 SoW 授权范围采集与 Prompt Injection 风险缓解

⚠️ 此类 MCP Server 通常直接封装真实攻击性工具(Metasploit、sqlmap、hashcat 等),风险等级高于 Skill 类资源,必须部署于隔离环境并严格限定授权范围These MCP servers wrap real offensive tools directly and carry higher risk than skill-based resources — deploy only in isolated, explicitly authorized environments.


🏆 知名 AI 攻防 / 智能渗透赛事

Notable AI Offense-Defense & Intelligent Penetration Competitions

本节收录全球范围内具有代表性的 AI 驱动攻防 / 自主渗透 竞技赛事,是检验 Agent 实战能力的"竞技场",产出的开源系统往往代表当前工程实践的最高水准。 This section covers representative AI-driven offense-defense / autonomous penetration competitions worldwide — the "arenas" that stress-test Agent capabilities, whose open-sourced systems often represent state-of-the-art engineering practice.

1. DARPA AIxCC 2025

DARPA AI Cyber Challenge 2025 Final

美国 DARPA 在 2025 年举办的 AI Cyber Challenge(AIxCC) 决赛中,7 支队伍各自开源了完整的 Cyber Reasoning System(CRS),代表当前自动化漏洞发现 + 修复 Agent 的最高工程水准。 The 7 finalist Cyber Reasoning Systems from DARPA's AI Cyber Challenge represent today's state-of-the-art in automated vulnerability discovery & patching agents.

排名队伍CRS 系统Stars仓库
🥇 1Team AtlantaATLANTIS642Team-Atlanta/aixcc-afc-atlantis
🥈 2Trail of BitsButtercup1.7ktrailofbits/buttercup
🥉 3TheoriRoboDucktheori-io/aixcc-afc-archive
4All You Need Is A Fuzzing BrainFuzzingBraino2lab/afc-crs-all-you-need-is-a-fuzzing-brain
5ShellphishARTIPHISHELL141shellphish/artiphishell
642-b3yond-6ugBugBuster42-b3yond-6ug/42-b3yond-6ug-crs
7Lacrosse (SIFT)Lacrosse CRSsiftech/afc-crs-lacrosse

2. 腾讯云智能渗透黑客松

Tencent Cloud Intelligent Penetration Hackathon

腾讯安全云鼎实验室主办,国内首个聚焦 LLM 智能体全流程自动化渗透 的顶级专业赛事,理念"铸刃止戈、以智御危"。已连续举办两届,累计汇聚清华大学、复旦大学、帝国理工学院、卡内基梅隆大学等国内外知名高校学生战队,鹏城实验室、中国科学院信息工程研究所等权威科研机构专家战队,以及阿里、京东、长亭、绿盟等行业领军企业战队,参赛规模从第一届 238 支战队/518 名选手增长至第二届 610 支战队/1,345 名选手,累计产出 20 套顶尖智能渗透技术框架。赛制核心导向为纯 AI 驱动渗透,严格限制人工操作,前 20 名可获开源贡献奖。官方资源仓:Yeti-791/Tsec-Hackathon(709 Stars)。 Hosted by Tencent Security Yunding Lab, the first domestic top-tier competition focused on LLM-agent fully-automated penetration. Two editions held so far, growing from 238 teams/518 competitors to 610 teams/1,345 competitors, producing 20 leading intelligent-penetration frameworks. Strictly AI-driven with manual operation prohibited. Official repo: Yeti-791/Tsec-Hackathon.

届次时间冠军战队参与规模
第一届2025-11xjtuHunter(西安交大)第2名 / BinX(广州大学)第3名清华大学、复旦大学、帝国理工学院、卡内基梅隆大学等国内外知名高校学生战队,鹏城实验室、中国科学院信息工程研究所等权威科研机构专家战队,以及阿里、京东、长亭等行业领军企业战队,共计 238 支战队、518 名顶尖选手参与
第二届2026-04ai小分队(第1名)/ Bytex(第3名,全场唯一 AK)首创"智能渗透主赛场 +『零界』平行赛场"双轨竞技模式,参赛规模在第一届基础上增长至 610 支战队、1,345 名安全极客与 AI 研究者;获奖队伍包括绿盟科技、京东、天翼安全、中国电信、清华大学、奇盾信息等

📑 相关学术论文

Related Academic Papers (grouped by topic; within each group, newest first)

在原有基础上,融合了 tmylla/Awesome-LLM4Cybersecurity 中渗透测试、进攻 AI、漏洞挖掘相关章节,并于 2026-09-11 与 simon-p-j-r/LLM4Pentest(108 篇分类清单)逐篇交叉核对:勘误多项标题/作者/链接(含 CyberSecEval 3 错链、MAPTA/D-CIPHER/Aurora 旧版标题、PwnGPT PDF 直链等)、移除 4 篇"攻击 AI 系统 / LLM 自身安全"类论文(UDora、AgentPoison、CyberSecEval 1/3)、补充 47 篇遗漏论文。现共收录 116 篇,按主题拆为 3 个子表:

  • A. 渗透测试 & 红队 Agent(62 篇)
  • B. 漏洞挖掘 / 利用 / 修复(20 篇)
  • C. 评测基准 & 训练方法 & 综述 & 奠基(34 篇)

时间以 arXiv v1 提交日期 / 期刊首发日期为准;⭐新补充 = 本轮新增(2026-09-11),ⓝ 为往轮补充。

Cross-checked entry-by-entry against simon-p-j-r/LLM4Pentest on 2026-09-11: multiple title/author/link errata fixed (incl. a wrong CyberSecEval 3 link), 4 "attacking-AI / LLM-safety" papers removed (UDora, AgentPoison, CyberSecEval 1/3), and 47 missing papers added — 116 in total: (A) Pentesting & Red-Team Agents (62) · (B) Vulnerability Discovery / Exploitation / Repair (20) · (C) Evaluation, Training, Surveys & Foundational (34).

A. 渗透测试 & 红队 Agent

Pentesting & Red-Team Agents

#时间论文作者 / 机构发表渠道关联项目 / 主题
A12026-07A Survey of LLM-Driven Penetration Testing: Taxonomy, Co-Evolution, and Open ChallengesZheyuan He et al.arXiv系统综述 81 篇文献:Agents4Pentest 分类学与四阶段架构演进(RLVR 转折)
A22026-07Intelligent Penetration Testing Through Integrated Knowledge Graph and Historical Decision Enhancement ⭐新补充Qianyu LiIEEE TDSC 2026知识图谱 + 历史决策增强的智能渗透
A32026-06ZERO-APT: A Closed-Loop Adversarial Framework for LLM-Driven Automated Penetration Testing under Intelligent DefenseAnlan Zheng, Tiantian ZhuarXiv攻击者-防御者-裁判回合制闭环,含实时智能防御
A42026-05APT-Agent: Automated Penetration Testing using Large Language Models ⭐新补充William Guanting Li et al.arXiv幻觉矫正 + 命令记忆,Metasploitable 2 端到端成功率 84.29%
A52026-05Pen-Strategist: A Reasoning Framework for Penetration Testing Strategy Formation and Analysis ⭐新补充Yasod Ginige et al.arXivRL 微调策略推理模型,策略推导 +87%、子任务 +47.5%
A62026-05From Intent to Invocation: A Reasoning-First Framework for Natural Language to Penetration Testing Commands ⭐新补充He Kong et al.ICASSP 2026自然语言 → 渗透命令的推理优先框架
A72026-04Hackers or Hallucinators? A Comprehensive Analysis of LLM-Based Automated Penetration TestingJiaren Peng et al.arXivsimon-p-j-r/LLM4Pentest:SoK + 13 框架统一基准实测(超 100 亿 token)
A82026-04Automation-Exploit: A Multi-Agent LLM Framework for Adaptive Offensive Security with Digital Twin-Based Risk-Mitigated Exploitation ⭐新补充Biagio Andreucci, Arcangelo CastiglionearXiv数字孪生隔离调试的"风险缓解型"多 Agent 黑盒攻击链
A92026-03Red-MIRROR: Agentic LLM-based Autonomous Penetration Testing with Reflective Verification and Knowledge-augmented Interaction ⭐新补充Tran Vy Khang et al.arXiv记忆-反思骨干 + RAG,XBOW 基准 86%
A102026-03STRIATUM-CTF: A Protocol-Driven Agentic Framework for General-Purpose CTF Solving ⭐新补充James Hugglestone et al.arXivMCP 协议驱动通用 CTF Agent,真实赛事击败 21 支人类战队夺冠
A112026-03Towards Reliable Local Security Agents: Verifiable Post-Training for Linux Privilege Escalation ⭐新补充Philipp Normann, Andreas Happe et al.arXivSFT+RLVR 后训练 4B 本地模型,Linux 提权 93.3%、成本降 80×
A122026-03PTFusion: LLM-driven context-aware knowledge fusion for web penetration testing ⭐新补充Wang et al.Information Fusion 2026上下文感知知识融合的 Web 渗透策略规划
A132026-03Building adaptative and transparent cyber agents with local language models ⭐新补充Maria RigakiExpert Systems with Applications 2026本地 LLM 构建自适应、可解释攻击 Agent
A142026-02AWE: Adaptive Agents for Dynamic Web Penetration Testing ⭐新补充Akshat Singh Jaswal et al.NDSS 2026stuxlabs/AWE:记忆增强多 Agent 动态 Web 渗透
A152026-02What Makes a Good LLM Agent for Real-world Penetration Testing? ⭐新补充Gelei Deng et al.arXivExcalibur:难度感知规划 + 证据引导攻击树搜索,GOAD 攻陷 4/5 主机
A162026-02LLMs as Hackers: Autonomous Linux Privilege Escalation Attacks ⭐新补充Andreas HappeEmpirical Software Engineering 2026自主 Linux 提权攻击实证
A172026-01PenForge: On-the-Fly Expert Agent Construction for Automated Penetration TestingHuihui Huang et al.ICSE-NIER 2026动态构造领域专家 Agent,CVE-Bench 零日设定 30%(SOTA 3×)
A182026-01WiFiPenTester: Advancing Wireless Ethical Hacking with Governed GenAI ⭐新补充Haitham S. Al-Sinani, Chris J. MitchellarXiv治理型 GenAI 无线渗透(人在回路)
A192026-01CTFAgent: An LLM-powered Agent for CTF Challenge Solving ⭐新补充Yuwen ZouJISA 2026LLM 驱动 CTF 解题 Agent
A202026AI-Driven Penetration Testing for ARM Systems: Experimental Evaluation and Deployment Framework Across Four Paradigms ⭐新补充Matthew RagsdaleIEEE Access 2026ARM 平台四范式 AI 渗透评估
A212025-12PentestEval: Benchmarking LLM-based Penetration Testing with Modular and Stage-Level DesignRuozhao Yang et al.arXiv六阶段模块化渗透评测,346 任务
A222025-12Comparing AI Agents to Cybersecurity Professionals in Real-World Penetration TestingJustin W. Lin et al.(Stanford)ICLR 2026Stanford-Trinity/ARTEMIS:8,000 主机企业网,胜 9/10 人类专家
A232025-12Automated Penetration Testing with LLM Agents and Classical Planning ⭐新补充Lingzhi Wang et al.arXivCHECKMATE:经典规划作外置"结构化大脑",超 Claude Code 20%
A242025-11Controller Makes Pentesting Better: An Improved Multi-Agent Automated Penetration Testing Framework ⭐新补充Geng et al.IEEE TrustCom 2025Controller 跨阶段调度多 Agent 渗透
A252025-11Automated tactics planning for cyber attack and defense based on large language model agents ⭐新补充Yimo RenNeural Networks 2025LLM Agent 攻防战术自动规划
A262025-10AutoPentester: An LLM Agent-based Framework for Automated PentestingYasod Ginige et al.IEEE TrustCom 2025全自动渗透,子任务完成率较 PentestGPT +27%
A272025-09xOffense: An Autonomous Multi-Agent Framework for Penetration Testing with Domain-Adapted Large Language ModelsPhung Duc Luong et al.arXiv微调 Qwen3-32B 多 Agent,子任务 79.17%
A282025-09Guided Reasoning in LLM-Driven Penetration Testing Using Structured Attack TreesKatsuaki Nakano et al.arXivMITRE ATT&CK 攻击树约束推理,查询量大幅下降
A292025-09PentestMCP: LLM and MCP Based Multi-Agent Framework for Automated Penetration Testing ⭐新补充Jiqiang Zhai et al.Research Square(预印本·在审)LLM + MCP + RAG 端到端自动渗透
A302025-08Multi-Agent Penetration Testing AI for the Web (MAPTA)Isaac David, Arthur GervaisarXivarthurgervais/mapta:XBOW 76.9%,10 项发现进入 CVE 评审
A312025-08Chimera: Harnessing Multi-Agent LLMs for Automatic Insider Threat Simulation ⭐新补充NDSS 2026fish98/Chimera:多 Agent 内部威胁自动化模拟
A322025-08CurriculumPT: LLM-Based Multi-Agent Autonomous Penetration Testing with Curriculum-Guided Task SchedulingXingyu Wu et al.Applied Sciences 2025课程式由易到难任务调度 + 经验知识库
A332025-08Pentest-R1: Towards Autonomous Penetration Testing Reasoning Optimized via Two-Stage RLHe Kong et al.arXiv离线+在线两阶段 RL,8B 模型比肩 GPT-4o
A342025-08Automated penetration testing: Formalization and realization ⭐新补充Charilaos SkandylasComputers & Security 2025自动化渗透测试的形式化与实现
A352025-07PenTest2.0: Towards Autonomous Privilege Escalation Using GenAIHaitham S. Al-Sinani, Chris J. MitchellarXivRAG + CoT + 任务树自主提权
A362025-07On the Surprising Efficacy of LLMs for Penetration-TestingAndreas Happe, Jürgen CitoarXivLLM 渗透有效性实证(含恶意采用视角)
A372025-05AutoPentest: Enhancing Vulnerability Management With Autonomous LLM AgentsJulius HenkearXivGPT-4o + LangChain 黑盒渗透
A382025-05RedTeamLLM: an Agentic AI framework for offensive securityBrian Challita, Pierre ParrendarXiv总结-推理-行动循环,含错误恢复
A392025-05RefPentester: A Knowledge-Informed Self-Reflective Penetration Testing Framework Based on Large Language Models ⭐新补充Hanzheng Dai et al.arXivipa-lab/hackingBuddyGPT:七状态机自反思渗透
A402025-04CAI: An Open, Bug Bounty-Ready Cybersecurity AIVíctor Mayoral-Vilches et al.(aliasrobotics)arXivaliasrobotics/cai:首个网络安全自主等级分类
A412025-02Construction and Evaluation of LLM-based agents for Semi-Autonomous penetration testingMasaya Kobayashi et al.arXiv多 LLM 模块半自主渗透
A422025-02RapidPen: Fully Automated IP-to-Shell Penetration Testing with LLM-based AgentsSho Nakatani(SecDevLab)arXivIP→Shell 全自动,单次 $0.3-0.6
A432025-02PenTest++: Elevating Ethical Hacking with AI and AutomationHaitham S. Al-Sinani, Chris J. MitchellarXiv道德黑客 AI 自动化升级
A442025-02Can LLMs Hack Enterprise Networks? Autonomous Assumed Breach Penetration-Testing Active Directory NetworksAndreas Happe, Jürgen CitoACM TOSEM 2025andreashappe/cochise:GOAD 全自主 AD 渗透
A452025-02D-CIPHER: Dynamic Collaborative Intelligent Multi-Agent System with Planner and Heterogeneous Executors for Offensive SecurityMeet Udeshi et al.(NYU)arXivNYU-LLM-CTF/nyuctf_agents:Planner-Executor 架构
A462025-02ARACNE: An LLM-Based Autonomous Shell Pentesting Agent ⭐新补充Tomas Nieponice et al.arXiv多 LLM 自主 Shell 渗透,OTW Bandit 57.58%
A472025-01Incalmo: An Autonomous LLM-assisted System for Red Teaming Multi-Host NetworksBrian Singer et al.(CMU)arXiv多主机红队,MHBench 40 网络 37 成功
A482025-01VulnBot: Autonomous Penetration Testing for A Multi-Agent Collaborative FrameworkHe Kong et al.arXivKHenryAegis/VulnBot:渗透任务图 PTG
A492024-12HackSynth: LLM Agent and Evaluation Framework for Autonomous Penetration TestingLajos Muzsai et al.(ELTE)arXivaielte-research/HackSynth:PicoCTF/OTW 200 题
A502024-12Hacking CTFs with Plain AgentsRustem Turtayev et al.arXiv朴素 Agent 饱和 InterCode-CTF(95%)
A512024-11PentestAgent: Incorporating LLM Agents to Automated Penetration TestingXiangmin Shen et al.AsiaCCS 2025GH05TCREW/pentestagent
A522024-11AutoPT: How Far Are We from the End2End Automated Web Penetration Testing?Benlong Wu et al.arXiv渗透状态机 PSM,任务完成 22%→41%
A532024-09BreachSeek: A Multi-Agent Automated Penetration TesterIbrahim Alshehri et al.arXivLangGraph 多 Agent 渗透
A542024-09Hacking, The Lazy Way: LLM Augmented PentestingDhruva Goyal et al.arXivbugbasesecurity/pentest-copilot:浏览器内 LLM 增强渗透
A552024-09EnIGMA: Interactive Tools Substantially Assist LM Agents in Finding Security VulnerabilitiesTalor Abramovich et al.(NYU)ICML 2025交互式工具(gdb 等)CTF Agent,识别"独白"幻觉现象
A562024-08CIPHER: Cybersecurity Intelligent Penetration-testing Helper for Ethical ResearcherDerry Pratama et al.Sensors 2024300+ writeup 训练的渗透垂域模型 + FARR 基准
A572024-08ChainReactor: Automated Privilege Escalation Chain Discovery via AI Planning ⭐新补充Giulio De Pasquale et al.USENIX Security 2024PDDL 经典规划(非 LLM)自动提权链发现
A582024-07PenHeal: A Two-Stage LLM Framework for Automated Pentesting and Optimal RemediationJunjie Huang, Quanyan ZhuACSW 2024两阶段:渗透 + 最优修复
A592024-07From Sands to Mansions: Towards Automated Cyberattack Emulation with Classical Planning and Large Language ModelsLingzhi Wang et al.ACNS 2026Aurora:CTI 报告→攻击链自动编排(250 报告数据集)
A602024-03AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attacksJiacen Xu et al.(UC Irvine)arXiv后渗透"hands-on-keyboard"自动化攻击
A612023-08PentestGPT: An LLM-empowered Automatic Penetration Testing ToolGelei Deng et al.(NTU)USENIX Security 2024GreyDGL/PentestGPT:奠基之作
A622023-07Getting pwn'd by AI: Penetration Testing with Large Language ModelsAndreas Happe, Jürgen Cito(TU Wien)ESEC/FSE 2023奠基论文,hackingBuddyGPT 前身

B. 漏洞挖掘 / 利用 / 修复

Vulnerability Discovery / Exploitation / Repair

#时间论文作者 / 机构发表渠道关联项目 / 主题
B12026-05FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and ReproductionZe Sheng et al.arXiv构建于 OSS-Fuzz,实战挖出 29 个 0day(2 个获 CVE),AIxCC 数据集 90% 检出
B22026-02FirmAgent: Leveraging Fuzzing to Assist LLM Agents with IoT Firmware Vulnerability Discovery ⭐新补充Jiangan Ji et al.(清华/信息工程大学)NDSS 2026AxiaoJJ/FirmAgent:Fuzzing + 双 LLM Agent 的 IoT 固件漏洞发现与 PoC 生成
B32025-10LLM Agents for Automated Web Vulnerability Reproduction: Are We There Yet?Bin Liu et al.arXiv20 个 Agent × 80 真实 CVE 漏洞复现实证
B42025-09VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing LLM Vulnerability RepairWeizhe Wang et al.arXiv基于 PoC exploit 的修复评测(12 LLM,最高仅 21.7%)
B52025-09All You Need Is A Fuzzing Brain: An LLM-Powered System for Automated Vulnerability Detection and PatchingZe Sheng et al.(o2lab)arXivAIxCC 决赛第 4 名 CRS 论文,28 漏洞(含 6 个 0day),附公开榜单
B62025-09LLM-Driven SAST-Genius: A Hybrid Static Analysis Framework for Comprehensive and Actionable SecurityVaibhav Agrawal, Kiarash AhiarXivSAST + LLM 混合静态分析,误报降约 91%
B72025-09ATLANTIS: AI-driven Threat Localization, Analysis, and Triage Intelligence SystemTaesoo Kim et al.(Team Atlanta)arXivAIxCC 决赛冠军 CRS 论文(符号执行 + 定向 fuzz + LLM)
B82025-08Prompt to Pwn: Automated Exploit Generation for Smart ContractsZeKe Xiao et al.ACISP 2026ReX 框架:LLM + Foundry 端到端智能合约 Exploit 生成
B92025-07LLMxCPG: Context-Aware Vulnerability Detection Through Code Property Graph-Guided Large Language ModelsAhmed Lekssays et al.USENIX Security 2025CPG 切片 + LLM,代码量降 67-91%、F1 +15-40%
B102025-07MalCodeAI: Autonomous Vulnerability Detection and Remediation via Language Agnostic Code ReasoningJugal Gajjar et al.IEEE IRI 2025跨 14 语言漏洞检测 + 修复(LoRA 微调 Qwen2.5-Coder-3B)
B112025-07PwnGPT: Automatic Exploit Generation Based on Large Language ModelsWanzong Peng et al.ACL 2025CTF 二进制 pwn 自动 Exploit 生成(分析-生成-验证三模块)
B122025-05VADER: A Human-Evaluated Benchmark for Vulnerability Assessment, Detection, Explanation, and RemediationEthan TS. Liu et al.arXiv漏洞处理四维人评基准(174 真实漏洞)
B132025-04CVE-Bench (NAACL): Benchmarking LLM-based Software Engineering Agent's Ability to Repair Real-World CVE VulnerabilitiesPeiran Wang et al.NAACL 2025509 个真实 CVE 修复评测(注:与 ICML 版同名不同任务)
B142025-03CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World VulnerabilitiesYuxuan Zhu et al.(UIUC Kang Lab)ICML 2025uiuc-kang-lab/cve-bench:真实 Web CVE 利用评测
B152025-03CASTLE: Benchmarking Dataset for Static Code Analyzers and LLMs towards CWE DetectionRichard A. Dubniczky et al.arXiv25 类 CWE × 250 微基准程序
B162024-10HonestCyberEval: An AI Cyber Risk Benchmark for Automated Software ExploitationDan Ristea, Vasilios MavroudisarXiv自动化利用能力风险基准(o1-preview 92.85%)
B172024-07eyeballvul: a future-proof benchmark for vulnerability detection in the wildTimothee ChauvinarXiv每周更新、防训练泄漏的漏洞检测基准
B182024-06Teams of LLM Agents can Exploit Zero-Day VulnerabilitiesYuxuan Zhu et al.(UIUC)arXivHPTSA:规划 Agent + 子 Agent 协作 0day 利用(+4.3×)
B192024-04LLM Agents can Autonomously Exploit One-day VulnerabilitiesRichard Fang et al.(UIUC)arXivGPT-4 给定 CVE 描述利用 87%,无描述仅 7%
B202024-02LLM Agents can Autonomously Hack WebsitesRichard Fang et al.(UIUC)arXiv早期工作:GPT-4 自主盲注/SQLi 攻击网站

C. 评测基准 & 训练方法 & 综述 & 奠基

Evaluation Benchmarks, Training Methods, Surveys & Foundational

#时间论文作者 / 机构发表渠道关联项目 / 主题
C12026-08RangeFactory: Scalable Construction of Multi-Hop Cyber Ranges ⭐新补充Hanlin Jiang et al.(北大)arXiv多跳靶场自动编排,RangeBench 1,148 实例 × 287 攻击链
C22026-08CyberForge: Verified Vulnerability Injection at Repository Level for Cybersecurity Agent Training ⭐新补充Amine Lbath et al.(NIST/UMD)arXivCyb3rForge/CyberForge:仓库级漏洞注入合成训练数据(1,034 实例)
C32026-07Baselines Before Architecture: Evaluating Coding Agents for Autonomous Penetration Testing ⭐新补充Ananda Dhakal et al.arXiv同模型 plain-agent 基线对照,质疑安全 harness 增益归因
C42026-06AgentCyberRange: Benchmarking Frontier AI Systems in Realistic Cyber Ranges ⭐新补充Fengyu Liu et al.(复旦)arXivAgentCyberRange:110 漏洞 × 8 企业级靶场,GPT-5.5+Codex 最优
C52026-06CyberGym-E2E: Scalable Real-World Benchmark for AI Agents' End-to-End Cybersecurity Capabilities ⭐新补充Tianneng Shi et al.(UC Berkeley)ICML 2026920 真实漏洞端到端(发现→PoC→补丁)
C62026-05CTFusion: A CTF-based Benchmark for LLM Agent EvaluationDongjun Lee, Ga-eun Bae, Insu YunICML 2026 AIWILD Workshop基于 Live CTF 的流式评测,抗数据污染/作弊
C72026-05ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks? ⭐新补充Zhun Wang et al.(UC Berkeley)arXiv898 实例"漏洞→利用"基准(用户态/V8/内核),Claude Mythos Preview 157 题
C82026-05How Reliable Are AI Attackers Against a Fixed Vulnerable Target? A 400-Run Empirical Study of LLM Penetration Testing Consistency ⭐新补充Galip Tolga ErdemarXiv4 模型 × 100 次同目标攻击一致性实证
C92026-04Autonomous LLM Agents & CTFs: A Second Look ⭐新补充Youness Bouchari et al.EuroS&P 2026 Workshop复检"接近人类"论断:claude-code 通用 Agent 即强基线
C102026-04Towards Optimal Agentic Architectures for Offensive Security Tasks ⭐新补充Isaac David, Arthur GervaisarXiv600 次运行的架构族消融(白盒 vs 黑盒、Web vs 二进制)
C112026-03Measuring AI Agents' Progress on Multi-Step Cyber Attack Scenarios ⭐新补充Linus Folkerts et al.arXiv32 步企业网 + 7 步工控攻击链,性能随算力对数线性扩展
C122025-11From Capabilities to Performance: Evaluating Key Functional Properties of LLM Architectures in Penetration Testing ⭐新补充Lanxiao Huang et al.EMNLP 2025记忆/通信/规划/监控五类功能增强对渗透成功率的影响
C132025-11Measuring and Augmenting Large Language Models for Solving Capture-the-Flag Challenges ⭐新补充Zimo Ji et al.ACM CCS 2025CTF 求解能力测量与增强
C142025-10PACEbench: A Framework for Evaluating Practical AI Cyber-Exploitation CapabilitiesZicheng Liu et al.ICLR 2026实战 AI 网络利用能力评测(单点/混合/链式/带防御)
C152025-10HackWorld: Evaluating Computer-Use Agents on Exploiting Web Application Vulnerabilities ⭐新补充Xiaoxue Ren et al.ICLR 2026GUI-Agent/HackWorld:CUA 视觉交互漏洞利用评测
C162025-08Towards Effective Offensive Security LLM Agents: Hyperparameter Tuning, LLM as a Judge, and a Lightweight CTF BenchmarkMinghao Shao et al.(NYU)AAAI 2026CTFTiny + CTFJudge + CCI 部分正确性指标
C172025-08Training Language Model Agents to Find Vulnerabilities with CTF-Dojo ⭐新补充Terry Yue Zhuo et al.(Amazon)arXivamazon-science/CTF-Dojo:658 个容器化 CTF 可执行训练环境
C182025-07Cyber-Zero: Training Cybersecurity Agents without RuntimeTerry Yue Zhuo et al.(Amazon AGI)ICLR 2026amazon-science/Cyber-Zero:无运行时轨迹合成训练
C192025-06CyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at ScaleZhun Wang et al.(UC Berkeley Sunblaze)ICLR 2026sunblaze-ucb/cybergym:1,507 真实漏洞,衍生 34 个 0day
C202025-06SEC-bench: Automated Benchmarking of LLM Agents on Real-World Software Security TasksHwiwon Lee et al.NeurIPS 2025SEC-bench/SEC-bench:PoC 生成 + 补丁全自动评测
C212025-05Forewarned is Forearmed: A Survey on Large Language Model-based Agents in Autonomous Cyberattacks ⭐新补充Minrui Xu et al.arXivLLM Agent 自主网络攻击综述("网络威胁通胀")
C222025-04Benchmarking Practices in LLM-driven Offensive Security: Testbeds, Metrics, and Experiment DesignAndreas Happe, Jürgen CitoarXiv19 篇原型评测方法学批判
C232025A Unified Modeling Framework for Automated Penetration Testing ⭐新补充Computers & Security 2025AutoPT 统一建模框架
C242025-02OCCULT: Evaluating Large Language Models for Offensive Cyber Operation CapabilitiesMichael Kouremetis et al.arXiv进攻性网络作战能力评测(TACTL/CyberLayer)
C252024-10AutoPenBench: Benchmarking Generative Agents for Penetration TestingLuca Gioacchini et al.(Politecnico di Torino)EMNLP Industry 2025lucagioacchini/auto-pen-bench:33 任务
C262024-10Catastrophic Cyber Capabilities Benchmark (3CB): Robustly Evaluating LLM Agent Cyber Offense Capabilities ⭐新补充Andrey Anurin et al.(Apart Research)arXivapartresearch/3cb:进攻能力稳健评测
C272024-10Towards Automated Penetration Testing: Introducing LLM Benchmark, Analysis, and ImprovementsIsamu Isozaki et al.ACM UMAP 2025渗透 LLM 基准 + PentestGPT 消融改进
C282024-08Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language ModelsAndy K. Zhang et al.(Stanford CRFM)ICLR 2025 Oralandyzorigin/cybench:40 道专业 CTF
C292024-07SoK: A Comparison of Autonomous Penetration Testing Agents ⭐新补充Raphael SimonARES 2024AutoPT Agent 系统化对比 SoK
C302024-06NYU CTF Bench: A Scalable Open-Source Benchmark for Evaluating LLMs in Offensive SecurityMinghao Shao et al.(NYU)NeurIPS 2024 D&BNYU-LLM-CTF/NYU_CTF_Bench:CSAW 200 题
C312024-05Got Root? A Linux Priv-Esc Benchmark ⭐新补充Andreas Happe, Jürgen CitoarXivLinux 提权能力标准化基准
C322024-02An Empirical Evaluation of LLMs for Solving Offensive Security Challenges ⭐新补充Minghao Shao et al.(NYU)NeurIPS 2024NickNameInvalid/LLM_CTF:早期全自动 CTF 工作流实证,超人类平均
C332024自动化渗透测试技术研究综述 ⭐新补充软件学报 2024中文视角的自动化渗透测试技术综述
C342023-06InterCode: Standardizing and Benchmarking Interactive Coding with Execution FeedbackJohn Yang et al.(Princeton NLP)NeurIPS 2023 D&Bprinceton-nlp/intercode:交互式执行反馈奠基基准

注:会议/期刊年份为论文实际收录会议届期;arXiv 时间为 v1 提交月份。来源致谢:tmylla/Awesome-LLM4CybersecurityEvanThomasLuke/Awesome-AI-Hacking-Agentssimon-p-j-r/LLM4Pentest(2026-09-11 逐篇交叉核对)。本轮移除的 4 篇"攻击 AI 系统 / LLM 自身安全"类论文:UDora(劫持 LLM Agent 推理的红队框架)、AgentPoison(LLM Agent 记忆投毒后门)、CyberSecEval 1/3(LLM 安全编码与风险评测,其基准本体仍保留于 Benchmark 章节)。 Note: conference years refer to actual proceedings; arXiv dates are v1. Credits to the awesome lists above. Four "attacking-AI / LLM-safety" papers removed this round: UDora, AgentPoison, and CyberSecEval 1/3 (the CyberSecEval benchmark family itself remains in the Benchmark section).


🧪 Agent 能力评测 Benchmark

Agent Capability Benchmarks (sorted by stars, desc)

用于评估渗透测试 / 网络安全 / CTF / 红队 Agent 能力的开源 benchmark。 Open-source benchmarks for evaluating pentest / cybersecurity / CTF / red-team Agent capabilities.

#Benchmark仓库Stars时间任务规模评测重点关联论文
1TSecBench ⭐新补充tsecbench.zc.tencent.com2026-07从腾讯云黑客松诞生,采用闭卷模式,结果更准确🔥 腾讯安全云鼎实验室出品,智能攻防 AI Agent 统一跑分基准,覆盖 Web/二进制漏洞挖掘、漏洞利用、多阶段渗透、云攻击、对抗规避 6 大维度,支持 3 种 Agent 接入方式
2CyberSecEval (1/2/3/4)meta-llama/PurpleLlama4.4k2023-12跨多类任务(不安全代码 / Prompt Injection / 攻击辅助 / AutoPatchBench 等)Meta 出品,覆盖 LLM "防/攻"两端arXiv:2312.04724 / arXiv:2408.01605
3CyberGymsunblaze-ucb/cybergym7842025-06真实世界漏洞分析任务(240GB 数据集)UC Berkeley 出品,强调 real-world,配 4 个示例 Agent(Star 一个多月翻倍,375→784)arXiv:2506.02548(ICLR 2026)
4XBOW Validation Benchmarksxbow-engineering/validation-benchmarks6942025-06104 道 Web 漏洞挑战(Jeopardy CTF)XBOW(首个登顶 HackerOne 的 AI)出品;⚠️ 已被主流模型刷至约 100% 饱和,仓库转为历史保留XBOW Engineering Blog
5Cybenchandyzorigin/cybench3172024-0840 道专业级 CTF 任务(17 个子任务)Stanford CRFM,支持 Unguided / Subtask 双模式arXiv:2408.08926(ICLR 2025)
6InterCode-CTFprinceton-nlp/intercode2552023-06100 道 picoCTF 题Bash/SQL/Python/CTF 交互式代码 Agent 评测arXiv:2306.14898(NeurIPS 2023 D&B)
7NYU CTF BenchNYU-LLM-CTF/NYU_CTF_Bench1712024-06200 题正式 + 55 题开发集,6 大类CSAW CTF 历年题目 + Docker 化部署arXiv:2406.05590(NeurIPS 2024 D&B)
8AutoPenBenchlucagioacchini/auto-pen-bench972024-1033 个任务(22 In-Vitro + 11 真实 CVE)生成式 Agent 渗透测试通用评测arXiv:2410.03225(EMNLP Industry 2025)
9inspect_cyberUKGovernmentBEIS/inspect_cyber382025-06通用扩展(任务可插拔)UK AI Security Institute 官方 Agentic Cyber 评估扩展
10CVE-Benchuiuc-kang-lab/cve-bench2025-0340 个 critical 严重程度 CVE首个基于真实 CVE 的 Web 漏洞利用 Agent 评测arXiv:2503.17332(ICML 2025)
11BountyBenchbountybench/bountybench2025-0525 个真实 GitHub 项目 + Bug Bounty用美元金额量化攻防影响力Stanford CRFM Blog(2025-05)
12SEC-benchSEC-bench/SEC-bench2025-06200 个 C/C++ 真实 CVE,PoC + 补丁双任务首个全自动化的真实安全工程评测arXiv:2506.11791(NeurIPS 2025)
13CTFTinyNYU-LLM-CTF/CTFTiny2025-0850 题轻量 CTF 子集配套 CTFJudge(LLM-as-a-Judge),降低复现成本arXiv:2508.05674(AAAI 2026)

备注:标 的 Stars 表示数据缺失或仓库较新。许多 Agent 项目(PentestGPT、cochise、xOffense、Cyber-Zero、deadend-cli 等)会在自己 README 中报告在 NYU CTF Bench / Cybench / AutoPenBench / XBOW 等 Benchmark 上的得分。 Note: "—" means missing data or a new repo. Many agent projects report scores against these benchmarks in their own READMEs.

Benchmark 选型小贴士|Selection Cheatsheet

评测目标 / Goal推荐 Benchmark / Recommendation
通用 CTF 能力 / General CTFNYU CTF Bench(200 题)、Cybench(40 题精选)、InterCode-CTF(轻量起步)
真实漏洞利用 / Real-world ExploitXBOW(104 Web)、CyberGym(真实漏洞 240GB)、AutoPenBench(CVE 任务)、CVE-Bench(Web)、SEC-bench(C/C++ CVE)、TSecBench(云鼎黑客松靶场)
LLM 安全 / 红队基础 / LLM Safety & Red TeamCyberSecEval(Meta 全家桶)
经济影响量化 / Economic ImpactBountyBench
政府级评估扩展 / Government-gradeinspect_cyber(UK AISI)
快速回归 / Lightweight RegressionCTFTiny

💼 商业化解决方案

Commercial Solutions

本节盘点全球范围内主流的 AI / Agentic 智能渗透测试 / 自主攻击安全 商业化产品。分为「国外」与「国内」两个子表。国外部分经全网核查(融资记录、公司估值、官网定价、并购/退出事件、权威媒体报道)后,按公司/产品的融资规模、估值与行业影响力精选 Top 20——原列表中缺乏可查融资证据、无第三方媒体报道、疑似早期占位官网的长尾条目已剔除(如 KinoSec、Casco、PentX、Revelion、qriousec、Penligent、bugbunny ai、Sec1、Zentinel、Shinobi Security、AutoVAPT.ai、RedVeil.ai、PAIStrike、Novee、AISLE、Pensar、Origin/Prelude、Hound、PentestGPT Pro 等)。国外首位为 Anthropic 的 Mythos(本身为前沿模型而非纯渗透产品,但其安全能力已构成该赛道的现象级存在,故保留)。 This section enumerates representative commercial AI / Agentic penetration testing & autonomous offensive security products worldwide. The international table has been fact-checked against funding records, valuations, official pricing pages, M&A/exit events, and credible media coverage, then narrowed to the Top 20 by funding scale, valuation, and market influence — long-tail entries lacking verifiable funding or press coverage were removed.

🌍 国外厂商 Top 20(按融资规模 / 估值 / 影响力排序)

International Vendors — Top 20 (ranked by funding, valuation & market influence)

#公司产品官网融资 / 估值 / 影响力证据产品定位与特色
1Anthropic ⭐新补充Claude Mythosanthropic.com/claude/mythos万亿美元级估值母公司,Project Glasswing 覆盖 150+ 关键基础设施机构🔥 2026 年最受关注的 AI 安全模型,无需专项安全训练即能发现数千 0day 并自主编写完整利用链,被美国财政部与美联储联合推荐
2PenteraPentera AVPpentera.io累计融资 $250-314M,估值 $1B,ARR 突破 $100M(2026-01),1200+ 企业客户AI 驱动的暴露验证平台(Exposure Validation),覆盖身份/终端/网络/云,持续真实攻击模拟(含 LockBit/BlackCat 等勒索家族)
3XBOWXBOWxbow.com2026-03 完成 $120M Series C(DFJ Growth/Northzone 领投),估值超 $1B,成立仅 26 个月即成独角兽首个登顶 HackerOne 排行榜的 AI,自主攻击性安全平台,真实 exploit 独立验证每一发现
4Aikido SecurityAikido AI Pentestaikido.dev/attack/aipentest2026-01 完成 $60M Series B(DST Global 领投),估值 $1B,欧洲史上最快独角兽网络安全公司All-in-one 应用安全平台,AI Pentest 为其模块之一,代码/云/应用统一安全平台
5SPLXSPLX (含 agentic-radar)splx.ai2025-11 被纳斯达克上市公司 Zscaler(NASDAQ: ZS)收购,商业化验证等级最高的退出事件LLM Agent 工作流安全扫描 + 红队,开源 agentic-radar
6Horizon3.aiNodeZero®horizon3.ai累计融资 $183.5M,估值 $660-750M(NEA 领投 $100M Series D)自称 "World's Best AI Hacker",无 Agent 部署,已执行 24 万+ 次自主渗透测试,客户含 NSA 与 4 家财富 10 强
7HadrianHadrianhadrian.io荷兰/伦敦网络安全公司,多轮 Growth 融资(Notion Capital 等机构),Gartner Peer Insights 常客持续攻击面管理 + Agentic AI 自主渗透,覆盖域名/子域名/证书/IP 全资产测绘
8RunSybilSybilrunsybil.com2026-03 完成 $40M 融资(Khosla Ventures 领投),创始人为 OpenAI 首位安全员工自主 Web 应用渗透 AI Agent,强调与人工 pentester 协作
9Strix (Usestrix)Strixusestrix.com开源版本 GitHub 60k+ Stars(社区影响力最高,一个多月激增 19k),商业化融资已启动开源 + 商业双栈 AI 黑客,动态运行代码找漏洞并用真实 PoC 验证
10Terra SecurityTerra Portalterra.security2025-09 完成 $30M Series A(Felicis Ventures 领投),累计融资 $38M+首个 Agentic AI + Human-in-the-Loop 持续渗透测试平台
11CalypsoAICalypsocalypsoai.com累计融资 $40.8M,估值 $145M,2018 年成立的老牌厂商,Gartner Cool Vendor企业级 GenAI 安全 + 红队评估
12CorridorCorridorcorridor.dev2026-03 完成 $25M Series A,创始人 Jack Cable 为美国前 CISA 安全工程师AI 生成代码实时安全护栏,源头级漏洞检测
13Veria LabsVeria CTF Agentverialabs.com2026-02 完成 $3.2M 种子轮,出自 CTFtime 美国第一战队,BSidesSF 2026 CTF 52/52 全胜夺冠自主 CTF 求解 Agent,多模型并行"蜂群"架构
14DreadnodeDreadnodedreadnode.io累计融资 $14M,估值 $60M,前 Microsoft AI Red Team 核心成员创办攻击性 ML 研究平台,聚焦 AI 系统评测与网络靶场
15MindgardMindgardmindgard.ai累计融资 $11.9M,Lancaster University 学术孵化,2026 Gartner 新兴技术报告收录专注 AI / LLM 红队(测 AI 模型本身),含 Mindgard Lite 自助平台
16Hex SecurityHexhex.coY Combinator 2026 冬季批入选企业,已获种子轮融资AI Agent 驱动的持续自主渗透测试
17Harmony IntelligenceHarmonyharmonyintelligence.com2025-03 完成 $3M 种子轮(Airtree 领投,30+ 投资人参与)AI 红队 + 安全评估,替代传统年度人工渗透
18TheoriXint / Xint Codexint.ioDARPA AIxCC 2025 决赛季军(RoboDuck),公开对比复现并超越 Anthropic Mythos 发现数一线攻防专家创办的老牌安全公司,AI 代码审计与渗透产品
19MindFortMindFortmindfort.ai2026-04 完成 $3M+ 种子轮(Y Combinator/468 Capital/CRV 参投),创始人为 OpenAI/Anthropic 前员工自主红队 AI Agent,长期在后台运行守护组织安全
20HacktronHacktron AIhacktron.ai累计融资 $3.5M,估值 $9.3M,创始团队为精英 CTF 竞技选手端到端 AI 渗透 / 漏洞挖掘平台,每次代码变更即触发安全测试

🇨🇳 国内厂商

Domestic Vendors (China)

#公司产品官网产品定位与特色
1绿盟科技绿盟智能渗透系统 AI-PTSAI-PTS 产品页基于"风云卫大模型 SecLLM + 多智能体(MAS)",2025-08 正式发布。聚焦 Web 应用安全测试与自动化渗透,含 8.8 万+ 漏洞知识图谱、8600+ POC 库
2京东云 ⭐新补充AIPTS AI 智能渗透测试服务京东云 AIPTS2026-06 正式上线,"One For All"理念服务多安全角色;自然语言发起任务 + AI 自动编排(资产探测/接口验证/漏洞分析)+ 攻击路径动态推进 + 一键生成攻击链证据报告,隶属京东云全栈大模型安全产品体系
3360 ⭐新补充"破阵子" 渗透测试智能体360.cn专属安全记忆机制(企业资产/权限/历史风险持续沉淀)+ 双引擎架构(批量常态化巡检 + 业务逻辑深度风险挖掘)+ 全流程闭环(发现→核验→整改复测);已具备 AI 应用新型风险检测(提示词注入/智能体越权),实战覆盖 132 家关基单位,发现 312 个有效漏洞(含 46 个 AI 新型漏洞),零误报
4阿里云 ⭐新补充Agentic BAS 智能渗透验证阿里云开发者社区2026-07-16 开放邀测,千问大模型驱动"三段式调度多 Agent 协同架构"(侦察/渗透/验证/报告 Agent + 中心调度),可还原完整攻击链(非孤立漏洞点),覆盖 AI 生成代码 / Agent 应用新型风险(Prompt 注入、工具滥用、RAG 投毒),支持每周例行自动验证与合规留痕
5万径安全(Yaklang)万径千机 / 小智 智能渗透机器人megavector.cn国内首款融合知识图谱与大模型的智能渗透机器人,"AI+YAK" 双引擎(YAK 为自研网络安全语言)
6长亭科技无锋chaitin.com--
7斗象科技(漏洞盒子)蛙池AIdigpool.cn全球首款"原生 AI"漏洞挖掘工具 / 白帽工作台。对话式挖洞,AI 自主拆解渗透意图,内置 SQLi/XSS/RCE/上传等漏洞检测专家技能矩阵
8奇安信AI 加特林 自动化渗透测试系统qianxin.com / AI"自动化漏洞攻击的火力平台",能在数分钟内将漏洞公告转为可执行的渗透链;与 QAX-GPT 安全大模型联动
9安恒信息AI 渗透测试智能体(基于恒脑 3.0)dbappsecurity.com.cn国内首个安全垂域大模型"恒脑"驱动的渗透 Agent,三大能力:自动化风险发现 + 任务规划、智能调度渗透工具、深度解析被动流量
10悬镜安全灵脉 PTE AI 自动化渗透测试平台pte.xmirror.cn结合漏扫工具与专家渗透优势,将专家能力训练为 AI,半自动化 / 自动化检测业务逻辑漏洞

🎯 选型对照(按典型场景)

Pick by Scenario

场景 / Scenario推荐产品(国外)推荐产品(国内)
Web App / API 自主渗透XBOW、Pentera、Strix、Mythos绿盟 AI-PTS、京东云 AIPTS、斗象蛙池AI
生产环境安全验证Horizon3.ai NodeZero、Pentera绿盟 AI-PTS、阿里云 Agentic BAS
漏洞赏金 / Bug HuntingXBOW、Strix、Veria Labs斗象蛙池AI、长亭 chainreactors
持续攻击面 + 攻击模拟Hadrian、Pentera、Terra Security360 破阵子、华云安灵刃
业务逻辑 / 复杂渗透XBOW、RunSybil、Mythos悬镜灵脉 PTE、万径千机 / 小智
火力打击型自动化漏洞利用Horizon3.ai NodeZero、Mythos奇安信 AI 加特林
LLM / Agent 红队(测 AI 本身)Mindgard、Dreadnode、SPLX(已被 Zscaler 收购)
AI 生成代码 / Agent 新型风险Corridor、Harmony Intelligence阿里云 Agentic BAS、360 破阵子
CTF / 竞赛型自主求解Veria Labs、Hacktron

📚 Awesome List 资源汇编

Awesome List Collection

本节汇总专门收录 Offensive AI / AI 安全相关精选资源的 Awesome List 仓库,本文档大量内容来自这几个 list 的交叉合并。 This section gathers Awesome List–style repositories. This document is largely derived from cross-merging the following lists.

#仓库Stars维护者内容定位
1fr0gger/Awesome-GPT-Agents ⭐新补充6.6kfr0gger网络安全 GPT Agents 全景清单,攻防双方向覆盖
2jiep/offensive-ai-compilation1.4kjiep攻击性 AI 综合资源(对抗 ML / 渗透 / 钓鱼 / 生成式 AI 滥用)
3ottosulin/awesome-ai-security1.4kottosulin通用 AI 安全资源集合(攻防兼顾)
4TalEliyahu/Awesome-AI-Security861TalEliyahu偏 AI 系统防御侧的资源、研究与工具
5EvanThomasLuke/Awesome-AI-Hacking-Agents653EvanThomasLukeAI Hacking Agent 全景 + AIxCC 决赛队伍 + 商业产品 + 论文(一个多月 Star 从 258 涨至 653)
6raphabot/awesome-cybersecurity-agentic-ai ⭐新补充578raphabot网络安全 Agentic AI 精选资源(MCP / 工具 / 框架 / 论文 / 社区)
7Eyadkelleh/awesome-skills-security ⭐新补充374Eyadkelleh基于 SecLists 精选打包的 Agent Skill 合集(Fuzzing/密码字典/Payload/Webshell/LLM 测试等),60+ Agent 兼容
8simon-p-j-r/LLM4Pentest352simon-p-j-r基于《Hackers or Hallucinators?》论文整理的 LLM 自动化渗透测试资源合集:105 篇学术论文 + 开源工具 / 博客 / 评测基准(自项目主表迁入)
9gmh5225/awesome-ai-security44gmh5225面向渗透测试者 / 漏洞猎人 / 安全研究的 AI 安全精选

⚠️ 变动说明(2026-09-02):原收录的 ox01024/awesome-offensive-security-ai 已被作者删除(404),本轮移除;EvanThomasLuke/Awesome-AI-Hacking-Agents 重新排序时反超 raphabot 列表。2026-09-07:simon-p-j-r/LLM4Pentest(352 Stars)实为资源合集而非 Agent 项目,自项目主表迁入本节。 Changelog note: ox01024/awesome-offensive-security-ai was deleted by its owner (404) and removed. 2026-09-07: simon-p-j-r/LLM4Pentest (352 stars) is a curated resource collection rather than an agent project, moved here from the main project table.


📊 统计概览

Statistics Overview

  • 项目总数 / Total projects:53(项目主表 46 个 + AIxCC CRS 系统 7 个;2026-09-07 移除 9 个偏离主线的项目,LLM4Pentest 迁入 Awesome List)
  • 进攻型 / 安全专用模型 / Models:11 个(A. 无对齐进攻型 6 个:Qwythos、WhiteRabbitNeo/DeepHat、Lily-Cybersecurity、BaronLLM、CyberStrike-OffSec-35B、BugTraceAI-CORE-Ultra-27B;B. 安全专用 5 个:VulnLLM-R、Foundation-Sec-8B-Reasoning、CyberSecQwen-4B、Meta-SecAlign、Titus-CybersecurityLLM)
  • 进攻型 AI Skill / Skills:3 个,均为 Star ≥ 100 的纯 Skill 项目(Anthropic-Cybersecurity-Skills、ctf-skills、awesome-skills-security)
  • 进攻型 AI MCP Server / MCP Servers:7 个,均为 Star ≥ 100 的安全工具集合类 MCP(PortSwigger mcp-server、MCP-Kali-Server、mcp-security-hub、MetasploitMCP、BloodHound-MCP-AI、mcp-shodan、pentest-mcp)
  • 收录论文 / Papers116 篇(A. 渗透 & 红队 62 篇 / B. 漏洞挖掘 20 篇 / C. 评测 & 训练 34 篇;覆盖 2023-06 → 2026-08;2026-09-11 与 LLM4Pentest 交叉核对:勘误多项 + 补充 47 篇 + 移除 4 篇 LLM 自身安全类)
  • 收录 Benchmark / Benchmarks:13 个(覆盖 2023-06 → 2026-07)
  • 商业产品 / Commercial products:32 个(国外 Top 20,经融资/估值/媒体报道核查精选 + 国内 12)
  • Awesome List:9 个(2026-09-07 新增 LLM4Pentest 资源合集;此前 ox01024/awesome-offensive-security-ai 已被作者删除并移除)
  • 主要语言 / Languages:Python ≈ 70%,TypeScript ≈ 12%,Go ≈ 8%,其他 ≈ 10%
  • 领域趋势 / Trends
    • 2023:方向探索(Happe & Cito、PentestGPT、InterCode-CTF)
    • 2024:基础工作落地 + 评测基准建立(Cybench、NYU CTF Bench、AutoPenBench、EnIGMA、Fang 三部曲、PenHeal、AutoPT)
    • 2025:多 Agent 协作 + 训练方法 + 自主 AD 渗透 + 真实 CVE 评测 + AIxCC 决赛 + RL 渗透 + 实证研究(VulnBot、cochise、D-CIPHER、Cyber-Zero、xOffense、CVE-Bench、SEC-bench、CyberGym、ATLANTIS、Buttercup、RapidPen、Pentest-R1、OCCULT、PACEbench)
    • 2026 起:商业化加速(XBOW、Pentera、Horizon3.ai、Hacktron、MindFort、Anthropic Mythos 等纷纷涌现)+ 持续基准化(PentestEval、PenForge、CTFusion、HackWorld、ExploitGym、AgentCyberRange)+ 靶场与训练数据基建(RangeFactory、CyberForge、CTF-Dojo)+ 攻防闭环与实战化(ZERO-APT 攻防裁判闭环、FuzzingBrain V2 实战挖 0day、Agents4Pentest 综述成型)

🕐 最后更新时间 / Last updated:2026-09-11 (UTC+8)


⚠️ 免责声明

Disclaimer

本文档汇总的所有项目、论文与 Benchmark 仅供学习研究、企业内部安全防护与授权渗透测试使用。 在任何情况下,使用者均须严格遵守所在国家和地区的法律法规以及目标组织的授权范围;严禁将其用于未经授权的攻击、入侵、破坏或其他任何违法活动。任何因滥用本文档收录内容而引发的法律责任、经济损失或安全后果,均由使用者自行承担,与本文档作者及所列项目维护者无关。

All projects, papers, and benchmarks compiled in this document are intended solely for learning, internal enterprise security hardening, and authorized penetration testing. Users must strictly comply with the laws and regulations of their jurisdiction as well as the authorization scope granted by the target organization. Any unauthorized attack, intrusion, sabotage, or other illegal activities are strictly prohibited. Any legal liability, financial loss, or security consequence resulting from misuse of the contents herein shall be borne entirely by the user, and is unrelated to the authors of this document or the maintainers of the listed projects.

ai-benchmarks
ai-hacking
ai-pentesting
ai-red-teaming
ai-security
autonomous-penetration
awesome-list
ctf
cybersecurity
hacking-agents
hacking-tool
intelligent-penetration
llm-security
offensive-ai
offensive-security
pentest
pentest-tool
redteam
security-tools

Contributors

Yeti-791

25 commits