IBM/awesome-agentic-workflow-optimization

Survey paper: From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents.

86

9 commits

updated Apr 3, 2026

See the code

README

Awesome Workflow Optimization for LLM Agents

Paper

A curated list of papers on workflow optimization for LLM agents.

This repository accompanies the survey paper: From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents (https://arxiv.org/abs/2603.22386).

Overview

This list focuses on papers whose main contribution is workflow optimization. To keep the repository concise and method-centric, it does not aim to cover general survey papers, benchmarks, datasets, or framework/tooling papers.

The list is organized by when workflow structure is determined: static optimization and dynamic optimization.

Table of Contents

Static Optimization

Offline template search over constrained design spaces

TitleYearPaper
AFlow: Automating Agentic Workflow Generation2025Link
Automated Design of Agentic Systems2025Link
A²Flow: Automating Agentic Workflow Generation via Self-Adaptive Abstraction Operators2026Link
SEW: Self-Evolving Agentic Workflows for Automated Code Generation2025Link
Evolutionary Generation of Multi-Agent Systems2026Link

Node-level optimization inside fixed scaffolds

TitleYearPaper
DSPy: Compiling Declarative Language Model Calls into State-of-the-Art Pipelines2024Link
Large Language Models as Optimizers2024Link
Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers2024Link
CAPO: Cost-Aware Prompt Optimization2025Link
GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning2026Link
Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System2025Link

Joint optimization of structure and local configuration

TitleYearPaper
Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies2026Link
Learning Multi-Agent Communication from Graph Modeling Perspective2024Link
Maestro: Joint Graph & Config Optimization for Reliable AI Agents2025Link

Verifiability in static workflow optimization

TitleYearPaper
MermaidFlow: Redefining Agentic Workflow Generation via Safety-Constrained Evolutionary Programming2025Link
VFlow: Discovering Optimal Agentic Workflows for Verilog Generation2026Link

Dynamic Optimization and Runtime Adaptation

Selection and pruning as the lightest form of runtime adaptation

TitleYearPaper
Cut the Crap: An Economical Communication Pipeline for LLM-Based Multi-Agent Systems2025Link
Adaptive Graph Pruning for Multi-Agent Communication2025Link
DAGP: Difficulty-Aware Graph Pruning for LLM-Based Multi-Agent Systems2025Link
AgentDropout: Dynamic Agent Elimination for Token-Efficient and High-Performance LLM-Based Multi-Agent Collaboration2025Link
A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration2024Link
MasRouter: Learning to Route LLMs for Multi-Agent Systems2025Link
SkillOrchestra: Learning to Route Agents via Skill Transfer2026Link

Construct-then-execute: pre-execution workflow generation

TitleYearPaper
Difficulty-Aware Agentic Orchestration for Query-Specific Multi-Agent Workflows2026Link
Assemble Your Crew: Automatic Multi-Agent Communication Topology Design via Autoregressive Graph Generation2026Link
G-Designer: Architecting Multi-Agent Communication Topologies via Graph Neural Networks2025Link
Dynamic Generation of Multi-LLM Agents Communication Topologies with Graph Diffusion Models2025Link
Multi-Agent Architecture Search via Agentic Supernet2025Link
ScoreFlow: Mastering LLM Agent Workflows via Score-Based Preference Optimization2025Link
FlowReasoner: Reinforcing Query-Level Meta-Agents2025Link
Workflow-R1: Group Sub-sequence Policy Optimization for Multi-Turn Workflow Construction2026Link
AutoFlow: Automated Workflow Generation for Large Language Model Agents2024Link
WorkflowLLM: Enhancing Workflow Orchestration Capability of Large Language Models2025Link
RobustFlow: Towards Robust Agentic Workflow Generation2025Link
ComfyUI-R1: Exploring Reasoning Models for Workflow Generation2025Link
AutoAgents: A Framework for Automatic Agent Generation2024Link

In-execution editing: interleaving execution with structural change

TitleYearPaper
DyFlow: Dynamic Workflow Framework for Agentic Reasoning2025Link
AgentConductor: Topology Evolution for Multi-Agent Competition-Level Code Generation2026Link
Aime: Towards Fully-Autonomous Multi-Agent Framework2025Link
AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration2026Link
MetaGen: Self-Evolving Roles and Topologies for Multi-Agent LLM Reasoning2026Link
ProAgent: From Robotic Process Automation to Agentic Process Automation2023Link
Flow: Modularized Agentic Workflow Automation2025Link
EvoFlow: Evolving Diverse Agentic Workflows on the Fly2025Link
DebFlow: Automating Agent Creation via Agent Debate2025Link
QualityFlow: An Agentic Workflow for Program Synthesis Controlled by LLM Quality Checks2025Link

Contributing

Contributions are welcome! To suggest a new paper, please open an issue with the following information:

  1. Paper title, year, and a link to the official paper page.
  2. The subsection you think it belongs to.
  3. A brief reason why its main contribution is workflow optimization.

We will review and update the list accordingly. Please note:

  • Only papers whose main contribution is workflow optimization will be included.
  • Each paper is placed in exactly one subsection that best matches its main contribution.
  • We prefer official paper pages (e.g., conference proceedings, arXiv).

Citation

If you find this repository or the accompanying survey helpful, please cite:

@article{yue2026survey,
  title={From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents},
  author={Yue, Ling and Bhandari, Kushal Raj and Ko, Ching-Yun and Patel, Dhaval and Lin, Shuxin and Zhou, Nianjun and Gao, Jianxi and Chen, Pin-Yu and Pan, Shaowu},
  journal={arXiv preprint arXiv:2603.22386},
  year={2026}
}

Star History

Star History Chart

agent
generation
optimization
survey
workflow

IBM/awesome-agentic-workflow-optimization

Survey paper: From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents.

86

9 commits

updated Apr 3, 2026

See the code

README

Awesome Workflow Optimization for LLM Agents

Paper

A curated list of papers on workflow optimization for LLM agents.

This repository accompanies the survey paper: From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents (https://arxiv.org/abs/2603.22386).

Overview

This list focuses on papers whose main contribution is workflow optimization. To keep the repository concise and method-centric, it does not aim to cover general survey papers, benchmarks, datasets, or framework/tooling papers.

The list is organized by when workflow structure is determined: static optimization and dynamic optimization.

Table of Contents

Static Optimization

Offline template search over constrained design spaces

TitleYearPaper
AFlow: Automating Agentic Workflow Generation2025Link
Automated Design of Agentic Systems2025Link
A²Flow: Automating Agentic Workflow Generation via Self-Adaptive Abstraction Operators2026Link
SEW: Self-Evolving Agentic Workflows for Automated Code Generation2025Link
Evolutionary Generation of Multi-Agent Systems2026Link

Node-level optimization inside fixed scaffolds

TitleYearPaper
DSPy: Compiling Declarative Language Model Calls into State-of-the-Art Pipelines2024Link
Large Language Models as Optimizers2024Link
Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers2024Link
CAPO: Cost-Aware Prompt Optimization2025Link
GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning2026Link
Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System2025Link

Joint optimization of structure and local configuration

TitleYearPaper
Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies2026Link
Learning Multi-Agent Communication from Graph Modeling Perspective2024Link
Maestro: Joint Graph & Config Optimization for Reliable AI Agents2025Link

Verifiability in static workflow optimization

TitleYearPaper
MermaidFlow: Redefining Agentic Workflow Generation via Safety-Constrained Evolutionary Programming2025Link
VFlow: Discovering Optimal Agentic Workflows for Verilog Generation2026Link

Dynamic Optimization and Runtime Adaptation

Selection and pruning as the lightest form of runtime adaptation

TitleYearPaper
Cut the Crap: An Economical Communication Pipeline for LLM-Based Multi-Agent Systems2025Link
Adaptive Graph Pruning for Multi-Agent Communication2025Link
DAGP: Difficulty-Aware Graph Pruning for LLM-Based Multi-Agent Systems2025Link
AgentDropout: Dynamic Agent Elimination for Token-Efficient and High-Performance LLM-Based Multi-Agent Collaboration2025Link
A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration2024Link
MasRouter: Learning to Route LLMs for Multi-Agent Systems2025Link
SkillOrchestra: Learning to Route Agents via Skill Transfer2026Link

Construct-then-execute: pre-execution workflow generation

TitleYearPaper
Difficulty-Aware Agentic Orchestration for Query-Specific Multi-Agent Workflows2026Link
Assemble Your Crew: Automatic Multi-Agent Communication Topology Design via Autoregressive Graph Generation2026Link
G-Designer: Architecting Multi-Agent Communication Topologies via Graph Neural Networks2025Link
Dynamic Generation of Multi-LLM Agents Communication Topologies with Graph Diffusion Models2025Link
Multi-Agent Architecture Search via Agentic Supernet2025Link
ScoreFlow: Mastering LLM Agent Workflows via Score-Based Preference Optimization2025Link
FlowReasoner: Reinforcing Query-Level Meta-Agents2025Link
Workflow-R1: Group Sub-sequence Policy Optimization for Multi-Turn Workflow Construction2026Link
AutoFlow: Automated Workflow Generation for Large Language Model Agents2024Link
WorkflowLLM: Enhancing Workflow Orchestration Capability of Large Language Models2025Link
RobustFlow: Towards Robust Agentic Workflow Generation2025Link
ComfyUI-R1: Exploring Reasoning Models for Workflow Generation2025Link
AutoAgents: A Framework for Automatic Agent Generation2024Link

In-execution editing: interleaving execution with structural change

TitleYearPaper
DyFlow: Dynamic Workflow Framework for Agentic Reasoning2025Link
AgentConductor: Topology Evolution for Multi-Agent Competition-Level Code Generation2026Link
Aime: Towards Fully-Autonomous Multi-Agent Framework2025Link
AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration2026Link
MetaGen: Self-Evolving Roles and Topologies for Multi-Agent LLM Reasoning2026Link
ProAgent: From Robotic Process Automation to Agentic Process Automation2023Link
Flow: Modularized Agentic Workflow Automation2025Link
EvoFlow: Evolving Diverse Agentic Workflows on the Fly2025Link
DebFlow: Automating Agent Creation via Agent Debate2025Link
QualityFlow: An Agentic Workflow for Program Synthesis Controlled by LLM Quality Checks2025Link

Contributing

Contributions are welcome! To suggest a new paper, please open an issue with the following information:

  1. Paper title, year, and a link to the official paper page.
  2. The subsection you think it belongs to.
  3. A brief reason why its main contribution is workflow optimization.

We will review and update the list accordingly. Please note:

  • Only papers whose main contribution is workflow optimization will be included.
  • Each paper is placed in exactly one subsection that best matches its main contribution.
  • We prefer official paper pages (e.g., conference proceedings, arXiv).

Citation

If you find this repository or the accompanying survey helpful, please cite:

@article{yue2026survey,
  title={From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents},
  author={Yue, Ling and Bhandari, Kushal Raj and Ko, Ching-Yun and Patel, Dhaval and Lin, Shuxin and Zhou, Nianjun and Gao, Jianxi and Chen, Pin-Yu and Pan, Shaowu},
  journal={arXiv preprint arXiv:2603.22386},
  year={2026}
}

Star History

Star History Chart

agent
generation
optimization
survey
workflow