🧠 model-native-agentic-ai

🙏 Citation

If you find our survey useful for your research, please consider citing our work:

@misc{sang2025pipelinessurveyparadigmshift,
      title={Beyond Pipelines: A Survey of the Paradigm Shift toward Model-Native Agentic AI}, 
      author={Jitao Sang and Jinlin Xiao and Jiarun Han and Jilin Chen and Xiaoyi Chen and Shuyu Wei and Yongjie Sun and Yuhang Wang},
      year={2025},
      eprint={2510.16720},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2510.16720}, 
}

🌟 Abstract

The rapid evolution of agentic AI marks a new phase in artificial intelligence, where Large Language Models (LLMs) no longer merely respond but act, reason, and adapt. This survey traces the paradigm shift in building agentic AI: from Pipeline-based systems, where planning, tool use, and memory are orchestrated by external logic, to the emerging Model-native paradigm, where these capabilities are internalized within the model’s parameters.

We first position Reinforcement Learning (RL) as the algorithmic engine enabling this paradigm shift. By reframing learning from imitating static data to outcome-driven exploration, RL underpins a unified solution of LLM + RL + Task across language, vision and embodied domains. Building on this, the survey systematically reviews how each capability—Planning, Tool use, and Memory—has evolved from externally scripted modules to end-to-end learned behaviors. Furthermore, it examines how this paradigm shift has reshaped major agent applications, specifically the Deep Research agent emphasizing long-horizon reasoning and the GUI agent emphasizing embodied interaction.

We conclude by discussing the continued internalization of agentic capabilities like Multi-agent collaboration and Reflection, alongside the evolving roles of the system and model layers in future agentic AI. Together, these developments outline a coherent trajectory toward model-native agentic AI as an integrated learning and interaction framework, marking the transition from constructing systems that apply intelligence to developing models that grow intelligence through experience.

📒 Table of Contents

• Core Capabilities: Planning
  • Pipeline-based Paradigm
  • Model-native Paradigm
• Core Capabilities: Tool Use
  • Pipeline-based Paradigm
  • Model-native Paradigm
• Core Capabilities: Memory
  • Short-Term Memory: Long Context
  • Short-Term Memory: Context Management
  • Long-Term Memory
• Applications
  • Deep Research Agent
  • GUI Agent
• Future Direction and Discussion: Emerging Model-native Capabilities
  • Multi-agent Collaboration
  • Reflection

📜 Papers

➤ 3  Core Capabilities: Planning

3.2  Pipeline-based Paradigm

3.3  Model-native Paradigm

➤ 4  Core Capabilities: Tool Use

4.2  Pipeline-based Paradigm

4.3  Model-native Paradigm

➤ 5  Core Capabilities: Memory

5.2  Short-Term Memory: Long Context

Pipeline-based paradigm

Model-native Paradigm

5.3  Short-Term Memory: Context Management

Pipeline-based paradigm

Model-native Paradigm

5.4  Long-Term Memory

➤ 6  Applications

6.1  Deep Research Agent

Pipeline-based paradigm

Model-native Paradigm

6.2  GUI Agent

Pipeline-based paradigm

Model-native Paradigm

➤ 7  Future Direction and Discussion

7.1.1  Emerging Model-native Capabilities: Multi-agent Collaboration

7.1.2  Emerging Model-native Capabilities: Reflection