LowEntropyAI/awesome-proactive-agent

A curated list of papers, benchmarks, project pages, and code for proactive agents.

21

35 commits

updated Sep 20, 2026

See the code

README

Awesome Proactive Agents dynamic banner

Awesome Proactive Agents

Proactive Agent banner

Awesome PRs Welcome Focus Scope

A curated research map for proactive agents: AI systems that infer latent user needs, decide when to intervene, ask for missing context or consent, and initiate useful assistance before a complete explicit command.

If this list is useful, a ⭐ helps others find it.

Companion Guides

  • Research Map: question-driven clusters for quickly locating papers by intervention timing, inference, long-term intent, personalization, evaluation, and safety.
  • Benchmark Matrix: side-by-side benchmark comparison by domain, input stream, proactive target, user model, data type, and metrics.

Contents


Scope

This list prioritizes papers where proactivity is a central research target. The list is broader than computer-use agents: it includes proactive dialogue, planning, recommendation, wearable assistance, GUI/mobile/OS agents, programming assistants, personalization, memory, benchmarks, optimization, and human factors.

Typical inclusion signals:

  • The agent predicts latent intent or missing context before a complete user instruction.
  • The agent decides when to ask, suggest, remind, intervene, execute, or stay silent.
  • The paper evaluates proactive behavior, intervention timing, user control, consent, interruption cost, or personalization.
  • The benchmark or dataset makes proactivity the primary task rather than a side effect of general tool use.

Resource labels:

  • Paper: arXiv, ACL Anthology, DOI, OpenReview, ACM, Springer, or official proceedings page.
  • Website: project page, conference page, lab page, or documentation.
  • Code / Dataset: GitHub, released code, released benchmark, or released dataset.
  • Notes: short English decision card with why the paper matters, proactivity signal, evaluation setup, limitations, and use cases.

Must Read

Selected starting points for understanding the field.

DatePaperWhy read it firstResources
2024-04Towards Human-centered Proactive Conversational AgentsEstablishes the human-centered dimensions of proactive agents: intelligence, adaptivity, and civility.arXiv DOI
2024-10Proactive AgentCanonical shift from reactive LLM agents to active assistance over event streams; introduces ProactiveBench.arXiv OpenReview Star Notes
2024-10Need Help?Strong user-study reference for proactive IDE assistance and intervention timing.arXiv Notes
2025-05ContextAgentExtends proactive agents to open-world sensory contexts and tool calling.arXiv Website Star Notes
2026-02ProAgentBenchReal workflow logs reveal why synthetic proactive data can overestimate performance.arXiv Code Notes
2026-03StreamReadyLearns both what to answer and when enough streaming-video evidence has arrived, with explicit penalties for premature and delayed answers.CVF Website Notes
2026-04KnowU-BenchClosest benchmark to proactive, personalized, consent-aware mobile assistants.arXiv HF Paper Star Notes
2026-05π-BenchSharp long-horizon benchmark for hidden-intent resolution in personal assistant workflows.arXiv Website Star Dataset Notes
2026-08VibeLifeBenchMakes act, ask, and stay-silent decisions explicit across multi-week personal-assistant tasks in a changing world.arXiv Notes
2026-08Why2SpeakTreats speaking and remaining silent as an auditable action policy, exposing the capability–faithfulness trade-off in intervention timing.arXiv Notes

Papers

Foundations, Surveys and Human Factors

DateTitleVenue / SourceTagsResources
2024-04Towards Human-centered Proactive Conversational AgentsSIGIR 2024Definition · Human Factors · DialoguearXiv DOI
2024-10Redefining Proactivity for Information Seeking DialogueSICON 2024Definition · Dialogue · Intent InferenceACL
2025-01When AI-Based Agents Are Proactive: Implications for Competence and System Satisfaction in Human-AI CollaborationBISE 2026Human Factors · Intervention Timing · TrustDOI
2025-02Assistance or Disruption? Exploring and Evaluating the Design and Trade-offs of Proactive AI Programming SupportCHI 2025Human Factors · Intervention Timing · IDEarXiv DOI Notes
2025-03Proactive Conversational AI: A Comprehensive Survey of Advancements and OpportunitiesACM TOIS 2025Survey · Definition · DialogueDOI
2025-08When not to help: planning for lasting human-AI collaborationarXiv 2508Human Factors · Intervention Timing · TrustarXiv Notes
2025-10Check Yourself Before You Wreck Yourself: Selectively Quitting Improves LLM Agent SafetyRegML 2025 WorkshopSafety & Consent · Tool Use · Intervention TimingarXiv OpenReview Notes
2026-01Developer Interaction Patterns with Proactive AI: A Five-Day Field StudyIUI 2026Human Factors · Real-world Data · IDEarXiv DOI Notes
2026-02From Fragmentation to Integration: Exploring the Design Space of AI Agents for Human-as-the-Unit Privacy ManagementCHI 2026Safety & Consent · Privacy · Human FactorsarXiv DOI
2026-02Exploring The Impact of Proactive Generative AI Agent Roles in Time-Sensitive Collaborative Problem-Solving TasksCHI 2026Human Factors · Collaboration · Intervention TimingarXiv DOI
2026-06Designing for Doubt: The Case for Informed Abstention in Autonomous AgentsAIES 2026Safety & Consent · Benchmark · Tool UsearXiv Notes
2026-07AI Assistants OverassistarXiv 2607Human Factors · Intervention Timing · EducationarXiv Notes
2026-08VeriForge: Mitigating Latent Knowledge Gaps in Narrative Drafting via Mixed-Initiative ScaffoldingUIST 2026Human Factors · Intervention Timing · GUIarXiv Notes
2026-08AI Watchdog: Agent Interfaces for Detecting and Defending Against Manipulative Dark Patterns in AI ConversationsarXiv 2608Human Factors · Safety & Consent · Intervention TimingarXiv Notes
2026-09Designing Proactive Thought Partners for WritingarXiv 2609Human Factors · Intervention Timing · PersonalizationarXiv Notes
2026-09Proactive Service Agents: A Unified Decision Framework, Methods, and EvaluationarXiv 2609Survey · Definition · Safety & ConsentarXiv Notes
2026-09When Intelligence Becomes Agency: A Theory of Governed, Proactive Agency for Symbiotic AI SystemsarXiv 2609Definition · Safety & Consent · Intervention TimingarXiv Notes
2026-09Oops, Not Now: PEARL, a RAG-Based Support Agent for Gameplay and What Players Want from AI HelpIEEE CoG 2026Human Factors · Intervention Timing · EducationarXiv Notes
2026-09Breaking Up is Hard to Do: AI Companions that Won't Let Their Users GoarXiv 2609Human Factors · Safety & Consent · DialoguearXiv Notes

Proactive Interaction and Planning

DateTitleVenue / SourceTagsResources
2024-03ProMISe: A Proactive Multi-turn Dialogue Dataset for Information-seeking Intent ResolutionFindings of EACL 2024Clarification · Dialogue · BenchmarkACL
2024-03Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification QuestionsEACL 2024Clarification · Dialogue · Intervention TimingACL Notes
2024-06Ask-before-Plan: Proactive Language Agents for Real-World PlanningFindings of EMNLP 2024Clarification · Planning · Intent InferencearXiv
2024-10Proactive Agent: Shifting LLM Agents from Reactive Responses to Active AssistanceICLR 2025Intent Inference · Benchmark · DesktoparXiv OpenReview Star Notes
2024-11PCQPR: Proactive Conversational Question Planning with ReflectionEMNLP 2024Dialogue · Planning · Intent InferenceACL Notes
2025-01Proactive Conversational Agents with Inner ThoughtsCHI 2025Dialogue · Intent Inference · Intervention TimingarXiv Star Notes
2025-01ProTOD: Proactive Task-oriented Dialogue System Based on LLMsCOLING 2025Dialogue · Planning · Tool UseACL
2025-07Tunable LLM-based Proactive Recommendation AgentACL 2025Recommendation · Personalization · Intent InferenceACL
2025-09PRINCIPLES: Synthetic Strategy Memory for Proactive Dialogue AgentsFindings of EMNLP 2025Dialogue · Memory · SimulationarXiv
2025-10ProMediate: A Simulation Testbed for Evaluating Proactive Mediation in Multi-Party NegotiationFindings of ACL 2026Dialogue · Collaboration · BenchmarkarXiv ACL
2026-01Proactivity-driven Personalized Agents for Advancing Human Learning through Engagement, Reflection, and Self-EfficacyACM CHIIR 2026 WorkshopPersonalization · Intent Inference · EducationarXiv
2026-01Long-term Task-oriented Agent: Proactive Long-term Intent Maintenance in Dynamic EnvironmentsarXiv 2601Long-horizon · Intent Inference · BenchmarkarXiv Notes
2026-01Value of Information: A Framework for Human–Agent CommunicationACL 2026Clarification · Intervention Timing · Safety & ConsentarXiv ACL Notes
2026-03PsyProbe: Proactive and Interpretable Dialogue through User State Modeling for Exploratory CounselingFindings of EACL 2026Dialogue · Intent Inference · Human FactorsACL Notes
2026-05Anticipate and Learn: Unleashing Idle-Time Compute in Proactive AgentsarXiv 2605Intent Inference · Memory · BenchmarkarXiv Website Star Notes
2026-07PROPER Agents: Proactivity Driven Personalized Agents for Advancing Knowledge Gap NavigationFindings of ACL 2026Personalization · Intent Inference · DialogueACL Star Notes
2026-07ProACT: Towards Breakdown-Aware Proactive Agent in Multi-User CollaborationarXiv 2607Collaboration · Intervention Timing · BenchmarkarXiv Notes
2026-07Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive InquirersACL 2026Clarification · Dialogue · OptimizationACL Notes
2026-07ProMed: Shapley Information Gain Guided Reinforcement Learning for Proactive Medical LLMsACL 2026Clarification · Dialogue · OptimizationACL Star Notes
2026-07"Excuse me, may I say something..." CoLabScience, A Proactive AI Assistant for Biomedical Discovery and LLM-Expert CollaborationsACL 2026Collaboration · Intervention Timing · BenchmarkACL Notes
2026-07Let LLM Tutors Ask First: Proactive LLM-Based Tutoring at Scale in a 1,500-Student Online ClassroomACL 2026 Industry TrackEducation · Intent Inference · Real-world DataACL Notes
2026-07When and What to Ask: AskBench and Rubric-Guided RLVR for LLM ClarificationFindings of ACL 2026Clarification · Benchmark · OptimizationACL Notes
2026-07ProActor: Timing-Aware Reinforcement Learning for Proactive Task Scheduling AgentsACL 2026Intervention Timing · Planning · OptimizationACL Notes
2026-08A Self-Triggered Agentic Push Recommendation SystemRecSys 2026Recommendation · Intervention Timing · Real-world DataarXiv Notes
2026-08CLAIM: Leading Open-domain Active Clarification of Large Language Models with Uncertainty MeasurementarXiv 2608Clarification · Dialogue · OptimizationarXiv Notes
2026-08JarvisBench: Always-on Intelligence Between Humans and AgentsarXiv 2608Intervention Timing · Collaboration · BenchmarkarXiv Website Star Notes
2026-08Bridging Search and CRM: Productionizing AI Product Research Agents for Customer Re-EngagementarXiv 2608Recommendation · Personalization · Real-world DataarXiv Notes
2026-08Why2Speak: Faithful Reasoning for Abstaining Action PoliciesarXiv 2608Intervention Timing · Collaboration · Safety & ConsentarXiv Notes
2026-08Clarify User Expertise: Towards Proactive Conversational Agents Tailoring Responses to User ProficiencyFindings of EMNLP 2026Clarification · Personalization · DialoguearXiv Notes
2026-08Beyond Information Seeking: Severity-Aware Question Supervision for Proactive Medical DialoguearXiv 2608Clarification · Dialogue · OptimizationarXiv Notes
2026-08From Passive Response to Proactive Correction: Enhancing LLM Robustness Against Input Fact PerturbationsEMNLP 2026Intent Inference · Safety & Consent · DialoguearXiv Notes
2026-09Speak for Me: Giving LLMs the Situational Awareness to Participate in a MeetingEMNLP 2026Collaboration · Intervention Timing · DialoguearXiv Star Notes
2026-09Ask Before You Optimize: Dynamic Pre-Formulation Clarification for Interactive OptimizationarXiv 2609Clarification · Planning · BenchmarkarXiv Notes
2026-09CC-Mediation: Evaluating Large Language Models for Cross-Cultural Conflict MediationarXiv 2609Dialogue · Intervention Timing · BenchmarkarXiv Star Notes
2026-09IdeaAMBIG: Benchmarking Implementation-Critical Gaps in Research-Idea SpecificationsarXiv 2609Clarification · Benchmark · Tool UsearXiv Notes
2026-09ProMediConv: Benchmarking Proactive Conversational Agents in Legal Dispute MediationFindings of EMNLP 2026Dialogue · Collaboration · BenchmarkarXiv Star Notes

GUI, Mobile, OS and Coding Agents

DateTitleVenue / SourceTagsResources
2024-10Need Help? Designing Proactive AI Assistants for ProgrammingCHI 2025IDE · Intervention Timing · Human FactorsarXiv Notes
2025-03CodingGenie: A Proactive LLM-Powered Programming AssistantFSE 2025 CompanionIDE · Intent Inference · Tool UsearXiv DOI Star Notes
2025-07FingerTip 20K: A Benchmark for Proactive and Personalized Mobile LLM AgentsICLR 2026Mobile · Personalization · BenchmarkarXiv Star Notes
2025-07ProactiveVA: Proactive Visual Analytics with LLM-Based UI AgentIEEE VIS 2025 / TVCG 2026GUI · Intervention Timing · Human FactorsarXiv DOI Notes
2025-08AppAgent-Pro: A Proactive GUI Agent System for Multidomain Information Integration and User AssistanceCIKM 2025GUI · Intent Inference · Tool UsearXiv Star Notes
2025-09VeriOS: Query-Driven Proactive Human-Agent-GUI Interaction for Trustworthy OS AgentsarXiv 2509OS · Safety & Consent · ClarificationarXiv Star Notes
2026-02ProAgentBench: Evaluating LLM Agents for Proactive Assistance with Real-World DataarXiv 2602Real-world Data · Intervention Timing · BenchmarkarXiv Code Notes
2026-02ProactiveMobile: A Comprehensive Benchmark for Boosting Proactive Intelligence on Mobile DevicesCVPR 2026Mobile · Intent Inference · BenchmarkarXiv CVF Notes
2026-03PIRA-Bench: A Transition from Reactive GUI Agents to GUI-based Proactive Intent Recommendation AgentsarXiv 2603GUI · Intent Inference · BenchmarkarXiv Website Dataset Notes
2026-03GUIDE: A Benchmark for Understanding and Assisting Users in Open-Ended GUI TasksCVPR 2026GUI · Intent Inference · BenchmarkarXiv Website Dataset Notes
2026-03Ask or Assume? Uncertainty-Aware Clarification-Seeking in Coding AgentsEMNLP 2026IDE · Clarification · Intervention TimingarXiv Notes
2026-04Ambig-SWE: Interactive Agents to Overcome Underspecificity in Software EngineeringICLR 2026IDE · Clarification · BenchmarkOpenReview Star Notes
2026-04Help Without Being Asked: A Deployed Proactive Agent System for On-Call Support with Continuous Self-ImprovementarXiv 2604Real-world Data · Intervention Timing · Skill LearningarXiv Star Notes
2026-04Proactive Agent Research Environment: Simulating Active Users to Evaluate Proactive AssistantsarXiv 2604Simulation · Intervention Timing · BenchmarkarXiv Website Star Notes
2026-04KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent EvaluationarXiv 2604Mobile · Personalization · Safety & ConsentarXiv HF Paper Star Notes
2026-05An Empirical Study of Proactive Coding Assistants in Real-World Software DevelopmentarXiv 2605IDE · Real-world Data · BenchmarkarXiv Notes
2026-05ToolCUA: Towards Optimal GUI-Tool Path Orchestration for Computer Use AgentsarXiv 2605GUI · Tool Use · OptimizationarXiv Star Notes
2026-04From Reactive to Proactive: Assessing the Proactivity of Voice Agents via ProVoice-BenchInterspeech 2026Multimodal / Wearable · Intervention Timing · BenchmarkarXiv Notes
2026-06Perceive Before Reasoning: A Pre-Reasoning Perception Framework for Efficient and Reliable Proactive Mobile AgentsarXiv 2606Mobile · Intervention Timing · Tool UsearXiv Notes
2026-07InquireMobile: Teaching VLM-based Mobile Agent to Request Human Assistance via Reinforcement Fine-TuningACL 2026Mobile · Safety & Consent · ClarificationACL Website Notes
2026-07PersonalAlign: Hierarchical Implicit Intent Alignment for Personalized GUI Agent with Long-Term User-Centric RecordsACL 2026GUI · Personalization · Intent InferenceACL Notes
2026-08Active-SWE: Benchmarking Coding Agents for Proactive Bug Fixing without Issue ReportsarXiv 2608IDE · Benchmark · Tool UsearXiv Notes
2026-08ITO: Real-time Browser Tab Orchestration Through Intent DetectionUIST 2026GUI · Intent Inference · Human FactorsarXiv Notes
2026-08Act2Intention: A Benchmark For Developing Active Mobile Agents Through Inferring User Intention from GUI ActionsarXiv 2608Mobile · Intent Inference · BenchmarkarXiv Star Notes
2026-08On the Prospects of Dynamic LLM Conversations in Software DevelopmentarXiv 2608IDE · Human Factors · Intervention TimingarXiv Notes
2026-08Towards Cognitive Process-Aware Proactive Writing SupportarXiv 2608GUI · Intent Inference · Human FactorsarXiv Notes
2026-08InsightToast: Proactive Information Retrieval & Glanceable Visualization in the Side Channel of Data-Rich MeetingsUIST 2026GUI · Collaboration · Intervention TimingarXiv Notes
2026-09Beyond Instruction-Driven Editing: Source-Grounded Problem Discovery with User-Governed Repair for Scientific PostersarXiv 2609GUI · Human Factors · Safety & ConsentarXiv Notes
2026-09Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI AgentsarXiv 2609GUI · Safety & Consent · Intervention TimingarXiv Star Notes

Multimodal, Wearable and Embodied Agents

DateTitleVenue / SourceTagsResources
2024-09AssistantX: An LLM-Powered Proactive Assistant in Collaborative Human-Populated EnvironmentsIROS 2025Embodied · Collaboration · PlanningarXiv
2024-10Satori: Towards Proactive AR Assistant with Belief-Desire-Intention User ModelingCHI 2025Multimodal / Wearable · Intent Inference · Human FactorsarXiv DOI Notes
2025-01YETI: Proactive Interventions by Multimodal AI Agents in Augmented Reality TasksarXiv 2501Multimodal / Wearable · Intervention Timing · Human FactorsarXiv Website Notes
2025-01AiGet: Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart GlassesCHI 2025Multimodal / Wearable · Intent Inference · PersonalizationarXiv DOI
2025-02WatchGuardian: Enabling User-Defined Personalized Just-in-Time Intervention on SmartwatcharXiv 2502Multimodal / Wearable · Personalization · Intervention TimingarXiv Notes
2025-02Mirai: A Wearable Proactive AI Inner-Voice for Contextual NudgingCHI EA 2025Multimodal / Wearable · Intervention Timing · Human FactorsarXiv DOI
2025-03OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video ContextsCVPR 2025Multimodal / Wearable · Intervention Timing · BenchmarkarXiv CVF Website Notes
2025-05ContextAgent: Context-Aware Proactive LLM Agents with Open-World Sensory PerceptionsNeurIPS 2025Multimodal / Wearable · Personalization · Tool UsearXiv Website Star Notes
2025-05PACE: Proactive Assistance in Human-Robot Collaboration Through Action-Completion EstimationICRA 2025Embodied · Intervention Timing · OptimizationDOI Notes
2025-06Proactive Assistant Dialogue Generation from Streaming Egocentric VideosEMNLP 2025Multimodal / Wearable · Dialogue · Intervention TimingarXiv
2025-07ProMemAssist: Exploring Timely Proactive Assistance Through Working Memory Modeling in Multi-Modal Wearable DevicesUIST 2025Multimodal / Wearable · Intervention Timing · Human FactorsarXiv DOI Notes
2025-12ProAgent: Harnessing On-Demand Sensory Contexts for Proactive LLM Agent SystemsarXiv 2512Multimodal / Wearable · Sensing · Intervention TimingarXiv Video Notes
2026-01ROMA: Real-time Omni-Multimodal Assistant with Interactive Streaming UnderstandingFindings of ACL 2026Multimodal / Wearable · Intervention Timing · OptimizationarXiv ACL Notes
2026-01Clarify or Answer: Reinforcement Learning for Agentic VQA with Context Under-specificationarXiv 2601Multimodal / Wearable · Clarification · OptimizationarXiv Notes
2026-03ProactiveBench: Benchmarking Proactiveness in Multimodal Large Language ModelsICLR 2026Multimodal / Wearable · Intervention Timing · BenchmarkarXiv Star Dataset Notes
2026-03StreamReady: Learning What to Answer and When in Long Streaming VideosCVPR 2026Multimodal / Wearable · Intervention Timing · BenchmarkarXiv CVF Website Notes
2026-03Em-Garde: A Propose-Match Framework for Proactive Streaming Video UnderstandingECCV 2026Multimodal / Wearable · Intervention Timing · OptimizationarXiv DOI Star Notes
2026-04AURA: Always-On Understanding and Real-Time Assistance via Video StreamsarXiv 2604Multimodal / Wearable · Intervention Timing · OptimizationarXiv Notes
2026-05IPIBench: Evaluating Interactive Proactive Intelligence of MLLMs under Continuous StreamsarXiv 2605Multimodal / Wearable · Intervention Timing · BenchmarkarXiv Notes
2026-05OmniPro: A Comprehensive Benchmark for Omni-Proactive Streaming Video UnderstandingarXiv 2605Multimodal / Wearable · Intervention Timing · BenchmarkarXiv Website Notes
2026-05EgoPro-Bench: Benchmarking Personalized Proactive Interaction in Egocentric Video StreamsarXiv 2605Multimodal / Wearable · Personalization · BenchmarkarXiv Notes
2026-05MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent MemoryarXiv 2605Memory · Multimodal / Wearable · BenchmarkarXiv Notes
2026-05PACT: Proactive Asking for Continual Task Assistance in Human-Robot CollaborationarXiv 2605Embodied · Clarification · Long-horizonarXiv Notes
2026-07Vinci2: Providing Proactive Assistance in Continuous Egocentric VideosECCV 2026Multimodal / Wearable · Intervention Timing · MemoryarXiv Website Notes
2026-07ChatMuse: Supporting In-Person Small-Group Conversation Experience with a Proactive Assistive AI Agent in Mixed RealityUIST 2026Multimodal / Wearable · Collaboration · Human FactorsarXiv Notes
2026-08GROVE: Growing and Reasoning over Temporally Stratified Memory from Streaming Video ExperiencearXiv 2608Multimodal / Wearable · Memory · Intervention TimingarXiv Star Notes
2026-08From Sports to Safety: Benchmarking Proactive Risk Inference in MLLMsarXiv 2608Multimodal / Wearable · Safety & Consent · BenchmarkarXiv Star Notes
2026-08StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video UnderstandingarXiv 2608Multimodal / Wearable · Long-horizon · BenchmarkarXiv Notes
2026-08MOSS-VL Technical ReportarXiv 2608Multimodal / Wearable · Intervention Timing · OptimizationarXiv Website Star Notes
2026-08StreamSoccer: Event-Driven Memory for Streaming Soccer CommentaryarXiv 2608Multimodal / Wearable · Intervention Timing · MemoryarXiv Notes
2026-08OmniAssistBench: Assistant-style Interaction Benchmark for Omni-LLMsarXiv 2608Multimodal / Wearable · Dialogue · BenchmarkarXiv Website Notes
2026-08When Seeing Is Not Enough: Benchmarking Interactive Visual Grounding in LVLMsEMNLP 2026Multimodal / Wearable · Clarification · BenchmarkarXiv Notes
2026-08MMPCBench: Benchmarking Multimodal Large Language Models on Proactive Critique of Flawed InputsarXiv 2608Multimodal / Wearable · Safety & Consent · BenchmarkarXiv Star Notes
2026-09Time-Aware Assistive NavigationICRA 2026Multimodal / Wearable · Intervention Timing · BenchmarkarXiv Website Notes
2026-09Ambient @ EgoProactive 2026: Proactive Egocentric Assistance with Visually Grounded SupervisionECCV 2026 Wearable AI ChallengeMultimodal / Wearable · Intervention Timing · OptimizationarXiv Star Notes
2026-09Omni Interaction Agent Technical ReportarXiv 2609Multimodal / Wearable · Dialogue · Intervention TimingarXiv Website Star Notes
2026-09Realtime-Venus: A Full-Duplex Interaction System with Asynchronous DelegationarXiv 2609Multimodal / Wearable · Dialogue · Tool UsearXiv Notes
2026-09Full-Duplex Speech Models Take the Floor When Asked, Not When NeededarXiv 2609Multimodal / Wearable · Intervention Timing · BenchmarkarXiv Notes

Benchmarks, Personalization and Optimization

DateTitleVenue / SourceTagsResources
2025-08ProactiveEval: A Unified Evaluation Framework for Proactive Dialogue AgentsACL 2026Benchmark · Dialogue · Intent InferencearXiv ACL Star Notes
2025-09ProPerSim: Developing Proactive and Personalized AI Assistants through User-Assistant SimulationICLR 2026Personalization · Simulation · BenchmarkarXiv
2025-10Beyond Reactivity: Measuring Proactive Problem Solving in LLM AgentsarXiv 2510Benchmark · Intent Inference · Tool UsearXiv Star Notes
2025-10AgentFold: Long-Horizon Web Agents with Proactive Context FoldingICLR 2026Long-horizon · Memory · Tool UsearXiv ICLR OpenReview Notes
2025-11Training Proactive and Personalized LLM AgentsCOLM 2026Personalization · Optimization · SimulationarXiv Star Notes
2025-11Structured Uncertainty guided Clarification for LLM AgentsFindings of ACL 2026Clarification · Tool Use · BenchmarkarXiv ACL Notes
2026-02Pushing Forward Pareto Frontiers of Proactive Agents with Behavioral Agentic OptimizationICML 2026Optimization · Human Factors · Safety & ConsentarXiv ICML
2026-03ProEvent: An Event-centric Benchmark for Proactive AgentsarXiv 2607 / ACL ARR 2026Benchmark · Long-horizon · Intervention TimingarXiv OpenReview Notes
2026-04SKILL0: In-Context Agentic Reinforcement Learning for Skill InternalizationarXiv 2604Optimization · Skill Learning · MemoryarXiv Star Notes
2026-04PASK: Toward Intent-Aware Proactive Agents with Long-Term MemoryarXiv 2604Long-horizon · Memory · Intervention TimingarXiv Website Notes
2026-05CogniFold: Always-On Proactive Memory via Cognitive FoldingarXiv 2605Memory · Intent Inference · BenchmarkarXiv HF Paper Star Dataset Notes
2026-05MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and EvaluationarXiv 2605Optimization · Skill Learning · MemoryarXiv Notes
2026-05Do Proactive Agents Really Need an LLM to Decide When to Wake and What to Anchor?arXiv 2605Intervention Timing · Optimization · Tool UsearXiv Notes
2026-05ProactBench: Beyond What The User Asked ForarXiv 2605Benchmark · Dialogue · Intent InferencearXiv Notes
2026-05Claw-Anything: Benchmarking Always-On Personal Assistants with Broader Access to User's Digital WorldarXiv 2605Long-horizon · Benchmark · Tool UsearXiv Notes
2026-05π-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon WorkflowsarXiv 2605Long-horizon · Intent Inference · BenchmarkarXiv Website Star Dataset Notes
2026-05VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User InteractionsarXiv 2605Long-horizon · Personalization · MemoryarXiv HF Paper Star Notes
2026-06Ψ-Bench: Evaluating Persona-Sensitive Influencing in Persuasive DialoguesarXiv 2606Dialogue · Personalization · BenchmarkarXiv Star Notes
2026-06Communication Policy Evolution for Proactive LLM AgentsarXiv 2606Dialogue · Intervention Timing · OptimizationarXiv Notes
2026-06See, Infer, Intervene: Proactive World Modeling for Goal-Oriented Social IntelligencearXiv 2606Multimodal / Wearable · Intervention Timing · BenchmarkarXiv Notes
2026-07Remember When It Matters: Proactive Memory Agent for Long-Horizon AgentsarXiv 2607Long-horizon · Memory · Intervention TimingarXiv Notes
2026-07ENPMR-Bench: Benchmarking Proactive Memory Retrieval for Emotional Support AgentsFindings of ACL 2026Memory · Dialogue · BenchmarkACL Notes
2026-08Preference-Driven Online Adaptation for Personalized Interaction Initiation in Proactive AI AssistantsarXiv 2608Personalization · Intervention Timing · OptimizationarXiv Notes
2026-08VibeLifeBench: Can Your Life Agent Be Proactive and Persistent in a Living World?arXiv 2608Long-horizon · Benchmark · Safety & ConsentarXiv Notes
2026-08Not Just Reason, Not Just Scan: Reinforcement Learning for Proactive Scientific Error Verification over Academic PaperFindings of EMNLP 2026Multimodal / Wearable · Optimization · Safety & ConsentarXiv Notes
2026-09RPCBench: A Benchmark for Proactive Premise Critique in LLM-based RecommendationarXiv 2609Recommendation · Benchmark · Safety & ConsentarXiv Star Notes
2026-09Propose to Learn, Learn to Propose: Evaluability-Aware Assistance under Bounded RationalityarXiv 2609 · Under reviewPersonalization · Planning · Human FactorsarXiv Notes
2026-09New Evidence, Same Choice: Testing Physical Experiment Selection in Vision Language ModelsarXiv 2609Benchmark · Planning · Tool UsearXiv Notes

Benchmarks

For detailed comparison, see BENCHMARKS.md.

DateBenchmarkPaperEnvironmentWhat it testsResources
2024-03ProMISeProMISeinformation-seeking dialogueproactive clarification for intent resolutionACL
2024-10RealHumanEvalNeed Help?programming tasksproactive IDE assistance with human usersarXiv
2024-10ProactiveBenchProactive Agentdesktop activity eventsproactive task prediction and acceptancearXiv Star
2025-03OmniMMIOmniMMIcontinuous audio-visual streamsproactive alerts, turn-taking, and streaming interactionarXiv CVF Website
2025-05ContextAgentBenchContextAgentwearable sensory contextsproactive service prediction and tool callingarXiv Star
2025-07FingerTip 20KFingerTip 20KAndroid trajectoriesproactive task suggestion and personalized executionarXiv Star
2025-08ProactiveEvalProactiveEvalproactive dialoguetarget planning and dialogue guidance across six domainsarXiv ACL Star
2025-10PROBEBeyond Reactivityweb problem-solving tasksbottleneck discovery and autonomous resolutionarXiv Star
2025-11UserVilleTraining Proactive and Personalized LLM AgentsSWE and deep-research user simulationproductivity, proactivity and personalization under vague promptsarXiv Star
2025-11ClarifyBenchStructured Uncertainty Guided Clarificationdynamic tool-calling tasksdecide which tool argument to clarify and when to stop askingarXiv ACL
2026-01ChronosBenchLong-term Task-oriented Agentdynamic task environmentsproactive long-term intent maintenancearXiv Notes
2026-02ProAgentBenchProAgentBenchreal workflow logswhen-to-assist and how-to-assistarXiv Code
2026-02ProactiveMobileProactiveMobilemobile device contextlatent intent to executable API sequencearXiv CVF
2026-03ProEventProEventfuture event trackingproactive event maintenance and remindersarXiv OpenReview Notes
2026-03PIRA-BenchPIRA-Benchcontinuous GUI screenshotsproactive GUI intent recommendationarXiv Website Dataset
2026-03ProReady-QAStreamReadylong streaming videos with annotated evidence windowsanswer only after sufficient evidence appears and avoid both premature and delayed responsesCVF Website
2026-03GUIDEGUIDEopen-ended GUI workflow videosbehavior state, intent, and help predictionarXiv Website Dataset Notes
2026-03ProactiveBench (MLLM)ProactiveBench / Trentovisual difficulty scenariosMLLM proactive help-seeking from visual contextarXiv Dataset
2026-05IPIBenchIPIBenchstreaming video, multi-turninteractive proactive monitoring, task management, reactive-proactive coordinationarXiv Notes
2026-04ProVoice-BenchProVoice-Benchvoice interaction streamsproactive voice intervention timing, over-triggering, monitoringarXiv Notes
2026-04Pare-BenchParemulti-app FSM environmentactive user simulation, intervention timing, multi-app executionarXiv Website Star
2026-04KnowU-BenchKnowU-BenchAndroid emulatorpersonalization, proactive tasks, consent and rejection handlingarXiv Star
2026-04LatentNeeds-BenchPASKreal speech transcripts over multi-turn sessionsdetect latent demand, assist, or stay silent under latency constraintsarXiv Website
2026-05CogEval-BenchCogniFoldstreaming event memoryproactive concept emergence and cognitive-structure formationarXiv Dataset Star
2026-05MemEyeMemEyemultimodal long-term memoryvisual evidence granularity and temporal state reasoningarXiv
2026-05ProCodeBenchProactive Coding Assistantsreal IDE tracesproactive coding intent prediction and sim-to-real evaluationarXiv
2026-05ProactBenchBeyond What The User Asked Forsynthetic multi-turn conversationsgrounded unstated-need inference at emergent, critical, and recovery triggersarXiv
2026-05OmniProOmniProcontinuous omni-modal video streamsautonomously decide when and what to report across multiple triggersarXiv Website
2026-05EgoPro-BenchEgoPro-Benchegocentric streaming videos and user profilespersonalized interaction timing with explicit attention-or-silence labelsarXiv
2026-05Claw-AnythingClaw-Anythingmonths of cross-service and multi-device activityanticipate needs and complete proactive personal-assistant tasks amid noisearXiv
2026-05π-Benchπ-Benchpersistent personal workspacesproactive hidden-intent resolution and checklist completion in long-horizon workflowsarXiv Website Star Dataset
2026-05ProActEvalAnticipate and Learnproactive assistant scenariosidle-time anticipation, evidence acquisition, user effort and hallucination reductionarXiv Website Star
2026-05VitaBench 2.0VitaBench 2.0long-term user interaction sequencespreference extraction, memory use, updates, and proactive missing-information acquisitionarXiv HF Paper Star
2026-06Ψ-BenchΨ-Benchpersuasive dialoguepersona-sensitive influencing with simulated clients and user profilesarXiv Star
2026-06GuidanceSalesBenchSee, Infer, Intervenepre-interaction retail videos and customer-state manifestsselect greet, elicit, inform, recommend, or holdarXiv
2026-07ProACT Collaboration BenchProACTmulti-user collaborationbreakdown detection, intervention timing, and non-interruptivenessarXiv
2026-07InquireBenchInquireMobilemobile GUIproactive confirmation before risky or uncertain actionsACL Website
2026-07AndroidIntentPersonalAlignlong-term Android recordsvague-intent resolution and instruction-free routine suggestionsACL
2026-07BSDDCoLabSciencestreaming biomedical discussionswhen and how to contribute without disrupting collaboratorsACL
2026-07ENPMR-BenchENPMR-Benchemotional-support dialoguelatent emotional-need inference and proactive supportive-memory retrievalACL
2026-07EgoServeVinci2continuous egocentric videowhen-and-whether assistance across four memory horizonsarXiv Website
2026-07Int-BenchAI Assistants Overassistsimulated learners solving 1,500 problemswhether, when, and how much a tutor should intervenearXiv
2026-07AskBenchWhen and What to Askinteractive intent-deficient and false-premise QAdecide when and what to clarify without sacrificing task performanceACL
2026-08Active-SWEActive-SWErepository snapshots without issue reportsautonomous discovery and repair of single, multiple, and potential bugsarXiv
2026-08SPRINTFrom Sports to Safetyreal sports videosearly hazard warning, cause grounding, and false-alarm controlarXiv Star
2026-08StreamArenaStreamArenahour-scale audio-visual streamsproactive monitoring alongside perception, retrospection, and tool usearXiv
2026-08VibeLifeBenchVibeLifeBenchsimulated multi-week life tasksautonomous act, ask, and stay-silent decisions under silent world changes and implicit constraintsarXiv Notes
2026-08JarvisBenchJarvisBenchongoing single- and multi-agent workrecognize consequential user-owned decisions, request judgment, and route it back to working agentsarXiv Star Notes
2026-08Act2Intention BenchAct2Intentioncontinuous mobile GUI trajectoriesunderstand, predict, suggest, and execute the next user intention from action historyarXiv Star Notes
2026-08StreamSoccerStreamSoccercontinuous soccer videocausal commentary across current, recent, and historical scopes with rule-assisted mode-or-silence schedulingarXiv Notes
2026-08OmniAssistBenchOmniAssistBenchcontinuous assistant-style video interactionsguide a user through a goal, incorporate visual prompts, and delay responses until the target eventarXiv Website
2026-08Interactive Visual GroundingWhen Seeing Is Not Enoughambiguous visual references under multi-turn protocolsask follow-up questions and synthesize acquired evidence to ground the targetarXiv
2026-08MMPCBenchMMPCBenchflawed multimodal user inputsautonomously detect, diagnose, and repair errors without an extra promptarXiv Star
2026-09PROS-BenchBeyond Instruction-Driven Editingsource papers paired with editable scientific postersdiscover source-grounded problems, obtain user acceptance, repair native objects, and validate outcomesarXiv
2026-09RPCBenchRPCBenchevidence-grounded recommendation requests with corrupted premisesproactively detect, localize, and handle premise failures without fabricating unsupported recommendationsarXiv Star
2026-09CONFLICTGUIDo GUI Agents Know When Not to Act?feasible and conflicting instructions grounded in GUI statesverify feasibility and terminate rather than over-comply when instructions or GUI evidence conflictarXiv Star
2026-09CC-MediationCC-Mediationten-turn cross-cultural conflict dialoguesdecide when to intervene and select a mediation strategy with persistent downstream benefitarXiv Star
2026-09OR-ClarifyAsk Before You Optimizepartially specified operations-research requests with hidden formulation slotsask only formulation-critical questions, avoid silent assumptions, and stop when ready to modelarXiv
2026-09TIMELITime-Aware Assistive Navigationegocentric navigation videos and closed-loop urban simulationdecide when to give concise guidance or remain silent for safetyarXiv Website
2026-09IdeaAMBIGIdeaAMBIGincomplete research-method specifications grounded in papers and codedetect implementation-critical gaps and issue clarification actions instead of assumingarXiv
2026-09Physical Experiment SelectionNew Evidence, Same Choicecontrolled visual-physics measurements with known experiment costsanswer when evidence is sufficient or select the cheapest resolving experimentarXiv
2026-09ProMediConvProMediConvmulti-stage legal dispute dialogues reconstructed from real casesselect mediation strategies proactively and improve party behavior over the trajectoryarXiv Star

Tag Vocabulary

Tags are intentionally compact and reusable. They describe the paper's main contribution, not every detail.

TagMeaning
DefinitionDefines or reframes proactive agents, proactive dialogue, or design-space boundaries.
SurveySynthesizes a broad proactive-agent subfield or taxonomy.
Human FactorsStudies interruption, control, satisfaction, workload, adoption, or developer experience.
TrustFocuses on competence perception, calibrated reliance, or trustworthy interaction.
Safety & ConsentCovers confirmation, autonomy boundaries, reversibility, rejection, or risk control.
PrivacyCenters privacy management, data minimization, or personal-context governance.
Intervention TimingFocuses on when an agent should act, ask, suggest, or remain silent.
Intent InferenceInfers latent goals, hidden constraints, future tasks, or missing information.
ClarificationProactively asks questions before planning, execution, or recommendation.
DialogueProactive behavior in conversational, persuasive, or task-oriented interaction.
PlanningProactive decomposition, task planning, scheduling, or future-state reasoning.
Tool UseTool calling, API execution, GUI operation, or action orchestration.
RecommendationProactive recommendation or suggestion ranking.
CollaborationMulti-party or human-agent collaborative problem solving.
EducationLearning, tutoring, reflection, or student engagement contexts.
Long-horizonMulti-session, dynamic, future-event, or long-running task maintenance.
PersonalizationUser preferences, personas, profiles, long-term user history, or user-specific adaptation.
MemoryPersistent memory, episodic memory, visual memory, skill memory, or cognitive memory structures.
SimulationUser simulation, environment simulation, synthetic users, or synthetic workflows.
OptimizationRL, reward modeling, multi-objective optimization, self-evolution, or behavior tuning.
Skill LearningSkill creation, skill internalization, skill memory, or reusable procedure learning.
BenchmarkIntroduces a dataset, evaluation suite, benchmark, simulator, or diagnostic protocol.
Real-world DataUses real user traces, field-study data, or deployment-like logs.
DesktopDesktop activity streams, workstation context, or event logs.
GUIGraphical interface agents, browser/app screens, or visual UI interaction.
MobileMobile GUI, Android/iOS workflows, phone sensors, or mobile user context.
OSOperating-system agents, cross-app workflows, or OS-level verification.
IDEProgramming assistants, code editors, or developer tooling.
Multimodal / WearableVideo, audio, AR, smart glasses, egocentric streams, or open-world sensory context.
SensingActive context acquisition, sensor selection, or on-demand sensory capture.
EmbodiedRobots, physical environments, or human-populated embodied settings.

Contributing

Pull requests are welcome.

Before adding a paper, check that it satisfies at least one of:

  • It predicts latent user intent before a complete explicit instruction.
  • It decides when to intervene, ask, suggest, execute, remind, or stay silent.
  • It evaluates proactive assistance, interruption cost, user control, consent, or personalization.
  • It contributes a benchmark or dataset where proactivity is the primary task.

Suggested note template:

# Paper Title

## Why It Matters

...

## Proactivity Signal

...

## Evaluation Setup

...

## Key Limitations

...

## Use For

...

Maintained by Low Entropy AI.

agent
ai
ai-agent
awesome-list
benchmark
llm
multimodal
proactive
proactive-agent

Contributors

Kaiming-Y

32 commits

KashiwaByte

2 commits

LowEntropyAI/awesome-proactive-agent

A curated list of papers, benchmarks, project pages, and code for proactive agents.

21

35 commits

updated Sep 20, 2026

See the code

README

Awesome Proactive Agents dynamic banner

Awesome Proactive Agents

Proactive Agent banner

Awesome PRs Welcome Focus Scope

A curated research map for proactive agents: AI systems that infer latent user needs, decide when to intervene, ask for missing context or consent, and initiate useful assistance before a complete explicit command.

If this list is useful, a ⭐ helps others find it.

Companion Guides

  • Research Map: question-driven clusters for quickly locating papers by intervention timing, inference, long-term intent, personalization, evaluation, and safety.
  • Benchmark Matrix: side-by-side benchmark comparison by domain, input stream, proactive target, user model, data type, and metrics.

Contents


Scope

This list prioritizes papers where proactivity is a central research target. The list is broader than computer-use agents: it includes proactive dialogue, planning, recommendation, wearable assistance, GUI/mobile/OS agents, programming assistants, personalization, memory, benchmarks, optimization, and human factors.

Typical inclusion signals:

  • The agent predicts latent intent or missing context before a complete user instruction.
  • The agent decides when to ask, suggest, remind, intervene, execute, or stay silent.
  • The paper evaluates proactive behavior, intervention timing, user control, consent, interruption cost, or personalization.
  • The benchmark or dataset makes proactivity the primary task rather than a side effect of general tool use.

Resource labels:

  • Paper: arXiv, ACL Anthology, DOI, OpenReview, ACM, Springer, or official proceedings page.
  • Website: project page, conference page, lab page, or documentation.
  • Code / Dataset: GitHub, released code, released benchmark, or released dataset.
  • Notes: short English decision card with why the paper matters, proactivity signal, evaluation setup, limitations, and use cases.

Must Read

Selected starting points for understanding the field.

DatePaperWhy read it firstResources
2024-04Towards Human-centered Proactive Conversational AgentsEstablishes the human-centered dimensions of proactive agents: intelligence, adaptivity, and civility.arXiv DOI
2024-10Proactive AgentCanonical shift from reactive LLM agents to active assistance over event streams; introduces ProactiveBench.arXiv OpenReview Star Notes
2024-10Need Help?Strong user-study reference for proactive IDE assistance and intervention timing.arXiv Notes
2025-05ContextAgentExtends proactive agents to open-world sensory contexts and tool calling.arXiv Website Star Notes
2026-02ProAgentBenchReal workflow logs reveal why synthetic proactive data can overestimate performance.arXiv Code Notes
2026-03StreamReadyLearns both what to answer and when enough streaming-video evidence has arrived, with explicit penalties for premature and delayed answers.CVF Website Notes
2026-04KnowU-BenchClosest benchmark to proactive, personalized, consent-aware mobile assistants.arXiv HF Paper Star Notes
2026-05π-BenchSharp long-horizon benchmark for hidden-intent resolution in personal assistant workflows.arXiv Website Star Dataset Notes
2026-08VibeLifeBenchMakes act, ask, and stay-silent decisions explicit across multi-week personal-assistant tasks in a changing world.arXiv Notes
2026-08Why2SpeakTreats speaking and remaining silent as an auditable action policy, exposing the capability–faithfulness trade-off in intervention timing.arXiv Notes

Papers

Foundations, Surveys and Human Factors

DateTitleVenue / SourceTagsResources
2024-04Towards Human-centered Proactive Conversational AgentsSIGIR 2024Definition · Human Factors · DialoguearXiv DOI
2024-10Redefining Proactivity for Information Seeking DialogueSICON 2024Definition · Dialogue · Intent InferenceACL
2025-01When AI-Based Agents Are Proactive: Implications for Competence and System Satisfaction in Human-AI CollaborationBISE 2026Human Factors · Intervention Timing · TrustDOI
2025-02Assistance or Disruption? Exploring and Evaluating the Design and Trade-offs of Proactive AI Programming SupportCHI 2025Human Factors · Intervention Timing · IDEarXiv DOI Notes
2025-03Proactive Conversational AI: A Comprehensive Survey of Advancements and OpportunitiesACM TOIS 2025Survey · Definition · DialogueDOI
2025-08When not to help: planning for lasting human-AI collaborationarXiv 2508Human Factors · Intervention Timing · TrustarXiv Notes
2025-10Check Yourself Before You Wreck Yourself: Selectively Quitting Improves LLM Agent SafetyRegML 2025 WorkshopSafety & Consent · Tool Use · Intervention TimingarXiv OpenReview Notes
2026-01Developer Interaction Patterns with Proactive AI: A Five-Day Field StudyIUI 2026Human Factors · Real-world Data · IDEarXiv DOI Notes
2026-02From Fragmentation to Integration: Exploring the Design Space of AI Agents for Human-as-the-Unit Privacy ManagementCHI 2026Safety & Consent · Privacy · Human FactorsarXiv DOI
2026-02Exploring The Impact of Proactive Generative AI Agent Roles in Time-Sensitive Collaborative Problem-Solving TasksCHI 2026Human Factors · Collaboration · Intervention TimingarXiv DOI
2026-06Designing for Doubt: The Case for Informed Abstention in Autonomous AgentsAIES 2026Safety & Consent · Benchmark · Tool UsearXiv Notes
2026-07AI Assistants OverassistarXiv 2607Human Factors · Intervention Timing · EducationarXiv Notes
2026-08VeriForge: Mitigating Latent Knowledge Gaps in Narrative Drafting via Mixed-Initiative ScaffoldingUIST 2026Human Factors · Intervention Timing · GUIarXiv Notes
2026-08AI Watchdog: Agent Interfaces for Detecting and Defending Against Manipulative Dark Patterns in AI ConversationsarXiv 2608Human Factors · Safety & Consent · Intervention TimingarXiv Notes
2026-09Designing Proactive Thought Partners for WritingarXiv 2609Human Factors · Intervention Timing · PersonalizationarXiv Notes
2026-09Proactive Service Agents: A Unified Decision Framework, Methods, and EvaluationarXiv 2609Survey · Definition · Safety & ConsentarXiv Notes
2026-09When Intelligence Becomes Agency: A Theory of Governed, Proactive Agency for Symbiotic AI SystemsarXiv 2609Definition · Safety & Consent · Intervention TimingarXiv Notes
2026-09Oops, Not Now: PEARL, a RAG-Based Support Agent for Gameplay and What Players Want from AI HelpIEEE CoG 2026Human Factors · Intervention Timing · EducationarXiv Notes
2026-09Breaking Up is Hard to Do: AI Companions that Won't Let Their Users GoarXiv 2609Human Factors · Safety & Consent · DialoguearXiv Notes

Proactive Interaction and Planning

DateTitleVenue / SourceTagsResources
2024-03ProMISe: A Proactive Multi-turn Dialogue Dataset for Information-seeking Intent ResolutionFindings of EACL 2024Clarification · Dialogue · BenchmarkACL
2024-03Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification QuestionsEACL 2024Clarification · Dialogue · Intervention TimingACL Notes
2024-06Ask-before-Plan: Proactive Language Agents for Real-World PlanningFindings of EMNLP 2024Clarification · Planning · Intent InferencearXiv
2024-10Proactive Agent: Shifting LLM Agents from Reactive Responses to Active AssistanceICLR 2025Intent Inference · Benchmark · DesktoparXiv OpenReview Star Notes
2024-11PCQPR: Proactive Conversational Question Planning with ReflectionEMNLP 2024Dialogue · Planning · Intent InferenceACL Notes
2025-01Proactive Conversational Agents with Inner ThoughtsCHI 2025Dialogue · Intent Inference · Intervention TimingarXiv Star Notes
2025-01ProTOD: Proactive Task-oriented Dialogue System Based on LLMsCOLING 2025Dialogue · Planning · Tool UseACL
2025-07Tunable LLM-based Proactive Recommendation AgentACL 2025Recommendation · Personalization · Intent InferenceACL
2025-09PRINCIPLES: Synthetic Strategy Memory for Proactive Dialogue AgentsFindings of EMNLP 2025Dialogue · Memory · SimulationarXiv
2025-10ProMediate: A Simulation Testbed for Evaluating Proactive Mediation in Multi-Party NegotiationFindings of ACL 2026Dialogue · Collaboration · BenchmarkarXiv ACL
2026-01Proactivity-driven Personalized Agents for Advancing Human Learning through Engagement, Reflection, and Self-EfficacyACM CHIIR 2026 WorkshopPersonalization · Intent Inference · EducationarXiv
2026-01Long-term Task-oriented Agent: Proactive Long-term Intent Maintenance in Dynamic EnvironmentsarXiv 2601Long-horizon · Intent Inference · BenchmarkarXiv Notes
2026-01Value of Information: A Framework for Human–Agent CommunicationACL 2026Clarification · Intervention Timing · Safety & ConsentarXiv ACL Notes
2026-03PsyProbe: Proactive and Interpretable Dialogue through User State Modeling for Exploratory CounselingFindings of EACL 2026Dialogue · Intent Inference · Human FactorsACL Notes
2026-05Anticipate and Learn: Unleashing Idle-Time Compute in Proactive AgentsarXiv 2605Intent Inference · Memory · BenchmarkarXiv Website Star Notes
2026-07PROPER Agents: Proactivity Driven Personalized Agents for Advancing Knowledge Gap NavigationFindings of ACL 2026Personalization · Intent Inference · DialogueACL Star Notes
2026-07ProACT: Towards Breakdown-Aware Proactive Agent in Multi-User CollaborationarXiv 2607Collaboration · Intervention Timing · BenchmarkarXiv Notes
2026-07Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive InquirersACL 2026Clarification · Dialogue · OptimizationACL Notes
2026-07ProMed: Shapley Information Gain Guided Reinforcement Learning for Proactive Medical LLMsACL 2026Clarification · Dialogue · OptimizationACL Star Notes
2026-07"Excuse me, may I say something..." CoLabScience, A Proactive AI Assistant for Biomedical Discovery and LLM-Expert CollaborationsACL 2026Collaboration · Intervention Timing · BenchmarkACL Notes
2026-07Let LLM Tutors Ask First: Proactive LLM-Based Tutoring at Scale in a 1,500-Student Online ClassroomACL 2026 Industry TrackEducation · Intent Inference · Real-world DataACL Notes
2026-07When and What to Ask: AskBench and Rubric-Guided RLVR for LLM ClarificationFindings of ACL 2026Clarification · Benchmark · OptimizationACL Notes
2026-07ProActor: Timing-Aware Reinforcement Learning for Proactive Task Scheduling AgentsACL 2026Intervention Timing · Planning · OptimizationACL Notes
2026-08A Self-Triggered Agentic Push Recommendation SystemRecSys 2026Recommendation · Intervention Timing · Real-world DataarXiv Notes
2026-08CLAIM: Leading Open-domain Active Clarification of Large Language Models with Uncertainty MeasurementarXiv 2608Clarification · Dialogue · OptimizationarXiv Notes
2026-08JarvisBench: Always-on Intelligence Between Humans and AgentsarXiv 2608Intervention Timing · Collaboration · BenchmarkarXiv Website Star Notes
2026-08Bridging Search and CRM: Productionizing AI Product Research Agents for Customer Re-EngagementarXiv 2608Recommendation · Personalization · Real-world DataarXiv Notes
2026-08Why2Speak: Faithful Reasoning for Abstaining Action PoliciesarXiv 2608Intervention Timing · Collaboration · Safety & ConsentarXiv Notes
2026-08Clarify User Expertise: Towards Proactive Conversational Agents Tailoring Responses to User ProficiencyFindings of EMNLP 2026Clarification · Personalization · DialoguearXiv Notes
2026-08Beyond Information Seeking: Severity-Aware Question Supervision for Proactive Medical DialoguearXiv 2608Clarification · Dialogue · OptimizationarXiv Notes
2026-08From Passive Response to Proactive Correction: Enhancing LLM Robustness Against Input Fact PerturbationsEMNLP 2026Intent Inference · Safety & Consent · DialoguearXiv Notes
2026-09Speak for Me: Giving LLMs the Situational Awareness to Participate in a MeetingEMNLP 2026Collaboration · Intervention Timing · DialoguearXiv Star Notes
2026-09Ask Before You Optimize: Dynamic Pre-Formulation Clarification for Interactive OptimizationarXiv 2609Clarification · Planning · BenchmarkarXiv Notes
2026-09CC-Mediation: Evaluating Large Language Models for Cross-Cultural Conflict MediationarXiv 2609Dialogue · Intervention Timing · BenchmarkarXiv Star Notes
2026-09IdeaAMBIG: Benchmarking Implementation-Critical Gaps in Research-Idea SpecificationsarXiv 2609Clarification · Benchmark · Tool UsearXiv Notes
2026-09ProMediConv: Benchmarking Proactive Conversational Agents in Legal Dispute MediationFindings of EMNLP 2026Dialogue · Collaboration · BenchmarkarXiv Star Notes

GUI, Mobile, OS and Coding Agents

DateTitleVenue / SourceTagsResources
2024-10Need Help? Designing Proactive AI Assistants for ProgrammingCHI 2025IDE · Intervention Timing · Human FactorsarXiv Notes
2025-03CodingGenie: A Proactive LLM-Powered Programming AssistantFSE 2025 CompanionIDE · Intent Inference · Tool UsearXiv DOI Star Notes
2025-07FingerTip 20K: A Benchmark for Proactive and Personalized Mobile LLM AgentsICLR 2026Mobile · Personalization · BenchmarkarXiv Star Notes
2025-07ProactiveVA: Proactive Visual Analytics with LLM-Based UI AgentIEEE VIS 2025 / TVCG 2026GUI · Intervention Timing · Human FactorsarXiv DOI Notes
2025-08AppAgent-Pro: A Proactive GUI Agent System for Multidomain Information Integration and User AssistanceCIKM 2025GUI · Intent Inference · Tool UsearXiv Star Notes
2025-09VeriOS: Query-Driven Proactive Human-Agent-GUI Interaction for Trustworthy OS AgentsarXiv 2509OS · Safety & Consent · ClarificationarXiv Star Notes
2026-02ProAgentBench: Evaluating LLM Agents for Proactive Assistance with Real-World DataarXiv 2602Real-world Data · Intervention Timing · BenchmarkarXiv Code Notes
2026-02ProactiveMobile: A Comprehensive Benchmark for Boosting Proactive Intelligence on Mobile DevicesCVPR 2026Mobile · Intent Inference · BenchmarkarXiv CVF Notes
2026-03PIRA-Bench: A Transition from Reactive GUI Agents to GUI-based Proactive Intent Recommendation AgentsarXiv 2603GUI · Intent Inference · BenchmarkarXiv Website Dataset Notes
2026-03GUIDE: A Benchmark for Understanding and Assisting Users in Open-Ended GUI TasksCVPR 2026GUI · Intent Inference · BenchmarkarXiv Website Dataset Notes
2026-03Ask or Assume? Uncertainty-Aware Clarification-Seeking in Coding AgentsEMNLP 2026IDE · Clarification · Intervention TimingarXiv Notes
2026-04Ambig-SWE: Interactive Agents to Overcome Underspecificity in Software EngineeringICLR 2026IDE · Clarification · BenchmarkOpenReview Star Notes
2026-04Help Without Being Asked: A Deployed Proactive Agent System for On-Call Support with Continuous Self-ImprovementarXiv 2604Real-world Data · Intervention Timing · Skill LearningarXiv Star Notes
2026-04Proactive Agent Research Environment: Simulating Active Users to Evaluate Proactive AssistantsarXiv 2604Simulation · Intervention Timing · BenchmarkarXiv Website Star Notes
2026-04KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent EvaluationarXiv 2604Mobile · Personalization · Safety & ConsentarXiv HF Paper Star Notes
2026-05An Empirical Study of Proactive Coding Assistants in Real-World Software DevelopmentarXiv 2605IDE · Real-world Data · BenchmarkarXiv Notes
2026-05ToolCUA: Towards Optimal GUI-Tool Path Orchestration for Computer Use AgentsarXiv 2605GUI · Tool Use · OptimizationarXiv Star Notes
2026-04From Reactive to Proactive: Assessing the Proactivity of Voice Agents via ProVoice-BenchInterspeech 2026Multimodal / Wearable · Intervention Timing · BenchmarkarXiv Notes
2026-06Perceive Before Reasoning: A Pre-Reasoning Perception Framework for Efficient and Reliable Proactive Mobile AgentsarXiv 2606Mobile · Intervention Timing · Tool UsearXiv Notes
2026-07InquireMobile: Teaching VLM-based Mobile Agent to Request Human Assistance via Reinforcement Fine-TuningACL 2026Mobile · Safety & Consent · ClarificationACL Website Notes
2026-07PersonalAlign: Hierarchical Implicit Intent Alignment for Personalized GUI Agent with Long-Term User-Centric RecordsACL 2026GUI · Personalization · Intent InferenceACL Notes
2026-08Active-SWE: Benchmarking Coding Agents for Proactive Bug Fixing without Issue ReportsarXiv 2608IDE · Benchmark · Tool UsearXiv Notes
2026-08ITO: Real-time Browser Tab Orchestration Through Intent DetectionUIST 2026GUI · Intent Inference · Human FactorsarXiv Notes
2026-08Act2Intention: A Benchmark For Developing Active Mobile Agents Through Inferring User Intention from GUI ActionsarXiv 2608Mobile · Intent Inference · BenchmarkarXiv Star Notes
2026-08On the Prospects of Dynamic LLM Conversations in Software DevelopmentarXiv 2608IDE · Human Factors · Intervention TimingarXiv Notes
2026-08Towards Cognitive Process-Aware Proactive Writing SupportarXiv 2608GUI · Intent Inference · Human FactorsarXiv Notes
2026-08InsightToast: Proactive Information Retrieval & Glanceable Visualization in the Side Channel of Data-Rich MeetingsUIST 2026GUI · Collaboration · Intervention TimingarXiv Notes
2026-09Beyond Instruction-Driven Editing: Source-Grounded Problem Discovery with User-Governed Repair for Scientific PostersarXiv 2609GUI · Human Factors · Safety & ConsentarXiv Notes
2026-09Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI AgentsarXiv 2609GUI · Safety & Consent · Intervention TimingarXiv Star Notes

Multimodal, Wearable and Embodied Agents

DateTitleVenue / SourceTagsResources
2024-09AssistantX: An LLM-Powered Proactive Assistant in Collaborative Human-Populated EnvironmentsIROS 2025Embodied · Collaboration · PlanningarXiv
2024-10Satori: Towards Proactive AR Assistant with Belief-Desire-Intention User ModelingCHI 2025Multimodal / Wearable · Intent Inference · Human FactorsarXiv DOI Notes
2025-01YETI: Proactive Interventions by Multimodal AI Agents in Augmented Reality TasksarXiv 2501Multimodal / Wearable · Intervention Timing · Human FactorsarXiv Website Notes
2025-01AiGet: Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart GlassesCHI 2025Multimodal / Wearable · Intent Inference · PersonalizationarXiv DOI
2025-02WatchGuardian: Enabling User-Defined Personalized Just-in-Time Intervention on SmartwatcharXiv 2502Multimodal / Wearable · Personalization · Intervention TimingarXiv Notes
2025-02Mirai: A Wearable Proactive AI Inner-Voice for Contextual NudgingCHI EA 2025Multimodal / Wearable · Intervention Timing · Human FactorsarXiv DOI
2025-03OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video ContextsCVPR 2025Multimodal / Wearable · Intervention Timing · BenchmarkarXiv CVF Website Notes
2025-05ContextAgent: Context-Aware Proactive LLM Agents with Open-World Sensory PerceptionsNeurIPS 2025Multimodal / Wearable · Personalization · Tool UsearXiv Website Star Notes
2025-05PACE: Proactive Assistance in Human-Robot Collaboration Through Action-Completion EstimationICRA 2025Embodied · Intervention Timing · OptimizationDOI Notes
2025-06Proactive Assistant Dialogue Generation from Streaming Egocentric VideosEMNLP 2025Multimodal / Wearable · Dialogue · Intervention TimingarXiv
2025-07ProMemAssist: Exploring Timely Proactive Assistance Through Working Memory Modeling in Multi-Modal Wearable DevicesUIST 2025Multimodal / Wearable · Intervention Timing · Human FactorsarXiv DOI Notes
2025-12ProAgent: Harnessing On-Demand Sensory Contexts for Proactive LLM Agent SystemsarXiv 2512Multimodal / Wearable · Sensing · Intervention TimingarXiv Video Notes
2026-01ROMA: Real-time Omni-Multimodal Assistant with Interactive Streaming UnderstandingFindings of ACL 2026Multimodal / Wearable · Intervention Timing · OptimizationarXiv ACL Notes
2026-01Clarify or Answer: Reinforcement Learning for Agentic VQA with Context Under-specificationarXiv 2601Multimodal / Wearable · Clarification · OptimizationarXiv Notes
2026-03ProactiveBench: Benchmarking Proactiveness in Multimodal Large Language ModelsICLR 2026Multimodal / Wearable · Intervention Timing · BenchmarkarXiv Star Dataset Notes
2026-03StreamReady: Learning What to Answer and When in Long Streaming VideosCVPR 2026Multimodal / Wearable · Intervention Timing · BenchmarkarXiv CVF Website Notes
2026-03Em-Garde: A Propose-Match Framework for Proactive Streaming Video UnderstandingECCV 2026Multimodal / Wearable · Intervention Timing · OptimizationarXiv DOI Star Notes
2026-04AURA: Always-On Understanding and Real-Time Assistance via Video StreamsarXiv 2604Multimodal / Wearable · Intervention Timing · OptimizationarXiv Notes
2026-05IPIBench: Evaluating Interactive Proactive Intelligence of MLLMs under Continuous StreamsarXiv 2605Multimodal / Wearable · Intervention Timing · BenchmarkarXiv Notes
2026-05OmniPro: A Comprehensive Benchmark for Omni-Proactive Streaming Video UnderstandingarXiv 2605Multimodal / Wearable · Intervention Timing · BenchmarkarXiv Website Notes
2026-05EgoPro-Bench: Benchmarking Personalized Proactive Interaction in Egocentric Video StreamsarXiv 2605Multimodal / Wearable · Personalization · BenchmarkarXiv Notes
2026-05MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent MemoryarXiv 2605Memory · Multimodal / Wearable · BenchmarkarXiv Notes
2026-05PACT: Proactive Asking for Continual Task Assistance in Human-Robot CollaborationarXiv 2605Embodied · Clarification · Long-horizonarXiv Notes
2026-07Vinci2: Providing Proactive Assistance in Continuous Egocentric VideosECCV 2026Multimodal / Wearable · Intervention Timing · MemoryarXiv Website Notes
2026-07ChatMuse: Supporting In-Person Small-Group Conversation Experience with a Proactive Assistive AI Agent in Mixed RealityUIST 2026Multimodal / Wearable · Collaboration · Human FactorsarXiv Notes
2026-08GROVE: Growing and Reasoning over Temporally Stratified Memory from Streaming Video ExperiencearXiv 2608Multimodal / Wearable · Memory · Intervention TimingarXiv Star Notes
2026-08From Sports to Safety: Benchmarking Proactive Risk Inference in MLLMsarXiv 2608Multimodal / Wearable · Safety & Consent · BenchmarkarXiv Star Notes
2026-08StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video UnderstandingarXiv 2608Multimodal / Wearable · Long-horizon · BenchmarkarXiv Notes
2026-08MOSS-VL Technical ReportarXiv 2608Multimodal / Wearable · Intervention Timing · OptimizationarXiv Website Star Notes
2026-08StreamSoccer: Event-Driven Memory for Streaming Soccer CommentaryarXiv 2608Multimodal / Wearable · Intervention Timing · MemoryarXiv Notes
2026-08OmniAssistBench: Assistant-style Interaction Benchmark for Omni-LLMsarXiv 2608Multimodal / Wearable · Dialogue · BenchmarkarXiv Website Notes
2026-08When Seeing Is Not Enough: Benchmarking Interactive Visual Grounding in LVLMsEMNLP 2026Multimodal / Wearable · Clarification · BenchmarkarXiv Notes
2026-08MMPCBench: Benchmarking Multimodal Large Language Models on Proactive Critique of Flawed InputsarXiv 2608Multimodal / Wearable · Safety & Consent · BenchmarkarXiv Star Notes
2026-09Time-Aware Assistive NavigationICRA 2026Multimodal / Wearable · Intervention Timing · BenchmarkarXiv Website Notes
2026-09Ambient @ EgoProactive 2026: Proactive Egocentric Assistance with Visually Grounded SupervisionECCV 2026 Wearable AI ChallengeMultimodal / Wearable · Intervention Timing · OptimizationarXiv Star Notes
2026-09Omni Interaction Agent Technical ReportarXiv 2609Multimodal / Wearable · Dialogue · Intervention TimingarXiv Website Star Notes
2026-09Realtime-Venus: A Full-Duplex Interaction System with Asynchronous DelegationarXiv 2609Multimodal / Wearable · Dialogue · Tool UsearXiv Notes
2026-09Full-Duplex Speech Models Take the Floor When Asked, Not When NeededarXiv 2609Multimodal / Wearable · Intervention Timing · BenchmarkarXiv Notes

Benchmarks, Personalization and Optimization

DateTitleVenue / SourceTagsResources
2025-08ProactiveEval: A Unified Evaluation Framework for Proactive Dialogue AgentsACL 2026Benchmark · Dialogue · Intent InferencearXiv ACL Star Notes
2025-09ProPerSim: Developing Proactive and Personalized AI Assistants through User-Assistant SimulationICLR 2026Personalization · Simulation · BenchmarkarXiv
2025-10Beyond Reactivity: Measuring Proactive Problem Solving in LLM AgentsarXiv 2510Benchmark · Intent Inference · Tool UsearXiv Star Notes
2025-10AgentFold: Long-Horizon Web Agents with Proactive Context FoldingICLR 2026Long-horizon · Memory · Tool UsearXiv ICLR OpenReview Notes
2025-11Training Proactive and Personalized LLM AgentsCOLM 2026Personalization · Optimization · SimulationarXiv Star Notes
2025-11Structured Uncertainty guided Clarification for LLM AgentsFindings of ACL 2026Clarification · Tool Use · BenchmarkarXiv ACL Notes
2026-02Pushing Forward Pareto Frontiers of Proactive Agents with Behavioral Agentic OptimizationICML 2026Optimization · Human Factors · Safety & ConsentarXiv ICML
2026-03ProEvent: An Event-centric Benchmark for Proactive AgentsarXiv 2607 / ACL ARR 2026Benchmark · Long-horizon · Intervention TimingarXiv OpenReview Notes
2026-04SKILL0: In-Context Agentic Reinforcement Learning for Skill InternalizationarXiv 2604Optimization · Skill Learning · MemoryarXiv Star Notes
2026-04PASK: Toward Intent-Aware Proactive Agents with Long-Term MemoryarXiv 2604Long-horizon · Memory · Intervention TimingarXiv Website Notes
2026-05CogniFold: Always-On Proactive Memory via Cognitive FoldingarXiv 2605Memory · Intent Inference · BenchmarkarXiv HF Paper Star Dataset Notes
2026-05MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and EvaluationarXiv 2605Optimization · Skill Learning · MemoryarXiv Notes
2026-05Do Proactive Agents Really Need an LLM to Decide When to Wake and What to Anchor?arXiv 2605Intervention Timing · Optimization · Tool UsearXiv Notes
2026-05ProactBench: Beyond What The User Asked ForarXiv 2605Benchmark · Dialogue · Intent InferencearXiv Notes
2026-05Claw-Anything: Benchmarking Always-On Personal Assistants with Broader Access to User's Digital WorldarXiv 2605Long-horizon · Benchmark · Tool UsearXiv Notes
2026-05π-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon WorkflowsarXiv 2605Long-horizon · Intent Inference · BenchmarkarXiv Website Star Dataset Notes
2026-05VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User InteractionsarXiv 2605Long-horizon · Personalization · MemoryarXiv HF Paper Star Notes
2026-06Ψ-Bench: Evaluating Persona-Sensitive Influencing in Persuasive DialoguesarXiv 2606Dialogue · Personalization · BenchmarkarXiv Star Notes
2026-06Communication Policy Evolution for Proactive LLM AgentsarXiv 2606Dialogue · Intervention Timing · OptimizationarXiv Notes
2026-06See, Infer, Intervene: Proactive World Modeling for Goal-Oriented Social IntelligencearXiv 2606Multimodal / Wearable · Intervention Timing · BenchmarkarXiv Notes
2026-07Remember When It Matters: Proactive Memory Agent for Long-Horizon AgentsarXiv 2607Long-horizon · Memory · Intervention TimingarXiv Notes
2026-07ENPMR-Bench: Benchmarking Proactive Memory Retrieval for Emotional Support AgentsFindings of ACL 2026Memory · Dialogue · BenchmarkACL Notes
2026-08Preference-Driven Online Adaptation for Personalized Interaction Initiation in Proactive AI AssistantsarXiv 2608Personalization · Intervention Timing · OptimizationarXiv Notes
2026-08VibeLifeBench: Can Your Life Agent Be Proactive and Persistent in a Living World?arXiv 2608Long-horizon · Benchmark · Safety & ConsentarXiv Notes
2026-08Not Just Reason, Not Just Scan: Reinforcement Learning for Proactive Scientific Error Verification over Academic PaperFindings of EMNLP 2026Multimodal / Wearable · Optimization · Safety & ConsentarXiv Notes
2026-09RPCBench: A Benchmark for Proactive Premise Critique in LLM-based RecommendationarXiv 2609Recommendation · Benchmark · Safety & ConsentarXiv Star Notes
2026-09Propose to Learn, Learn to Propose: Evaluability-Aware Assistance under Bounded RationalityarXiv 2609 · Under reviewPersonalization · Planning · Human FactorsarXiv Notes
2026-09New Evidence, Same Choice: Testing Physical Experiment Selection in Vision Language ModelsarXiv 2609Benchmark · Planning · Tool UsearXiv Notes

Benchmarks

For detailed comparison, see BENCHMARKS.md.

DateBenchmarkPaperEnvironmentWhat it testsResources
2024-03ProMISeProMISeinformation-seeking dialogueproactive clarification for intent resolutionACL
2024-10RealHumanEvalNeed Help?programming tasksproactive IDE assistance with human usersarXiv
2024-10ProactiveBenchProactive Agentdesktop activity eventsproactive task prediction and acceptancearXiv Star
2025-03OmniMMIOmniMMIcontinuous audio-visual streamsproactive alerts, turn-taking, and streaming interactionarXiv CVF Website
2025-05ContextAgentBenchContextAgentwearable sensory contextsproactive service prediction and tool callingarXiv Star
2025-07FingerTip 20KFingerTip 20KAndroid trajectoriesproactive task suggestion and personalized executionarXiv Star
2025-08ProactiveEvalProactiveEvalproactive dialoguetarget planning and dialogue guidance across six domainsarXiv ACL Star
2025-10PROBEBeyond Reactivityweb problem-solving tasksbottleneck discovery and autonomous resolutionarXiv Star
2025-11UserVilleTraining Proactive and Personalized LLM AgentsSWE and deep-research user simulationproductivity, proactivity and personalization under vague promptsarXiv Star
2025-11ClarifyBenchStructured Uncertainty Guided Clarificationdynamic tool-calling tasksdecide which tool argument to clarify and when to stop askingarXiv ACL
2026-01ChronosBenchLong-term Task-oriented Agentdynamic task environmentsproactive long-term intent maintenancearXiv Notes
2026-02ProAgentBenchProAgentBenchreal workflow logswhen-to-assist and how-to-assistarXiv Code
2026-02ProactiveMobileProactiveMobilemobile device contextlatent intent to executable API sequencearXiv CVF
2026-03ProEventProEventfuture event trackingproactive event maintenance and remindersarXiv OpenReview Notes
2026-03PIRA-BenchPIRA-Benchcontinuous GUI screenshotsproactive GUI intent recommendationarXiv Website Dataset
2026-03ProReady-QAStreamReadylong streaming videos with annotated evidence windowsanswer only after sufficient evidence appears and avoid both premature and delayed responsesCVF Website
2026-03GUIDEGUIDEopen-ended GUI workflow videosbehavior state, intent, and help predictionarXiv Website Dataset Notes
2026-03ProactiveBench (MLLM)ProactiveBench / Trentovisual difficulty scenariosMLLM proactive help-seeking from visual contextarXiv Dataset
2026-05IPIBenchIPIBenchstreaming video, multi-turninteractive proactive monitoring, task management, reactive-proactive coordinationarXiv Notes
2026-04ProVoice-BenchProVoice-Benchvoice interaction streamsproactive voice intervention timing, over-triggering, monitoringarXiv Notes
2026-04Pare-BenchParemulti-app FSM environmentactive user simulation, intervention timing, multi-app executionarXiv Website Star
2026-04KnowU-BenchKnowU-BenchAndroid emulatorpersonalization, proactive tasks, consent and rejection handlingarXiv Star
2026-04LatentNeeds-BenchPASKreal speech transcripts over multi-turn sessionsdetect latent demand, assist, or stay silent under latency constraintsarXiv Website
2026-05CogEval-BenchCogniFoldstreaming event memoryproactive concept emergence and cognitive-structure formationarXiv Dataset Star
2026-05MemEyeMemEyemultimodal long-term memoryvisual evidence granularity and temporal state reasoningarXiv
2026-05ProCodeBenchProactive Coding Assistantsreal IDE tracesproactive coding intent prediction and sim-to-real evaluationarXiv
2026-05ProactBenchBeyond What The User Asked Forsynthetic multi-turn conversationsgrounded unstated-need inference at emergent, critical, and recovery triggersarXiv
2026-05OmniProOmniProcontinuous omni-modal video streamsautonomously decide when and what to report across multiple triggersarXiv Website
2026-05EgoPro-BenchEgoPro-Benchegocentric streaming videos and user profilespersonalized interaction timing with explicit attention-or-silence labelsarXiv
2026-05Claw-AnythingClaw-Anythingmonths of cross-service and multi-device activityanticipate needs and complete proactive personal-assistant tasks amid noisearXiv
2026-05π-Benchπ-Benchpersistent personal workspacesproactive hidden-intent resolution and checklist completion in long-horizon workflowsarXiv Website Star Dataset
2026-05ProActEvalAnticipate and Learnproactive assistant scenariosidle-time anticipation, evidence acquisition, user effort and hallucination reductionarXiv Website Star
2026-05VitaBench 2.0VitaBench 2.0long-term user interaction sequencespreference extraction, memory use, updates, and proactive missing-information acquisitionarXiv HF Paper Star
2026-06Ψ-BenchΨ-Benchpersuasive dialoguepersona-sensitive influencing with simulated clients and user profilesarXiv Star
2026-06GuidanceSalesBenchSee, Infer, Intervenepre-interaction retail videos and customer-state manifestsselect greet, elicit, inform, recommend, or holdarXiv
2026-07ProACT Collaboration BenchProACTmulti-user collaborationbreakdown detection, intervention timing, and non-interruptivenessarXiv
2026-07InquireBenchInquireMobilemobile GUIproactive confirmation before risky or uncertain actionsACL Website
2026-07AndroidIntentPersonalAlignlong-term Android recordsvague-intent resolution and instruction-free routine suggestionsACL
2026-07BSDDCoLabSciencestreaming biomedical discussionswhen and how to contribute without disrupting collaboratorsACL
2026-07ENPMR-BenchENPMR-Benchemotional-support dialoguelatent emotional-need inference and proactive supportive-memory retrievalACL
2026-07EgoServeVinci2continuous egocentric videowhen-and-whether assistance across four memory horizonsarXiv Website
2026-07Int-BenchAI Assistants Overassistsimulated learners solving 1,500 problemswhether, when, and how much a tutor should intervenearXiv
2026-07AskBenchWhen and What to Askinteractive intent-deficient and false-premise QAdecide when and what to clarify without sacrificing task performanceACL
2026-08Active-SWEActive-SWErepository snapshots without issue reportsautonomous discovery and repair of single, multiple, and potential bugsarXiv
2026-08SPRINTFrom Sports to Safetyreal sports videosearly hazard warning, cause grounding, and false-alarm controlarXiv Star
2026-08StreamArenaStreamArenahour-scale audio-visual streamsproactive monitoring alongside perception, retrospection, and tool usearXiv
2026-08VibeLifeBenchVibeLifeBenchsimulated multi-week life tasksautonomous act, ask, and stay-silent decisions under silent world changes and implicit constraintsarXiv Notes
2026-08JarvisBenchJarvisBenchongoing single- and multi-agent workrecognize consequential user-owned decisions, request judgment, and route it back to working agentsarXiv Star Notes
2026-08Act2Intention BenchAct2Intentioncontinuous mobile GUI trajectoriesunderstand, predict, suggest, and execute the next user intention from action historyarXiv Star Notes
2026-08StreamSoccerStreamSoccercontinuous soccer videocausal commentary across current, recent, and historical scopes with rule-assisted mode-or-silence schedulingarXiv Notes
2026-08OmniAssistBenchOmniAssistBenchcontinuous assistant-style video interactionsguide a user through a goal, incorporate visual prompts, and delay responses until the target eventarXiv Website
2026-08Interactive Visual GroundingWhen Seeing Is Not Enoughambiguous visual references under multi-turn protocolsask follow-up questions and synthesize acquired evidence to ground the targetarXiv
2026-08MMPCBenchMMPCBenchflawed multimodal user inputsautonomously detect, diagnose, and repair errors without an extra promptarXiv Star
2026-09PROS-BenchBeyond Instruction-Driven Editingsource papers paired with editable scientific postersdiscover source-grounded problems, obtain user acceptance, repair native objects, and validate outcomesarXiv
2026-09RPCBenchRPCBenchevidence-grounded recommendation requests with corrupted premisesproactively detect, localize, and handle premise failures without fabricating unsupported recommendationsarXiv Star
2026-09CONFLICTGUIDo GUI Agents Know When Not to Act?feasible and conflicting instructions grounded in GUI statesverify feasibility and terminate rather than over-comply when instructions or GUI evidence conflictarXiv Star
2026-09CC-MediationCC-Mediationten-turn cross-cultural conflict dialoguesdecide when to intervene and select a mediation strategy with persistent downstream benefitarXiv Star
2026-09OR-ClarifyAsk Before You Optimizepartially specified operations-research requests with hidden formulation slotsask only formulation-critical questions, avoid silent assumptions, and stop when ready to modelarXiv
2026-09TIMELITime-Aware Assistive Navigationegocentric navigation videos and closed-loop urban simulationdecide when to give concise guidance or remain silent for safetyarXiv Website
2026-09IdeaAMBIGIdeaAMBIGincomplete research-method specifications grounded in papers and codedetect implementation-critical gaps and issue clarification actions instead of assumingarXiv
2026-09Physical Experiment SelectionNew Evidence, Same Choicecontrolled visual-physics measurements with known experiment costsanswer when evidence is sufficient or select the cheapest resolving experimentarXiv
2026-09ProMediConvProMediConvmulti-stage legal dispute dialogues reconstructed from real casesselect mediation strategies proactively and improve party behavior over the trajectoryarXiv Star

Tag Vocabulary

Tags are intentionally compact and reusable. They describe the paper's main contribution, not every detail.

TagMeaning
DefinitionDefines or reframes proactive agents, proactive dialogue, or design-space boundaries.
SurveySynthesizes a broad proactive-agent subfield or taxonomy.
Human FactorsStudies interruption, control, satisfaction, workload, adoption, or developer experience.
TrustFocuses on competence perception, calibrated reliance, or trustworthy interaction.
Safety & ConsentCovers confirmation, autonomy boundaries, reversibility, rejection, or risk control.
PrivacyCenters privacy management, data minimization, or personal-context governance.
Intervention TimingFocuses on when an agent should act, ask, suggest, or remain silent.
Intent InferenceInfers latent goals, hidden constraints, future tasks, or missing information.
ClarificationProactively asks questions before planning, execution, or recommendation.
DialogueProactive behavior in conversational, persuasive, or task-oriented interaction.
PlanningProactive decomposition, task planning, scheduling, or future-state reasoning.
Tool UseTool calling, API execution, GUI operation, or action orchestration.
RecommendationProactive recommendation or suggestion ranking.
CollaborationMulti-party or human-agent collaborative problem solving.
EducationLearning, tutoring, reflection, or student engagement contexts.
Long-horizonMulti-session, dynamic, future-event, or long-running task maintenance.
PersonalizationUser preferences, personas, profiles, long-term user history, or user-specific adaptation.
MemoryPersistent memory, episodic memory, visual memory, skill memory, or cognitive memory structures.
SimulationUser simulation, environment simulation, synthetic users, or synthetic workflows.
OptimizationRL, reward modeling, multi-objective optimization, self-evolution, or behavior tuning.
Skill LearningSkill creation, skill internalization, skill memory, or reusable procedure learning.
BenchmarkIntroduces a dataset, evaluation suite, benchmark, simulator, or diagnostic protocol.
Real-world DataUses real user traces, field-study data, or deployment-like logs.
DesktopDesktop activity streams, workstation context, or event logs.
GUIGraphical interface agents, browser/app screens, or visual UI interaction.
MobileMobile GUI, Android/iOS workflows, phone sensors, or mobile user context.
OSOperating-system agents, cross-app workflows, or OS-level verification.
IDEProgramming assistants, code editors, or developer tooling.
Multimodal / WearableVideo, audio, AR, smart glasses, egocentric streams, or open-world sensory context.
SensingActive context acquisition, sensor selection, or on-demand sensory capture.
EmbodiedRobots, physical environments, or human-populated embodied settings.

Contributing

Pull requests are welcome.

Before adding a paper, check that it satisfies at least one of:

  • It predicts latent user intent before a complete explicit instruction.
  • It decides when to intervene, ask, suggest, execute, remind, or stay silent.
  • It evaluates proactive assistance, interruption cost, user control, consent, or personalization.
  • It contributes a benchmark or dataset where proactivity is the primary task.

Suggested note template:

# Paper Title

## Why It Matters

...

## Proactivity Signal

...

## Evaluation Setup

...

## Key Limitations

...

## Use For

...

Maintained by Low Entropy AI.

agent
ai
ai-agent
awesome-list
benchmark
llm
multimodal
proactive
proactive-agent

Contributors

Kaiming-Y

32 commits

KashiwaByte

2 commits