supernalintelligence/Awesome-Gui-Agents

Awesome list of GUI agents (browser and computer use)

69

12 commits

updated Aug 26, 2025

See the code

README

Awesome GUI Compute Agents

Supernal Intelligence Logo

License: MIT Stars

Follow on X Bluesky Website

A curated list of GUI (Graphical User Interface) compute agents - AI systems that can see, understand, and interact with graphical interfaces like humans do.

This project is maintained by Parni and Ian. Follow Supernal Intelligence for more updates.

Website: supernalintelligence.com
Join our Discord: Supernal Intelligence Discord

For more complete data and the latest information, please visit our website: supernalintelligence.com

What are GUI Compute Agents?

GUI compute agents are AI systems designed to interact with graphical user interfaces just like humans do. They can:

  • See and understand screen elements
  • Click buttons, type text, and drag elements
  • Navigate through applications and websites
  • Complete complex visual workflows
  • Automate GUI-based tasks through natural language instructions

Contents

Commercial Agents

NameDeveloperStatusKey FeaturesEnvironment
AceGeneral AgentsUpcoming (2025)Achieved 20× human speed on UI tasks; controls full computer via screen pixelsDesktop, Browser
ACT-1Adept AIReleased (2022)Pioneer in digital actions; self-correcting behaviorDesktop, Browser
CloudCruiseCloudCruiseReleasedCloud-based GUI automation; enterprise-gradeCloud, Browser
Felluo AIFelluoReleasedVision-based GUI automation; supports both browser and desktop interactionsDesktop, Browser
Adaptive.AIAdaptive AI IncReleasedAI risk management framework; technology strategy consultingBrowser
AgentGPTReworkdReleased (2023)User-friendly interface for creating goal-oriented agentsBrowser
AI Agent StudioAutomation AnywhereReleased (2025)Handles structured and unstructured data; creates AI agents for enterprise automationBrowser
Apple Intelligence AgentsAppleUpcoming (2025)Deep OS integration; privacy-focusedPhone, Desktop
AskUI Vision AgentAskUIReleasedCross-platform functionality without virtual machinesDesktop, Browser, Phone
Beam AIBeamReleasedAgentic Process Automation platform for customer support, onboarding, sales proposal generationBrowser
Claude Agent KitAnthropicUpcoming (2024)Official toolkit for building Claude-powered agentsBrowser
Claude Computer UseAnthropicReleased (2024)Works on desktop apps and browsers; AI model-based approachBrowser, Desktop, Multi-device
DevinCognition LabsUpcoming (2025)Full-stack programming capabilities with browser accessDesktop, Browser
Fuyu-HeavyAdept AIReleased (2024)Ranked 3rd best vision-action model behind GPT-4V and Gemini UltraDesktop, Browser
Gemini 1.5 Pro (Tool Use)GoogleReleasedLong context, tool orchestration in WorkspaceBrowser
Google MarinerGoogle DeepMindUnreleasedHigh WebVoyager benchmark performanceBrowser
GumloopGumloopReleased (2023)Visual workflow canvas; 90+ pre-built templates; Chrome extension for web automationBrowser
Highlight AIEmbedded IntelligenceReleased (2024)Instant Q&A and automation on desktop; strong privacy focusDesktop, Browser
HyperbrowserHyperbrowser.ai (YC Backed)Released (2024)Sub-second browser launch, 10,000+ concurrent browsers, CAPTCHA solvingBrowser
LindyLindy.aiReleasedVirtual AI assistant for daily business tasksBrowser
ManusMonica AI (China)Released (2024)World's first general AI agent; SOTA on GAIA benchmarkDesktop, Browser, Phone
MultiOn (now Please AI)Please AIReleased (2023)Multi-step web tasks end-to-end; preference learningBrowser
OpenAI CUA (Operator)OpenAIReleased (2025)High benchmark performance; uses reasoning models techBrowser, Desktop
Perplexity CometPerplexity AIUpcoming (2025)Autonomous multi-step search with citationsBrowser
Project JarvisGoogleRumoredComputer-using agent system; few details availableDesktop, Browser
ProxyConvergence AIReleased (2025)Handles concurrent sub-tasks; cheaper alternative to OperatorBrowser
RelayRelay.appReleased (2021)Clean, simple interface; extensive app integrationsBrowser
Relevance AIRelevance AIReleasedDrag-and-drop skill building, templates, integrationsBrowser
ServiceNow AI AgentsServiceNowReleasedBuilt-in governance, analytics, text-to-action capabilitiesBrowser
VyVerceptReleased (2025)Advanced human-computer interaction; works with existing applicationsDesktop

Open Source Agents

NameDeveloperLicenseKey FeaturesEnvironment
Agent SSimular AIResearch LicenseWeb research, content summarization, data extractionBrowser, Desktop
Agent S2Simular AIResearch LicenseOSWorld: 34.5%; AndroidWorld: 50%; outperforms OpenAI CUA/OperatorBrowser, Desktop, Phone
AutoGenMicrosoftMITAgents can converse with each other to solve tasksBrowser
AutoGPTSignificant GravitasMITPioneer in autonomous GPT agents; self-prompting with memoryBrowser
BabyAGIYohei NakajimaMITAutonomous task creation and prioritizationBrowser
Browser UseY Combinator/ETH ZurichProprietaryMakes websites more digestible for AI agentsBrowser
c/ua (Computer-Use Agent)TryCuaOpen SourceHigh-performance virtualization; fully isolated virtual environmentsDesktop, Virtual Machine
CogAgentTsinghua Univ. & ZhipuResearch License (CC BY-NC)High-performance open model rivaling closed modelsDesktop, Browser
CrewAICrewAIProprietaryEnables orchestration of specialized agents in teamsBrowser
HyperAgentFSoft-AI4CodeApache 2.0Handles GitHub issue resolution, repository-level code generationBrowser, Desktop
LangGraphLangChainMITFramework for building stateful, multi-agent systemsBrowser
LLM AgentsNVIDIA/MetaResearch LicenseStandardized evaluation for LLM agentsBrowser
OctoGoogle DeepMindApache 2.0Zero-shot generalization to new objects and tasksPhysical World
OpenInterpreterOpen InterpreterProprietaryCode interpreter for local executionDesktop, Browser
OWLCamel-AIProprietaryDistributed task automationBrowser
RooCodeOpen-sourceProprietaryAutonomous coding in VS CodeBrowser, Desktop
Simular AISimularResearch LicenseSOTA on OSWorld and AndroidWorld benchmarksDesktop, Browser, Phone
SunaKortixProprietaryHighly versatile generalist agent; handles complex tasksBrowser
UI-TARSByteDance/TikTokResearch LicenseAutonomous GUI execution on PC/Mac/AndroidBrowser, Desktop, Phone
Vercel AI SDK Computer UseVercelOpen SourceStandardized API for different AI models; streaming capabilitiesBrowser, Web
WebVoyagerHongliang He et al.Research License59.1% success on 15-website benchmarkBrowser
Felluo AIFelluoProprietaryVision-based GUI automationBrowser, Desktop

Research Projects

NameInstitutionFocus AreaRelease Date
Deep Research AgentOpenAIWeb browsing, research2024
GatoGoogle DeepMindMulti-modal, multi-task, multi-embodiment2022
HuggingGPT (Jarvis)MicrosoftOrchestrates specialists for multi-modal tasks2023
I-AFMMicrosoft ResearchMulti-modal, multi-task system2024
MagmaMicrosoft ResearchVision-language-action model2025
mlejva's Computer AgentVasek MlejnskyGUI interaction2024
PaLM-EGoogle DeepMind & Robotics at GoogleEmbodied multimodal language model2023
RT-2Google DeepMindVision-language-action model2023
SayCanGoogleGrounded language model for robotics2022
SIMAGoogle DeepMind3D virtual environments2024
WebAgentGoogle DeepMindAutonomous web browsing and form-filling2024

By Environment

Browser-Based Agents

Browser-based agents specialize in navigating and interacting with web interfaces:

NameDeveloperStatusDevelopment Type
HyperbrowserHyperbrowser.ai (YC Backed)ReleasedCommercial
Perplexity CometPerplexity AIUpcomingCommercial
Browser UseY Combinator/ETH ZurichReleasedCommercial, Open-source
CloudCruiseCloudCruiseReleasedCommercial
Deep Research AgentOpenAIUnreleasedCommercial, Research
Felluo AIFelluoReleasedCommercial
Google MarinerGoogle DeepMindUnreleasedCommercial, Research
GumloopGumloopReleasedCommercial
MultiOn (now Please AI)Please AIReleasedCommercial
ProxyConvergence AIReleasedCommercial
SunaKortixReleasedOpen-source
WebVoyagerHongliang He et al.ReleasedResearch, Open-source

Desktop Agents

Desktop agents interact with operating system GUIs and desktop applications:

NameDeveloperStatusDevelopment Type
AceGeneral AgentsUpcomingCommercial, Research
Claude Computer UseAnthropicReleasedCommercial
Felluo AIFelluoReleasedCommercial
Fuyu-HeavyAdept AIReleasedCommercial, Research
Highlight AIEmbedded IntelligenceReleasedCommercial
OpenAI CUA (Operator)OpenAIReleasedCommercial
Project JarvisGoogleRumoredCommercial, Research
CogAgentTsinghua Univ. & ZhipuReleasedResearch, Open-source
VyVerceptReleasedCommercial
c/ua (Computer-Use Agent)TryCuaReleasedOpen Source

Physical World Agents

These agents operate in 3D environments, games, and physical systems:

NameDeveloperStatusDevelopment Type
GatoGoogle DeepMindReleasedResearch
I-AFMMicrosoft ResearchReleasedResearch
MagmaMicrosoft ResearchReleasedResearch, Open Source
OctoGoogle DeepMindReleasedOpen Source, Research
PaLM-EGoogle DeepMind & Robotics at GoogleReleasedResearch
RT-2Google DeepMindReleasedResearch
SayCanGoogleReleasedResearch
SIMAGoogle DeepMindReleasedResearch

Cloud Agents

Cloud-based agents running in remote environments:

NameDeveloperStatusDevelopment Type
CloudCruiseCloudCruiseReleasedCommercial

Multi-Device Agents

Agents that can operate across multiple device types:

NameDeveloperStatusSupported Devices
Agent S2Simular AIReleasedWindows, MacOS, Linux, Android, iOS
AskUI Vision AgentAskUIReleasedWindows, MacOS, Linux, Android, iOS
Claude Computer UseAnthropicReleasedWindows, MacOS, Linux, Multi-device
ManusMonica AI (China)ReleasedWindows, MacOS, Linux, Android, iOS
Simular AISimularReleasedWindows, MacOS, Linux, Android, iOS
UI-TARSByteDance/TikTokReleasedWindows, MacOS, Linux, Android, iOS

By Task Complexity

For a full breakdown of agents by task complexity, including Single Workflow, Multiple Workflow, and Complex Workflow Agents, please visit our website: supernalintelligence.com

Resources

Communities

Contribution

Contributions welcome! Please read the contribution guidelines first or email i@supernal.ai if you see an error or want to contribute.

License

This awesome list is maintained by Parni and Ian, and is released under the MIT Open Source License.

supernalintelligence/Awesome-Gui-Agents

Awesome list of GUI agents (browser and computer use)

69

12 commits

updated Aug 26, 2025

See the code

README

Awesome GUI Compute Agents

Supernal Intelligence Logo

License: MIT Stars

Follow on X Bluesky Website

A curated list of GUI (Graphical User Interface) compute agents - AI systems that can see, understand, and interact with graphical interfaces like humans do.

This project is maintained by Parni and Ian. Follow Supernal Intelligence for more updates.

Website: supernalintelligence.com
Join our Discord: Supernal Intelligence Discord

For more complete data and the latest information, please visit our website: supernalintelligence.com

What are GUI Compute Agents?

GUI compute agents are AI systems designed to interact with graphical user interfaces just like humans do. They can:

  • See and understand screen elements
  • Click buttons, type text, and drag elements
  • Navigate through applications and websites
  • Complete complex visual workflows
  • Automate GUI-based tasks through natural language instructions

Contents

Commercial Agents

NameDeveloperStatusKey FeaturesEnvironment
AceGeneral AgentsUpcoming (2025)Achieved 20× human speed on UI tasks; controls full computer via screen pixelsDesktop, Browser
ACT-1Adept AIReleased (2022)Pioneer in digital actions; self-correcting behaviorDesktop, Browser
CloudCruiseCloudCruiseReleasedCloud-based GUI automation; enterprise-gradeCloud, Browser
Felluo AIFelluoReleasedVision-based GUI automation; supports both browser and desktop interactionsDesktop, Browser
Adaptive.AIAdaptive AI IncReleasedAI risk management framework; technology strategy consultingBrowser
AgentGPTReworkdReleased (2023)User-friendly interface for creating goal-oriented agentsBrowser
AI Agent StudioAutomation AnywhereReleased (2025)Handles structured and unstructured data; creates AI agents for enterprise automationBrowser
Apple Intelligence AgentsAppleUpcoming (2025)Deep OS integration; privacy-focusedPhone, Desktop
AskUI Vision AgentAskUIReleasedCross-platform functionality without virtual machinesDesktop, Browser, Phone
Beam AIBeamReleasedAgentic Process Automation platform for customer support, onboarding, sales proposal generationBrowser
Claude Agent KitAnthropicUpcoming (2024)Official toolkit for building Claude-powered agentsBrowser
Claude Computer UseAnthropicReleased (2024)Works on desktop apps and browsers; AI model-based approachBrowser, Desktop, Multi-device
DevinCognition LabsUpcoming (2025)Full-stack programming capabilities with browser accessDesktop, Browser
Fuyu-HeavyAdept AIReleased (2024)Ranked 3rd best vision-action model behind GPT-4V and Gemini UltraDesktop, Browser
Gemini 1.5 Pro (Tool Use)GoogleReleasedLong context, tool orchestration in WorkspaceBrowser
Google MarinerGoogle DeepMindUnreleasedHigh WebVoyager benchmark performanceBrowser
GumloopGumloopReleased (2023)Visual workflow canvas; 90+ pre-built templates; Chrome extension for web automationBrowser
Highlight AIEmbedded IntelligenceReleased (2024)Instant Q&A and automation on desktop; strong privacy focusDesktop, Browser
HyperbrowserHyperbrowser.ai (YC Backed)Released (2024)Sub-second browser launch, 10,000+ concurrent browsers, CAPTCHA solvingBrowser
LindyLindy.aiReleasedVirtual AI assistant for daily business tasksBrowser
ManusMonica AI (China)Released (2024)World's first general AI agent; SOTA on GAIA benchmarkDesktop, Browser, Phone
MultiOn (now Please AI)Please AIReleased (2023)Multi-step web tasks end-to-end; preference learningBrowser
OpenAI CUA (Operator)OpenAIReleased (2025)High benchmark performance; uses reasoning models techBrowser, Desktop
Perplexity CometPerplexity AIUpcoming (2025)Autonomous multi-step search with citationsBrowser
Project JarvisGoogleRumoredComputer-using agent system; few details availableDesktop, Browser
ProxyConvergence AIReleased (2025)Handles concurrent sub-tasks; cheaper alternative to OperatorBrowser
RelayRelay.appReleased (2021)Clean, simple interface; extensive app integrationsBrowser
Relevance AIRelevance AIReleasedDrag-and-drop skill building, templates, integrationsBrowser
ServiceNow AI AgentsServiceNowReleasedBuilt-in governance, analytics, text-to-action capabilitiesBrowser
VyVerceptReleased (2025)Advanced human-computer interaction; works with existing applicationsDesktop

Open Source Agents

NameDeveloperLicenseKey FeaturesEnvironment
Agent SSimular AIResearch LicenseWeb research, content summarization, data extractionBrowser, Desktop
Agent S2Simular AIResearch LicenseOSWorld: 34.5%; AndroidWorld: 50%; outperforms OpenAI CUA/OperatorBrowser, Desktop, Phone
AutoGenMicrosoftMITAgents can converse with each other to solve tasksBrowser
AutoGPTSignificant GravitasMITPioneer in autonomous GPT agents; self-prompting with memoryBrowser
BabyAGIYohei NakajimaMITAutonomous task creation and prioritizationBrowser
Browser UseY Combinator/ETH ZurichProprietaryMakes websites more digestible for AI agentsBrowser
c/ua (Computer-Use Agent)TryCuaOpen SourceHigh-performance virtualization; fully isolated virtual environmentsDesktop, Virtual Machine
CogAgentTsinghua Univ. & ZhipuResearch License (CC BY-NC)High-performance open model rivaling closed modelsDesktop, Browser
CrewAICrewAIProprietaryEnables orchestration of specialized agents in teamsBrowser
HyperAgentFSoft-AI4CodeApache 2.0Handles GitHub issue resolution, repository-level code generationBrowser, Desktop
LangGraphLangChainMITFramework for building stateful, multi-agent systemsBrowser
LLM AgentsNVIDIA/MetaResearch LicenseStandardized evaluation for LLM agentsBrowser
OctoGoogle DeepMindApache 2.0Zero-shot generalization to new objects and tasksPhysical World
OpenInterpreterOpen InterpreterProprietaryCode interpreter for local executionDesktop, Browser
OWLCamel-AIProprietaryDistributed task automationBrowser
RooCodeOpen-sourceProprietaryAutonomous coding in VS CodeBrowser, Desktop
Simular AISimularResearch LicenseSOTA on OSWorld and AndroidWorld benchmarksDesktop, Browser, Phone
SunaKortixProprietaryHighly versatile generalist agent; handles complex tasksBrowser
UI-TARSByteDance/TikTokResearch LicenseAutonomous GUI execution on PC/Mac/AndroidBrowser, Desktop, Phone
Vercel AI SDK Computer UseVercelOpen SourceStandardized API for different AI models; streaming capabilitiesBrowser, Web
WebVoyagerHongliang He et al.Research License59.1% success on 15-website benchmarkBrowser
Felluo AIFelluoProprietaryVision-based GUI automationBrowser, Desktop

Research Projects

NameInstitutionFocus AreaRelease Date
Deep Research AgentOpenAIWeb browsing, research2024
GatoGoogle DeepMindMulti-modal, multi-task, multi-embodiment2022
HuggingGPT (Jarvis)MicrosoftOrchestrates specialists for multi-modal tasks2023
I-AFMMicrosoft ResearchMulti-modal, multi-task system2024
MagmaMicrosoft ResearchVision-language-action model2025
mlejva's Computer AgentVasek MlejnskyGUI interaction2024
PaLM-EGoogle DeepMind & Robotics at GoogleEmbodied multimodal language model2023
RT-2Google DeepMindVision-language-action model2023
SayCanGoogleGrounded language model for robotics2022
SIMAGoogle DeepMind3D virtual environments2024
WebAgentGoogle DeepMindAutonomous web browsing and form-filling2024

By Environment

Browser-Based Agents

Browser-based agents specialize in navigating and interacting with web interfaces:

NameDeveloperStatusDevelopment Type
HyperbrowserHyperbrowser.ai (YC Backed)ReleasedCommercial
Perplexity CometPerplexity AIUpcomingCommercial
Browser UseY Combinator/ETH ZurichReleasedCommercial, Open-source
CloudCruiseCloudCruiseReleasedCommercial
Deep Research AgentOpenAIUnreleasedCommercial, Research
Felluo AIFelluoReleasedCommercial
Google MarinerGoogle DeepMindUnreleasedCommercial, Research
GumloopGumloopReleasedCommercial
MultiOn (now Please AI)Please AIReleasedCommercial
ProxyConvergence AIReleasedCommercial
SunaKortixReleasedOpen-source
WebVoyagerHongliang He et al.ReleasedResearch, Open-source

Desktop Agents

Desktop agents interact with operating system GUIs and desktop applications:

NameDeveloperStatusDevelopment Type
AceGeneral AgentsUpcomingCommercial, Research
Claude Computer UseAnthropicReleasedCommercial
Felluo AIFelluoReleasedCommercial
Fuyu-HeavyAdept AIReleasedCommercial, Research
Highlight AIEmbedded IntelligenceReleasedCommercial
OpenAI CUA (Operator)OpenAIReleasedCommercial
Project JarvisGoogleRumoredCommercial, Research
CogAgentTsinghua Univ. & ZhipuReleasedResearch, Open-source
VyVerceptReleasedCommercial
c/ua (Computer-Use Agent)TryCuaReleasedOpen Source

Physical World Agents

These agents operate in 3D environments, games, and physical systems:

NameDeveloperStatusDevelopment Type
GatoGoogle DeepMindReleasedResearch
I-AFMMicrosoft ResearchReleasedResearch
MagmaMicrosoft ResearchReleasedResearch, Open Source
OctoGoogle DeepMindReleasedOpen Source, Research
PaLM-EGoogle DeepMind & Robotics at GoogleReleasedResearch
RT-2Google DeepMindReleasedResearch
SayCanGoogleReleasedResearch
SIMAGoogle DeepMindReleasedResearch

Cloud Agents

Cloud-based agents running in remote environments:

NameDeveloperStatusDevelopment Type
CloudCruiseCloudCruiseReleasedCommercial

Multi-Device Agents

Agents that can operate across multiple device types:

NameDeveloperStatusSupported Devices
Agent S2Simular AIReleasedWindows, MacOS, Linux, Android, iOS
AskUI Vision AgentAskUIReleasedWindows, MacOS, Linux, Android, iOS
Claude Computer UseAnthropicReleasedWindows, MacOS, Linux, Multi-device
ManusMonica AI (China)ReleasedWindows, MacOS, Linux, Android, iOS
Simular AISimularReleasedWindows, MacOS, Linux, Android, iOS
UI-TARSByteDance/TikTokReleasedWindows, MacOS, Linux, Android, iOS

By Task Complexity

For a full breakdown of agents by task complexity, including Single Workflow, Multiple Workflow, and Complex Workflow Agents, please visit our website: supernalintelligence.com

Resources

Communities

Contribution

Contributions welcome! Please read the contribution guidelines first or email i@supernal.ai if you see an error or want to contribute.

License

This awesome list is maintained by Parni and Ian, and is released under the MIT Open Source License.