⬢github Rust · 12.4K ★ +4.6K since we first saw it · pushed 14 min ago · Apache-2.0
vercel-labs/agent-desktop
Computer use CLI for AI agents
Agent Desktop is a Rust-based CLI and C library that lets AI agents control desktop applications on macOS, Windows, and Linux. Instead of guessing from screenshots, it reads each app's real UI structure via the OS accessibility tree, returning JSON snapshots where every clickable element has a stable ref. Agents act on refs, re-snapshot to verify, and the loop stays in their own code.
Why now: Not clear from the sources — no release announcement is cited, but its ~7.7k stars and Vercel Labs branding suggest attention around recent activity in the fast-moving computer-use agent space.
Who it is for: Developers building desktop computer-use AI agents who need reliable, deterministic UI interaction rather than pixel-based automation.
accessibilityaccessibility-apiai-agentsautomationclicomputer-usecomputer-use-agentcomputer-use-agentsdesktop-automationmacos
Stars over our 128 snapshots: 7.8K to 12.4K, since 1 d ago.
Where people talked about it
- ⬢github vercel-labs/agent-desktop just now
API: https://socialmediatrends-api.osmike.com/v1/repos/vercel-labs/agent-desktop