Ghost OS fixes this. It's an MCP server that gives any AI agent access to every app on your Mac, not just browsers. Native apps, Electron apps, menu bars, Finder, everything.
Most computer-use tools rely on screenshots and pixel guessing, or require Docker containers and sandboxed browsers. Ghost OS takes a different approach: it reads the macOS accessibility tree, which the OS provides for every app. Structured data about every button, text field, and link. Faster, lighter, and works with apps that never touch a browser.
When the AI figures out a workflow (send a Gmail, post on Slack, download a paper), it saves it as a JSON recipe. Plain text, auditable, version controllable. A frontier model learns it once, a small model replays it forever.
brew install ghostwright/ghost-os/ghost-os && ghost setup
Two commands. No Docker, no sandboxes, no container overhead. Works with Claude Code, but the MCP protocol means any agent can plug in. MIT licensed, written in Swift. Built on steipete's AXorcist for the accessibility layer.Happy to answer questions.