mcp-server-macos-use
@mediar-ai
AI agent that controls computer with OS-level tools, MCP compatible, works with any model
Overview
What is mcp-server-macos-use?
An MCP server in Swift that controls macOS applications via accessibility APIs through the MacosUseSDK. It is designed for users of MCP-compatible clients like Claude Desktop who need to automate or interact with desktop apps programmatically.
How to use mcp-server-macos-use?
Build the server with swift build -c debug, then run the executable. It communicates over standard input/output (stdio). Configure your MCP client (e.g., Claude Desktop) by pointing it to the server binary path in the client's configuration file.
Key features of mcp-server-macos-use
- Open or activate an application and traverse its accessibility tree
- Simulate mouse clicks at specified coordinates
- Simulate typing text into a target application
- Press keyboard keys with optional modifier flags
- Refresh traversal to get current UI state without action
- Control traversal behavior with optional parameters (diff, visibility, animation, delay)
Use cases of mcp-server-macos-use
- Automating repetitive UI tasks in any macOS application
- Querying the current UI state of a running desktop app
- Building AI-powered assistants that interact with native macOS software
- Accessibility tree inspection and testing
FAQ from mcp-server-macos-use
What does mcp-server-macos-use do?
It exposes MCP tools that let you open apps, click, type, and press keys, then traverse the accessibility tree—allowing programmatic control of macOS apps from an MCP client.
What dependencies does mcp-server-macos-use require?
It requires the MacosUseSDK Swift package and Swift toolchain to build. No other runtime dependencies are listed.
How does mcp-server-macos-use communicate?
It uses the stdio transport: the server reads and writes MCP messages over standard input and output.
How do I integrate mcp-server-macos-use with Claude Desktop?
Add an entry to Claude Desktop's configuration with the command set to the absolute path of the built server executable, under the mcpServers key.
Where can I get help or request features?
Reach out via email ([email protected]) or Discord (m13v_). The maintainer is open to tailoring the server for specific needs.