Swift MCP GUI Server

@NakaokaRei

Repository

Basic information

About Swift MCP GUI Server

MCP server that can execute commands such as keyboard input and mouse movement on macOS

Swift MCP GUI Server config

No standard config provided

This server doesn't expose a parseable MCP config block in its README. See the repository for install instructions.

Repository

Swift MCP GUI Server tools

Tool list not available yet

This listing does not currently have a tool list to display. This does not mean the server has no tools; check its documentation for supported capabilities.

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is Swift MCP GUI Server?

A Model Context Protocol (MCP) server that allows controlling macOS through SwiftAutoGUI. It provides tools for programmatically controlling the mouse and keyboard through MCP clients.

How to use Swift MCP GUI Server?

Install via Homebrew (brew install NakaokaRei/tap/swift-mcp-gui) or from source using swift package experimental-install. Then add the binary path to your MCP client configuration (e.g., /opt/homebrew/bin/swift-mcp-gui on Apple Silicon, /usr/local/bin/swift-mcp-gui on Intel, or ~/.swiftpm/bin/swift-mcp-gui for source builds).

Key features of Swift MCP GUI Server

Move mouse cursor to specified coordinates
Perform left or right mouse clicks
Send keyboard shortcuts and key combinations
Scroll in four directions with configurable clicks
Capture full screen or a region as file path or inline image
Execute AppleScript code directly or from a file

Use cases of Swift MCP GUI Server

Automate repetitive macOS GUI tasks via MCP clients
Provide AI agents with screen capture and mouse/keyboard control
Test UI interactions by programmatically clicking and typing
Retrieve pixel colors or screen dimensions for automation scripts
Execute AppleScripts as part of a larger MCP workflow

Frequently asked questions

What are the system requirements for Swift MCP GUI Server?

macOS 15.0 or later, Swift 6.0 or later, and Xcode 16.0 or later.

How do I install Swift MCP GUI Server?

You can install it via Homebrew (`brew install NakaokaRei/tap/swift-mcp-gui`) or build from source using `swift package experimental-install`. Upgrade via `brew upgrade swift-mcp-gui`.

Do I need special permissions to use Swift MCP GUI Server?

Yes, the server requires full accessibility permissions in System Preferences to control your mouse and keyboard.

What tools does Swift MCP GUI Server provide?

It offers 11 tools: `moveMouse`, `mouseClick`, `sendKeys`, `scroll`, `getScreenSize`, `getPixelColor`, `captureScreen`, `captureRegion`, `saveScreenshot`, `executeAppleScript`, and `executeAppleScriptFile`. Each has documented input parameters.

How does screen capture output work?

You can choose between two output formats: `"path"` (saves to a temporary file and returns the file path with dimensions, reducing token consumption) or `"image"` (returns inline image content for AI vision, e.g., Claude). Quality and scale are adjustable.

Comments

More Productivity MCP servers

QoreNext Trade Screening MCP

QoreNext

Qorenext Trade screening MCP is a Model Context Protocol server that enables Claude and other AI clients to run sanctions screening and trade-screening due-diligence directly in chat.

JobYap

JobYap aggregates job postings directly from companies' official careers sites and gives every posting a public discussion thread, with salaries, locations and full descriptions.

RADAAR

The RADAAR MCP (Model Context Protocol) Server acts as a bridge between AI assistants (such as Claude, ChatGPT, or custom LLM agents) and the RADAAR social media management platform. By exposing RADAAR’s core tools and A

ZenSched

ZenShows LLC

Field workforce scheduling for AI agents. Connect over MCP for account create, verified GPS punches, worker invites, shifts, forms, webhooks, and timesheets — no human dashboard. MCP: https://mcp.zensched.com/mcp Site: h

One

Connect your agent to the apps your team already uses: Gmail, Slack, Stripe, Shopify, HubSpot, Notion, Linear, Salesforce, QuickBooks and more. One hosted MCP server with OAuth sign-in, nothing to install and no API keys