Desktop Automation
@tanob
About Desktop Automation
A Model Context Protocol server that provides desktop automation capabilities using RobotJS and screenshot capabilities
Basic information
Config
Add this server to your MCP-compatible client using the configuration below.
{
"mcpServers": {
"desktop-automation": {
"command": "npx",
"args": [
"-y",
"mcp-desktop-automation"
]
}
}
}Tools
6Gets the screen dimensions
Captures the current screen content
Presses a keyboard key or key combination
Types text at the current cursor position
Performs a mouse click
Moves the mouse to specified coordinates
Overview
What is Desktop Automation?
A Model Context Protocol (MCP) server that provides desktop automation capabilities using RobotJS and screenshot functions. It enables Large Language Models to control mouse movements, keyboard inputs, and capture screenshots of the desktop environment.
How to use Desktop Automation?
Configure Claude Desktop with the NPX command as shown in the README. The server requires system-level permissions for screen capture, mouse control, and keyboard simulation, which may need to be granted in your operating system's security settings.
Key features of Desktop Automation
- Desktop mouse control (move, click)
- Keyboard input simulation (keys, text typing)
- Screen size detection
- Screenshot capture and listing
- Simple JSON response format
Use cases of Desktop Automation
- Automate repetitive desktop tasks via an LLM
- Test GUI applications programmatically
- Assist users by performing actions on their desktop
- Capture screen content for analysis or documentation
FAQ from Desktop Automation
What runtime does Desktop Automation require?
Node.js version 14.x or higher is required.
Which MCP clients are supported?
The server has been primarily tested with Claude Desktop, though it may work with other MCP clients.
Is there a limit on screenshot size?
Yes, the current implementation has a 1MB response size limit. High-resolution screenshots may fail; 800x600 resolution has been tested to work reliably.
What permissions does Desktop Automation need?
It needs system-level permissions to capture screenshots, control mouse movement and clicks, and simulate keyboard input.
What tools does Desktop Automation provide?
It provides tools: get_screen_size, screen_capture, keyboard_press, keyboard_type, mouse_click, and mouse_move.
More Productivity MCP servers
applescript-mcp MCP Server
joshrutkowskiA macOS AppleScript MCP server
Lamda
firerpaAndroid Full-Stack Device Control Platform: WebRTC/H.264 remote desktop, UI/OCR/image-matching automation, one-click MITM, built-in Frida, proxy/VPN/frp/P2P networking, MCP/Agent, 160+ APIs, designed for multi-device clusters and engineered deployments.
Outlook Calendar MCP Tool
merajmehrabiA Model Context Protocol (MCP) server that allows Claude to access and manage your local Microsfot Outlook calendar (Windows only).
ntfy-mcp: Your Friendly Task Completion Notifier
teddyzxcv
Npx Y convex@latest mcp start
get-convexThe open-source reactive database for app developers
Comments