Desktop Automation
@tanob
About Desktop Automation
A Model Context Protocol server that provides desktop automation capabilities using RobotJS and screenshot capabilities
Basic information
Config
Add this server to your MCP-compatible client using the configuration below.
{
"mcpServers": {
"desktop-automation": {
"command": "npx",
"args": [
"-y",
"mcp-desktop-automation"
]
}
}
}Tools
6Gets the screen dimensions
Captures the current screen content
Presses a keyboard key or key combination
Types text at the current cursor position
Performs a mouse click
Moves the mouse to specified coordinates
Overview
What is Desktop Automation?
A Model Context Protocol (MCP) server that provides desktop automation capabilities using RobotJS and screenshot functions. It enables Large Language Models to control mouse movements, keyboard inputs, and capture screenshots of the desktop environment.
How to use Desktop Automation?
Configure Claude Desktop with the NPX command as shown in the README. The server requires system-level permissions for screen capture, mouse control, and keyboard simulation, which may need to be granted in your operating system's security settings.
Key features of Desktop Automation
- Desktop mouse control (move, click)
- Keyboard input simulation (keys, text typing)
- Screen size detection
- Screenshot capture and listing
- Simple JSON response format
Use cases of Desktop Automation
- Automate repetitive desktop tasks via an LLM
- Test GUI applications programmatically
- Assist users by performing actions on their desktop
- Capture screen content for analysis or documentation
FAQ from Desktop Automation
What runtime does Desktop Automation require?
Node.js version 14.x or higher is required.
Which MCP clients are supported?
The server has been primarily tested with Claude Desktop, though it may work with other MCP clients.
Is there a limit on screenshot size?
Yes, the current implementation has a 1MB response size limit. High-resolution screenshots may fail; 800x600 resolution has been tested to work reliably.
What permissions does Desktop Automation need?
It needs system-level permissions to capture screenshots, control mouse movement and clicks, and simulate keyboard input.
What tools does Desktop Automation provide?
It provides tools: get_screen_size, screen_capture, keyboard_press, keyboard_type, mouse_click, and mouse_move.
More Productivity MCP servers
MCPControl
CheffromspaceMCP server for Windows OS automation
Task Manager MCP Server
tradesdontlieA task management MCP server that provides comprehensive project and task tracking capabilities
Computer Control MCP
AB498MCP server that provides computer control capabilities, like mouse, keyboard, OCR, etc. using PyAutoGUI, RapidOCR, ONNXRuntime. Similar to 'computer-use' by Anthropic. With Zero External Dependencies.
Todoist MCP Server
abhiz123MCP server for Todoist integration enabling natural language task management with Claude
C++ Excel Automation MCP Server
smileFAaceA MCP server for automatically create, view and modify Excel related file using LLM
Comments