Desktop Automation

What is Desktop Automation?

A Model Context Protocol (MCP) server that provides desktop automation capabilities using RobotJS and screenshot functions. It enables Large Language Models to control mouse movements, keyboard inputs, and capture screenshots of the desktop environment.

How to use Desktop Automation?

Configure Claude Desktop with the NPX command as shown in the README. The server requires system-level permissions for screen capture, mouse control, and keyboard simulation, which may need to be granted in your operating system's security settings.

Key features of Desktop Automation

• Desktop mouse control (move, click)
• Keyboard input simulation (keys, text typing)
• Screen size detection
• Screenshot capture and listing
• Simple JSON response format

Use cases of Desktop Automation

• Automate repetitive desktop tasks via an LLM
• Test GUI applications programmatically
• Assist users by performing actions on their desktop
• Capture screen content for analysis or documentation

FAQ from Desktop Automation

What runtime does Desktop Automation require?

Node.js version 14.x or higher is required.

Which MCP clients are supported?

The server has been primarily tested with Claude Desktop, though it may work with other MCP clients.

Is there a limit on screenshot size?

Yes, the current implementation has a 1MB response size limit. High-resolution screenshots may fail; 800x600 resolution has been tested to work reliably.

What permissions does Desktop Automation need?

It needs system-level permissions to capture screenshots, control mouse movement and clicks, and simulate keyboard input.

What tools does Desktop Automation provide?

It provides tools: get_screen_size, screen_capture, keyboard_press, keyboard_type, mouse_click, and mouse_move.