Desktop Automation
@tanob
Desktop Automation について
A Model Context Protocol server that provides desktop automation capabilities using RobotJS and screenshot capabilities
基本情報
設定
以下の設定を使って、このサーバーを MCP 対応クライアントに追加してください。
{
"mcpServers": {
"desktop-automation": {
"command": "npx",
"args": [
"-y",
"mcp-desktop-automation"
]
}
}
}ツール
6Gets the screen dimensions
Captures the current screen content
Presses a keyboard key or key combination
Types text at the current cursor position
Performs a mouse click
Moves the mouse to specified coordinates
概要
What is Desktop Automation?
A Model Context Protocol (MCP) server that provides desktop automation capabilities using RobotJS and screenshot functions. It enables Large Language Models to control mouse movements, keyboard inputs, and capture screenshots of the desktop environment.
How to use Desktop Automation?
Configure Claude Desktop with the NPX command as shown in the README. The server requires system-level permissions for screen capture, mouse control, and keyboard simulation, which may need to be granted in your operating system's security settings.
Key features of Desktop Automation
- Desktop mouse control (move, click)
- Keyboard input simulation (keys, text typing)
- Screen size detection
- Screenshot capture and listing
- Simple JSON response format
Use cases of Desktop Automation
- Automate repetitive desktop tasks via an LLM
- Test GUI applications programmatically
- Assist users by performing actions on their desktop
- Capture screen content for analysis or documentation
FAQ from Desktop Automation
What runtime does Desktop Automation require?
Node.js version 14.x or higher is required.
Which MCP clients are supported?
The server has been primarily tested with Claude Desktop, though it may work with other MCP clients.
Is there a limit on screenshot size?
Yes, the current implementation has a 1MB response size limit. High-resolution screenshots may fail; 800x600 resolution has been tested to work reliably.
What permissions does Desktop Automation need?
It needs system-level permissions to capture screenshots, control mouse movement and clicks, and simulate keyboard input.
What tools does Desktop Automation provide?
It provides tools: get_screen_size, screen_capture, keyboard_press, keyboard_type, mouse_click, and mouse_move.
「生産性」の他のコンテンツ
Swift MCP GUI Server
NakaokaReiMCP server that can execute commands such as keyboard input and mouse movement on macOS
TickTick MCP Server
alexarevalo9A Model Context Protocol (MCP) server designed to integrate with the TickTick task management platform, enabling intelligent context-aware task operations and automation.
Desktop Commander
wonderwhy-erThis is MCP server for Claude that gives it terminal control, file system search and diff file editing capabilities
MCP Google Calendar Server
markelaugust74A Model Context Protocol (MCP) server implementation for Google Calendar integration. Create and manage calendar events directly through Claude or other AI assistants.
ATLAS: Task Management System
cyanheadsA Model Context Protocol (MCP) server for ATLAS, a Neo4j-powered task management system for LLM Agents - implementing a three-tier architecture (Projects, Tasks, Knowledge) to manage complex workflows. Now with Deep Research.
コメント