PyMCPAutoGUI 🖱️⌨️🖼️ - GUI Automation via MCP

Name: PyMCPAutoGUI 🖱️⌨️🖼️ - GUI Automation via MCP
Author: kitfactory

@kitfactory

Repository

About PyMCPAutoGUI 🖱️⌨️🖼️ - GUI Automation via MCP

GUI manipulation MCP server

#gui-automation #mcp #python

Basic information

Config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "PyMCPAutoGUI": {
      "command": "python",
      "args": [
        "-m",
        "venv",
        ".venv"
      ]
    }
  }
}

Tools

No tools detected

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is PyMCPAutoGUI 🖱️⌨️🖼️ - GUI Automation via MCP?

PyMCPAutoGUI bridges AI agents (e.g., in Cursor or other MCP-compatible environments) with the computer’s graphical user interface. It lets an agent see the screen, control the mouse and keyboard, and interact with windows — just like a human user.

How to use PyMCPAutoGUI 🖱️⌨️🖼️ - GUI Automation via MCP?

Install via pip install pymcpautogui in a Python 3.11+ virtual environment. Run python -m pymcpautogui.server to start the MCP server (defaults to port 6789). Connect from Cursor by adding the provided JSON configuration to mcp.json; then use @PyMCPAutoGUI in chats to invoke tools like move_to, write, screenshot, or activate_window.