Advertise
MCP.so
Sign In

ScreenPilot MCP Server

@Mtehabsim

Repository

Basic information

Category

Other

Transports

stdio

Author

Mtehabsim

About ScreenPilot MCP Server

Tool that allows the AI to control your device in the same way you do, enabling automation for everything!

#automation#mcp-server

ScreenPilot MCP Server config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "ScreenPilot": {
      "command": "python",
      "args": [
        "-m",
        "venv",
        "venv"
      ]
    }
  }
}

ScreenPilot MCP Server tools

1

Scroll in different directions and to specific positions

Overview

What is ScreenPilot?

ScreenPilot is an MCP server that lets an LLM take full control of your device by providing a screen automation toolkit for controlling and interacting with graphical user interfaces. It is built for automation, education, and having fun.

How to use ScreenPilot?

Install Python 3.12, clone the repository, create and activate a virtual environment, install the required packages from requirements.txt, then configure the server in Claude AI Desktop’s MCP settings by adding the full paths to python.exe and main.py in the config file. After saving and restarting Claude, ScreenPilot’s tools become available.

Key features of ScreenPilot

  • Screen capture and analysis
  • Mouse control (clicking, positioning)
  • Keyboard input (typing, key presses, hotkeys)
  • Scrolling in different directions and to specific positions
  • Element detection (check if elements exist, wait for them)
  • Action sequences (perform multiple actions in order)

Use cases of ScreenPilot

  • Automate repetitive desktop tasks via an LLM agent
  • Create educational demos that show step‑by‑step GUI interactions
  • Build fun experiments that let an AI control on‑screen elements
  • Assist with UI testing by capturing and analyzing screenshots

Frequently asked questions

1

What does ScreenPilot do?

ScreenPilot is an MCP server that gives an LLM the ability to capture screenshots, control the mouse, type text, press keys, scroll, detect elements, and run action sequences on your device.

2

What are the system requirements?

You need Python 3.12 installed, a virtual environment, and the packages listed in `requirements.txt`. The server is designed to work with Claude AI Desktop (the README provides configuration steps for it).

3

What tools does ScreenPilot provide?

Six tools: Screen Capture, Mouse Control, Keyboard Actions, Scrolling, Element Detection, and Action Sequences.

4

How do I install ScreenPilot?

Clone the repository, create a Python 3.12 virtual environment, activate it, run `pip install -r requirements.txt`, then configure the MCP server in Claude AI Desktop’s settings by editing the config file with the correct paths to `python.exe` and `main.py`.

Comments

More Other MCP servers

Klarix Intelligence Engine

Klarix

B2B competitive intelligence, live sales battlecards, 5-axis ICP prospect fit scoring, and tech stack teardowns over MCP and REST with cited public-web evidence.

N

Next Generation Movers: free moving quotes (remote MCP)

Next Generation Movers

Free moving quotes for AI agents from Next Generation Movers, a licensed interstate mover (USDOT 3764697). US long-distance nationwide and local DC/MD/VA. Indicative ballpark price and booking options; optional $0.01 x40

Lemon.io

lemon-io

Request dedicated senior developers to work on your project, write job descriptions, and prep technical interviews — all without leaving your Claude chat. Just describe what you need, and Lemon.io MCP does the rest. 1–3

MaxKB

1Panel-dev

🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。

22.0K

Senso MCP for Joomla

sensomedia

Senso MCP turns a Joomla 5 or 6 site into a remote MCP server. It runs inside Joomla itself (no extra server, no Node.js bridge) and is secured with OAuth 2.1 and Joomla's own ACL. The free pack lets an AI assistant crea

Advertise