Advertise
MCP.so
Sign In

ScreenPilot MCP Server

@Mtehabsim

Repository

Basic information

Category

Other

Last updated

Transports

stdio

Author

Mtehabsim

About ScreenPilot MCP Server

Tool that allows the AI to control your device in the same way you do, enabling automation for everything!

#automation#mcp-server

ScreenPilot MCP Server config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "ScreenPilot": {
      "command": "python",
      "args": [
        "-m",
        "venv",
        "venv"
      ]
    }
  }
}

ScreenPilot MCP Server tools

1

Scroll in different directions and to specific positions

Overview

What is ScreenPilot?

ScreenPilot is an MCP server that lets an LLM take full control of your device by providing a screen automation toolkit for controlling and interacting with graphical user interfaces. It is built for automation, education, and having fun.

How to use ScreenPilot?

Install Python 3.12, clone the repository, create and activate a virtual environment, install the required packages from requirements.txt, then configure the server in Claude AI Desktop’s MCP settings by adding the full paths to python.exe and main.py in the config file. After saving and restarting Claude, ScreenPilot’s tools become available.

Key features of ScreenPilot

  • Screen capture and analysis
  • Mouse control (clicking, positioning)
  • Keyboard input (typing, key presses, hotkeys)
  • Scrolling in different directions and to specific positions
  • Element detection (check if elements exist, wait for them)
  • Action sequences (perform multiple actions in order)

Use cases of ScreenPilot

  • Automate repetitive desktop tasks via an LLM agent
  • Create educational demos that show step‑by‑step GUI interactions
  • Build fun experiments that let an AI control on‑screen elements
  • Assist with UI testing by capturing and analyzing screenshots

Frequently asked questions

1

What does ScreenPilot do?

ScreenPilot is an MCP server that gives an LLM the ability to capture screenshots, control the mouse, type text, press keys, scroll, detect elements, and run action sequences on your device.

2

What are the system requirements?

You need Python 3.12 installed, a virtual environment, and the packages listed in `requirements.txt`. The server is designed to work with Claude AI Desktop (the README provides configuration steps for it).

3

What tools does ScreenPilot provide?

Six tools: Screen Capture, Mouse Control, Keyboard Actions, Scrolling, Element Detection, and Action Sequences.

4

How do I install ScreenPilot?

Clone the repository, create a Python 3.12 virtual environment, activate it, run `pip install -r requirements.txt`, then configure the MCP server in Claude AI Desktop’s settings by editing the config file with the correct paths to `python.exe` and `main.py`.

Comments

More Other MCP servers

Screenpipe

screenpipe

YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context

22.0K

Health by Dr Brad

Dr Brad Stanfield

Health by Dr Brad works out a health plan from your own results: which screening is due at your age, and evidence-based suggestions, each with the reason and the published guideline or study behind it. Your record is one

Blender

ahujasid

Open-source MCP to use Blender with any LLM

23.6K

der die das – German noun genders (Lingviko)

Lingviko

The article (der, die, das) of 90,000 German nouns, compounds included, plus a checker that finds wrong articles in German text (“mit der Zug” → dem). Uses dictionary data, not AI guessing. Free, no login.

EverArt

modelcontextprotocol

Model Context Protocol Servers

88.1K
Advertise