MSPaint MCP Server with AI-based Planning Algorithms

@shettysaish20

Basic information

About MSPaint MCP Server with AI-based Planning Algorithms

Using Advanced AI Prompting to enhance LLM planning to solve complex math problems and draw the answer on MSPaint Canvas

#mathgpt #math-solver #math-assistant

MSPaint MCP Server with AI-based Planning Algorithms config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "MSPaint-MCP-Server-V2": {
      "command": "python",
      "args": [
        "mcp_paint_app/mcp_client.py"
      ]
    }
  }
}

MSPaint MCP Server with AI-based Planning Algorithms tools

Tool list not available yet

This listing does not currently have a tool list to display. This does not mean the server has no tools; check its documentation for supported capabilities.

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is MSPaint MCP Server with AI-based Planning Algorithms?

An MCP (Model Context Protocol) server that enables an AI agent powered by Google Gemini to automate legacy Windows MSPaint. The agent solves complex multi‑step math problems and draws the final answer on the Paint canvas using tools defined via fastmcp and pywinauto. It is intended for developers and researchers exploring structured prompting and tool‑augmented AI workflows.

How to use MSPaint MCP Server with AI-based Planning Algorithms?

Create a Conda environment with Python 3.11 and activate it.
Install dependencies with pip install -r requirements.txt.
Place your Gemini API key in a .env file as GEMINI_API_KEY=YOUR_KEY.
Run the client: python mcp_paint_app/mcp_client.py.
This starts the client, which connects to the MCP server, initializes the AI agent, and begins solving the provided math expression.

Frequently asked questions

What are the system dependencies and runtime requirements?

Python 3.11+ and Conda are recommended. Dependencies include `pywin32`, `pywinauto`, `fastmcp`, `python-dotenv`, `google-genai`, and `rich`. A Google Gemini API key is required.

What if the AI agent does not select the correct tools?

Review the system prompt in the client code; ensure tool descriptions are accurate and complete. Adjust the prompt if necessary.

How do I fix coordinate issues when drawing in MSPaint?

Coordinates used for clicking and drawing may need adjustment based on your screen resolution and window size. Use the debugging print statements in the code to identify and set the correct values.

What should I do if I encounter permission errors?

Try running

Comments

More Reasoning MCP servers

Task Planner MCP Server

CaptainCrouton89

An MCP (Model Context Protocol) server that helps AI assistants (like Claude) break down complex tasks into manageable steps, track progress, and manage a hierarchical task list.