MSPaint MCP Server with AI-based Planning Algorithms

Name: MSPaint MCP Server with AI-based Planning Algorithms
Author: shettysaish20

@shettysaish20

About MSPaint MCP Server with AI-based Planning Algorithms

Using Advanced AI Prompting to enhance LLM planning to solve complex math problems and draw the answer on MSPaint Canvas

#mathgpt #math-solver #math-assistant

Basic information

Config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "MSPaint-MCP-Server-V2": {
      "command": "python",
      "args": [
        "mcp_paint_app/mcp_client.py"
      ]
    }
  }
}

Tools

No tools detected

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is MSPaint MCP Server with AI-based Planning Algorithms?

An MCP (Model Context Protocol) server that enables an AI agent powered by Google Gemini to automate legacy Windows MSPaint. The agent solves complex multi‑step math problems and draws the final answer on the Paint canvas using tools defined via fastmcp and pywinauto. It is intended for developers and researchers exploring structured prompting and tool‑augmented AI workflows.

How to use MSPaint MCP Server with AI-based Planning Algorithms?

Create a Conda environment with Python 3.11 and activate it.
Install dependencies with pip install -r requirements.txt.
Place your Gemini API key in a .env file as GEMINI_API_KEY=YOUR_KEY.
Run the client: python mcp_paint_app/mcp_client.py.
This starts the client, which connects to the MCP server, initializes the AI agent, and begins solving the provided math expression.

FAQ from MSPaint MCP Server with AI-based Planning Algorithms

What are the system dependencies and runtime requirements?

Python 3.11+ and Conda are recommended. Dependencies include pywin32, pywinauto, fastmcp, python-dotenv, google-genai, and rich. A Google Gemini API key is required.

What if the AI agent does not select the correct tools?

Review the system prompt in the client code; ensure tool descriptions are accurate and complete. Adjust the prompt if necessary.

How do I fix coordinate issues when drawing in MSPaint?

Coordinates used for clicking and drawing may need adjustment based on your screen resolution and window size. Use the debugging print statements in the code to identify and set the correct values.

What should I do if I encounter permission errors?

Try running

Comments

More Reasoning MCP servers

n8n Workflow Builder MCP

ifmelate

MCP server that allow LLM in agent mode builds n8n workflows for you

n8n Workflow Builder MCP Server

makafeli

AI assistant integration for n8n workflow automation through Model Context Protocol (MCP). Connect Claude Desktop, ChatGPT, and other AI assistants to n8n for natural language workflow management.

530

IntelliNode Medical Use Cases

Barqawiz

Multi-Agent AI Orchestration Workshop

MCP Sandbox

danstarns

Turn any JavaScript module into a sandboxed MCP (Model Context Protocol) server with automatic reflection and type inference.

AWorld: Advancing Agentic AI

inclusionAI

Search, understand, reproduce, and improve an idea with ease

1.2K