MCP.so
Sign In

Paint Drawing Agent

@shivman

Repository

About Paint Drawing Agent

This project demonstrates an Agentic AI system that uses a Gemini-powered MCP server to interpret natural language instructions and automate Microsoft Paint using GUI simulation tools on Windows.

#paint-ai-agent#automation#ai

Basic information

Category

AI & Agents

Runtime

python

Transports

stdio

Publisher

shivman

Config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "paint-ai-agent": {
      "command": "python",
      "args": [
        "talk2mcp.py"
      ]
    }
  }
}

Tools

No tools detected

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is Paint Drawing Agent?

A Python-based automation tool that uses Google's Gemini AI to control Microsoft Paint through natural language commands, enabling users to draw shapes, write text, and manipulate colors in MS Paint using simple English instructions.

How to use Paint Drawing Agent?

Clone the repository, install dependencies with pip install -r requirements.txt, create a .env file with your Google API key, then run python talk2mcp.py and enter natural language commands like "Draw a red circle in the center". Type 'quit' to exit.

Key features of Paint Drawing Agent

  • Natural language control of Microsoft Paint
  • Automated drawing of circles, rectangles, and lines
  • Text insertion with position control
  • Color selection and management
  • Window management and canvas positioning
  • Detailed logging and error handling
  • Position calibration system for accuracy

Use cases of Paint Drawing Agent

  • Automating repetitive drawing tasks in MS Paint
  • Creating diagrams or annotations without manual mouse interaction
  • Generating custom shapes and text for quick visual mockups

FAQ from Paint Drawing Agent

What prerequisites are required?

Windows 10 or later, Python 3.8+, Microsoft Paint (mspaint.exe), and a Google Cloud API key for Gemini AI.

How does calibration work?

The system uses a calibration system to accurately locate Paint interface elements. Run python enhanced_calibrate.py and follow on-screen instructions to recalibrate tool positions.

Where are logs stored?

Application logs are in /logs/paint_agent_[timestamp].log, LLM interaction logs in /LLM_LOGS/session_log.json, and calibration data in /calibration_profiles/.

What should I do if Paint is not found?

Ensure MS Paint is installed and try running Paint manually first. If drawing positions are off, run calibration again and check that screen resolution matches the calibration profile.

How can I handle AI communication errors?

Verify that your API key is correctly set in the .env file and check your internet connection.

Comments

More AI & Agents MCP servers

MCP Server - Remote MacOs Use

baryhuang

The only general AI agent that does NOT requires extra API key, giving you full control on your local and remote MacOs from Claude Desktop App

487

meGPT - upload an author's content into an LLM

adrianco

Code to process many kinds of content by an author into an MCP server

287

MCP Client for Ollama (ollmcp)

jonigl

Harness the power of local LLMs with this TUI MCP Client for Ollama. Featuring all core MCP primitives (tools, prompts, resources), agent mode, multi-server, model switching, streaming responses, human-in-the-loop, thinking mode, model params config, system prompts, and saved pre

768

Open Multi-Agent Canvas

CopilotKit

The open-source multi-agent chat interface that lets you manage multiple agents in one dynamic conversation and add MCP servers for deep research

507

Gemini MCP Server

aliargun

MCP server implementation for Google's Gemini API

259