UI Explorer MCP Server

Name: UI Explorer MCP Server
Author: modularflow

@modularflow

Repository

About UI Explorer MCP Server

MCP Server for tools to explore the UI on your computer.

Basic information

Config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "mcp-ui-explorer": {
      "command": "python",
      "args": [
        "record_macro.py",
        "--name",
        "Login Workflow"
      ]
    }
  }
}

Tools

No tools detected

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is UI Explorer MCP Server?

UI Explorer MCP Server is an MCP server that provides tools for exploring and interacting with UI elements on your screen. It is designed for developers and testers who need to automate UI workflows on Windows.

How to use UI Explorer MCP Server?

Install the package via pip install mcp-ui-explorer or clone the repository. Then, configure your MCP client (e.g., Roo in Cursor or Claude Desktop) with the server command uvx mcp-ui-explorer. Use the provided MCP tools like explore_ui, screenshot_ui, and click_ui_element to scan and control UI elements.

Key features of UI Explorer MCP Server

Explore UI hierarchies across screen regions
Take screenshots with highlighted UI boundaries
Click at screen coordinates programmatically
Send keyboard input and shortcuts
Record and playback UI workflows as macros

Use cases of UI Explorer MCP Server

Automating repetitive UI tasks on Windows
Debugging and verifying UI layouts during development
Recording and replaying multi-step user workflows

FAQ from UI Explorer MCP Server

What operating system does UI Explorer MCP Server support?

Windows.

How do I install UI Explorer MCP Server?

Use pip install mcp-ui-explorer or clone the repository and install in development mode with pip install -e . or uv pip install -e ..

How do I record and playback macros?

Run python record_macro.py --name "My Workflow" to record and python play_macro.py --file "macros/My Workflow.json" to playback. Windows users can use the provided batch files.

What tools does UI Explorer MCP Server provide?

explore_ui, screenshot_ui, click_ui_element, and keyboard_input.

What are the runtime requirements for UI Explorer MCP Server?

Python 3.10+, MCP 1.6.0+, PyAutoGUI, PyWinAuto, Pillow, and Pydantic 2.0+.

Comments

More Other MCP servers

AutoBrowser MCP

autobrowser-ai

Browser MCP is a Model Context Provider (MCP) server that allows AI applications to control your browser

6.8K

Activepieces

activepieces

AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents

23.2K