Advertise
MCP.so
Sign In

Omniparser Autogui MCP Server

@NON906

Repository

Basic information

Category

Other

License

MIT

Transports

stdio

Author

NON906

About Omniparser Autogui MCP Server

Automatic operation of on-screen GUI.

Omniparser Autogui MCP Server config

No standard config provided

This server doesn't expose a parseable MCP config block in its README. See the repository for install instructions.

Repository

Omniparser Autogui MCP Server tools

Tool list not available yet

This listing does not currently have a tool list to display. This does not mean the server has no tools; check its documentation for supported capabilities.

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is omniparser-autogui-mcp?

omniparser-autogui-mcp is an MCP server that uses Microsoft's OmniParser to analyze the computer screen and automatically perform GUI operations. It is confirmed to work on Windows and is intended for users who want AI-driven desktop automation.

How to use omniparser-autogui-mcp?

Clone the repository recursively, run uv sync, set the OCR_LANG environment variable (e.g., en), and execute uv run download_models.py to download OmniParser models. Then configure the server in claude_desktop_config.json with the uv command pointing to the cloned directory. Additional environment variables allow customization of the backend load, target window, OmniParser server address, SSE transport, and model paths.

Key features of omniparser-autogui-mcp

  • Integrates OmniParser for screen analysis and GUI automation
  • Supports both stdio and SSE transport modes
  • Allows targeting a specific window or the entire screen
  • Can offload OmniParser processing to another device
  • Configurable via environment variables for OmniParser model settings

Use cases of omniparser-autogui-mcp

  • Automate repetitive desktop tasks based on screen content
  • Search for specific text in a browser window and click results
  • Operate legacy applications that lack APIs or scripting support
  • Build AI assistants that can control the user interface directly

Frequently asked questions

1

What is OmniParser?

OmniParser is a Microsoft research project that parses a screenshot into structured elements (e.g., icons, text boxes) for GUI automation. This server uses it under a CC-BY-4.0 license (models have separate licenses).

2

Does omniparser-autogui-mcp require a GPU?

The README does not specify GPU requirements. It is confirmed on Windows, and models are downloaded locally; performance may depend on the platform.

3

How does omniparser-autogui-mcp handle authentication or security?

No authentication mechanism is mentioned. The server operates on the local machine or over a network via SSE; no built-in security features are described.

4

Can I run OmniParser on a separate machine?

Yes. Set the `OMNI_PARSER_SERVER` environment variable to the server's address and port (e.g., `127.0.0.1:8000`). Start the remote server with `uv run omniparserserver`.

5

What are the transport options?

The default transport is stdio. To use SSE, set the `SSE_HOST` and `SSE_PORT` environment variables.

Comments

More Other MCP servers

Yuppsy

Yuppsy MCP: build and publish real estate websites from your AI assistant. Yuppsy lets your AI assistant create live websites for real estate agents and individual property listings. You don't need a designer or any code

Reactive Resume

amruthpillai

A one-of-a-kind resume builder that keeps your privacy in mind. Completely secure, customizable, portable, open-source and free forever. Try it out today!

39.5K

Health by Dr Brad

Dr Brad Stanfield

Health by Dr Brad works out a health plan from your own results: which screening is due at your age, and evidence-based suggestions, each with the reason and the published guideline or study behind it. Your record is one

Blender

ahujasid

Open-source MCP to use Blender with any LLM

23.6K

🚀 Model Context Protocol (MCP) Curriculum for Beginners

microsoft

This open-source curriculum introduces the fundamentals of Model Context Protocol (MCP) through real-world, cross-language examples in .NET, Java, TypeScript, JavaScript, Rust and Python. Designed for developers, it focuses on practical techniques for building modular, scalable,

16.7K
Advertise