How is this different from traditional YOLO models?
Traditional YOLO only detects a fixed list of objects, while this server uses zero-shot learning to detect anything described in natural language.
M
MCP YOLOE: Zero-Shot Object Detection & Segmentation
@rjn32s
Basic information
About MCP YOLOE: Zero-Shot Object Detection & Segmentation
Provide your AI agents with "eyes." This server enables open-vocabulary object detection and instance segmentation using naturally phrased text prompts (e.g., "detect the laptop next to the coffee").
MCP YOLOE: Zero-Shot Object Detection & Segmentation config
Add this server to your MCP-compatible client using the configuration below.
{
"mcpServers": {
"mcp-yolo": {
"command": "uvx",
"args": [
"mcp-yolo"
]
}
}
}MCP YOLOE: Zero-Shot Object Detection & Segmentation tools
Tool list not available yet
This listing does not currently have a tool list to display. This does not mean the server has no tools; check its documentation for supported capabilities.
Fetch the live tool list by running this server in a temporary sandbox using the button above.
Overview
What is MCP YOLOE: Zero-Shot Object Detection & Segmentation?
MCP YOLOE is a Model Context Protocol server that gives AI agents advanced computer vision using zero-shot learning. It detects and segments any object described in natural language, unlike fixed-list YOLO models.
How to use MCP YOLOE: Zero-Shot Object Detection & Segmentation?
You interact through an AI agent (e.g., Claude) by providing a natural language prompt such as “Find the ‘vintage typewriter’ in this image and give me its exact coordinates.” The server accepts local file paths, remote image URLs, and Base64-encoded images as input.
Key features of MCP YOLOE: Zero-Shot Object Detection & Segmentation
- Zero-shot detection with natural language prompts.
- Precision segmentation with exact polygon masks.
- Flexible inputs: local paths, URLs, Base64.
- Agent-first design for Claude, IDEs, and workspace agents.
- Uses YOLOE26‑L architecture (55.0 mAP, ~6.2ms on T4).
Use cases of MCP YOLOE: Zero-Shot Object Detection & Segmentation
- Find and locate arbitrary objects in images using descriptive text.
- Obtain exact polygon masks for detected objects for further processing.
- Integrate computer vision capabilities into AI agents for automated image analysis.
- Support diverse input sources (local files, URLs, embedded data) in agent workflows.
Frequently asked questions
What is the underlying model and its performance?
It uses the state-of-the-art YOLOE26‑L architecture, achieving high precision (55.0 mAP) and rapid inference (~6.2ms on T4 GPUs).
What input formats can I use?
The server works with local file paths, remote image URLs, and Base64-encoded strings.
Is it designed for agent integration?
Yes, it is specifically built for integration with Claude, IDEs, and autonomous workspace agents.
Does it require special runtime or dependencies?
The README does not specify runtime requirements beyond the model architecture (YOLOE26‑L).
More Other MCP servers
Figs, Relationship Expert
Figs O'Sullivan, LMFTCouples therapist Figs O'Sullivan (LMFT, 17 years, endorsed by Sue Johnson, creator of EFT) inside your AI. Ask relationship questions answered from his clinical writing, name the pattern in a fight, get a three-step rep
Soar Flight Booking MCP
Soar Flight Booking MCP is a remote MCP server available at https://mcp.soar.flights.
Activepieces
activepiecesAI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents
23.2K
Lemon.io
lemon-ioRequest dedicated senior developers to work on your project, write job descriptions, and prep technical interviews — all without leaving your Claude chat. Just describe what you need, and Lemon.io MCP does the rest. 1–3
Handl
Handl speaks the Model Context Protocol. Your whole billing operation — projects, invoices, clients, reports, approvals — as tools any AI assistant can call, inside your autonomy rules.
Comments