MCP YOLOE: Zero-Shot Object Detection & Segmentation

Name: MCP YOLOE: Zero-Shot Object Detection & Segmentation
Author: rjn32s

@rjn32s

MCP YOLOE: Zero-Shot Object Detection & Segmentation について

Provide your AI agents with "eyes." This server enables open-vocabulary object detection and instance segmentation using naturally phrased text prompts (e.g., "detect the laptop next to the coffee").

#vision #ai #object #detection #segmentation #zero-shot #yolo

基本情報

カテゴリ

その他

トランスポート

stdio

公開者

rjn32s

投稿者

Rajan shukla

設定

以下の設定を使って、このサーバーを MCP 対応クライアントに追加してください。

{
  "mcpServers": {
    "mcp-yolo": {
      "command": "uvx",
      "args": [
        "mcp-yolo"
      ]
    }
  }
}

ツール

ツールは検出されませんでした

ツールは README から自動的に抽出されます。メンテナーは ## Tools という見出しの下に記載することで、このタブに反映できます。

概要

What is MCP YOLOE: Zero-Shot Object Detection & Segmentation?

MCP YOLOE is a Model Context Protocol server that gives AI agents advanced computer vision using zero-shot learning. It detects and segments any object described in natural language, unlike fixed-list YOLO models.

How to use MCP YOLOE: Zero-Shot Object Detection & Segmentation?

You interact through an AI agent (e.g., Claude) by providing a natural language prompt such as “Find the ‘vintage typewriter’ in this image and give me its exact coordinates.” The server accepts local file paths, remote image URLs, and Base64-encoded images as input.

Key features of MCP YOLOE: Zero-Shot Object Detection & Segmentation

Zero-shot detection with natural language prompts.
Precision segmentation with exact polygon masks.
Flexible inputs: local paths, URLs, Base64.
Agent-first design for Claude, IDEs, and workspace agents.
Uses YOLOE26‑L architecture (55.0 mAP, ~6.2ms on T4).

Use cases of MCP YOLOE: Zero-Shot Object Detection & Segmentation

Find and locate arbitrary objects in images using descriptive text.
Obtain exact polygon masks for detected objects for further processing.
Integrate computer vision capabilities into AI agents for automated image analysis.
Support diverse input sources (local files, URLs, embedded data) in agent workflows.

FAQ from MCP YOLOE: Zero-Shot Object Detection & Segmentation

How is this different from traditional YOLO models?

Traditional YOLO only detects a fixed list of objects, while this server uses zero-shot learning to detect anything described in natural language.

What is the underlying model and its performance?

It uses the state-of-the-art YOLOE26‑L architecture, achieving high precision (55.0 mAP) and rapid inference (~6.2ms on T4 GPUs).

What input formats can I use?

The server works with local file paths, remote image URLs, and Base64-encoded strings.

Is it designed for agent integration?

Yes, it is specifically built for integration with Claude, IDEs, and autonomous workspace agents.

Does it require special runtime or dependencies?

The README does not specify runtime requirements beyond the model architecture (YOLOE26‑L).

「その他」の他のコンテンツ

MCP Toolbox for Databases

googleapis

MCP Toolbox for Databases is an open source MCP server for databases.

15.9K

XcodeBuildMCP

cameroncooke

A Model Context Protocol (MCP) server and CLI that provides tools for agent use when working on iOS and macOS projects.

6.0K

Reactive Resume

amruthpillai

A one-of-a-kind resume builder that keeps your privacy in mind. Completely secure, customizable, portable, open-source and free forever. Try it out today!

39.5K