広告掲載
MCP.so
ログイン

Apache Beam MCP Server

@souravch

リポジトリ

基本情報

カテゴリ

その他

ライセンス

MIT

トランスポート

stdio

作者

souravch

Apache Beam MCP Server について

MCP server to manage apache beam workflows with different runners

Apache Beam MCP Server の設定

以下の設定を使って、このサーバーを MCP 対応クライアントに追加してください。

{
  "mcpServers": {
    "beam-mcp-server": {
      "command": "python",
      "args": [
        "-m",
        "venv",
        "beam-mcp-venv"
      ]
    }
  }
}

Apache Beam MCP Server のツール

ツール一覧はまだありません

この掲載には表示できるツール一覧がまだありません。サーバーにツールがないという意味ではありません。対応機能はプロジェクトのドキュメントをご確認ください。

ツールは README から自動的に抽出されます。メンテナーは ## Tools という見出しの下に記載することで、このタブに反映できます。

概要

What is Apache Beam MCP Server?

The Apache Beam MCP Server is a Model Context Protocol server for managing Apache Beam data pipelines across multiple runners including Flink, Spark, Dataflow, and Direct. It provides a standardized API for data engineers, AI/LLM developers, and DevOps teams to create, monitor, and control pipelines.

How to use Apache Beam MCP Server?

Clone the repository, create a Python virtual environment (3.9+), install dependencies from requirements.txt, then start the server with python main.py --debug --port 8888. For runner-specific configurations, set CONFIG_PATH environment variable. Pipelines are submitted via HTTP POST to /api/v1/jobs with job parameters in JSON. Use the Python client library or curl for interaction.

Key features of Apache Beam MCP Server

  • Multi-runner support: Flink, Spark, Dataflow, and Direct
  • MCP compliant for AI/LLM integration
  • Pipeline management: create, monitor, and control jobs
  • Easy to extend with new runners or custom features
  • Production-ready with Docker, Kubernetes, and monitoring

Use cases of Apache Beam MCP Server

  • Manage Apache Beam pipelines with a consistent API across different runners
  • Enable AI-controlled data pipelines through the MCP standard
  • Simplify pipeline operations and monitoring for DevOps teams
  • Deploy and scale pipelines in Docker or Kubernetes environments

よくある質問

1

Which Apache Beam runners are supported?

The server supports Flink, Spark, Dataflow, and Direct runners.

2

How can I deploy the server in a containerized environment?

Pre-built Docker images are available on GitHub Container Registry. Kubernetes deployment is supported via `kubectl apply` or Helm chart, with detailed instructions in the deployment guide.

3

What monitoring and observability features are included?

Prometheus metrics are exposed at `/metrics`, pre-configured Grafana dashboards are available, structured JSON logging is used, and a health check endpoint is provided at `/health`.

4

What are the runtime dependencies?

The server requires Python 3.9+ and Apache Beam 2.50.0. It can run with the Direct runner (no external dependencies) or with Flink, Spark, or Dataflow runners if those are installed.

5

What API endpoints are available for pipeline management?

The server implements MCP standard endpoints (`/tools`, `/resources`, `/contexts`) plus pipeline-specific endpoints at `/api/v1/jobs` for submitting, monitoring, and managing jobs.

コメント

「その他」の他のコンテンツ

Activepieces

activepieces

AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents

23.2K

Figs, Relationship Expert

Figs O'Sullivan, LMFT

Couples therapist Figs O'Sullivan (LMFT, 17 years, endorsed by Sue Johnson, creator of EFT) inside your AI. Ask relationship questions answered from his clinical writing, name the pattern in a fight, get a three-step rep

ICSS

chokcoco

不止于 CSS

20.7K

Senso MCP for Joomla

sensomedia

Senso MCP turns a Joomla 5 or 6 site into a remote MCP server. It runs inside Joomla itself (no extra server, no Node.js bridge) and is secured with OAuth 2.1 and Joomla's own ACL. The free pack lets an AI assistant crea

Codelf

unbug

A search tool helps dev to solve the naming things problem.

14.2K
広告掲載