Computer Use AI SDK

Name: Computer Use AI SDK
Author: m13v

@m13v

代码仓库

关于 Computer Use AI SDK

暂无概览

基本信息

分类

开发工具

运行时

rust

传输方式

stdio

发布者

m13v

配置

使用下面的配置,将此服务器添加到你的 MCP 客户端。

{
  "mcpServers": {
    "MCP-server-client-computer-use-ai-sdk": {
      "command": "npx",
      "args": [
        "tsx",
        "main.ts"
      ]
    }
  }
}

工具

未检测到工具

工具是从 README 中自动提取的。维护者可以在 ## Tools 标题下列出工具,即可填充这部分内容。

概览

What is Computer Use AI SDK?

It is an open‑source MCP server that controls a computer natively on macOS, using underlying desktop‑rendered elements instead of pixel‑based vision. It is designed as an alternative to proprietary computer‑use agents like OpenAI’s Operator and Claude’s Computer Use, giving developers full control without virtual machines or guardrails.

How to use Computer Use AI SDK?

Clone the repository, install Rust and Node.js, then run the backend server with cargo run --bin server in the mcp-server-os-level directory. Choose between a CLI interface (set the ANTHROPIC_API_KEY environment variable and run npx tsx main.ts in mcp-client-cli-interface) or a web‑app interface (set the key in a .env file and run npm run dev in mcp-client-nextjs).

Key features of Computer Use AI SDK

Launches apps, reads content, clicks, enters text, and presses keys.
Uses desktop‑rendered elements for speed and reliability.
Native on macOS with no virtual machine overhead.
No guardrails — full control over any app or website.
Provides both CLI and web‑based client interfaces.
Integrates with Anthropic’s API for AI agent capabilities.

Use cases of Computer Use AI SDK

Build custom AI agent workflows for automating everyday computer tasks.
Develop custom user interfaces for computer automation.
Schedule workflows to run periodically via cron.
Combine with other MCP servers for cross‑system automation.

FAQ from Computer Use AI SDK

What makes this different from pixel‑based computer use tools?

It reads desktop‑rendered elements instead of pixels, making it faster and more reliable than vision‑based models, and runs natively on macOS without virtual machines.