@mysleekdesigns
基本信息
28-tool MCP server for web scraping, crawling, deep research & autonomous extraction — clean Markdown & structured JSON for Claude, Cursor & any MCP client. 1,000 free one-time credits, local-Ollama LLM support.
使用下面的配置,将此服务器添加到你的 MCP 客户端。
{
"mcpServers": {
"crawlforge": {
"command": "npx",
"args": [
"-y",
"crawlforge-mcp-server"
],
"env": {
"CRAWLFORGE_API_KEY": "cf_live_your_api_key_here"
}
}
}
}工具列表暂未提供
当前收录暂时没有可展示的工具列表，不代表服务没有工具。请查阅项目文档了解支持的能力。
点击上方按钮,在临时沙箱中运行此服务器并实时获取工具列表。
CrawlForge MCP Server is a Model Context Protocol server that gives AI assistants 28 web tools — scraping, crawling, web search, real Google SERP rank tracking, multi-source deep research, an autonomous agent, document processing and stealth browsing — through a single stdio or Streamable HTTP connection.
It is built for developers and agent builders who want live web data in a shape a model can actually use: clean Markdown, schema-validated JSON, links, metadata and screenshots from one fetch, rather than raw HTML a model has to guess its way through. Every tool is MCP-native and metered by credits, so cost is predictable per call. The server is MIT-licensed, runs on Node.js 18+, and works in Claude Desktop, Claude Code, Cursor, n8n and any other MCP client.
Unlike most hosted scraping APIs, LLM-powered extraction defaults to a local Ollama model — no LLM provider key, no per-token cost, and page content never leaves your machine. OpenAI and Anthropic are opt-in.
Get a free API key at crawlforge.dev/signup — 1,000 credits, no credit card. Then run the one-step installer, which stores your key and registers the server with every MCP client it detects:
npx crawlforge init
Or configure a client by hand with the Config block above (CRAWLFORGE_API_KEY is the only required environment variable). For n8n or any HTTP-transport client, run the server in Streamable HTTP mode:
export CRAWLFORGE_API_KEY=cf_live_your_api_key_here
npx -p crawlforge-mcp-server crawlforge-mcp --http # Streamable HTTP endpoint on :10000/mcp
Then just ask in natural language — "research the top 5 competitors in this space and cite sources", "crawl these docs and summarize them", "pull the price and rating from this Amazon listing", "tell me when this pricing page changes" — and the client picks the right tool.
Optional environment variables: OLLAMA_BASE_URL / OLLAMA_DEFAULT_MODEL to steer local LLM extraction, OPENAI_API_KEY or ANTHROPIC_API_KEY for cloud extraction, DATAFORSEO_LOGIN / DATAFORSEO_PASSWORD to enable serp_rank, and CRAWLFORGE_TOOLS / CRAWLFORGE_TOOL_GROUPS to expose only a subset of tools to a given client.
scrape tool takes a formats array (markdown, html, rawHtml, text, links, metadata, screenshot, JSON-schema) and serves every requested format from a single request, with per-format partial-success warnings.extract_with_llm and extract_structured run against local Ollama out of the box: $0 per token, and your page content stays on your machine. Cloud providers are opt-in per call.agent — describe the outcome in plain English with no URLs; it plans, searches, navigates and shapes an answer under orchestrator-enforced hard stops (max steps, max URLs, wall-clock), never limits the LLM can talk itself out of.deep_research with stealth recovery — multi-stage research that automatically retries sources returning 403 through a real fingerprinted browser (Camoufox) and re-extracts from the rendered HTML.serp_rank returns the actual SERP position for a keyword and domain, the number a search API cannot give you. It costs 0 credits until you configure DataForSEO.scrape_template returns structured data from Amazon, Shopify, LinkedIn, GitHub, YouTube, X/Twitter, Reddit, Hacker News, Product Hunt, Stack Overflow and npm without writing a single selector.track_changes baselines a page and reports a change percentage plus a diff on every later check, with CSS-selector scoping and webhooks.structuredContent on the tools that return records, self-correctable input errors the model can retry from, deterministic tools/list ordering for prompt-cache friendliness, elicitation before expensive runs, and experimental async tasks on the four long-running tools.CrawlForge/<version>, respect robots.txt, and are cryptographically signed with Web Bot Auth (RFC 9421) so sites can verify who is crawling them.deep_research or agent gathers, dedupes and synthesizes across many sources with citations, from a single natural-language prompt.map_site discovers the URL inventory, crawl_deep walks it, and generate_llms_txt produces an llms.txt for the site.scrape_template for known marketplaces, extract_structured with your own JSON schema for everything else.track_changes watches pricing pages, terms, or regulatory notices and fires a webhook when a page meaningfully changes.batch_scrape processes many URLs in one job (async with a webhook for large batches), paginated back through get_batch_results.stealth_mode and scrape_with_actions handle Cloudflare/DataDome challenges, logins, and click-and-wait flows; localization emulates a country and language for geo-specific pricing.search_web for ranked results, serp_rank for true organic position, analyze_content and summarize_content for sentiment, entities, keywords and summaries.process_document parses PDFs, Word files and other formats into text a model can reason over.Yes to both. Every tool is metered, so a CrawlForge API key is required — there is no anonymous mode. New accounts get **1,000 free credits, no credit card**, and that grant never expires. Get one at [crawlforge.dev/signup](https://www.crawlforge.dev/signup).
Costs range from 1 to 10 credits per call: | Credits | Tools | |---|---| | 1 | `fetch_url`, `extract_text`, `extract_links`, `extract_metadata`, `scrape_template`, `list_ollama_models`, `get_batch_results` | | 2 | `scrape`, `scrape_structured`, `extract_content`, `map_site`, `process_document`, `localization` | | 3 | `track_changes`, `analyze_content`, `extract_structured`, `extract_with_llm` | | 4 | `summarize_content`, `crawl_deep` | | 5 | `search_web`, `reddit_search`, `serp_rank`, `batch_scrape`, `scrape_with_actions`, `stealth_mode`, `generate_llms_txt` | | 8 | `agent` | | 10 | `deep_research` | Two exceptions work in your favour: `serp_rank` charges **0** until DataForSEO is configured, and `stealth_mode` bookkeeping operations (`configure`, `enable`, `disable`, `get_stats`, `cleanup`) cost 1 credit instead of 5. Paid plans are Hobby $19/mo (5,000 credits), Professional $99/mo (50,000), Business $399/mo (250,000) — all with access to every tool, and credits roll over month to month.
No. `extract_with_llm`, `extract_structured` and `deep_research` default to a **local Ollama** model, so there is no LLM API key, no per-token charge, and no page content leaving your machine. Run `list_ollama_models` to see what you have installed. Pass `provider: "openai"` or `provider: "anthropic"` with the matching key only if you want a cloud model — that usage is billed by your provider, not by CrawlForge.
Any MCP client. `npx crawlforge init` auto-detects and configures Claude Desktop, Claude Code and Cursor in one command; other clients take the standard `npx -y crawlforge-mcp-server` stdio stanza shown in the Config block. For n8n or anything speaking HTTP, start the server with `--http` and point the MCP Client Tool node at `http://<host>:10000/mcp` with a Bearer credential set to your API key.
Escalate. `stealth_mode` runs an anti-detection browser (Chromium stealth by default, Camoufox for advanced fingerprinting) and clears challenges that a plain fetch cannot, while `scrape_with_actions` drives real interactions — click, type, scroll, wait, screenshot — before extracting. `deep_research` does this automatically: sources that return 403 are silently retried through Camoufox and re-extracted from the rendered HTML. Hard IP-reputation blocks still require residential proxies, which CrawlForge does not provide.
Every URL is validated before the request leaves the process — http/https only, with loopback, RFC1918, IPv6 private and link-local ranges, cloud metadata endpoints and dangerous ports (SSH, SMTP, MySQL, Postgres, Redis, MongoDB and others) all blocked, and each redirect hop re-validated up to a cap of 5. Browser automation accepts only 7 vetted action types and `executeJavaScript` throws unless explicitly enabled at deploy time. Scraped data is never retained — only usage logs. ---
Cartesia MCP is a remote MCP server for Cartesia (https://cartesia.ai) available at https://mcp.cartesia.ai.
NetFoundry MCP Gateway enables secure, isolated access to Model Context Protocol (MCP) tools across distributed systems without exposing public endpoints. Zero trust gateway for MCP servers. Aggregate, filter, and secure
Extract, search and tag any document — invoices, receipts, contracts, forms, or your own templates. 13 tools, one sign-in (OAuth 2.1) or API key, free FileTag tier, data residency in the EU, US, Israel or Asia.
TruVerifAI's Panel Review is the guardian agent for AI's highest-stakes coding decisions: four frontier models argue over an AI coding agent's riskiest designs, diffs, and commits before they execute, with local review g
Open-source Node.js FHIR MCP server with SMART Backend Services, metadata-aware search/CRUD tools, compact responses, FHIRPath filtering, safe pagination, audit events, and terminology lookup.
评论