mcp-server-Bloom
@Robinson777-prog
A Model Context Protocol (MCP) server implementation that integrates with web scraping capabilities.
Overview
What is mcp-server-Bloom?
A Model Context Protocol (MCP) server that integrates with web scraping capabilities, offering automated URL discovery, web search, and content extraction from websites.
How to use mcp-server-Bloom?
Clone the repository, follow the installation instructions in INSTALL.md, configure crawling and extraction options in config.json, then run the main script to start URL discovery and extraction.
Key features of mcp-server-Bloom
- Automatic URL discovery from an initial seed using advanced crawling
- Web search with content extraction for text, images, and metadata
- Automatic retries with exponential backoff for failed requests
- Batch processing with built-in rate limiting for compliance
- Real-time credit usage monitoring for cloud APIs
Use cases of mcp-server-Bloom
- Extracting relevant content from websites for data analysis
- Automating web research by crawling seed URLs
- Monitoring web pages for changes or new content
FAQ from mcp-server-Bloom
What features does mcp-server-Bloom provide?
It provides URL discovery, web search with content extraction, automatic retries with exponential backoff, batch processing with rate limiting, and credit usage monitoring.
How is mcp-server-Bloom configured?
Configuration is done via a config.json file where crawling and extraction options are set.
What should I do to get started?
Clone the repository, follow the installation instructions in INSTALL.md, configure config.json, and run the main script.