a year ago
research-and-dataScrape any developer documentation and save it locally as a markdown file using anthropic's MCP to standardize communication between the cli and the documentation server
Overview
what is WhatsUpDoc?
WhatsUpDoc is a command-line tool designed to scrape developer documentation from any website and save it locally as a markdown file using the Model Context Protocol (MCP) for standardized communication.
how to use WhatsUpDoc?
To use WhatsUpDoc, install it globally using npm, and then run the command downmarked fetch <url> to fetch and save documentation as a markdown file.
key features of WhatsUpDoc?
- Fetch documentation from any website and convert it to Markdown
- Save documentation to any location on your system
- Target specific content using CSS selectors
- Recursively fetch linked documentation pages
- Split documentation by headers into separate files
- Uses the Model Context Protocol (MCP) for standardized communication
use cases of WhatsUpDoc?
- Fetching and saving React documentation for offline access.
- Scraping Python documentation for personal reference.
- Collecting and organizing documentation from various sources for development purposes.
FAQ from WhatsUpDoc?
- Is WhatsUpDoc free to use?
Yes! WhatsUpDoc is free to use and open-source.
- What programming languages does WhatsUpDoc support?
WhatsUpDoc can scrape documentation from any website, regardless of the programming language.
- How does WhatsUpDoc handle different documentation structures?
It uses CSS selectors to target specific content, allowing for flexibility in handling various documentation layouts.