WEBCLAW
Rust MCP server that gives AI agents reliable web access. Bypasses Cloudflare and bot protection using Chrome-level TLS fingerprinting, no headless browser needed. 10 tools for scraping, crawling, search, structured extraction, summarization, and more. Output is clean markdown optimized for LLMs with 67% fewer tokens than raw HTML. 8 of 10 tools work locally without an API key.
Overview
webclaw MCP Server
10 tools for web extraction:
- scrape — extract clean content from any URL
- crawl — recursive site crawling with depth control
- search — web search with result scraping
- extract — structured JSON extraction using LLM
- summarize — page summaries
- brand — extract colors, fonts, logos
- diff — track content changes between snapshots
- map — discover URLs from sitemaps
- batch — parallel multi URL extraction
- research — deep multi source analysis
Setup
npx create-webclaw
Auto detects Claude Desktop, Claude Code, Cursor, Windsurf, Codex, OpenCode and writes the correct config for each one.
Manual config
{
"mcpServers": {
"webclaw": {
"command": "webclaw-mcp",
"args": []
}
}
}
Install the binary
brew tap 0xMassi/webclaw && brew install webclaw
Or download from GitHub releases: https://github.com/0xMassi/webclaw/releases
MIT licensed. https://github.com/0xMassi/webclaw
Server Config
{
"mcpServers": {
"webclaw": {
"command": "webclaw-mcp",
"args": []
}
}
}Recommend Clients
TraeBuild with Free GPT-4.1 & Claude 3.7. Fully MCP-Ready.
A Sleek AI Assistant & MCP Client5ire is a cross-platform desktop AI assistant, MCP client. It compatible with major service providers, supports local knowledge base and tools via model context protocol servers .
WindsurfThe new purpose-built IDE to harness magic
CursorThe AI Code Editor
MCP ConnectEnables cloud-based AI services to access local Stdio based MCP servers via HTTP requests
Roo Code (prev. Roo Cline)Roo Code (prev. Roo Cline) gives you a whole dev team of AI agents in your code editor.
LutraLutra is the first MCP compatible client built for everyone
y-cli 🚀A Tiny Terminal Chat App for AI Models with MCP Client Support
SOCIAL-API.AI
Cline – #1 on OpenRouterAutonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your permission every step of the way.
ZedCode at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.
Cherry Studio🍒 Cherry Studio is a desktop client that supports for multiple LLM providers.
Continue⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other building blocks
HyperChatHyperChat is a Chat client that strives for openness, utilizing APIs from various LLMs to achieve the best Chat experience, as well as implementing productivity tools through the MCP protocol.
Y GuiA web-based graphical interface for AI chat interactions with support for multiple AI models and MCP (Model Context Protocol) servers.
ChatWiseThe second fastest AI chatbot™
DeepChatYour AI Partner on Desktop
chatmcpChatMCP is an AI chat client implementing the Model Context Protocol (MCP).
MCP PlaygroundCall MCP Server Tools Online
Refact.aiOpen-source AI Agent for VS Code and JetBrains that autonomously solves coding tasks end-to-end.
Visual Studio Code - Open Source ("Code - OSS")Visual Studio Code