WEBCLAW
Rust MCP server that gives AI agents reliable web access. Bypasses Cloudflare and bot protection using Chrome-level TLS fingerprinting, no headless browser needed. 10 tools for scraping, crawling, search, structured extraction, summarization, and more. Output is clean markdown optimized for LLMs with 67% fewer tokens than raw HTML. 8 of 10 tools work locally without an API key.
Content
webclaw MCP Server
10 tools for web extraction:
- scrape — extract clean content from any URL
- crawl — recursive site crawling with depth control
- search — web search with result scraping
- extract — structured JSON extraction using LLM
- summarize — page summaries
- brand — extract colors, fonts, logos
- diff — track content changes between snapshots
- map — discover URLs from sitemaps
- batch — parallel multi URL extraction
- research — deep multi source analysis
Setup
npx create-webclaw
Auto detects Claude Desktop, Claude Code, Cursor, Windsurf, Codex, OpenCode and writes the correct config for each one.
Manual config
{
"mcpServers": {
"webclaw": {
"command": "webclaw-mcp",
"args": []
}
}
}
Install the binary
brew tap 0xMassi/webclaw && brew install webclaw
Or download from GitHub releases: https://github.com/0xMassi/webclaw/releases
MIT licensed. https://github.com/0xMassi/webclaw
Server Config
{
"mcpServers": {
"webclaw": {
"command": "webclaw-mcp",
"args": []
}
}
}Recommend Clients
TraeBuild with Free GPT-4.1 & Claude 3.7. Fully MCP-Ready.
WindsurfThe new purpose-built IDE to harness magic
MCP PlaygroundCall MCP Server Tools Online
LutraLutra is the first MCP compatible client built for everyone
chatmcpChatMCP is an AI chat client implementing the Model Context Protocol (MCP).
SOCIAL-API.AI
MCP ConnectEnables cloud-based AI services to access local Stdio based MCP servers via HTTP requests
Roo Code (prev. Roo Cline)Roo Code (prev. Roo Cline) gives you a whole dev team of AI agents in your code editor.
A Sleek AI Assistant & MCP Client5ire is a cross-platform desktop AI assistant, MCP client. It compatible with major service providers, supports local knowledge base and tools via model context protocol servers .
ChatWiseThe second fastest AI chatbot™
y-cli 🚀A Tiny Terminal Chat App for AI Models with MCP Client Support
DeepChatYour AI Partner on Desktop
HyperChatHyperChat is a Chat client that strives for openness, utilizing APIs from various LLMs to achieve the best Chat experience, as well as implementing productivity tools through the MCP protocol.
Cherry Studio🍒 Cherry Studio is a desktop client that supports for multiple LLM providers.
CursorThe AI Code Editor
Visual Studio Code - Open Source ("Code - OSS")Visual Studio Code
Continue⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other building blocks
Cline – #1 on OpenRouterAutonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your permission every step of the way.
Y GuiA web-based graphical interface for AI chat interactions with support for multiple AI models and MCP (Model Context Protocol) servers.
ZedCode at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.
Refact.aiOpen-source AI Agent for VS Code and JetBrains that autonomously solves coding tasks end-to-end.