WEBCLAW
Rust MCP server that gives AI agents reliable web access. Bypasses Cloudflare and bot protection using Chrome-level TLS fingerprinting, no headless browser needed. 10 tools for scraping, crawling, search, structured extraction, summarization, and more. Output is clean markdown optimized for LLMs with 67% fewer tokens than raw HTML. 8 of 10 tools work locally without an API key.
Overview
webclaw MCP Server
10 tools for web extraction:
- scrape — extract clean content from any URL
- crawl — recursive site crawling with depth control
- search — web search with result scraping
- extract — structured JSON extraction using LLM
- summarize — page summaries
- brand — extract colors, fonts, logos
- diff — track content changes between snapshots
- map — discover URLs from sitemaps
- batch — parallel multi URL extraction
- research — deep multi source analysis
Setup
npx create-webclaw
Auto detects Claude Desktop, Claude Code, Cursor, Windsurf, Codex, OpenCode and writes the correct config for each one.
Manual config
{
"mcpServers": {
"webclaw": {
"command": "webclaw-mcp",
"args": []
}
}
}
Install the binary
brew tap 0xMassi/webclaw && brew install webclaw
Or download from GitHub releases: https://github.com/0xMassi/webclaw/releases
MIT licensed. https://github.com/0xMassi/webclaw
Server Config
{
"mcpServers": {
"webclaw": {
"command": "webclaw-mcp",
"args": []
}
}
}Recommend Clients
TraeBuild with Free GPT-4.1 & Claude 3.7. Fully MCP-Ready.
ChatWiseThe second fastest AI chatbot™
chatmcpChatMCP is an AI chat client implementing the Model Context Protocol (MCP).
Refact.aiOpen-source AI Agent for VS Code and JetBrains that autonomously solves coding tasks end-to-end.
Y GuiA web-based graphical interface for AI chat interactions with support for multiple AI models and MCP (Model Context Protocol) servers.
Visual Studio Code - Open Source ("Code - OSS")Visual Studio Code
Roo Code (prev. Roo Cline)Roo Code (prev. Roo Cline) gives you a whole dev team of AI agents in your code editor.
WindsurfThe new purpose-built IDE to harness magic
CursorThe AI Code Editor
ZedCode at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.
A Sleek AI Assistant & MCP Client5ire is a cross-platform desktop AI assistant, MCP client. It compatible with major service providers, supports local knowledge base and tools via model context protocol servers .
Cherry Studio🍒 Cherry Studio is a desktop client that supports for multiple LLM providers.
MCP ConnectEnables cloud-based AI services to access local Stdio based MCP servers via HTTP requests
y-cli 🚀A Tiny Terminal Chat App for AI Models with MCP Client Support
LutraLutra is the first MCP compatible client built for everyone
SOCIAL-API.AI
HyperChatHyperChat is a Chat client that strives for openness, utilizing APIs from various LLMs to achieve the best Chat experience, as well as implementing productivity tools through the MCP protocol.
MCP PlaygroundCall MCP Server Tools Online
Cline – #1 on OpenRouterAutonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your permission every step of the way.
Continue⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other building blocks
DeepChatYour AI Partner on Desktop