WEBCLAW
Rust MCP server that gives AI agents reliable web access. Bypasses Cloudflare and bot protection using Chrome-level TLS fingerprinting, no headless browser needed. 10 tools for scraping, crawling, search, structured extraction, summarization, and more. Output is clean markdown optimized for LLMs with 67% fewer tokens than raw HTML. 8 of 10 tools work locally without an API key.
内容
webclaw MCP Server
10 tools for web extraction:
- scrape — extract clean content from any URL
- crawl — recursive site crawling with depth control
- search — web search with result scraping
- extract — structured JSON extraction using LLM
- summarize — page summaries
- brand — extract colors, fonts, logos
- diff — track content changes between snapshots
- map — discover URLs from sitemaps
- batch — parallel multi URL extraction
- research — deep multi source analysis
Setup
npx create-webclaw
Auto detects Claude Desktop, Claude Code, Cursor, Windsurf, Codex, OpenCode and writes the correct config for each one.
Manual config
{
"mcpServers": {
"webclaw": {
"command": "webclaw-mcp",
"args": []
}
}
}
Install the binary
brew tap 0xMassi/webclaw && brew install webclaw
Or download from GitHub releases: https://github.com/0xMassi/webclaw/releases
MIT licensed. https://github.com/0xMassi/webclaw
服务器配置
{
"mcpServers": {
"webclaw": {
"command": "webclaw-mcp",
"args": []
}
}
}推荐的 MCP Client
TraeBuild with Free GPT-4.1 & Claude 3.7. Fully MCP-Ready.
CursorThe AI Code Editor
Cherry Studio🍒 Cherry Studio is a desktop client that supports for multiple LLM providers.
A Sleek AI Assistant & MCP Client5ire is a cross-platform desktop AI assistant, MCP client. It compatible with major service providers, supports local knowledge base and tools via model context protocol servers .
EXPLYT
Y GuiA web-based graphical interface for AI chat interactions with support for multiple AI models and MCP (Model Context Protocol) servers.
Continue⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other building blocks
MCP PlaygroundCall MCP Server Tools Online
Cline – #1 on OpenRouterAutonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your permission every step of the way.
Refact.aiOpen-source AI Agent for VS Code and JetBrains that autonomously solves coding tasks end-to-end.
Roo Code (prev. Roo Cline)Roo Code (prev. Roo Cline) gives you a whole dev team of AI agents in your code editor.
WindsurfThe new purpose-built IDE to harness magic
Visual Studio Code - Open Source ("Code - OSS")Visual Studio Code
y-cli 🚀A Tiny Terminal Chat App for AI Models with MCP Client Support
LutraLutra is the first MCP compatible client built for everyone
chatmcpChatMCP is an AI chat client implementing the Model Context Protocol (MCP).
HyperChatHyperChat is a Chat client that strives for openness, utilizing APIs from various LLMs to achieve the best Chat experience, as well as implementing productivity tools through the MCP protocol.
ChatWiseThe second fastest AI chatbot™
DeepChatYour AI Partner on Desktop
MCP ConnectEnables cloud-based AI services to access local Stdio based MCP servers via HTTP requests
ZedCode at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.