Anycrawl - Turn Any Website Into Llm Ready

Created By

any4ai3 months ago

Turn any website into LLM-ready, and provide SERP

Content

AnyCrawl MCP Server

🚀 AnyCrawl MCP Server — Powerful web scraping and crawling for Cursor, Claude, and other LLM clients via the Model Context Protocol (MCP).

Features

Web Scraping: Extract content from single URLs with multiple output formats
Website Crawling: Crawl entire websites with configurable depth and limits
Search Engine Integration: Search the web and optionally scrape results
Multiple Engines: Support for Playwright, Cheerio, and Puppeteer
Flexible Output: Markdown, HTML, text, screenshots, and structured JSON
Async Operations: Non-blocking crawl jobs with status monitoring
Error Handling: Robust error handling and logging
Multiple Modes: Support for different deployment scenarios (CLOUD_SERVICE, SSE_LOCAL, HTTP_STREAMABLE_SERVER, runLocalServer)

Get your API key

Visit the AnyCrawl website and sign up or log in: AnyCrawl
🎉 Sign up for free to receive 1,500 credits — enough to crawl nearly 1,500 pages.
Open the dashboard → API Keys → Copy your key.
Copy the key and set it as the ANYCRAWL_API_KEY environment variable (see above).

Server Config

{
  "mcpServers": {
    "anycrawl-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "anycrawl-mcp-server"
      ],
      "env": {
        "ANYCRAWL_API_KEY": "<YOUR_TOKEN>",
        "ANYCRAWL_BASE_URL": "https://api.anycrawl.dev",
        "LOG_LEVEL": "info"
      }
    }
  }
}

Recommend Servers

TraeBuild with Free GPT-4.1 & Claude 3.7. Fully MCP-Ready.

MiniMax MCPOfficial MiniMax Model Context Protocol (MCP) server that enables interaction with powerful Text to Speech, image generation and video generation APIs.

Howtocook Mcp基于Anduin2017 / HowToCook （程序员在家做饭指南）的mcp server，帮你推荐菜谱、规划膳食，解决“今天吃什么“的世纪难题； Based on Anduin2017/HowToCook (Programmer's Guide to Cooking at Home), MCP Server helps you recommend recipes, plan meals, and solve the century old problem of "what to eat today"

Tavily Mcp

WindsurfThe new purpose-built IDE to harness magic

ChatWiseThe second fastest AI chatbot™

EdgeOne Pages MCPAn MCP service designed for deploying HTML content to EdgeOne Pages and obtaining an accessible public URL.

CursorThe AI Code Editor

Baidu Map百度地图核心API现已全面兼容MCP协议，是国内首家兼容MCP协议的地图服务商。

MCP AdvisorMCP Advisor & Installation - Use the right MCP server for your needs

Amap Maps高德地图官方 MCP Server