Better Fetch

Created By

flutterninja97 months ago

A powerful Model Context Protocol (MCP) server that intelligently fetches and processes web content with nested URL crawling capabilities. Transform any documentation site or web resource into clean, structured markdown files perfect for AI consumption and analysis.

# fetch

# documentation

Overview Content Tools Comments

Overview

What is Better Fetch?

Better Fetch is a powerful Model Context Protocol (MCP) server designed to intelligently fetch and process web content, featuring nested URL crawling capabilities. It transforms any documentation site or web resource into clean, structured markdown files suitable for AI consumption and analysis.

How to use Better Fetch?

To use Better Fetch, clone the repository from GitHub, install the necessary dependencies, and configure your MCP client to point to the Better Fetch server. You can then use the provided tools to fetch web content either through nested crawling or single-page extraction.

Key features of Better Fetch?

Smart Web Crawling: Nested URL fetching, single-page mode, domain filtering, and pattern matching.
Intelligent Content Processing: Content cleaning, smart section detection, automatic titles, and table of contents generation.
Advanced Markdown Generation: Clean formatting, code block preservation, link preservation, and metadata integration.
Highly Configurable: Crawl depth control, page limits, timeout settings, and error handling.

Use cases of Better Fetch?

Processing API documentation and technical references.
Conducting competitive analysis by gathering competitor documentation.
Creating structured knowledge bases from scattered web content.
Preparing clean content for AI model training and chatbot knowledge bases.

FAQ from Better Fetch?

What is the maximum crawl depth?

The default maximum crawl depth is 2 levels, but it can be configured.

Can I limit the number of pages processed?

Yes, you can set a maximum page limit (default is 50 pages).

Is Better Fetch free to use?

Yes, Better Fetch is open-source and free to use.

Server Config

{
  "mcpServers": {
    "better-fetch": {
      "command": "node",
      "args": [
        "/absolute/path/to/better-fetch/dist/server.js"
      ],
      "env": {
        "NODE_ENV": "production"
      }
    }
  }
}

Recommend Servers

TraeBuild with Free GPT-4.1 & Claude 3.7. Fully MCP-Ready.

Visual Studio Code - Open Source ("Code - OSS")Visual Studio Code

Zhipu Web SearchZhipu Web Search MCP Server is a search engine specifically designed for large models. It integrates four search engines, allowing users to flexibly compare and switch between them. Building upon the web crawling and ranking capabilities of traditional search engines, it enhances intent recognition capabilities, returning results more suitable for large model processing (such as webpage titles, URLs, summaries, site names, site icons, etc.). This helps AI applications achieve "dynamic knowledge acquisition" and "precise scenario adaptation" capabilities.

Context7Context7 MCP Server -- Up-to-date code documentation for LLMs and AI code editors

AiimagemultistyleA Model Context Protocol (MCP) server for image generation and manipulation using fal.ai's Stable Diffusion model.

WindsurfThe new purpose-built IDE to harness magic

Amap Maps高德地图官方 MCP Server

Baidu Map百度地图核心API现已全面兼容MCP协议，是国内首家兼容MCP协议的地图服务商。

MiniMax MCPOfficial MiniMax Model Context Protocol (MCP) server that enables interaction with powerful Text to Speech, image generation and video generation APIs.

ChatWiseThe second fastest AI chatbot™

MCP AdvisorMCP Advisor & Installation - Use the right MCP server for your needs