MCP Web Search Crawler
A lightweight MCP server for web searching via DuckDuckGo and extracting page content as Markdown.
Overview
what is MCP Web Search Crawler?
MCP Web Search Crawler is a lightweight Model Context Protocol (MCP) server that enables web searching via DuckDuckGo and extracts page content in Markdown format.
how to use MCP Web Search Crawler?
To use the MCP Web Search Crawler, clone the repository from GitHub, configure the server in your MCP client, and run the server to start searching and crawling.
key features of MCP Web Search Crawler?
- Web search capabilities using DuckDuckGo, returning links, titles, and body snippets.
- URL crawling to extract content as Markdown.
use cases of MCP Web Search Crawler?
- Integrating web search functionality into AI assistants.
- Extracting and formatting web content for documentation or analysis.
- Enabling automated web data collection for research purposes.
FAQ from MCP Web Search Crawler?
- Can I use this crawler for any website?
Yes, you can crawl any publicly accessible website to extract content.
- Is there a limit to the number of searches?
No, there is no specified limit to the number of searches you can perform.
- What format does the extracted content come in?
The extracted content is returned in Markdown format.
Recommend Servers
TraeBuild with Free GPT-4.1 & Claude 3.7. Fully MCP-Ready.
Zhipu Web SearchZhipu Web Search MCP Server is a search engine specifically designed for large models. It integrates four search engines, allowing users to flexibly compare and switch between them. Building upon the web crawling and ranking capabilities of traditional search engines, it enhances intent recognition capabilities, returning results more suitable for large model processing (such as webpage titles, URLs, summaries, site names, site icons, etc.). This helps AI applications achieve "dynamic knowledge acquisition" and "precise scenario adaptation" capabilities.
BlenderBlenderMCP connects Blender to Claude AI through the Model Context Protocol (MCP), allowing Claude to directly interact with and control Blender. This integration enables prompt assisted 3D modeling, scene creation, and manipulation.
ChatWiseThe second fastest AI chatbot™
Baidu Map百度地图核心API现已全面兼容MCP协议，是国内首家兼容MCP协议的地图服务商。
Playwright McpPlaywright MCP server
MiniMax MCPOfficial MiniMax Model Context Protocol (MCP) server that enables interaction with powerful Text to Speech, image generation and video generation APIs.
WindsurfThe new purpose-built IDE to harness magic
Amap Maps高德地图官方 MCP Server
Serper MCP ServerA Serper MCP Server
MCP AdvisorMCP Advisor & Installation - Use the right MCP server for your needs
Tavily Mcp
CursorThe AI Code Editor
Howtocook Mcp基于Anduin2017 / HowToCook （程序员在家做饭指南）的mcp server，帮你推荐菜谱、规划膳食，解决“今天吃什么“的世纪难题；
Based on Anduin2017/HowToCook (Programmer's Guide to Cooking at Home), MCP Server helps you recommend recipes, plan meals, and solve the century old problem of "what to eat today"
DeepChatYour AI Partner on Desktop
RedisA Model Context Protocol server that provides access to Redis databases. This server enables LLMs to interact with Redis key-value stores through a set of standardized tools.
Y GuiA web-based graphical interface for AI chat interactions with support for multiple AI models and MCP (Model Context Protocol) servers.
Jina AI MCP ToolsA Model Context Protocol (MCP) server that integrates with Jina AI Search Foundation APIs.
AiimagemultistyleA Model Context Protocol (MCP) server for image generation and manipulation using fal.ai's Stable Diffusion model.
Visual Studio Code - Open Source ("Code - OSS")Visual Studio Code
EdgeOne Pages MCPAn MCP service designed for deploying HTML content to EdgeOne Pages and obtaining an accessible public URL.