MCP Web Search Crawler
A lightweight MCP server for web searching via DuckDuckGo and extracting page content as Markdown.
Overview
what is MCP Web Search Crawler?
MCP Web Search Crawler is a lightweight Model Context Protocol (MCP) server that enables web searching via DuckDuckGo and extracts page content in Markdown format.
how to use MCP Web Search Crawler?
To use the MCP Web Search Crawler, clone the repository from GitHub, configure the server in your MCP client, and run the server to start searching and crawling.
key features of MCP Web Search Crawler?
- Web search capabilities using DuckDuckGo, returning links, titles, and body snippets.
- URL crawling to extract content as Markdown.
use cases of MCP Web Search Crawler?
- Integrating web search functionality into AI assistants.
- Extracting and formatting web content for documentation or analysis.
- Enabling automated web data collection for research purposes.
FAQ from MCP Web Search Crawler?
- Can I use this crawler for any website?
Yes, you can crawl any publicly accessible website to extract content.
- Is there a limit to the number of searches?
No, there is no specified limit to the number of searches you can perform.
- What format does the extracted content come in?
The extracted content is returned in Markdown format.
Recommend Servers
TraeBuild with Free GPT-4.1 & Claude 3.7. Fully MCP-Ready.
DeepChatYour AI Partner on Desktop
Context7Context7 MCP Server -- Up-to-date code documentation for LLMs and AI code editors
ChatWiseThe second fastest AI chatbot™
Zhipu Web SearchZhipu Web Search MCP Server is a search engine specifically designed for large models. It integrates four search engines, allowing users to flexibly compare and switch between them. Building upon the web crawling and ranking capabilities of traditional search engines, it enhances intent recognition capabilities, returning results more suitable for large model processing (such as webpage titles, URLs, summaries, site names, site icons, etc.). This helps AI applications achieve "dynamic knowledge acquisition" and "precise scenario adaptation" capabilities.
AiimagemultistyleA Model Context Protocol (MCP) server for image generation and manipulation using fal.ai's Stable Diffusion model.
Baidu Map百度地图核心API现已全面兼容MCP协议，是国内首家兼容MCP协议的地图服务商。
CursorThe AI Code Editor
WindsurfThe new purpose-built IDE to harness magic
Howtocook Mcp基于Anduin2017 / HowToCook （程序员在家做饭指南）的mcp server，帮你推荐菜谱、规划膳食，解决“今天吃什么“的世纪难题；
Based on Anduin2017/HowToCook (Programmer's Guide to Cooking at Home), MCP Server helps you recommend recipes, plan meals, and solve the century old problem of "what to eat today"
Tavily Mcp
TimeA Model Context Protocol server that provides time and timezone conversion capabilities. This server enables LLMs to get current time information and perform timezone conversions using IANA timezone names, with automatic system timezone detection.
EdgeOne Pages MCPAn MCP service designed for deploying HTML content to EdgeOne Pages and obtaining an accessible public URL.
Visual Studio Code - Open Source ("Code - OSS")Visual Studio Code
BlenderBlenderMCP connects Blender to Claude AI through the Model Context Protocol (MCP), allowing Claude to directly interact with and control Blender. This integration enables prompt assisted 3D modeling, scene creation, and manipulation.
MiniMax MCPOfficial MiniMax Model Context Protocol (MCP) server that enables interaction with powerful Text to Speech, image generation and video generation APIs.
Serper MCP ServerA Serper MCP Server
MCP AdvisorMCP Advisor & Installation - Use the right MCP server for your needs
Jina AI MCP ToolsA Model Context Protocol (MCP) server that integrates with Jina AI Search Foundation APIs.
Playwright McpPlaywright MCP server
Amap Maps高德地图官方 MCP Server