#web-scraping

Model Context Protocol server that integrates AgentQL's data extraction capabilities.

Official Firecrawl MCP Server - Adds powerful web scraping to Cursor, Claude and any other LLM clients.

Browser automation and web scraping

Outscraper MCP Server provides MCP-compatible clients with access to Outscraper’s data extraction tools. It enables web, business, maps, reviews, and search-related data collection through the Outscraper API using a simple MCP server configuration.

The Google for AI agents — ask Claude to research any company, analyze competitors, track market trends, monitor breaking news, and investigate key people. 6 intelligence tools returning structured JSON with per-source confidence breakdowns and A–F data quality grades. Aggregates DuckDuckGo, NewsAPI, Wikipedia, web scraping, and social profiles.

Suprsonic is a unified agent API that bundles dozens of capabilities behind one API key. Instead of signing up for Perplexity, SerperDev, Firecrawl, Icypeas, LeadMagic, Deepgram, ElevenLabs, and a dozen other providers, your agent gets one key and one response format. Capabilities include: search, scrape, profiles, emails, images, tts, stt, sms, documents, companies, email-verify, transcribe, invoice-parse, subtitle, file-convert, bg-remove, screenshot Every call is routed through a multi-provider waterfall with automatic failover. Credits are deducted only on success. SDKs for Python and TypeScript, MCP server for Claude Desktop/Cursor/VS Code, and a REST API for everything else.

Your AI agent scrapes X today, gets broken HTML tomorrow. Taprun compiles the site once into a deterministic program, then `tap doctor` monitors health contracts + structural diffs to catch silent breakage before your data goes stale. 140+ pre-built skills across 68+ sites. Works with Claude Code, Cursor, Windsurf, any MCP host.

Web scraping, crawling, and data extraction for AI agents. 5 built-in tools: scrape (clean markdown from any URL), crawl (follow links across entire sites), map (discover all URLs on a domain), extract (structured JSON via schema), and search (web search with optional page scraping). 833ms average latency, single binary, 6 MB RAM. Self-host free or use managed cloud at fastcrw.com with 500 free credits. Firecrawl-compatible API. Works with Claude Desktop, Claude Code, Cursor, Windsurf, and any MCP-compatible client.

What it does 8 MCP tools that give your AI assistant the ability to research the web, read academic papers, extract YouTube videos, pull tweets, and ingest local files — all through the standard MCP protocol.

x402-paid utility tools for AI agents on Solana. Web scraping, screenshots, structured data extraction, code review, content generation, sentiment analysis, and web search. Every tool call settles in USDC via x402 micropayments. Built for autonomous agents that need web access and data processing without API key management. Part of the RelayZero agent economy network.

Rust MCP server that gives AI agents reliable web access. Bypasses Cloudflare and bot protection using Chrome-level TLS fingerprinting, no headless browser needed. 10 tools for scraping, crawling, search, structured extraction, summarization, and more. Output is clean markdown optimized for LLMs with 67% fewer tokens than raw HTML. 8 of 10 tools work locally without an API key.

Web data API that just works. Pass any URL, get clean markdown — Cloudflare, JavaScript, CAPTCHAs handled automatically. No config needed. 97.6% success rate across 500+ domains. Free tier included.

MCP server for website change monitoring. Let your AI assistant track websites, detect changes, and compare snapshots with visual diffs.

Pay-per-use APIs for AI agents. 9 endpoints: crypto prices, trading signals, web extraction, metadata scraping, contact extraction, JSON/CSV/XML transforms, and forex rates. Powered by x402 protocol with USDC micropayments on Base.

AI-powered website crawling, analysis, and export via MCP. 38 tools for crawl control, browser enrichment capture, WARC/ZIP/single-HTML export, observation timeline, and evidence-backed findings. 4 resources, 4 prompts. Dual-mode: full (38 tools) or code (6 tools). Install: npx crawlio-mcp

100-tool browser automation for AI agents via MCP. Screenshots, DOM inspection, network capture, form filling, cookie management, tab orchestration, session recording, and structured data extraction via Chrome extension. One-command setup: npx crawlio-browser init auto-configures 14 MCP clients.recording + 1 compiler) with framework-aware intelligence, typed evidence infrastructure, and confidence-tracked findings — captures what static crawlers can't see.

Web fetching, search, and structured data extraction API built for AI agents. Fetch any page as clean markdown, raw HTML, or JSON-LD. Search the web and news across 20+ countries. One credit per request, no tiers, no subscriptions. 500 free requests on signup.

Scrape any webpage as clean Markdown and extract YouTube transcripts. Enterprise grade infrastructure at $0.001 per request.

PageCrawl is a cloud-hosted MCP server that lets AI assistants monitor web pages for changes in real time. It supports multiple tracking modes including full-page text monitoring, content-only extraction, reader mode, price tracking with availability detection, and CSS/XPath selector-based monitoring. Features include change history with diffs, workspace and tag management, configurable check frequencies, and file monitoring (PDF, Word, Excel). Connect any MCP-compatible AI client to automate web monitoring workflows — track competitor pages, policy changes, pricing updates, product availability, and more.

30+ pay-per-use API tools for AI agents via MCP: image generation (Flux 1.1 Pro), web scraping, browser automation (Playwright), TTS, PDF, QR code, weather, crypto price, WhatsApp, code execution and more. No subscription needed — pay per use via API credits or x402/USDC micropayments. Use with npx iteratools-mcp.

MCP server that converts any URL to clean, token-efficient Markdown for AI agents. Strips ads, navigation, and scripts. Supports CSS selectors, batch processing (10 URLs), and token counting.

33 utility APIs for AI agents — image generation, web scraping, crypto analysis, code review, OCR, TTS & more. Remote MCP server with Streamable HTTP. Pay-per-request via x402 micropayments. One wallet, zero API keys.

AI-powered native browser with built-in MCP server. 7 tools for browser automation — navigate, click, fill forms, extract data, run pipelines. ~30 tokens per page description vs 25,000 for DOM snapshots. macOS Apple Silicon. MIT licensed.

Token-efficient web browser for LLM agents. Extract clean markdown from any public web page — saves 90-95% of tokens compared to raw HTML.

Convert any URL to clean, LLM-ready Markdown or plain text. Remote MCP server, no local install needed.

x402-native API gateway for AI agents. 20+ capabilities (web scraping, screenshots, search, email, translate) — pay-per-use in USDC, no API keys needed.

Give your AI agent unblockable browser access. Aluvia routes traffic through premium mobile carrier IPs to bypass 403s, CAPTCHAs, and WAFs automatically.

Web scraping MCP server for AI agents. Bypass anti-bot systems and get clean, LLM-ready Markdown content. Supports both stdio and Streamable HTTP transports. Built on 8+ years of production scraping infrastructure.

Browser automation MCP server using Chrome/Edge. Access authenticated sites, handle CAPTCHAs, SSO, and JavaScript-heavy pages with your real browser session.

Opengraph.io MCP Server — Instant Link Metadata Extraction An MCP server that connects clients to the Opengraph.io web API, fetching rich metadata (titles, descriptions, images, Open Graph tags, etc.) for any URL. It lets clients retrieve structured link preview data. Ideal for chat bots, UIs, and agents that need to unfurl links and display previews or analyze page metadata, using your Opengraph.io App ID. There is also a suite of image generation tools. There are both stdio & https transports available use the npx config for stdio or the url config for HTTPS

Browser automation for web scraping when standard HTTP requests fail. Use ONLY when pages require: (1) Authentication - login forms, SSO, 401/403 errors, corporate intranets, (2) Anti-bot protection - CAPTCHA, Cloudflare challenges, rate limiting, (3) JavaScript rendering - SPAs, dynamic content loaded after page load. Can fetch pages, click elements, fill forms, and extract content. Opens real browser for user authentication, then automates interactions and extraction. DO NOT use for simple HTML pages that work with regular HTTP GET requests.

MCP server for browser automation via Puppeteer. Executes arbitrary JavaScript with direct access to Puppeteer Browser instance. Single "execute" tool runs your code in a sandboxed Node.js VM with a browser global - full Puppeteer API access in one call.

Get real-time web data, automatically handle anti-bot systems, extract structured data, and capture screenshots with your favorite tools, such as Cursor or LangChain.

Access millions of posts, comments and user profiles at major social media platforms. No API keys. No rate limits. No restrictions. The MCP is optimized to handle large datasets considering LLMs context window size. • Fully Remote • No Local Installation • No Self-Hosting Required More details at: https://xpoz.ai

Advanced MCP server for comprehensive web research, content discovery, and trends analysis. Features multi-engine search, intelligent content extraction, website traversal, and real-time data streaming.

Crawlbase Web MCP Server (Model Context Protocol) connects AI agents and large language models (LLMs) with real-time web data. Built on Crawlbase’s proven web scraping and crawling infrastructure, it handles JavaScript rendering, anti-bot protection, and web data extraction at scale — powering Claude, Cursor, and Windsurf. It delivers a reliable, production-ready pipeline of live, structured data for AI workflows and intelligent applications.

Enable language models to perform advanced AI-powered web scraping with enterprise-grade reliability. Transform webpages into structured markdown, extract data using AI, and execute AI-powered web searches seamlessly. Enhance your applications with powerful web data extraction capabilities through this integration.

🚀 The ONLY browser automation that bypasses Cloudflare, antibots, and social media blocks. Supercharge any MCP-compatible AI agent with undetectable, real-browser automation. No CAPTCHAs. No blocks. Just results.⚡ 30-second setup • 🛡️ Undetectable by design • 🏆 98.7% success rate on protected sites • 🕵️ Full network debugging via AI chat Features: Works on protected sites that block traditional automation- Pixel-accurate element cloning via Chrome DevTools Protocol - Full network debugging through AI chat — see every request, response, header, and payload- Your AI agent becomes a network detective — no more guessing what APIs are being called- 🎛️ Modular architecture — disable unused sections, run minimal installs- ⚡ Lightweight deployments — from 21 core tools to full 88-tool arsenal- Clean MCP integration — no custom brokers or wrappers needed- 88 focused tools organized into 11 logical sections

Manage your GoLogin browser profiles and automation directly through AI conversations. This MCP server connects to the GoLogin API, letting you create, configure, and control browser profiles using natural language. With GoLogin MCP Server, you can: - Manage browser profiles - Create, update, delete, and list your browser profiles - Configure proxies - Set up and modify proxy settings for your profiles - Handle fingerprints - Customize browser fingerprints and user agents - Manage folders - Organize your profiles into folders - Account information - Check your subscription status and usage Example Use Cases - "Create a new browser profile with a US proxy" - "Show me all my browser profiles." - "Update the proxy settings for my profile." - "Delete old profiles I no longer need." - "Check my GoLogin account status." - "Create a folder to organize my profiles."

Configured Puppeteer Vision MCP server for website scraping with specific settings for specify4it.com

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

MCP integrated Web Scraping API that quickly and reliably scrapes any website—no selectors required. Premium proxies, CAPTCHA solving, JavaScript rendering, and automated structured data extraction are all included.

The Oxylabs MCP server provides a bridge between AI models and the web. It enables them to scrape any URL, render JavaScript-heavy pages, extract and format content for AI use, bypass anti-scraping measures, and access geo-restricted web data from 195+ countries.

Mirror of

A Model Context Protocol (MCP) server that demonstrates how to scrape financial data using the israeli-bank-scrapers library

An MCP server that provides web content to your agent.

Roo MCP Server - Real-world automation for web scraping and browser control

Web Scraping Agent with N8N and MCP Server

Example MCP server and instructions for connecting Anthropic LLMs to external web scraping tools, with real-world examples and Bright Data integration.

Example MCP server and instructions for connecting Anthropic LLMs to external web scraping tools, with real-world examples and Bright Data integration.

Browser extension to enable MCP in claude.ai

Olostep MCP Server offers web access tooling to AI apps with minimal setup. It allows AI to: 1. Search the web using google 2. Get the markdown content of any web page 3. Discover and filter out relevant URLs within a website.

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

MCP server for using ScrAPI to scrape web pages.

MCP server for Firecrawl Simple — a web scraping and site mapping tool enabling LLMs to access and process web content

Basic MCP Server for Web Scraping

Bridge the gap between your web crawler and AI language models using Model Context Protocol (MCP). With mcp-server-webcrawl, your AI client filters and analyzes web content under your direction or autonomously, extracting insights from your web content. Support for WARC, wget, InterroBot, Katana, and SiteOne crawlers is available out of the gate. The server includes a full-text search interface with boolean support, resource filtering by type, HTTP status, and more.

A Model Context Protocol (MCP) server implementation that integrates with web scraping capabilities.

A browser automation MCP server for AI models like Claude and Gemini 2.5, enabling web browsing capabilities through natural language

Mirror of

Mirror of

MCP server for fetch web page content using Playwright headless browser.

MCP server for browser automation with screenshot and console logging capabilities

Search Google, scrape webpage and retrieve content in markdown.

Model Context Protocol (MCP) server for Windsurf integration with image generation and web scraping capabilities.

This project demonstrates how to use Cloudflare Browser Rendering to extract web content for LLM context. It includes experiments with the REST API and Workers Binding API, as well as an MCP server implementation that can be used to provide web context to LLMs.

mcp server with duckducksearch, web2md, and web2photo

A Browser Automation Tool for Humans and AI - Built with Playwright, optimized for Bun runtime, supporting CLI and MCP Server modes for webpage analysis and automation

A Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches. Local alternative to SERP APIs with MCP server integration.

Model Context Protocol (MCP) Server for Graphlit Platform

Web Search tools are a series of tools that allow Claude to acces de internet via MCP Server

Mirror of

Mirror of

MCP server to download entire websites

Mirror of