Sponsored by Deepsite.site

PageCrawl

Created By
PageCrawl15 days ago
PageCrawl is a cloud-hosted MCP server that lets AI assistants monitor web pages for changes in real time. It supports multiple tracking modes including full-page text monitoring, content-only extraction, reader mode, price tracking with availability detection, and CSS/XPath selector-based monitoring. Features include change history with diffs, workspace and tag management, configurable check frequencies, and file monitoring (PDF, Word, Excel). Connect any MCP-compatible AI client to automate web monitoring workflows — track competitor pages, policy changes, pricing updates, product availability, and more.
Overview
<!-- Resource hints for better performance -->
<link rel="preconnect" href="https://analytics.lite.lt">
<!-- Preload Raleway font (used in headings - LCP element) -->
<link rel="preload" href="/fonts/raleway-latin.woff2" as="font" type="font/woff2" crossorigin>

<!-- Self-hosted fonts (loaded before website.css to prevent CLS from font swap) -->
<style>
    @font-face {
        font-family: 'Raleway';
        font-style: normal;
        font-weight: 400;
        font-display: swap;
        src: url('/fonts/raleway-latin.woff2') format('woff2');
    }
    @font-face {
        font-family: 'Raleway';
        font-style: normal;
        font-weight: 600;
        font-display: swap;
        src: url('/fonts/raleway-latin.woff2') format('woff2');
    }
    @font-face {
        font-family: 'Raleway Fallback';
        src: local('Arial');
        size-adjust: 105%;
        ascent-override: 95%;
        descent-override: 22%;
        line-gap-override: 0%;
    }
    .web-app h1, .web-app h2, .web-app h3, .web-app h4, .web-app h5, .web-app h6 {
        font-family: 'Raleway', 'Raleway Fallback', sans-serif;
    }
    /* Prevent FontAwesome SVG icons from flashing as large black shapes before JS loads */
    .svg-inline--fa { display: inline-block; height: 1em; overflow: visible; vertical-align: -.125em; }
    .svg-inline--fa.fa-w-16 { width: 1em; }
    .svg-inline--fa.fa-w-20 { width: 1.25em; }
</style>

<link rel="stylesheet" href="/build/assets/CmrP1cWk.css">

<!-- Preload app.css (will be deferred via media="print" trick) -->
<link rel="preload" href="/build/assets/Bsc_rjew.css" as="style">

<link rel="alternate" type="application/atom+xml" href="https://pagecrawl.io/feed" title="PageCrawl.io blog">
<link rel="alternate" type="application/atom+xml" href="https://pagecrawl.io/help/feed" title="PageCrawl.io Help Center">

<!-- Essential component fixes only -->
<style>
    body {
        line-height: 1.5715; /* Match Ant Design to prevent CLS when app.css loads deferred */
    }
    @supports(padding:max(0px)) {
        body, header, footer {
            padding-left: min(0vmin, env(safe-area-inset-left));
            padding-right: min(0vmin, env(safe-area-inset-right));
        }
        div > section.ant-layout > section.ant-layout {
            padding-left: env(safe-area-inset-left);
            padding-right: env(safe-area-inset-right);
        }
    }

    [data-testid="left-image"], [data-testid="right-image"] {
        object-position: center top !important;
    }
    /*.web-app #sentry-feedback {*/
    /*    display: none;*/
    /*}*/
    .badge-limits {
        vertical-align: middle !important;
    }
</style>


                        <!-- Google tag (gtag.js) - loaded synchronously so Redux-Beacon can use it -->
    <script async src="https://www.googletagmanager.com/gtag/js?id=G-W3K0L8KWGJ"></script>
    <script>
        window.dataLayer = window.dataLayer || [];
        function gtag(){dataLayer.push(arguments);}
        gtag('js', new Date());
        gtag('config', 'G-W3K0L8KWGJ');
    </script>
    <script defer data-domain="pagecrawl.io" src="https://analytics.lite.lt/js/script.js"></script>
    <script>
        // Track AI referral sources
        (function() {
            try {
                var ref = document.referrer;
                if (!ref) return;
                var aiSources = {
                    'chatgpt.com': 'ChatGPT',
                    'chat.openai.com': 'ChatGPT',
                    'perplexity.ai': 'Perplexity',
                    'claude.ai': 'Claude',
                    'gemini.google.com': 'Gemini',
                    'copilot.microsoft.com': 'Copilot',
                    'you.com': 'You.com',
                    'phind.com': 'Phind'
                };
                var hostname = new URL(ref).hostname.replace('www.', '');
                var source = aiSources[hostname];
                if (source && typeof gtag === 'function') {
                    gtag('event', 'ai_referral', {
                        ai_source: source,
                        referrer: ref
                    });
                }
            } catch(e) {}
        })();
    </script>
                        <script defer src="/static/fp.js"></script>
                    <meta name="referrer" content="strict-origin">
        








                    <style>
        /*.web-app .h1, .web-app .h2, .web-app .h3, .web-app .h4, .web-app .h5, .web-app .h6, .web-app h1, .web-app h2, .web-app h3, .web-app h4, .web-app h5, .web-app h6 {*/
        /*    clear: both;*/
        /*    color: #202b36;*/
        /*    font-family: Raleway,sans-serif !important;*/
        /*    font-weight: 600 !important;*/
        /*}*/
        body, .ant-layout *, .ant-modal-root {
            font-family: -apple-system,BlinkMacSystemFont,Segoe UI,Roboto,Helvetica Neue,Arial,Noto Sans,sans-serif,Apple Color Emoji,Segoe UI Emoji,Segoe UI Symbol,Noto Color Emoji !important;
        }

        .enhanced-table .ai-summary {min-height: 85px;}
    </style>

    <!-- Defer app.css to prevent render blocking (77 KiB) -->
    <link rel="stylesheet" href="/build/assets/Bsc_rjew.css" media="print" onload="this.media='all'">
    <noscript>
        <link rel="stylesheet" href="/build/assets/Bsc_rjew.css">
    </noscript>

    
    <title data-react-helmet="true">AI Assistants (MCP Server) | Integrations | Help Center | PageCrawl.io</title>
    <meta data-react-helmet="true" charset="utf-8"/><meta data-react-helmet="true" property="og:type" content="article"/><meta data-react-helmet="true" name="description" content="Connect PageCrawl to AI assistants like Claude, ChatGPT, and other MCP-compatible tools to manage your page monitors through natural conversation."/><meta data-react-helmet="true" property="og:description" content="Connect PageCrawl to AI assistants like Claude, ChatGPT, and other MCP-compatible tools to manage your page monitors through natural conversation."/><meta data-react-helmet="true" name="twitter:description" content="Connect PageCrawl to AI assistants like Claude, ChatGPT, and other MCP-compatible tools to manage your page monitors through natural conversation."/>
    <link data-react-helmet="true" rel="canonical" href="https://pagecrawl.io/help/integrations/article/mcp-server-ai-tools"/>
</head>
<body >
<div id="root"><div><div class="body-wrap"><header class="site-header site-header-small"><div class="container"><div class="site-header-inner"><div class="brand header-brand"><h1 class="m-0"><a aria-current="page" class="active" href="/"><img alt="pagecrawl.io" width="309" height="140" class="logo" title="PageCrawl.io" fetchpriority="high" srcSet="/images/logo.png" src="/images/logo-small.png"/></a></h1></div><ul class="header-links list-reset m-0"><li><a href="/app/auth/login">Login</a></li><li><a class="button button-sm button-shadow" href="/app/auth/register">Register</a></li></ul></div></div></header><main><section class="section"><div class=""><article class="help-article"><nav class="help-article__breadcrumbs"><a href="/">Home</a><span class="help-article__breadcrumbs-separator">/</span><a href="/help">Help Center</a><span class="help-article__breadcrumbs-separator">/</span><span>Integrations</span><span class="help-article__breadcrumbs-separator">/</span><span class="help-article__breadcrumbs-current">AI Assistants (MCP Server)</span></nav><div class="help-article__layout"><main class="help-article__main"><header class="help-article__header"><h1 class="help-article__title">AI Assistants (MCP Server)</h1><div class="help-article__meta"><span>Last updated: <!-- -->5 March, 2026</span><span class="blog-reading-time">5<!-- --> min read</span></div></header><div class="help-article__content"><p>PageCrawl includes a built-in MCP (Model Context Protocol) server that lets AI assistants manage your page monitors. You can add monitors, check history, trigger checks, and more, all through natural conversation with tools like Claude or ChatGPT.</p>

MCP is an open protocol that standardizes how AI tools connect to external services. Once connected, your AI assistant can directly interact with your PageCrawl account without you needing to use the web interface or API manually.

Available on Enterprise and Ultimate plans.

What You Can Do

The MCP server provides six tools that your AI assistant can use:

ToolWhat It Does
List workspacesView all your teams and workspaces with their IDs
List monitorsSearch and view monitors across all workspaces by URL, domain, or name
Get monitor detailsSee full configuration of a specific monitor including tracked elements and latest values
Get monitor historyRetrieve historical checks and detected changes with AI summaries
Add page monitorCreate a new monitor with URL, selectors, frequency, and element tracking
Trigger checkTrigger a one-off check on a monitor. Rate limited, not for programmatic use

Supported Element Types

When creating monitors through MCP, you can track the following element types:

  • Full Page - Entire page text content (no selector needed)
  • Text - Text content of a specific element (CSS selector required)
  • Number - Numeric values with change thresholds
  • Price - Price values with currency detection
  • HTML - Raw HTML structure of an element
  • JavaScript - Execute JavaScript and track the result
  • File Hash - Monitor file changes by checksum (no selector needed)
  • PDF - Track changes in PDF documents (no selector needed)

Setting Up with Claude.ai

  1. Go to claude.ai Settings
  2. Navigate to the Integrations section
  3. Click Add Integration and search for PageCrawl, or enter the MCP server URL: https://pagecrawl.io/mcp
  4. You will be redirected to PageCrawl to authorize access
  5. Log in (if not already) and click Approve
  6. PageCrawl tools are now available in your Claude conversations

Setting Up with Claude Code

Add the following to your .mcp.json file (in your project root or ~/.claude/):

{
  "mcpServers": {
    "pagecrawl": {
      "url": "https://pagecrawl.io/mcp"
    }
  }
}

When Claude Code first tries to use PageCrawl tools, it will open a browser window for you to authorize the connection via OAuth.

Setting Up with Claude Desktop

Add the following to your claude_desktop_config.json:

{
  "mcpServers": {
    "pagecrawl": {
      "url": "https://pagecrawl.io/mcp"
    }
  }
}

Restart Claude Desktop. On first use, it will prompt you to authorize the connection through your browser.

Setting Up with ChatGPT

Works with ChatGPT on web, desktop, and mobile. Requires a ChatGPT Plus, Pro, Team, Enterprise, or Edu plan.

  1. Go to chatgpt.com (or open the ChatGPT desktop app)
  2. Navigate to Settings > Connectors > Create
  3. Enter a name (e.g. "PageCrawl"), a short description, and set the URL to: https://pagecrawl.io/mcp
  4. Click Create. You will be redirected to PageCrawl to authorize access
  5. Log in and click Approve
  6. To use in a conversation, click the + button near the message input, select More, and enable PageCrawl

Setting Up with Other MCP Clients

Any MCP-compatible client can connect to PageCrawl. The server details:

  • URL: https://pagecrawl.io/mcp
  • Authentication: OAuth 2.0 (automatic via MCP protocol)
  • Protocol: MCP over HTTP with JSON-RPC 2.0
  • OAuth Discovery: https://pagecrawl.io/.well-known/oauth-authorization-server

The client will handle the OAuth flow automatically. No manual token setup is required.

Example Conversations

Once connected, you can interact with PageCrawl naturally:

Adding a monitor:

"Monitor example.com/pricing every hour and track the full page text"

Checking status:

"Show me all my monitors that have changed recently"

Getting details:

"What changes were detected on the pricing page in the last week?"

Triggering a check:

"Run a check on my competitor's product page now"

Searching monitors:

"Find all monitors tracking example.com"

Working with Workspaces

All tools automatically search across every workspace you have access to. You do not need to know which workspace a monitor is in to find or interact with it.

  • Use List monitors with the search parameter to find monitors by URL, domain, or name
  • Use List monitors with workspace_id to filter results to a specific workspace
  • Use List workspaces to see all your teams and workspaces with their IDs
  • Only Add page monitor requires a workspace_id to specify where to create the new monitor

Limits and Quotas

MCP operations respect your plan's limits:

  • Monitor creation counts toward your page monitor quota
  • Triggered checks are rate limited and placed in a deprioritized queue, so checks may take a while to complete. This is designed for occasional, manual use only (one or two checks at a time). It does not support programmatic or automated triggering - requests that exceed rate limits will be rejected with an error. Instead, configure the check frequency on each monitor and use scheduling settings to run checks at specific times.
  • If you exceed your monitor limit, new monitors are created in a disabled state
  • If you exceed your check limit, manual check triggers will be rejected

See Check Limits and Website Limits for details on plan quotas.

Ready to Track Changes?

Set up monitoring in under 60 seconds and never miss important updates again.

Track a New Page
    </body>

Server Config

{
  "mcpServers": {
    "pagecrawl": {
      "url": "https://pagecrawl.io/mcp"
    }
  }
}
Recommend Servers
TraeBuild with Free GPT-4.1 & Claude 3.7. Fully MCP-Ready.
Baidu Map百度地图核心API现已全面兼容MCP协议,是国内首家兼容MCP协议的地图服务商。
Y GuiA web-based graphical interface for AI chat interactions with support for multiple AI models and MCP (Model Context Protocol) servers.
MCP AdvisorMCP Advisor & Installation - Use the right MCP server for your needs
Visual Studio Code - Open Source ("Code - OSS")Visual Studio Code
Playwright McpPlaywright MCP server
Jina AI MCP ToolsA Model Context Protocol (MCP) server that integrates with Jina AI Search Foundation APIs.
Howtocook Mcp基于Anduin2017 / HowToCook (程序员在家做饭指南)的mcp server,帮你推荐菜谱、规划膳食,解决“今天吃什么“的世纪难题; Based on Anduin2017/HowToCook (Programmer's Guide to Cooking at Home), MCP Server helps you recommend recipes, plan meals, and solve the century old problem of "what to eat today"
Amap Maps高德地图官方 MCP Server
ChatWiseThe second fastest AI chatbot™
BlenderBlenderMCP connects Blender to Claude AI through the Model Context Protocol (MCP), allowing Claude to directly interact with and control Blender. This integration enables prompt assisted 3D modeling, scene creation, and manipulation.
CursorThe AI Code Editor
Serper MCP ServerA Serper MCP Server
Zhipu Web SearchZhipu Web Search MCP Server is a search engine specifically designed for large models. It integrates four search engines, allowing users to flexibly compare and switch between them. Building upon the web crawling and ranking capabilities of traditional search engines, it enhances intent recognition capabilities, returning results more suitable for large model processing (such as webpage titles, URLs, summaries, site names, site icons, etc.). This helps AI applications achieve "dynamic knowledge acquisition" and "precise scenario adaptation" capabilities.
AiimagemultistyleA Model Context Protocol (MCP) server for image generation and manipulation using fal.ai's Stable Diffusion model.
RedisA Model Context Protocol server that provides access to Redis databases. This server enables LLMs to interact with Redis key-value stores through a set of standardized tools.
MiniMax MCPOfficial MiniMax Model Context Protocol (MCP) server that enables interaction with powerful Text to Speech, image generation and video generation APIs.
Tavily Mcp
DeepChatYour AI Partner on Desktop
EdgeOne Pages MCPAn MCP service designed for deploying HTML content to EdgeOne Pages and obtaining an accessible public URL.
WindsurfThe new purpose-built IDE to harness magic