ScrapeMole Reader

Use when you need to read one public web page: fetches the URL live and returns its main readable content as clean Markdown (or plain text), with navigation, ads, cookie banners and boilerplate removed, plus title, byline, publish date, language and word count. Respects robots.txt. Server-rendered HTML only (no JavaScript execution). Paid tool: x402 USDC on Base, $0.003 per successful call; call without payment to receive the PaymentRequired object.

{
  "type": "object",
  "properties": {
    "url": {
      "type": "string",
      "description": "Public http(s) URL of the page."
    },
    "format": {
      "type": "string",
      "description": "Output format.",
      "enum": [
        "markdown",
        "text"
      ],
      "default": "markdown"
    },
    "maxChars": {
      "type": "string",
      "description": "Cut the content at this many characters (1000-200000).",
      "default": "50000"
    },
    "images": {
      "type": "string",
      "description": "Keep images as Markdown image links (true/false).",
      "default": "true"
    },
    "links": {
      "type": "string",
      "description": "Keep hyperlinks as Markdown links (true/false).",
      "default": "true"
    }
  },
  "required": [
    "url"
  ],
  "additionalProperties": false
}

Use when you need a link preview or page metadata: fetches the URL live and returns title, description, site name, canonical URL, language, Open Graph and Twitter card tags, preview image, favicon, author and publish date, RSS/Atom feeds, robots meta and JSON-LD (schema.org) types, after following redirects. Paid tool: x402 USDC on Base, $0.001 per successful call; call without payment to receive the PaymentRequired object.

{
  "type": "object",
  "properties": {
    "url": {
      "type": "string",
      "description": "Public http(s) URL."
    }
  },
  "required": [
    "url"
  ],
  "additionalProperties": false
}

Use when you need the latest posts or headlines from a site, blog, newsroom, podcast or subreddit: give a feed URL or just the site URL (the RSS/Atom feed is auto-discovered from the page) and get normalized items with title, link, publish date (ISO 8601), author, summary, image and categories, newest first as the feed lists them. Paid tool: x402 USDC on Base, $0.002 per successful call; call without payment to receive the PaymentRequired object.

{
  "type": "object",
  "properties": {
    "url": {
      "type": "string",
      "description": "Feed URL, or a site/page URL to auto-discover its feed."
    },
    "limit": {
      "type": "string",
      "description": "Max items (1-100).",
      "default": "20"
    }
  },
  "required": [
    "url"
  ],
  "additionalProperties": false
}

Use when you need the outgoing links of one page (crawling, SEO audits, finding a contact/pricing/docs page, link building): fetches the URL live (respects robots.txt) and returns every http(s) link resolved to an absolute URL, deduplicated, with anchor text (or image alt), internal vs external, rel nofollow/sponsored/ugc, target=_blank and occurrence count, plus internal/external totals. Filter with type=internal|external. Paid tool: x402 USDC on Base, $0.002 per successful call; call without payment to receive the PaymentRequired object.

{
  "type": "object",
  "properties": {
    "url": {
      "type": "string",
      "description": "Public http(s) URL of the page."
    },
    "type": {
      "type": "string",
      "description": "Which links to return.",
      "enum": [
        "all",
        "internal",
        "external"
      ],
      "default": "all"
    },
    "limit": {
      "type": "string",
      "description": "Max distinct links (1-2000).",
      "default": "500"
    }
  },
  "required": [
    "url"
  ],
  "additionalProperties": false
}

Use when you need the list of pages a site publishes (to crawl it, find recent posts, or audit SEO): give a site URL (the sitemap is discovered from robots.txt Sitemap: lines, then /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml) or a sitemap URL directly. Returns the page URLs with lastmod, changefreq and priority; for a sitemap index, returns its child sitemaps and (expand=true, default) the URLs of the first child sitemaps up to the limit. Gzipped sitemaps supported. Paid tool: x402 USDC on Base, $0.002 per successful call; call without payment to receive the PaymentRequired object.

{
  "type": "object",
  "properties": {
    "url": {
      "type": "string",
      "description": "Site URL (e.g. https://example.com) or a sitemap .xml/.xml.gz URL."
    },
    "limit": {
      "type": "string",
      "description": "Max page URLs returned (1-5000).",
      "default": "1000"
    },
    "expand": {
      "type": "string",
      "description": "For a sitemap index, also read the first child sitemaps (true/false).",
      "default": "true"
    }
  },
  "required": [
    "url"
  ],
  "additionalProperties": false
}