Turns any URL into clean markdown through a simple HTTP API, designed specifically for AI agents that need web content. Instead of managing API keys or subscriptions, you pay per scrape using x402 micropayments on Base: half a cent for static pages, 1.5 cents if you need JavaScript rendering. The main endpoint is POST /scrape, which returns markdown along with title and word count. There's also a free /probe endpoint to estimate costs before scraping. Built on Hono with Cheerio and Mozilla Readability for content extraction, cached via Upstash Redis. Reach for this when your agent needs to ingest web content on demand without account setup overhead.
Web scraping API for AI agents. Any URL → clean markdown. Pay per scrape via x402 micropayments on Base.
No accounts. No API keys. No subscriptions.
| Method | Path | Auth | Description |
|---|---|---|---|
| GET | /health | None | Service status |
| GET | /probe?url= | None | Cost estimate (free) |
| POST | /scrape | x402 USDC | Scrape URL → markdown |
| GET | /openapi.json | None | OpenAPI 3.1 spec |
| GET | /docs/llms.txt | None | LLM-friendly description |
| GET | /.well-known/agent-card.json | None | A2A agent card |
| Mode | Price |
|---|---|
| Static (js: false) | $0.005 USDC |
| JS rendering (js: true) | $0.015 USDC |
import { wrapFetchWithPayment } from "x402-fetch";
import { createWalletClient, http } from "viem";
import { base } from "viem/chains";
import { privateKeyToAccount } from "viem/accounts";
const account = privateKeyToAccount(process.env.WALLET_PRIVATE_KEY);
const wallet = createWalletClient({ account, chain: base, transport: http() });
const fetch402 = wrapFetchWithPayment(fetch, wallet);
const res = await fetch402("https://zlurp.ai/scrape", {
method: "POST",
headers: { "Content-Type": "application/json" },
body: JSON.stringify({ url: "https://example.com" }),
});
const { markdown, title, wordCount } = await res.json();
cp .env.example .env # fill in RECEIVING_ADDRESS, NETWORK, REDIS_URL
npm install
npm run dev
csoai-org/pdf-document-mcp
xt765/mcp-document-converter
io.github.ai-aviate/better-notion
suekou/mcp-notion-server
meterlong/mcp-doc
n24q02m/better-notion-mcp