Know when a website changes. Without checking it yourself.

What Crawlwise does

You tell us which website to watch. We look at it for you and, when something changes, we send a short message to your app. That message is called a webhook. It is signed, so your app can prove it really came from us.

We can watch four kinds of things:

• Sitemaps: the list of pages a site publishes. You hear about new, updated and removed pages.
• Feeds: RSS, Atom or JSON news feeds. You hear about new posts.
• Tech stack: the tools a site is built with (for example WordPress or Shopify). You hear when one is added or removed.
• Checks on demand: ask for a fresh look at any time, not only on the schedule.

Get a key

A key is a password for your app. It goes in every request so we know which account to use.

Your key is shown once. Save it somewhere safe, like a password manager. Lost it? Get a new one.

Add your first monitor

A monitor is one thing we watch for you. The easiest way to start is from your dashboard: press Add first monitor and paste the web address where your app should receive messages.

Prefer code? Copy this, swap in your key and your web address, and run it. It watches our built-in demo feed, which gets a new post every 5 minutes, so you see a real change quickly.

curl -X POST "https://crawlwisedata.com/v1/monitors" \
  -H "Authorization: Bearer YOUR_KEY" \
  -H "Content-Type: application/json" \
  -d '{"endpoint":"feed","name":"my-first-monitor","url":"https://crawlwisedata.com/demo-target/feed.xml","webhookUrl":"https://your-app.example.com/crawlwise","schedule":true}'

Receive and verify a webhook

Don’t wait for a real change. Send yourself a free test message right now: press Send test webhook in the dashboard, or run:

curl -X POST "https://crawlwisedata.com/v1/monitors/test" \
  -H "Authorization: Bearer YOUR_KEY" \
  -H "Content-Type: application/json" \
  -d '{"endpoint":"feed","name":"my-first-monitor"}'

Every message carries a signature in the X-Crawlwise-Signature header. Your app checks it with a secret only you and we know. If the check passes, the message is genuine.

import { createHmac, timingSafeEqual } from 'node:crypto';
// secret: from GET /v1/webhooks/secret. rawBody: the request body exactly as received.
export function verify(secret, rawBody, header) {
  const m = /^t=(\d+),v1=([0-9a-f]{64})$/i.exec(header || '');
  if (!m || Math.abs(Date.now() / 1000 - Number(m[1])) > 300) return false;
  const expected = createHmac('sha256', secret).update(`${m[1]}.${rawBody}`).digest();
  const got = Buffer.from(m[2], 'hex');
  return got.length === expected.length && timingSafeEqual(got, expected);
}

Credits and billing, in dollars

You pay with credits. 10,000 credits = $1 (with the $10 pack). You pay a little when we check and nothing changed, and a bit more when we find a change.

Ways to buy, all on the pricing page:

• $10 pack: 100,000 credits, one time. Never expire while your account is active.
• $25 pack: 262,500 credits, one time (5% bonus).
• Starter, $19/month: 250,000 credits every month, about 43 quiet monitors. Unused Starter credits carry over for one month, then expire.

Open your dashboard →