CrawlwiseData
Free tools

Free sitemap & feed checker

Enter a public site URL. Crawlwise finds sitemaps via robots.txt (or reads a feed) using the same production demo endpoints. No key needed. Ready for change alerts? Get a free trial key and we’ll POST signed webhooks when pages or posts appear, update, or disappear.

Check a site

Demo mode: 20 calls/day/IP, smaller result sizes (sitemaps up to 75 URLs, feeds up to 15 items), no monitors.

Discovers sitemaps via robots.txt. Demo returns up to 100 URLs.

API docs →
GET /v1/sitemap?url=netlify.com&max=100

Enter a URL and press Run check. Sitemap URLs or feed items appear here.

From check to webhook

Watch for new, updated, and removed pages

One-shot checks are free in demo mode. With a trial key, create feed or sitemap monitors: Crawlwise schedules the polls and POSTs signed change events. Noop checks cost 2 credits — you pay for changes, not empty runs.

Get a free trial key

1,000 free credits, one time (about 33 tech-stack lookups or 100 feed reads). No card. One key per email every 30 days; per network up to 5 requests an hour and 10 a day. We never email you.

Trial limits: 20 requests/min, 5 monitors. If a call costs more than your balance, it's refused and you're charged nothing. Disposable email addresses are refused. We keep only a salted hash of your email (Privacy). Agents: POST /v1/trial with {"email": "…", "acceptTerms": true} (or accept later with POST /v1/terms/accept).

Also free: tech stack lookup · monitors howto · pricing