# Crawlwise Data

> Website change alerts via signed webhooks, plus on-demand tech-stack, feed and sitemap APIs. Deterministic Node.js — no browser, no AI at runtime. Pay for changes, not empty checks.

Base URL: https://crawlwisedata.com
Contact: Crawlwise Data support — crawlwise.support@gmail.com

## For AI agents

- [OpenAPI 3 spec (JSON)](https://crawlwisedata.com/openapi.json): machine-readable API + webhook event schema
- [OpenAPI 3 spec (YAML)](https://crawlwisedata.com/openapi.yaml): same spec
- [Full agent brief](https://crawlwisedata.com/llms-full.txt): longer description of endpoints, auth, billing and MCP
- [Human API docs](https://crawlwisedata.com/docs.html): every endpoint with cURL / JS / Python
- [Pricing (HTML)](https://crawlwisedata.com/pricing.html) · [Pricing (JSON)](https://crawlwisedata.com/v1/pricing)
- [Bot / site-owner page](https://crawlwisedata.com/bot.html): CrawlwiseBot user-agent, robots.txt, opt-out
- [Free tech stack lookup](https://crawlwisedata.com/tech-stack.html) · [Free sitemap/feed checker](https://crawlwisedata.com/sitemap-checker.html)
- Compare: [vs Visualping](https://crawlwisedata.com/crawlwise-vs-visualping.html) · [vs BuiltWith](https://crawlwisedata.com/crawlwise-vs-builtwith.html) · [Change alerts for AI agents](https://crawlwisedata.com/website-change-alerts-for-ai-agents.html)
- [Status](https://crawlwisedata.com/status.html) · [Health JSON](https://crawlwisedata.com/v1/health)
- MCP: local stdio package `crawlwise-mcp` on npm. Install/run with `npx crawlwise-mcp` (Claude Desktop / Cursor config: command `npx`, args `["-y","crawlwise-mcp"]`). Tools: techstack, feed, sitemap, list_monitors, create_monitor, test_monitor_webhook, run_monitor, get_account. Auth: env `CRAWLWISE_API_KEY` (no key yet? `POST /v1/trial`).

## Quick start

1. Free demo (no key, 20 calls/day/IP; Retry-After until 00:00 UTC): `GET /v1/techstack?url=wordpress.org`
2. Free trial key (1,000 one-time credits, no card): `POST /v1/trial` with JSON `{"email":"you@company.com","acceptTerms":true}` (accepts the Terms at /terms.html; without it, call `POST /v1/terms/accept {"acceptTerms":true}` with the key before use) → `apiKey` shown once. One per email every 30 days (per network 5 requests/hour, 10/day); disposable domains refused; if a call costs more than your balance it's refused and you're charged nothing. Or buy a pack or plan at /pricing.html → copy `cw_live_...` (`cw_test_...` in test mode; older `wd_live_` keys still work) key once
3. `Authorization: Bearer $CRAWLWISE_API_KEY`
4. Optional: `POST /v1/monitors` with `schedule:true` + https `webhookUrl` for server-side checks and signed change POSTs
5. See a change during the trial: point a monitor at the built-in demo target (`/demo-target/feed.xml` or `/demo-target/sitemap.xml`, changes every 5 minutes), `POST /v1/monitors/test` for a free signed sample event, `POST /v1/monitors/run` to check now (real signed `monitor.change` when it changed). Sitemap monitor baselines cost a flat 10 credits for any site size

## Core endpoints

- `GET /v1/techstack` — detect CMS, frameworks, CDN, DNS (30 credits). DNS TXT domain-verification records (e.g. openai-domain-verification) are listed in `verifications` (confidence 0), not as technologies
- `GET /v1/feed` — RSS/Atom/JSON Feed, optional `monitor=` new-items (10 credits)
- `GET /v1/sitemap` — sitemap URLs + optional change diff (10 + 1/URL; delivering a sitemap change needs at least 11 credits (10 base + 1 per URL); a check that finds no change costs 2)
- `GET|POST|DELETE /v1/monitors` — list / create / delete scheduled monitors
- `POST /v1/monitors/test` — free signed sample webhook (`monitor.test`) · `POST /v1/monitors/run` — check now, webhook on change
- `GET /v1/demo-target` — built-in feed/sitemap that change every 5 minutes
- `GET /v1/webhooks/secret` · `GET /v1/webhooks/deliveries` — HMAC secret + delivery log
- `POST /v1/trial` — free trial key (no auth) · `GET /v1/trial` — trial rules
- `GET /v1/account` — balance and plan (`accountType`: trial | standard)
- `GET /v1/pricing` · `GET /v1/health` — public

## Optional

- [Terms](https://crawlwisedata.com/terms.html)
- [Privacy](https://crawlwisedata.com/privacy.html)
- [Support](https://crawlwisedata.com/support.html)