For sites built with AI

Your AI built the site. CrawlSpec makes the pages worth indexing.

CrawlSpec drafts each page from your crawl, your Search Console queries and the facts you add. Nothing goes live until you approve it.

Demo requests go to support@crawlspec.dev

Or scan your site for free

We crawl 25 pages and show the top three fixes in full, each with a prompt for your coding agent. No account, no card. What the Free Scan does

25 pages, depth 2, robots.txt honoured. Most scans finish in under a minute, and the report link stays live for 14 days.

The CrawlSpec page editor with an AI-drafted section waiting for Accept

Crawled, then left out of the index

AI site builders ship pages that look finished. Google can crawl them, judge them thin or mass-produced, and leave them out of its index. The usual answer is more pages in bulk. CrawlSpec writes fewer, better ones.

What CrawlSpec does

Written from your own data

Drafts also use the keywords you track, not only your crawl and Search Console. The editor flags any number that doesn't trace to a fact you added, the brief's sources or your live page.

Finds the pages Google is passing over

Your crawl finds duplicate titles, broken links and wrong canonicals, grouped by template so one fix covers many pages. Search Console shows the queries that get impressions but no clicks.

The Issues table with the detail panel open on one issue

You stay the editor

Every section shows who wrote it: the AI, the AI with your edits, you, or your live page.

Lands in your app

Export an approved page as Markdown, or hand its brief to your agent. The kit (beta, by invitation) lets your app pull approved pages, and CrawlSpec never gets write access to your repo.

Ask for a kit invite

How a page gets written

CrawlEvery URL,politelyResearchYour queries,your factsDraftThe AI proposeseach sectionApproveYou accept,edit or writeDeliverExport, or handthe brief to your agentRe-crawlYour next crawlreads it again

The research behind each page is a brief: the page's must-fix issues, its structure, the links pointing to it and the queries people find you for.

Works with your coding agent

Your agent reads the same data you do: an MCP server with 11 workspace tools serves audits, briefs, keywords and pages competing for the same query. It can also mark a brief as applied and ask for a re-check.

Included in every paid plan

tools/list

  • list_projects
  • get_recommendations
  • get_briefs
  • get_topics
  • get_keywords
  • get_consolidated_audit
  • mark_brief_applied
  • get_page_audit
  • get_cannibalization
  • get_brief_prompt_pack
  • request_brief_recheck

What CrawlSpec is not

Not a bulk page generator. If you want hundreds of pages a day, use another tool.

No promise of rankings. What Google does with a page is up to Google.

No backlink index. To see who links to you, keep using a backlink tool.

No rank tracking. Keep your rank tracker if you use one.

Founding 50

The first 50 workspaces on yearly Pro pay $195/yr instead of $390/yr, locked in while the subscription stays active.

Make your pages worth indexing

Start with the page that needs it most.