stripe.comgithub.iocss-tricks.comlobste.rsalgolia.comweb.dev

crawlgraph vs semrush — the all-in-one suite vs the focused tool

semrush ships fifty things. crawlgraph ships one. here's why — for a real subset of seos — that's the point.

pete the seo wizard
April 28, 2026 · 9 min read · 2,050 words
sharexlinkedin

semrush is an all-in-one marketing platform. keyword research, position tracking, site audit, ppc intelligence, social scheduling, content templates, agency white-labeling. crawlgraph is a backlink intelligence tool. the right comparison isn't price-per-feature; it's whether you actually need the other forty nine things.

most seos i talk to use semrush like a swiss army knife with two blades open and the rest folded. they pay $140/mo for the pro plan, click into the backlink section three days a week, and never open the social tab. this post is about that pattern, and what changes when you stop paying for it.

the framing problem

semrush is genuinely excellent at what it does. the keyword database is enormous, the rank tracker is accurate, the ppc data has no real free alternative. if your job is to manage a multi-channel marketing program for a brand, you probably need most of the platform — and the per-seat price reflects what it costs to build and maintain.

but a lot of seos aren't doing that job. they're running an agency that delivers backlink audits, or an in-house team where keyword research already lives in google search console and a separate rank tracker. for that audience, the suite is mostly drag — features you scroll past, dashboards you never load, notifications you mute.

what each tool actually does

the cleanest way to look at this is to be honest about what semrush does that crawlgraph doesn't, and what crawlgraph does that semrush doesn't. nobody's strictly better — they're shaped differently.

semrushcrawlgraph
keyword research databaseyes (huge)✗ no
position / rank trackingyes, regional✗ no
ppc & ad copy intel✓ yes✗ no
social media scheduler✓ yes✗ no
site audit (on-page)✓ yes✗ no
open / auditable methodologyno, proprietaryyes (common crawl)
rows per export query10k100k max
per-row / per-query quotascredits, tieredno row quota
public apimetered addon1,000 calls/mo included
billing model$140/mo recurring$99 once (lifetime)

five rows for semrush, five for crawlgraph. that's deliberate. semrush wins clearly on the feature breadth side; crawlgraph wins on methodology, row caps, and billing. neither column is a takedown. the question is which side aligns with your actual workflow.

top sources by authoritycg-authority · 0–100
producthunt.com
90
indiehackers.com
84
news.ycombinator.com
94
reddit.com
96
hn.algolia.com
82
medium.com
90
dev.to
78
fig. 1 — top inbound domains for a typical SaaS, ranked by cg-authority. the same shape semrush prints; sourced from common crawl.

crawlgraph is not free. the free tier returns the top 5 backlinks per domain — enough to sanity-check a profile but not to run a full audit. the $99 lifetime tier removes the per-domain cap and unlocks exports up to 100k rows per query. semrush's free account caps you at 10 queries per day with truncated reports.

the 70% you never use

i did the exercise once with my own semrush account: pulled the audit log, counted which features i'd clicked into in the trailing 90 days. it was four. backlink analytics, the keyword overview tool, position tracking for one client, and the site audit when something broke. everything else — content templates, ppc keyword magic, social poster, market explorer, eyeballs on competitors' ad copy — sat idle.

that's not a knock on semrush. those features exist because some customer uses them and it's genuinely cheaper to bundle than to unbundle. what it does mean is that if your usage looks like mine, you're paying for a platform and using it as a single-purpose tool. the unit economics get uncomfortable.

livetry it on your own site

run this query against your domain — free

first 5 backlinks free. no signup required.

https://

the case for a focused tool

focused tools have a few real advantages over suites:

  • one mental model. there are two endpoints to learn — /api/v1/backlinks and /api/v1/gap-analysis — and a web ui that lets you type a domain and see the rows. that's the surface area. new hires get up to speed in fifteen minutes.
  • open methodology. the underlying graph is common crawl. anyone can verify our numbers against the same parquet. that's not marketing language; it's a property of using public data instead of a black-box recrawler.
  • no row-count quota games. the export cap is 100k rows per query, full stop. there's no “you used 1,200 of your 10,000 monthly credits” running through your head when you click export.
  • billing that doesn't renew. $99, once. the $5/mo seo fix addon is opt-in. there is no annual contract conversation in q4.

a 30-minute semrush migration

if you're curious whether you could move the backlink piece of your workflow off semrush, here's the practical version. four api calls (or four web-ui domain entries) cover what 95% of semrush's backlink users actually do.

the first one is the analogue of semrush's “backlinks” report. post a domain, get up to 100,000 referring linking domains plus the release id you're reading from:

bash
curl -X POST https://crawlgraph.com/api/v1/backlinks \
  -H "Authorization: Bearer cg_live_…" \
  -H "Content-Type: application/json" \
  -d '{"domain": "competitor.com", "limit": 1000}'

and the response, trimmed:

json
{
  "domain": "competitor.com",
  "release_id": "CC-MAIN-2026-jan-feb-mar",
  "total_linking_domains": 12704,
  "returned": 1000,
  "results": [
    { "linking_domain": "industry-news.com", "num_hosts": 47, "tld": "com" },
    { "linking_domain": "review-blog.io",    "num_hosts": 9,  "tld": "io"  }
  ]
}

the other three: a second call against the competitor in question (same shape with a different domain), a gap-analysis submission to compare your site against two or three rivals, and an eyeball pass on the top linkers via the web ui to sanity-check what showed up. that covers the prospecting, the gap, and the qualitative read in roughly half an hour. full reference at /docs/api.

api access, in numbers

lifetime tier includes a public api with 1,000 /api/v1/backlinks calls per month and 50 /api/v1/gap-analysis calls per month. auth is a bearer token starting with cg_live_. semrush sells api credits separately and the per-call pricing climbs fast.

checkpoint

seen enough? run it on your site free.

5 backlinks free. $99 once for unlimited.

when to stay on semrush

three honest reasons to keep paying. they're real.

  • keyword research is core to your job. the semrush keyword database is a genuine moat. for content strategy, search-volume modelling, and difficulty scoring, there is no $99-once alternative.
  • you bill clients for rank tracking. position tracking with regional segmentation is one of semrush's strongest products. crawlgraph doesn't do this and isn't going to.
  • multi-channel campaigns. if your team manages organic, ppc, and social out of one tab, the suite earns its fee. unbundling makes the weekly status meeting harder, not easier.

the verdict

crawlgraph vs semrush isn't a takedown. semrush is a good product for a real audience. the question is whether you're in that audience or whether you're paying $1,680 a year primarily to access backlink rows that an open dataset already covers.

the way to decide is to run a domain — yours or a competitor's — through the crawlgraph homepage on the free tier, see the top 5 backlinks, and judge whether the index covers what you need. if it does, the $99 lifetime tier is the cheap part of the decision. methodology background lives in common crawl, explained for seos.

ahrefs · backlinkslocked
upgrade required · $129/mo
crawlgraph · live $99 once
G
github.io92
C
css-tricks.com88
L
lobste.rs86
A
algolia.com84
W
web.dev80
same data · one-time
$99$129/moonce
unlock the data →
stripe checkout · instant access
comparisons#semrush#pricing#methodology
sharexlinkedin
pete the seo wizard
author

writes the queries we run internally. ships one tactical post a week.

the dispatch
one post a week.

+ a free domain audit when you sign up.