SEO Crawl Depth Explained: What It Is and Why It Matters for South African Websites

SEO crawl depth explained is the starting point for understanding why some of your pages rank — and why others, containing perfectly useful content, never appear in search results at all. In South African search engine optimisation, crawl depth describes one straightforward measurement: how many clicks it takes for Googlebot to reach a specific page starting from your homepage.

If that number climbs too high, the page may not get crawled, will not get indexed, and cannot rank regardless of how well it is written or how relevant it is to a searcher's query.

For most South African websites, the problem is not weak content — it is structure. WordPress category hierarchies, WooCommerce product nestings, and forgotten location or landing pages routinely push useful content further from the homepage than a typical crawl will ever reach. The full range of actions to take once you have diagnosed a structure problem is covered in our crawlability improvement guide. This post focuses on what crawl depth means, how to measure it, and which target depth applies to your specific site type.

SEO Crawl Depth Explained: Definition and Measurement

Crawl depth is the minimum number of clicks — following internal links only — that it takes to travel from your homepage to a given page. Your homepage sits at depth 0. A service page linked directly from the homepage navigation is at depth 1. A blog post linked from a category page that itself is one click from the homepage sits at depth 2. A product inside a sub-category inside a category is at depth 3 or deeper, depending on how many tiers your navigation creates.

The table below maps depth levels to the types of pages typically found there, and the crawl treatment each level tends to receive:

Crawl depth in SEO is distinct from your crawl budget, which describes how many pages Google crawls on your site within a given period. The two concepts intersect: when your crawl allocation runs short, pages at greater depth are the first to be dropped. Understanding both is essential for technical search work on any South African site with more than a few dozen pages.

How Googlebot Discovers and Prioritises Your Pages

Google is a fully automated search engine that uses crawlers to explore the web constantly, and it relies almost entirely on links to find new and updated pages. According to Google's own SEO Starter Guide, Googlebot "primarily finds pages through links from other pages it already crawled." A page with no inbound links — from any source — depends entirely on your XML sitemap for discovery, and even then may receive lower crawl priority than pages that are naturally linked.

This link-following model has a direct implication for depth. Google starts at your most-linked pages — typically the homepage and top-level navigation — and follows every crawlable link it finds on those pages. A crawlable link means a standard HTML anchor: <a href="...">. Links fired through JavaScript events, inaccessible behind login walls, or blocked by robots.txt are invisible to Googlebot. From those starting points, the crawler moves outward, reaching depth 1 pages, then depth 2, then depth 3, spending more of its crawl on pages encountered earlier in that chain.

Pages with more internal links pointing to them get discovered and revisited more frequently. Pages with zero internal links pointing to them — orphan pages — receive no link equity flow at all and are essentially invisible to the crawler unless they appear in your sitemap. The result is predictable: well-linked shallow pages get indexed faster; poorly linked deep pages may never be indexed at all.

Flat vs. Deep: The Architecture Trade-Off

A flat site architecture keeps every page within three clicks of the homepage; a deep architecture forces important pages four, five, or more clicks away through layered navigation. Practitioners consistently find that a flat approach produces better crawl outcomes than a deep, siloed structure — not because Google penalises depth directly, but because shallower pages receive more inbound internal links, tend to be crawled more frequently, and are typically indexed sooner.

Managing crawl depth site architecture well is rarely deliberate — it is mostly the casualty of organic growth. A business starts with a clear structure: Home > Services > Service Page. Clean, flat. Then the blog grows. A plugin adds a shop. The shop gets categories, then sub-categories.

Each layer adds one click to every page below it. Within two years, a product page that started at depth 3 may now sit at depth 5 because two new sub-category tiers were inserted above it. The page content has not changed. The rankings have.

The primary correction for a deep structure is not a site rebuild — it is internal linking strategy. Adding direct links from high-authority pages (the homepage, key category pages, or popular blog posts) to buried pages effectively creates a shorter path to them. A product page at depth 5 in the category hierarchy can be reached at depth 2 if your homepage footer links directly to it. Googlebot follows the shortest available path, so adding links from shallower pages immediately reduces the effective crawl depth for those pages.

Target Page Levels by Site Type: A Decision Table

Once you understand what SEO crawl depth explained means for your particular site type, the practical question is: what target depth should each category of page hit? The answer depends on your site's total page count and structure. The table below gives concrete, site-type-specific targets — more useful than the generic "under three clicks" advice you find on most resources.

The consistent rule across every site type: your highest commercial-value pages — the ones a converting visitor must reach — should sit at depth 2 or shallower. Pages at depth 4 are borderline; anything at depth 5 or deeper needs a direct internal link shortcut or a structural flatten before you invest further in content for those pages. No amount of content quality compensates for a page Googlebot cannot reliably find. This is also where improving website indexation begins — with structure, not with sitemap submissions alone.

Auditing Your Site Structure in Under an Hour

A depth audit does not require expensive tooling. For most South African small business sites, the following four-step process gives a complete picture using tools that are either free or already in use.

Step 1 — Google Search Console coverage report. Go to Index > Pages in your Search Console account. Filter for "Discovered — currently not indexed" and "Crawled — currently not indexed." These are pages Google found but has not indexed — often a signal that they are too deep, too thin, or blocked. Export the list and note the URLs.

Step 2 — Run a site crawl. Screaming Frog's desktop crawler (free up to 500 URLs for most South African SME sites) crawls your site the way Googlebot does and reports the exact depth of every page. After the crawl completes, go to the Crawl Depth column in the internal pages report and sort descending. You will immediately see which pages are deepest.

Step 3 — Cross-reference depth against commercial value. Not every deep page is a problem. A blog post from 2019 at depth 5 that gets no traffic may simply be a candidate for pruning. A product page at depth 5 that generates significant revenue is a structural emergency. Score each deep page by its commercial importance and prioritise accordingly. The framework for prioritising this work sits in our guide to prioritising search fixes.

Step 4 — Add internal links or flatten the hierarchy. For each high-priority page sitting too deep, choose the faster fix: add a direct internal link from a page already sitting at depth 1 or 2 (a blog post, the homepage footer, a sidebar widget), or restructure the category hierarchy to remove a tier. The link approach is faster; the restructure is more durable for large sites. If you are weighing up a restructure on a large site, our technical SEO service in South Africa starts with a free audit and agrees a flat monthly retainer before work begins.

Common Architecture Mistakes on South African Websites

South African SME websites make a consistent set of architecture errors that push important content beyond practical crawl reach — the same patterns that SEO crawl depth explained analysis surfaces on almost every technical audit. Most are the result of organic site growth rather than deliberate bad choices, but the search impact is the same.

Over-nested WooCommerce categories. The most common pattern: Shop > Category > Sub-category > Sub-sub-category > Product. Each tier is logical for navigation, but every tier adds one to every product's depth. A three-tier category structure below Shop puts products at depth 4. The fix is to collapse the middle tiers where possible and add featured product links directly to category pages.

Location pages buried in sub-navigation. A Johannesburg business that serves Cape Town, Durban, and Pretoria will often create location-specific pages and add them to a dropdown hidden behind a "Locations" menu item. Those pages sit at depth 3 at best, depth 4 in many implementations, and receive no homepage link equity. Linking key location pages from the footer or homepage body reduces their effective depth immediately.

Blog posts with no internal links pointing to them. Every post that exists only as a chronological entry in the blog archive — with no links from other posts, no topic cluster links, and no category page with meaningful prominence — is effectively an orphan. It may appear in the sitemap, but without internal link equity it sits lower in crawl priority. The correction is systematic internal linking, connecting newer posts to relevant older content and vice versa.

Legacy pages never removed or redirected. Temporary pages created during load-shedding periods (generator availability, hours updates, alternative delivery notices) frequently remain on South African sites long after they are relevant. These pages add to the total URL count that Googlebot has to process, consume crawl allocation, and distract from pages that matter. A quarterly review of the coverage report catches these before they compound.

Paginated archive pages creating extra tiers. WordPress category archives paginate (/page/2/, /page/3/) and each pagination page sits one level deeper in the crawl path. Blog posts linked only from deeper pagination pages effectively inherit that extra depth. The practical fix is robust internal linking between posts, so posts are reachable via content links rather than depending solely on the paginated archive for discovery.

Why South African Businesses Choose Growth Pulse Media for Technical Search

Most search agencies in South Africa operate at the content level — keywords, posts, meta descriptions. Growth Pulse Media's founder, Dirk van Greuning, built and scaled a large South African ecommerce business before founding the agency.

That operational background means the technical questions — how a WooCommerce category structure is flattening rankings, why a multi-location service site's city pages are not being indexed, where the crawl budget is being wasted on duplicate filter URLs — come with a cost attached. The fix is treated with the same urgency as a conversion rate problem.

Our SEO work for South African businesses starts with the structural foundation: crawl health, indexation, internal linking, and page architecture before any content investment. We run with a limited client load specifically so each account gets senior attention on these questions — not a junior executing a templated checklist. All work is executed in-house.

If you are investing in content for a site where Googlebot cannot reliably reach the pages you are building, the content spend is largely wasted. Fixing the structure first is not cautious — it is the faster path to organic revenue.

Who This Is NOT For

Frequently Asked Questions

What is crawl depth in SEO?

Crawl depth in search engine optimisation is the number of clicks required to reach a specific page starting from your homepage. The homepage sits at depth 0, pages one click away are depth 1, and each additional link hop adds one to the count. Pages at greater depth are reached later in a crawl session — and on sites with large page counts, may be skipped if the crawl allocation runs out before reaching them.

Does crawl depth directly affect Google rankings?

Crawl depth affects rankings indirectly: a page that is not crawled cannot be indexed, and a page that is not indexed cannot rank. SEO practitioners associate pages closer to the homepage with stronger discoverability and more inbound internal link equity — though this is a practitioner observation, not a platform-confirmed ranking mechanism. The primary confirmed path is discoverability: a page Googlebot cannot reliably reach will not appear in search results regardless of its quality.

What is a good crawl depth for a website?

For most websites, keeping priority pages within three clicks (depth 3) of the homepage is the widely recommended target. For smaller professional service sites (under 40 pages), most pages can sit at depth 1 or 2. For larger WooCommerce or Shopify stores with hundreds of products, depth 3 to 4 is acceptable for product pages provided key category pages are at depth 1 or 2. Pages at depth 5 or beyond should either be flattened through category restructuring or given direct internal links from shallower pages.

How do I check my site's crawl depth?

The most practical approach for auditing website crawl depth on South African sites is Screaming Frog SEO Spider — the free version handles up to 500 URLs and reports depth per page in its internal pages report. Sort the depth column in descending order to immediately identify your deepest pages. Cross-reference those against your Google Search Console coverage report — specifically the "Discovered — currently not indexed" filter — to see whether your deepest pages are the ones failing to index. That intersection is your priority fix list.

What is the difference between crawl depth and crawl budget?

Crawl depth is the structural measurement — how many clicks from the homepage to a given page. Crawl budget is the allocation — how many pages Google crawls on your site in a given period. The two interact: when your crawl budget is limited (which it always is, to varying degrees), pages at greater crawl depth are the first to be skipped when the budget runs short. Fixing crawl depth problems reduces the number of hops Googlebot needs to reach important pages, making better use of whatever crawl allocation your site has.

Dirk van Greuning Founder, Growth Pulse Media

Founder of Growth Pulse Media and a specialist in South African search dominance. Dirk translates his experience in scaling South African businesses into high-velocity digital strategies for B2B and retail leaders. He writes about SEO, lead generation, and paid media from an operator's perspective — prioritising pipeline value over impressions.

Connect on LinkedIn