Technical SEO Crawling Tips | Julia Nesterets
With Julia Nesterets, CEO and co-founder of JetOctopus · Streamed live · 64 min
What this episode covers
Julia Nesterets explains technical SEO using crawl data joined with server logs and Search Console to find problems such as impressions with no clicks. She covers auditing faceted navigation, which can create millions of duplicate pages, and internal linking on large sites. She also shares how she and her co-founder built JetOctopus, a cloud-based crawler, after facing crawl costs they could not afford.
Key takeaways
- ✦Join crawl data, server logs and Search Console to find pages that get impressions but no clicks.
- ✦Audit faceted navigation, since filter combinations can create millions of duplicate pages.
- ✦Use internal linking on large sites to capture the many long-tail queries they can rank for.
- ✦Check server logs for the hours after site updates so errors are fixed before crawlers arrive.
- ✦Benchmark crawl depth against your own data rather than relying on generic click-depth rules.
Key moments
- 36:58Faceted Navigation Duplicate Pages
“the main thing there was with the duplicated pages by these faceted filters”
- 42:20Crawl Depth and Click Distance
“so the main conclusion you should make your site structure simpler so there should be not more than like five or not more than eight click from the main page”
- 59:02Starting an SEO SaaS Company
“I would say that you should build a dramatically better solution really dramatically better”
Quotes are from the episode transcript, lightly cleaned of auto-caption errors.
Questions answered in this episode
- How can I find pages that get impressions but no clicks?
- Julia suggests joining crawl data, server logs and Search Console, then building a segment of top pages visited by search bots that get impressions but no clicks. These pages are a close SEO opportunity to improve CTR through titles and meta descriptions.
- How many clicks from the homepage should a page be?
- Julia says simpler structures are better and suggests not more than five or eight clicks from the main page, but notes that benchmarks should come from your own data.
- Should I start my own SEO SaaS company?
- Julia advises building a dramatically better solution with strong competitive advantages that are hard to replicate, then focusing on sales and marketing.
More episodes on Technical SEO

SEO Audit Checklist: Technical and On-Page Checks | Luke Hill
Luke Hill

Google Search Console Strategies for SEO | Matthew Mellinger
Matthew Mellinger

Technical SEO: Crawling, Rendering and Authority | John Chung
John Chung

SEO Automation: Embedding Clusters and Link Checks | Samantha Torres
Samantha Torres

llms.txt: Guiding AI Models to Your Key Content | Jordan Pearce
Jordan Pearce

SEO Audit After a Google Update | Kristine Schachinger
Kristine Schachinger