# Google Indexing and Crawling Explained | Carolyn Holzman | SEO Video S

> Carolyn Holzman explains that Google indexing works in three systems: crawling, indexing and serving, and shows how to test it with a plain-HTML keyword and…

Source: https://www.seo.video/videos/google-indexing-and-crawling-explained-carolyn-holzman

SEO Video Show · Live[Technical SEO](https://www.seo.video/videos/topic/technical-seo)[Content & On-Page SEO](https://www.seo.video/videos/topic/content-seo)

# Google Indexing and Crawling Explained | Carolyn Holzman

With **Carolyn Holzman**, founder and president of American Way Media · Streamed live March 10, 2023 · 65 min

## What this episode covers

Carolyn Holzman explains that Google indexing works in three systems: crawling, indexing and serving, and shows how to test it with a plain-HTML keyword and a JavaScript-rendered keyword. She shares results from her ongoing crawl tests, including differences between mobile-primary and desktop-primary sites, and covers server logs, internal links, robots.txt, sitemaps and duplicate URLs. Her main point is that many indexing problems come from Google's systems rather than from your content.

### Key takeaways

-   ✦Track indexing as three separate systems: crawling, indexing and serving.
-   ✦Test indexing with a plain-HTML keyword and a JavaScript-rendered keyword so you can tell which pass Google has reached.
-   ✦When Search Console reports Google systems as the reason a page isn't indexed, resubmit the page rather than assuming your content is at fault.
-   ✦Get duplicate URLs under control with canonicals, since Google may demote both duplicate pages.
-   ✦Run experiments on a separate test site rather than your money site.

## Key moments

1.  [33:29Three Systems Behind Indexation](?t=2009)
    
    > “it's a crawling system it's an indexing system and it's a serving system”
    
2.  [37:59Plain HTML Versus JavaScript Keyword](?t=2279)
    
    > “the only time that you can see that keyword is if it's gone through the second pass”
    
3.  [39:22Google Systems Cause Indexing Problems](?t=2362)
    
    > “they tell you very clearly it's Google systems that's not your website that's Google systems”
    
4.  [53:06Indexing Issues Often Not Your Fault](?t=3186)
    
    > “it very often has nothing to do with you it doesn't mean there aren't things to do”
    
5.  [58:49Duplicate URLs Get Demoted](?t=3529)
    
    > “they demote both of those pages so that's why it's essential to get your duplicate content under control”
    

Quotes are from the episode transcript, lightly cleaned of auto-caption errors.

## Questions answered in this episode

How does Google indexing work?

Carolyn explains that indexation is made of three systems: a crawling system, an indexing system and a serving system, and content can only be found by its keywords once it is served.

Do indexing services help get pages indexed?

Carolyn recommends them when Google is accepting new content, but says they have no special door into Google, so they can't force indexing when Google isn't taking new content.

What happens when Google finds two URLs with the same page?

Carolyn says she has never seen Google pick the better page and ignore the other; instead it demotes both pages, so duplicate content needs to be controlled.

Related guides

-   [YouTube Keyword Research: Find Topics People Search (and AI Asks About)](https://www.seo.video/guides/youtube-keyword-research)

[Watch on YouTube →](https://www.youtube.com/watch?v=uqHSgJEkq2k)[Subscribe to the SEO Video Show: live every Friday at 12pm PT](https://www.youtube.com/channel/UCf99ytepIJxWaTtH06KfkHA)

## More episodes on Technical SEO

[![](https://i.ytimg.com/vi/qDN8Hsen5yI/mqdefault.jpg)

SEO Audit Checklist: Technical and On-Page Checks | Luke Hill

Luke Hill

](https://www.seo.video/videos/seo-audit-checklist-technical-and-on-page-checks-luke-hill)[![](https://i.ytimg.com/vi/2TLwrLF3_1U/mqdefault.jpg)

Google Search Console Strategies for SEO | Matthew Mellinger

Matthew Mellinger

](https://www.seo.video/videos/google-search-console-strategies-for-seo-matthew-mellinger)[![](https://i.ytimg.com/vi/WAnkPdzuPyw/mqdefault.jpg)

Technical SEO: Crawling, Rendering and Authority | John Chung

John Chung

](https://www.seo.video/videos/technical-seo-crawling-rendering-and-authority-john-chung)[![](https://i.ytimg.com/vi/0qzVFNKr3QI/mqdefault.jpg)

SEO Automation: Embedding Clusters and Link Checks | Samantha Torres

Samantha Torres

](https://www.seo.video/videos/seo-automation-embedding-clusters-and-link-checks-samantha-torres)[![](https://i.ytimg.com/vi/pQQxZOI-e5c/mqdefault.jpg)

llms.txt: Guiding AI Models to Your Key Content | Jordan Pearce

Jordan Pearce

](https://www.seo.video/videos/llms-txt-guiding-ai-models-to-your-key-content-jordan-pearce)[![](https://i.ytimg.com/vi/4L_cqFLzT3c/mqdefault.jpg)

SEO Audit After a Google Update | Kristine Schachinger

Kristine Schachinger

](https://www.seo.video/videos/seo-audit-after-a-google-update-kristine-schachinger)
