# SEO Testing Methods Explained | Nick Swan | SEO Video Show

> Nick Swan explains how SEO testing works, focusing on time-based tests that compare performance before and after a page change. He covers single, group and…

Source: https://www.seo.video/videos/seo-testing-methods-explained-nick-swan

SEO Video Show · Live[Content & On-Page SEO](https://www.seo.video/videos/topic/content-seo)[Technical SEO](https://www.seo.video/videos/topic/technical-seo)

# SEO Testing Methods Explained | Nick Swan

With **Nick Swan**, Founder of SEOtesting.com · Streamed live September 29, 2023 · 63 min

## What this episode covers

Nick Swan explains how SEO testing works, focusing on time-based tests that compare performance before and after a page change. He covers single, group and URL switch tests, split testing for template-driven sites, and testing historical changes with Search Console data. His main conclusion is that SEO results should be read as a story, accounting for algorithm updates and seasonality, because Google remains a black box.

### Key takeaways

-   ✦Record the date of every change and compare the periods before and after it.
-   ✦Check algorithm updates and seasonality before trusting a result, and consider year-on-year comparisons.
-   ✦Read the full story in the data, since rising impressions with falling CTR can mean the page ranks for more queries.
-   ✦Use group tests to roll one change across many pages, then drill into outliers.
-   ✦Run split tests on pages that already get clicks so the averages are meaningful.

## Key moments

1.  [28:33What SEO testing means](?t=1713)
    
    > “I think we've all been doing SEO testing it's just now there's tools and more data available”
    
2.  [31:38Data informed not data driven](?t=1898)
    
    > “we're more data informed rather than data driven”
    
3.  [33:08Reading the story behind data](?t=1988)
    
    > “if you start to rank for more queries that's a good thing”
    
4.  [34:56Algorithm updates and seasonality risks](?t=2096)
    
    > “the biggest downfall of time-based testing is algorithm updates and seasonality”
    
5.  [35:48Year-on-year testing for seasonality](?t=2148)
    
    > “you could actually test for example September 2022 versus September 2023”
    
6.  [36:11Group SEO tests explained](?t=2171)
    
    > “you're making that change on multiple Pages at the same time”
    

Quotes are from the episode transcript, lightly cleaned of auto-caption errors.

## Questions answered in this episode

How do you keep seasonality from skewing an SEO test result?

Pay attention to algorithm updates and what else happened on the site, and use year-on-year testing to compare the same two months in different years.

What is SEO split testing?

Similar pages are divided into a test group and a control group, the change is made to the test group, and both groups are tracked over the same period to see if the test group outperforms.

Related guides

-   [YouTube Keyword Research: Find Topics People Search (and AI Asks About)](https://www.seo.video/guides/youtube-keyword-research)

[Watch on YouTube →](https://www.youtube.com/watch?v=twE6syKuyrs)[Subscribe to the SEO Video Show: live every Friday at 12pm PT](https://www.youtube.com/channel/UCf99ytepIJxWaTtH06KfkHA)

## More episodes on Content & On-Page SEO

[![](https://i.ytimg.com/vi/HHb37Qd-Emo/mqdefault.jpg)

Zero-Click Marketing: Influence Before the Click | Amanda Natividad

Amanda Natividad

](https://www.seo.video/videos/zero-click-marketing-influence-before-the-click-amanda-natividad)[![](https://i.ytimg.com/vi/TVMV9l2zqHw/mqdefault.jpg)

Content Strategy for Enterprise SEO | Angela Clark Wilson

Angela Clark Wilson

](https://www.seo.video/videos/content-strategy-for-enterprise-seo-angela-clark-wilson)[![](https://i.ytimg.com/vi/COGRYwbvVmI/mqdefault.jpg)

PPC for SEO: Using Paid Data for Keywords | Derek Booth

Derek Booth

](https://www.seo.video/videos/ppc-for-seo-using-paid-data-for-keywords-derek-booth)[![](https://i.ytimg.com/vi/iZkx5fY1Vuk/mqdefault.jpg)

B2B Content Marketing: Top-of-Funnel Still Matters | Monty Montgomery

Monty Montgomery

](https://www.seo.video/videos/b2b-content-marketing-top-of-funnel-still-matters-monty-montgomery)[![](https://i.ytimg.com/vi/E8oWCZ-_y6Q/mqdefault.jpg)

Jobs to Be Done Framework for Marketing | Jordan Fowler

Jordan Fowler

](https://www.seo.video/videos/jobs-to-be-done-framework-for-marketing-jordan-fowler)[![](https://i.ytimg.com/vi/DZQtUBj0qro/mqdefault.jpg)

SEO Course for Beginners | Ștefan Prohnițchi

Ștefan Prohnițchi

](https://www.seo.video/videos/seo-course-for-beginners-stefan-prohnitchi)
