SEO Testing Methods Explained | Nick Swan
With Nick Swan, Founder of SEOtesting.com · Streamed live · 63 min
What this episode covers
Nick Swan explains how SEO testing works, focusing on time-based tests that compare performance before and after a page change. He covers single, group and URL switch tests, split testing for template-driven sites, and testing historical changes with Search Console data. His main conclusion is that SEO results should be read as a story, accounting for algorithm updates and seasonality, because Google remains a black box.
Key takeaways
- ✦Record the date of every change and compare the periods before and after it.
- ✦Check algorithm updates and seasonality before trusting a result, and consider year-on-year comparisons.
- ✦Read the full story in the data, since rising impressions with falling CTR can mean the page ranks for more queries.
- ✦Use group tests to roll one change across many pages, then drill into outliers.
- ✦Run split tests on pages that already get clicks so the averages are meaningful.
Key moments
- 28:33What SEO testing means
“I think we've all been doing SEO testing it's just now there's tools and more data available”
- 31:38Data informed not data driven
“we're more data informed rather than data driven”
- 33:08Reading the story behind data
“if you start to rank for more queries that's a good thing”
- 34:56Algorithm updates and seasonality risks
“the biggest downfall of time-based testing is algorithm updates and seasonality”
- 35:48Year-on-year testing for seasonality
“you could actually test for example September 2022 versus September 2023”
- 36:11Group SEO tests explained
“you're making that change on multiple Pages at the same time”
Quotes are from the episode transcript, lightly cleaned of auto-caption errors.
Questions answered in this episode
- How do you keep seasonality from skewing an SEO test result?
- Pay attention to algorithm updates and what else happened on the site, and use year-on-year testing to compare the same two months in different years.
- What is SEO split testing?
- Similar pages are divided into a test group and a control group, the change is made to the test group, and both groups are tracked over the same period to see if the test group outperforms.
More episodes on Content & On-Page SEO

Zero-Click Marketing: Influence Before the Click | Amanda Natividad
Amanda Natividad

Content Strategy for Enterprise SEO | Angela Clark Wilson
Angela Clark Wilson

PPC for SEO: Using Paid Data for Keywords | Derek Booth
Derek Booth

B2B Content Marketing: Top-of-Funnel Still Matters | Monty Montgomery
Monty Montgomery

Jobs to Be Done Framework for Marketing | Jordan Fowler
Jordan Fowler

SEO Course for Beginners | Ștefan Prohnițchi
Ștefan Prohnițchi