Scaled across thousands of pages on an enterprise site, that small change equals millions of visits.
The difference between position 1 and 2 (or even 6 and 3) can be attributed to user engagement metrics like CTR. The fastest way to manipulate CTR is through changes in page titles and meta descriptions.
Changing your titles and metas is easy — it's SEO 101. However, tracking these changes across thousands of pages is a real challenge. That's why we built a Google Sheets-based reporting system that does all the heavy lifting for you.
The file is built to evaluate:
- The (+/-) of keyword rankings when you change page titles or meta descriptions
- The (+/-) of Click Through Rate (CTR) when you change page titles or meta descriptions
Use Cases for The Report
This report is best used to measure mass amounts of changes in bulk on large, enterprise websites. In particular, websites with a large number of pages that you can group together.
For example:
- Ecommerce product pages
- Ecommerce category pages
- "Location" pages for national franchises
- Directory pages / listings
It operates by pulling in data from Google Search Console to measure the impact of rankings and SERP CTR over periods of time.
In order to get the most out of this report, you'll need to use proper testing techniques by setting a hypothesis, control, and test.
Example 1 — Ecommerce Site
Let's imagine we're working with a health/supplement brand like GNC.
- Hypothesis: Adding "FREE Shipping today only" into the meta description will increase CTR of keywords ranking between positions 2 and 6.
- Test: Change 50% of meta descriptions to include the words "FREE Shipping" at the end.
- Control: Leave 50% of meta descriptions as is, ensuring that the rest of the naming nomenclature is consistent.
- Measure: Use the report to measure the ranking changes and CTR changes of the test and control pages over a 3-month period, pulling the data every 15 days (6 reporting periods).
Example 2 — National Franchise
Let's imagine we're working with a national gym like 24 Hour Fitness.
- Hypothesis: Adding a zip code to page titles will increase keyword rankings in that local market.
- Test: Change 50% of page titles to include the zip code in the page title.
- Control: Leave 50% of page titles as is, ensuring that the rest of the naming nomenclature is consistent.
- Measure: Use the report to measure the ranking changes and CTR changes of the test and control pages over a 3-month period, pulling the data every 15 days (6 reporting periods).
Again, this works best on larger websites where you can dynamically make mass changes to templates (page titles and metas) to measure the impact on a large scale. While you can use this on any site, the data will likely be inconsistent due to the lack of volume.
Running the Report
We put together a Google Sheets file that does all the legwork for you. The instructions below will run you through tab by tab how to build the report. The five tabs are:
- On-page Variation
- Implementation Review
- Results Data
- Test + Control Analysis
- Test vs. Control Analysis
On-Page Variation Tab
We recommend grouping the pages you want to test by page-type (product pages, location pages, etc.) before starting to run the report. This way you'll obtain more consistent results.
For the purpose of this demonstration, we'll be testing the location pages of a national franchise.
Pulling Current Titles and Metadata
- Manually upload your target pages into a crawler (we like Screaming Frog) to pull current titles and meta descriptions.
- Export your data as .csv.
- Copy the exported .csv sheet (all cells) and paste it as values only into the screaming frog crawl_1 tab (make sure to paste the data starting on cell A1, otherwise the formulas behind this tab will not run properly).
By doing this, the On-page strategy tab will be populated with the corresponding target URLs, title tags, and meta descriptions. Make sure all your columns are being filled with data by expanding the formula down.
Developing Nomenclature Strategies (The Hypothesis)
Now we're ready to define the "Nomenclature Strategies" — the variances we'll use to test new titles and metas.
We came up with 3 different Nomenclatures to test page titles:
- Strategy 1 = 20 - 100+
- Strategy 2 = Location Name
- Strategy 3 = Top
Each of these would be tacked on to the beginning of the page's existing title.
Strategy 1: 20 - 100+
- Hypothesis: Adding a "number between 20 and 100" and "+" at the beginning of the title will increase CTR and page rankings on that specific page.
- Test: Change 50% of page titles to include Strategy 1.
- Control: Leave 50% of page titles as is, ensuring the rest of the naming nomenclature is consistent.
Fill out columns B, D, and F with your nomenclature strategies, new titles, and new meta descriptions accordingly.
Defining Control vs. Test Groups
After you get all your metadata written, it's time to set up your control groups. We created 2 categories to easily manage this distinction:
- Test: These pages are the ones we're updating.
- Control: These pages will remain as is.
Evaluate how many pages you have per "nomenclature strategy" and divide each group in two. Assign "Control" to 50% of the pages and "Test" to the other 50%.
Example:
- # Pages on Strategy 1 = 18 pages = 9 control + 9 test
- # Pages on Strategy 2 = 18 pages = 9 control + 9 test
- # Pages on Strategy 3 = 8 pages = 4 control + 4 test
In other words, you'll only be changing titles and meta descriptions on half of your pages. The rest will remain as is.
Implementation Review Tab (Optional)
Since clients' in-house SEO teams or developers are usually the ones updating pages, it's always best practice to verify that all your recommendations were properly implemented.
To make this easier, we created a sheet called "Implementation Review" which, based on custom-built formulas, will do this verification for you.
Note: If you are 100% sure all changes have been implemented on test pages, you can skip this step and hide this tab. If not, follow these steps:
- Manually crawl your pages as a list on Screaming Frog.
- Export the file as .csv.
- Copy/paste all data into the screaming frog crawl_2 tab.
This new data will populate the Implementation Review tab automatically. The formulas on the "Title implemented on site?" columns will verify if changes were implemented by comparing current vs. recommended titles. These columns will display:
- YES if the changes were positively implemented on the page.
- NO if the changes have not been implemented yet.
Results Data Tab
Once you verify that all the metadata recommendations were successfully implemented, you can start running the actual report by analyzing the performance breakdown of the pages that were changed.
We recommend waiting until you have a full 3 months since making the changes before running this report.
Identifying Date Windows for Analysis
The identification of your date periods for analysis will depend on your business sales activity: is it seasonal, cyclical, or neutral?
Year-over-year (Y/Y) reporting: If the changes were implemented on July 1st, set your results window (period after the changes were made) to be from July 15th to September 15th 2019. Then, your comparable window (time before changes were made) should be the same dates from the prior year: July 15th – September 15th 2018.
Period over period / before vs. after: If you're working with a neutral client (sales do not depend on seasons or specific sale cycles), you can simply compare the performance of your pages on a before-and-after basis depending on when the changes were made.
For this part of the process, we use a reporting automation plugin for Google Sheets called Supermetrics. It makes your life significantly easier, though you can still download the data manually from Google Search Console and follow the same format.
Setting up GSC Data Sheets
You'll find two empty data resource sheets:
- _GSC data 1: This sheet will have the data from your comparable window.
- _GSC data 2: This sheet will have the data from your results window.
These tabs follow the same process of creation — the only variation is the date window selection. Make sure all Supermetrics settings are set as follows:
- Data Source: Google Search Console
- Sites: client site
- Dates: 1st period (comparable)
- Metrics: CTR% and Avg. Position
- Split by: Full URL
- Filter: Clicks greater than 1
Once you fill out both data resource sheets, your Results tab should be automatically populated. The % Change columns (H and K) have a custom-built formula that compares 1st and 2nd period results on CTR and Average Position per page. The color scale on each column represents the positive (green) or negative (red) performance of a page.
Results Analysis: Pivot Tables and Charts
Once your Results Data sheet is complete, you can start visualizing your strategy performance. We've built two Pivot Tables and Charts default setups that look at the performance of each of your Nomenclature Strategies:
- Test + Control Analysis tab: An aggregate analysis of CTR and Position % change average from both Control and Test pages together per strategy.
- Test vs. Control Analysis tab: A comparison of the CTR and Position % change average of the performance of each strategy between the Control pages (pages as is) and the Test pages (updated pages).
Making Decisions
A large majority of page rankings may decrease as a result of your tests — this is not a bad thing.
When done in a controlled environment, it's easy to revert the changes. More importantly, it reinforces the importance of testing. If you want to grow, you have to be willing to take risks and make changes.
Testing isn't about confirming what you already believe. It's about discovering what's actually true — even when it surprises you.
The brands with the best-performing title tags aren't the ones who guessed right. They're the ones who tested systematically and kept what worked.