What should an SEO agency case study show?
An SEO agency case study should show where the site started, what was done, how long it took and what changed for the business. Digital Thrive lists the starting point, documented methodology and data with metrics as the three elements to examine. JumpFly adds that a reputable study explains its data sources and accounts for seasonality and industry trends.
Most case studies skip several of these. The gap matters because most are correlational: Marco Giordano, a data analyst writing in a newsletter on analytics for SEO, notes that case studies rarely prove cause and effect. Treat a case study as a hypothesis to test, not a result to copy.
What are the nine checks?
The nine checks test whether a lift was real, caused by the agency and relevant to you. Work through them in order.
- Baseline. Ask what the numbers were before the work began. A claim of a 200% traffic increase needs the baseline and a breakdown by page, as Giordano points out, and Digital Thrive asks for the site's technical baseline, content health and authority signals.
- Time window. Check the dates compared. JumpFly says year-over-year data best removes seasonality and that comparing one week with the week before tells you little.
- Metric. Ask what changed. eSEOspace puts revenue and qualified leads first and rankings last, so a case study that reports only rankings or impressions has skipped the outcome.
- Brand versus non-brand traffic. Analyze AI advises recomputing the lift on non-brand clicks in Search Console. If the lift disappears, the cause sits upstream of search, such as a PR event or funding announcement.
- Control group. Look for comparable pages the agency did not change. Analyze AI's example: refreshed pages grew 34% and matched control pages grew 6%, so the attributable lift is about 28 points.
- Category movement. Check whether the whole market moved. In Analyze AI's example, traffic rose 18% while category search volume rose 25%, so the site lost share even though its chart went up.
- Method. Look for specifics on technical, on-page and off-page work. Digital Thrive says vague claims cannot be reproduced, and eSEOspace expects every referring domain to be named.
- Match. Compare the client with you on domain strength, industry and competition. Digital Thrive calls the failure to do so the transferability trap.
- Verification. Ask to see first-party data. JumpFly names Google Search Console and GA4 as the ideal sources, and eSEOspace treats agency-owned accounts with no client admin access as a red flag.
How do you score a case study?
Score each check as a pass, a partial or a fail, using the signals below. A case study that passes six or more is worth a conversation, which is our rule of thumb, not a published standard.
| Check | Pass signal | Fail signal |
|---|---|---|
| 1. Baseline | Starting figures and date given | Only a percentage change |
| 2. Time window | Same period compared year over year | Month-on-month or an unstated period |
| 3. Metric | Qualified leads or revenue reported | Rankings or impressions only |
| 4. Brand split | Non-brand shown separately | One combined traffic line |
| 5. Control | Unchanged comparison pages reported | No comparison |
| 6. Category | Market or category trend reported | Site viewed in isolation |
| 7. Method | Pages, changes and dates listed | Phrases such as improved content |
| 8. Match | Similar industry, size and authority | Different market with no caveat |
| 9. Verification | Search Console access or dated screenshots offered | Slides only |
What does a weak claim look like when you test it?
A weak claim is a single number with no context, and each of the nine checks turns it into a question. Take this invented example: Organic traffic up 300% in six months.
Start with the baseline: 300% of what, and on which date? Then the window: were the six months compared with the same six months a year earlier? Then the metric: did qualified leads rise, or only sessions? The brand split asks how much came from searches for the client's own name. A control asks whether pages the agency did not touch also grew. The category check asks whether the market rose. An agency that answers all six in writing has a case study. An agency that cannot has a headline.
Do B2B SaaS and fintech case studies transfer to your business?
They transfer only if the buying context matches, so compare buyers, not just sectors. Digital Thrive warns that tactics which worked in one industry, niche or competitive market often fail in another. A case study for a product-led SaaS company may rest on integration and comparison pages, while a fintech case study may rest on careful claim review and compliance. Check which of those applies to you before you borrow the result.
Our pages for SaaS and fintech set out how those buyers differ. Ask each agency for the nearest match to your sector and sales cycle, not its biggest result.
What can you check when a case study is anonymised?
You can still check the dates, the metric, the comparison and the data, even when the client's name is hidden. Anonymised case studies are common because software and logistics contracts often forbid naming customers. Ask for the date ranges compared, the type of figure shown, and a live walk-through of the client's Search Console data with the property hidden.
Our own case studies are anonymised, and we are a new agency without a named B2B client case study yet. Each figure on them is read from Search Console on the dates stated. Hold us to the same nine checks. For how to build a case study that survives them, see what we measure in a B2B SEO case study.
How do you triage case studies in ten minutes?
Triage with three questions before you read the detail. Does it give a baseline and a time window? Does it report a business metric, not rankings? Does the agency offer to show first-party data? A case study that fails two of these three can be dropped from the shortlist. For the full selection process, see twelve questions to ask when choosing a B2B SEO agency, and to see how we would test your own site, book a free B2B SEO audit.