TL;DR

Read agency case studies by separating the reported metric, measurement period and documented work. HWM’s examples include revenue totals, attributed revenue shares and a revenue lift. They describe implementation, but do not isolate its causal contribution or predict what another brand will achieve.

On this page5 sections
  1. Compare the metric before comparing the result
  2. What this evidence supports
  3. What the headline figures leave unresolved
  4. A rubric for evaluating an agency’s evidence
  5. Apply the questions to your own account

Compare the metric before comparing the result

Absolute email revenue, the share of revenue attributed to email and percentage growth answer different questions. They also depend on account scale, the measurement window and the attribution definition. A large headline figure alone cannot establish whether an agency is a good fit for your account.

The table below links each reported figure to HWM’s public case page. These are HWM’s own reports, not independently audited benchmarks. The implementation column summarizes what those pages describe; it does not establish what caused the result.

AccountMetricReported figure and sourceMeasurement periodWork described publicly
Furniture and clothingAbsolute email revenue$3.4M[1]A single fourth quarter8 flows, 4 core and 4 advanced; A/B-tested flow revisions
Japanese and Scotch whisky retailerEmail-attributed share of revenue57%[2]Ninety days8 flows, 4 core and 4 advanced; focus on subscription sign-ups and churn
Personalized POD giftsEmail revenue lift+380%[3]Thirty days after launch8 flows, 4 core and 4 advanced; interest tags; tuned send times and formats
Streetwear and sneakersEmail-attributed share of revenue39%[4]Three months8 flows, 4 core and 4 advanced; lifestyle segmentation and interest tags
Personalized giftsAbsolute email revenue$1.1M[5]BFCM and Christmas, approximately two monthsDeliverability and list cleaning, holiday campaigns, post-purchase experience

What this evidence supports

Each linked page describes work performed alongside a reported outcome. For example, the furniture case documents the flows built and the A/B-tested revisions, while the whisky case describes its starting point (email under 10% of revenue) and the churn focus. The other linked cases also include implementation descriptions; a short card on the case-study index does not contain all the detail available on its underlying page.

You can use those descriptions to ask about an agency’s delivery process. They do not establish that the same implementation will produce the same outcome elsewhere. None of these public summaries isolates the incremental effect of each change through a controlled comparison.

What the headline figures leave unresolved

The +380%[3] lift needs a baseline amount and a comparable measurement window to be interpreted fully. A share such as 57%[2] also depends on the attribution model and the store’s other channels. The $3.4M[1] holiday-quarter total does not tell you what an off-season period would produce.

Ask for the metric definition, attribution settings, comparison period and account context. If those are unavailable, record the limitation instead of filling it with an assumption.

A rubric for evaluating an agency’s evidence

  • Metric: What exactly was measured? Separate attributed revenue, incremental revenue and lift.
  • Timeframe: Does the period include a major promotion or holiday? Is the comparison period equivalent?
  • Baseline: What was happening before the work? Is the starting amount disclosed?
  • Implementation: What changed, and what is described only at a high level?
  • Limits: What cannot be concluded from the published evidence?

Use this alongside the agency-vetting checklist. For a closer look at one account, read the furniture-brand teardown.

Apply the questions to your own account

Book a free Klaviyo audit to discuss your current flow coverage, measurement and delivery needs. Browse the case-study library for the source pages behind these examples.

Sources

  1. Huge Win Media case study: $3.4M in Q4 email revenue for a $30M/year furniture & clothing brand
  2. Huge Win Media case study: 57% email attributed revenue for a premium Japanese & Scotch whisky retailer
  3. Huge Win Media case study: +380% email revenue, $560K+ in 30 days for a personalized POD gifts brand
  4. Huge Win Media case study: 39% email attributed revenue, $489.4K in 3 months for a streetwear brand
  5. Huge Win Media case study: $1.1M BFCM email revenue for a $20M/year personalized gifts brand

Want a teardown like this on YOUR Klaviyo account?

Book a free audit