The Ecomm Analyst

Growing stores, one honest take at a time.

Running Post-Purchase Surveys That Actually Tell You Something

Most DTC stores I audit either don’t run a post-purchase survey or run one that asks too much. The common version is a multi-question form that loads after checkout, asks for product feedback, attribution, NPS, and how the customer wants to be contacted. Response rate sits at 8 to 12%. The data is messy and gets ignored.

The version that works is one question. “How did you first hear about us?” That’s it. Multiple choice with 6 to 8 options plus an “Other (please specify)” field. Response rate jumps to 30 to 40%.

The reason this matters for attribution is that it gives you a self-reported channel mix that doesn’t depend on pixels firing or platforms claiming. When 35% of customers say they first heard about the brand from a friend, that’s 35% of acquisition you can’t see in any ad platform dashboard. When 15% say “TikTok” but TikTok Ads claims 35%, you’ve got a real read on where the gap is.

The mistakes I see operators make with this data.

Treating the survey as ground truth. It isn’t. Customers forget. They round up. They say “Google” when they actually clicked an Instagram ad and then searched the brand name. The survey is one input, not the answer.

Mixing the survey with pixel data without separating them. If you average the two, you get a number that’s wrong in both directions. Better to look at them side by side and ask why they disagree.

Not segmenting by customer LTV. The channels that bring in high-LTV customers aren’t always the channels that bring in the most customers. A 5% channel by acquisition that has 2x average LTV is a different story than a 30% channel that’s all one-and-done.

I run survey responses through ThoughtMetric so I can cross-reference them against pixel-based attribution and look at LTV by reported channel. The interesting numbers are usually the ones where survey-reported share is much higher than pixel-attributed share. That gap is where the brand is actually working, and where the platforms can’t see it.

Set up the survey as a single question, present it on the order confirmation page, and run it for 90 days before you trust the read. That’s enough volume to start seeing the patterns hold.

3 responses to “Running Post-Purchase Surveys That Actually Tell You Something”

  1. Fairing vs KnoCommerce – The Ecomm Analyst Avatar

    […] which changes the answer depending on how many orders you do. If you have not run a survey before, running post-purchase surveys that tell you something covers the setup mistakes that matter more than tool […]

    Like

  2. How to attribute sales from limited product drops – The Ecomm Analyst Avatar

    […] A post-purchase survey earns its keep on drop day. Ask where they first heard about the release, not just how they found the store. Answers like a creator’s post, a friend or a community Discord rarely leave a click, and they often explain more of the demand than any ad. My notes on writing survey questions that hold up are in running post-purchase surveys that actually tell you something. […]

    Like

  3. How to measure referral program revenue on Shopify – The Ecomm Analyst Avatar

    […] If you don’t have a survey yet, start one before launch so you have something to compare against. Guidance on question design is in running post-purchase surveys that tell you something. […]

    Like

Leave a Reply

Navigation

About

Six years in e-commerce. Three Shopify stores across different niches, one scaled past seven figures. I’ve tested hundreds of ad creatives, obsessed over email flows, and learned more from my failures than my wins.

Now I focus on conversion optimization, retention marketing, and the analytics behind it all. This blog is where I share what actually works, backed by real numbers. No fluff, no guru energy.