Measure a Shopify quiz as a step in the buying journey, not as a marketing channel. The quiz app will report revenue from everyone who took the quiz and then bought, and that number is real, but it is not revenue the quiz created. Your ads, email, and search sent those shoppers to the quiz. The useful questions are whether quiz takers convert better than similar shoppers who skipped it, and which traffic sources send people who finish it.
Why do quiz apps overstate their impact?
Quiz apps count revenue from quiz completers, and quiz completers are your most engaged visitors. Someone who answers eight questions about their skin type was already more likely to buy than someone who bounced from the homepage. When the app reports that quiz takers convert at three or four times the store average, part of that is the quiz helping and part of it is the quiz attracting people who were going to buy.
The second problem is double counting. If your attribution tool credits a Meta ad for an order and your quiz app credits the quiz for the same order, someone on your team will eventually add those together in a deck. Quiz revenue is a slice of your existing revenue, not an extra channel on top of it.
How should you track quiz traffic?
Keep the original source on every session. Shoppers should arrive at the quiz with the UTM parameters from whatever sent them, and those should carry through to the result page and the order. If your quiz lives on its own page or subdomain, check that it does not strip UTMs or start a new session, because that turns every quiz order into internal or direct traffic in your reports.
Tag paid traffic that lands on the quiz separately from paid traffic that lands on product pages. A simple utm_content value for quiz landings is enough. That lets you compare the same campaign sending people to two different first pages.
Your attribution tool should then let you group orders by landing page or UTM content. ThoughtMetric can report orders and revenue by UTM parameters and by page location alongside the channel that drove the visit. (Disclosure: ThoughtMetric sponsors this site.) Most attribution tools and GA4 can do a version of this. The point is to read quiz performance by traffic source, not as a single number from the quiz app.
What test actually tells you if the quiz works?
Split the same traffic between the quiz and a product or collection page, and compare conversion rate and revenue per visitor. You can do this with ads by running two ad sets with identical targeting and different landing pages, or on site with a testing tool. Run it for at least two weeks, or long enough to get a few hundred orders across both sides, and compare new customer conversion separately from returning.
If the quiz side wins on revenue per visitor, the quiz is earning its place. If it wins on conversion rate but loses on revenue per visitor, it may be steering people to cheaper products. If it loses outright, it may still be worth keeping for the zero-party data it collects, but that is a different argument from sales impact.
Which metrics matter most?
Quiz completion rate tells you whether the quiz is too long. Conversion rate of completers versus non-completers from the same source tells you whether it helps. Average order value of quiz orders tells you what it recommends. And repeat purchase rate of quiz customers over 60 to 90 days tells you whether the recommendations were right. That last one is the most overlooked and often the most valuable. If quiz customers reorder more, the quiz is matching people to products that work for them. More on product-level reads in how to measure product performance for e-commerce.
What about the quiz email list?
Many quizzes collect an email before showing results. Sales from that list later will be credited to email in most tools, not to the quiz or the ad that brought the person in. That is not wrong, but it means the quiz’s real contribution includes some of your email revenue. If you want to see it, segment the quiz list in your email platform and track its revenue separately.
A simple checklist
- Treat the quiz as a step in the journey, not a channel, and never add quiz revenue on top of channel revenue.
- Make sure UTMs survive the quiz pages through to checkout.
- Tag paid traffic landing on the quiz so you can compare it with product page landings.
- Test quiz versus product page on the same traffic and compare revenue per visitor.
- Track repeat purchase rate of quiz customers over 60 to 90 days.
- Segment the quiz email list if you want to see its downstream revenue.
Leave a Reply