Transparency
How Ripplux measures ad waste
Every number in your audit report has a source, a confidence level, and a known limit. This page explains what Ripplux checks, what evidence each finding rests on, and where the honest boundaries are.
Most analytics tools are black boxes. They show you a number and ask you to trust it. Ripplux earns trust differently: every finding names the evidence behind it, findings are labeled Estimated until a real experiment upgrades them to Tested, and when we are unsure, the report says so. If a finding cannot be backed, it does not ship.
Data collection & sync
Ripplux connects to three data sources: Shopify (orders, customers, UTM parameters), Meta Ads (campaigns, ad sets, creatives, daily performance), and Google Ads (campaigns, ad groups, daily performance metrics).
All data is fetched via official platform APIs using OAuth tokens that you authorize. Ripplux never stores raw creative assets, only performance metrics. Data is synced on demand and can be refreshed at any time from the dashboard.
Every order is classified as ad-attributed or organic based on the tracking signals it carries (UTM parameters and paid touchpoints). That classification is the foundation the engines build on, and it comes from your store's own records, not from what an ad platform claims about itself.
Why this matters
Meta and Google each grade their own homework. Ripplux starts from the one dataset neither platform controls: your actual Shopify orders.
Cannibalization detection
Ad cannibalization occurs when ad spend is used to convert customers who would have purchased organically anyway. Ripplux detects this through customer journey analysis.
The engine looks at each customer's full purchase history, grouped by an anonymized customer reference from Shopify (we never store names or emails). When a customer's very first purchase was organic and a later purchase gets credited to a paid ad, that later purchase is flagged: you paid to win back a customer who already knew the way to your store. The engine adds up what those conversions cost you, and that total is your cannibalized spend.
What the finding rests on
Real, individual customer journeys from your order history. Not a survey, not an industry average: each flagged dollar traces back to a specific returning customer whose first purchase needed no ad.
This is a deliberately conservative reading. It only counts customers who demonstrably converted organically before being re-targeted. Customers who would have found you organically on their very first purchase are not counted, so true cannibalization may be higher than the number in your report.
Creative fatigue analysis
Creative fatigue is the performance decay that sets in when the same audience keeps seeing the same ad. The ad still spends at full rate; it just stops earning at full rate. No platform will flag this for you, because the spend keeps flowing either way.
Ripplux tracks each active creative's daily performance over the last 30 days and identifies the day it peaked. A creative is flagged as fatigued only when its click-through rate has fallen well below that peak and stayed down for at least a full week, so a single slow day never triggers a false alarm.
The wasted amount is the gap between what the creative earns now and what it earned at its peak, applied to what you spent on it since the decline set in. The further past its peak an ad runs, the more of its budget the report attributes to decay rather than performance.
What the finding rests on
Thirty days of the creative's own daily record. The comparison is the ad against its own best self, not against a generic benchmark.
This method does not model natural performance variation or market-level changes such as seasonality, which is why fatigue findings ship as Estimated until an experiment confirms them.
Conversion leak measurement
Conversion leaks are drop-offs in the purchase funnel: visitors who showed buying intent but did not complete a purchase. Ripplux analyzes four funnel stages: landing page visit, cart addition, checkout initiation, and completed purchase.
Each stage transition is compared against benchmarks for stores like yours. A stage losing far more visitors than comparable stores lose is flagged as a leak candidate, and the report estimates the revenue that a normal-range funnel would have kept.
What the finding rests on
Your funnel's stage-by-stage counts, compared against industry benchmarks. This is the most benchmark-dependent engine, and the report says so.
Conversion leak estimates carry the most uncertainty of any finding, because they depend on funnel tracking quality, which varies by Shopify theme and checkout configuration. Treat them as directional signals rather than precise measurements; the report labels them accordingly.
Incrementality testing
Incrementality testing is the gold standard for measuring true ad effectiveness. Rather than relying on attribution models (which are influenced by the platform reporting them), incrementality tests use randomized holdout groups to measure cause and effect: a portion of your audience is withheld from an ad, and the sales difference between the two groups is the ad's real contribution.
Designing one of these well is mostly about sizing. Too small a holdout, or too short a test, and the result is noise. Ripplux sizes each experiment from your store's actual conversion volume: the holdout share (between 5% and 20% of the campaign's audience) and the duration (up to 90 days, with platform minimums) are both chosen so the test can produce a statistically meaningful answer for your store, not a generic one.
When the test ends, Ripplux applies a standard statistical significance test to the two groups. A result only earns the Tested badge when the difference is statistically significant and the holdout group has seen enough conversions to rule out luck. If the bar is not met, the result is reported as Inconclusive, not dressed up as certainty.
What the finding rests on
A randomized experiment on your own audience: the same methodology enterprise incrementality platforms are built around, sized to your store's volume.
Confidence levels & limitations
Every finding in a Ripplux audit is assigned a confidence level that reflects how the result was derived:
Estimated
Derived from analysis of your synced data (journey analysis, creative performance trajectories, funnel drop-offs). No controlled experiment was run. These numbers are directionally correct but carry uncertainty.
Tested
A conclusive incrementality experiment confirmed the finding: the measured difference was statistically significant with enough conversions behind it to rule out luck. The true ROAS and incremental lift figures come from randomized data.
Inconclusive
An experiment was run but did not reach statistical significance. The audit report remains at Estimated confidence. Ripplux will suggest a revised holdout share or duration for a follow-up test.
Known limitations
- Cannibalization estimates are lower bounds. Prospective cannibalization is not modeled.
- Creative fatigue analysis requires 30 days of daily data per creative; new creatives will have limited data.
- Conversion leak accuracy depends on the quality of Shopify funnel tracking in your specific theme.
- Incrementality tests require a minimum monthly ad spend of $5,000 and at least 50 conversions per 30 days to be eligible.
- Attribution overlap between Meta and Google is estimated using campaign budget ratios, not user-level deduplication.
- All monetary estimates use USD. Currency conversion for non-USD stores uses the rate at the time of data sync.
See it applied to your store
Ripplux is live on the Shopify App Store. Install free and run this methodology on your own orders, no charge for 14 days.
Start your free auditFounding cohort open: Pro at $99/mo, locked for life.